2020-06-27T04:23:28.138 INFO:root:teuthology version: 1.0.0-ebb68fe 2020-06-27T04:23:28.141 DEBUG:teuthology.run:Teuthology command: teuthology --name kchai-2020-06-27_03:47:06-rados-wip-kefu-testing-2020-06-26-1211-distro-basic-smithi --owner scheduled_kchai@teuthology --archive /home/teuthworker/archive/kchai-2020-06-27_03:47:06-rados-wip-kefu-testing-2020-06-26-1211-distro-basic-smithi/5182942 --lock --description rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_api_tests} --block --verbose -- /tmp/teuthology-worker.lu373n4m.tmp 2020-06-27T04:23:28.165 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-06-27T04:23:28.231 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kchai-2020-06-27_03:47:06-rados-wip-kefu-testing-2020-06-26-1211-distro-basic-smithi/5182942 branch: wip-kefu-testing-2020-06-26-1211 description: rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_api_tests} email: tchaikov@gmail.com first_in_suite: false job_id: '5182942' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: kchai-2020-06-27_03:47:06-rados-wip-kefu-testing-2020-06-26-1211-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: '8.1' overrides: admin_socket: branch: wip-kefu-testing-2020-06-26-1211 ceph: conf: client: debug ms: 1 global: ms bind msgr1: false ms bind msgr2: true ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd shutdown pgref assert: true log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 cephadm: cephadm_mode: root install: ceph: sha1: 77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-kefu-testing-2020-06-26-1211 sha1: 77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 owner: scheduled_kchai@teuthology priority: 90 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.realm.zone.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b sha1: 77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 sleep_before_teardown: 0 suite: rados suite_branch: wip-kefu-testing-2020-06-26-1211 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-06-26-1211/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 tasks: - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.22317 2020-06-27T04:23:28.232 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-06-26-1211/qa; will attempt to use it 2020-06-27T04:23:28.233 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-06-26-1211/qa/tasks 2020-06-27T04:23:28.233 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-06-27T04:23:28.235 INFO:teuthology.task.internal:Checking packages... 2020-06-27T04:23:28.259 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5' 2020-06-27T04:23:28.259 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-06-27T04:23:28.260 INFO:teuthology.packaging:ref: None 2020-06-27T04:23:28.260 INFO:teuthology.packaging:tag: None 2020-06-27T04:23:28.261 INFO:teuthology.packaging:branch: wip-kefu-testing-2020-06-26-1211 2020-06-27T04:23:28.261 INFO:teuthology.packaging:sha1: 77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 2020-06-27T04:23:28.262 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-kefu-testing-2020-06-26-1211 2020-06-27T04:23:28.452 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-2978.g77ddaecfcb0 2020-06-27T04:23:28.453 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-06-27T04:23:28.463 INFO:teuthology.task.internal:no buildpackages task found 2020-06-27T04:23:28.463 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-06-27T04:23:28.478 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-06-27T04:23:28.479 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-06-27T04:23:28.537 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:23:38.556 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:23:48.572 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:23:58.592 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:24:08.613 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:24:18.633 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:24:28.653 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:24:38.671 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:24:48.683 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:24:58.695 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:25:08.711 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-06-27T04:25:18.732 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-06-27T04:25:28.747 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-06-27T04:25:38.765 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-06-27T04:25:48.784 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-06-27T04:25:58.804 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-06-27T04:26:08.823 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-06-27T04:26:18.840 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-06-27T04:26:28.856 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-06-27T04:26:38.876 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-06-27T04:26:48.895 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:26:58.912 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:27:08.927 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:27:18.943 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:27:28.960 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:27:38.980 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:27:48.999 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:27:59.015 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:28:09.032 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:28:19.048 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:28:29.065 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:28:39.083 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:28:49.100 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:28:59.116 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:29:09.136 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-27T04:29:19.155 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_kchai@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/kchai-2020-06-27_03:47:06-rados-wip-kefu-testing-2020-06-26-1211-distro-basic-smithi/5182942'} 2020-06-27T04:29:19.181 DEBUG:teuthology.lock.ops:locked ubuntu@smithi031.front.sepia.ceph.com, ubuntu@smithi051.front.sepia.ceph.com 2020-06-27T04:29:19.249 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7604c2ed08>, signals=[15]) 2020-06-27T04:29:19.466 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of centos 8.1 2020-06-27T04:29:19.471 INFO:teuthology.provision.fog.smithi051:Scheduling deploy of centos 8.1 2020-06-27T04:29:19.801 INFO:teuthology.orchestra.console:Power off smithi031 2020-06-27T04:29:19.803 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-06-27T04:29:19.827 INFO:teuthology.orchestra.console:Power off smithi051 2020-06-27T04:29:19.828 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-06-27T04:29:19.843 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-27T04:29:19.858 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-27T04:29:23.877 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-27T04:29:23.894 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-27T04:29:27.998 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-27T04:29:28.011 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-27T04:29:28.226 INFO:teuthology.orchestra.console:Power off for smithi051 completed 2020-06-27T04:29:28.329 INFO:teuthology.orchestra.console:Power on smithi051 2020-06-27T04:29:28.329 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-06-27T04:29:28.355 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-27T04:29:32.114 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-27T04:29:32.328 INFO:teuthology.orchestra.console:Power off for smithi031 completed 2020-06-27T04:29:32.380 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-27T04:29:32.430 INFO:teuthology.orchestra.console:Power on smithi031 2020-06-27T04:29:32.431 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-06-27T04:29:32.457 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-27T04:29:36.487 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-27T04:29:36.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-27T04:29:36.703 INFO:teuthology.orchestra.console:Power on for smithi031 completed 2020-06-27T04:29:36.713 INFO:teuthology.orchestra.console:Power on for smithi051 completed 2020-06-27T04:29:36.805 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2020-06-27T04:29:36.815 INFO:teuthology.provision.fog.smithi051:Waiting for deploy to finish 2020-06-27T04:31:52.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:31:52.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:31:52.703 ERROR:teuthology.orchestra.connection:Error connecting to smithi031.front.sepia.ceph.com Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/connection.py", line 108, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 446, in connect passphrase, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 764, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 740, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 1580, in auth_publickey return self.auth_handler.wait_for_response(my_event) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/auth_handler.py", line 250, in wait_for_response raise e paramiko.ssh_exception.AuthenticationException: Authentication failed. 2020-06-27T04:32:01.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:32:10.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:32:19.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:32:28.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:32:37.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:32:59.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:33:08.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:33:17.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:33:26.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:33:27.174 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-06-27T04:33:27.176 INFO:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-06-27T04:33:42.571 INFO:teuthology.provision.fog.smithi031:Node is ready 2020-06-27T04:33:42.571 INFO:teuthology.orchestra.run.smithi031:> hostname 2020-06-27T04:33:42.591 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com 2020-06-27T04:33:42.592 INFO:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts 2020-06-27T04:33:42.650 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031 2020-06-27T04:33:42.651 INFO:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2020-06-27T04:33:42.772 INFO:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts 2020-06-27T04:33:42.807 INFO:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts 2020-06-27T04:33:42.880 INFO:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname 2020-06-27T04:33:42.953 INFO:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2020-06-27T04:33:43.024 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2020-06-27T04:33:43.025 DEBUG:teuthology.parallel:result is None 2020-06-27T04:33:43.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:33:44.226 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-06-27T04:33:44.227 INFO:teuthology.orchestra.run.smithi051:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-06-27T04:33:44.549 INFO:teuthology.provision.fog.smithi051:Node is ready 2020-06-27T04:33:44.549 INFO:teuthology.orchestra.run.smithi051:> hostname 2020-06-27T04:33:44.564 INFO:teuthology.orchestra.run.smithi051.stdout:smithi051.front.sepia.ceph.com 2020-06-27T04:33:44.565 INFO:teuthology.orchestra.run.smithi051:> grep smithi051.front.sepia.ceph.com /etc/hosts 2020-06-27T04:33:44.619 INFO:teuthology.orchestra.run.smithi051.stdout:172.21.15.51 smithi051.front.sepia.ceph.com smithi051 2020-06-27T04:33:44.620 INFO:teuthology.orchestra.run.smithi051:> sudo hostname smithi051 2020-06-27T04:33:44.757 INFO:teuthology.orchestra.run.smithi051:> sudo sed -i -e 's/smithi051.front.sepia.ceph.com/smithi051/g' /etc/hosts 2020-06-27T04:33:44.790 INFO:teuthology.orchestra.run.smithi051:> sudo sed -i -e 's/172.21.15.51/172.21.15.51/g' /etc/hosts 2020-06-27T04:33:44.862 INFO:teuthology.orchestra.run.smithi051:> sudo sed -i -e 's/smithi051.front.sepia.ceph.com/smithi051/g' /etc/hostname 2020-06-27T04:33:44.934 INFO:teuthology.orchestra.run.smithi051:> sudo hostname smithi051 2020-06-27T04:33:45.003 INFO:teuthology.provision.fog.smithi051:Deploy complete! 2020-06-27T04:33:45.004 DEBUG:teuthology.parallel:result is None 2020-06-27T04:33:45.157 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com 2020-06-27T04:33:45.158 INFO:teuthology.lock.ops:New key found. Updating... 2020-06-27T04:33:45.190 INFO:teuthology.lock.ops:Checking smithi051.front.sepia.ceph.com 2020-06-27T04:33:45.190 INFO:teuthology.lock.ops:New key found. Updating... 2020-06-27T04:33:45.213 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server 2020-06-27T04:33:45.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-27T04:33:45.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:33:45.287 INFO:teuthology.orchestra.run.smithi031:> true 2020-06-27T04:33:45.380 INFO:teuthology.orchestra.run.smithi031:> uname -m 2020-06-27T04:33:45.440 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2020-06-27T04:33:45.441 INFO:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2020-06-27T04:33:45.497 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Linux" 2020-06-27T04:33:45.497 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8 (Core)" 2020-06-27T04:33:45.498 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2020-06-27T04:33:45.498 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2020-06-27T04:33:45.498 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8" 2020-06-27T04:33:45.498 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2020-06-27T04:33:45.499 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-06-27T04:33:45.499 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2020-06-27T04:33:45.499 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-06-27T04:33:45.499 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.centos.org/" 2020-06-27T04:33:45.499 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-06-27T04:33:45.500 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:33:45.500 INFO:teuthology.orchestra.run.smithi031.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-06-27T04:33:45.500 INFO:teuthology.orchestra.run.smithi031.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-06-27T04:33:45.500 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-06-27T04:33:45.500 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-06-27T04:33:45.500 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:33:45.502 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2020-06-27T04:33:45.521 INFO:teuthology.lock.ops:Updating [smithi051.front.sepia.ceph.com]: set os type and version on server 2020-06-27T04:33:45.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-27T04:33:45.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:33:45.593 INFO:teuthology.orchestra.run.smithi051:> true 2020-06-27T04:33:45.679 INFO:teuthology.orchestra.run.smithi051:> uname -m 2020-06-27T04:33:45.735 INFO:teuthology.orchestra.run.smithi051.stdout:x86_64 2020-06-27T04:33:45.735 INFO:teuthology.orchestra.run.smithi051:> cat /etc/os-release 2020-06-27T04:33:45.791 INFO:teuthology.orchestra.run.smithi051.stdout:NAME="CentOS Linux" 2020-06-27T04:33:45.791 INFO:teuthology.orchestra.run.smithi051.stdout:VERSION="8 (Core)" 2020-06-27T04:33:45.791 INFO:teuthology.orchestra.run.smithi051.stdout:ID="centos" 2020-06-27T04:33:45.791 INFO:teuthology.orchestra.run.smithi051.stdout:ID_LIKE="rhel fedora" 2020-06-27T04:33:45.792 INFO:teuthology.orchestra.run.smithi051.stdout:VERSION_ID="8" 2020-06-27T04:33:45.792 INFO:teuthology.orchestra.run.smithi051.stdout:PLATFORM_ID="platform:el8" 2020-06-27T04:33:45.792 INFO:teuthology.orchestra.run.smithi051.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-06-27T04:33:45.792 INFO:teuthology.orchestra.run.smithi051.stdout:ANSI_COLOR="0;31" 2020-06-27T04:33:45.792 INFO:teuthology.orchestra.run.smithi051.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-06-27T04:33:45.793 INFO:teuthology.orchestra.run.smithi051.stdout:HOME_URL="https://www.centos.org/" 2020-06-27T04:33:45.793 INFO:teuthology.orchestra.run.smithi051.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-06-27T04:33:45.793 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:33:45.793 INFO:teuthology.orchestra.run.smithi051.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-06-27T04:33:45.793 INFO:teuthology.orchestra.run.smithi051.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-06-27T04:33:45.794 INFO:teuthology.orchestra.run.smithi051.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-06-27T04:33:45.794 INFO:teuthology.orchestra.run.smithi051.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-06-27T04:33:45.794 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:33:45.795 INFO:teuthology.lock.ops:Updating smithi051.front.sepia.ceph.com on lock server 2020-06-27T04:33:45.814 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-06-27T04:33:45.843 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi031.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD6IZvCbfZplr4Fgn84xDUx+b7aDpgsngUg+9HC8zlsig6jhKhrj68wUZNmhggnBh0R8/IlqBUZIphnkI4z5yDcg8Nf5JhEm+cXN8TuXz8LA7KFeqW5vxjQzY72Fv6dp+3fhbk0qmWSCqfbzr/zQt6/lcwBE1w8zDwEtBGt1H7djgUMDEtUgYx74RCRe8x6V4Kp+pVEoViwY2AHf3OzRa4vZ/QxcTrPOc3MsL85dC570S2zf14bIa107jDPtfYp8cKQMHFfPnxtNCXP/TLM/oE0Sul/CSGC/s/DtM9FN9gjHc1Ll5NiI0UsKbcdtafvqvG7wmYYEqXv0C4yQVsWD8a5K3cMDa0eAAZFLHxqMDbAKopS2y7RfdgQNlccJtO4u2ZDaTCHtMuXlgNJbWoeWiK8wFEiUEB+AmCR/piYx9XOC0UgF/IdGr3HDlD/VY0yt8t6EoXhEFO6Kbz0aBcm3yrKMNFtCuAYW+3+ZlgIJMMnk6Qm7DuqwY+QGZbxQDAw6/8= smithi051.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEvVrAOFD6VgVQ6L9ZBYl1aVYVspjzwxWgC4rRbmS6ZTdePjutbJvBXR2NSFRu+JaMSx3M2wmOEjQrOez98XQ2zHu9tDaXGABOn/GqLyb924RoPeT6aNGSHMs3sM8J2I3cio92Yprc/3XqN0sYd07xleUgP9xFt4JztYZLdnvow6ZXM4S8v6EkLUEOr6gt7jv/GAtYnTFRkGK2oeMryuvxwp5PwkiXaMAPWTC72pmkovMzJt8f1y7osSEMToXPV9dXAw9BnkPr9vdX62rRzkO/P3yOqODXX40qRGF3iUYwfFUOeYczPaMEpeEWmN7SGrlrkMDD3rfcowxXAZEdcnEyp6FeaEQx24ft4AbpAhzIO+30M+IOt3vaZn6JLlx1XsYXAcNDxf2NJ7b+NiEqF1BGw1DG7hh+IUo1rxx+ptTEOv+B8PVquuBsWKduw9rCU3EQpwqK0GgQIH8G4W4ySkeGdGbU4OV201Uv+MlZwcAxtbz5Z/950/qU8+2S6RD+9j8= 2020-06-27T04:33:45.844 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-06-27T04:33:45.893 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-06-27T04:33:45.906 INFO:teuthology.task.internal:Saving configuration 2020-06-27T04:33:45.917 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-06-27T04:33:45.928 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-06-27T04:33:45.943 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-06-27 04:29:19.163690', 'description': '/home/teuthworker/archive/kchai-2020-06-27_03:47:06-rados-wip-kefu-testing-2020-06-26-1211-distro-basic-smithi/5182942', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLLei6bejCn34pdaiLhB8pcyeANy+AzYza1Mz40jhi7u61S0F6fNhZYKNOuDYwd+bwPKZxBt3EpKgD+iXyjvkJs=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi031.front.sepia.ceph.com'} 2020-06-27T04:33:45.957 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-06-27 04:29:19.163711', 'description': '/home/teuthworker/archive/kchai-2020-06-27_03:47:06-rados-wip-kefu-testing-2020-06-26-1211-distro-basic-smithi/5182942', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDcXIsAO1z/BgJ5/8V45YEV4W9Ajobj6ULt38nAcnIxuidz2RO6q9tjQ48qwuz7pO+r3KHSptDXERMhmiWohLNY=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi051.front.sepia.ceph.com'} 2020-06-27T04:33:45.958 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-06-27T04:33:45.968 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.realm.zone.a', 'node-exporter.a', 'alertmanager.a'] 2020-06-27T04:33:45.969 INFO:teuthology.task.internal:roles: ubuntu@smithi051.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2020-06-27T04:33:45.969 INFO:teuthology.run_tasks:Running task console_log... 2020-06-27T04:33:46.046 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7604559ae8>, signals=[15]) 2020-06-27T04:33:46.047 INFO:teuthology.run_tasks:Running task internal.connect... 2020-06-27T04:33:46.058 INFO:teuthology.task.internal:Opening connections... 2020-06-27T04:33:46.059 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2020-06-27T04:33:46.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:33:46.139 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi051.front.sepia.ceph.com 2020-06-27T04:33:46.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:33:46.216 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-06-27T04:33:46.225 INFO:teuthology.orchestra.run.smithi031:> uname -m 2020-06-27T04:33:46.245 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2020-06-27T04:33:46.245 INFO:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2020-06-27T04:33:46.300 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Linux" 2020-06-27T04:33:46.301 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8 (Core)" 2020-06-27T04:33:46.301 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2020-06-27T04:33:46.301 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2020-06-27T04:33:46.301 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8" 2020-06-27T04:33:46.302 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2020-06-27T04:33:46.302 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-06-27T04:33:46.302 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2020-06-27T04:33:46.302 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-06-27T04:33:46.302 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.centos.org/" 2020-06-27T04:33:46.303 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-06-27T04:33:46.303 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:33:46.303 INFO:teuthology.orchestra.run.smithi031.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-06-27T04:33:46.303 INFO:teuthology.orchestra.run.smithi031.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-06-27T04:33:46.303 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-06-27T04:33:46.304 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-06-27T04:33:46.304 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:33:46.304 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2020-06-27T04:33:46.329 INFO:teuthology.orchestra.run.smithi051:> uname -m 2020-06-27T04:33:46.348 INFO:teuthology.orchestra.run.smithi051.stdout:x86_64 2020-06-27T04:33:46.349 INFO:teuthology.orchestra.run.smithi051:> cat /etc/os-release 2020-06-27T04:33:46.406 INFO:teuthology.orchestra.run.smithi051.stdout:NAME="CentOS Linux" 2020-06-27T04:33:46.406 INFO:teuthology.orchestra.run.smithi051.stdout:VERSION="8 (Core)" 2020-06-27T04:33:46.406 INFO:teuthology.orchestra.run.smithi051.stdout:ID="centos" 2020-06-27T04:33:46.406 INFO:teuthology.orchestra.run.smithi051.stdout:ID_LIKE="rhel fedora" 2020-06-27T04:33:46.407 INFO:teuthology.orchestra.run.smithi051.stdout:VERSION_ID="8" 2020-06-27T04:33:46.407 INFO:teuthology.orchestra.run.smithi051.stdout:PLATFORM_ID="platform:el8" 2020-06-27T04:33:46.407 INFO:teuthology.orchestra.run.smithi051.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-06-27T04:33:46.407 INFO:teuthology.orchestra.run.smithi051.stdout:ANSI_COLOR="0;31" 2020-06-27T04:33:46.407 INFO:teuthology.orchestra.run.smithi051.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-06-27T04:33:46.408 INFO:teuthology.orchestra.run.smithi051.stdout:HOME_URL="https://www.centos.org/" 2020-06-27T04:33:46.408 INFO:teuthology.orchestra.run.smithi051.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-06-27T04:33:46.408 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:33:46.408 INFO:teuthology.orchestra.run.smithi051.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-06-27T04:33:46.408 INFO:teuthology.orchestra.run.smithi051.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-06-27T04:33:46.409 INFO:teuthology.orchestra.run.smithi051.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-06-27T04:33:46.409 INFO:teuthology.orchestra.run.smithi051.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-06-27T04:33:46.409 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:33:46.409 INFO:teuthology.lock.ops:Updating smithi051.front.sepia.ceph.com on lock server 2020-06-27T04:33:46.431 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-06-27T04:33:46.457 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-06-27T04:33:46.492 INFO:teuthology.task.internal:Checking for old test directory... 2020-06-27T04:33:46.492 INFO:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2020-06-27T04:33:46.495 INFO:teuthology.orchestra.run.smithi051:> test '!' -e /home/ubuntu/cephtest 2020-06-27T04:33:46.512 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-06-27T04:33:46.522 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-06-27T04:33:46.523 INFO:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2020-06-27T04:33:46.558 INFO:teuthology.orchestra.run.smithi051:> test -z $(ls -A /var/lib/ceph) 2020-06-27T04:33:46.593 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-06-27T04:33:46.638 INFO:teuthology.run_tasks:Running task kernel... 2020-06-27T04:33:46.667 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'ceph.rgw.realm.zone.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'alertmanager.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'grafana.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}} 2020-06-27T04:33:46.668 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-06-27T04:33:46.668 INFO:teuthology.orchestra.run.smithi031:> uname -r 2020-06-27T04:33:46.686 INFO:teuthology.orchestra.run.smithi031.stdout:4.18.0-193.6.3.el8_2.x86_64 2020-06-27T04:33:46.686 INFO:teuthology.task.kernel:Running kernel on smithi031: 4.18.0-193.6.3.el8_2.x86_64 2020-06-27T04:33:46.687 INFO:teuthology.orchestra.run.smithi031:> sudo yum install -y kernel 2020-06-27T04:33:49.705 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-8 - AppStream 35 MB/s | 7.0 MB 00:00 2020-06-27T04:33:50.956 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-8 - Base 26 MB/s | 2.2 MB 00:00 2020-06-27T04:33:51.403 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-8 - Extras 87 kB/s | 5.5 kB 00:00 2020-06-27T04:33:51.559 INFO:teuthology.orchestra.run.smithi031.stdout:Copr repo for ceph-el8 owned by ktdreyer 2.4 kB/s | 257 B 00:00 2020-06-27T04:33:52.184 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 12 MB/s | 7.1 MB 00:00 2020-06-27T04:33:53.725 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 3.7 MB/s | 20 kB 00:00 2020-06-27T04:33:54.704 INFO:teuthology.orchestra.run.smithi031.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-06-27T04:33:54.705 INFO:teuthology.orchestra.run.smithi031.stdout:Package kernel-4.18.0-193.6.3.el8_2.x86_64 is already installed. 2020-06-27T04:33:54.862 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:33:54.864 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2020-06-27T04:33:54.864 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:33:55.005 INFO:teuthology.orchestra.run.smithi031:> echo no | sudo yum reinstall kernel || true 2020-06-27T04:33:55.481 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:02 ago on Sat 27 Jun 2020 04:33:53 AM UTC. 2020-06-27T04:33:55.894 INFO:teuthology.orchestra.run.smithi031.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-06-27T04:33:55.895 INFO:teuthology.orchestra.run.smithi031.stdout:Installed package kernel-4.18.0-193.6.3.el8_2.x86_64 (from BaseOS) not available. 2020-06-27T04:33:55.949 INFO:teuthology.orchestra.run.smithi031.stderr:Error: No packages marked for reinstall. 2020-06-27T04:33:56.003 INFO:teuthology.orchestra.run.smithi031:> sudo yum reinstall -y kernel || true 2020-06-27T04:33:56.429 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:03 ago on Sat 27 Jun 2020 04:33:53 AM UTC. 2020-06-27T04:33:56.685 INFO:teuthology.orchestra.run.smithi031.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-06-27T04:33:56.686 INFO:teuthology.orchestra.run.smithi031.stdout:Installed package kernel-4.18.0-193.6.3.el8_2.x86_64 (from BaseOS) not available. 2020-06-27T04:33:56.746 INFO:teuthology.orchestra.run.smithi031.stderr:Error: No packages marked for reinstall. 2020-06-27T04:33:56.793 INFO:teuthology.orchestra.run.smithi031:> rpm -q kernel --last | head -n 1 2020-06-27T04:33:56.871 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-4.18.0-193.6.3.el8_2.x86_64 Sun 21 Jun 2020 12:15:58 PM UTC 2020-06-27T04:33:56.873 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.6.3.el8_2.x86_64 2020-06-27T04:33:56.873 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-06-27T04:33:56.874 INFO:teuthology.orchestra.run.smithi051:> uname -r 2020-06-27T04:33:56.891 INFO:teuthology.orchestra.run.smithi051.stdout:4.18.0-193.6.3.el8_2.x86_64 2020-06-27T04:33:56.891 INFO:teuthology.task.kernel:Running kernel on smithi051: 4.18.0-193.6.3.el8_2.x86_64 2020-06-27T04:33:56.892 INFO:teuthology.orchestra.run.smithi051:> sudo yum install -y kernel 2020-06-27T04:33:59.550 INFO:teuthology.orchestra.run.smithi051.stdout:CentOS-8 - AppStream 36 MB/s | 7.0 MB 00:00 2020-06-27T04:34:00.820 INFO:teuthology.orchestra.run.smithi051.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-06-27T04:34:01.270 INFO:teuthology.orchestra.run.smithi051.stdout:CentOS-8 - Extras 85 kB/s | 5.5 kB 00:00 2020-06-27T04:34:01.422 INFO:teuthology.orchestra.run.smithi051.stdout:Copr repo for ceph-el8 owned by ktdreyer 2.9 kB/s | 257 B 00:00 2020-06-27T04:34:02.027 INFO:teuthology.orchestra.run.smithi051.stdout:Extra Packages for Enterprise Linux 13 MB/s | 7.1 MB 00:00 2020-06-27T04:34:03.597 INFO:teuthology.orchestra.run.smithi051.stdout:lab-extras 4.1 MB/s | 20 kB 00:00 2020-06-27T04:34:04.592 INFO:teuthology.orchestra.run.smithi051.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-06-27T04:34:04.592 INFO:teuthology.orchestra.run.smithi051.stdout:Package kernel-4.18.0-193.6.3.el8_2.x86_64 is already installed. 2020-06-27T04:34:04.743 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:34:04.744 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2020-06-27T04:34:04.744 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:34:04.884 INFO:teuthology.orchestra.run.smithi051:> echo no | sudo yum reinstall kernel || true 2020-06-27T04:34:05.313 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:00:02 ago on Sat 27 Jun 2020 04:34:03 AM UTC. 2020-06-27T04:34:05.572 INFO:teuthology.orchestra.run.smithi051.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-06-27T04:34:05.572 INFO:teuthology.orchestra.run.smithi051.stdout:Installed package kernel-4.18.0-193.6.3.el8_2.x86_64 (from BaseOS) not available. 2020-06-27T04:34:05.623 INFO:teuthology.orchestra.run.smithi051.stderr:Error: No packages marked for reinstall. 2020-06-27T04:34:05.669 INFO:teuthology.orchestra.run.smithi051:> sudo yum reinstall -y kernel || true 2020-06-27T04:34:06.097 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:00:03 ago on Sat 27 Jun 2020 04:34:03 AM UTC. 2020-06-27T04:34:06.363 INFO:teuthology.orchestra.run.smithi051.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-06-27T04:34:06.363 INFO:teuthology.orchestra.run.smithi051.stdout:Installed package kernel-4.18.0-193.6.3.el8_2.x86_64 (from BaseOS) not available. 2020-06-27T04:34:06.395 INFO:teuthology.orchestra.run.smithi051.stderr:Error: No packages marked for reinstall. 2020-06-27T04:34:06.440 INFO:teuthology.orchestra.run.smithi051:> rpm -q kernel --last | head -n 1 2020-06-27T04:34:06.525 INFO:teuthology.orchestra.run.smithi051.stdout:kernel-4.18.0-193.6.3.el8_2.x86_64 Sun 21 Jun 2020 12:15:58 PM UTC 2020-06-27T04:34:06.527 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.6.3.el8_2.x86_64 2020-06-27T04:34:06.527 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-06-27T04:34:06.527 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-06-27T04:34:06.528 INFO:teuthology.orchestra.run.smithi031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-06-27T04:34:06.570 INFO:teuthology.orchestra.run.smithi031.stdout:ttyS1 2020-06-27T04:34:06.588 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-06-27T04:34:06.589 INFO:teuthology.orchestra.run.smithi051:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-06-27T04:34:06.633 INFO:teuthology.orchestra.run.smithi051.stdout:ttyS1 2020-06-27T04:34:06.647 INFO:teuthology.run_tasks:Running task internal.base... 2020-06-27T04:34:06.656 INFO:teuthology.task.internal:Creating test directory... 2020-06-27T04:34:06.656 INFO:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-06-27T04:34:06.662 INFO:teuthology.orchestra.run.smithi051:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-06-27T04:34:06.702 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-06-27T04:34:06.709 INFO:teuthology.run_tasks:Running task internal.archive... 2020-06-27T04:34:06.724 INFO:teuthology.task.internal:Creating archive directory... 2020-06-27T04:34:06.725 INFO:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-06-27T04:34:06.728 INFO:teuthology.orchestra.run.smithi051:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-06-27T04:34:06.763 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-06-27T04:34:06.772 INFO:teuthology.task.internal:Enabling coredump saving... 2020-06-27T04:34:06.773 INFO:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-06-27T04:34:06.796 INFO:teuthology.orchestra.run.smithi051:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-06-27T04:34:06.835 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-06-27T04:34:06.842 INFO:teuthology.orchestra.run.smithi051.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-06-27T04:34:06.853 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-06-27T04:34:06.859 INFO:teuthology.orchestra.run.smithi051.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-06-27T04:34:06.860 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-06-27T04:34:06.868 INFO:teuthology.task.internal:Configuring sudo... 2020-06-27T04:34:06.869 INFO:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-06-27T04:34:06.906 INFO:teuthology.orchestra.run.smithi051:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-06-27T04:34:06.938 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-06-27T04:34:06.955 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-06-27T04:34:06.956 INFO:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-06-27T04:34:06.977 INFO:teuthology.orchestra.run.smithi051:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-06-27T04:34:06.992 INFO:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-06-27T04:34:07.068 INFO:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-06-27T04:34:07.143 INFO:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-06-27T04:34:07.185 INFO:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-06-27T04:34:07.234 INFO:teuthology.orchestra.run.smithi031:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-06-27T04:34:07.319 INFO:teuthology.orchestra.run.smithi051:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-06-27T04:34:07.353 INFO:teuthology.orchestra.run.smithi051:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-06-27T04:34:07.419 INFO:teuthology.orchestra.run.smithi051:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-06-27T04:34:07.496 INFO:teuthology.orchestra.run.smithi051:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-06-27T04:34:07.548 INFO:teuthology.orchestra.run.smithi051:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-06-27T04:34:07.633 INFO:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2020-06-27T04:34:07.636 INFO:teuthology.orchestra.run.smithi051:> sudo service rsyslog restart 2020-06-27T04:34:07.693 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-06-27T04:34:07.732 INFO:teuthology.orchestra.run.smithi051.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-06-27T04:34:07.987 INFO:teuthology.run_tasks:Running task internal.timer... 2020-06-27T04:34:07.998 INFO:teuthology.task.internal:Starting timer... 2020-06-27T04:34:07.998 INFO:teuthology.run_tasks:Running task pcp... 2020-06-27T04:34:08.029 INFO:teuthology.run_tasks:Running task selinux... 2020-06-27T04:34:08.052 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-06-27T04:34:08.053 INFO:teuthology.orchestra.run.smithi031:> sudo service auditd rotate 2020-06-27T04:34:08.129 INFO:teuthology.orchestra.run.smithi031.stdout:Rotating logs: [ OK ] 2020-06-27T04:34:08.131 INFO:teuthology.orchestra.run.smithi051:> sudo service auditd rotate 2020-06-27T04:34:08.196 INFO:teuthology.orchestra.run.smithi051.stdout:Rotating logs: [ OK ] 2020-06-27T04:34:08.206 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-06-27T04:34:08.207 INFO:teuthology.orchestra.run.smithi031:> /usr/sbin/getenforce 2020-06-27T04:34:08.236 INFO:teuthology.orchestra.run.smithi031.stdout:Permissive 2020-06-27T04:34:08.237 INFO:teuthology.orchestra.run.smithi051:> /usr/sbin/getenforce 2020-06-27T04:34:08.257 INFO:teuthology.orchestra.run.smithi051.stdout:Permissive 2020-06-27T04:34:08.257 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi031.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi051.front.sepia.ceph.com': 'permissive'} 2020-06-27T04:34:08.258 INFO:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-06-27T04:34:08.310 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-27T04:34:08.311 INFO:teuthology.orchestra.run.smithi051:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-06-27T04:34:08.343 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-27T04:34:08.343 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-06-27T04:34:08.344 INFO:teuthology.orchestra.run.smithi031:> sudo /usr/sbin/setenforce permissive 2020-06-27T04:34:08.384 INFO:teuthology.orchestra.run.smithi051:> sudo /usr/sbin/setenforce permissive 2020-06-27T04:34:08.416 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-06-27T04:34:08.430 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-06-27T04:34:08.431 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-06-27T04:34:08.450 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-06-27T04:34:08.453 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi031.front.sepia.ceph.com,smithi051.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-06-27T04:34:08.844 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-06-27T04:34:09.861 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-06-27T04:34:12.214 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-06-27T04:34:12.236 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:12 +0000 (0:00:00.079) 0:00:00.079 ********* 2020-06-27T04:34:12.253 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:12 +0000 (0:00:00.016) 0:00:00.096 ********* 2020-06-27T04:34:13.880 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi031.front.sepia.ceph.com] 2020-06-27T04:34:13.894 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] 2020-06-27T04:34:14.018 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:14 +0000 (0:00:01.764) 0:00:01.861 ********* 2020-06-27T04:34:14.052 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:14 +0000 (0:00:00.033) 0:00:01.895 ********* 2020-06-27T04:34:14.497 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-06-27T04:34:14.499 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-06-27T04:34:14.530 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:14 +0000 (0:00:00.478) 0:00:02.373 ********* 2020-06-27T04:34:14.539 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-06-27T04:34:14.575 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:14 +0000 (0:00:00.044) 0:00:02.418 ********* 2020-06-27T04:34:15.110 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi031.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-06-27T04:34:15.151 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:15 +0000 (0:00:00.576) 0:00:02.994 ********* 2020-06-27T04:34:15.161 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-06-27T04:34:15.197 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:15 +0000 (0:00:00.045) 0:00:03.040 ********* 2020-06-27T04:34:15.205 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-06-27T04:34:15.207 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:15.349 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:15 +0000 (0:00:00.152) 0:00:03.192 ********* 2020-06-27T04:34:15.362 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:15.398 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:15 +0000 (0:00:00.048) 0:00:03.241 ********* 2020-06-27T04:34:15.714 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-27T04:34:15.753 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:15 +0000 (0:00:00.354) 0:00:03.596 ********* 2020-06-27T04:34:15.755 INFO:teuthology.task.ansible.out: 2020-06-27T04:34:15.768 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-27T04:34:15.802 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:15 +0000 (0:00:00.048) 0:00:03.645 ********* 2020-06-27T04:34:16.701 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-06-27T04:34:16.703 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1593232455.820841-255483712928643/source", "state": "file", "uid": 0} changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1593232455.7731562-206709235332942/source", "state": "file", "uid": 0} 2020-06-27T04:34:16.736 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:16 +0000 (0:00:00.933) 0:00:04.579 ********* 2020-06-27T04:34:16.738 INFO:teuthology.task.ansible.out: 2020-06-27T04:34:16.778 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:16 +0000 (0:00:00.042) 0:00:04.621 ********* 2020-06-27T04:34:17.187 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-06-27T04:34:17.189 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-06-27T04:34:17.190 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-06-27T04:34:17.254 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-06-27T04:34:17.256 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-06-27T04:34:17.378 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** 2020-06-27T04:34:17.381 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-06-27T04:34:17.393 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-06-27T04:34:17.555 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:17 +0000 (0:00:00.776) 0:00:05.397 ********* 2020-06-27T04:34:17.588 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:17 +0000 (0:00:00.033) 0:00:05.431 ********* 2020-06-27T04:34:18.250 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi031.front.sepia.ceph.com] 2020-06-27T04:34:18.308 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] 2020-06-27T04:34:18.366 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-06-27T04:34:18.367 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:18 +0000 (0:00:00.777) 0:00:06.209 ********* 2020-06-27T04:34:18.447 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:18 +0000 (0:00:00.081) 0:00:06.290 ********* 2020-06-27T04:34:18.930 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-06-27T04:34:18.932 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.191307", "end": "2020-06-27 04:34:18.898378", "rc": 0, "start": "2020-06-27 04:34:18.707071", "stderr": "", "stderr_lines": [], "stdout": "1fb75ffefa35e7aa6244774f8a516bcfc9e1ef11", "stdout_lines": ["1fb75ffefa35e7aa6244774f8a516bcfc9e1ef11"]} 2020-06-27T04:34:18.973 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:18 +0000 (0:00:00.525) 0:00:06.816 ********* 2020-06-27T04:34:18.983 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.182914", "end": "2020-06-27 04:34:18.925722", "rc": 0, "start": "2020-06-27 04:34:18.742808", "stderr": "", "stderr_lines": [], "stdout": "1fb75ffefa35e7aa6244774f8a516bcfc9e1ef11", "stdout_lines": ["1fb75ffefa35e7aa6244774f8a516bcfc9e1ef11"]} 2020-06-27T04:34:19.028 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:19 +0000 (0:00:00.054) 0:00:06.870 ********* 2020-06-27T04:34:19.204 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.009294", "end": "2020-06-27 04:34:19.178501", "failed_when_result": false, "rc": 0, "start": "2020-06-27 04:34:19.169207", "stderr": "", "stderr_lines": [], "stdout": "1fb75ffefa35e7aa6244774f8a516bcfc9e1ef11", "stdout_lines": ["1fb75ffefa35e7aa6244774f8a516bcfc9e1ef11"]} 2020-06-27T04:34:19.241 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:19 +0000 (0:00:00.213) 0:00:07.084 ********* 2020-06-27T04:34:19.272 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.009032", "end": "2020-06-27 04:34:19.246706", "failed_when_result": false, "rc": 0, "start": "2020-06-27 04:34:19.237674", "stderr": "", "stderr_lines": [], "stdout": "1fb75ffefa35e7aa6244774f8a516bcfc9e1ef11", "stdout_lines": ["1fb75ffefa35e7aa6244774f8a516bcfc9e1ef11"]} 2020-06-27T04:34:19.274 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-06-27T04:34:19.306 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:19 +0000 (0:00:00.065) 0:00:07.149 ********* 2020-06-27T04:34:19.342 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:19 +0000 (0:00:00.035) 0:00:07.185 ********* 2020-06-27T04:34:19.351 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-06-27T04:34:19.353 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.396 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:19 +0000 (0:00:00.053) 0:00:07.238 ********* 2020-06-27T04:34:19.408 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-06-27T04:34:19.410 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-06-27T04:34:19.444 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:19 +0000 (0:00:00.048) 0:00:07.287 ********* 2020-06-27T04:34:19.454 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-06-27T04:34:19.456 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.493 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:19 +0000 (0:00:00.049) 0:00:07.336 ********* 2020-06-27T04:34:19.504 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-06-27T04:34:19.507 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.542 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:19 +0000 (0:00:00.048) 0:00:07.385 ********* 2020-06-27T04:34:19.551 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-06-27T04:34:19.552 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.589 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:19 +0000 (0:00:00.047) 0:00:07.432 ********* 2020-06-27T04:34:19.598 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-06-27T04:34:19.600 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.635 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:19 +0000 (0:00:00.046) 0:00:07.478 ********* 2020-06-27T04:34:19.644 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-06-27T04:34:19.646 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.690 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:19 +0000 (0:00:00.046) 0:00:07.525 ********* 2020-06-27T04:34:19.693 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.731 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:19 +0000 (0:00:00.049) 0:00:07.574 ********* 2020-06-27T04:34:19.741 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-06-27T04:34:19.743 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.783 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:19 +0000 (0:00:00.047) 0:00:07.622 ********* 2020-06-27T04:34:19.792 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-06-27T04:34:19.794 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.830 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:19 +0000 (0:00:00.050) 0:00:07.673 ********* 2020-06-27T04:34:19.840 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-06-27T04:34:19.842 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.852 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.853 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.863 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.865 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.902 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:19 +0000 (0:00:00.072) 0:00:07.745 ********* 2020-06-27T04:34:19.913 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.914 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.916 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.917 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.919 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIw 2020-06-27T04:34:19.921 INFO:teuthology.task.ansible.out:AAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d6932535 2020-06-27T04:34:19.922 INFO:teuthology.task.ansible.out:11d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.933 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.946 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.958 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.959 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mb 2020-06-27T04:34:19.961 INFO:teuthology.task.ansible.out:a.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.970 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.972 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.982 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.984 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2i 2020-06-27T04:34:19.986 INFO:teuthology.task.ansible.out:ihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:19.996 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.007 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.008 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.019 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.021 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281a 2020-06-27T04:34:20.022 INFO:teuthology.task.ansible.out:o7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd 2020-06-27T04:34:20.024 INFO:teuthology.task.ansible.out:1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.033 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.035 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34a 2020-06-27T04:34:20.036 INFO:teuthology.task.ansible.out:e98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.046 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.048 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.063 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.065 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.076 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.077 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\n 2020-06-27T04:34:20.079 INFO:teuthology.task.ansible.out:dzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.081 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.082 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.093 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Con 2020-06-27T04:34:20.095 INFO:teuthology.task.ansible.out:ditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.108 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.110 INFO:teuthology.task.ansible.out: 2020-06-27T04:34:20.113 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.114 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.116 INFO:teuthology.task.ansible.out: skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.118 INFO:teuthology.task.ansible.out: 2020-06-27T04:34:20.118 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.118 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.121 INFO:teuthology.task.ansible.out: 2020-06-27T04:34:20.122 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.125 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.127 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.159 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.162 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.163 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 2020-06-27T04:34:20.166 INFO:teuthology.task.ansible.out: 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.175 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.177 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.178 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.180 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.182 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.183 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.198 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.200 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.201 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs 2020-06-27T04:34:20.202 INFO:teuthology.task.ansible.out:1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.204 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2020-06-27T04:34:20.206 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.215 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.217 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.228 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.230 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.241 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.243 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.243 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.254 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.256 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.266 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.268 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.268 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.270 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.288 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.296 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.298 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.308 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.310 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.312 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.313 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi 2020-06-27T04:34:20.315 INFO:teuthology.task.ansible.out:8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.323 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.325 INFO:teuthology.task.ansible.out: skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.327 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.330 INFO:teuthology.task.ansible.out: 2020-06-27T04:34:20.330 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.341 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.343 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.354 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.357 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos 2020-06-27T04:34:20.359 INFO:teuthology.task.ansible.out:TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.367 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.369 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.371 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.381 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.383 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.393 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.406 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.408 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.418 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.420 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.420 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.421 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.421 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.424 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name 2020-06-27T04:34:20.426 INFO:teuthology.task.ansible.out:": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.433 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.434 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.444 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.446 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.448 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.448 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.459 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.460 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.461 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.461 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.472 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.474 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.475 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.475 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.486 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.488 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.498 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.500 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.501 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.512 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.528 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.530 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.530 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.531 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scar 2020-06-27T04:34:20.532 INFO:teuthology.task.ansible.out:valhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.571 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:20 +0000 (0:00:00.668) 0:00:08.414 ********* 2020-06-27T04:34:20.582 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.584 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.585 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.585 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.586 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn 2020-06-27T04:34:20.587 INFO:teuthology.task.ansible.out:": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.604 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.606 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} TASK [users : Create all users without sudo access.] *************************** TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.607 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.652 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:20 +0000 (0:00:00.081) 0:00:08.495 ********* 2020-06-27T04:34:20.661 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.663 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.664 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.664 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.666 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.666 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.681 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-06-27T04:34:20.683 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.720 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:20 +0000 (0:00:00.067) 0:00:08.563 ********* 2020-06-27T04:34:20.755 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:20 +0000 (0:00:00.034) 0:00:08.598 ********* 2020-06-27T04:34:20.766 INFO:teuthology.task.ansible.out: 2020-06-27T04:34:20.768 INFO:teuthology.task.ansible.out:TASK [users : Clone the keys repo] ********************************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.810 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:20 +0000 (0:00:00.054) 0:00:08.653 ********* 2020-06-27T04:34:20.819 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-06-27T04:34:20.860 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:20 +0000 (0:00:00.050) 0:00:08.703 ********* 2020-06-27T04:34:20.870 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-06-27T04:34:20.872 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.907 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:20 +0000 (0:00:00.046) 0:00:08.750 ********* 2020-06-27T04:34:20.916 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-06-27T04:34:20.918 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:20.959 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:20 +0000 (0:00:00.052) 0:00:08.802 ********* 2020-06-27T04:34:20.968 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-27T04:34:20.970 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.004 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:21 +0000 (0:00:00.045) 0:00:08.847 ********* 2020-06-27T04:34:21.016 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-06-27T04:34:21.018 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.053 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:21 +0000 (0:00:00.049) 0:00:08.896 ********* 2020-06-27T04:34:21.063 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-06-27T04:34:21.065 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.102 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:21 +0000 (0:00:00.048) 0:00:08.945 ********* 2020-06-27T04:34:21.112 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.153 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:21 +0000 (0:00:00.050) 0:00:08.996 ********* 2020-06-27T04:34:21.164 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-27T04:34:21.164 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.166 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.167 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.178 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.180 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.190 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.192 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.201 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.202 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.238 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:21 +0000 (0:00:00.084) 0:00:09.081 ********* 2020-06-27T04:34:21.247 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-27T04:34:21.249 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.250 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.250 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.250 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.251 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.251 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.252 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.252 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.252 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.264 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.270 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.275 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-06-27T04:34:21.276 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi031.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.310 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:21 +0000 (0:00:00.072) 0:00:09.153 ********* 2020-06-27T04:34:21.319 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.321 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.321 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.322 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.333 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.335 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.346 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.348 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.357 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.360 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.399 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:21 +0000 (0:00:00.088) 0:00:09.242 ********* 2020-06-27T04:34:21.425 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.426 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.427 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.427 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.428 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.428 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.429 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.429 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.429 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.430 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.441 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.450 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.453 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.454 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.465 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.466 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.480 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.487 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.489 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.498 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.500 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.510 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.511 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.522 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.524 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.534 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.535 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.545 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.546 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.562 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:21.597 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:21 +0000 (0:00:00.197) 0:00:09.440 ********* 2020-06-27T04:34:22.226 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "4f13f291a93b37bba6a159b6c4f0dc6d6479e734", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-06-27T04:34:22.229 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "4f13f291a93b37bba6a159b6c4f0dc6d6479e734", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-06-27T04:34:22.264 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:22 +0000 (0:00:00.667) 0:00:10.107 ********* 2020-06-27T04:34:22.307 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:22 +0000 (0:00:00.043) 0:00:10.150 ********* 2020-06-27T04:34:22.315 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-06-27T04:34:22.317 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => { "msg": "Host smithi031.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-06-27T04:34:22.354 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:22 +0000 (0:00:00.046) 0:00:10.197 ********* 2020-06-27T04:34:22.363 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => { "msg": "Host smithi051.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-06-27T04:34:22.399 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:22 +0000 (0:00:00.045) 0:00:10.242 ********* 2020-06-27T04:34:22.412 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-06-27T04:34:22.414 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-06-27T04:34:22.449 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:22 +0000 (0:00:00.049) 0:00:10.292 ********* 2020-06-27T04:34:22.469 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-06-27T04:34:22.505 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:22 +0000 (0:00:00.055) 0:00:10.348 ********* 2020-06-27T04:34:22.514 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-06-27T04:34:22.516 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:22.550 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:22 +0000 (0:00:00.045) 0:00:10.393 ********* 2020-06-27T04:34:22.559 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:22.595 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:22 +0000 (0:00:00.045) 0:00:10.438 ********* 2020-06-27T04:34:23.152 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-06-27T04:34:23.154 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.362722", "end": "2020-06-27 04:34:23.115774", "rc": 0, "start": "2020-06-27 04:34:22.753052", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.332611", "end": "2020-06-27 04:34:23.120689", "rc": 0, "start": "2020-06-27 04:34:22.788078", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-06-27T04:34:23.189 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:23 +0000 (0:00:00.593) 0:00:11.032 ********* 2020-06-27T04:34:23.233 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:23 +0000 (0:00:00.044) 0:00:11.076 ********* 2020-06-27T04:34:23.242 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-06-27T04:34:23.243 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:23.282 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:23 +0000 (0:00:00.048) 0:00:11.124 ********* 2020-06-27T04:34:23.292 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:23.332 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:23 +0000 (0:00:00.049) 0:00:11.174 ********* 2020-06-27T04:34:23.342 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-06-27T04:34:23.343 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:23.379 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:23 +0000 (0:00:00.047) 0:00:11.222 ********* 2020-06-27T04:34:23.389 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:23.427 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:23 +0000 (0:00:00.047) 0:00:11.270 ********* 2020-06-27T04:34:23.437 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-06-27T04:34:23.438 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:23.476 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:23 +0000 (0:00:00.048) 0:00:11.318 ********* 2020-06-27T04:34:23.487 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:23.524 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:23 +0000 (0:00:00.048) 0:00:11.367 ********* 2020-06-27T04:34:23.532 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:23.578 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:23 +0000 (0:00:00.053) 0:00:11.421 ********* 2020-06-27T04:34:23.589 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:23.630 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:23 +0000 (0:00:00.051) 0:00:11.473 ********* 2020-06-27T04:34:23.640 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-06-27T04:34:23.642 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:23.685 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:23 +0000 (0:00:00.055) 0:00:11.528 ********* 2020-06-27T04:34:23.695 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:23.733 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:23 +0000 (0:00:00.047) 0:00:11.576 ********* 2020-06-27T04:34:23.741 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-06-27T04:34:23.743 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:23.777 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:23 +0000 (0:00:00.044) 0:00:11.620 ********* 2020-06-27T04:34:23.786 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:23.825 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:23 +0000 (0:00:00.047) 0:00:11.668 ********* 2020-06-27T04:34:23.832 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-06-27T04:34:23.834 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-27T04:34:23.869 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:23 +0000 (0:00:00.043) 0:00:11.712 ********* 2020-06-27T04:34:23.889 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-27T04:34:23.890 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-27T04:34:23.929 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:23 +0000 (0:00:00.056) 0:00:11.768 ********* 2020-06-27T04:34:23.935 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-06-27T04:34:23.937 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:23.972 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:23 +0000 (0:00:00.047) 0:00:11.815 ********* 2020-06-27T04:34:23.982 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:24.018 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.045) 0:00:11.861 ********* 2020-06-27T04:34:24.028 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-06-27T04:34:24.030 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:24.066 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.047) 0:00:11.909 ********* 2020-06-27T04:34:24.075 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:24.110 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.044) 0:00:11.953 ********* 2020-06-27T04:34:24.119 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-06-27T04:34:24.121 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-27T04:34:24.156 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.045) 0:00:11.998 ********* 2020-06-27T04:34:24.165 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-27T04:34:24.203 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.047) 0:00:12.046 ********* 2020-06-27T04:34:24.212 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-06-27T04:34:24.213 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:24.253 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.048) 0:00:12.094 ********* 2020-06-27T04:34:24.260 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:24.302 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.050) 0:00:12.145 ********* 2020-06-27T04:34:24.312 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-27T04:34:24.349 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.047) 0:00:12.192 ********* 2020-06-27T04:34:24.361 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-27T04:34:24.398 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.049) 0:00:12.241 ********* 2020-06-27T04:34:24.407 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-06-27T04:34:24.409 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:24.459 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.049) 0:00:12.291 ********* 2020-06-27T04:34:24.460 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:24.509 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.061) 0:00:12.352 ********* 2020-06-27T04:34:24.519 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-06-27T04:34:24.521 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:24.562 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.052) 0:00:12.405 ********* 2020-06-27T04:34:24.571 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:24.618 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.056) 0:00:12.461 ********* 2020-06-27T04:34:24.627 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-06-27T04:34:24.629 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:24.666 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.047) 0:00:12.509 ********* 2020-06-27T04:34:24.676 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:24.729 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.063) 0:00:12.572 ********* 2020-06-27T04:34:24.741 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-06-27T04:34:24.743 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:24.786 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.057) 0:00:12.629 ********* 2020-06-27T04:34:24.798 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:24.840 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.053) 0:00:12.683 ********* 2020-06-27T04:34:24.849 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-06-27T04:34:24.851 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-27T04:34:24.886 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.046) 0:00:12.729 ********* 2020-06-27T04:34:24.897 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-27T04:34:24.934 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.047) 0:00:12.776 ********* 2020-06-27T04:34:24.944 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:24.979 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:24 +0000 (0:00:00.045) 0:00:12.822 ********* 2020-06-27T04:34:24.987 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:25.023 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:25 +0000 (0:00:00.044) 0:00:12.866 ********* 2020-06-27T04:34:25.031 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-06-27T04:34:25.033 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:25.067 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:25 +0000 (0:00:00.044) 0:00:12.910 ********* 2020-06-27T04:34:25.076 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:25.114 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:25 +0000 (0:00:00.046) 0:00:12.957 ********* 2020-06-27T04:34:25.128 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:25.166 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:25 +0000 (0:00:00.052) 0:00:13.009 ********* 2020-06-27T04:34:25.177 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:25.220 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:25 +0000 (0:00:00.052) 0:00:13.062 ********* 2020-06-27T04:34:25.228 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-06-27T04:34:25.230 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:25.266 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:25 +0000 (0:00:00.046) 0:00:13.109 ********* 2020-06-27T04:34:25.275 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:25.312 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:25 +0000 (0:00:00.046) 0:00:13.155 ********* 2020-06-27T04:34:25.326 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:25.360 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:25 +0000 (0:00:00.048) 0:00:13.203 ********* 2020-06-27T04:34:25.369 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:25.406 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:25 +0000 (0:00:00.044) 0:00:13.248 ********* 2020-06-27T04:34:25.415 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-06-27T04:34:25.419 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:25.453 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:25 +0000 (0:00:00.047) 0:00:13.296 ********* 2020-06-27T04:34:25.463 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:25.504 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:25 +0000 (0:00:00.050) 0:00:13.347 ********* 2020-06-27T04:34:25.513 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-06-27T04:34:25.520 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-27T04:34:25.551 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:25 +0000 (0:00:00.046) 0:00:13.394 ********* 2020-06-27T04:34:25.560 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-27T04:34:25.600 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:25 +0000 (0:00:00.049) 0:00:13.443 ********* 2020-06-27T04:34:25.610 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-06-27T04:34:25.612 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:25.650 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:25 +0000 (0:00:00.049) 0:00:13.493 ********* 2020-06-27T04:34:25.660 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:25.700 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:25 +0000 (0:00:00.049) 0:00:13.542 ********* 2020-06-27T04:34:25.710 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-06-27T04:34:25.712 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:25.754 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:25 +0000 (0:00:00.053) 0:00:13.596 ********* 2020-06-27T04:34:25.764 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:25.803 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:25 +0000 (0:00:00.049) 0:00:13.645 ********* 2020-06-27T04:34:25.987 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-06-27T04:34:25.989 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-27T04:34:26.024 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:26 +0000 (0:00:00.221) 0:00:13.867 ********* 2020-06-27T04:34:26.047 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-27T04:34:26.097 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:26 +0000 (0:00:00.072) 0:00:13.940 ********* 2020-06-27T04:34:26.589 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-06-27T04:34:26.591 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-06-27T04:34:26.654 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-06-27T04:34:27.100 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-06-27T04:34:27.138 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:27 +0000 (0:00:01.040) 0:00:14.980 ********* 2020-06-27T04:34:27.187 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-06-27T04:34:27.229 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:27 +0000 (0:00:00.091) 0:00:15.072 ********* 2020-06-27T04:34:27.703 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-06-27T04:34:27.705 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-06-27T04:34:27.800 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-06-27T04:34:28.245 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-06-27T04:34:28.289 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:28 +0000 (0:00:01.059) 0:00:16.131 ********* 2020-06-27T04:34:28.330 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-06-27T04:34:28.332 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:28.366 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:28 +0000 (0:00:00.077) 0:00:16.209 ********* 2020-06-27T04:34:28.382 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-06-27T04:34:28.384 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-06-27T04:34:28.421 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:28 +0000 (0:00:00.054) 0:00:16.264 ********* 2020-06-27T04:34:28.442 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:28.478 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:28 +0000 (0:00:00.056) 0:00:16.321 ********* 2020-06-27T04:34:28.488 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-06-27T04:34:28.490 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:28.526 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:28 +0000 (0:00:00.047) 0:00:16.369 ********* 2020-06-27T04:34:28.535 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-06-27T04:34:28.537 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:28.580 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:28 +0000 (0:00:00.048) 0:00:16.418 ********* 2020-06-27T04:34:28.586 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-06-27T04:34:28.588 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:28.624 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:28 +0000 (0:00:00.049) 0:00:16.467 ********* 2020-06-27T04:34:28.634 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-06-27T04:34:28.635 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:28.676 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:28 +0000 (0:00:00.051) 0:00:16.518 ********* 2020-06-27T04:34:28.688 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-06-27T04:34:28.689 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:28.727 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:28 +0000 (0:00:00.051) 0:00:16.569 ********* 2020-06-27T04:34:28.736 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-06-27T04:34:28.738 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:28.774 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:28 +0000 (0:00:00.047) 0:00:16.617 ********* 2020-06-27T04:34:28.789 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-06-27T04:34:28.791 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:28.840 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:28 +0000 (0:00:00.066) 0:00:16.683 ********* 2020-06-27T04:34:28.849 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-06-27T04:34:28.851 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:28.885 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:28 +0000 (0:00:00.044) 0:00:16.728 ********* 2020-06-27T04:34:28.895 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-06-27T04:34:28.896 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:28.931 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:28 +0000 (0:00:00.045) 0:00:16.774 ********* 2020-06-27T04:34:28.940 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-06-27T04:34:28.942 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:28.977 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:28 +0000 (0:00:00.045) 0:00:16.820 ********* 2020-06-27T04:34:28.992 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-06-27T04:34:28.994 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:29.031 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:29 +0000 (0:00:00.054) 0:00:16.874 ********* 2020-06-27T04:34:29.042 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-06-27T04:34:29.044 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:29.081 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:29 +0000 (0:00:00.050) 0:00:16.924 ********* 2020-06-27T04:34:29.091 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-06-27T04:34:29.093 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:29.127 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:29 +0000 (0:00:00.045) 0:00:16.970 ********* 2020-06-27T04:34:29.137 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-06-27T04:34:29.139 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:29.177 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:29 +0000 (0:00:00.049) 0:00:17.020 ********* 2020-06-27T04:34:29.193 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:29.229 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:29 +0000 (0:00:00.052) 0:00:17.072 ********* 2020-06-27T04:34:29.278 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:29.304 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:29 +0000 (0:00:00.075) 0:00:17.147 ********* 2020-06-27T04:34:29.530 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.122277", "end": "2020-06-27 04:34:29.500365", "rc": 0, "start": "2020-06-27 04:34:29.378088", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:34:29.562 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:29 +0000 (0:00:00.257) 0:00:17.405 ********* 2020-06-27T04:34:30.529 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.996926", "end": "2020-06-27 04:34:30.500352", "rc": 0, "start": "2020-06-27 04:34:29.503426", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:34:30.566 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:30 +0000 (0:00:01.003) 0:00:18.408 ********* 2020-06-27T04:34:30.935 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-06-27T04:34:30.937 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-06-27T04:34:30.973 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:30 +0000 (0:00:00.407) 0:00:18.816 ********* 2020-06-27T04:34:31.004 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-06-27T04:34:31.006 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:31.040 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:31 +0000 (0:00:00.066) 0:00:18.883 ********* 2020-06-27T04:34:31.070 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-06-27T04:34:31.072 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:31.113 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:31 +0000 (0:00:00.072) 0:00:18.956 ********* 2020-06-27T04:34:31.114 INFO:teuthology.task.ansible.out: 2020-06-27T04:34:31.145 INFO:teuthology.task.ansible.out: 2020-06-27T04:34:31.147 INFO:teuthology.task.ansible.out:TASK [common : Install Kerberos Packages (Debian)] ***************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:31.184 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:31 +0000 (0:00:00.071) 0:00:19.027 ********* 2020-06-27T04:34:31.186 INFO:teuthology.task.ansible.out: 2020-06-27T04:34:31.216 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-06-27T04:34:31.218 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:31.258 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:31 +0000 (0:00:00.074) 0:00:19.101 ********* 2020-06-27T04:34:31.536 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-06-27T04:34:31.577 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:31 +0000 (0:00:00.318) 0:00:19.420 ********* 2020-06-27T04:34:31.606 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-06-27T04:34:31.608 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:31.649 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:31 +0000 (0:00:00.072) 0:00:19.492 ********* 2020-06-27T04:34:31.679 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-06-27T04:34:31.681 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:31.714 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:31 +0000 (0:00:00.064) 0:00:19.557 ********* 2020-06-27T04:34:31.744 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-06-27T04:34:31.746 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:31.779 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:31 +0000 (0:00:00.064) 0:00:19.622 ********* 2020-06-27T04:34:31.807 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-06-27T04:34:31.834 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:31 +0000 (0:00:00.055) 0:00:19.677 ********* 2020-06-27T04:34:31.849 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-06-27T04:34:31.851 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:31.892 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:31 +0000 (0:00:00.057) 0:00:19.734 ********* 2020-06-27T04:34:32.419 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-06-27T04:34:32.421 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-06-27T04:34:32.455 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:32 +0000 (0:00:00.563) 0:00:20.298 ********* 2020-06-27T04:34:32.817 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-06-27T04:34:32.819 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-06-27T04:34:32.854 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:32 +0000 (0:00:00.399) 0:00:20.697 ********* 2020-06-27T04:34:33.419 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi031.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-06-27T04:34:33.427 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-06-27T04:34:33.429 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-06-27T04:34:33.499 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:33 +0000 (0:00:00.644) 0:00:21.342 ********* 2020-06-27T04:34:33.982 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi031.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-06-27T04:34:34.066 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-06-27T04:34:34.474 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-06-27T04:34:34.518 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:34 +0000 (0:00:01.018) 0:00:22.360 ********* 2020-06-27T04:34:34.580 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-06-27T04:34:34.733 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-06-27T04:34:34.735 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-06-27T04:34:34.770 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:34 +0000 (0:00:00.252) 0:00:22.613 ********* 2020-06-27T04:34:35.108 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-06-27T04:34:35.111 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-06-27T04:34:35.158 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:35 +0000 (0:00:00.388) 0:00:23.001 ********* 2020-06-27T04:34:35.350 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-06-27T04:34:35.352 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-06-27T04:34:35.390 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-06-27T04:34:35.391 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-06-27T04:34:35.426 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:35 +0000 (0:00:00.268) 0:00:23.269 ********* 2020-06-27T04:34:35.881 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-06-27T04:34:35.882 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-06-27T04:34:35.945 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-06-27T04:34:36.363 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-06-27T04:34:36.413 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:36 +0000 (0:00:00.986) 0:00:24.256 ********* 2020-06-27T04:34:36.436 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-06-27T04:34:36.448 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:36.483 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:36 +0000 (0:00:00.069) 0:00:24.326 ********* 2020-06-27T04:34:36.522 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-06-27T04:34:36.525 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-06-27T04:34:36.561 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:36 +0000 (0:00:00.078) 0:00:24.404 ********* 2020-06-27T04:34:36.794 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-06-27T04:34:36.832 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:36 +0000 (0:00:00.270) 0:00:24.675 ********* 2020-06-27T04:34:36.885 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-06-27T04:34:36.886 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:36.896 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:36.907 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:36.909 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:36.946 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:36 +0000 (0:00:00.114) 0:00:24.789 ********* 2020-06-27T04:34:36.957 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-06-27T04:34:36.959 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-06-27T04:34:36.996 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:36 +0000 (0:00:00.050) 0:00:24.839 ********* 2020-06-27T04:34:37.037 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-06-27T04:34:37.039 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:37.079 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:37 +0000 (0:00:00.082) 0:00:24.922 ********* 2020-06-27T04:34:37.131 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-06-27T04:34:37.133 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-06-27T04:34:37.192 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:37 +0000 (0:00:00.111) 0:00:25.034 ********* 2020-06-27T04:34:37.412 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi051.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-06-27T04:34:37.445 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:37 +0000 (0:00:00.254) 0:00:25.288 ********* 2020-06-27T04:34:37.497 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-06-27T04:34:37.499 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:37.509 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:37.520 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:37.554 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:37 +0000 (0:00:00.109) 0:00:25.397 ********* 2020-06-27T04:34:37.930 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-06-27T04:34:37.932 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-06-27T04:34:37.972 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:37 +0000 (0:00:00.411) 0:00:25.809 ********* 2020-06-27T04:34:38.013 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-06-27T04:34:38.015 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:38.049 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:38 +0000 (0:00:00.083) 0:00:25.892 ********* 2020-06-27T04:34:38.536 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-06-27T04:34:38.538 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-06-27T04:34:38.601 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:38 +0000 (0:00:00.551) 0:00:26.444 ********* 2020-06-27T04:34:38.619 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-06-27T04:34:38.621 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-06-27T04:34:38.662 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:38 +0000 (0:00:00.061) 0:00:26.505 ********* 2020-06-27T04:34:38.673 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-06-27T04:34:38.674 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:38.713 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:38 +0000 (0:00:00.051) 0:00:26.556 ********* 2020-06-27T04:34:39.222 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-06-27T04:34:39.224 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-06-27T04:34:39.276 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:39 +0000 (0:00:00.562) 0:00:27.119 ********* 2020-06-27T04:34:39.286 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-06-27T04:34:39.288 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-06-27T04:34:39.329 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:39 +0000 (0:00:00.052) 0:00:27.172 ********* 2020-06-27T04:34:39.338 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-06-27T04:34:39.341 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:39.380 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:39 +0000 (0:00:00.049) 0:00:27.222 ********* 2020-06-27T04:34:39.622 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-27T04:34:39.663 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:39 +0000 (0:00:00.284) 0:00:27.506 ********* 2020-06-27T04:34:39.868 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-06-27T04:34:39.870 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-06-27T04:34:39.931 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:39 +0000 (0:00:00.267) 0:00:27.774 ********* 2020-06-27T04:34:39.966 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi031.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-06-27T04:34:40.009 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:40 +0000 (0:00:00.077) 0:00:27.852 ********* 2020-06-27T04:34:40.019 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-06-27T04:34:40.021 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-06-27T04:34:40.058 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:40 +0000 (0:00:00.049) 0:00:27.901 ********* 2020-06-27T04:34:40.077 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-06-27T04:34:40.079 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:40.115 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:40 +0000 (0:00:00.056) 0:00:27.958 ********* 2020-06-27T04:34:40.292 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-06-27T04:34:40.294 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-27T04:34:40.336 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:40 +0000 (0:00:00.220) 0:00:28.178 ********* 2020-06-27T04:34:40.640 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi051.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-06-27T04:34:40.677 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:40 +0000 (0:00:00.342) 0:00:28.520 ********* 2020-06-27T04:34:40.689 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-06-27T04:34:40.690 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-06-27T04:34:40.737 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:40 +0000 (0:00:00.060) 0:00:28.580 ********* 2020-06-27T04:34:40.746 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-06-27T04:34:40.748 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:34:40.799 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:40 +0000 (0:00:00.061) 0:00:28.642 ********* 2020-06-27T04:34:41.361 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-06-27T04:34:41.396 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:41 +0000 (0:00:00.596) 0:00:29.238 ********* 2020-06-27T04:34:41.555 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-06-27T04:34:41.556 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2020-06-27 04:33:22 UTC", "ActiveEnterTimestampMonotonic": "19932393", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target var-run.mount time-sync.target nss-lookup.target tmp.mount system.slice -.mount basic.target sysinit.target systemd-tmpfiles-setup.service systemd-journald.socket local-fs.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-06-27 04:33:22 UTC", "AssertTimestampMonotonic": "19931600", "Before": "shutdown.target plymouth-quit.service multi-user.target xdm.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-06-27 04:33:22 UTC", "ConditionTimestampMonotonic": "19931600", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-06-27T04:34:41.558 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2498", "ExecMainStartTimestamp": "Sat 2020-06-27 04:33:22 UTC", "ExecMainStartTimestampMonotonic": "19932365", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Sat 2020-06-27 04:33:22 UTC] ; stop_time=[n/a] ; pid=2498 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-06-27 04:33:22 UTC", "InactiveExitTimestampMonotonic": "19932393", "InvocationID": "ae4d058239bc43a6989cfac77481b810", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-06-27T04:34:41.559 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2498", "MemoryAccounting": "yes", "MemoryCurrent": "1146880", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-06-27T04:34:41.561 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infi 2020-06-27T04:34:41.566 INFO:teuthology.task.ansible.out:nity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-06-27 04:33:22 UTC", "StateChangeTimestampMonotonic": "19932393", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-06-27 04:33:22 UTC", "WatchdogTimestampMonotonic": "19932392", "WatchdogUSec": "0"}} 2020-06-27T04:34:41.597 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:41 +0000 (0:00:00.201) 0:00:29.440 ********* 2020-06-27T04:34:41.736 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2020-06-27 04:33:12 UTC", "ActiveEnterTimestampMonotonic": "15267213", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target system.slice local-fs.target sysinit.target systemd-tmpfiles-setup.service time-sync.target tmp.mount -.mount nss-lookup.target var-run.mount network.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-06-27 04:33:12 UTC", "AssertTimestampMonotonic": "15266180", "Before": "xdm.service plymouth-quit.service multi-user.target getty@tty1.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-06-27 04:33:12 UTC", "ConditionTimestampMonotonic": "15266178", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-06-27T04:34:41.738 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2451", "ExecMainStartTimestamp": "Sat 2020-06-27 04:33:12 UTC", "ExecMainStartTimestampMonotonic": "15267186", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Sat 2020-06-27 04:33:12 UTC] ; stop_time=[n/a] ; pid=2451 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-06-27 04:33:12 UTC", "InactiveExitTimestampMonotonic": "15267213", "InvocationID": "3a43effb80b445aaa1ee2ff6dc00e1bd", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-06-27T04:34:41.739 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2451", "MemoryAccounting": "yes", "MemoryCurrent": "1536000", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-06-27T04:34:41.741 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-06-27 04:33:12 UTC", "StateChangeTimestampMonotonic": "15267213", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-06-27 04:33:12 UTC", "WatchdogTimestampMonotonic": "15267212", "WatchdogUSec": "0"}} 2020-06-27T04:34:41.779 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:41 +0000 (0:00:00.182) 0:00:29.622 ********* 2020-06-27T04:34:41.831 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001861", "end": "2020-06-27 04:34:41.802361", "rc": 0, "start": "2020-06-27 04:34:41.800500", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-06-27T04:34:41.882 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:41 +0000 (0:00:00.101) 0:00:29.724 ********* 2020-06-27T04:34:42.000 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001741", "end": "2020-06-27 04:34:41.970626", "rc": 0, "start": "2020-06-27 04:34:41.968885", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-06-27T04:34:42.036 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:42 +0000 (0:00:00.153) 0:00:29.878 ********* 2020-06-27T04:34:42.885 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-06-27T04:34:42.887 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-06-27T04:34:42.932 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:42 +0000 (0:00:00.896) 0:00:30.775 ********* 2020-06-27T04:34:43.031 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-06-27T04:34:43.073 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:43 +0000 (0:00:00.141) 0:00:30.916 ********* 2020-06-27T04:34:43.934 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-06-27T04:34:43.936 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-06-27T04:34:43.971 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:43 +0000 (0:00:00.897) 0:00:31.814 ********* 2020-06-27T04:34:44.118 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-06-27T04:34:44.153 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:44 +0000 (0:00:00.182) 0:00:31.996 ********* 2020-06-27T04:34:45.426 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-06-27T04:34:45.428 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-06-27T04:34:45.461 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:45 +0000 (0:00:01.307) 0:00:33.304 ********* 2020-06-27T04:34:45.471 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-06-27T04:34:45.528 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:34:45 +0000 (0:00:00.066) 0:00:33.370 ********* 2020-06-27T04:35:02.674 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-06-27T04:35:02.676 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.993796", "end": "2020-06-27 04:35:02.644473", "failed_when_result": false, "rc": 0, "start": "2020-06-27 04:34:45.650677", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-06-27T04:35:02.710 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:02 +0000 (0:00:17.181) 0:00:50.553 ********* 2020-06-27T04:35:02.807 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:17.061531", "end": "2020-06-27 04:35:02.779255", "failed_when_result": false, "rc": 0, "start": "2020-06-27 04:34:45.717724", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-06-27T04:35:02.865 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:02 +0000 (0:00:00.154) 0:00:50.707 ********* 2020-06-27T04:35:03.250 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-06-27T04:35:03.290 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:03 +0000 (0:00:00.425) 0:00:51.133 ********* 2020-06-27T04:35:03.404 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-06-27T04:35:03.446 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:03 +0000 (0:00:00.155) 0:00:51.289 ********* 2020-06-27T04:35:03.523 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-06-27T04:35:03.525 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.014832", "end": "2020-06-27 04:35:03.501895", "rc": 0, "start": "2020-06-27 04:35:03.487063", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:35:03.558 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:03 +0000 (0:00:00.112) 0:00:51.401 ********* 2020-06-27T04:35:03.694 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.013094", "end": "2020-06-27 04:35:03.659943", "rc": 0, "start": "2020-06-27 04:35:03.646849", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:35:03.726 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:03 +0000 (0:00:00.163) 0:00:51.564 ********* 2020-06-27T04:35:03.806 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-06-27T04:35:03.808 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.019854", "end": "2020-06-27 04:35:03.768990", "rc": 0, "start": "2020-06-27 04:35:03.749136", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:35:03.843 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:03 +0000 (0:00:00.121) 0:00:51.686 ********* 2020-06-27T04:35:03.956 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.011980", "end": "2020-06-27 04:35:03.927049", "rc": 0, "start": "2020-06-27 04:35:03.915069", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:35:03.995 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:03 +0000 (0:00:00.152) 0:00:51.838 ********* 2020-06-27T04:35:20.805 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.729364", "end": "2020-06-27 04:35:20.777024", "rc": 0, "start": "2020-06-27 04:35:04.047660", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:35:20.841 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:20 +0000 (0:00:16.845) 0:01:08.683 ********* 2020-06-27T04:35:21.076 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-06-27T04:35:21.078 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-06-27T04:35:21.112 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:21 +0000 (0:00:00.270) 0:01:08.954 ********* 2020-06-27T04:35:21.153 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-06-27T04:35:21.156 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-06-27T04:35:21.190 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:21 +0000 (0:00:00.078) 0:01:09.033 ********* 2020-06-27T04:35:21.242 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-06-27T04:35:21.244 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-06-27T04:35:21.279 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:21 +0000 (0:00:00.088) 0:01:09.121 ********* 2020-06-27T04:35:21.327 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi051.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_ 2020-06-27T04:35:21.329 INFO:teuthology.task.ansible.out:master/roles/testnode/vars/centos_8.yml"} 2020-06-27T04:35:21.370 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:21 +0000 (0:00:00.091) 0:01:09.212 ********* 2020-06-27T04:35:21.425 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-06-27T04:35:21.428 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-06-27T04:35:21.461 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:21 +0000 (0:00:00.091) 0:01:09.304 ********* 2020-06-27T04:35:21.471 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-06-27T04:35:21.472 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:17.212326", "end": "2020-06-27 04:35:21.407866", "rc": 0, "start": "2020-06-27 04:35:04.195540", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:35:21.513 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:21 +0000 (0:00:00.052) 0:01:09.356 ********* 2020-06-27T04:35:21.682 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-06-27T04:35:21.684 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-06-27T04:35:21.730 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:21 +0000 (0:00:00.216) 0:01:09.573 ********* 2020-06-27T04:35:21.761 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-06-27T04:35:21.763 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-06-27T04:35:21.802 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:21 +0000 (0:00:00.070) 0:01:09.644 ********* 2020-06-27T04:35:21.845 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-06-27T04:35:21.854 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-06-27T04:35:21.886 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:21 +0000 (0:00:00.085) 0:01:09.729 ********* 2020-06-27T04:35:21.928 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-06-27T04:35:21.930 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-06-27T04:35:21.969 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:21 +0000 (0:00:00.083) 0:01:09.812 ********* 2020-06-27T04:35:21.979 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-06-27T04:35:21.981 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "gid": 1220, "name": "ubuntu", "state": "present", "system": false} 2020-06-27T04:35:22.016 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:22 +0000 (0:00:00.046) 0:01:09.859 ********* 2020-06-27T04:35:22.034 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-06-27T04:35:22.036 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-06-27T04:35:22.075 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:22 +0000 (0:00:00.059) 0:01:09.918 ********* 2020-06-27T04:35:22.085 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:22.120 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:22 +0000 (0:00:00.044) 0:01:09.963 ********* 2020-06-27T04:35:22.129 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-06-27T04:35:22.131 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-06-27T04:35:22.165 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:22 +0000 (0:00:00.045) 0:01:10.008 ********* 2020-06-27T04:35:22.178 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:22.213 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:22 +0000 (0:00:00.047) 0:01:10.055 ********* 2020-06-27T04:35:22.382 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-06-27T04:35:22.384 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-06-27T04:35:22.430 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:22 +0000 (0:00:00.217) 0:01:10.273 ********* 2020-06-27T04:35:22.477 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-06-27T04:35:22.479 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-06-27T04:35:22.529 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:22 +0000 (0:00:00.097) 0:01:10.370 ********* 2020-06-27T04:35:22.670 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-06-27T04:35:22.672 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 1220, "name": "ubuntu", "state": "present", "system": false} 2020-06-27T04:35:22.709 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:22 +0000 (0:00:00.181) 0:01:10.551 ********* 2020-06-27T04:35:22.742 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-06-27T04:35:22.744 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:22.780 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:22 +0000 (0:00:00.071) 0:01:10.623 ********* 2020-06-27T04:35:22.812 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-06-27T04:35:22.813 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:22.850 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:22 +0000 (0:00:00.069) 0:01:10.692 ********* 2020-06-27T04:35:23.117 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-06-27T04:35:23.119 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-06-27T04:35:23.167 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:23 +0000 (0:00:00.316) 0:01:11.009 ********* 2020-06-27T04:35:23.176 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-06-27T04:35:23.179 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-06-27T04:35:23.217 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:23 +0000 (0:00:00.050) 0:01:11.060 ********* 2020-06-27T04:35:23.265 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-06-27T04:35:23.267 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi051"}, "changed": false} 2020-06-27T04:35:23.301 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:23 +0000 (0:00:00.083) 0:01:11.144 ********* 2020-06-27T04:35:23.748 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-06-27T04:35:23.750 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-06-27T04:35:23.801 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:23 +0000 (0:00:00.500) 0:01:11.644 ********* 2020-06-27T04:35:23.854 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-06-27T04:35:23.855 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi031"}, "changed": false} 2020-06-27T04:35:23.891 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:23 +0000 (0:00:00.089) 0:01:11.734 ********* 2020-06-27T04:35:24.402 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-06-27T04:35:24.403 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi051", "ansible_hostname": "smithi051", "ansible_nodename": "smithi051"}, "changed": false, "name": "smithi051"} 2020-06-27T04:35:24.441 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:24 +0000 (0:00:00.549) 0:01:12.283 ********* 2020-06-27T04:35:24.503 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi031", "ansible_hostname": "smithi031", "ansible_nodename": "smithi031"}, "changed": false, "name": "smithi031"} 2020-06-27T04:35:24.572 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:24 +0000 (0:00:00.131) 0:01:12.415 ********* 2020-06-27T04:35:24.950 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-06-27T04:35:24.951 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-06-27T04:35:24.994 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:24 +0000 (0:00:00.421) 0:01:12.837 ********* 2020-06-27T04:35:25.130 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-06-27T04:35:25.167 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:25 +0000 (0:00:00.172) 0:01:13.010 ********* 2020-06-27T04:35:25.578 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-06-27T04:35:25.580 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-06-27T04:35:25.637 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:25 +0000 (0:00:00.470) 0:01:13.480 ********* 2020-06-27T04:35:25.746 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-06-27T04:35:25.789 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:25 +0000 (0:00:00.151) 0:01:13.631 ********* 2020-06-27T04:35:26.354 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-06-27T04:35:26.356 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-06-27T04:35:26.408 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:26 +0000 (0:00:00.619) 0:01:14.251 ********* 2020-06-27T04:35:26.432 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-06-27T04:35:26.470 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:26 +0000 (0:00:00.062) 0:01:14.313 ********* 2020-06-27T04:35:26.964 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-06-27T04:35:26.966 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-06-27T04:35:27.012 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:27 +0000 (0:00:00.541) 0:01:14.855 ********* 2020-06-27T04:35:27.021 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-06-27T04:35:27.057 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:27 +0000 (0:00:00.045) 0:01:14.900 ********* 2020-06-27T04:35:27.234 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-06-27T04:35:27.276 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:27 +0000 (0:00:00.218) 0:01:15.119 ********* 2020-06-27T04:35:27.297 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-06-27T04:35:27.333 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:27 +0000 (0:00:00.056) 0:01:15.176 ********* 2020-06-27T04:35:27.497 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-06-27T04:35:27.499 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-06-27T04:35:27.541 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:27 +0000 (0:00:00.208) 0:01:15.384 ********* 2020-06-27T04:35:27.567 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-06-27T04:35:27.610 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:27 +0000 (0:00:00.068) 0:01:15.453 ********* 2020-06-27T04:35:27.785 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-06-27T04:35:27.787 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1220, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-06-27T04:35:27.824 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:27 +0000 (0:00:00.212) 0:01:15.666 ********* 2020-06-27T04:35:27.880 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1220, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-06-27T04:35:27.918 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:27 +0000 (0:00:00.095) 0:01:15.761 ********* 2020-06-27T04:35:28.392 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-06-27T04:35:28.394 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-06-27T04:35:28.428 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:28 +0000 (0:00:00.510) 0:01:16.271 ********* 2020-06-27T04:35:28.499 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-06-27T04:35:28.537 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:28 +0000 (0:00:00.109) 0:01:16.380 ********* 2020-06-27T04:35:28.990 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-06-27T04:35:29.028 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:29 +0000 (0:00:00.490) 0:01:16.871 ********* 2020-06-27T04:35:29.069 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-06-27T04:35:29.120 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:29 +0000 (0:00:00.091) 0:01:16.963 ********* 2020-06-27T04:35:30.948 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-06-27T04:35:30.950 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-06-27T04:35:30.950 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.703027", "end": "2020-06-27 04:35:30.921188", "rc": 0, "start": "2020-06-27 04:35:29.218161", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:35:30.992 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:30 +0000 (0:00:01.872) 0:01:18.835 ********* 2020-06-27T04:35:31.205 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.858491", "end": "2020-06-27 04:35:31.170391", "rc": 0, "start": "2020-06-27 04:35:29.311900", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:35:31.254 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:31 +0000 (0:00:00.261) 0:01:19.097 ********* 2020-06-27T04:35:31.543 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-06-27T04:35:31.545 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2020-06-27T04:35:31.859 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2020-06-27T04:35:32.033 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2020-06-27T04:35:32.410 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2020-06-27T04:35:32.541 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2020-06-27T04:35:32.610 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:32 +0000 (0:00:01.356) 0:01:20.453 ********* 2020-06-27T04:35:32.919 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2020-06-27T04:35:32.960 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:32 +0000 (0:00:00.349) 0:01:20.803 ********* 2020-06-27T04:35:33.168 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-06-27T04:35:33.170 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-06-27T04:35:33.204 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:33 +0000 (0:00:00.243) 0:01:21.047 ********* 2020-06-27T04:35:33.549 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-06-27T04:35:33.599 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:33 +0000 (0:00:00.394) 0:01:21.442 ********* 2020-06-27T04:35:33.737 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-06-27T04:35:33.739 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-06-27T04:35:34.158 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-06-27T04:35:34.253 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-06-27T04:35:34.682 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-06-27T04:35:34.806 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-06-27T04:35:34.854 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:34 +0000 (0:00:01.255) 0:01:22.697 ********* 2020-06-27T04:35:35.191 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-06-27T04:35:35.236 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:35 +0000 (0:00:00.382) 0:01:23.079 ********* 2020-06-27T04:35:35.425 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-06-27T04:35:35.427 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.330950", "end": "2020-06-27 04:35:35.399477", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-06-27 04:35:35.068527", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-06-27T04:35:35.463 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:35 +0000 (0:00:00.226) 0:01:23.306 ********* 2020-06-27T04:35:35.496 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:35.533 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:35 +0000 (0:00:00.070) 0:01:23.376 ********* 2020-06-27T04:35:35.595 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi051.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-06-27T04:35:35.597 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-06-27T04:35:35.633 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:35 +0000 (0:00:00.100) 0:01:23.476 ********* 2020-06-27T04:35:35.674 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-06-27T04:35:35.676 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:35.714 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:35 +0000 (0:00:00.080) 0:01:23.557 ********* 2020-06-27T04:35:35.755 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-27T04:35:35.757 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-06-27T04:35:35.799 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:35 +0000 (0:00:00.084) 0:01:23.641 ********* 2020-06-27T04:35:35.830 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** changed: [smithi031.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.310217", "end": "2020-06-27 04:35:35.786010", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-06-27 04:35:35.475793", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-06-27T04:35:35.869 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:35 +0000 (0:00:00.070) 0:01:23.712 ********* 2020-06-27T04:35:35.880 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-06-27T04:35:35.882 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:35.922 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:35 +0000 (0:00:00.051) 0:01:23.763 ********* 2020-06-27T04:35:35.930 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-06-27T04:35:35.932 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:35.974 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:35 +0000 (0:00:00.053) 0:01:23.816 ********* 2020-06-27T04:35:35.984 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-06-27T04:35:35.985 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:36.021 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:36 +0000 (0:00:00.046) 0:01:23.863 ********* 2020-06-27T04:35:36.031 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-06-27T04:35:36.033 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-06-27T04:35:36.043 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-06-27T04:35:36.081 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:36 +0000 (0:00:00.060) 0:01:23.924 ********* 2020-06-27T04:35:36.132 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-06-27T04:35:36.134 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:36.169 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:36 +0000 (0:00:00.088) 0:01:24.012 ********* 2020-06-27T04:35:36.222 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-27T04:35:36.224 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-06-27T04:35:36.257 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:36 +0000 (0:00:00.087) 0:01:24.100 ********* 2020-06-27T04:35:36.268 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-06-27T04:35:36.269 INFO:teuthology.task.ansible.out:fatal: [smithi051.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007054", "end": "2020-06-27 04:35:36.239071", "msg": "non-zero return code", "rc": 1, "start": "2020-06-27 04:35:36.232017", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-06-27T04:35:36.306 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:36 +0000 (0:00:00.049) 0:01:24.149 ********* 2020-06-27T04:35:36.315 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-06-27T04:35:36.317 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:36.352 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:36 +0000 (0:00:00.045) 0:01:24.195 ********* 2020-06-27T04:35:36.362 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-06-27T04:35:36.363 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:36.399 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:36 +0000 (0:00:00.046) 0:01:24.242 ********* 2020-06-27T04:35:36.417 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-06-27T04:35:36.419 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:36.452 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:36 +0000 (0:00:00.053) 0:01:24.295 ********* 2020-06-27T04:35:36.691 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-06-27T04:35:36.693 INFO:teuthology.task.ansible.out:fatal: [smithi031.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006938", "end": "2020-06-27 04:35:36.663425", "msg": "non-zero return code", "rc": 1, "start": "2020-06-27 04:35:36.656487", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-06-27T04:35:36.730 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:36 +0000 (0:00:00.278) 0:01:24.573 ********* 2020-06-27T04:35:36.732 INFO:teuthology.task.ansible.out: 2020-06-27T04:35:36.778 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-06-27T04:35:36.780 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:36.813 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:36 +0000 (0:00:00.082) 0:01:24.656 ********* 2020-06-27T04:35:38.921 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-06-27T04:35:38.955 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:38 +0000 (0:00:02.141) 0:01:26.798 ********* 2020-06-27T04:35:39.422 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-06-27T04:35:39.461 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:39 +0000 (0:00:00.506) 0:01:27.304 ********* 2020-06-27T04:35:40.963 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-06-27T04:35:40.965 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2020-06-27T04:35:41.004 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:40 +0000 (0:00:01.542) 0:01:28.847 ********* 2020-06-27T04:35:41.663 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2020-06-27T04:35:41.700 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:41 +0000 (0:00:00.696) 0:01:29.543 ********* 2020-06-27T04:35:44.112 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-06-27T04:35:44.118 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64"]} 2020-06-27T04:35:44.148 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:44 +0000 (0:00:02.448) 0:01:31.991 ********* 2020-06-27T04:35:44.189 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:44.223 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:44 +0000 (0:00:00.074) 0:01:32.066 ********* 2020-06-27T04:35:44.798 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-06-27T04:35:44.800 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64"]} 2020-06-27T04:35:44.838 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:44 +0000 (0:00:00.614) 0:01:32.681 ********* 2020-06-27T04:35:44.887 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-06-27T04:35:44.889 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:44.923 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:44 +0000 (0:00:00.085) 0:01:32.766 ********* 2020-06-27T04:35:45.193 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-06-27T04:35:45.202 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-06-27T04:35:45.249 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:45 +0000 (0:00:00.325) 0:01:33.092 ********* 2020-06-27T04:35:45.298 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-06-27T04:35:45.300 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:45.343 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:45 +0000 (0:00:00.088) 0:01:33.181 ********* 2020-06-27T04:35:45.688 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target dbus.service polkit.service system.slice sysinit.target dbus.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ipset.service iptables.service ebtables.service ip6tables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": " 2020-06-27T04:35:45.690 INFO:teuthology.task.ansible.out:/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Li 2020-06-27T04:35:45.691 INFO:teuthology.task.ansible.out:mitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWh 2020-06-27T04:35:45.693 INFO:teuthology.task.ansible.out:enUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-06-27T04:35:45.742 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:45 +0000 (0:00:00.404) 0:01:33.585 ********* 2020-06-27T04:35:45.937 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-06-27T04:35:45.939 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-06-27T04:35:45.974 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:45 +0000 (0:00:00.231) 0:01:33.817 ********* 2020-06-27T04:35:46.022 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-06-27T04:35:46.024 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:46.060 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:46 +0000 (0:00:00.086) 0:01:33.903 ********* 2020-06-27T04:35:46.086 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-06-27T04:35:46.088 INFO:teuthology.task.ansible.out:fatal: [smithi051.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-06-27T04:35:46.122 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:46 +0000 (0:00:00.062) 0:01:33.965 ********* 2020-06-27T04:35:46.402 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-06-27T04:35:46.402 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sysinit.target polkit.service system.slice basic.target dbus.socket dbus.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "iptables.service ip6tables.service shutdown.target ebtables.service ipset.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-06-27T04:35:46.404 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", 2020-06-27T04:35:46.406 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice dbus.socket sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-06-27T04:35:46.408 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-06-27T04:35:46.447 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:46 +0000 (0:00:00.324) 0:01:34.290 ********* 2020-06-27T04:35:46.792 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-06-27T04:35:46.794 INFO:teuthology.task.ansible.out:fatal: [smithi031.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-06-27T04:35:46.831 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:46 +0000 (0:00:00.383) 0:01:34.674 ********* 2020-06-27T04:35:46.939 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-06-27T04:35:46.941 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-06-27T04:35:46.982 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:46 +0000 (0:00:00.151) 0:01:34.825 ********* 2020-06-27T04:35:47.023 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-06-27T04:35:47.025 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:47.059 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.076) 0:01:34.902 ********* 2020-06-27T04:35:47.099 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-06-27T04:35:47.101 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:47.134 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.075) 0:01:34.977 ********* 2020-06-27T04:35:47.155 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-06-27T04:35:47.188 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.054) 0:01:35.031 ********* 2020-06-27T04:35:47.198 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-06-27T04:35:47.199 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:47.234 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.046) 0:01:35.077 ********* 2020-06-27T04:35:47.243 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-06-27T04:35:47.245 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:47.281 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.046) 0:01:35.124 ********* 2020-06-27T04:35:47.291 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:47.328 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.047) 0:01:35.171 ********* 2020-06-27T04:35:47.338 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-06-27T04:35:47.339 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:47.376 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.047) 0:01:35.219 ********* 2020-06-27T04:35:47.385 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-06-27T04:35:47.387 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:47.422 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.046) 0:01:35.265 ********* 2020-06-27T04:35:47.431 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-06-27T04:35:47.433 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:47.474 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.052) 0:01:35.317 ********* 2020-06-27T04:35:47.485 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:47.523 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.048) 0:01:35.365 ********* 2020-06-27T04:35:47.530 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-06-27T04:35:47.532 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:47.568 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.045) 0:01:35.411 ********* 2020-06-27T04:35:47.578 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-06-27T04:35:47.616 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.047) 0:01:35.459 ********* 2020-06-27T04:35:47.625 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-06-27T04:35:47.627 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:47.663 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.046) 0:01:35.505 ********* 2020-06-27T04:35:47.672 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-06-27T04:35:47.673 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:47.712 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.050) 0:01:35.555 ********* 2020-06-27T04:35:47.721 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-06-27T04:35:47.723 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:47.758 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.045) 0:01:35.601 ********* 2020-06-27T04:35:47.768 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-06-27T04:35:47.769 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:47.813 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.051) 0:01:35.653 ********* 2020-06-27T04:35:47.820 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-06-27T04:35:47.857 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.046) 0:01:35.700 ********* 2020-06-27T04:35:47.876 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-06-27T04:35:47.877 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-06-27T04:35:47.910 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.053) 0:01:35.753 ********* 2020-06-27T04:35:47.919 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:47.956 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:47 +0000 (0:00:00.046) 0:01:35.799 ********* 2020-06-27T04:35:47.965 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-06-27T04:35:47.966 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:48.007 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:48 +0000 (0:00:00.051) 0:01:35.850 ********* 2020-06-27T04:35:48.016 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-06-27T04:35:48.018 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:48.054 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:48 +0000 (0:00:00.046) 0:01:35.897 ********* 2020-06-27T04:35:48.064 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-06-27T04:35:48.102 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:48 +0000 (0:00:00.047) 0:01:35.945 ********* 2020-06-27T04:35:48.112 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-06-27T04:35:48.114 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-06-27T04:35:48.154 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:48 +0000 (0:00:00.048) 0:01:35.994 ********* 2020-06-27T04:35:48.161 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-06-27T04:35:48.163 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:48.210 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:48 +0000 (0:00:00.053) 0:01:36.047 ********* 2020-06-27T04:35:48.212 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-06-27T04:35:48.214 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:48.254 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:48 +0000 (0:00:00.045) 0:01:36.093 ********* 2020-06-27T04:35:48.259 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-06-27T04:35:48.260 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:48.296 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:48 +0000 (0:00:00.046) 0:01:36.139 ********* 2020-06-27T04:35:48.307 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-06-27T04:35:48.344 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:48 +0000 (0:00:00.047) 0:01:36.187 ********* 2020-06-27T04:35:48.356 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-06-27T04:35:48.358 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:48.394 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:48 +0000 (0:00:00.049) 0:01:36.236 ********* 2020-06-27T04:35:48.407 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-06-27T04:35:48.409 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:48.445 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:48 +0000 (0:00:00.052) 0:01:36.288 ********* 2020-06-27T04:35:48.455 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-06-27T04:35:48.457 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:48.492 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:48 +0000 (0:00:00.046) 0:01:36.335 ********* 2020-06-27T04:35:48.501 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-06-27T04:35:48.503 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:48.539 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:48 +0000 (0:00:00.046) 0:01:36.382 ********* 2020-06-27T04:35:48.550 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:48.584 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:48 +0000 (0:00:00.045) 0:01:36.427 ********* 2020-06-27T04:35:48.595 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-06-27T04:35:48.597 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:48.635 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:48 +0000 (0:00:00.050) 0:01:36.478 ********* 2020-06-27T04:35:48.644 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-06-27T04:35:48.647 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:48.686 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:48 +0000 (0:00:00.050) 0:01:36.528 ********* 2020-06-27T04:35:48.703 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:48.733 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:48 +0000 (0:00:00.047) 0:01:36.576 ********* 2020-06-27T04:35:48.743 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-06-27T04:35:48.745 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:48.905 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:48 +0000 (0:00:00.171) 0:01:36.748 ********* 2020-06-27T04:35:48.925 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-06-27T04:35:48.927 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:48.961 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:48 +0000 (0:00:00.055) 0:01:36.804 ********* 2020-06-27T04:35:48.971 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-06-27T04:35:48.972 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.008 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.047) 0:01:36.851 ********* 2020-06-27T04:35:49.022 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.059 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.050) 0:01:36.901 ********* 2020-06-27T04:35:49.068 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-06-27T04:35:49.070 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.105 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.046) 0:01:36.948 ********* 2020-06-27T04:35:49.114 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-06-27T04:35:49.116 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.151 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.045) 0:01:36.994 ********* 2020-06-27T04:35:49.160 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-06-27T04:35:49.162 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.197 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.045) 0:01:37.040 ********* 2020-06-27T04:35:49.206 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-06-27T04:35:49.207 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.247 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.050) 0:01:37.090 ********* 2020-06-27T04:35:49.256 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-06-27T04:35:49.259 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.302 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.054) 0:01:37.145 ********* 2020-06-27T04:35:49.310 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-06-27T04:35:49.311 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.347 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.044) 0:01:37.190 ********* 2020-06-27T04:35:49.356 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-06-27T04:35:49.358 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.396 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.047) 0:01:37.237 ********* 2020-06-27T04:35:49.403 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-06-27T04:35:49.405 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.454 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.050) 0:01:37.287 ********* 2020-06-27T04:35:49.455 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.491 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.046) 0:01:37.334 ********* 2020-06-27T04:35:49.501 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-06-27T04:35:49.503 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.538 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.047) 0:01:37.381 ********* 2020-06-27T04:35:49.548 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-06-27T04:35:49.550 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.585 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.046) 0:01:37.428 ********* 2020-06-27T04:35:49.596 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-06-27T04:35:49.598 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.644 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.048) 0:01:37.476 ********* TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.679 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.045) 0:01:37.522 ********* 2020-06-27T04:35:49.687 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-06-27T04:35:49.688 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.722 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.043) 0:01:37.565 ********* 2020-06-27T04:35:49.739 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-06-27T04:35:49.741 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.773 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.050) 0:01:37.616 ********* 2020-06-27T04:35:49.782 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-06-27T04:35:49.784 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.819 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.045) 0:01:37.662 ********* 2020-06-27T04:35:49.828 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-06-27T04:35:49.830 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.865 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.046) 0:01:37.708 ********* 2020-06-27T04:35:49.873 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-06-27T04:35:49.875 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.910 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.044) 0:01:37.753 ********* 2020-06-27T04:35:49.922 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:49.956 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.046) 0:01:37.799 ********* 2020-06-27T04:35:49.965 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-06-27T04:35:49.968 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.005 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:49 +0000 (0:00:00.048) 0:01:37.848 ********* 2020-06-27T04:35:50.016 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-06-27T04:35:50.017 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.057 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.052) 0:01:37.900 ********* 2020-06-27T04:35:50.066 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.105 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.047) 0:01:37.948 ********* 2020-06-27T04:35:50.116 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.158 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.053) 0:01:38.001 ********* 2020-06-27T04:35:50.167 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-06-27T04:35:50.169 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.204 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.045) 0:01:38.047 ********* 2020-06-27T04:35:50.214 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-06-27T04:35:50.216 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.255 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.050) 0:01:38.097 ********* 2020-06-27T04:35:50.264 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.305 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.045) 0:01:38.143 ********* 2020-06-27T04:35:50.309 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-06-27T04:35:50.311 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.346 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.045) 0:01:38.188 ********* 2020-06-27T04:35:50.355 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-06-27T04:35:50.356 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.391 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.045) 0:01:38.234 ********* 2020-06-27T04:35:50.400 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-27T04:35:50.402 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.436 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.044) 0:01:38.279 ********* 2020-06-27T04:35:50.450 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.481 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.044) 0:01:38.324 ********* 2020-06-27T04:35:50.489 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-06-27T04:35:50.491 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.526 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.045) 0:01:38.369 ********* 2020-06-27T04:35:50.535 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-06-27T04:35:50.536 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.571 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.044) 0:01:38.414 ********* 2020-06-27T04:35:50.582 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-06-27T04:35:50.584 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.618 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.046) 0:01:38.461 ********* 2020-06-27T04:35:50.626 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-27T04:35:50.628 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.668 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.050) 0:01:38.511 ********* 2020-06-27T04:35:50.680 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-06-27T04:35:50.682 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.718 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.049) 0:01:38.561 ********* 2020-06-27T04:35:50.726 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-06-27T04:35:50.728 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.766 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.047) 0:01:38.608 ********* 2020-06-27T04:35:50.775 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-06-27T04:35:50.777 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.813 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.047) 0:01:38.656 ********* 2020-06-27T04:35:50.822 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-06-27T04:35:50.824 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.862 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.048) 0:01:38.704 ********* 2020-06-27T04:35:50.908 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:50.945 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:50 +0000 (0:00:00.083) 0:01:38.788 ********* 2020-06-27T04:35:50.977 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-06-27T04:35:50.979 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:51.012 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:51 +0000 (0:00:00.066) 0:01:38.855 ********* 2020-06-27T04:35:51.052 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-06-27T04:35:51.054 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-06-27T04:35:51.102 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:51 +0000 (0:00:00.089) 0:01:38.945 ********* 2020-06-27T04:35:51.264 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-06-27T04:35:51.304 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:51 +0000 (0:00:00.197) 0:01:39.142 ********* 2020-06-27T04:35:51.356 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-06-27T04:35:51.357 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-06-27T04:35:51.398 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:51 +0000 (0:00:00.098) 0:01:39.241 ********* 2020-06-27T04:35:51.542 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-06-27T04:35:51.585 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:51 +0000 (0:00:00.186) 0:01:39.427 ********* 2020-06-27T04:35:51.626 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-06-27T04:35:51.628 INFO:teuthology.task.ansible.out:[WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-06-27T04:35:51.663 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:51 +0000 (0:00:00.078) 0:01:39.506 ********* 2020-06-27T04:35:51.696 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-06-27T04:35:51.697 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:51.731 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:51 +0000 (0:00:00.068) 0:01:39.574 ********* 2020-06-27T04:35:51.761 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-06-27T04:35:51.763 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:51.806 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:51 +0000 (0:00:00.073) 0:01:39.648 ********* 2020-06-27T04:35:51.815 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-06-27T04:35:51.816 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-06-27T04:35:51.862 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:51 +0000 (0:00:00.049) 0:01:39.697 ********* 2020-06-27T04:35:51.867 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-06-27T04:35:51.869 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:51.912 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:51 +0000 (0:00:00.057) 0:01:39.754 ********* 2020-06-27T04:35:51.920 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-06-27T04:35:51.922 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:51.958 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:51 +0000 (0:00:00.046) 0:01:39.801 ********* 2020-06-27T04:35:51.966 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-06-27T04:35:51.968 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.003 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:51 +0000 (0:00:00.044) 0:01:39.846 ********* 2020-06-27T04:35:52.014 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-06-27T04:35:52.016 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.063 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.060) 0:01:39.906 ********* 2020-06-27T04:35:52.075 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-06-27T04:35:52.076 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.117 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.053) 0:01:39.960 ********* 2020-06-27T04:35:52.127 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-06-27T04:35:52.129 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.167 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.048) 0:01:40.009 ********* 2020-06-27T04:35:52.178 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-06-27T04:35:52.180 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.213 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.047) 0:01:40.056 ********* 2020-06-27T04:35:52.223 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-06-27T04:35:52.225 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.272 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.058) 0:01:40.114 ********* 2020-06-27T04:35:52.283 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.318 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.046) 0:01:40.161 ********* 2020-06-27T04:35:52.335 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.363 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.045) 0:01:40.206 ********* 2020-06-27T04:35:52.373 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.411 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.047) 0:01:40.254 ********* 2020-06-27T04:35:52.421 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-06-27T04:35:52.423 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.457 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.046) 0:01:40.300 ********* 2020-06-27T04:35:52.467 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-06-27T04:35:52.468 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.509 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.051) 0:01:40.351 ********* 2020-06-27T04:35:52.518 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.557 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.048) 0:01:40.400 ********* 2020-06-27T04:35:52.566 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.602 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.045) 0:01:40.445 ********* 2020-06-27T04:35:52.611 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-06-27T04:35:52.613 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.648 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.045) 0:01:40.491 ********* 2020-06-27T04:35:52.658 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-06-27T04:35:52.660 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.698 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.049) 0:01:40.541 ********* 2020-06-27T04:35:52.712 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.749 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.050) 0:01:40.592 ********* 2020-06-27T04:35:52.758 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.793 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.044) 0:01:40.636 ********* 2020-06-27T04:35:52.802 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-06-27T04:35:52.804 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.838 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.045) 0:01:40.681 ********* 2020-06-27T04:35:52.847 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-06-27T04:35:52.849 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.882 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.043) 0:01:40.725 ********* 2020-06-27T04:35:52.898 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-06-27T04:35:52.900 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.938 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.054) 0:01:40.780 ********* 2020-06-27T04:35:52.946 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-06-27T04:35:52.950 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:52.986 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:52 +0000 (0:00:00.045) 0:01:40.826 ********* 2020-06-27T04:35:52.992 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-06-27T04:35:52.994 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.029 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.045) 0:01:40.872 ********* 2020-06-27T04:35:53.036 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-06-27T04:35:53.042 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.074 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.044) 0:01:40.917 ********* 2020-06-27T04:35:53.092 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-06-27T04:35:53.094 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.128 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.053) 0:01:40.970 ********* 2020-06-27T04:35:53.136 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-06-27T04:35:53.138 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.173 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.044) 0:01:41.015 ********* 2020-06-27T04:35:53.180 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-06-27T04:35:53.182 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.218 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.045) 0:01:41.061 ********* 2020-06-27T04:35:53.228 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-06-27T04:35:53.230 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.264 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.046) 0:01:41.107 ********* 2020-06-27T04:35:53.273 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-06-27T04:35:53.275 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.312 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.047) 0:01:41.155 ********* 2020-06-27T04:35:53.325 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-06-27T04:35:53.327 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.364 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.052) 0:01:41.207 ********* 2020-06-27T04:35:53.373 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-06-27T04:35:53.375 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.410 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.045) 0:01:41.253 ********* 2020-06-27T04:35:53.422 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.461 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.050) 0:01:41.304 ********* 2020-06-27T04:35:53.470 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-06-27T04:35:53.472 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.507 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.046) 0:01:41.350 ********* 2020-06-27T04:35:53.516 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-06-27T04:35:53.518 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.558 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.051) 0:01:41.401 ********* 2020-06-27T04:35:53.567 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-06-27T04:35:53.569 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.603 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.044) 0:01:41.446 ********* 2020-06-27T04:35:53.614 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-06-27T04:35:53.616 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.648 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.045) 0:01:41.491 ********* 2020-06-27T04:35:53.658 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-06-27T04:35:53.660 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.694 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.045) 0:01:41.537 ********* 2020-06-27T04:35:53.703 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-06-27T04:35:53.705 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.744 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.049) 0:01:41.587 ********* 2020-06-27T04:35:53.752 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-06-27T04:35:53.755 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.790 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.046) 0:01:41.633 ********* 2020-06-27T04:35:53.799 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-27T04:35:53.801 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-06-27T04:35:53.840 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.049) 0:01:41.683 ********* 2020-06-27T04:35:53.849 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-06-27T04:35:53.851 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.886 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.045) 0:01:41.729 ********* 2020-06-27T04:35:53.905 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-06-27T04:35:53.907 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} ok: [smithi051.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-06-27T04:35:53.918 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.932 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi051.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.961 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:53 +0000 (0:00:00.074) 0:01:41.804 ********* 2020-06-27T04:35:53.970 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-06-27T04:35:53.972 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-06-27T04:35:54.016 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:54 +0000 (0:00:00.054) 0:01:41.858 ********* 2020-06-27T04:35:54.033 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-06-27T04:35:54.062 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:54 +0000 (0:00:00.046) 0:01:41.905 ********* 2020-06-27T04:35:54.114 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-06-27T04:35:54.116 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-06-27T04:35:54.128 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-06-27T04:35:54.141 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-06-27T04:35:54.143 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-06-27T04:35:54.153 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-06-27T04:35:54.154 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-06-27T04:35:54.167 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-06-27T04:35:54.211 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:54 +0000 (0:00:00.148) 0:01:42.053 ********* 2020-06-27T04:35:54.303 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-06-27T04:35:54.305 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004551", "end": "2020-06-27 04:35:54.234564", "rc": 0, "start": "2020-06-27 04:35:54.230013", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-06-27T04:35:54.351 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:54 +0000 (0:00:00.140) 0:01:42.194 ********* 2020-06-27T04:35:54.390 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-06-27T04:35:54.392 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:54.430 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:54 +0000 (0:00:00.078) 0:01:42.272 ********* 2020-06-27T04:35:54.469 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-06-27T04:35:54.471 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:54.471 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi031.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004642", "end": "2020-06-27 04:35:54.422085", "rc": 0, "start": "2020-06-27 04:35:54.417443", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-06-27T04:35:54.509 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:54 +0000 (0:00:00.079) 0:01:42.352 ********* 2020-06-27T04:35:54.544 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:54 +0000 (0:00:00.034) 0:01:42.387 ********* 2020-06-27T04:35:54.559 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-06-27T04:35:54.561 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:54.600 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:54 +0000 (0:00:00.055) 0:01:42.443 ********* 2020-06-27T04:35:54.609 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-06-27T04:35:54.611 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:54.645 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:54 +0000 (0:00:00.044) 0:01:42.487 ********* 2020-06-27T04:35:54.653 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-06-27T04:35:54.655 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:54.691 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:54 +0000 (0:00:00.046) 0:01:42.534 ********* 2020-06-27T04:35:54.700 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:54.743 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:54 +0000 (0:00:00.051) 0:01:42.586 ********* 2020-06-27T04:35:54.755 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-06-27T04:35:54.757 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:54.793 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:54 +0000 (0:00:00.049) 0:01:42.635 ********* 2020-06-27T04:35:54.824 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-06-27T04:35:54.826 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:54.862 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:54 +0000 (0:00:00.068) 0:01:42.705 ********* 2020-06-27T04:35:55.744 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-06-27T04:35:55.746 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-06-27T04:35:55.788 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:55 +0000 (0:00:00.922) 0:01:43.627 ********* 2020-06-27T04:35:55.847 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-06-27T04:35:55.849 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-06-27T04:35:55.851 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532851712, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180872, 'block_used': 12914236, 'inode_total': 61054976, 'inode_available': 60990227, 'inode_used': 64749, 'uuid': '220eacd9-89e4-405a-9715-0beec0854dc9'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180872, "block_size": 4096, "block_total": 240095108, "block_used": 12914236, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990227, "inode_total": 61054976, "inode_used": 64749, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532851712, "size_total": 983429562368, "uuid": "220eacd9-89e4-405a-9715-0beec0854dc9"}} 2020-06-27T04:35:55.889 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:55 +0000 (0:00:00.103) 0:01:43.731 ********* 2020-06-27T04:35:55.924 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:55 +0000 (0:00:00.035) 0:01:43.766 ********* 2020-06-27T04:35:55.945 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532851712, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180872, 'block_used': 12914236, 'inode_total': 61054976, 'inode_available': 60990227, 'inode_used': 64749, 'uuid': '220eacd9-89e4-405a-9715-0beec0854dc9'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180872, "block_size": 4096, "block_total": 240095108, "block_used": 12914236, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990227, "inode_total": 61054976, "inode_used": 64749, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532851712, "size_total": 983429562368, "uuid": "220eacd9-89e4-405a-9715-0beec0854dc9"}} 2020-06-27T04:35:55.983 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:55 +0000 (0:00:00.058) 0:01:43.826 ********* 2020-06-27T04:35:56.154 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-06-27T04:35:56.156 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005259", "end": "2020-06-27 04:35:56.129861", "rc": 0, "start": "2020-06-27 04:35:56.124602", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:35:56.210 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:56 +0000 (0:00:00.227) 0:01:44.053 ********* 2020-06-27T04:35:56.231 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005399", "end": "2020-06-27 04:35:56.179972", "rc": 0, "start": "2020-06-27 04:35:56.174573", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:35:56.275 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:56 +0000 (0:00:00.064) 0:01:44.118 ********* 2020-06-27T04:35:56.284 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-06-27T04:35:56.285 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532851712, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180872, 'block_used': 12914236, 'inode_total': 61054976, 'inode_available': 60990227, 'inode_used': 64749, 'uuid': '220eacd9-89e4-405a-9715-0beec0854dc9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180872, "block_size": 4096, "block_total": 240095108, "block_used": 12914236, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990227, "inode_total": 61054976, "inode_used": 64749, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532851712, "size_total": 983429562368, "uuid": "220eacd9-89e4-405a-9715-0beec0854dc9"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:56.321 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:56 +0000 (0:00:00.046) 0:01:44.164 ********* 2020-06-27T04:35:56.334 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532851712, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180872, 'block_used': 12914236, 'inode_total': 61054976, 'inode_available': 60990227, 'inode_used': 64749, 'uuid': '220eacd9-89e4-405a-9715-0beec0854dc9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180872, "block_size": 4096, "block_total": 240095108, "block_used": 12914236, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990227, "inode_total": 61054976, "inode_used": 64749, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532851712, "size_total": 983429562368, "uuid": "220eacd9-89e4-405a-9715-0beec0854dc9"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:35:56.371 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:56 +0000 (0:00:00.049) 0:01:44.214 ********* 2020-06-27T04:35:56.380 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-06-27T04:35:56.415 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:56 +0000 (0:00:00.044) 0:01:44.258 ********* 2020-06-27T04:35:56.468 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:35:56 +0000 (0:00:00.044) 0:01:44.303 ********* 2020-06-27T04:35:57.980 INFO:teuthology.task.ansible.out: 2020-06-27T04:35:57.982 INFO:teuthology.task.ansible.out:TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqUQnGJPqkPPGV1d9cWYikWnC4RtIUfsHk'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.303121", "end": "2020-06-27 04:35:57.936079", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqUQnGJPqkPPGV1d9cWYikWnC4RtIUfsHk"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:35:56.632958", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-27T04:35:57.993 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQF4hQ5THoCQpX69Sj4hfEUUim2g0lXjVb'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.276247", "end": "2020-06-27 04:35:57.947371", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQF4hQ5THoCQpX69Sj4hfEUUim2g0lXjVb"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:35:56.671124", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-27T04:35:59.253 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-c6iVer-ocCc-0DMW-0Vs6-9hYp-yyNb-OkfXNO', 'nvme-INTEL_SSDPEDMD016T4_CVFT6011006A1P6DGN', 'nvme-nvme.8086-43564654363031313030364131503644474e-494e54454c205353445045444d443031365434-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD016T4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '3125627568', 'sectorsize': '512', 'size': '1.46 TB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.069741", "end": "2020-06-27 04:35:59.222282", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-c6iVer-ocCc-0DMW-0Vs6-9hYp-yyNb-OkfXNO", "nvme-INTEL_SSDPEDMD016T4_CVFT6011006A1P6DGN", "nvme-nvme.8086-43564654363031313030364131503644474e-494e54454c205353445045444d443031365434-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD016T4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "3125627568", "sectorsize": "512", "size": "1.46 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:35:58.152541", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! Yo 2020-06-27T04:35:59.256 INFO:teuthology.task.ansible.out:u may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-27T04:35:59.264 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-q5sVrg-U8oy-fAcu-Pucn-3IeZ-Vha8-vp0S4Z', 'nvme-INTEL_SSDPEDMD400G4_CVFT53310008400BGN', 'nvme-nvme.8086-43564654353333313030303834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.062327", "end": "2020-06-27 04:35:59.228445", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-q5sVrg-U8oy-fAcu-Pucn-3IeZ-Vha8-vp0S4Z", "nvme-INTEL_SSDPEDMD400G4_CVFT53310008400BGN", "nvme-nvme.8086-43564654353333313030303834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:35:58.166118", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-06-27T04:35:59.267 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-27T04:36:00.515 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQGLqD8M4G0VTsOv965S9yVKO3qHgduyao'], 'uuids': ['7524d79f-1360-46b8-9da4-f197e29baf54'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.048347", "end": "2020-06-27 04:36:00.479842", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQGLqD8M4G0VTsOv965S9yVKO3qHgduyao"], "labels": [], "masters": [], "uuids": ["7524d79f-1360-46b8-9da4-f197e29baf54"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:35:59.431495", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-27T04:36:00.527 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqeVM43FpmXw0fxN6zObhygDekBZoYIf1q'], 'uuids': ['ac3e035f-9d6d-40f6-99c2-0e49072df90b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.058925", "end": "2020-06-27 04:36:00.492746", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqeVM43FpmXw0fxN6zObhygDekBZoYIf1q"], "labels": [], "masters": [], "uuids": ["ac3e035f-9d6d-40f6-99c2-0e49072df90b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:35:59.433821", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-27T04:36:01.760 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQPOCQmUuYJqC0NU9UMlHC2tVq2sOTYn2o'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.045665", "end": "2020-06-27 04:36:01.730519", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQPOCQmUuYJqC0NU9UMlHC2tVq2sOTYn2o"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:36:00.684854", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-27T04:36:01.813 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqnDU6dWcWe3skeiN9nRC8rnOcb9G5Beff'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.058308", "end": "2020-06-27 04:36:01.761184", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqnDU6dWcWe3skeiN9nRC8rnOcb9G5Beff"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:36:00.702876", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-27T04:36:03.019 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQQ8XAdG2nUCLfTZqlBfiYgd0UHGw3lyYk'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.040925", "end": "2020-06-27 04:36:02.980880", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQQ8XAdG2nUCLfTZqlBfiYgd0UHGw3lyYk"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:36:01.939955", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-27T04:36:03.052 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQEW', 'wwn-0x5000c500871a7b41'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4HQEW', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871a7b41', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQEW-part1', 'wwn-0x5000c500871a7b41-part1'], 'uuids': ['220eacd9-89e4-405a-9715-0beec0854dc9'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '220eacd9-89e4-405a-9715-0beec0854dc9', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQEW", "wwn-0x5000c500871a7b41"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQEW-part1", "wwn-0x5000c500871a7b41-part1"], "labels": [], "masters": [], "uuids": ["220eacd9-89e4-405a-9715-0beec0854dc9"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "220eacd9-89e4-405a-9715-0beec0854dc9"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQEW", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a7b41"}}, 2020-06-27T04:36:03.054 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-06-27T04:36:03.077 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqmX6Dh63BLfVORi7d6zAi87ATAujIReos'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.060879", "end": "2020-06-27 04:36:03.034557", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqmX6Dh63BLfVORi7d6zAi87ATAujIReos"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:36:01.973678", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-27T04:36:03.097 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HPJX', 'wwn-0x5000c500871aa859'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4HPJX', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871aa859', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HPJX-part1', 'wwn-0x5000c500871aa859-part1'], 'uuids': ['220eacd9-89e4-405a-9715-0beec0854dc9'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '220eacd9-89e4-405a-9715-0beec0854dc9', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HPJX", "wwn-0x5000c500871aa859"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HPJX-part1", "wwn-0x5000c500871aa859-part1"], "labels": [], "masters": [], "uuids": ["220eacd9-89e4-405a-9715-0beec0854dc9"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "220eacd9-89e4-405a-9715-0beec0854dc9"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HPJX", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871aa859"}}, 2020-06-27T04:36:03.099 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-06-27T04:36:04.307 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQLofE6Ty9ClpDIGXQf0n0WgXSnNAHTkfD'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.047226", "end": "2020-06-27 04:36:04.272183", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQLofE6Ty9ClpDIGXQf0n0WgXSnNAHTkfD"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:36:03.224957", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-27T04:36:04.353 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:04 +0000 (0:00:07.893) 0:01:52.196 ********* 2020-06-27T04:36:04.383 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqvtw4FkTfyszQf9TLY39HvL2XdAnqEfgQ'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.082881", "end": "2020-06-27 04:36:04.330806", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqvtw4FkTfyszQf9TLY39HvL2XdAnqEfgQ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:36:03.247925", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-27T04:36:04.430 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:04 +0000 (0:00:00.075) 0:01:52.272 ********* 2020-06-27T04:36:04.777 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-06-27T04:36:04.779 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQF4hQ5THoCQpX69Sj4hfEUUim2g0lXjVb'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.145730", "end": "2020-06-27 04:36:04.733151", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQF4hQ5THoCQpX69Sj4hfEUUim2g0lXjVb"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:36:04.587421", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.142974 s, 807 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.142974 s, 807 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:04.790 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqUQnGJPqkPPGV1d9cWYikWnC4RtIUfsHk'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.103080", "end": "2020-06-27 04:36:04.761725", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqUQnGJPqkPPGV1d9cWYikWnC4RtIUfsHk"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:36:04.658645", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.100312 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.100312 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:05.028 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-q5sVrg-U8oy-fAcu-Pucn-3IeZ-Vha8-vp0S4Z', 'nvme-INTEL_SSDPEDMD400G4_CVFT53310008400BGN', 'nvme-nvme.8086-43564654353333313030303834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036413", "end": "2020-06-27 04:36:04.993685", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-q5sVrg-U8oy-fAcu-Pucn-3IeZ-Vha8-vp0S4Z", "nvme-INTEL_SSDPEDMD400G4_CVFT53310008400BGN", "nvme-nvme.8086-43564654353333313030303834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:36:04.957272", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0337247 s, 3.4 GB/s", "std 2020-06-27T04:36:05.030 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0337247 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:05.037 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-c6iVer-ocCc-0DMW-0Vs6-9hYp-yyNb-OkfXNO', 'nvme-INTEL_SSDPEDMD016T4_CVFT6011006A1P6DGN', 'nvme-nvme.8086-43564654363031313030364131503644474e-494e54454c205353445045444d443031365434-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD016T4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '3125627568', 'sectorsize': '512', 'size': '1.46 TB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036261", "end": "2020-06-27 04:36:04.995095", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-c6iVer-ocCc-0DMW-0Vs6-9hYp-yyNb-OkfXNO", "nvme-INTEL_SSDPEDMD016T4_CVFT6011006A1P6DGN", "nvme-nvme.8086-43564654363031313030364131503644474e-494e54454c205353445045444d443031365434-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD016T4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "3125627568", "sectorsize": "512", "size": "1.46 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:36:04.958834", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.033691 s, 3.4 GB/s", "stderr 2020-06-27T04:36:05.039 INFO:teuthology.task.ansible.out:_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.033691 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:05.338 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqeVM43FpmXw0fxN6zObhygDekBZoYIf1q'], 'uuids': ['ac3e035f-9d6d-40f6-99c2-0e49072df90b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.102992", "end": "2020-06-27 04:36:05.303982", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqeVM43FpmXw0fxN6zObhygDekBZoYIf1q"], "labels": [], "masters": [], "uuids": ["ac3e035f-9d6d-40f6-99c2-0e49072df90b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:36:05.200990", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.100321 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.100321 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:05.371 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQGLqD8M4G0VTsOv965S9yVKO3qHgduyao'], 'uuids': ['7524d79f-1360-46b8-9da4-f197e29baf54'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.139088", "end": "2020-06-27 04:36:05.341548", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQGLqD8M4G0VTsOv965S9yVKO3qHgduyao"], "labels": [], "masters": [], "uuids": ["7524d79f-1360-46b8-9da4-f197e29baf54"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:36:05.202460", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136496 s, 845 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136496 s, 845 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:05.631 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqnDU6dWcWe3skeiN9nRC8rnOcb9G5Beff'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.102552", "end": "2020-06-27 04:36:05.606037", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqnDU6dWcWe3skeiN9nRC8rnOcb9G5Beff"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:36:05.503485", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0998836 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0998836 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:05.710 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQPOCQmUuYJqC0NU9UMlHC2tVq2sOTYn2o'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.140011", "end": "2020-06-27 04:36:05.681177", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQPOCQmUuYJqC0NU9UMlHC2tVq2sOTYn2o"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:36:05.541166", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137339 s, 840 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137339 s, 840 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:05.939 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqmX6Dh63BLfVORi7d6zAi87ATAujIReos'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.104219", "end": "2020-06-27 04:36:05.909293", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqmX6Dh63BLfVORi7d6zAi87ATAujIReos"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:36:05.805074", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.101558 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.101558 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:05.951 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HPJX', 'wwn-0x5000c500871aa859'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4HPJX', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871aa859', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HPJX-part1', 'wwn-0x5000c500871aa859-part1'], 'uuids': ['220eacd9-89e4-405a-9715-0beec0854dc9'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '220eacd9-89e4-405a-9715-0beec0854dc9', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HPJX", "wwn-0x5000c500871aa859"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HPJX-part1", "wwn-0x5000c500871aa859-part1"], "labels": [], "masters": [], "uuids": ["220eacd9-89e4-405a-9715-0beec0854dc9"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "220eacd9-89e4-405a-9715-0beec0854dc9"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HPJX", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871aa859"}}, 2020-06-27T04:36:05.953 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-06-27T04:36:06.067 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQQ8XAdG2nUCLfTZqlBfiYgd0UHGw3lyYk'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.140760", "end": "2020-06-27 04:36:06.038069", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQQ8XAdG2nUCLfTZqlBfiYgd0UHGw3lyYk"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:36:05.897309", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138079 s, 835 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138079 s, 835 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:06.079 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQEW', 'wwn-0x5000c500871a7b41'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4HQEW', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871a7b41', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQEW-part1', 'wwn-0x5000c500871a7b41-part1'], 'uuids': ['220eacd9-89e4-405a-9715-0beec0854dc9'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '220eacd9-89e4-405a-9715-0beec0854dc9', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQEW", "wwn-0x5000c500871a7b41"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQEW-part1", "wwn-0x5000c500871a7b41-part1"], "labels": [], "masters": [], "uuids": ["220eacd9-89e4-405a-9715-0beec0854dc9"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "220eacd9-89e4-405a-9715-0beec0854dc9"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQEW", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a7b41"}}, 2020-06-27T04:36:06.081 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-06-27T04:36:06.247 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqvtw4FkTfyszQf9TLY39HvL2XdAnqEfgQ'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.103454", "end": "2020-06-27 04:36:06.218362", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-oV392zj3UT8P4rwb8XUUi5GtLkOsweSqvtw4FkTfyszQf9TLY39HvL2XdAnqEfgQ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:36:06.114908", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.100796 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.100796 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:06.307 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:06 +0000 (0:00:01.878) 0:01:54.150 ********* 2020-06-27T04:36:06.309 INFO:teuthology.task.ansible.out: 2020-06-27T04:36:06.421 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQLofE6Ty9ClpDIGXQf0n0WgXSnNAHTkfD'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.139409", "end": "2020-06-27 04:36:06.382720", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-02urQBQxjHVjliceQobRRleaF4iaDPyQLofE6Ty9ClpDIGXQf0n0WgXSnNAHTkfD"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:36:06.243311", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136739 s, 844 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136739 s, 844 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:06.460 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:06 +0000 (0:00:00.152) 0:01:54.303 ********* 2020-06-27T04:36:06.607 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-06-27T04:36:06.609 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.078065", "end": "2020-06-27 04:36:06.574117", "rc": 0, "start": "2020-06-27 04:36:06.496052", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:06.644 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:06 +0000 (0:00:00.183) 0:01:54.486 ********* 2020-06-27T04:36:06.766 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.073833", "end": "2020-06-27 04:36:06.722896", "rc": 0, "start": "2020-06-27 04:36:06.649063", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:06.811 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:06 +0000 (0:00:00.167) 0:01:54.654 ********* 2020-06-27T04:36:06.906 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-06-27T04:36:06.908 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.044793", "end": "2020-06-27 04:36:06.876843", "rc": 0, "start": "2020-06-27 04:36:06.832050", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:06.959 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:06 +0000 (0:00:00.148) 0:01:54.802 ********* 2020-06-27T04:36:06.993 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-06-27T04:36:07.031 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:07 +0000 (0:00:00.071) 0:01:54.874 ********* 2020-06-27T04:36:07.077 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-06-27T04:36:07.079 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for physical volumes] *********************************** changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.047337", "end": "2020-06-27 04:36:07.053627", "rc": 0, "start": "2020-06-27 04:36:07.006290", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:07.113 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:07 +0000 (0:00:00.081) 0:01:54.956 ********* 2020-06-27T04:36:07.156 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:07 +0000 (0:00:00.042) 0:01:54.998 ********* 2020-06-27T04:36:07.166 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-06-27T04:36:07.224 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:07 +0000 (0:00:00.067) 0:01:55.066 ********* 2020-06-27T04:36:07.235 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-06-27T04:36:07.239 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:07.293 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:07 +0000 (0:00:00.069) 0:01:55.136 ********* 2020-06-27T04:36:07.304 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-06-27T04:36:07.305 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:07.345 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:07 +0000 (0:00:00.051) 0:01:55.188 ********* 2020-06-27T04:36:07.355 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-06-27T04:36:07.357 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:07.395 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:07 +0000 (0:00:00.050) 0:01:55.238 ********* 2020-06-27T04:36:07.405 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-06-27T04:36:07.406 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:07.443 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:07 +0000 (0:00:00.047) 0:01:55.286 ********* 2020-06-27T04:36:07.465 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-06-27T04:36:07.468 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:07.503 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:07 +0000 (0:00:00.060) 0:01:55.346 ********* 2020-06-27T04:36:07.512 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-06-27T04:36:07.514 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:07.553 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:07 +0000 (0:00:00.049) 0:01:55.396 ********* 2020-06-27T04:36:07.594 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-06-27T04:36:07.595 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:07.628 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:07 +0000 (0:00:00.075) 0:01:55.471 ********* 2020-06-27T04:36:07.732 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-06-27T04:36:07.735 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-27T04:36:07.769 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:07 +0000 (0:00:00.141) 0:01:55.612 ********* 2020-06-27T04:36:07.821 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-06-27T04:36:07.823 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532851712, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180872, 'block_used': 12914236, 'inode_total': 61054976, 'inode_available': 60990227, 'inode_used': 64749, 'uuid': '220eacd9-89e4-405a-9715-0beec0854dc9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180872, "block_size": 4096, "block_total": 240095108, "block_used": 12914236, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990227, "inode_total": 61054976, "inode_used": 64749, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532851712, "size_total": 983429562368, "uuid": "220eacd9-89e4-405a-9715-0beec0854dc9"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:07.869 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:07 +0000 (0:00:00.099) 0:01:55.711 ********* 2020-06-27T04:36:07.902 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-06-27T04:36:07.903 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-27T04:36:07.939 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:07 +0000 (0:00:00.070) 0:01:55.782 ********* 2020-06-27T04:36:07.948 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-06-27T04:36:07.950 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:07.989 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:07 +0000 (0:00:00.049) 0:01:55.832 ********* 2020-06-27T04:36:08.009 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi031.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532851712, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180872, 'block_used': 12914236, 'inode_total': 61054976, 'inode_available': 60990227, 'inode_used': 64749, 'uuid': '220eacd9-89e4-405a-9715-0beec0854dc9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180872, "block_size": 4096, "block_total": 240095108, "block_used": 12914236, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990227, "inode_total": 61054976, "inode_used": 64749, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532851712, "size_total": 983429562368, "uuid": "220eacd9-89e4-405a-9715-0beec0854dc9"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:08.055 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:08 +0000 (0:00:00.066) 0:01:55.898 ********* 2020-06-27T04:36:08.072 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-27T04:36:08.074 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:08.108 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:08 +0000 (0:00:00.052) 0:01:55.951 ********* 2020-06-27T04:36:08.118 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-06-27T04:36:08.120 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:08.154 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:08 +0000 (0:00:00.045) 0:01:55.997 ********* 2020-06-27T04:36:08.164 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-27T04:36:08.166 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:08.201 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:08 +0000 (0:00:00.046) 0:01:56.044 ********* 2020-06-27T04:36:08.222 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-27T04:36:08.223 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:08.258 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:08 +0000 (0:00:00.057) 0:01:56.101 ********* 2020-06-27T04:36:08.268 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-06-27T04:36:08.270 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:08.307 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:08 +0000 (0:00:00.048) 0:01:56.150 ********* 2020-06-27T04:36:08.317 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-27T04:36:08.319 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:08.356 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:08 +0000 (0:00:00.048) 0:01:56.199 ********* 2020-06-27T04:36:08.366 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-06-27T04:36:08.368 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:08.405 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:08 +0000 (0:00:00.049) 0:01:56.248 ********* 2020-06-27T04:36:08.415 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-06-27T04:36:08.417 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:08.454 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:08 +0000 (0:00:00.048) 0:01:56.297 ********* 2020-06-27T04:36:08.465 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-06-27T04:36:08.467 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:08.507 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:08 +0000 (0:00:00.052) 0:01:56.350 ********* 2020-06-27T04:36:08.517 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-06-27T04:36:08.519 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:08.557 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:08 +0000 (0:00:00.050) 0:01:56.400 ********* 2020-06-27T04:36:08.600 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-06-27T04:36:08.602 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:08.636 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:08 +0000 (0:00:00.079) 0:01:56.479 ********* 2020-06-27T04:36:09.246 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-06-27T04:36:09.248 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-06-27T04:36:09.289 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:09 +0000 (0:00:00.651) 0:01:57.131 ********* 2020-06-27T04:36:09.299 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-06-27T04:36:09.348 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:09 +0000 (0:00:00.059) 0:01:57.191 ********* 2020-06-27T04:36:09.980 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-27T04:36:09.987 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-27T04:36:10.340 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-27T04:36:10.420 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-27T04:36:10.693 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-27T04:36:10.786 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-27T04:36:11.058 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-27T04:36:11.172 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-27T04:36:11.404 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-27T04:36:11.448 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:11 +0000 (0:00:02.100) 0:01:59.291 ********* 2020-06-27T04:36:11.547 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-27T04:36:11.588 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:11 +0000 (0:00:00.139) 0:01:59.430 ********* 2020-06-27T04:36:11.667 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-06-27T04:36:11.669 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-06-27T04:36:11.706 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:11 +0000 (0:00:00.117) 0:01:59.548 ********* 2020-06-27T04:36:11.814 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-06-27T04:36:11.817 INFO:teuthology.task.ansible.out: 2020-06-27T04:36:11.857 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:11 +0000 (0:00:00.151) 0:01:59.700 ********* 2020-06-27T04:36:11.959 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-06-27T04:36:11.961 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-27T04:36:12.103 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-27T04:36:12.166 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-27T04:36:12.293 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-27T04:36:12.360 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-27T04:36:12.500 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-27T04:36:12.554 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-27T04:36:12.577 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:12.621 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:12 +0000 (0:00:00.764) 0:02:00.464 ********* 2020-06-27T04:36:12.704 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-27T04:36:12.716 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:12.760 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:12 +0000 (0:00:00.138) 0:02:00.603 ********* 2020-06-27T04:36:12.846 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-06-27T04:36:12.847 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-06-27T04:36:12.884 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:12 +0000 (0:00:00.123) 0:02:00.727 ********* 2020-06-27T04:36:12.926 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-06-27T04:36:12.928 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-06-27T04:36:12.966 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:12 +0000 (0:00:00.082) 0:02:00.809 ********* 2020-06-27T04:36:12.992 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-06-27T04:36:12.994 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-06-27T04:36:13.031 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:13 +0000 (0:00:00.065) 0:02:00.874 ********* 2020-06-27T04:36:13.074 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-06-27T04:36:13.076 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-06-27T04:36:13.111 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:13 +0000 (0:00:00.080) 0:02:00.954 ********* 2020-06-27T04:36:13.572 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi031.front.sepia.ceph.com] => {"changed": true} changed: [smithi051.front.sepia.ceph.com] => {"changed": true} 2020-06-27T04:36:13.614 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:13 +0000 (0:00:00.503) 0:02:01.457 ********* 2020-06-27T04:36:13.661 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:13 +0000 (0:00:00.046) 0:02:01.504 ********* 2020-06-27T04:36:14.245 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-06-27T04:36:14.247 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-06-27T04:36:14.286 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:14 +0000 (0:00:00.625) 0:02:02.129 ********* 2020-06-27T04:36:14.331 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:14 +0000 (0:00:00.044) 0:02:02.174 ********* 2020-06-27T04:36:14.340 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-06-27T04:36:14.342 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:14.377 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:14 +0000 (0:00:00.045) 0:02:02.220 ********* 2020-06-27T04:36:14.387 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:14.431 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:14 +0000 (0:00:00.053) 0:02:02.274 ********* 2020-06-27T04:36:14.442 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:14.477 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:14 +0000 (0:00:00.046) 0:02:02.320 ********* 2020-06-27T04:36:14.485 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:14.525 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:14 +0000 (0:00:00.047) 0:02:02.367 ********* 2020-06-27T04:36:14.532 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-06-27T04:36:14.535 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:14.572 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:14 +0000 (0:00:00.047) 0:02:02.415 ********* 2020-06-27T04:36:14.581 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:14.622 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:14 +0000 (0:00:00.050) 0:02:02.465 ********* 2020-06-27T04:36:14.631 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-06-27T04:36:14.633 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:14.669 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:14 +0000 (0:00:00.046) 0:02:02.512 ********* 2020-06-27T04:36:14.678 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:14.714 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:14 +0000 (0:00:00.045) 0:02:02.557 ********* 2020-06-27T04:36:14.723 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-06-27T04:36:14.725 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:14.761 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:14 +0000 (0:00:00.046) 0:02:02.604 ********* 2020-06-27T04:36:14.771 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:14.809 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:14 +0000 (0:00:00.045) 0:02:02.649 ********* 2020-06-27T04:36:14.818 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-06-27T04:36:14.819 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:14.854 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:14 +0000 (0:00:00.047) 0:02:02.697 ********* 2020-06-27T04:36:14.865 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:14.909 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:14 +0000 (0:00:00.055) 0:02:02.752 ********* 2020-06-27T04:36:14.918 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-06-27T04:36:14.920 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:14.956 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:14 +0000 (0:00:00.046) 0:02:02.798 ********* 2020-06-27T04:36:14.966 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:15.001 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:14 +0000 (0:00:00.045) 0:02:02.844 ********* 2020-06-27T04:36:15.015 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:15.053 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:15 +0000 (0:00:00.052) 0:02:02.896 ********* 2020-06-27T04:36:15.063 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:15.099 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:15 +0000 (0:00:00.045) 0:02:02.942 ********* 2020-06-27T04:36:15.108 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-06-27T04:36:15.109 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:15.153 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:15 +0000 (0:00:00.054) 0:02:02.996 ********* 2020-06-27T04:36:15.163 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:15.203 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:15 +0000 (0:00:00.049) 0:02:03.045 ********* 2020-06-27T04:36:15.219 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:15.266 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:15 +0000 (0:00:00.056) 0:02:03.102 ********* 2020-06-27T04:36:15.271 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:15.311 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:15 +0000 (0:00:00.051) 0:02:03.154 ********* 2020-06-27T04:36:15.322 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-06-27T04:36:15.323 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:15.360 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:15 +0000 (0:00:00.048) 0:02:03.202 ********* 2020-06-27T04:36:15.368 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:15.405 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:15 +0000 (0:00:00.046) 0:02:03.248 ********* 2020-06-27T04:36:15.892 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-06-27T04:36:15.894 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-06-27T04:36:15.938 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:15 +0000 (0:00:00.532) 0:02:03.781 ********* 2020-06-27T04:36:15.949 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-06-27T04:36:15.988 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:15 +0000 (0:00:00.050) 0:02:03.831 ********* 2020-06-27T04:36:16.281 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-06-27T04:36:16.283 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2020-06-27 04:33:22 UTC", "ActiveEnterTimestampMonotonic": "19853988", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target ntpd.service systemd-tmpfiles-setup.service system.slice basic.target ntpdate.service systemd-journald.socket tmp.mount -.mount sntp.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-06-27 04:33:20 UTC", "AssertTimestampMonotonic": "18722169", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-06-27 04:33:20 UTC", "ConditionTimestampMonotonic": "18722140", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ntpd.service systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-06-27T04:36:16.285 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2439", "ExecMainStartTimestamp": "Sat 2020-06-27 04:33:21 UTC", "ExecMainStartTimestampMonotonic": "19026729", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Sat 2020-06-27 04:33:20 UTC] ; stop_time=[Sat 2020-06-27 04:33:21 UTC] ; pid=2425 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Sat 2020-06-27 04:33:21 UTC] ; stop_time=[Sat 2020-06-27 04:33:22 UTC] ; pid=2460 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-06-27 04:33:20 UTC", "InactiveExitTimestampMonotonic": "18752550", "InvocationID": "652362b4f341422e83d33e23fac7eacd", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZE 2020-06-27T04:36:16.287 INFO:teuthology.task.ansible.out:Soft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2439", "MemoryAccounting": "yes", "MemoryCurrent": "2748416", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no" 2020-06-27T04:36:16.288 INFO:teuthology.task.ansible.out:, "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-06-27 04:33:22 UTC", "StateChangeTimestampMonotonic": "19853988", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-06-27 04:33:21 UTC", "WatchdogTimestampMonotonic": "19026742", "WatchdogUSec": "0"}} 2020-06-27T04:36:16.323 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:16 +0000 (0:00:00.335) 0:02:04.166 ********* 2020-06-27T04:36:16.337 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2020-06-27 04:33:12 UTC", "ActiveEnterTimestampMonotonic": "15260406", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service basic.target tmp.mount sysinit.target ntpd.service ntpdate.service sntp.service systemd-journald.socket system.slice -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-06-27 04:33:11 UTC", "AssertTimestampMonotonic": "13890348", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-06-27 04:33:11 UTC", "ConditionTimestampMonotonic": "13890320", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-06-27T04:36:16.339 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1612", "ExecMainStartTimestamp": "Sat 2020-06-27 04:33:12 UTC", "ExecMainStartTimestampMonotonic": "15142621", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Sat 2020-06-27 04:33:11 UTC] ; stop_time=[Sat 2020-06-27 04:33:12 UTC] ; pid=1594 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Sat 2020-06-27 04:33:12 UTC] ; stop_time=[Sat 2020-06-27 04:33:12 UTC] ; pid=2395 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-06-27 04:33:11 UTC", "InactiveExitTimestampMonotonic": "13908967", "InvocationID": "36b396283840451fbc37009b3a27ee98", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZE 2020-06-27T04:36:16.341 INFO:teuthology.task.ansible.out:Soft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1612", "MemoryAccounting": "yes", "MemoryCurrent": "2740224", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no" 2020-06-27T04:36:16.342 INFO:teuthology.task.ansible.out:, "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-06-27 04:33:12 UTC", "StateChangeTimestampMonotonic": "15260406", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-06-27 04:33:12 UTC", "WatchdogTimestampMonotonic": "15142660", "WatchdogUSec": "0"}} 2020-06-27T04:36:16.376 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:16 +0000 (0:00:00.052) 0:02:04.219 ********* 2020-06-27T04:36:16.386 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-27T04:36:16.389 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-06-27T04:36:16.432 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:16 +0000 (0:00:00.056) 0:02:04.275 ********* 2020-06-27T04:36:16.447 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-06-27T04:36:16.485 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:16 +0000 (0:00:00.052) 0:02:04.328 ********* 2020-06-27T04:36:16.494 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-27T04:36:16.496 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-06-27T04:36:16.544 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:16 +0000 (0:00:00.058) 0:02:04.386 ********* 2020-06-27T04:36:16.553 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-06-27T04:36:16.591 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:16 +0000 (0:00:00.047) 0:02:04.434 ********* 2020-06-27T04:36:16.600 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-06-27T04:36:16.602 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:16.637 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:16 +0000 (0:00:00.046) 0:02:04.480 ********* 2020-06-27T04:36:16.646 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:16.683 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:16 +0000 (0:00:00.045) 0:02:04.526 ********* 2020-06-27T04:36:16.692 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-06-27T04:36:16.693 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:16.731 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:16 +0000 (0:00:00.047) 0:02:04.574 ********* 2020-06-27T04:36:16.741 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:16.790 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:16 +0000 (0:00:00.059) 0:02:04.633 ********* 2020-06-27T04:36:16.799 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-06-27T04:36:16.801 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:16.837 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:16 +0000 (0:00:00.046) 0:02:04.680 ********* 2020-06-27T04:36:16.847 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:16.884 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:16 +0000 (0:00:00.046) 0:02:04.727 ********* 2020-06-27T04:36:17.078 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-06-27T04:36:17.080 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 1220, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-06-27T04:36:17.116 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:17 +0000 (0:00:00.232) 0:02:04.959 ********* 2020-06-27T04:36:17.127 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "gid": 1220, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-06-27T04:36:17.163 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:17 +0000 (0:00:00.047) 0:02:05.006 ********* 2020-06-27T04:36:17.657 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-06-27T04:36:17.658 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1220, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-06-27T04:36:17.706 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:17 +0000 (0:00:00.542) 0:02:05.548 ********* 2020-06-27T04:36:17.716 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1220, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-06-27T04:36:17.755 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:17 +0000 (0:00:00.049) 0:02:05.598 ********* 2020-06-27T04:36:19.037 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-06-27T04:36:19.039 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-06-27T04:36:19.073 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:19 +0000 (0:00:01.317) 0:02:06.916 ********* 2020-06-27T04:36:19.083 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-06-27T04:36:19.122 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:19 +0000 (0:00:00.049) 0:02:06.965 ********* 2020-06-27T04:36:19.131 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-06-27T04:36:19.132 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:19.167 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:19 +0000 (0:00:00.045) 0:02:07.010 ********* 2020-06-27T04:36:19.177 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:19.214 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:19 +0000 (0:00:00.046) 0:02:07.057 ********* 2020-06-27T04:36:19.224 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-06-27T04:36:19.259 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:19 +0000 (0:00:00.045) 0:02:07.102 ********* 2020-06-27T04:36:19.268 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-06-27T04:36:19.314 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:19 +0000 (0:00:00.047) 0:02:07.150 ********* 2020-06-27T04:36:19.461 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-06-27T04:36:19.463 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-06-27T04:36:19.498 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:19 +0000 (0:00:00.190) 0:02:07.341 ********* 2020-06-27T04:36:19.520 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-06-27T04:36:19.557 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:19 +0000 (0:00:00.059) 0:02:07.400 ********* 2020-06-27T04:36:19.567 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-06-27T04:36:19.569 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:19.606 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:19 +0000 (0:00:00.048) 0:02:07.448 ********* 2020-06-27T04:36:19.615 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:19.660 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:19 +0000 (0:00:00.054) 0:02:07.503 ********* 2020-06-27T04:36:19.669 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-06-27T04:36:19.671 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-06-27T04:36:19.708 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:19 +0000 (0:00:00.048) 0:02:07.551 ********* 2020-06-27T04:36:19.719 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-06-27T04:36:19.755 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:19 +0000 (0:00:00.046) 0:02:07.598 ********* 2020-06-27T04:36:19.765 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-06-27T04:36:19.766 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:19.807 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:19 +0000 (0:00:00.052) 0:02:07.650 ********* 2020-06-27T04:36:19.817 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:19.856 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:19 +0000 (0:00:00.047) 0:02:07.698 ********* 2020-06-27T04:36:20.029 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-06-27T04:36:20.030 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-06-27T04:36:20.076 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:20 +0000 (0:00:00.221) 0:02:07.919 ********* 2020-06-27T04:36:20.099 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-06-27T04:36:20.142 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:20 +0000 (0:00:00.065) 0:02:07.985 ********* 2020-06-27T04:36:20.303 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-06-27T04:36:20.305 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-06-27T04:36:20.341 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:20 +0000 (0:00:00.198) 0:02:08.184 ********* 2020-06-27T04:36:20.366 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-06-27T04:36:20.416 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:20 +0000 (0:00:00.075) 0:02:08.259 ********* 2020-06-27T04:36:20.422 INFO:teuthology.task.ansible.out: 2020-06-27T04:36:20.426 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-06-27T04:36:20.428 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.462 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:20 +0000 (0:00:00.046) 0:02:08.305 ********* 2020-06-27T04:36:20.473 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.510 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:20 +0000 (0:00:00.046) 0:02:08.352 ********* 2020-06-27T04:36:20.519 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-06-27T04:36:20.520 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.536 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.538 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.572 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:20 +0000 (0:00:00.062) 0:02:08.415 ********* 2020-06-27T04:36:20.583 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.584 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.584 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.585 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.585 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.622 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:20 +0000 (0:00:00.049) 0:02:08.465 ********* 2020-06-27T04:36:20.632 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-06-27T04:36:20.633 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.634 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.635 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.646 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.683 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:20 +0000 (0:00:00.060) 0:02:08.526 ********* 2020-06-27T04:36:20.694 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.695 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.696 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.732 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:20 +0000 (0:00:00.049) 0:02:08.575 ********* 2020-06-27T04:36:20.743 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-27T04:36:20.744 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.780 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:20 +0000 (0:00:00.048) 0:02:08.623 ********* 2020-06-27T04:36:20.788 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.830 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:20 +0000 (0:00:00.049) 0:02:08.673 ********* 2020-06-27T04:36:20.839 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-06-27T04:36:20.841 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.877 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:20 +0000 (0:00:00.044) 0:02:08.718 ********* 2020-06-27T04:36:20.884 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.921 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:20 +0000 (0:00:00.046) 0:02:08.764 ********* 2020-06-27T04:36:20.930 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-06-27T04:36:20.932 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:20.968 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:20 +0000 (0:00:00.047) 0:02:08.811 ********* 2020-06-27T04:36:20.978 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:21.017 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:21 +0000 (0:00:00.048) 0:02:08.860 ********* 2020-06-27T04:36:21.027 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-06-27T04:36:21.028 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:21.064 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:21 +0000 (0:00:00.047) 0:02:08.907 ********* 2020-06-27T04:36:21.074 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:21.114 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:21 +0000 (0:00:00.049) 0:02:08.957 ********* 2020-06-27T04:36:21.123 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-06-27T04:36:21.129 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:21.170 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:21 +0000 (0:00:00.049) 0:02:09.006 ********* 2020-06-27T04:36:21.173 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:21.212 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:21 +0000 (0:00:00.048) 0:02:09.055 ********* 2020-06-27T04:36:21.222 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-06-27T04:36:21.223 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:21.260 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:21 +0000 (0:00:00.048) 0:02:09.103 ********* 2020-06-27T04:36:21.269 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:21.308 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:21 +0000 (0:00:00.048) 0:02:09.151 ********* 2020-06-27T04:36:21.317 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-06-27T04:36:21.319 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:21.361 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:21 +0000 (0:00:00.052) 0:02:09.204 ********* 2020-06-27T04:36:21.372 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:21.410 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:21 +0000 (0:00:00.048) 0:02:09.253 ********* 2020-06-27T04:36:21.419 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-06-27T04:36:21.420 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:21.456 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:21 +0000 (0:00:00.046) 0:02:09.299 ********* 2020-06-27T04:36:21.465 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:36:21.507 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:21 +0000 (0:00:00.050) 0:02:09.350 ********* 2020-06-27T04:36:21.714 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-06-27T04:36:21.716 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005466", "end": "2020-06-27 04:36:21.674365", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-06-27 04:36:21.668899", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:21.917 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003162", "end": "2020-06-27 04:36:21.875686", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-06-27 04:36:21.872524", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:22.134 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002998", "end": "2020-06-27 04:36:22.102921", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-06-27 04:36:22.099923", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:22.768 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:01.006491", "end": "2020-06-27 04:36:22.721571", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-06-27 04:36:21.715080", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:22.986 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003123", "end": "2020-06-27 04:36:22.939058", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-06-27 04:36:22.935935", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:23.176 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002819", "end": "2020-06-27 04:36:23.141925", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-06-27 04:36:23.139106", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:23.375 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:01.027104", "end": "2020-06-27 04:36:23.331714", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-06-27 04:36:22.304610", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:23.414 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:23 +0000 (0:00:01.906) 0:02:11.257 ********* 2020-06-27T04:36:23.428 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.025473", "end": "2020-06-27 04:36:23.358869", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-06-27 04:36:23.333396", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:36:23.476 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:23 +0000 (0:00:00.062) 0:02:11.319 ********* 2020-06-27T04:36:23.485 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-06-27T04:36:23.525 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:23 +0000 (0:00:00.049) 0:02:11.368 ********* 2020-06-27T04:36:23.584 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:36:23 +0000 (0:00:00.058) 0:02:11.427 ********* 2020-06-27T04:36:23.752 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-06-27T04:36:23.754 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-06-27T04:36:23.829 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-06-27T04:36:23.949 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-06-27T04:36:23.954 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-06-27T04:36:23.958 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2020-06-27T04:36:23.959 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi031.front.sepia.ceph.com : ok=112 changed=31 unreachable=0 failed=0 skipped=177 rescued=0 ignored=3 smithi051.front.sepia.ceph.com : ok=112 changed=31 unreachable=0 failed=0 skipped=177 rescued=0 ignored=3 Saturday 27 June 2020 04:36:23 +0000 (0:00:00.374) 0:02:11.801 ********* =============================================================================== common : nrpe - Remove SELinux policy package -------------------------- 17.18s common : nrpe - Load SELinux policy package ---------------------------- 16.85s testnode : Zap all non-root disks --------------------------------------- 7.89s testnode : Install packages --------------------------------------------- 2.45s testnode : Ensure ceph packages are not present. ------------------------ 2.14s testnode : Create logical volume(s) ------------------------------------- 2.10s testnode : List any leftover Ceph artifacts from previous jobs ---------- 1.91s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.88s testnode : Rebuild rpmdb ------------------------------------------------ 1.87s Gathering Facts --------------------------------------------------------- 1.76s testnode : Ensure ceph dependency packages are not present. ------------- 1.54s testnode : Configure local mirrorlists ---------------------------------- 1.36s testnode : Install packages via pip ------------------------------------- 1.32s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 1.31s testnode : Configure version specific repos in /etc/yum.repos.d/ -------- 1.26s common : Configure local epel mirrorlists ------------------------------- 1.06s common : Configure epel repos in /etc/yum.repos.d/ ---------------------- 1.04s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.02s common : Upload custom netsaint sc 2020-06-27T04:36:23.961 INFO:teuthology.task.ansible.out:ripts for raid/disk/smart/monitoring to /usr/libexec/. --- 0.99s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.93s 2020-06-27T04:36:24.321 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi031.front.sepia.ceph.com'), Remote(name='ubuntu@smithi051.front.sepia.ceph.com')] 2020-06-27T04:36:24.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-27T04:36:24.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:36:24.401 INFO:teuthology.orchestra.run.smithi031:> true 2020-06-27T04:36:24.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-27T04:36:24.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:36:24.560 INFO:teuthology.orchestra.run.smithi051:> true 2020-06-27T04:36:24.647 INFO:teuthology.run_tasks:Running task clock... 2020-06-27T04:36:24.661 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-06-27T04:36:24.662 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-06-27T04:36:24.662 INFO:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-06-27T04:36:24.710 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-06-27T04:36:24.727 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-06-27T04:36:24.775 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: ntpd: command not found 2020-06-27T04:36:24.793 INFO:teuthology.orchestra.run.smithi031.stdout:506 Cannot talk to daemon 2020-06-27T04:36:24.814 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-06-27T04:36:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-06-27T04:36:24.909 INFO:teuthology.orchestra.run.smithi031.stderr:bash: ntpq: command not found 2020-06-27T04:36:24.911 INFO:teuthology.orchestra.run.smithi031.stdout:210 Number of sources = 4 2020-06-27T04:36:24.912 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-06-27T04:36:24.912 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2020-06-27T04:36:24.912 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-27T04:36:24.912 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-27T04:36:24.912 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-27T04:36:24.913 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-27T04:36:24.913 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-06-27T04:36:24.914 INFO:teuthology.orchestra.run.smithi051:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-06-27T04:36:24.957 INFO:teuthology.orchestra.run.smithi051.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-06-27T04:36:24.980 INFO:teuthology.orchestra.run.smithi051.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-06-27T04:36:25.030 INFO:teuthology.orchestra.run.smithi051.stderr:sudo: ntpd: command not found 2020-06-27T04:36:25.048 INFO:teuthology.orchestra.run.smithi051.stdout:506 Cannot talk to daemon 2020-06-27T04:36:25.069 INFO:teuthology.orchestra.run.smithi051.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-06-27T04:36:25.090 INFO:teuthology.orchestra.run.smithi051.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-06-27T04:36:25.148 INFO:teuthology.orchestra.run.smithi051.stderr:bash: ntpq: command not found 2020-06-27T04:36:25.150 INFO:teuthology.orchestra.run.smithi051.stdout:210 Number of sources = 4 2020-06-27T04:36:25.151 INFO:teuthology.orchestra.run.smithi051.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-06-27T04:36:25.151 INFO:teuthology.orchestra.run.smithi051.stdout:=============================================================================== 2020-06-27T04:36:25.151 INFO:teuthology.orchestra.run.smithi051.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-27T04:36:25.151 INFO:teuthology.orchestra.run.smithi051.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-27T04:36:25.152 INFO:teuthology.orchestra.run.smithi051.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-27T04:36:25.152 INFO:teuthology.orchestra.run.smithi051.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-27T04:36:25.152 INFO:teuthology.run_tasks:Running task install... 2020-06-27T04:36:25.160 DEBUG:teuthology.task.install:project ceph 2020-06-27T04:36:25.161 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5'}} 2020-06-27T04:36:25.161 DEBUG:teuthology.task.install:config {'sha1': '77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5'} 2020-06-27T04:36:25.162 INFO:teuthology.task.install:Using flavor: basic 2020-06-27T04:36:25.169 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-06-27T04:36:25.169 INFO:teuthology.task.install:extra packages: [] 2020-06-27T04:36:25.170 INFO:teuthology.orchestra.run.smithi031:> sudo lsb_release -is 2020-06-27T04:36:25.211 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS 2020-06-27T04:36:25.212 DEBUG:teuthology.misc:System to be installed: CentOS 2020-06-27T04:36:25.212 INFO:teuthology.orchestra.run.smithi051:> sudo lsb_release -is 2020-06-27T04:36:25.213 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'tag': None, 'sha1': '77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'debuginfo': None, 'flavor': 'basic', 'downgrade_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'exclude_packages': [], 'extras': None, 'wait_for_package': False, 'project': 'ceph', 'packages': {}, 'install_ceph_packages': True, 'repos_only': False} 2020-06-27T04:36:25.214 INFO:teuthology.orchestra.run.smithi031:> sudo lsb_release -is 2020-06-27T04:36:25.254 INFO:teuthology.orchestra.run.smithi051.stdout:CentOS 2020-06-27T04:36:25.255 DEBUG:teuthology.misc:System to be installed: CentOS 2020-06-27T04:36:25.256 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'tag': None, 'sha1': '77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'debuginfo': None, 'flavor': 'basic', 'downgrade_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'exclude_packages': [], 'extras': None, 'wait_for_package': False, 'project': 'ceph', 'packages': {}, 'install_ceph_packages': True, 'repos_only': False} 2020-06-27T04:36:25.256 INFO:teuthology.orchestra.run.smithi051:> sudo lsb_release -is 2020-06-27T04:36:25.291 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS 2020-06-27T04:36:25.292 DEBUG:teuthology.misc:System to be installed: CentOS 2020-06-27T04:36:25.293 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 2020-06-27T04:36:25.343 INFO:teuthology.orchestra.run.smithi051.stdout:CentOS 2020-06-27T04:36:25.345 DEBUG:teuthology.misc:System to be installed: CentOS 2020-06-27T04:36:25.345 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 2020-06-27T04:36:25.507 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-06-26-1211/77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5/centos/8/flavors/default/ 2020-06-27T04:36:25.507 INFO:teuthology.task.install.rpm:Package version is 16.0.0-2978.g77ddaecfcb0 2020-06-27T04:36:25.522 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-06-26-1211/77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5/centos/8/flavors/default/ 2020-06-27T04:36:25.523 INFO:teuthology.task.install.rpm:Package version is 16.0.0-2978.g77ddaecfcb0 2020-06-27T04:36:25.647 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-06-26-1211/77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-06-26-1211/77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-06-26-1211/77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-06-27T04:36:25.648 INFO:teuthology.orchestra.run.smithi031:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-06-27T04:36:25.659 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-06-26-1211/77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-06-26-1211/77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-06-26-1211/77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-06-27T04:36:25.659 INFO:teuthology.orchestra.run.smithi051:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-06-27T04:36:25.697 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2020-06-27T04:36:25.698 INFO:teuthology.orchestra.run.smithi031:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-06-27T04:36:25.707 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2020-06-27T04:36:25.708 INFO:teuthology.orchestra.run.smithi051:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-06-27T04:36:25.769 INFO:teuthology.orchestra.run.smithi031:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-06-27T04:36:25.780 INFO:teuthology.orchestra.run.smithi051:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-06-27T04:36:25.858 INFO:teuthology.orchestra.run.smithi031:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-06-27T04:36:25.868 INFO:teuthology.orchestra.run.smithi051:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-06-27T04:36:25.888 INFO:teuthology.orchestra.run.smithi031.stdout:check_obsoletes = 1 2020-06-27T04:36:25.890 INFO:teuthology.orchestra.run.smithi031:> sudo yum clean all 2020-06-27T04:36:25.898 INFO:teuthology.orchestra.run.smithi051.stdout:check_obsoletes = 1 2020-06-27T04:36:25.899 INFO:teuthology.orchestra.run.smithi051:> sudo yum clean all 2020-06-27T04:36:26.187 INFO:teuthology.orchestra.run.smithi031.stdout:46 files removed 2020-06-27T04:36:26.195 INFO:teuthology.orchestra.run.smithi051.stdout:46 files removed 2020-06-27T04:36:26.216 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-radosgw 2020-06-27T04:36:26.225 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-radosgw 2020-06-27T04:36:26.845 INFO:teuthology.orchestra.run.smithi031.stdout:ceph packages for x86_64 277 kB/s | 71 kB 00:00 2020-06-27T04:36:26.851 INFO:teuthology.orchestra.run.smithi051.stdout:ceph packages for x86_64 277 kB/s | 71 kB 00:00 2020-06-27T04:36:27.092 INFO:teuthology.orchestra.run.smithi031.stdout:ceph noarch packages 67 kB/s | 14 kB 00:00 2020-06-27T04:36:27.097 INFO:teuthology.orchestra.run.smithi051.stdout:ceph noarch packages 68 kB/s | 14 kB 00:00 2020-06-27T04:36:27.330 INFO:teuthology.orchestra.run.smithi031.stdout:ceph source packages 6.6 kB/s | 1.4 kB 00:00 2020-06-27T04:36:27.335 INFO:teuthology.orchestra.run.smithi051.stdout:ceph source packages 6.6 kB/s | 1.4 kB 00:00 2020-06-27T04:36:27.515 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-8 - AppStream 43 MB/s | 7.0 MB 00:00 2020-06-27T04:36:27.561 INFO:teuthology.orchestra.run.smithi051.stdout:CentOS-8 - AppStream 34 MB/s | 7.0 MB 00:00 2020-06-27T04:36:28.778 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-8 - Base 26 MB/s | 2.2 MB 00:00 2020-06-27T04:36:28.816 INFO:teuthology.orchestra.run.smithi051.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-06-27T04:36:29.226 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-8 - Extras 87 kB/s | 5.5 kB 00:00 2020-06-27T04:36:29.259 INFO:teuthology.orchestra.run.smithi051.stdout:CentOS-8 - Extras 87 kB/s | 5.5 kB 00:00 2020-06-27T04:36:29.391 INFO:teuthology.orchestra.run.smithi031.stdout:Copr repo for ceph-el8 owned by ktdreyer 2.2 kB/s | 257 B 00:00 2020-06-27T04:36:29.441 INFO:teuthology.orchestra.run.smithi051.stdout:Copr repo for ceph-el8 owned by ktdreyer 1.9 kB/s | 257 B 00:00 2020-06-27T04:36:29.917 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 15 MB/s | 7.1 MB 00:00 2020-06-27T04:36:30.073 INFO:teuthology.orchestra.run.smithi051.stdout:Extra Packages for Enterprise Linux 12 MB/s | 7.1 MB 00:00 2020-06-27T04:36:31.493 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 3.9 MB/s | 20 kB 00:00 2020-06-27T04:36:31.607 INFO:teuthology.orchestra.run.smithi051.stdout:lab-extras 4.0 MB/s | 20 kB 00:00 2020-06-27T04:36:32.588 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:36:32.599 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:36:32.600 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2020-06-27T04:36:32.600 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:36:32.600 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2020-06-27T04:36:32.600 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 11 M 2020-06-27T04:36:32.601 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrading: 2020-06-27T04:36:32.601 INFO:teuthology.orchestra.run.smithi031.stdout: librados2 x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 3.7 M 2020-06-27T04:36:32.601 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1 x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 2.0 M 2020-06-27T04:36:32.601 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2020-06-27T04:36:32.601 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 6.0 M 2020-06-27T04:36:32.602 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 22 M 2020-06-27T04:36:32.602 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 25 k 2020-06-27T04:36:32.602 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2 x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 541 k 2020-06-27T04:36:32.602 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 489 k 2020-06-27T04:36:32.602 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2 x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 3.4 M 2020-06-27T04:36:32.603 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse 2020-06-27T04:36:32.603 INFO:teuthology.orchestra.run.smithi031.stdout: x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 40 k 2020-06-27T04:36:32.603 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common 2020-06-27T04:36:32.603 INFO:teuthology.orchestra.run.smithi031.stdout: x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 67 k 2020-06-27T04:36:32.603 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 204 k 2020-06-27T04:36:32.604 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 367 k 2020-06-27T04:36:32.604 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 332 k 2020-06-27T04:36:32.604 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 113 k 2020-06-27T04:36:32.604 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2020-06-27T04:36:32.604 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2020-06-27T04:36:32.604 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable 2020-06-27T04:36:32.605 INFO:teuthology.orchestra.run.smithi031.stdout: noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2020-06-27T04:36:32.605 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq x86_64 0.9.0-1.el8 CentOS-Base 47 k 2020-06-27T04:36:32.605 INFO:teuthology.orchestra.run.smithi031.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-06-27T04:36:32.605 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-06-27T04:36:32.605 INFO:teuthology.orchestra.run.smithi031.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-06-27T04:36:32.606 INFO:teuthology.orchestra.run.smithi031.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-06-27T04:36:32.606 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-06-27T04:36:32.606 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:36:32.606 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2020-06-27T04:36:32.606 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:36:32.606 INFO:teuthology.orchestra.run.smithi031.stdout:Install 22 Packages 2020-06-27T04:36:32.607 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrade 2 Packages 2020-06-27T04:36:32.607 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:36:32.607 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 51 M 2020-06-27T04:36:32.607 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2020-06-27T04:36:32.674 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:36:32.688 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:36:32.689 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repository Size 2020-06-27T04:36:32.689 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:36:32.689 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2020-06-27T04:36:32.689 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-radosgw x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 11 M 2020-06-27T04:36:32.689 INFO:teuthology.orchestra.run.smithi051.stdout:Upgrading: 2020-06-27T04:36:32.690 INFO:teuthology.orchestra.run.smithi051.stdout: librados2 x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 3.7 M 2020-06-27T04:36:32.690 INFO:teuthology.orchestra.run.smithi051.stdout: librbd1 x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 2.0 M 2020-06-27T04:36:32.690 INFO:teuthology.orchestra.run.smithi051.stdout:Installing dependencies: 2020-06-27T04:36:32.690 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-base x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 6.0 M 2020-06-27T04:36:32.691 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-common x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 22 M 2020-06-27T04:36:32.691 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-selinux x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 25 k 2020-06-27T04:36:32.691 INFO:teuthology.orchestra.run.smithi051.stdout: libcephfs2 x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 541 k 2020-06-27T04:36:32.692 INFO:teuthology.orchestra.run.smithi051.stdout: libradosstriper1 x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 489 k 2020-06-27T04:36:32.692 INFO:teuthology.orchestra.run.smithi051.stdout: librgw2 x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 3.4 M 2020-06-27T04:36:32.692 INFO:teuthology.orchestra.run.smithi051.stdout: python3-ceph-argparse 2020-06-27T04:36:32.692 INFO:teuthology.orchestra.run.smithi051.stdout: x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 40 k 2020-06-27T04:36:32.692 INFO:teuthology.orchestra.run.smithi051.stdout: python3-ceph-common 2020-06-27T04:36:32.693 INFO:teuthology.orchestra.run.smithi051.stdout: x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 67 k 2020-06-27T04:36:32.693 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cephfs x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 204 k 2020-06-27T04:36:32.693 INFO:teuthology.orchestra.run.smithi051.stdout: python3-rados x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 367 k 2020-06-27T04:36:32.693 INFO:teuthology.orchestra.run.smithi051.stdout: python3-rbd x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 332 k 2020-06-27T04:36:32.693 INFO:teuthology.orchestra.run.smithi051.stdout: python3-rgw x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 113 k 2020-06-27T04:36:32.693 INFO:teuthology.orchestra.run.smithi051.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2020-06-27T04:36:32.694 INFO:teuthology.orchestra.run.smithi051.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2020-06-27T04:36:32.694 INFO:teuthology.orchestra.run.smithi051.stdout: python3-prettytable 2020-06-27T04:36:32.694 INFO:teuthology.orchestra.run.smithi051.stdout: noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2020-06-27T04:36:32.694 INFO:teuthology.orchestra.run.smithi051.stdout: librabbitmq x86_64 0.9.0-1.el8 CentOS-Base 47 k 2020-06-27T04:36:32.694 INFO:teuthology.orchestra.run.smithi051.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-06-27T04:36:32.695 INFO:teuthology.orchestra.run.smithi051.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-06-27T04:36:32.695 INFO:teuthology.orchestra.run.smithi051.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-06-27T04:36:32.695 INFO:teuthology.orchestra.run.smithi051.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-06-27T04:36:32.695 INFO:teuthology.orchestra.run.smithi051.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-06-27T04:36:32.695 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:36:32.695 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2020-06-27T04:36:32.696 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:36:32.696 INFO:teuthology.orchestra.run.smithi051.stdout:Install 22 Packages 2020-06-27T04:36:32.696 INFO:teuthology.orchestra.run.smithi051.stdout:Upgrade 2 Packages 2020-06-27T04:36:32.696 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:36:32.697 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 51 M 2020-06-27T04:36:32.697 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2020-06-27T04:36:33.974 INFO:teuthology.orchestra.run.smithi031.stdout:(1/24): ceph-base-16.0.0-2978.g77ddaecfcb0.el8. 4.4 MB/s | 6.0 MB 00:01 2020-06-27T04:36:34.033 INFO:teuthology.orchestra.run.smithi031.stdout:(2/24): ceph-selinux-16.0.0-2978.g77ddaecfcb0.e 426 kB/s | 25 kB 00:00 2020-06-27T04:36:34.167 INFO:teuthology.orchestra.run.smithi031.stdout:(3/24): libcephfs2-16.0.0-2978.g77ddaecfcb0.el8 3.9 MB/s | 541 kB 00:00 2020-06-27T04:36:34.241 INFO:teuthology.orchestra.run.smithi031.stdout:(4/24): libradosstriper1-16.0.0-2978.g77ddaecfc 6.6 MB/s | 489 kB 00:00 2020-06-27T04:36:34.756 INFO:teuthology.orchestra.run.smithi031.stdout:(5/24): librgw2-16.0.0-2978.g77ddaecfcb0.el8.x8 6.6 MB/s | 3.4 MB 00:00 2020-06-27T04:36:34.817 INFO:teuthology.orchestra.run.smithi031.stdout:(6/24): python3-ceph-argparse-16.0.0-2978.g77dd 660 kB/s | 40 kB 00:00 2020-06-27T04:36:34.878 INFO:teuthology.orchestra.run.smithi031.stdout:(7/24): python3-ceph-common-16.0.0-2978.g77ddae 1.1 MB/s | 67 kB 00:00 2020-06-27T04:36:34.946 INFO:teuthology.orchestra.run.smithi031.stdout:(8/24): python3-cephfs-16.0.0-2978.g77ddaecfcb0 2.9 MB/s | 204 kB 00:00 2020-06-27T04:36:35.020 INFO:teuthology.orchestra.run.smithi031.stdout:(9/24): python3-rados-16.0.0-2978.g77ddaecfcb0. 4.8 MB/s | 367 kB 00:00 2020-06-27T04:36:35.094 INFO:teuthology.orchestra.run.smithi031.stdout:(10/24): python3-rbd-16.0.0-2978.g77ddaecfcb0.e 4.4 MB/s | 332 kB 00:00 2020-06-27T04:36:35.160 INFO:teuthology.orchestra.run.smithi031.stdout:(11/24): python3-rgw-16.0.0-2978.g77ddaecfcb0.e 1.7 MB/s | 113 kB 00:00 2020-06-27T04:36:35.194 INFO:teuthology.orchestra.run.smithi031.stdout:(12/24): librdkafka-0.11.4-1.el8.x86_64.rpm 10 MB/s | 353 kB 00:00 2020-06-27T04:36:35.198 INFO:teuthology.orchestra.run.smithi031.stdout:(13/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 64 MB/s | 259 kB 00:00 2020-06-27T04:36:35.200 INFO:teuthology.orchestra.run.smithi031.stdout:(14/24): python3-prettytable-0.7.2-14.el8.noarc 32 MB/s | 44 kB 00:00 2020-06-27T04:36:35.202 INFO:teuthology.orchestra.run.smithi031.stdout:(15/24): librabbitmq-0.9.0-1.el8.x86_64.rpm 30 MB/s | 47 kB 00:00 2020-06-27T04:36:35.280 INFO:teuthology.orchestra.run.smithi031.stdout:(16/24): fmt-6.2.1-1.el8.x86_64.rpm 1.5 MB/s | 116 kB 00:00 2020-06-27T04:36:35.326 INFO:teuthology.orchestra.run.smithi031.stdout:(17/24): gperftools-libs-2.7-6.el8.x86_64.rpm 6.6 MB/s | 315 kB 00:00 2020-06-27T04:36:35.357 INFO:teuthology.orchestra.run.smithi031.stdout:(18/24): leveldb-1.22-1.el8.x86_64.rpm 5.7 MB/s | 181 kB 00:00 2020-06-27T04:36:35.374 INFO:teuthology.orchestra.run.smithi031.stdout:(19/24): liboath-2.6.2-3.el8.x86_64.rpm 3.5 MB/s | 59 kB 00:00 2020-06-27T04:36:35.390 INFO:teuthology.orchestra.run.smithi031.stdout:(20/24): libunwind-1.3.1-3.el8.x86_64.rpm 4.6 MB/s | 75 kB 00:00 2020-06-27T04:36:35.461 INFO:teuthology.orchestra.run.smithi051.stdout:(1/24): ceph-base-16.0.0-2978.g77ddaecfcb0.el8. 2.2 MB/s | 6.0 MB 00:02 2020-06-27T04:36:35.536 INFO:teuthology.orchestra.run.smithi051.stdout:(2/24): ceph-selinux-16.0.0-2978.g77ddaecfcb0.e 331 kB/s | 25 kB 00:00 2020-06-27T04:36:35.688 INFO:teuthology.orchestra.run.smithi031.stdout:(21/24): ceph-radosgw-16.0.0-2978.g77ddaecfcb0. 3.4 MB/s | 11 MB 00:03 2020-06-27T04:36:35.780 INFO:teuthology.orchestra.run.smithi051.stdout:(3/24): libcephfs2-16.0.0-2978.g77ddaecfcb0.el8 2.2 MB/s | 541 kB 00:00 2020-06-27T04:36:36.042 INFO:teuthology.orchestra.run.smithi051.stdout:(4/24): libradosstriper1-16.0.0-2978.g77ddaecfc 1.8 MB/s | 489 kB 00:00 2020-06-27T04:36:36.167 INFO:teuthology.orchestra.run.smithi031.stdout:(22/24): ceph-common-16.0.0-2978.g77ddaecfcb0.e 6.2 MB/s | 22 MB 00:03 2020-06-27T04:36:36.236 INFO:teuthology.orchestra.run.smithi031.stdout:(23/24): librados2-16.0.0-2978.g77ddaecfcb0.el8 4.4 MB/s | 3.7 MB 00:00 2020-06-27T04:36:36.244 INFO:teuthology.orchestra.run.smithi031.stdout:(24/24): librbd1-16.0.0-2978.g77ddaecfcb0.el8.x 3.6 MB/s | 2.0 MB 00:00 2020-06-27T04:36:36.247 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:36:36.247 INFO:teuthology.orchestra.run.smithi031.stdout:Total 14 MB/s | 51 MB 00:03 2020-06-27T04:36:36.253 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2020-06-27T04:36:36.322 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2020-06-27T04:36:36.322 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2020-06-27T04:36:36.556 INFO:teuthology.orchestra.run.smithi051.stdout:(5/24): ceph-radosgw-16.0.0-2978.g77ddaecfcb0.e 2.7 MB/s | 11 MB 00:03 2020-06-27T04:36:36.584 INFO:teuthology.orchestra.run.smithi051.stdout:(6/24): python3-ceph-argparse-16.0.0-2978.g77dd 1.4 MB/s | 40 kB 00:00 2020-06-27T04:36:36.609 INFO:teuthology.orchestra.run.smithi051.stdout:(7/24): python3-ceph-common-16.0.0-2978.g77ddae 2.6 MB/s | 67 kB 00:00 2020-06-27T04:36:36.640 INFO:teuthology.orchestra.run.smithi051.stdout:(8/24): librgw2-16.0.0-2978.g77ddaecfcb0.el8.x8 5.7 MB/s | 3.4 MB 00:00 2020-06-27T04:36:36.665 INFO:teuthology.orchestra.run.smithi051.stdout:(9/24): python3-cephfs-16.0.0-2978.g77ddaecfcb0 3.6 MB/s | 204 kB 00:00 2020-06-27T04:36:36.714 INFO:teuthology.orchestra.run.smithi051.stdout:(10/24): python3-rados-16.0.0-2978.g77ddaecfcb0 4.9 MB/s | 367 kB 00:00 2020-06-27T04:36:36.740 INFO:teuthology.orchestra.run.smithi051.stdout:(11/24): python3-rbd-16.0.0-2978.g77ddaecfcb0.e 4.4 MB/s | 332 kB 00:00 2020-06-27T04:36:36.741 INFO:teuthology.orchestra.run.smithi051.stdout:(12/24): python3-rgw-16.0.0-2978.g77ddaecfcb0.e 4.2 MB/s | 113 kB 00:00 2020-06-27T04:36:36.777 INFO:teuthology.orchestra.run.smithi051.stdout:(13/24): librdkafka-0.11.4-1.el8.x86_64.rpm 9.3 MB/s | 353 kB 00:00 2020-06-27T04:36:36.778 INFO:teuthology.orchestra.run.smithi051.stdout:(14/24): python3-prettytable-0.7.2-14.el8.noarc 31 MB/s | 44 kB 00:00 2020-06-27T04:36:36.780 INFO:teuthology.orchestra.run.smithi051.stdout:(15/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.6 MB/s | 259 kB 00:00 2020-06-27T04:36:36.780 INFO:teuthology.orchestra.run.smithi051.stdout:(16/24): librabbitmq-0.9.0-1.el8.x86_64.rpm 28 MB/s | 47 kB 00:00 2020-06-27T04:36:36.875 INFO:teuthology.orchestra.run.smithi051.stdout:(17/24): fmt-6.2.1-1.el8.x86_64.rpm 1.2 MB/s | 116 kB 00:00 2020-06-27T04:36:36.882 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2020-06-27T04:36:36.883 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2020-06-27T04:36:36.894 INFO:teuthology.orchestra.run.smithi051.stdout:(18/24): gperftools-libs-2.7-6.el8.x86_64.rpm 2.7 MB/s | 315 kB 00:00 2020-06-27T04:36:36.913 INFO:teuthology.orchestra.run.smithi051.stdout:(19/24): leveldb-1.22-1.el8.x86_64.rpm 4.7 MB/s | 181 kB 00:00 2020-06-27T04:36:36.914 INFO:teuthology.orchestra.run.smithi051.stdout:(20/24): liboath-2.6.2-3.el8.x86_64.rpm 3.0 MB/s | 59 kB 00:00 2020-06-27T04:36:36.932 INFO:teuthology.orchestra.run.smithi051.stdout:(21/24): libunwind-1.3.1-3.el8.x86_64.rpm 3.8 MB/s | 75 kB 00:00 2020-06-27T04:36:37.251 INFO:teuthology.orchestra.run.smithi051.stdout:(22/24): librbd1-16.0.0-2978.g77ddaecfcb0.el8.x 6.3 MB/s | 2.0 MB 00:00 2020-06-27T04:36:37.503 INFO:teuthology.orchestra.run.smithi051.stdout:(23/24): librados2-16.0.0-2978.g77ddaecfcb0.el8 6.3 MB/s | 3.7 MB 00:00 2020-06-27T04:36:38.084 INFO:teuthology.orchestra.run.smithi051.stdout:(24/24): ceph-common-16.0.0-2978.g77ddaecfcb0.e 4.1 MB/s | 22 MB 00:05 2020-06-27T04:36:38.088 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:36:38.088 INFO:teuthology.orchestra.run.smithi051.stdout:Total 9.5 MB/s | 51 MB 00:05 2020-06-27T04:36:38.095 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2020-06-27T04:36:38.158 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2020-06-27T04:36:38.158 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2020-06-27T04:36:38.199 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2020-06-27T04:36:38.468 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2020-06-27T04:36:38.667 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2020-06-27T04:36:38.761 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2020-06-27T04:36:38.762 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2020-06-27T04:36:38.834 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2020-06-27T04:36:39.257 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2020-06-27T04:36:39.434 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librados2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 4/26 2020-06-27T04:36:39.531 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 4/26 2020-06-27T04:36:39.757 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rados-2:16.0.0-2978.g77ddaecfcb0.el8.x86_6 5/26 2020-06-27T04:36:39.926 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 6/26 2020-06-27T04:36:39.927 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2020-06-27T04:36:40.106 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2020-06-27T04:36:40.171 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 6/26 2020-06-27T04:36:40.295 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2020-06-27T04:36:40.401 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librbd1-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 7/26 2020-06-27T04:36:40.472 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2020-06-27T04:36:40.473 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 7/26 2020-06-27T04:36:40.677 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 8/26 2020-06-27T04:36:40.825 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/26 2020-06-27T04:36:40.883 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2020-06-27T04:36:41.055 INFO:teuthology.orchestra.run.smithi051.stdout: Upgrading : librados2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 4/26 2020-06-27T04:36:41.142 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: librados2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 4/26 2020-06-27T04:36:41.207 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/26 2020-06-27T04:36:41.361 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-rados-2:16.0.0-2978.g77ddaecfcb0.el8.x86_6 5/26 2020-06-27T04:36:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librgw2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 10/26 2020-06-27T04:36:41.436 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librgw2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 10/26 2020-06-27T04:36:41.497 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : libcephfs2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 6/26 2020-06-27T04:36:41.615 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2020-06-27T04:36:41.739 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: libcephfs2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 6/26 2020-06-27T04:36:41.748 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-argparse-2:16.0.0-2978.g77ddaecfcb0.e 12/26 2020-06-27T04:36:41.929 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cephfs-2:16.0.0-2978.g77ddaecfcb0.el8.x86_ 13/26 2020-06-27T04:36:41.938 INFO:teuthology.orchestra.run.smithi051.stdout: Upgrading : librbd1-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 7/26 2020-06-27T04:36:41.989 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: librbd1-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 7/26 2020-06-27T04:36:42.151 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 14/26 2020-06-27T04:36:42.190 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 8/26 2020-06-27T04:36:42.330 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/26 2020-06-27T04:36:42.373 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 15/26 2020-06-27T04:36:42.526 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libradosstriper1-2:16.0.0-2978.g77ddaecfcb0.el8.x8 16/26 2020-06-27T04:36:42.601 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libradosstriper1-2:16.0.0-2978.g77ddaecfcb0.el8.x8 16/26 2020-06-27T04:36:42.716 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/26 2020-06-27T04:36:42.798 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2020-06-27T04:36:42.888 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : librgw2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 10/26 2020-06-27T04:36:42.972 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: librgw2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 10/26 2020-06-27T04:36:43.009 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 18/26 2020-06-27T04:36:43.161 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2020-06-27T04:36:43.182 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2020-06-27T04:36:43.303 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-ceph-argparse-2:16.0.0-2978.g77ddaecfcb0.e 12/26 2020-06-27T04:36:43.350 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8 20/26 2020-06-27T04:36:43.475 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-cephfs-2:16.0.0-2978.g77ddaecfcb0.el8.x86_ 13/26 2020-06-27T04:36:43.697 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-rgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 14/26 2020-06-27T04:36:43.927 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-rbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 15/26 2020-06-27T04:36:44.063 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : libradosstriper1-2:16.0.0-2978.g77ddaecfcb0.el8.x8 16/26 2020-06-27T04:36:44.142 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: libradosstriper1-2:16.0.0-2978.g77ddaecfcb0.el8.x8 16/26 2020-06-27T04:36:44.336 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2020-06-27T04:36:44.513 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 18/26 2020-06-27T04:36:44.702 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2020-06-27T04:36:44.838 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8 20/26 2020-06-27T04:36:47.197 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 21/26 2020-06-27T04:36:47.366 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 21/26 2020-06-27T04:36:48.130 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 21/26 2020-06-27T04:36:48.451 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-base-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 22/26 2020-06-27T04:36:48.525 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-base-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 22/26 2020-06-27T04:36:48.683 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-selinux-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 23/26 2020-06-27T04:36:48.727 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 21/26 2020-06-27T04:36:48.946 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 21/26 2020-06-27T04:36:49.705 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 21/26 2020-06-27T04:36:50.010 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-base-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 22/26 2020-06-27T04:36:50.102 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-base-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 22/26 2020-06-27T04:36:50.229 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-selinux-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 23/26 2020-06-27T04:37:05.927 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-selinux-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 23/26 2020-06-27T04:37:05.928 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /sys 2020-06-27T04:37:05.928 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /proc 2020-06-27T04:37:05.928 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /dev 2020-06-27T04:37:05.928 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /run 2020-06-27T04:37:05.928 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /mnt 2020-06-27T04:37:05.929 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /var/tmp 2020-06-27T04:37:05.929 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /home 2020-06-27T04:37:05.929 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /tmp 2020-06-27T04:37:05.929 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /dev 2020-06-27T04:37:05.929 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:07.155 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-radosgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 24/26 2020-06-27T04:37:07.261 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 24/26 2020-06-27T04:37:07.262 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2020-06-27T04:37:07.482 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2020-06-27T04:37:07.482 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2020-06-27T04:37:07.558 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-selinux-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 23/26 2020-06-27T04:37:07.559 INFO:teuthology.orchestra.run.smithi051.stdout:skipping the directory /sys 2020-06-27T04:37:07.559 INFO:teuthology.orchestra.run.smithi051.stdout:skipping the directory /proc 2020-06-27T04:37:07.559 INFO:teuthology.orchestra.run.smithi051.stdout:skipping the directory /dev 2020-06-27T04:37:07.560 INFO:teuthology.orchestra.run.smithi051.stdout:skipping the directory /run 2020-06-27T04:37:07.560 INFO:teuthology.orchestra.run.smithi051.stdout:skipping the directory /mnt 2020-06-27T04:37:07.560 INFO:teuthology.orchestra.run.smithi051.stdout:skipping the directory /var/tmp 2020-06-27T04:37:07.560 INFO:teuthology.orchestra.run.smithi051.stdout:skipping the directory /home 2020-06-27T04:37:07.560 INFO:teuthology.orchestra.run.smithi051.stdout:skipping the directory /tmp 2020-06-27T04:37:07.560 INFO:teuthology.orchestra.run.smithi051.stdout:skipping the directory /dev 2020-06-27T04:37:07.561 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:08.137 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2020-06-27T04:37:08.138 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-base-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/26 2020-06-27T04:37:08.138 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2/26 2020-06-27T04:37:08.138 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-radosgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 3/26 2020-06-27T04:37:08.138 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-selinux-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 4/26 2020-06-27T04:37:08.138 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 5/26 2020-06-27T04:37:08.139 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libradosstriper1-2:16.0.0-2978.g77ddaecfcb0.el8.x8 6/26 2020-06-27T04:37:08.139 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librgw2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 7/26 2020-06-27T04:37:08.139 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-argparse-2:16.0.0-2978.g77ddaecfcb0.e 8/26 2020-06-27T04:37:08.139 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8 9/26 2020-06-27T04:37:08.139 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cephfs-2:16.0.0-2978.g77ddaecfcb0.el8.x86_ 10/26 2020-06-27T04:37:08.140 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rados-2:16.0.0-2978.g77ddaecfcb0.el8.x86_6 11/26 2020-06-27T04:37:08.140 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 12/26 2020-06-27T04:37:08.140 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 13/26 2020-06-27T04:37:08.140 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/26 2020-06-27T04:37:08.140 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2020-06-27T04:37:08.141 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2020-06-27T04:37:08.141 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 17/26 2020-06-27T04:37:08.141 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2020-06-27T04:37:08.141 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 19/26 2020-06-27T04:37:08.141 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2020-06-27T04:37:08.141 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2020-06-27T04:37:08.142 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2020-06-27T04:37:08.142 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 23/26 2020-06-27T04:37:08.142 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2020-06-27T04:37:08.142 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 25/26 2020-06-27T04:37:08.776 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-radosgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 24/26 2020-06-27T04:37:08.814 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2020-06-27T04:37:08.814 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:08.814 INFO:teuthology.orchestra.run.smithi031.stdout:Upgraded: 2020-06-27T04:37:08.815 INFO:teuthology.orchestra.run.smithi031.stdout: librados2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:08.815 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:08.815 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:08.815 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2020-06-27T04:37:08.815 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:08.816 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:08.816 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:08.816 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:08.816 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:08.816 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:08.817 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:08.817 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:08.817 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:08.817 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:08.817 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:08.817 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:08.818 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:08.818 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-06-27T04:37:08.818 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-06-27T04:37:08.818 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-06-27T04:37:08.818 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-06-27T04:37:08.819 INFO:teuthology.orchestra.run.smithi031.stdout: fmt-6.2.1-1.el8.x86_64 2020-06-27T04:37:08.819 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-06-27T04:37:08.819 INFO:teuthology.orchestra.run.smithi031.stdout: leveldb-1.22-1.el8.x86_64 2020-06-27T04:37:08.819 INFO:teuthology.orchestra.run.smithi031.stdout: liboath-2.6.2-3.el8.x86_64 2020-06-27T04:37:08.819 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind-1.3.1-3.el8.x86_64 2020-06-27T04:37:08.819 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:08.820 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:37:08.842 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 24/26 2020-06-27T04:37:08.842 INFO:teuthology.orchestra.run.smithi051.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2020-06-27T04:37:09.028 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-test 2020-06-27T04:37:09.045 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2020-06-27T04:37:09.045 INFO:teuthology.orchestra.run.smithi051.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2020-06-27T04:37:09.483 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:38 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:37:09.695 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2020-06-27T04:37:09.695 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-base-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/26 2020-06-27T04:37:09.695 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2/26 2020-06-27T04:37:09.695 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-radosgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 3/26 2020-06-27T04:37:09.696 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-selinux-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 4/26 2020-06-27T04:37:09.696 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : libcephfs2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 5/26 2020-06-27T04:37:09.696 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : libradosstriper1-2:16.0.0-2978.g77ddaecfcb0.el8.x8 6/26 2020-06-27T04:37:09.696 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : librgw2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 7/26 2020-06-27T04:37:09.696 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-ceph-argparse-2:16.0.0-2978.g77ddaecfcb0.e 8/26 2020-06-27T04:37:09.697 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8 9/26 2020-06-27T04:37:09.697 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-cephfs-2:16.0.0-2978.g77ddaecfcb0.el8.x86_ 10/26 2020-06-27T04:37:09.697 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-rados-2:16.0.0-2978.g77ddaecfcb0.el8.x86_6 11/26 2020-06-27T04:37:09.697 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-rbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 12/26 2020-06-27T04:37:09.697 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-rgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 13/26 2020-06-27T04:37:09.698 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/26 2020-06-27T04:37:09.698 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2020-06-27T04:37:09.698 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2020-06-27T04:37:09.698 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 17/26 2020-06-27T04:37:09.698 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2020-06-27T04:37:09.698 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 19/26 2020-06-27T04:37:09.699 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2020-06-27T04:37:09.699 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2020-06-27T04:37:09.699 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2020-06-27T04:37:09.699 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : librados2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 23/26 2020-06-27T04:37:09.699 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2020-06-27T04:37:09.700 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : librbd1-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 25/26 2020-06-27T04:37:09.949 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:37:09.950 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:37:09.950 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2020-06-27T04:37:09.951 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:37:09.951 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2020-06-27T04:37:09.951 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 45 M 2020-06-27T04:37:09.951 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2020-06-27T04:37:09.952 INFO:teuthology.orchestra.run.smithi031.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2020-06-27T04:37:09.952 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma x86_64 6.8.2-1.el8 CentOS-AppStream 188 k 2020-06-27T04:37:09.952 INFO:teuthology.orchestra.run.smithi031.stdout: socat x86_64 1.7.3.2-6.el8 CentOS-AppStream 298 k 2020-06-27T04:37:09.952 INFO:teuthology.orchestra.run.smithi031.stdout: libxslt x86_64 1.1.32-3.el8 CentOS-Base 249 k 2020-06-27T04:37:09.952 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-06-27T04:37:09.953 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:09.953 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2020-06-27T04:37:09.953 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:37:09.953 INFO:teuthology.orchestra.run.smithi031.stdout:Install 6 Packages 2020-06-27T04:37:09.953 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:09.954 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 46 M 2020-06-27T04:37:09.954 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 196 M 2020-06-27T04:37:09.955 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2020-06-27T04:37:09.988 INFO:teuthology.orchestra.run.smithi031.stdout:(1/6): jq-1.5-12.el8.x86_64.rpm 4.5 MB/s | 161 kB 00:00 2020-06-27T04:37:09.991 INFO:teuthology.orchestra.run.smithi031.stdout:(2/6): oniguruma-6.8.2-1.el8.x86_64.rpm 4.8 MB/s | 188 kB 00:00 2020-06-27T04:37:09.994 INFO:teuthology.orchestra.run.smithi031.stdout:(3/6): socat-1.7.3.2-6.el8.x86_64.rpm 45 MB/s | 298 kB 00:00 2020-06-27T04:37:09.997 INFO:teuthology.orchestra.run.smithi031.stdout:(4/6): libxslt-1.1.32-3.el8.x86_64.rpm 54 MB/s | 249 kB 00:00 2020-06-27T04:37:10.057 INFO:teuthology.orchestra.run.smithi031.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.1 MB/s | 69 kB 00:00 2020-06-27T04:37:10.352 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2020-06-27T04:37:10.352 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:10.353 INFO:teuthology.orchestra.run.smithi051.stdout:Upgraded: 2020-06-27T04:37:10.353 INFO:teuthology.orchestra.run.smithi051.stdout: librados2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:10.353 INFO:teuthology.orchestra.run.smithi051.stdout: librbd1-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:10.353 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:10.353 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2020-06-27T04:37:10.354 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-radosgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:10.354 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-base-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:10.354 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:10.354 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-selinux-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:10.354 INFO:teuthology.orchestra.run.smithi051.stdout: libcephfs2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:10.355 INFO:teuthology.orchestra.run.smithi051.stdout: libradosstriper1-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:10.355 INFO:teuthology.orchestra.run.smithi051.stdout: librgw2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:10.355 INFO:teuthology.orchestra.run.smithi051.stdout: python3-ceph-argparse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:10.355 INFO:teuthology.orchestra.run.smithi051.stdout: python3-ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:10.355 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cephfs-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:10.356 INFO:teuthology.orchestra.run.smithi051.stdout: python3-rados-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:10.356 INFO:teuthology.orchestra.run.smithi051.stdout: python3-rbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:10.356 INFO:teuthology.orchestra.run.smithi051.stdout: python3-rgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:10.356 INFO:teuthology.orchestra.run.smithi051.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-06-27T04:37:10.356 INFO:teuthology.orchestra.run.smithi051.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-06-27T04:37:10.357 INFO:teuthology.orchestra.run.smithi051.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-06-27T04:37:10.357 INFO:teuthology.orchestra.run.smithi051.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-06-27T04:37:10.357 INFO:teuthology.orchestra.run.smithi051.stdout: fmt-6.2.1-1.el8.x86_64 2020-06-27T04:37:10.357 INFO:teuthology.orchestra.run.smithi051.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-06-27T04:37:10.357 INFO:teuthology.orchestra.run.smithi051.stdout: leveldb-1.22-1.el8.x86_64 2020-06-27T04:37:10.358 INFO:teuthology.orchestra.run.smithi051.stdout: liboath-2.6.2-3.el8.x86_64 2020-06-27T04:37:10.358 INFO:teuthology.orchestra.run.smithi051.stdout: libunwind-1.3.1-3.el8.x86_64 2020-06-27T04:37:10.358 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:10.358 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:37:10.552 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-test 2020-06-27T04:37:10.999 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:00:39 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:37:11.386 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:37:11.387 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:37:11.388 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repository Size 2020-06-27T04:37:11.388 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:37:11.388 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2020-06-27T04:37:11.388 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-test x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 45 M 2020-06-27T04:37:11.389 INFO:teuthology.orchestra.run.smithi051.stdout:Installing dependencies: 2020-06-27T04:37:11.389 INFO:teuthology.orchestra.run.smithi051.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2020-06-27T04:37:11.389 INFO:teuthology.orchestra.run.smithi051.stdout: oniguruma x86_64 6.8.2-1.el8 CentOS-AppStream 188 k 2020-06-27T04:37:11.389 INFO:teuthology.orchestra.run.smithi051.stdout: socat x86_64 1.7.3.2-6.el8 CentOS-AppStream 298 k 2020-06-27T04:37:11.389 INFO:teuthology.orchestra.run.smithi051.stdout: libxslt x86_64 1.1.32-3.el8 CentOS-Base 249 k 2020-06-27T04:37:11.390 INFO:teuthology.orchestra.run.smithi051.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-06-27T04:37:11.390 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:11.390 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2020-06-27T04:37:11.390 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:37:11.390 INFO:teuthology.orchestra.run.smithi051.stdout:Install 6 Packages 2020-06-27T04:37:11.391 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:11.391 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 46 M 2020-06-27T04:37:11.391 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 196 M 2020-06-27T04:37:11.392 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2020-06-27T04:37:11.422 INFO:teuthology.orchestra.run.smithi051.stdout:(1/6): jq-1.5-12.el8.x86_64.rpm 5.0 MB/s | 161 kB 00:00 2020-06-27T04:37:11.428 INFO:teuthology.orchestra.run.smithi051.stdout:(2/6): socat-1.7.3.2-6.el8.x86_64.rpm 55 MB/s | 298 kB 00:00 2020-06-27T04:37:11.430 INFO:teuthology.orchestra.run.smithi051.stdout:(3/6): oniguruma-6.8.2-1.el8.x86_64.rpm 4.6 MB/s | 188 kB 00:00 2020-06-27T04:37:11.432 INFO:teuthology.orchestra.run.smithi051.stdout:(4/6): libxslt-1.1.32-3.el8.x86_64.rpm 62 MB/s | 249 kB 00:00 2020-06-27T04:37:11.506 INFO:teuthology.orchestra.run.smithi051.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 911 kB/s | 69 kB 00:00 2020-06-27T04:37:12.422 INFO:teuthology.orchestra.run.smithi031.stdout:(6/6): ceph-test-16.0.0-2978.g77ddaecfcb0.el8.x 18 MB/s | 45 MB 00:02 2020-06-27T04:37:12.424 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:37:12.425 INFO:teuthology.orchestra.run.smithi031.stdout:Total 19 MB/s | 46 MB 00:02 2020-06-27T04:37:12.431 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2020-06-27T04:37:12.456 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2020-06-27T04:37:12.456 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2020-06-27T04:37:12.748 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2020-06-27T04:37:12.749 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2020-06-27T04:37:13.250 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2020-06-27T04:37:13.422 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 1/6 2020-06-27T04:37:13.614 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2020-06-27T04:37:13.741 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 3/6 2020-06-27T04:37:13.895 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 4/6 2020-06-27T04:37:13.989 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 4/6 2020-06-27T04:37:14.711 INFO:teuthology.orchestra.run.smithi051.stdout:(6/6): ceph-test-16.0.0-2978.g77ddaecfcb0.el8.x 14 MB/s | 45 MB 00:03 2020-06-27T04:37:14.714 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:37:14.714 INFO:teuthology.orchestra.run.smithi051.stdout:Total 14 MB/s | 46 MB 00:03 2020-06-27T04:37:14.722 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2020-06-27T04:37:14.746 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2020-06-27T04:37:14.747 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2020-06-27T04:37:15.025 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2020-06-27T04:37:15.026 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2020-06-27T04:37:15.510 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2020-06-27T04:37:15.668 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 1/6 2020-06-27T04:37:15.874 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2020-06-27T04:37:16.021 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 3/6 2020-06-27T04:37:16.189 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 4/6 2020-06-27T04:37:16.266 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 4/6 2020-06-27T04:37:18.544 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : jq-1.5-12.el8.x86_64 5/6 2020-06-27T04:37:18.767 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-test-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 6/6 2020-06-27T04:37:18.986 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-test-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 6/6 2020-06-27T04:37:18.986 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-test-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/6 2020-06-27T04:37:18.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : jq-1.5-12.el8.x86_64 2/6 2020-06-27T04:37:18.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 3/6 2020-06-27T04:37:18.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 4/6 2020-06-27T04:37:18.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 5/6 2020-06-27T04:37:19.410 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2020-06-27T04:37:19.411 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:19.411 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2020-06-27T04:37:19.411 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:19.411 INFO:teuthology.orchestra.run.smithi031.stdout: jq-1.5-12.el8.x86_64 2020-06-27T04:37:19.412 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-06-27T04:37:19.412 INFO:teuthology.orchestra.run.smithi031.stdout: socat-1.7.3.2-6.el8.x86_64 2020-06-27T04:37:19.412 INFO:teuthology.orchestra.run.smithi031.stdout: libxslt-1.1.32-3.el8.x86_64 2020-06-27T04:37:19.412 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-06-27T04:37:19.412 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:19.413 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:37:19.681 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph 2020-06-27T04:37:20.115 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:49 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:37:20.583 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:37:20.587 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:37:20.587 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2020-06-27T04:37:20.588 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:37:20.588 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2020-06-27T04:37:20.588 INFO:teuthology.orchestra.run.smithi031.stdout: ceph x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:37:20.588 INFO:teuthology.orchestra.run.smithi031.stdout: ceph 6.5 k 2020-06-27T04:37:20.588 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2020-06-27T04:37:20.589 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:37:20.589 INFO:teuthology.orchestra.run.smithi031.stdout: ceph 2.1 M 2020-06-27T04:37:20.589 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:37:20.589 INFO:teuthology.orchestra.run.smithi031.stdout: ceph 1.5 M 2020-06-27T04:37:20.590 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:37:20.590 INFO:teuthology.orchestra.run.smithi031.stdout: ceph 4.9 M 2020-06-27T04:37:20.590 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:37:20.590 INFO:teuthology.orchestra.run.smithi031.stdout: ceph 18 M 2020-06-27T04:37:20.590 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core noarch 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:37:20.591 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-noarch 172 k 2020-06-27T04:37:20.591 INFO:teuthology.orchestra.run.smithi031.stdout: python3-lxml x86_64 4.2.3-1.el8 CentOS-AppStream 1.5 M 2020-06-27T04:37:20.591 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2020-06-27T04:37:20.591 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2020-06-27T04:37:20.591 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2020-06-27T04:37:20.591 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2020-06-27T04:37:20.592 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2020-06-27T04:37:20.592 INFO:teuthology.orchestra.run.smithi031.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2020-06-27T04:37:20.592 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2020-06-27T04:37:20.592 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-06-27T04:37:20.592 INFO:teuthology.orchestra.run.smithi031.stdout: python3-urllib3 noarch 1.24.2-2.el8 CentOS-Base 176 k 2020-06-27T04:37:20.593 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-06-27T04:37:20.593 INFO:teuthology.orchestra.run.smithi031.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-06-27T04:37:20.593 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot noarch 8.2.1-1.el8 epel 145 k 2020-06-27T04:37:20.593 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2020-06-27T04:37:20.593 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2020-06-27T04:37:20.594 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2020-06-27T04:37:20.594 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2020-06-27T04:37:20.594 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2020-06-27T04:37:20.594 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2020-06-27T04:37:20.594 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2020-06-27T04:37:20.595 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2020-06-27T04:37:20.595 INFO:teuthology.orchestra.run.smithi031.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2020-06-27T04:37:20.595 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2020-06-27T04:37:20.595 INFO:teuthology.orchestra.run.smithi031.stdout: python3-trustme noarch 0.5.2-4.el8 epel 26 k 2020-06-27T04:37:20.595 INFO:teuthology.orchestra.run.smithi031.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-06-27T04:37:20.595 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-06-27T04:37:20.596 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-06-27T04:37:20.596 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2020-06-27T04:37:20.596 INFO:teuthology.orchestra.run.smithi031.stdout:Installing weak dependencies: 2020-06-27T04:37:20.596 INFO:teuthology.orchestra.run.smithi031.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-06-27T04:37:20.596 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-06-27T04:37:20.597 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:20.597 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2020-06-27T04:37:20.597 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:37:20.597 INFO:teuthology.orchestra.run.smithi031.stdout:Install 36 Packages 2020-06-27T04:37:20.597 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:20.598 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 32 M 2020-06-27T04:37:20.598 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 111 M 2020-06-27T04:37:20.598 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2020-06-27T04:37:20.799 INFO:teuthology.orchestra.run.smithi031.stdout:(1/36): ceph-16.0.0-2978.g77ddaecfcb0.el8.x86_6 32 kB/s | 6.5 kB 00:00 2020-06-27T04:37:20.847 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : jq-1.5-12.el8.x86_64 5/6 2020-06-27T04:37:21.097 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-test-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 6/6 2020-06-27T04:37:21.322 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-test-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 6/6 2020-06-27T04:37:21.322 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-test-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/6 2020-06-27T04:37:21.322 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : jq-1.5-12.el8.x86_64 2/6 2020-06-27T04:37:21.323 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 3/6 2020-06-27T04:37:21.323 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 4/6 2020-06-27T04:37:21.323 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 5/6 2020-06-27T04:37:21.601 INFO:teuthology.orchestra.run.smithi031.stdout:(2/36): ceph-mgr-16.0.0-2978.g77ddaecfcb0.el8.x 1.5 MB/s | 1.5 MB 00:01 2020-06-27T04:37:21.674 INFO:teuthology.orchestra.run.smithi031.stdout:(3/36): ceph-mds-16.0.0-2978.g77ddaecfcb0.el8.x 2.0 MB/s | 2.1 MB 00:01 2020-06-27T04:37:21.683 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2020-06-27T04:37:21.683 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:21.683 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2020-06-27T04:37:21.684 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-test-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:21.684 INFO:teuthology.orchestra.run.smithi051.stdout: jq-1.5-12.el8.x86_64 2020-06-27T04:37:21.684 INFO:teuthology.orchestra.run.smithi051.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-06-27T04:37:21.684 INFO:teuthology.orchestra.run.smithi051.stdout: socat-1.7.3.2-6.el8.x86_64 2020-06-27T04:37:21.684 INFO:teuthology.orchestra.run.smithi051.stdout: libxslt-1.1.32-3.el8.x86_64 2020-06-27T04:37:21.685 INFO:teuthology.orchestra.run.smithi051.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-06-27T04:37:21.685 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:21.685 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:37:21.711 INFO:teuthology.orchestra.run.smithi031.stdout:(4/36): ceph-mgr-modules-core-16.0.0-2978.g77dd 4.6 MB/s | 172 kB 00:00 2020-06-27T04:37:21.745 INFO:teuthology.orchestra.run.smithi031.stdout:(5/36): python3-html5lib-0.999999999-6.el8.noar 6.3 MB/s | 214 kB 00:00 2020-06-27T04:37:21.764 INFO:teuthology.orchestra.run.smithi031.stdout:(6/36): python3-lxml-4.2.3-1.el8.x86_64.rpm 81 MB/s | 1.5 MB 00:00 2020-06-27T04:37:21.766 INFO:teuthology.orchestra.run.smithi031.stdout:(7/36): python3-mako-1.0.6-13.el8.noarch.rpm 58 MB/s | 157 kB 00:00 2020-06-27T04:37:21.768 INFO:teuthology.orchestra.run.smithi031.stdout:(8/36): python3-markupsafe-0.23-19.el8.x86_64.r 28 MB/s | 39 kB 00:00 2020-06-27T04:37:21.769 INFO:teuthology.orchestra.run.smithi031.stdout:(9/36): python3-pytz-2017.2-9.el8.noarch.rpm 35 MB/s | 54 kB 00:00 2020-06-27T04:37:21.771 INFO:teuthology.orchestra.run.smithi031.stdout:(10/36): python3-webencodings-0.5.1-6.el8.noarc 21 MB/s | 27 kB 00:00 2020-06-27T04:37:21.777 INFO:teuthology.orchestra.run.smithi031.stdout:(11/36): python3-werkzeug-0.12.2-4.el8.noarch.r 74 MB/s | 457 kB 00:00 2020-06-27T04:37:21.781 INFO:teuthology.orchestra.run.smithi031.stdout:(12/36): python3-chardet-3.0.4-7.el8.noarch.rpm 60 MB/s | 195 kB 00:00 2020-06-27T04:37:21.782 INFO:teuthology.orchestra.run.smithi031.stdout:(13/36): python3-pysocks-1.6.8-3.el8.noarch.rpm 28 MB/s | 34 kB 00:00 2020-06-27T04:37:21.784 INFO:teuthology.orchestra.run.smithi031.stdout:(14/36): python3-requests-2.20.0-2.1.el8_1.noar 54 MB/s | 123 kB 00:00 2020-06-27T04:37:21.787 INFO:teuthology.orchestra.run.smithi031.stdout:(15/36): python3-urllib3-1.24.2-2.el8.noarch.rp 62 MB/s | 176 kB 00:00 2020-06-27T04:37:21.851 INFO:teuthology.orchestra.run.smithi031.stdout:(16/36): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 691 kB/s | 44 kB 00:00 2020-06-27T04:37:21.897 INFO:teuthology.orchestra.run.smithi031.stdout:(17/36): python3-beautifulsoup4-4.6.3-2.el8.1.n 3.9 MB/s | 185 kB 00:00 2020-06-27T04:37:21.914 INFO:teuthology.orchestra.run.smithi031.stdout:(18/36): python3-cheroot-8.2.1-1.el8.noarch.rpm 8.6 MB/s | 145 kB 00:00 2020-06-27T04:37:21.961 INFO:teuthology.orchestra.run.smithi031.stdout:(19/36): python3-cherrypy-18.4.0-1.el8.noarch.r 8.0 MB/s | 384 kB 00:00 2020-06-27T04:37:21.977 INFO:teuthology.orchestra.run.smithi031.stdout:(20/36): python3-cssselect-0.9.2-10.el8.noarch. 2.5 MB/s | 40 kB 00:00 2020-06-27T04:37:21.991 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph 2020-06-27T04:37:21.993 INFO:teuthology.orchestra.run.smithi031.stdout:(21/36): python3-jaraco-6.2-6.el8.noarch.rpm 715 kB/s | 11 kB 00:00 2020-06-27T04:37:22.009 INFO:teuthology.orchestra.run.smithi031.stdout:(22/36): python3-jaraco-functools-2.0-4.el8.noa 1.1 MB/s | 18 kB 00:00 2020-06-27T04:37:22.025 INFO:teuthology.orchestra.run.smithi031.stdout:(23/36): python3-logutils-0.3.5-11.el8.noarch.r 3.0 MB/s | 49 kB 00:00 2020-06-27T04:37:22.041 INFO:teuthology.orchestra.run.smithi031.stdout:(24/36): python3-more-itertools-7.2.0-3.el8.noa 3.6 MB/s | 59 kB 00:00 2020-06-27T04:37:22.074 INFO:teuthology.orchestra.run.smithi031.stdout:(25/36): python3-pecan-1.3.2-9.el8.noarch.rpm 8.6 MB/s | 283 kB 00:00 2020-06-27T04:37:22.090 INFO:teuthology.orchestra.run.smithi031.stdout:(26/36): python3-portend-2.6-1.el8.noarch.rpm 979 kB/s | 16 kB 00:00 2020-06-27T04:37:22.106 INFO:teuthology.orchestra.run.smithi031.stdout:(27/36): python3-simplegeneric-0.8.1-17.el8.noa 1.1 MB/s | 19 kB 00:00 2020-06-27T04:37:22.122 INFO:teuthology.orchestra.run.smithi031.stdout:(28/36): python3-singledispatch-3.4.0.3-18.el8. 1.5 MB/s | 24 kB 00:00 2020-06-27T04:37:22.138 INFO:teuthology.orchestra.run.smithi031.stdout:(29/36): python3-tempora-1.14.1-5.el8.noarch.rp 1.8 MB/s | 29 kB 00:00 2020-06-27T04:37:22.154 INFO:teuthology.orchestra.run.smithi031.stdout:(30/36): python3-trustme-0.5.2-4.el8.noarch.rpm 1.7 MB/s | 26 kB 00:00 2020-06-27T04:37:22.185 INFO:teuthology.orchestra.run.smithi031.stdout:(31/36): python3-waitress-1.2.1-2.el8.1.noarch. 7.5 MB/s | 241 kB 00:00 2020-06-27T04:37:22.217 INFO:teuthology.orchestra.run.smithi031.stdout:(32/36): python3-webob-1.8.5-1.el8.1.noarch.rpm 7.7 MB/s | 251 kB 00:00 2020-06-27T04:37:22.233 INFO:teuthology.orchestra.run.smithi031.stdout:(33/36): python3-webtest-2.0.33-1.el8.noarch.rp 5.2 MB/s | 85 kB 00:00 2020-06-27T04:37:22.249 INFO:teuthology.orchestra.run.smithi031.stdout:(34/36): python3-zc-lockfile-2.0-2.el8.noarch.r 1.4 MB/s | 23 kB 00:00 2020-06-27T04:37:22.425 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:00:51 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:37:22.789 INFO:teuthology.orchestra.run.smithi031.stdout:(35/36): ceph-mon-16.0.0-2978.g77ddaecfcb0.el8. 2.5 MB/s | 4.9 MB 00:01 2020-06-27T04:37:23.373 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:37:23.379 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:37:23.379 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repository Size 2020-06-27T04:37:23.379 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:37:23.380 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2020-06-27T04:37:23.380 INFO:teuthology.orchestra.run.smithi051.stdout: ceph x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:37:23.380 INFO:teuthology.orchestra.run.smithi051.stdout: ceph 6.5 k 2020-06-27T04:37:23.380 INFO:teuthology.orchestra.run.smithi051.stdout:Installing dependencies: 2020-06-27T04:37:23.380 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mds x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:37:23.381 INFO:teuthology.orchestra.run.smithi051.stdout: ceph 2.1 M 2020-06-27T04:37:23.381 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:37:23.381 INFO:teuthology.orchestra.run.smithi051.stdout: ceph 1.5 M 2020-06-27T04:37:23.381 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mon x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:37:23.381 INFO:teuthology.orchestra.run.smithi051.stdout: ceph 4.9 M 2020-06-27T04:37:23.382 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-osd x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:37:23.382 INFO:teuthology.orchestra.run.smithi051.stdout: ceph 18 M 2020-06-27T04:37:23.382 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-modules-core noarch 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:37:23.382 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-noarch 172 k 2020-06-27T04:37:23.382 INFO:teuthology.orchestra.run.smithi051.stdout: python3-lxml x86_64 4.2.3-1.el8 CentOS-AppStream 1.5 M 2020-06-27T04:37:23.383 INFO:teuthology.orchestra.run.smithi051.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2020-06-27T04:37:23.383 INFO:teuthology.orchestra.run.smithi051.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2020-06-27T04:37:23.383 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2020-06-27T04:37:23.383 INFO:teuthology.orchestra.run.smithi051.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2020-06-27T04:37:23.383 INFO:teuthology.orchestra.run.smithi051.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2020-06-27T04:37:23.384 INFO:teuthology.orchestra.run.smithi051.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2020-06-27T04:37:23.384 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2020-06-27T04:37:23.384 INFO:teuthology.orchestra.run.smithi051.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-06-27T04:37:23.384 INFO:teuthology.orchestra.run.smithi051.stdout: python3-urllib3 noarch 1.24.2-2.el8 CentOS-Base 176 k 2020-06-27T04:37:23.384 INFO:teuthology.orchestra.run.smithi051.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-06-27T04:37:23.385 INFO:teuthology.orchestra.run.smithi051.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-06-27T04:37:23.385 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cheroot noarch 8.2.1-1.el8 epel 145 k 2020-06-27T04:37:23.385 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2020-06-27T04:37:23.385 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2020-06-27T04:37:23.385 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2020-06-27T04:37:23.385 INFO:teuthology.orchestra.run.smithi051.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2020-06-27T04:37:23.386 INFO:teuthology.orchestra.run.smithi051.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2020-06-27T04:37:23.386 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2020-06-27T04:37:23.386 INFO:teuthology.orchestra.run.smithi051.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2020-06-27T04:37:23.386 INFO:teuthology.orchestra.run.smithi051.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2020-06-27T04:37:23.386 INFO:teuthology.orchestra.run.smithi051.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2020-06-27T04:37:23.387 INFO:teuthology.orchestra.run.smithi051.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2020-06-27T04:37:23.387 INFO:teuthology.orchestra.run.smithi051.stdout: python3-trustme noarch 0.5.2-4.el8 epel 26 k 2020-06-27T04:37:23.387 INFO:teuthology.orchestra.run.smithi051.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-06-27T04:37:23.387 INFO:teuthology.orchestra.run.smithi051.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-06-27T04:37:23.387 INFO:teuthology.orchestra.run.smithi051.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-06-27T04:37:23.388 INFO:teuthology.orchestra.run.smithi051.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2020-06-27T04:37:23.388 INFO:teuthology.orchestra.run.smithi051.stdout:Installing weak dependencies: 2020-06-27T04:37:23.388 INFO:teuthology.orchestra.run.smithi051.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-06-27T04:37:23.388 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-06-27T04:37:23.388 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:23.389 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2020-06-27T04:37:23.389 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:37:23.389 INFO:teuthology.orchestra.run.smithi051.stdout:Install 36 Packages 2020-06-27T04:37:23.389 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:23.390 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 32 M 2020-06-27T04:37:23.390 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 111 M 2020-06-27T04:37:23.390 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2020-06-27T04:37:23.524 INFO:teuthology.orchestra.run.smithi051.stdout:(1/36): ceph-16.0.0-2978.g77ddaecfcb0.el8.x86_6 46 kB/s | 6.5 kB 00:00 2020-06-27T04:37:23.748 INFO:teuthology.orchestra.run.smithi051.stdout:(2/36): ceph-mgr-16.0.0-2978.g77ddaecfcb0.el8.x 4.2 MB/s | 1.5 MB 00:00 2020-06-27T04:37:23.818 INFO:teuthology.orchestra.run.smithi051.stdout:(3/36): ceph-mds-16.0.0-2978.g77ddaecfcb0.el8.x 5.0 MB/s | 2.1 MB 00:00 2020-06-27T04:37:23.874 INFO:teuthology.orchestra.run.smithi051.stdout:(4/36): ceph-mgr-modules-core-16.0.0-2978.g77dd 3.0 MB/s | 172 kB 00:00 2020-06-27T04:37:23.949 INFO:teuthology.orchestra.run.smithi051.stdout:(5/36): python3-html5lib-0.999999999-6.el8.noar 5.8 MB/s | 214 kB 00:00 2020-06-27T04:37:23.969 INFO:teuthology.orchestra.run.smithi051.stdout:(6/36): python3-lxml-4.2.3-1.el8.x86_64.rpm 78 MB/s | 1.5 MB 00:00 2020-06-27T04:37:23.971 INFO:teuthology.orchestra.run.smithi051.stdout:(7/36): python3-mako-1.0.6-13.el8.noarch.rpm 59 MB/s | 157 kB 00:00 2020-06-27T04:37:23.973 INFO:teuthology.orchestra.run.smithi051.stdout:(8/36): python3-markupsafe-0.23-19.el8.x86_64.r 28 MB/s | 39 kB 00:00 2020-06-27T04:37:23.974 INFO:teuthology.orchestra.run.smithi051.stdout:(9/36): python3-pytz-2017.2-9.el8.noarch.rpm 36 MB/s | 54 kB 00:00 2020-06-27T04:37:23.976 INFO:teuthology.orchestra.run.smithi051.stdout:(10/36): python3-webencodings-0.5.1-6.el8.noarc 22 MB/s | 27 kB 00:00 2020-06-27T04:37:23.982 INFO:teuthology.orchestra.run.smithi051.stdout:(11/36): python3-werkzeug-0.12.2-4.el8.noarch.r 72 MB/s | 457 kB 00:00 2020-06-27T04:37:23.990 INFO:teuthology.orchestra.run.smithi051.stdout:(12/36): python3-chardet-3.0.4-7.el8.noarch.rpm 25 MB/s | 195 kB 00:00 2020-06-27T04:37:23.992 INFO:teuthology.orchestra.run.smithi051.stdout:(13/36): python3-pysocks-1.6.8-3.el8.noarch.rpm 23 MB/s | 34 kB 00:00 2020-06-27T04:37:23.994 INFO:teuthology.orchestra.run.smithi051.stdout:(14/36): python3-requests-2.20.0-2.1.el8_1.noar 53 MB/s | 123 kB 00:00 2020-06-27T04:37:23.997 INFO:teuthology.orchestra.run.smithi051.stdout:(15/36): python3-urllib3-1.24.2-2.el8.noarch.rp 60 MB/s | 176 kB 00:00 2020-06-27T04:37:24.072 INFO:teuthology.orchestra.run.smithi051.stdout:(16/36): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 582 kB/s | 44 kB 00:00 2020-06-27T04:37:24.129 INFO:teuthology.orchestra.run.smithi051.stdout:(17/36): python3-beautifulsoup4-4.6.3-2.el8.1.n 3.2 MB/s | 185 kB 00:00 2020-06-27T04:37:24.167 INFO:teuthology.orchestra.run.smithi051.stdout:(18/36): python3-cheroot-8.2.1-1.el8.noarch.rpm 3.8 MB/s | 145 kB 00:00 2020-06-27T04:37:24.224 INFO:teuthology.orchestra.run.smithi051.stdout:(19/36): python3-cherrypy-18.4.0-1.el8.noarch.r 6.6 MB/s | 384 kB 00:00 2020-06-27T04:37:24.243 INFO:teuthology.orchestra.run.smithi051.stdout:(20/36): python3-cssselect-0.9.2-10.el8.noarch. 2.1 MB/s | 40 kB 00:00 2020-06-27T04:37:24.262 INFO:teuthology.orchestra.run.smithi051.stdout:(21/36): python3-jaraco-6.2-6.el8.noarch.rpm 585 kB/s | 11 kB 00:00 2020-06-27T04:37:24.281 INFO:teuthology.orchestra.run.smithi051.stdout:(22/36): python3-jaraco-functools-2.0-4.el8.noa 926 kB/s | 18 kB 00:00 2020-06-27T04:37:24.300 INFO:teuthology.orchestra.run.smithi051.stdout:(23/36): python3-logutils-0.3.5-11.el8.noarch.r 2.5 MB/s | 49 kB 00:00 2020-06-27T04:37:24.319 INFO:teuthology.orchestra.run.smithi051.stdout:(24/36): python3-more-itertools-7.2.0-3.el8.noa 3.0 MB/s | 59 kB 00:00 2020-06-27T04:37:24.359 INFO:teuthology.orchestra.run.smithi051.stdout:(25/36): python3-pecan-1.3.2-9.el8.noarch.rpm 7.0 MB/s | 283 kB 00:00 2020-06-27T04:37:24.378 INFO:teuthology.orchestra.run.smithi051.stdout:(26/36): python3-portend-2.6-1.el8.noarch.rpm 813 kB/s | 16 kB 00:00 2020-06-27T04:37:24.398 INFO:teuthology.orchestra.run.smithi051.stdout:(27/36): python3-simplegeneric-0.8.1-17.el8.noa 983 kB/s | 19 kB 00:00 2020-06-27T04:37:24.417 INFO:teuthology.orchestra.run.smithi051.stdout:(28/36): python3-singledispatch-3.4.0.3-18.el8. 1.2 MB/s | 24 kB 00:00 2020-06-27T04:37:24.436 INFO:teuthology.orchestra.run.smithi051.stdout:(29/36): python3-tempora-1.14.1-5.el8.noarch.rp 1.5 MB/s | 29 kB 00:00 2020-06-27T04:37:24.458 INFO:teuthology.orchestra.run.smithi051.stdout:(30/36): ceph-mon-16.0.0-2978.g77ddaecfcb0.el8. 5.2 MB/s | 4.9 MB 00:00 2020-06-27T04:37:24.458 INFO:teuthology.orchestra.run.smithi051.stdout:(31/36): python3-trustme-0.5.2-4.el8.noarch.rpm 1.2 MB/s | 26 kB 00:00 2020-06-27T04:37:24.497 INFO:teuthology.orchestra.run.smithi051.stdout:(32/36): python3-webob-1.8.5-1.el8.1.noarch.rpm 6.4 MB/s | 251 kB 00:00 2020-06-27T04:37:24.516 INFO:teuthology.orchestra.run.smithi051.stdout:(33/36): python3-webtest-2.0.33-1.el8.noarch.rp 4.3 MB/s | 85 kB 00:00 2020-06-27T04:37:24.535 INFO:teuthology.orchestra.run.smithi051.stdout:(34/36): python3-zc-lockfile-2.0-2.el8.noarch.r 1.2 MB/s | 23 kB 00:00 2020-06-27T04:37:24.570 INFO:teuthology.orchestra.run.smithi051.stdout:(35/36): python3-waitress-1.2.1-2.el8.1.noarch. 2.1 MB/s | 241 kB 00:00 2020-06-27T04:37:25.065 INFO:teuthology.orchestra.run.smithi051.stdout:(36/36): ceph-osd-16.0.0-2978.g77ddaecfcb0.el8. 14 MB/s | 18 MB 00:01 2020-06-27T04:37:25.068 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:37:25.068 INFO:teuthology.orchestra.run.smithi051.stdout:Total 19 MB/s | 32 MB 00:01 2020-06-27T04:37:25.080 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2020-06-27T04:37:25.123 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2020-06-27T04:37:25.124 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2020-06-27T04:37:25.482 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2020-06-27T04:37:25.482 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2020-06-27T04:37:25.775 INFO:teuthology.orchestra.run.smithi031.stdout:(36/36): ceph-osd-16.0.0-2978.g77ddaecfcb0.el8. 4.3 MB/s | 18 MB 00:04 2020-06-27T04:37:25.778 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:37:25.779 INFO:teuthology.orchestra.run.smithi031.stdout:Total 6.1 MB/s | 32 MB 00:05 2020-06-27T04:37:25.793 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2020-06-27T04:37:25.840 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2020-06-27T04:37:25.840 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2020-06-27T04:37:26.212 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2020-06-27T04:37:26.213 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2020-06-27T04:37:26.816 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2020-06-27T04:37:27.066 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/36 2020-06-27T04:37:27.265 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/36 2020-06-27T04:37:27.526 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/36 2020-06-27T04:37:27.762 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/36 2020-06-27T04:37:27.783 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2020-06-27T04:37:27.913 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 5/36 2020-06-27T04:37:28.020 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/36 2020-06-27T04:37:28.094 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/36 2020-06-27T04:37:28.243 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/36 2020-06-27T04:37:28.360 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/36 2020-06-27T04:37:28.434 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/36 2020-06-27T04:37:28.562 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/36 2020-06-27T04:37:28.599 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/36 2020-06-27T04:37:28.775 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/36 2020-06-27T04:37:28.818 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/36 2020-06-27T04:37:28.967 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 5/36 2020-06-27T04:37:29.010 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 11/36 2020-06-27T04:37:29.164 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/36 2020-06-27T04:37:29.201 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 12/36 2020-06-27T04:37:29.336 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/36 2020-06-27T04:37:29.398 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 13/36 2020-06-27T04:37:29.471 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/36 2020-06-27T04:37:29.641 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/36 2020-06-27T04:37:29.657 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 14/36 2020-06-27T04:37:29.854 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/36 2020-06-27T04:37:29.973 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 15/36 2020-06-27T04:37:30.239 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 11/36 2020-06-27T04:37:30.257 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 16/36 2020-06-27T04:37:30.421 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 12/36 2020-06-27T04:37:30.534 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 17/36 2020-06-27T04:37:30.610 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 13/36 2020-06-27T04:37:30.743 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 18/36 2020-06-27T04:37:30.863 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 14/36 2020-06-27T04:37:30.972 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 19/36 2020-06-27T04:37:31.196 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 20/36 2020-06-27T04:37:31.211 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 15/36 2020-06-27T04:37:31.585 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 21/36 2020-06-27T04:37:31.611 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 16/36 2020-06-27T04:37:31.821 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 22/36 2020-06-27T04:37:31.914 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 17/36 2020-06-27T04:37:32.012 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 23/36 2020-06-27T04:37:32.122 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 18/36 2020-06-27T04:37:32.192 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/36 2020-06-27T04:37:32.362 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 19/36 2020-06-27T04:37:32.370 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 25/36 2020-06-27T04:37:32.600 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 20/36 2020-06-27T04:37:32.610 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-portend-2.6-1.el8.noarch 26/36 2020-06-27T04:37:32.827 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 27/36 2020-06-27T04:37:32.980 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 21/36 2020-06-27T04:37:33.087 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/36 2020-06-27T04:37:33.245 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 22/36 2020-06-27T04:37:33.413 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/36 2020-06-27T04:37:33.449 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 23/36 2020-06-27T04:37:33.629 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/36 2020-06-27T04:37:33.731 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 30/36 2020-06-27T04:37:33.806 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 25/36 2020-06-27T04:37:34.067 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-portend-2.6-1.el8.noarch 26/36 2020-06-27T04:37:34.081 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-2978.g77ddaecfcb0.e 31/36 2020-06-27T04:37:34.220 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-mgr-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 32/36 2020-06-27T04:37:34.281 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 27/36 2020-06-27T04:37:34.517 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/36 2020-06-27T04:37:34.855 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/36 2020-06-27T04:37:35.154 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 30/36 2020-06-27T04:37:35.529 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-2978.g77ddaecfcb0.e 31/36 2020-06-27T04:37:35.694 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 32/36 2020-06-27T04:37:35.834 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-mgr-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 32/36 2020-06-27T04:37:35.972 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-osd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 33/36 2020-06-27T04:37:36.425 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-osd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 33/36 2020-06-27T04:37:36.622 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-mon-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 34/36 2020-06-27T04:37:36.836 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-mon-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 34/36 2020-06-27T04:37:37.022 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-mds-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 35/36 2020-06-27T04:37:37.041 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-mds-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 35/36 2020-06-27T04:37:37.153 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 36/36 2020-06-27T04:37:37.314 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 32/36 2020-06-27T04:37:37.484 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-osd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 33/36 2020-06-27T04:37:37.511 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 36/36 2020-06-27T04:37:37.511 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/36 2020-06-27T04:37:37.511 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-mds-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2/36 2020-06-27T04:37:37.512 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-mgr-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 3/36 2020-06-27T04:37:37.512 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-mon-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 4/36 2020-06-27T04:37:37.512 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-osd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 5/36 2020-06-27T04:37:37.512 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-2978.g77ddaecfcb0.e 6/36 2020-06-27T04:37:37.512 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/36 2020-06-27T04:37:37.512 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 8/36 2020-06-27T04:37:37.513 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/36 2020-06-27T04:37:37.513 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/36 2020-06-27T04:37:37.513 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/36 2020-06-27T04:37:37.513 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/36 2020-06-27T04:37:37.513 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/36 2020-06-27T04:37:37.514 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 14/36 2020-06-27T04:37:37.514 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 15/36 2020-06-27T04:37:37.514 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 16/36 2020-06-27T04:37:37.514 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 17/36 2020-06-27T04:37:37.514 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/36 2020-06-27T04:37:37.515 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 19/36 2020-06-27T04:37:37.515 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 20/36 2020-06-27T04:37:37.515 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 21/36 2020-06-27T04:37:37.515 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 22/36 2020-06-27T04:37:37.515 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 23/36 2020-06-27T04:37:37.515 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 24/36 2020-06-27T04:37:37.516 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 25/36 2020-06-27T04:37:37.516 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 26/36 2020-06-27T04:37:37.516 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 27/36 2020-06-27T04:37:37.516 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-portend-2.6-1.el8.noarch 28/36 2020-06-27T04:37:37.516 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 29/36 2020-06-27T04:37:37.517 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 30/36 2020-06-27T04:37:37.517 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 31/36 2020-06-27T04:37:37.517 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 32/36 2020-06-27T04:37:37.517 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 33/36 2020-06-27T04:37:37.517 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 34/36 2020-06-27T04:37:37.518 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 35/36 2020-06-27T04:37:37.944 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-osd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 33/36 2020-06-27T04:37:38.141 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mon-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 34/36 2020-06-27T04:37:38.275 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 36/36 2020-06-27T04:37:38.275 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:38.276 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2020-06-27T04:37:38.276 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:38.276 INFO:teuthology.orchestra.run.smithi051.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-06-27T04:37:38.276 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-06-27T04:37:38.276 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mds-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:38.277 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:38.277 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mon-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:38.277 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-osd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:38.277 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-modules-core-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:37:38.277 INFO:teuthology.orchestra.run.smithi051.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-06-27T04:37:38.278 INFO:teuthology.orchestra.run.smithi051.stdout: python3-mako-1.0.6-13.el8.noarch 2020-06-27T04:37:38.278 INFO:teuthology.orchestra.run.smithi051.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-06-27T04:37:38.278 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pytz-2017.2-9.el8.noarch 2020-06-27T04:37:38.278 INFO:teuthology.orchestra.run.smithi051.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-06-27T04:37:38.278 INFO:teuthology.orchestra.run.smithi051.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-06-27T04:37:38.279 INFO:teuthology.orchestra.run.smithi051.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-06-27T04:37:38.279 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-06-27T04:37:38.279 INFO:teuthology.orchestra.run.smithi051.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-06-27T04:37:38.279 INFO:teuthology.orchestra.run.smithi051.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-06-27T04:37:38.279 INFO:teuthology.orchestra.run.smithi051.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-06-27T04:37:38.279 INFO:teuthology.orchestra.run.smithi051.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-06-27T04:37:38.280 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-06-27T04:37:38.280 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-06-27T04:37:38.280 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jaraco-6.2-6.el8.noarch 2020-06-27T04:37:38.280 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-06-27T04:37:38.280 INFO:teuthology.orchestra.run.smithi051.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-06-27T04:37:38.281 INFO:teuthology.orchestra.run.smithi051.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-06-27T04:37:38.281 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-06-27T04:37:38.281 INFO:teuthology.orchestra.run.smithi051.stdout: python3-portend-2.6-1.el8.noarch 2020-06-27T04:37:38.281 INFO:teuthology.orchestra.run.smithi051.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-06-27T04:37:38.281 INFO:teuthology.orchestra.run.smithi051.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-06-27T04:37:38.281 INFO:teuthology.orchestra.run.smithi051.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-06-27T04:37:38.282 INFO:teuthology.orchestra.run.smithi051.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-06-27T04:37:38.282 INFO:teuthology.orchestra.run.smithi051.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-06-27T04:37:38.282 INFO:teuthology.orchestra.run.smithi051.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-06-27T04:37:38.282 INFO:teuthology.orchestra.run.smithi051.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-06-27T04:37:38.282 INFO:teuthology.orchestra.run.smithi051.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-06-27T04:37:38.283 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:38.284 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:37:38.356 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mon-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 34/36 2020-06-27T04:37:38.591 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-base 2020-06-27T04:37:39.036 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:08 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:37:39.133 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mds-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 35/36 2020-06-27T04:37:39.155 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mds-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 35/36 2020-06-27T04:37:39.248 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 36/36 2020-06-27T04:37:39.296 INFO:teuthology.orchestra.run.smithi051.stdout:Package ceph-base-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:37:39.408 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:37:39.409 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2020-06-27T04:37:39.409 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:37:39.601 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 36/36 2020-06-27T04:37:39.602 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/36 2020-06-27T04:37:39.602 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mds-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2/36 2020-06-27T04:37:39.603 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 3/36 2020-06-27T04:37:39.603 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mon-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 4/36 2020-06-27T04:37:39.603 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-osd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 5/36 2020-06-27T04:37:39.603 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-2978.g77ddaecfcb0.e 6/36 2020-06-27T04:37:39.603 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/36 2020-06-27T04:37:39.604 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 8/36 2020-06-27T04:37:39.604 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/36 2020-06-27T04:37:39.604 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/36 2020-06-27T04:37:39.604 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/36 2020-06-27T04:37:39.604 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/36 2020-06-27T04:37:39.604 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/36 2020-06-27T04:37:39.605 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 14/36 2020-06-27T04:37:39.605 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 15/36 2020-06-27T04:37:39.605 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 16/36 2020-06-27T04:37:39.605 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 17/36 2020-06-27T04:37:39.605 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/36 2020-06-27T04:37:39.606 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 19/36 2020-06-27T04:37:39.606 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 20/36 2020-06-27T04:37:39.606 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 21/36 2020-06-27T04:37:39.606 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 22/36 2020-06-27T04:37:39.606 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 23/36 2020-06-27T04:37:39.606 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 24/36 2020-06-27T04:37:39.607 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 25/36 2020-06-27T04:37:39.608 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 26/36 2020-06-27T04:37:39.608 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 27/36 2020-06-27T04:37:39.608 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-portend-2.6-1.el8.noarch 28/36 2020-06-27T04:37:39.608 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 29/36 2020-06-27T04:37:39.609 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 30/36 2020-06-27T04:37:39.609 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 31/36 2020-06-27T04:37:39.609 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 32/36 2020-06-27T04:37:39.609 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 33/36 2020-06-27T04:37:39.609 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 34/36 2020-06-27T04:37:39.610 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 35/36 2020-06-27T04:37:39.618 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install cephadm 2020-06-27T04:37:40.053 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:09 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:37:40.397 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 36/36 2020-06-27T04:37:40.397 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:40.397 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2020-06-27T04:37:40.397 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:40.398 INFO:teuthology.orchestra.run.smithi031.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-06-27T04:37:40.398 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-06-27T04:37:40.398 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:40.398 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:40.398 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:40.399 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:40.399 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:37:40.399 INFO:teuthology.orchestra.run.smithi031.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-06-27T04:37:40.399 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako-1.0.6-13.el8.noarch 2020-06-27T04:37:40.399 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-06-27T04:37:40.400 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz-2017.2-9.el8.noarch 2020-06-27T04:37:40.400 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-06-27T04:37:40.400 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-06-27T04:37:40.400 INFO:teuthology.orchestra.run.smithi031.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-06-27T04:37:40.400 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-06-27T04:37:40.400 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-06-27T04:37:40.401 INFO:teuthology.orchestra.run.smithi031.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-06-27T04:37:40.401 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-06-27T04:37:40.401 INFO:teuthology.orchestra.run.smithi031.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-06-27T04:37:40.401 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-06-27T04:37:40.401 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-06-27T04:37:40.402 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-6.2-6.el8.noarch 2020-06-27T04:37:40.402 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-06-27T04:37:40.402 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-06-27T04:37:40.402 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-06-27T04:37:40.402 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-06-27T04:37:40.402 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend-2.6-1.el8.noarch 2020-06-27T04:37:40.403 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-06-27T04:37:40.403 INFO:teuthology.orchestra.run.smithi031.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-06-27T04:37:40.403 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-06-27T04:37:40.403 INFO:teuthology.orchestra.run.smithi031.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-06-27T04:37:40.403 INFO:teuthology.orchestra.run.smithi031.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-06-27T04:37:40.404 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-06-27T04:37:40.404 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-06-27T04:37:40.404 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-06-27T04:37:40.404 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:40.405 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:37:40.432 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:37:40.433 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:37:40.433 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repo Size 2020-06-27T04:37:40.434 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:37:40.434 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2020-06-27T04:37:40.434 INFO:teuthology.orchestra.run.smithi051.stdout: cephadm x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 48 k 2020-06-27T04:37:40.434 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:40.434 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2020-06-27T04:37:40.435 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:37:40.435 INFO:teuthology.orchestra.run.smithi051.stdout:Install 1 Package 2020-06-27T04:37:40.435 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:40.435 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 48 k 2020-06-27T04:37:40.435 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 175 k 2020-06-27T04:37:40.435 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2020-06-27T04:37:40.586 INFO:teuthology.orchestra.run.smithi051.stdout:cephadm-16.0.0-2978.g77ddaecfcb0.el8.x86_64.rpm 313 kB/s | 48 kB 00:00 2020-06-27T04:37:40.587 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:37:40.587 INFO:teuthology.orchestra.run.smithi051.stdout:Total 310 kB/s | 48 kB 00:00 2020-06-27T04:37:40.589 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2020-06-27T04:37:40.597 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2020-06-27T04:37:40.597 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2020-06-27T04:37:40.599 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2020-06-27T04:37:40.600 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2020-06-27T04:37:40.642 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2020-06-27T04:37:40.776 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-base 2020-06-27T04:37:41.218 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:10 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:37:41.481 INFO:teuthology.orchestra.run.smithi031.stdout:Package ceph-base-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:37:41.593 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:37:41.594 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2020-06-27T04:37:41.594 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:37:41.718 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install cephadm 2020-06-27T04:37:42.092 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:37:42.155 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:11 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:37:42.256 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:37:42.407 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:37:42.543 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:37:42.544 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:37:42.544 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repo Size 2020-06-27T04:37:42.544 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:37:42.545 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2020-06-27T04:37:42.545 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 48 k 2020-06-27T04:37:42.545 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:42.545 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2020-06-27T04:37:42.545 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:37:42.546 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2020-06-27T04:37:42.546 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:42.546 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 48 k 2020-06-27T04:37:42.546 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 175 k 2020-06-27T04:37:42.546 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2020-06-27T04:37:42.664 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:37:42.665 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:42.665 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2020-06-27T04:37:42.665 INFO:teuthology.orchestra.run.smithi051.stdout: cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:42.665 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:42.666 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:37:42.698 INFO:teuthology.orchestra.run.smithi031.stdout:cephadm-16.0.0-2978.g77ddaecfcb0.el8.x86_64.rpm 311 kB/s | 48 kB 00:00 2020-06-27T04:37:42.699 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:37:42.699 INFO:teuthology.orchestra.run.smithi031.stdout:Total 309 kB/s | 48 kB 00:00 2020-06-27T04:37:42.701 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2020-06-27T04:37:42.709 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2020-06-27T04:37:42.709 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2020-06-27T04:37:42.711 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2020-06-27T04:37:42.711 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2020-06-27T04:37:42.751 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2020-06-27T04:37:42.876 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-immutable-object-cache 2020-06-27T04:37:43.318 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:12 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:37:43.730 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:37:43.731 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:37:43.731 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repo Size 2020-06-27T04:37:43.731 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:37:43.732 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2020-06-27T04:37:43.732 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-immutable-object-cache x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 205 k 2020-06-27T04:37:43.732 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:43.732 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2020-06-27T04:37:43.732 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:37:43.732 INFO:teuthology.orchestra.run.smithi051.stdout:Install 1 Package 2020-06-27T04:37:43.733 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:43.733 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 205 k 2020-06-27T04:37:43.733 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 734 k 2020-06-27T04:37:43.734 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2020-06-27T04:37:43.934 INFO:teuthology.orchestra.run.smithi051.stdout:ceph-immutable-object-cache-16.0.0-2978.g77ddae 1.0 MB/s | 205 kB 00:00 2020-06-27T04:37:43.934 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:37:43.935 INFO:teuthology.orchestra.run.smithi051.stdout:Total 1.0 MB/s | 205 kB 00:00 2020-06-27T04:37:43.936 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2020-06-27T04:37:43.950 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2020-06-27T04:37:43.950 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2020-06-27T04:37:44.001 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2020-06-27T04:37:44.001 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2020-06-27T04:37:44.122 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2020-06-27T04:37:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:37:44.279 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-2978.g77ddaecfc 1/1 2020-06-27T04:37:44.391 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:37:44.547 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:37:44.638 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-2978.g77ddaecfc 1/1 2020-06-27T04:37:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:37:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:44.839 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2020-06-27T04:37:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:44.840 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:37:44.896 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-2978.g77ddaecfc 1/1 2020-06-27T04:37:44.896 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:44.897 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2020-06-27T04:37:44.897 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-immutable-object-cache-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:44.897 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:44.897 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:37:45.100 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-immutable-object-cache 2020-06-27T04:37:45.218 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-mgr 2020-06-27T04:37:45.545 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:14 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:37:45.660 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:14 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:37:45.928 INFO:teuthology.orchestra.run.smithi051.stdout:Package ceph-mgr-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:37:45.967 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:37:45.968 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:37:45.968 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repo Size 2020-06-27T04:37:45.968 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:37:45.968 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2020-06-27T04:37:45.969 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 205 k 2020-06-27T04:37:45.969 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:45.969 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2020-06-27T04:37:45.969 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:37:45.969 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2020-06-27T04:37:45.970 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:45.970 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 205 k 2020-06-27T04:37:45.970 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 734 k 2020-06-27T04:37:45.970 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2020-06-27T04:37:46.038 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:37:46.039 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2020-06-27T04:37:46.039 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:37:46.152 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-mgr-dashboard 2020-06-27T04:37:46.172 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-immutable-object-cache-16.0.0-2978.g77ddae 1.0 MB/s | 205 kB 00:00 2020-06-27T04:37:46.172 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:37:46.172 INFO:teuthology.orchestra.run.smithi031.stdout:Total 1.0 MB/s | 205 kB 00:00 2020-06-27T04:37:46.174 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2020-06-27T04:37:46.187 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2020-06-27T04:37:46.188 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2020-06-27T04:37:46.237 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2020-06-27T04:37:46.238 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2020-06-27T04:37:46.356 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2020-06-27T04:37:46.498 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-2978.g77ddaecfc 1/1 2020-06-27T04:37:46.589 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:15 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:37:46.814 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-2978.g77ddaecfc 1/1 2020-06-27T04:37:46.972 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:37:46.973 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:37:46.974 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repository Size 2020-06-27T04:37:46.974 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:37:46.974 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2020-06-27T04:37:46.974 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-dashboard noarch 2:16.0.0-2978.g77ddaecfcb0.el8 ceph-noarch 3.5 M 2020-06-27T04:37:46.975 INFO:teuthology.orchestra.run.smithi051.stdout:Installing dependencies: 2020-06-27T04:37:46.975 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-grafana-dashboards 2020-06-27T04:37:46.975 INFO:teuthology.orchestra.run.smithi051.stdout: noarch 2:16.0.0-2978.g77ddaecfcb0.el8 ceph-noarch 24 k 2020-06-27T04:37:46.975 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-prometheus-alerts noarch 2:16.0.0-2978.g77ddaecfcb0.el8 ceph-noarch 8.8 k 2020-06-27T04:37:46.975 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2020-06-27T04:37:46.976 INFO:teuthology.orchestra.run.smithi051.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2020-06-27T04:37:46.976 INFO:teuthology.orchestra.run.smithi051.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2020-06-27T04:37:46.976 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:46.976 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2020-06-27T04:37:46.976 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:37:46.977 INFO:teuthology.orchestra.run.smithi051.stdout:Install 6 Packages 2020-06-27T04:37:46.977 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:46.977 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 3.8 M 2020-06-27T04:37:46.978 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 17 M 2020-06-27T04:37:46.978 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2020-06-27T04:37:47.053 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-2978.g77ddaecfc 1/1 2020-06-27T04:37:47.054 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:47.054 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2020-06-27T04:37:47.054 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:37:47.055 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:47.055 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:37:47.085 INFO:teuthology.orchestra.run.smithi051.stdout:(1/6): ceph-prometheus-alerts-16.0.0-2978.g77dd 80 kB/s | 8.8 kB 00:00 2020-06-27T04:37:47.114 INFO:teuthology.orchestra.run.smithi051.stdout:(2/6): ceph-grafana-dashboards-16.0.0-2978.g77d 174 kB/s | 24 kB 00:00 2020-06-27T04:37:47.137 INFO:teuthology.orchestra.run.smithi051.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 829 kB/s | 43 kB 00:00 2020-06-27T04:37:47.162 INFO:teuthology.orchestra.run.smithi051.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 701 kB/s | 34 kB 00:00 2020-06-27T04:37:47.232 INFO:teuthology.orchestra.run.smithi051.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 2.0 MB/s | 196 kB 00:00 2020-06-27T04:37:47.372 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-mgr 2020-06-27T04:37:47.617 INFO:teuthology.orchestra.run.smithi051.stdout:(6/6): ceph-mgr-dashboard-16.0.0-2978.g77ddaecf 5.4 MB/s | 3.5 MB 00:00 2020-06-27T04:37:47.619 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:37:47.620 INFO:teuthology.orchestra.run.smithi051.stdout:Total 5.8 MB/s | 3.8 MB 00:00 2020-06-27T04:37:47.623 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2020-06-27T04:37:47.632 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2020-06-27T04:37:47.632 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2020-06-27T04:37:47.807 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2020-06-27T04:37:47.808 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2020-06-27T04:37:47.812 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:16 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:37:48.077 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2020-06-27T04:37:48.088 INFO:teuthology.orchestra.run.smithi031.stdout:Package ceph-mgr-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:37:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:37:48.200 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2020-06-27T04:37:48.200 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:37:48.295 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2020-06-27T04:37:48.322 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-mgr-dashboard 2020-06-27T04:37:48.514 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2020-06-27T04:37:48.705 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2020-06-27T04:37:48.755 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:17 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:37:48.827 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-2978.g77ddaecfcb0.el 4/6 2020-06-27T04:37:49.149 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:37:49.162 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:37:49.163 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2020-06-27T04:37:49.163 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:37:49.163 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2020-06-27T04:37:49.163 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard noarch 2:16.0.0-2978.g77ddaecfcb0.el8 ceph-noarch 3.5 M 2020-06-27T04:37:49.164 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2020-06-27T04:37:49.164 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards 2020-06-27T04:37:49.164 INFO:teuthology.orchestra.run.smithi031.stdout: noarch 2:16.0.0-2978.g77ddaecfcb0.el8 ceph-noarch 24 k 2020-06-27T04:37:49.164 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts noarch 2:16.0.0-2978.g77ddaecfcb0.el8 ceph-noarch 8.8 k 2020-06-27T04:37:49.164 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2020-06-27T04:37:49.165 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2020-06-27T04:37:49.165 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2020-06-27T04:37:49.165 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:49.165 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2020-06-27T04:37:49.165 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:37:49.166 INFO:teuthology.orchestra.run.smithi031.stdout:Install 6 Packages 2020-06-27T04:37:49.166 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:49.166 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 3.8 M 2020-06-27T04:37:49.166 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 17 M 2020-06-27T04:37:49.166 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2020-06-27T04:37:49.262 INFO:teuthology.orchestra.run.smithi031.stdout:(1/6): ceph-prometheus-alerts-16.0.0-2978.g77dd 81 kB/s | 8.8 kB 00:00 2020-06-27T04:37:49.290 INFO:teuthology.orchestra.run.smithi031.stdout:(2/6): ceph-grafana-dashboards-16.0.0-2978.g77d 175 kB/s | 24 kB 00:00 2020-06-27T04:37:49.292 INFO:teuthology.orchestra.run.smithi031.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.4 MB/s | 43 kB 00:00 2020-06-27T04:37:49.336 INFO:teuthology.orchestra.run.smithi031.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 719 kB/s | 34 kB 00:00 2020-06-27T04:37:49.388 INFO:teuthology.orchestra.run.smithi031.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 2.0 MB/s | 196 kB 00:00 2020-06-27T04:37:49.741 INFO:teuthology.orchestra.run.smithi031.stdout:(6/6): ceph-mgr-dashboard-16.0.0-2978.g77ddaecf 5.9 MB/s | 3.5 MB 00:00 2020-06-27T04:37:49.743 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:37:49.744 INFO:teuthology.orchestra.run.smithi031.stdout:Total 6.4 MB/s | 3.8 MB 00:00 2020-06-27T04:37:49.747 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2020-06-27T04:37:49.756 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2020-06-27T04:37:49.757 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2020-06-27T04:37:49.880 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-2978.g77ddaecfcb0.e 5/6 2020-06-27T04:37:49.926 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2020-06-27T04:37:49.926 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2020-06-27T04:37:50.142 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-2978.g77ddaecfcb0.el8.no 6/6 2020-06-27T04:37:50.359 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-2978.g77ddaecfcb0.el8.no 6/6 2020-06-27T04:37:50.360 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-2978.g77ddaecfcb0.e 1/6 2020-06-27T04:37:50.360 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-2978.g77ddaecfcb0.el8.no 2/6 2020-06-27T04:37:50.361 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-2978.g77ddaecfcb0.el 3/6 2020-06-27T04:37:50.361 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2020-06-27T04:37:50.361 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2020-06-27T04:37:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2020-06-27T04:37:52.029 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2020-06-27T04:37:52.030 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:52.030 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2020-06-27T04:37:52.030 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-dashboard-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:37:52.030 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-grafana-dashboards-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:37:52.031 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-prometheus-alerts-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:37:52.031 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-06-27T04:37:52.031 INFO:teuthology.orchestra.run.smithi051.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-06-27T04:37:52.031 INFO:teuthology.orchestra.run.smithi051.stdout: python3-routes-2.4.1-12.el8.noarch 2020-06-27T04:37:52.031 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:52.032 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:37:52.099 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2020-06-27T04:37:52.177 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-mgr-diskprediction-local 2020-06-27T04:37:52.353 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2020-06-27T04:37:52.508 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2020-06-27T04:37:52.622 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:21 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:37:52.664 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-2978.g77ddaecfcb0.el 4/6 2020-06-27T04:37:53.039 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:37:53.040 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:37:53.041 INFO:teuthology.orchestra.run.smithi051.stdout: Package ArchVersion Repository Size 2020-06-27T04:37:53.041 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:37:53.041 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2020-06-27T04:37:53.041 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-2978.g77ddaecfcb0.el8 ceph-noarch 8.6 M 2020-06-27T04:37:53.042 INFO:teuthology.orchestra.run.smithi051.stdout:Installing dependencies: 2020-06-27T04:37:53.042 INFO:teuthology.orchestra.run.smithi051.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-06-27T04:37:53.042 INFO:teuthology.orchestra.run.smithi051.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-06-27T04:37:53.042 INFO:teuthology.orchestra.run.smithi051.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-06-27T04:37:53.042 INFO:teuthology.orchestra.run.smithi051.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-06-27T04:37:53.042 INFO:teuthology.orchestra.run.smithi051.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-06-27T04:37:53.043 INFO:teuthology.orchestra.run.smithi051.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-06-27T04:37:53.043 INFO:teuthology.orchestra.run.smithi051.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-06-27T04:37:53.043 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:53.043 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2020-06-27T04:37:53.043 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:37:53.044 INFO:teuthology.orchestra.run.smithi051.stdout:Install 8 Packages 2020-06-27T04:37:53.044 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:37:53.044 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 37 M 2020-06-27T04:37:53.045 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 205 M 2020-06-27T04:37:53.045 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2020-06-27T04:37:53.164 INFO:teuthology.orchestra.run.smithi051.stdout:(1/8): openblas-0.3.3-2.el8.x86_64.rpm 35 MB/s | 4.3 MB 00:00 2020-06-27T04:37:53.177 INFO:teuthology.orchestra.run.smithi051.stdout:(2/8): openblas-threads-0.3.3-2.el8.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2020-06-27T04:37:53.185 INFO:teuthology.orchestra.run.smithi051.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 31 MB/s | 225 kB 00:00 2020-06-27T04:37:53.235 INFO:teuthology.orchestra.run.smithi051.stdout:(4/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 53 MB/s | 3.7 MB 00:00 2020-06-27T04:37:53.246 INFO:teuthology.orchestra.run.smithi051.stdout:(5/8): libgfortran-8.3.1-4.5.el8.x86_64.rpm 56 MB/s | 638 kB 00:00 2020-06-27T04:37:53.250 INFO:teuthology.orchestra.run.smithi051.stdout:(6/8): libquadmath-8.3.1-4.5.el8.x86_64.rpm 41 MB/s | 169 kB 00:00 2020-06-27T04:37:53.469 INFO:teuthology.orchestra.run.smithi051.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.1.0+24 51 MB/s | 15 MB 00:00 2020-06-27T04:37:53.770 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-2978.g77ddaecfcb0.e 5/6 2020-06-27T04:37:53.968 INFO:teuthology.orchestra.run.smithi051.stdout:(8/8): ceph-mgr-diskprediction-local-16.0.0-297 9.3 MB/s | 8.6 MB 00:00 2020-06-27T04:37:53.970 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:37:53.971 INFO:teuthology.orchestra.run.smithi051.stdout:Total 39 MB/s | 37 MB 00:00 2020-06-27T04:37:53.982 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2020-06-27T04:37:54.002 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2020-06-27T04:37:54.002 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2020-06-27T04:37:54.073 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-2978.g77ddaecfcb0.el8.no 6/6 2020-06-27T04:37:54.286 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-2978.g77ddaecfcb0.el8.no 6/6 2020-06-27T04:37:54.287 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-2978.g77ddaecfcb0.e 1/6 2020-06-27T04:37:54.287 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-2978.g77ddaecfcb0.el8.no 2/6 2020-06-27T04:37:54.287 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-2978.g77ddaecfcb0.el 3/6 2020-06-27T04:37:54.287 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2020-06-27T04:37:54.288 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2020-06-27T04:37:54.308 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2020-06-27T04:37:54.308 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2020-06-27T04:37:54.552 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2020-06-27T04:37:54.553 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:54.553 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2020-06-27T04:37:54.553 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:37:54.554 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:37:54.554 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:37:54.554 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-06-27T04:37:54.554 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-06-27T04:37:54.554 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes-2.4.1-12.el8.noarch 2020-06-27T04:37:54.555 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:54.555 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:37:54.674 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-mgr-diskprediction-local 2020-06-27T04:37:55.040 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2020-06-27T04:37:55.110 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:24 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:37:55.178 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-06-27T04:37:55.303 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-06-27T04:37:55.498 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:37:55.499 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:37:55.500 INFO:teuthology.orchestra.run.smithi031.stdout: Package ArchVersion Repository Size 2020-06-27T04:37:55.500 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:37:55.500 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2020-06-27T04:37:55.500 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-2978.g77ddaecfcb0.el8 ceph-noarch 8.6 M 2020-06-27T04:37:55.501 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2020-06-27T04:37:55.501 INFO:teuthology.orchestra.run.smithi031.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-06-27T04:37:55.501 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-06-27T04:37:55.501 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-06-27T04:37:55.501 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-06-27T04:37:55.502 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-06-27T04:37:55.502 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-06-27T04:37:55.502 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-06-27T04:37:55.502 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:55.502 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2020-06-27T04:37:55.502 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:37:55.503 INFO:teuthology.orchestra.run.smithi031.stdout:Install 8 Packages 2020-06-27T04:37:55.503 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:37:55.503 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 37 M 2020-06-27T04:37:55.504 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 205 M 2020-06-27T04:37:55.504 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2020-06-27T04:37:55.518 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-06-27T04:37:55.601 INFO:teuthology.orchestra.run.smithi031.stdout:(1/8): openblas-0.3.3-2.el8.x86_64.rpm 44 MB/s | 4.3 MB 00:00 2020-06-27T04:37:55.659 INFO:teuthology.orchestra.run.smithi031.stdout:(2/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 64 MB/s | 3.7 MB 00:00 2020-06-27T04:37:55.665 INFO:teuthology.orchestra.run.smithi031.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 41 MB/s | 225 kB 00:00 2020-06-27T04:37:55.691 INFO:teuthology.orchestra.run.smithi031.stdout:(4/8): openblas-threads-0.3.3-2.el8.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2020-06-27T04:37:55.713 INFO:teuthology.orchestra.run.smithi031.stdout:(5/8): libgfortran-8.3.1-4.5.el8.x86_64.rpm 29 MB/s | 638 kB 00:00 2020-06-27T04:37:55.723 INFO:teuthology.orchestra.run.smithi031.stdout:(6/8): libquadmath-8.3.1-4.5.el8.x86_64.rpm 17 MB/s | 169 kB 00:00 2020-06-27T04:37:55.926 INFO:teuthology.orchestra.run.smithi031.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.1.0+24 56 MB/s | 15 MB 00:00 2020-06-27T04:37:56.084 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-06-27T04:37:56.257 INFO:teuthology.orchestra.run.smithi031.stdout:(8/8): ceph-mgr-diskprediction-local-16.0.0-297 11 MB/s | 8.6 MB 00:00 2020-06-27T04:37:56.259 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:37:56.260 INFO:teuthology.orchestra.run.smithi031.stdout:Total 48 MB/s | 37 MB 00:00 2020-06-27T04:37:56.260 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : openblas-0.3.3-2.el8.x86_64 3/8 2020-06-27T04:37:56.271 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2020-06-27T04:37:56.291 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2020-06-27T04:37:56.291 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2020-06-27T04:37:56.615 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2020-06-27T04:37:56.616 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2020-06-27T04:37:56.841 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 3/8 2020-06-27T04:37:57.018 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-06-27T04:37:57.198 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2020-06-27T04:37:57.346 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-06-27T04:37:57.483 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-06-27T04:37:57.663 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-06-27T04:37:57.770 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-06-27T04:37:58.119 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2020-06-27T04:37:58.211 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-06-27T04:37:58.363 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-0.3.3-2.el8.x86_64 3/8 2020-06-27T04:37:58.376 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-06-27T04:37:58.925 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 3/8 2020-06-27T04:37:59.071 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-06-27T04:37:59.831 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-06-27T04:38:00.138 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2020-06-27T04:38:00.354 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-06-27T04:38:00.465 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-06-27T04:38:01.888 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 7/8 2020-06-27T04:38:02.043 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-2978.g77ddaec 8/8 2020-06-27T04:38:02.297 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-2978.g77ddaec 8/8 2020-06-27T04:38:02.298 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-2978.g77ddaec 1/8 2020-06-27T04:38:02.298 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 2/8 2020-06-27T04:38:02.298 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 3/8 2020-06-27T04:38:02.298 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2020-06-27T04:38:02.298 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2020-06-27T04:38:02.299 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 6/8 2020-06-27T04:38:02.299 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 7/8 2020-06-27T04:38:02.445 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-06-27T04:38:02.817 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 8/8 2020-06-27T04:38:02.818 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:02.818 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2020-06-27T04:38:02.818 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-diskprediction-local-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:38:02.819 INFO:teuthology.orchestra.run.smithi051.stdout: openblas-0.3.3-2.el8.x86_64 2020-06-27T04:38:02.819 INFO:teuthology.orchestra.run.smithi051.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-06-27T04:38:02.819 INFO:teuthology.orchestra.run.smithi051.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-06-27T04:38:02.819 INFO:teuthology.orchestra.run.smithi051.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-06-27T04:38:02.819 INFO:teuthology.orchestra.run.smithi051.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-06-27T04:38:02.820 INFO:teuthology.orchestra.run.smithi051.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-06-27T04:38:02.820 INFO:teuthology.orchestra.run.smithi051.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-06-27T04:38:02.820 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:02.820 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:38:02.951 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-mgr-rook 2020-06-27T04:38:03.388 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:32 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:03.771 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:38:03.773 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:03.773 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repository Size 2020-06-27T04:38:03.773 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:03.774 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2020-06-27T04:38:03.774 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-rook noarch 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:38:03.774 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-noarch 27 k 2020-06-27T04:38:03.774 INFO:teuthology.orchestra.run.smithi051.stdout:Installing dependencies: 2020-06-27T04:38:03.774 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2020-06-27T04:38:03.775 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2020-06-27T04:38:03.775 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2020-06-27T04:38:03.775 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2020-06-27T04:38:03.775 INFO:teuthology.orchestra.run.smithi051.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2020-06-27T04:38:03.775 INFO:teuthology.orchestra.run.smithi051.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2020-06-27T04:38:03.775 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-06-27T04:38:03.776 INFO:teuthology.orchestra.run.smithi051.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-06-27T04:38:03.776 INFO:teuthology.orchestra.run.smithi051.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-06-27T04:38:03.776 INFO:teuthology.orchestra.run.smithi051.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-06-27T04:38:03.776 INFO:teuthology.orchestra.run.smithi051.stdout: python3-rsa noarch 3.4.2-12.el8 epel 73 k 2020-06-27T04:38:03.776 INFO:teuthology.orchestra.run.smithi051.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-06-27T04:38:03.777 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:03.777 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2020-06-27T04:38:03.777 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:03.777 INFO:teuthology.orchestra.run.smithi051.stdout:Install 13 Packages 2020-06-27T04:38:03.777 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:03.778 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 1.9 M 2020-06-27T04:38:03.778 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 24 M 2020-06-27T04:38:03.779 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2020-06-27T04:38:03.809 INFO:teuthology.orchestra.run.smithi051.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 806 kB/s | 27 kB 00:00 2020-06-27T04:38:03.811 INFO:teuthology.orchestra.run.smithi051.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 580 kB/s | 20 kB 00:00 2020-06-27T04:38:03.813 INFO:teuthology.orchestra.run.smithi051.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 32 MB/s | 126 kB 00:00 2020-06-27T04:38:03.814 INFO:teuthology.orchestra.run.smithi051.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 36 MB/s | 110 kB 00:00 2020-06-27T04:38:03.816 INFO:teuthology.orchestra.run.smithi051.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 27 MB/s | 43 kB 00:00 2020-06-27T04:38:03.817 INFO:teuthology.orchestra.run.smithi051.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 47 MB/s | 155 kB 00:00 2020-06-27T04:38:03.864 INFO:teuthology.orchestra.run.smithi051.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 351 kB/s | 16 kB 00:00 2020-06-27T04:38:03.873 INFO:teuthology.orchestra.run.smithi051.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 576 kB/s | 33 kB 00:00 2020-06-27T04:38:03.874 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 7/8 2020-06-27T04:38:03.905 INFO:teuthology.orchestra.run.smithi051.stdout:(9/13): ceph-mgr-rook-16.0.0-2978.g77ddaecfcb0. 212 kB/s | 27 kB 00:00 2020-06-27T04:38:03.909 INFO:teuthology.orchestra.run.smithi051.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 1.7 MB/s | 81 kB 00:00 2020-06-27T04:38:03.926 INFO:teuthology.orchestra.run.smithi051.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 3.7 MB/s | 61 kB 00:00 2020-06-27T04:38:03.980 INFO:teuthology.orchestra.run.smithi051.stdout:(12/13): python3-rsa-3.4.2-12.el8.noarch.rpm 968 kB/s | 73 kB 00:00 2020-06-27T04:38:04.043 INFO:teuthology.orchestra.run.smithi051.stdout:(13/13): python3-kubernetes-11.0.0-2.el8.noarch 6.9 MB/s | 1.2 MB 00:00 2020-06-27T04:38:04.044 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:38:04.044 INFO:teuthology.orchestra.run.smithi051.stdout:Total 7.1 MB/s | 1.9 MB 00:00 2020-06-27T04:38:04.052 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2020-06-27T04:38:04.067 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2020-06-27T04:38:04.067 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2020-06-27T04:38:04.070 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-2978.g77ddaec 8/8 2020-06-27T04:38:04.143 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2020-06-27T04:38:04.144 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2020-06-27T04:38:04.301 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-2978.g77ddaec 8/8 2020-06-27T04:38:04.301 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-2978.g77ddaec 1/8 2020-06-27T04:38:04.302 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 2/8 2020-06-27T04:38:04.302 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 3/8 2020-06-27T04:38:04.302 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2020-06-27T04:38:04.302 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2020-06-27T04:38:04.302 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 6/8 2020-06-27T04:38:04.303 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 7/8 2020-06-27T04:38:04.569 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 8/8 2020-06-27T04:38:04.569 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:04.570 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2020-06-27T04:38:04.570 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:38:04.570 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-0.3.3-2.el8.x86_64 2020-06-27T04:38:04.570 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-06-27T04:38:04.570 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-06-27T04:38:04.571 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-06-27T04:38:04.571 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-06-27T04:38:04.571 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-06-27T04:38:04.571 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-06-27T04:38:04.571 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:04.572 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:38:04.671 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2020-06-27T04:38:04.720 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-mgr-rook 2020-06-27T04:38:04.973 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2020-06-27T04:38:05.158 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:34 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:05.200 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2020-06-27T04:38:05.446 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 3/13 2020-06-27T04:38:05.550 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:38:05.551 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:05.551 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2020-06-27T04:38:05.551 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:05.551 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2020-06-27T04:38:05.552 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook noarch 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:38:05.552 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-noarch 27 k 2020-06-27T04:38:05.552 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2020-06-27T04:38:05.552 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2020-06-27T04:38:05.552 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2020-06-27T04:38:05.553 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2020-06-27T04:38:05.553 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2020-06-27T04:38:05.553 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2020-06-27T04:38:05.553 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2020-06-27T04:38:05.553 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-06-27T04:38:05.554 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-06-27T04:38:05.555 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-06-27T04:38:05.555 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-06-27T04:38:05.555 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa noarch 3.4.2-12.el8 epel 73 k 2020-06-27T04:38:05.556 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-06-27T04:38:05.556 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:05.556 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2020-06-27T04:38:05.556 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:05.556 INFO:teuthology.orchestra.run.smithi031.stdout:Install 13 Packages 2020-06-27T04:38:05.557 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:05.557 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 1.9 M 2020-06-27T04:38:05.558 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 24 M 2020-06-27T04:38:05.558 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2020-06-27T04:38:05.583 INFO:teuthology.orchestra.run.smithi031.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 902 kB/s | 27 kB 00:00 2020-06-27T04:38:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 38 MB/s | 126 kB 00:00 2020-06-27T04:38:05.589 INFO:teuthology.orchestra.run.smithi031.stdout:(3/13): python3-pyasn1-modules-0.3.7-6.el8.noar 53 MB/s | 110 kB 00:00 2020-06-27T04:38:05.589 INFO:teuthology.orchestra.run.smithi031.stdout:(4/13): python3-jsonpointer-1.10-11.el8.noarch. 560 kB/s | 20 kB 00:00 2020-06-27T04:38:05.592 INFO:teuthology.orchestra.run.smithi031.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 58 MB/s | 155 kB 00:00 2020-06-27T04:38:05.592 INFO:teuthology.orchestra.run.smithi031.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 16 MB/s | 43 kB 00:00 2020-06-27T04:38:05.649 INFO:teuthology.orchestra.run.smithi031.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 290 kB/s | 16 kB 00:00 2020-06-27T04:38:05.649 INFO:teuthology.orchestra.run.smithi031.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 578 kB/s | 33 kB 00:00 2020-06-27T04:38:05.658 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2020-06-27T04:38:05.687 INFO:teuthology.orchestra.run.smithi031.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 2.1 MB/s | 81 kB 00:00 2020-06-27T04:38:05.718 INFO:teuthology.orchestra.run.smithi031.stdout:(10/13): python3-rsa-3.4.2-12.el8.noarch.rpm 3.7 MB/s | 73 kB 00:00 2020-06-27T04:38:05.725 INFO:teuthology.orchestra.run.smithi031.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 3.1 MB/s | 61 kB 00:00 2020-06-27T04:38:05.824 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2020-06-27T04:38:05.836 INFO:teuthology.orchestra.run.smithi031.stdout:(12/13): python3-kubernetes-11.0.0-2.el8.noarch 6.2 MB/s | 1.2 MB 00:00 2020-06-27T04:38:05.875 INFO:teuthology.orchestra.run.smithi031.stdout:(13/13): ceph-mgr-rook-16.0.0-2978.g77ddaecfcb0 85 kB/s | 27 kB 00:00 2020-06-27T04:38:05.876 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:38:05.877 INFO:teuthology.orchestra.run.smithi031.stdout:Total 5.9 MB/s | 1.9 MB 00:00 2020-06-27T04:38:05.884 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2020-06-27T04:38:05.900 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2020-06-27T04:38:05.900 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2020-06-27T04:38:05.977 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2020-06-27T04:38:05.977 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2020-06-27T04:38:06.078 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2020-06-27T04:38:06.357 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2020-06-27T04:38:06.501 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2020-06-27T04:38:06.600 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2020-06-27T04:38:06.760 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2020-06-27T04:38:06.995 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2020-06-27T04:38:07.182 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 3/13 2020-06-27T04:38:07.335 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2020-06-27T04:38:07.753 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2020-06-27T04:38:07.999 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 10/13 2020-06-27T04:38:08.301 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2020-06-27T04:38:08.494 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2020-06-27T04:38:08.723 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2020-06-27T04:38:09.002 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2020-06-27T04:38:09.253 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2020-06-27T04:38:09.267 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2020-06-27T04:38:09.416 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-mgr-rook-2:16.0.0-2978.g77ddaecfcb0.el8.noarc 13/13 2020-06-27T04:38:09.648 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-2978.g77ddaecfcb0.el8.noarc 13/13 2020-06-27T04:38:09.661 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-mgr-rook-2:16.0.0-2978.g77ddaecfcb0.el8.noarc 1/13 2020-06-27T04:38:09.662 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2020-06-27T04:38:09.662 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2020-06-27T04:38:09.662 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2020-06-27T04:38:09.662 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2020-06-27T04:38:09.662 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2020-06-27T04:38:09.663 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2020-06-27T04:38:09.663 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2020-06-27T04:38:09.663 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2020-06-27T04:38:09.663 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2020-06-27T04:38:09.663 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 11/13 2020-06-27T04:38:09.664 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 12/13 2020-06-27T04:38:09.992 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2020-06-27T04:38:09.993 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:09.993 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2020-06-27T04:38:09.993 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-rook-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:38:09.993 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-06-27T04:38:09.993 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-06-27T04:38:09.994 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-06-27T04:38:09.994 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-06-27T04:38:09.994 INFO:teuthology.orchestra.run.smithi051.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-06-27T04:38:09.994 INFO:teuthology.orchestra.run.smithi051.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-06-27T04:38:09.994 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-06-27T04:38:09.995 INFO:teuthology.orchestra.run.smithi051.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-06-27T04:38:09.995 INFO:teuthology.orchestra.run.smithi051.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-06-27T04:38:09.995 INFO:teuthology.orchestra.run.smithi051.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-06-27T04:38:09.995 INFO:teuthology.orchestra.run.smithi051.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-06-27T04:38:09.995 INFO:teuthology.orchestra.run.smithi051.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-06-27T04:38:09.995 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:09.996 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:38:10.153 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-mgr-cephadm 2020-06-27T04:38:10.388 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2020-06-27T04:38:10.592 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:39 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:10.640 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 10/13 2020-06-27T04:38:10.802 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2020-06-27T04:38:10.976 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:38:10.977 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:10.977 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repository Size 2020-06-27T04:38:10.978 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:10.978 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2020-06-27T04:38:10.978 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-cephadm noarch 2:16.0.0-2978.g77ddaecfcb0.el8 ceph-noarch 52 k 2020-06-27T04:38:10.978 INFO:teuthology.orchestra.run.smithi051.stdout:Installing dependencies: 2020-06-27T04:38:10.978 INFO:teuthology.orchestra.run.smithi051.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2020-06-27T04:38:10.979 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2020-06-27T04:38:10.979 INFO:teuthology.orchestra.run.smithi051.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-06-27T04:38:10.979 INFO:teuthology.orchestra.run.smithi051.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2020-06-27T04:38:10.979 INFO:teuthology.orchestra.run.smithi051.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2020-06-27T04:38:10.979 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:10.979 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2020-06-27T04:38:10.980 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:10.980 INFO:teuthology.orchestra.run.smithi051.stdout:Install 6 Packages 2020-06-27T04:38:10.980 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:10.981 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 5.8 M 2020-06-27T04:38:10.981 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 24 M 2020-06-27T04:38:10.981 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2020-06-27T04:38:11.010 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2020-06-27T04:38:11.028 INFO:teuthology.orchestra.run.smithi051.stdout:(1/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 11 MB/s | 538 kB 00:00 2020-06-27T04:38:11.075 INFO:teuthology.orchestra.run.smithi051.stdout:(2/6): python3-apipkg-1.5-6.el8.noarch.rpm 456 kB/s | 21 kB 00:00 2020-06-27T04:38:11.090 INFO:teuthology.orchestra.run.smithi051.stdout:(3/6): python3-babel-2.5.1-5.el8.noarch.rpm 44 MB/s | 4.8 MB 00:00 2020-06-27T04:38:11.132 INFO:teuthology.orchestra.run.smithi051.stdout:(4/6): ceph-mgr-cephadm-16.0.0-2978.g77ddaecfcb 341 kB/s | 52 kB 00:00 2020-06-27T04:38:11.151 INFO:teuthology.orchestra.run.smithi051.stdout:(5/6): python3-remoto-1.1.4-4.el8.noarch.rpm 777 kB/s | 48 kB 00:00 2020-06-27T04:38:11.153 INFO:teuthology.orchestra.run.smithi051.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 4.4 MB/s | 355 kB 00:00 2020-06-27T04:38:11.154 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:38:11.155 INFO:teuthology.orchestra.run.smithi051.stdout:Total 33 MB/s | 5.8 MB 00:00 2020-06-27T04:38:11.160 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2020-06-27T04:38:11.170 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2020-06-27T04:38:11.170 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2020-06-27T04:38:11.177 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-rook-2:16.0.0-2978.g77ddaecfcb0.el8.noarc 13/13 2020-06-27T04:38:11.251 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2020-06-27T04:38:11.251 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2020-06-27T04:38:11.392 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-2978.g77ddaecfcb0.el8.noarc 13/13 2020-06-27T04:38:11.393 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-rook-2:16.0.0-2978.g77ddaecfcb0.el8.noarc 1/13 2020-06-27T04:38:11.393 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2020-06-27T04:38:11.393 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2020-06-27T04:38:11.393 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2020-06-27T04:38:11.393 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2020-06-27T04:38:11.394 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2020-06-27T04:38:11.394 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2020-06-27T04:38:11.394 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2020-06-27T04:38:11.394 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2020-06-27T04:38:11.394 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2020-06-27T04:38:11.395 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 11/13 2020-06-27T04:38:11.395 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 12/13 2020-06-27T04:38:11.527 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2020-06-27T04:38:11.708 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2020-06-27T04:38:11.709 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:11.709 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2020-06-27T04:38:11.709 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:38:11.709 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-06-27T04:38:11.709 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-06-27T04:38:11.710 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-06-27T04:38:11.710 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-06-27T04:38:11.710 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-06-27T04:38:11.710 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-06-27T04:38:11.710 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-06-27T04:38:11.711 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-06-27T04:38:11.711 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-06-27T04:38:11.711 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-06-27T04:38:11.711 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-06-27T04:38:11.711 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-06-27T04:38:11.711 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:11.712 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:38:11.832 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2020-06-27T04:38:11.873 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-mgr-cephadm 2020-06-27T04:38:12.055 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2020-06-27T04:38:12.313 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:41 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:12.726 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:38:12.727 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:12.727 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2020-06-27T04:38:12.728 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:12.728 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2020-06-27T04:38:12.728 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm noarch 2:16.0.0-2978.g77ddaecfcb0.el8 ceph-noarch 52 k 2020-06-27T04:38:12.728 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2020-06-27T04:38:12.728 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2020-06-27T04:38:12.729 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2020-06-27T04:38:12.729 INFO:teuthology.orchestra.run.smithi031.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-06-27T04:38:12.729 INFO:teuthology.orchestra.run.smithi031.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2020-06-27T04:38:12.729 INFO:teuthology.orchestra.run.smithi031.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2020-06-27T04:38:12.729 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:12.729 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2020-06-27T04:38:12.730 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:12.730 INFO:teuthology.orchestra.run.smithi031.stdout:Install 6 Packages 2020-06-27T04:38:12.730 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:12.731 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 5.8 M 2020-06-27T04:38:12.731 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 24 M 2020-06-27T04:38:12.731 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2020-06-27T04:38:12.776 INFO:teuthology.orchestra.run.smithi031.stdout:(1/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 11 MB/s | 538 kB 00:00 2020-06-27T04:38:12.825 INFO:teuthology.orchestra.run.smithi031.stdout:(2/6): python3-babel-2.5.1-5.el8.noarch.rpm 50 MB/s | 4.8 MB 00:00 2020-06-27T04:38:12.826 INFO:teuthology.orchestra.run.smithi031.stdout:(3/6): python3-apipkg-1.5-6.el8.noarch.rpm 435 kB/s | 21 kB 00:00 2020-06-27T04:38:12.882 INFO:teuthology.orchestra.run.smithi031.stdout:(4/6): ceph-mgr-cephadm-16.0.0-2978.g77ddaecfcb 341 kB/s | 52 kB 00:00 2020-06-27T04:38:12.887 INFO:teuthology.orchestra.run.smithi031.stdout:(5/6): python3-remoto-1.1.4-4.el8.noarch.rpm 774 kB/s | 48 kB 00:00 2020-06-27T04:38:12.903 INFO:teuthology.orchestra.run.smithi031.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 4.5 MB/s | 355 kB 00:00 2020-06-27T04:38:12.904 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:38:12.905 INFO:teuthology.orchestra.run.smithi031.stdout:Total 33 MB/s | 5.8 MB 00:00 2020-06-27T04:38:12.909 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2020-06-27T04:38:12.919 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2020-06-27T04:38:12.920 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2020-06-27T04:38:13.004 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2020-06-27T04:38:13.004 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2020-06-27T04:38:13.080 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/6 2020-06-27T04:38:13.277 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2020-06-27T04:38:13.421 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 4/6 2020-06-27T04:38:13.550 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2020-06-27T04:38:13.707 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2020-06-27T04:38:13.899 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.noar 6/6 2020-06-27T04:38:14.101 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.noar 6/6 2020-06-27T04:38:14.101 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.noar 1/6 2020-06-27T04:38:14.101 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 2/6 2020-06-27T04:38:14.102 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/6 2020-06-27T04:38:14.102 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2020-06-27T04:38:14.102 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2020-06-27T04:38:14.134 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2020-06-27T04:38:14.675 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 6/6 2020-06-27T04:38:14.675 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:14.675 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2020-06-27T04:38:14.675 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:38:14.676 INFO:teuthology.orchestra.run.smithi051.stdout: python3-babel-2.5.1-5.el8.noarch 2020-06-27T04:38:14.676 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-06-27T04:38:14.676 INFO:teuthology.orchestra.run.smithi051.stdout: python3-apipkg-1.5-6.el8.noarch 2020-06-27T04:38:14.676 INFO:teuthology.orchestra.run.smithi051.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-06-27T04:38:14.676 INFO:teuthology.orchestra.run.smithi051.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-06-27T04:38:14.676 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:14.677 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:38:15.113 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-fuse 2020-06-27T04:38:15.115 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/6 2020-06-27T04:38:15.442 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 4/6 2020-06-27T04:38:15.569 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:44 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:15.701 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2020-06-27T04:38:15.860 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.noar 6/6 2020-06-27T04:38:15.953 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:38:15.954 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:15.955 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repository Size 2020-06-27T04:38:15.955 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:15.955 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2020-06-27T04:38:15.955 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-fuse x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 607 k 2020-06-27T04:38:15.955 INFO:teuthology.orchestra.run.smithi051.stdout:Installing dependencies: 2020-06-27T04:38:15.956 INFO:teuthology.orchestra.run.smithi051.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2020-06-27T04:38:15.956 INFO:teuthology.orchestra.run.smithi051.stdout: fuse-common x86_64 3.2.1-12.el8 CentOS-Base 21 k 2020-06-27T04:38:15.956 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:15.956 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2020-06-27T04:38:15.956 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:15.956 INFO:teuthology.orchestra.run.smithi051.stdout:Install 3 Packages 2020-06-27T04:38:15.957 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:15.957 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 710 k 2020-06-27T04:38:15.957 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 2.2 M 2020-06-27T04:38:15.958 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2020-06-27T04:38:15.991 INFO:teuthology.orchestra.run.smithi051.stdout:(1/3): fuse-common-3.2.1-12.el8.x86_64.rpm 613 kB/s | 21 kB 00:00 2020-06-27T04:38:15.992 INFO:teuthology.orchestra.run.smithi051.stdout:(2/3): fuse-2.9.7-12.el8.x86_64.rpm 2.3 MB/s | 82 kB 00:00 2020-06-27T04:38:16.094 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.noar 6/6 2020-06-27T04:38:16.094 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.noar 1/6 2020-06-27T04:38:16.094 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 2/6 2020-06-27T04:38:16.095 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/6 2020-06-27T04:38:16.095 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2020-06-27T04:38:16.095 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2020-06-27T04:38:16.182 INFO:teuthology.orchestra.run.smithi051.stdout:(3/3): ceph-fuse-16.0.0-2978.g77ddaecfcb0.el8.x 2.6 MB/s | 607 kB 00:00 2020-06-27T04:38:16.184 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:38:16.184 INFO:teuthology.orchestra.run.smithi051.stdout:Total 3.0 MB/s | 710 kB 00:00 2020-06-27T04:38:16.188 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2020-06-27T04:38:16.211 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2020-06-27T04:38:16.211 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2020-06-27T04:38:16.282 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2020-06-27T04:38:16.283 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2020-06-27T04:38:16.407 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 6/6 2020-06-27T04:38:16.407 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:16.408 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2020-06-27T04:38:16.408 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:38:16.408 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel-2.5.1-5.el8.noarch 2020-06-27T04:38:16.408 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-06-27T04:38:16.408 INFO:teuthology.orchestra.run.smithi031.stdout: python3-apipkg-1.5-6.el8.noarch 2020-06-27T04:38:16.409 INFO:teuthology.orchestra.run.smithi031.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-06-27T04:38:16.409 INFO:teuthology.orchestra.run.smithi031.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-06-27T04:38:16.409 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:16.409 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:38:16.478 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2020-06-27T04:38:16.479 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2020-06-27T04:38:16.479 INFO:teuthology.orchestra.run.smithi051.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-06-27T04:38:16.479 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:16.539 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-fuse 2020-06-27T04:38:16.896 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2020-06-27T04:38:16.981 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:45 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:17.048 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 3/3 2020-06-27T04:38:17.373 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 3/3 2020-06-27T04:38:17.373 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/3 2020-06-27T04:38:17.373 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2020-06-27T04:38:17.378 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:38:17.379 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:17.379 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2020-06-27T04:38:17.380 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:17.380 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2020-06-27T04:38:17.380 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 607 k 2020-06-27T04:38:17.380 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2020-06-27T04:38:17.380 INFO:teuthology.orchestra.run.smithi031.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2020-06-27T04:38:17.381 INFO:teuthology.orchestra.run.smithi031.stdout: fuse-common x86_64 3.2.1-12.el8 CentOS-Base 21 k 2020-06-27T04:38:17.381 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:17.381 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2020-06-27T04:38:17.381 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:17.381 INFO:teuthology.orchestra.run.smithi031.stdout:Install 3 Packages 2020-06-27T04:38:17.381 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:17.382 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 710 k 2020-06-27T04:38:17.382 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 2.2 M 2020-06-27T04:38:17.383 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2020-06-27T04:38:17.416 INFO:teuthology.orchestra.run.smithi031.stdout:(1/3): fuse-2.9.7-12.el8.x86_64.rpm 2.3 MB/s | 82 kB 00:00 2020-06-27T04:38:17.416 INFO:teuthology.orchestra.run.smithi031.stdout:(2/3): fuse-common-3.2.1-12.el8.x86_64.rpm 609 kB/s | 21 kB 00:00 2020-06-27T04:38:17.609 INFO:teuthology.orchestra.run.smithi031.stdout:(3/3): ceph-fuse-16.0.0-2978.g77ddaecfcb0.el8.x 2.6 MB/s | 607 kB 00:00 2020-06-27T04:38:17.610 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:38:17.611 INFO:teuthology.orchestra.run.smithi031.stdout:Total 3.0 MB/s | 710 kB 00:00 2020-06-27T04:38:17.614 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2020-06-27T04:38:17.637 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2020-06-27T04:38:17.638 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2020-06-27T04:38:17.639 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2020-06-27T04:38:17.639 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:17.639 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2020-06-27T04:38:17.639 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-06-27T04:38:17.639 INFO:teuthology.orchestra.run.smithi051.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-06-27T04:38:17.640 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:17.640 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:38:17.709 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2020-06-27T04:38:17.710 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2020-06-27T04:38:17.905 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2020-06-27T04:38:17.906 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2020-06-27T04:38:17.906 INFO:teuthology.orchestra.run.smithi031.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-06-27T04:38:17.906 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:17.957 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install librados-devel 2020-06-27T04:38:18.273 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2020-06-27T04:38:18.400 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 3/3 2020-06-27T04:38:18.402 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:47 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:18.728 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 3/3 2020-06-27T04:38:18.729 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/3 2020-06-27T04:38:18.729 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2020-06-27T04:38:18.785 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:38:18.786 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:18.786 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repo Size 2020-06-27T04:38:18.786 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:18.786 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2020-06-27T04:38:18.787 INFO:teuthology.orchestra.run.smithi051.stdout: librados-devel x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 141 k 2020-06-27T04:38:18.787 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:18.787 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2020-06-27T04:38:18.787 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:18.787 INFO:teuthology.orchestra.run.smithi051.stdout:Install 1 Package 2020-06-27T04:38:18.788 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:18.788 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 141 k 2020-06-27T04:38:18.788 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 485 k 2020-06-27T04:38:18.788 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2020-06-27T04:38:18.963 INFO:teuthology.orchestra.run.smithi051.stdout:librados-devel-16.0.0-2978.g77ddaecfcb0.el8.x86 796 kB/s | 141 kB 00:00 2020-06-27T04:38:18.964 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:38:18.964 INFO:teuthology.orchestra.run.smithi051.stdout:Total 791 kB/s | 141 kB 00:00 2020-06-27T04:38:18.966 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2020-06-27T04:38:18.973 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2020-06-27T04:38:18.974 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2020-06-27T04:38:19.019 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2020-06-27T04:38:19.019 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:19.019 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2020-06-27T04:38:19.020 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-06-27T04:38:19.020 INFO:teuthology.orchestra.run.smithi031.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-06-27T04:38:19.020 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:19.020 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:38:19.026 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2020-06-27T04:38:19.027 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2020-06-27T04:38:19.139 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2020-06-27T04:38:19.380 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : librados-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:19.597 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: librados-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:19.702 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install librados-devel 2020-06-27T04:38:19.850 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : librados-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:19.850 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:19.851 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2020-06-27T04:38:19.851 INFO:teuthology.orchestra.run.smithi051.stdout: librados-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:38:19.851 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:19.852 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:38:20.118 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install libcephfs2 2020-06-27T04:38:20.154 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:49 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:20.528 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:38:20.529 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:20.529 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repo Size 2020-06-27T04:38:20.530 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:20.530 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2020-06-27T04:38:20.530 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 141 k 2020-06-27T04:38:20.530 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:20.530 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2020-06-27T04:38:20.531 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:20.531 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2020-06-27T04:38:20.531 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:20.531 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 141 k 2020-06-27T04:38:20.531 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 485 k 2020-06-27T04:38:20.532 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2020-06-27T04:38:20.563 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:49 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:20.707 INFO:teuthology.orchestra.run.smithi031.stdout:librados-devel-16.0.0-2978.g77ddaecfcb0.el8.x86 795 kB/s | 141 kB 00:00 2020-06-27T04:38:20.708 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:38:20.708 INFO:teuthology.orchestra.run.smithi031.stdout:Total 790 kB/s | 141 kB 00:00 2020-06-27T04:38:20.710 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2020-06-27T04:38:20.719 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2020-06-27T04:38:20.719 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2020-06-27T04:38:20.772 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2020-06-27T04:38:20.773 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2020-06-27T04:38:20.850 INFO:teuthology.orchestra.run.smithi051.stdout:Package libcephfs2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:38:20.889 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2020-06-27T04:38:20.963 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:38:20.964 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2020-06-27T04:38:20.964 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:38:21.085 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librados-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:21.193 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install libcephfs-devel 2020-06-27T04:38:21.302 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:21.590 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:21.590 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:21.590 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2020-06-27T04:38:21.590 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:38:21.591 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:21.591 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:38:21.635 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:50 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:21.872 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install libcephfs2 2020-06-27T04:38:22.009 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:38:22.010 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:22.010 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repo Size 2020-06-27T04:38:22.010 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:22.011 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2020-06-27T04:38:22.011 INFO:teuthology.orchestra.run.smithi051.stdout: libcephfs-devel x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 23 k 2020-06-27T04:38:22.011 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:22.011 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2020-06-27T04:38:22.011 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:22.011 INFO:teuthology.orchestra.run.smithi051.stdout:Install 1 Package 2020-06-27T04:38:22.012 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:22.012 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 23 k 2020-06-27T04:38:22.012 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 84 k 2020-06-27T04:38:22.012 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2020-06-27T04:38:22.139 INFO:teuthology.orchestra.run.smithi051.stdout:libcephfs-devel-16.0.0-2978.g77ddaecfcb0.el8.x8 182 kB/s | 23 kB 00:00 2020-06-27T04:38:22.140 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:38:22.140 INFO:teuthology.orchestra.run.smithi051.stdout:Total 180 kB/s | 23 kB 00:00 2020-06-27T04:38:22.142 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2020-06-27T04:38:22.146 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2020-06-27T04:38:22.146 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2020-06-27T04:38:22.148 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2020-06-27T04:38:22.149 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2020-06-27T04:38:22.210 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2020-06-27T04:38:22.319 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:51 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:22.379 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : libcephfs-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_6 1/1 2020-06-27T04:38:22.566 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: libcephfs-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_6 1/1 2020-06-27T04:38:22.610 INFO:teuthology.orchestra.run.smithi031.stdout:Package libcephfs2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:38:22.726 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:38:22.726 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2020-06-27T04:38:22.727 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:38:22.782 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : libcephfs-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_6 1/1 2020-06-27T04:38:22.782 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:22.782 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2020-06-27T04:38:22.783 INFO:teuthology.orchestra.run.smithi051.stdout: libcephfs-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:38:22.783 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:22.783 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:38:22.894 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install libcephfs-devel 2020-06-27T04:38:22.949 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install librados2 2020-06-27T04:38:23.335 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:52 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:23.392 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:52 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:23.655 INFO:teuthology.orchestra.run.smithi051.stdout:Package librados2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:38:23.718 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:38:23.719 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:23.720 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repo Size 2020-06-27T04:38:23.720 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:23.720 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2020-06-27T04:38:23.720 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 23 k 2020-06-27T04:38:23.720 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:23.721 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2020-06-27T04:38:23.721 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:23.721 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2020-06-27T04:38:23.721 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:23.721 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 23 k 2020-06-27T04:38:23.722 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 84 k 2020-06-27T04:38:23.722 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2020-06-27T04:38:23.768 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:38:23.769 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2020-06-27T04:38:23.769 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:38:23.849 INFO:teuthology.orchestra.run.smithi031.stdout:libcephfs-devel-16.0.0-2978.g77ddaecfcb0.el8.x8 181 kB/s | 23 kB 00:00 2020-06-27T04:38:23.850 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:38:23.850 INFO:teuthology.orchestra.run.smithi031.stdout:Total 180 kB/s | 23 kB 00:00 2020-06-27T04:38:23.852 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2020-06-27T04:38:23.856 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2020-06-27T04:38:23.856 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2020-06-27T04:38:23.858 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2020-06-27T04:38:23.859 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2020-06-27T04:38:23.910 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2020-06-27T04:38:23.911 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install librbd1 2020-06-27T04:38:24.091 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_6 1/1 2020-06-27T04:38:24.289 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_6 1/1 2020-06-27T04:38:24.353 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:53 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:24.532 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_6 1/1 2020-06-27T04:38:24.533 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:24.533 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2020-06-27T04:38:24.533 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:38:24.533 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:24.534 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:38:24.646 INFO:teuthology.orchestra.run.smithi051.stdout:Package librbd1-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:38:24.660 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install librados2 2020-06-27T04:38:24.759 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:38:24.760 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2020-06-27T04:38:24.760 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:38:24.903 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install python3-rados 2020-06-27T04:38:25.099 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:54 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:25.344 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:54 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:25.407 INFO:teuthology.orchestra.run.smithi031.stdout:Package librados2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:38:25.521 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:38:25.522 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2020-06-27T04:38:25.522 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:38:25.622 INFO:teuthology.orchestra.run.smithi051.stdout:Package python3-rados-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:38:25.677 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install librbd1 2020-06-27T04:38:25.734 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:38:25.735 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2020-06-27T04:38:25.736 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:38:25.886 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install python3-rgw 2020-06-27T04:38:26.124 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:55 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:26.332 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:55 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:26.390 INFO:teuthology.orchestra.run.smithi031.stdout:Package librbd1-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:38:26.502 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:38:26.503 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2020-06-27T04:38:26.504 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:38:26.597 INFO:teuthology.orchestra.run.smithi051.stdout:Package python3-rgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:38:26.633 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-rados 2020-06-27T04:38:26.708 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:38:26.717 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2020-06-27T04:38:26.717 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:38:26.869 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install python3-cephfs 2020-06-27T04:38:27.072 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:56 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:27.308 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:56 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:27.340 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-rados-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:38:27.451 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:38:27.453 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2020-06-27T04:38:27.453 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:38:27.574 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-rgw 2020-06-27T04:38:27.579 INFO:teuthology.orchestra.run.smithi051.stdout:Package python3-cephfs-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:38:27.694 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:38:27.695 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2020-06-27T04:38:27.695 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:38:27.877 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install python3-rbd 2020-06-27T04:38:28.017 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:57 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:28.315 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:57 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:28.318 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-rgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:38:28.430 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:38:28.431 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2020-06-27T04:38:28.432 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:38:28.596 INFO:teuthology.orchestra.run.smithi051.stdout:Package python3-rbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:38:28.601 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-cephfs 2020-06-27T04:38:28.708 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:38:28.709 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2020-06-27T04:38:28.709 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:38:28.859 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install rbd-fuse 2020-06-27T04:38:29.042 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:58 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:29.298 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:58 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:29.323 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-cephfs-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:38:29.434 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:38:29.435 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2020-06-27T04:38:29.436 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:38:29.556 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-rbd 2020-06-27T04:38:29.677 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:38:29.678 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:29.678 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repo Size 2020-06-27T04:38:29.678 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:29.678 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2020-06-27T04:38:29.678 INFO:teuthology.orchestra.run.smithi051.stdout: rbd-fuse x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 90 k 2020-06-27T04:38:29.679 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:29.679 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2020-06-27T04:38:29.679 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:29.679 INFO:teuthology.orchestra.run.smithi051.stdout:Install 1 Package 2020-06-27T04:38:29.679 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:29.680 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 90 k 2020-06-27T04:38:29.680 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 333 k 2020-06-27T04:38:29.680 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2020-06-27T04:38:29.832 INFO:teuthology.orchestra.run.smithi051.stdout:rbd-fuse-16.0.0-2978.g77ddaecfcb0.el8.x86_64.rp 589 kB/s | 90 kB 00:00 2020-06-27T04:38:29.833 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:38:29.833 INFO:teuthology.orchestra.run.smithi051.stdout:Total 585 kB/s | 90 kB 00:00 2020-06-27T04:38:29.834 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2020-06-27T04:38:29.847 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2020-06-27T04:38:29.847 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2020-06-27T04:38:29.900 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2020-06-27T04:38:29.901 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2020-06-27T04:38:30.001 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:58 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:30.041 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2020-06-27T04:38:30.203 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : rbd-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:30.400 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: rbd-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:30.624 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : rbd-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:30.625 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:30.625 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2020-06-27T04:38:30.625 INFO:teuthology.orchestra.run.smithi051.stdout: rbd-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:38:30.625 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:30.625 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:38:30.649 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-rbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:38:30.763 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:38:30.764 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2020-06-27T04:38:30.764 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:38:30.925 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install rbd-fuse 2020-06-27T04:38:30.933 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install rbd-mirror 2020-06-27T04:38:31.367 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:02:00 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:31.372 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:02:00 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:31.753 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:38:31.754 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:31.754 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repo Size 2020-06-27T04:38:31.754 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:31.754 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2020-06-27T04:38:31.755 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 90 k 2020-06-27T04:38:31.755 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:31.755 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2020-06-27T04:38:31.755 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:31.756 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2020-06-27T04:38:31.756 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:31.756 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 90 k 2020-06-27T04:38:31.756 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 333 k 2020-06-27T04:38:31.756 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2020-06-27T04:38:31.807 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:38:31.808 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:31.808 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repo Size 2020-06-27T04:38:31.808 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:31.808 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2020-06-27T04:38:31.809 INFO:teuthology.orchestra.run.smithi051.stdout: rbd-mirror x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 2.7 M 2020-06-27T04:38:31.809 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:31.809 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2020-06-27T04:38:31.809 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:31.809 INFO:teuthology.orchestra.run.smithi051.stdout:Install 1 Package 2020-06-27T04:38:31.810 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:31.810 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 2.7 M 2020-06-27T04:38:31.810 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 12 M 2020-06-27T04:38:31.810 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2020-06-27T04:38:31.908 INFO:teuthology.orchestra.run.smithi031.stdout:rbd-fuse-16.0.0-2978.g77ddaecfcb0.el8.x86_64.rp 592 kB/s | 90 kB 00:00 2020-06-27T04:38:31.908 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:38:31.909 INFO:teuthology.orchestra.run.smithi031.stdout:Total 588 kB/s | 90 kB 00:00 2020-06-27T04:38:31.910 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2020-06-27T04:38:31.922 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2020-06-27T04:38:31.923 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2020-06-27T04:38:31.977 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2020-06-27T04:38:31.980 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2020-06-27T04:38:32.082 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2020-06-27T04:38:32.141 INFO:teuthology.orchestra.run.smithi051.stdout:rbd-mirror-16.0.0-2978.g77ddaecfcb0.el8.x86_64. 8.4 MB/s | 2.7 MB 00:00 2020-06-27T04:38:32.141 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:38:32.141 INFO:teuthology.orchestra.run.smithi051.stdout:Total 8.4 MB/s | 2.7 MB 00:00 2020-06-27T04:38:32.142 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2020-06-27T04:38:32.149 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2020-06-27T04:38:32.149 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2020-06-27T04:38:32.213 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2020-06-27T04:38:32.214 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2020-06-27T04:38:32.222 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:32.458 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:32.714 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:32.714 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:32.714 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2020-06-27T04:38:32.714 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:38:32.714 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:32.715 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:38:33.064 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install rbd-mirror 2020-06-27T04:38:33.260 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2020-06-27T04:38:33.488 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : rbd-mirror-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:33.506 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:02:02 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:33.824 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: rbd-mirror-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:33.898 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:38:33.899 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:33.899 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repo Size 2020-06-27T04:38:33.899 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:33.900 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2020-06-27T04:38:33.900 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 2.7 M 2020-06-27T04:38:33.900 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:33.900 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2020-06-27T04:38:33.900 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:33.901 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2020-06-27T04:38:33.901 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:33.901 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 2.7 M 2020-06-27T04:38:33.901 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 12 M 2020-06-27T04:38:33.902 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2020-06-27T04:38:34.065 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : rbd-mirror-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:34.066 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:34.066 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2020-06-27T04:38:34.066 INFO:teuthology.orchestra.run.smithi051.stdout: rbd-mirror-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:38:34.066 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:34.067 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:38:34.213 INFO:teuthology.orchestra.run.smithi031.stdout:rbd-mirror-16.0.0-2978.g77ddaecfcb0.el8.x86_64. 8.7 MB/s | 2.7 MB 00:00 2020-06-27T04:38:34.214 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:38:34.214 INFO:teuthology.orchestra.run.smithi031.stdout:Total 8.6 MB/s | 2.7 MB 00:00 2020-06-27T04:38:34.216 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2020-06-27T04:38:34.230 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2020-06-27T04:38:34.231 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2020-06-27T04:38:34.294 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2020-06-27T04:38:34.294 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2020-06-27T04:38:34.428 INFO:teuthology.orchestra.run.smithi051:> sudo yum -y install rbd-nbd 2020-06-27T04:38:34.679 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2020-06-27T04:38:34.824 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-mirror-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:34.874 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:02:03 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:35.190 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-mirror-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:35.301 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2020-06-27T04:38:35.302 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:35.302 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repo Size 2020-06-27T04:38:35.302 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:35.302 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2020-06-27T04:38:35.302 INFO:teuthology.orchestra.run.smithi051.stdout: rbd-nbd x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 164 k 2020-06-27T04:38:35.303 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:35.303 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2020-06-27T04:38:35.303 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2020-06-27T04:38:35.303 INFO:teuthology.orchestra.run.smithi051.stdout:Install 1 Package 2020-06-27T04:38:35.303 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:35.304 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 164 k 2020-06-27T04:38:35.304 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 645 k 2020-06-27T04:38:35.304 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2020-06-27T04:38:35.440 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-mirror-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:35.440 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:35.440 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2020-06-27T04:38:35.441 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:38:35.441 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:35.441 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:38:35.480 INFO:teuthology.orchestra.run.smithi051.stdout:rbd-nbd-16.0.0-2978.g77ddaecfcb0.el8.x86_64.rpm 925 kB/s | 164 kB 00:00 2020-06-27T04:38:35.480 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:38:35.481 INFO:teuthology.orchestra.run.smithi051.stdout:Total 920 kB/s | 164 kB 00:00 2020-06-27T04:38:35.482 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2020-06-27T04:38:35.496 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2020-06-27T04:38:35.496 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2020-06-27T04:38:35.550 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2020-06-27T04:38:35.550 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2020-06-27T04:38:35.666 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2020-06-27T04:38:35.727 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install rbd-nbd 2020-06-27T04:38:35.860 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : rbd-nbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:36.081 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: rbd-nbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:36.174 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:02:05 ago on Sat 27 Jun 2020 04:36:31 AM UTC. 2020-06-27T04:38:36.355 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : rbd-nbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:36.355 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:36.355 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2020-06-27T04:38:36.355 INFO:teuthology.orchestra.run.smithi051.stdout: rbd-nbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:38:36.356 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:38:36.356 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2020-06-27T04:38:36.588 DEBUG:teuthology.parallel:result is None 2020-06-27T04:38:36.946 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-06-27T04:38:36.947 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:36.948 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repo Size 2020-06-27T04:38:36.948 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:36.948 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2020-06-27T04:38:36.948 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 164 k 2020-06-27T04:38:36.949 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:36.949 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2020-06-27T04:38:36.949 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-06-27T04:38:36.949 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2020-06-27T04:38:36.949 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:36.950 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 164 k 2020-06-27T04:38:36.950 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 645 k 2020-06-27T04:38:36.950 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2020-06-27T04:38:37.187 INFO:teuthology.orchestra.run.smithi031.stdout:rbd-nbd-16.0.0-2978.g77ddaecfcb0.el8.x86_64.rpm 687 kB/s | 164 kB 00:00 2020-06-27T04:38:37.187 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:38:37.188 INFO:teuthology.orchestra.run.smithi031.stdout:Total 683 kB/s | 164 kB 00:00 2020-06-27T04:38:37.190 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2020-06-27T04:38:37.204 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2020-06-27T04:38:37.205 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2020-06-27T04:38:37.262 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2020-06-27T04:38:37.262 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2020-06-27T04:38:37.503 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2020-06-27T04:38:37.688 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-nbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:37.915 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-nbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:38.195 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-nbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:38:38.196 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:38.196 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2020-06-27T04:38:38.196 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:38:38.196 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:38:38.197 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-06-27T04:38:38.526 DEBUG:teuthology.parallel:result is None 2020-06-27T04:38:38.527 INFO:teuthology.orchestra.run.smithi031:> sudo lsb_release -is 2020-06-27T04:38:38.568 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS 2020-06-27T04:38:38.569 DEBUG:teuthology.misc:System to be installed: CentOS 2020-06-27T04:38:38.570 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 2020-06-27T04:38:38.764 INFO:teuthology.orchestra.run.smithi031:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-06-27T04:38:38.784 INFO:teuthology.orchestra.run.smithi031.stdout:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:38:38.785 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:38:38.785 INFO:teuthology.task.install:The correct ceph version 16.0.0-2978.g77ddaecfcb0 is installed. 2020-06-27T04:38:38.786 INFO:teuthology.orchestra.run.smithi051:> sudo lsb_release -is 2020-06-27T04:38:38.834 INFO:teuthology.orchestra.run.smithi051.stdout:CentOS 2020-06-27T04:38:38.835 DEBUG:teuthology.misc:System to be installed: CentOS 2020-06-27T04:38:38.836 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 2020-06-27T04:38:39.045 INFO:teuthology.orchestra.run.smithi051:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-06-27T04:38:39.068 INFO:teuthology.orchestra.run.smithi051.stdout:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:38:39.068 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:38:39.068 INFO:teuthology.task.install:The correct ceph version 16.0.0-2978.g77ddaecfcb0 is installed. 2020-06-27T04:38:39.069 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-06-27T04:38:39.070 INFO:teuthology.orchestra.run.smithi031:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-06-27T04:38:39.104 INFO:teuthology.orchestra.run.smithi051:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-06-27T04:38:39.148 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-06-27T04:38:39.148 INFO:teuthology.orchestra.run.smithi031:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-06-27T04:38:39.184 INFO:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-06-27T04:38:39.255 INFO:teuthology.orchestra.run.smithi051:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-06-27T04:38:39.290 INFO:teuthology.orchestra.run.smithi051:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-06-27T04:38:39.365 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-06-27T04:38:39.366 INFO:teuthology.orchestra.run.smithi031:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-06-27T04:38:39.413 INFO:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-06-27T04:38:39.485 INFO:teuthology.orchestra.run.smithi051:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-06-27T04:38:39.530 INFO:teuthology.orchestra.run.smithi051:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-06-27T04:38:39.606 INFO:teuthology.run_tasks:Running task cephadm... 2020-06-27T04:38:39.709 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd shutdown pgref assert': True}}, 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'cephadm_mode': 'root'} 2020-06-27T04:38:39.710 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 2020-06-27T04:38:39.714 INFO:tasks.cephadm:Cluster fsid is 12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:38:39.714 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2020-06-27T04:38:39.715 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.31', 'mon.c': '[v2:172.21.15.31:3301,v1:172.21.15.31:6790]', 'mon.b': '172.21.15.51'} 2020-06-27T04:38:39.715 INFO:tasks.cephadm:First mon is mon.a on smithi031 2020-06-27T04:38:39.716 INFO:tasks.cephadm:First mgr is y 2020-06-27T04:38:39.716 INFO:tasks.cephadm:Normalizing hostnames... 2020-06-27T04:38:39.716 INFO:teuthology.orchestra.run.smithi031:> sudo hostname $(hostname -s) 2020-06-27T04:38:39.749 INFO:teuthology.orchestra.run.smithi051:> sudo hostname $(hostname -s) 2020-06-27T04:38:39.783 INFO:tasks.cephadm:Downloading cephadm (repo git://git.ceph.com/ceph-ci.git ref 77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5)... 2020-06-27T04:38:39.783 INFO:teuthology.orchestra.run.smithi031:> git archive --remote=git://git.ceph.com/ceph-ci.git 77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm 2020-06-27T04:38:39.911 INFO:teuthology.orchestra.run.smithi051:> git archive --remote=git://git.ceph.com/ceph-ci.git 77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm 2020-06-27T04:38:40.055 INFO:teuthology.orchestra.run.smithi031:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2020-06-27T04:38:40.074 INFO:teuthology.orchestra.run.smithi051:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2020-06-27T04:38:40.091 INFO:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph 2020-06-27T04:38:40.146 INFO:teuthology.orchestra.run.smithi051:> sudo mkdir -p /etc/ceph 2020-06-27T04:38:40.181 INFO:teuthology.orchestra.run.smithi031:> sudo chmod 777 /etc/ceph 2020-06-27T04:38:40.219 INFO:teuthology.orchestra.run.smithi051:> sudo chmod 777 /etc/ceph 2020-06-27T04:38:40.254 INFO:tasks.cephadm:Adding local image mirror vossi04.front.sepia.ceph.com:5000 2020-06-27T04:38:40.305 DEBUG:teuthology.orchestra.remote:smithi031:/etc/containers/registries.conf is 4KB 2020-06-27T04:38:40.364 INFO:teuthology.orchestra.run.smithi031:> sudo sh -c 'cat > /etc/containers/registries.conf' 2020-06-27T04:38:40.450 DEBUG:teuthology.orchestra.remote:smithi051:/etc/containers/registries.conf is 4KB 2020-06-27T04:38:40.504 INFO:teuthology.orchestra.run.smithi051:> sudo sh -c 'cat > /etc/containers/registries.conf' 2020-06-27T04:38:40.548 INFO:tasks.cephadm:Writing seed config... 2020-06-27T04:38:40.550 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2020-06-27T04:38:40.550 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2020-06-27T04:38:40.550 INFO:tasks.cephadm: override: [client] debug ms = 1 2020-06-27T04:38:40.551 INFO:tasks.cephadm: override: [global] ms bind msgr1 = False 2020-06-27T04:38:40.551 INFO:tasks.cephadm: override: [global] ms bind msgr2 = True 2020-06-27T04:38:40.551 INFO:tasks.cephadm: override: [global] ms type = async 2020-06-27T04:38:40.552 INFO:tasks.cephadm: override: [mon] debug mon = 20 2020-06-27T04:38:40.552 INFO:tasks.cephadm: override: [mon] debug ms = 1 2020-06-27T04:38:40.552 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2020-06-27T04:38:40.553 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2020-06-27T04:38:40.553 INFO:tasks.cephadm: override: [osd] debug filestore = 20 2020-06-27T04:38:40.553 INFO:tasks.cephadm: override: [osd] debug journal = 20 2020-06-27T04:38:40.553 INFO:tasks.cephadm: override: [osd] debug ms = 20 2020-06-27T04:38:40.554 INFO:tasks.cephadm: override: [osd] debug osd = 25 2020-06-27T04:38:40.554 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2020-06-27T04:38:40.555 INFO:teuthology.orchestra.run.smithi031:> cat > /home/ubuntu/cephtest/seed.ceph.conf 2020-06-27T04:38:40.582 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 12892ae2-b830-11ea-a06d-001a4aab830c ms bind msgr1 = False ms bind msgr2 = True ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug filestore = 20 debug journal = 20 debug ms = 20 debug osd = 25 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2020-06-27T04:38:40.583 INFO:teuthology.orchestra.run.smithi031:mon.a> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mon.a.service 2020-06-27T04:38:40.625 INFO:teuthology.orchestra.run.smithi031:mgr.y> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mgr.y.service 2020-06-27T04:38:40.656 INFO:ceph.mon.a.smithi031.stdout:-- Logs begin at Sat 2020-06-27 04:33:08 UTC. -- 2020-06-27T04:38:40.657 INFO:tasks.cephadm:Bootstrapping... 2020-06-27T04:38:40.658 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -v bootstrap --fsid 12892ae2-b830-11ea-a06d-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.31 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2020-06-27T04:38:40.688 INFO:ceph.mgr.y.smithi031.stdout:-- Logs begin at Sat 2020-06-27 04:33:08 UTC. -- 2020-06-27T04:38:40.833 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Verifying podman|docker is present... 2020-06-27T04:38:40.833 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Verifying lvm2 is present... 2020-06-27T04:38:40.834 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Verifying time synchronization is in place... 2020-06-27T04:38:40.834 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2020-06-27T04:38:40.840 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2020-06-27T04:38:40.840 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.005740165710449219, stop=False, exit=None, reads=[5] 2020-06-27T04:38:40.840 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.005827665328979492, stop=False, exit=1, reads=[3, 5] 2020-06-27T04:38:40.841 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.005891084671020508, stop=True, exit=1, reads=[3, 5] 2020-06-27T04:38:40.841 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2020-06-27T04:38:40.845 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stdout inactive 2020-06-27T04:38:40.845 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.004346609115600586, stop=False, exit=3, reads=[3] 2020-06-27T04:38:40.845 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.004423618316650391, stop=True, exit=3, reads=[3] 2020-06-27T04:38:40.846 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2020-06-27T04:38:40.850 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stdout enabled 2020-06-27T04:38:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.00459742546081543, stop=False, exit=0, reads=[3] 2020-06-27T04:38:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.00467228889465332, stop=True, exit=0, reads=[3] 2020-06-27T04:38:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2020-06-27T04:38:40.856 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stdout active 2020-06-27T04:38:40.856 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.00427699089050293, stop=False, exit=0, reads=[3] 2020-06-27T04:38:40.856 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.004351615905761719, stop=True, exit=0, reads=[3] 2020-06-27T04:38:40.857 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Unit chronyd.service is enabled and running 2020-06-27T04:38:40.857 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Repeating the final host check... 2020-06-27T04:38:40.857 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:podman|docker (/bin/podman) is present 2020-06-27T04:38:40.857 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:systemctl is present 2020-06-27T04:38:40.857 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:lvcreate is present 2020-06-27T04:38:40.858 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2020-06-27T04:38:40.861 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2020-06-27T04:38:40.861 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.004036426544189453, stop=False, exit=None, reads=[5] 2020-06-27T04:38:40.861 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.004103422164916992, stop=False, exit=1, reads=[3, 5] 2020-06-27T04:38:40.862 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.0041637420654296875, stop=True, exit=1, reads=[3, 5] 2020-06-27T04:38:40.862 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2020-06-27T04:38:40.866 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stdout inactive 2020-06-27T04:38:40.866 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.0040667057037353516, stop=False, exit=3, reads=[3] 2020-06-27T04:38:40.866 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.004142284393310547, stop=True, exit=3, reads=[3] 2020-06-27T04:38:40.866 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2020-06-27T04:38:40.871 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stdout enabled 2020-06-27T04:38:40.871 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.004532814025878906, stop=False, exit=0, reads=[3] 2020-06-27T04:38:40.872 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.004609823226928711, stop=True, exit=0, reads=[3] 2020-06-27T04:38:40.872 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2020-06-27T04:38:40.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stdout active 2020-06-27T04:38:40.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.004059553146362305, stop=False, exit=0, reads=[3] 2020-06-27T04:38:40.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.0041351318359375, stop=True, exit=0, reads=[3] 2020-06-27T04:38:40.877 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Unit chronyd.service is enabled and running 2020-06-27T04:38:40.878 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Host looks OK 2020-06-27T04:38:40.878 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:root:Cluster fsid: 12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:38:40.878 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Acquiring lock 140449376975896 on /run/cephadm/12892ae2-b830-11ea-a06d-001a4aab830c.lock 2020-06-27T04:38:40.878 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Lock 140449376975896 acquired on /run/cephadm/12892ae2-b830-11ea-a06d-001a4aab830c.lock 2020-06-27T04:38:40.879 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Verifying IP 172.21.15.31 port 3300 ... 2020-06-27T04:38:40.880 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Verifying IP 172.21.15.31 port 6789 ... 2020-06-27T04:38:40.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Base mon IP is 172.21.15.31, final addrv is [v2:172.21.15.31:3300,v1:172.21.15.31:6789] 2020-06-27T04:38:40.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /sbin/ip route ls 2020-06-27T04:38:40.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/sbin/ip:stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 103 2020-06-27T04:38:40.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/sbin/ip:stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.31 metric 103 2020-06-27T04:38:40.881 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/sbin/ip:profile rt=0.0010941028594970703, stop=False, exit=0, reads=[4] 2020-06-27T04:38:40.881 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/sbin/ip:profile rt=0.001169443130493164, stop=True, exit=0, reads=[4] 2020-06-27T04:38:40.882 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Mon IP 172.21.15.31 is in CIDR network 172.21.0.0/20 2020-06-27T04:38:40.882 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Pulling latest quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 container... 2020-06-27T04:38:40.882 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman pull quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 2020-06-27T04:38:43.019 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Trying to pull quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5... 2020-06-27T04:38:43.019 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=2.122323751449585, stop=False, exit=None, reads=[6] 2020-06-27T04:38:43.144 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Getting image source signatures 2020-06-27T04:38:43.145 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=2.2482314109802246, stop=False, exit=None, reads=[6] 2020-06-27T04:38:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2020-06-27T04:38:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=2.3905181884765625, stop=False, exit=None, reads=[6] 2020-06-27T04:38:43.328 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:d71c5eab96b2ab4ce9461534cf5e4beda459d7dd3049e9ee2a4c73a13c0629b4 2020-06-27T04:38:43.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=2.4322633743286133, stop=False, exit=None, reads=[6] 2020-06-27T04:38:43.345 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2020-06-27T04:38:43.345 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=2.448810338973999, stop=False, exit=None, reads=[6] 2020-06-27T04:38:43.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2020-06-27T04:38:43.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=2.473822832107544, stop=False, exit=None, reads=[6] 2020-06-27T04:38:43.386 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2020-06-27T04:38:43.387 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=2.4904377460479736, stop=False, exit=None, reads=[6] 2020-06-27T04:38:43.412 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2020-06-27T04:38:43.412 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=2.515458583831787, stop=False, exit=None, reads=[6] 2020-06-27T04:38:43.428 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2020-06-27T04:38:43.429 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=2.532132148742676, stop=False, exit=None, reads=[6] 2020-06-27T04:38:43.537 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2020-06-27T04:38:43.538 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=2.6404647827148438, stop=False, exit=None, reads=[6] 2020-06-27T04:38:43.538 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2020-06-27T04:38:43.538 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2020-06-27T04:38:43.538 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2020-06-27T04:38:43.539 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=2.6406335830688477, stop=False, exit=None, reads=[6] 2020-06-27T04:38:43.539 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2020-06-27T04:38:43.539 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=2.6407463550567627, stop=False, exit=None, reads=[6] 2020-06-27T04:38:43.539 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2020-06-27T04:38:43.539 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=2.6408369541168213, stop=False, exit=None, reads=[6] 2020-06-27T04:38:43.540 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2020-06-27T04:38:43.540 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=2.6409692764282227, stop=False, exit=None, reads=[6] 2020-06-27T04:38:43.603 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:d39895339ef7a0e9628b865a3778627c4f5e85d12eb370d2754379bc7a95d7f3 2020-06-27T04:38:43.604 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=2.707056760787964, stop=False, exit=None, reads=[6] 2020-06-27T04:39:04.385 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Writing manifest to image destination 2020-06-27T04:39:04.385 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=23.488452434539795, stop=False, exit=None, reads=[6] 2020-06-27T04:39:04.386 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stderr Storing signatures 2020-06-27T04:39:04.386 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=23.488635778427124, stop=False, exit=None, reads=[6] 2020-06-27T04:39:17.727 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:stdout 2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119 2020-06-27T04:39:17.728 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=36.83092737197876, stop=False, exit=None, reads=[4] 2020-06-27T04:39:17.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=36.89657235145569, stop=False, exit=0, reads=[4, 6] 2020-06-27T04:39:17.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/bin/podman:profile rt=36.89671301841736, stop=True, exit=0, reads=[4, 6] 2020-06-27T04:39:17.794 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Extracting ceph user uid/gid from container image... 2020-06-27T04:39:17.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '--entrypoint', 'stat', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-c', '%u %g', '/var/lib/ceph'] 2020-06-27T04:39:17.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 --entrypoint stat quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -c %u %g /var/lib/ceph 2020-06-27T04:39:18.653 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:stat:stdout 167 167 2020-06-27T04:39:18.653 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:stat:profile rt=0.8572328090667725, stop=False, exit=None, reads=[4] 2020-06-27T04:39:30.641 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:stat:profile rt=12.844351530075073, stop=False, exit=0, reads=[4, 6] 2020-06-27T04:39:30.642 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:stat:profile rt=12.844664096832275, stop=True, exit=0, reads=[4, 6] 2020-06-27T04:39:30.642 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Creating initial keys... 2020-06-27T04:39:30.643 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '--entrypoint', '/usr/bin/ceph-authtool', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '--gen-print-key'] 2020-06-27T04:39:30.643 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 --entrypoint /usr/bin/ceph-authtool quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 --gen-print-key 2020-06-27T04:39:31.242 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQCDzfZe6HteDRAAKGhFm4tIKZZA9mpvMJVDKw== 2020-06-27T04:39:31.243 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:profile rt=0.5995242595672607, stop=False, exit=None, reads=[4] 2020-06-27T04:39:31.668 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:profile rt=1.025360345840454, stop=False, exit=0, reads=[4, 6] 2020-06-27T04:39:31.669 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:profile rt=1.025517463684082, stop=True, exit=0, reads=[4, 6] 2020-06-27T04:39:31.669 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '--entrypoint', '/usr/bin/ceph-authtool', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '--gen-print-key'] 2020-06-27T04:39:31.669 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 --entrypoint /usr/bin/ceph-authtool quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 --gen-print-key 2020-06-27T04:39:32.242 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQCEzfZeFzlLDRAA5V7xodqqzNm73IOl9BF3xA== 2020-06-27T04:39:32.242 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:profile rt=0.5728929042816162, stop=False, exit=None, reads=[4] 2020-06-27T04:39:32.639 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:profile rt=0.9698481559753418, stop=False, exit=0, reads=[4, 6] 2020-06-27T04:39:32.640 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:profile rt=0.9700181484222412, stop=True, exit=0, reads=[4, 6] 2020-06-27T04:39:32.640 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '--entrypoint', '/usr/bin/ceph-authtool', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '--gen-print-key'] 2020-06-27T04:39:32.640 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 --entrypoint /usr/bin/ceph-authtool quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 --gen-print-key 2020-06-27T04:39:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQCFzfZeu+5aChAA7DeLUcKCWykchnAEPrIFQw== 2020-06-27T04:39:33.192 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:profile rt=0.5509967803955078, stop=False, exit=None, reads=[4] 2020-06-27T04:39:33.651 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:profile rt=1.0102996826171875, stop=False, exit=0, reads=[4, 6] 2020-06-27T04:39:33.651 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:profile rt=1.0104658603668213, stop=True, exit=0, reads=[4, 6] 2020-06-27T04:39:33.652 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Creating initial monmap... 2020-06-27T04:39:33.652 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/tmp/ceph-tmph5jyxmrv:/tmp/monmap:z', '--entrypoint', '/usr/bin/monmaptool', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '--create', '--clobber', '--fsid', '12892ae2-b830-11ea-a06d-001a4aab830c', '--addv', 'a', '[v2:172.21.15.31:3300,v1:172.21.15.31:6789]', '/tmp/monmap'] 2020-06-27T04:39:33.652 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /tmp/ceph-tmph5jyxmrv:/tmp/monmap:z --entrypoint /usr/bin/monmaptool quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 --create --clobber --fsid 12892ae2-b830-11ea-a06d-001a4aab830c --addv a [v2:172.21.15.31:3300,v1:172.21.15.31:6789] /tmp/monmap 2020-06-27T04:39:34.191 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2020-06-27T04:39:34.192 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: set fsid to 12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:39:34.192 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2020-06-27T04:39:34.192 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/monmaptool:profile rt=0.5386495590209961, stop=False, exit=None, reads=[6] 2020-06-27T04:39:34.613 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/monmaptool:profile rt=0.9600191116333008, stop=False, exit=0, reads=[6, 8] 2020-06-27T04:39:34.613 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/monmaptool:profile rt=0.960235595703125, stop=True, exit=0, reads=[6, 8] 2020-06-27T04:39:34.614 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Creating mon... 2020-06-27T04:39:34.614 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '-v', '/tmp/ceph-tmp_5zpl55l:/tmp/keyring:z', '-v', '/tmp/ceph-tmph5jyxmrv:/tmp/monmap:z', '--entrypoint', '/usr/bin/ceph-mon', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '--mkfs', '-i', 'a', '--fsid', '12892ae2-b830-11ea-a06d-001a4aab830c', '-c', '/dev/null', '--monmap', '/tmp/monmap', '--keyring', '/tmp/keyring', '--setuser', 'ceph', '--setgroup', 'ceph', '--default-log-to-file=false', '--default-log-to-stderr=true', '--default-log-stderr-prefix="debug "', '--default-mon-cluster-log-to-file=false', '--default-mon-cluster-log-to-stderr=true'] 2020-06-27T04:39:34.615 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmp_5zpl55l:/tmp/keyring:z -v /tmp/ceph-tmph5jyxmrv:/tmp/monmap:z --entrypoint /usr/bin/ceph-mon quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 --mkfs -i a --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2020-06-27T04:39:35.315 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.197+0000 7fd825279700 0 set uid:gid to 167:167 (ceph:ceph) 2020-06-27T04:39:35.315 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.197+0000 7fd825279700 1 imported monmap: 2020-06-27T04:39:35.315 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr epoch 0 2020-06-27T04:39:35.316 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr fsid 12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:39:35.316 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr last_changed 2020-06-27T04:39:34.169049+0000 2020-06-27T04:39:35.316 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr created 2020-06-27T04:39:34.169049+0000 2020-06-27T04:39:35.316 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr min_mon_release 0 (unknown) 2020-06-27T04:39:35.316 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2020-06-27T04:39:35.317 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-06-27T04:39:35.317 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.197+0000 7fd825279700 0 /usr/bin/ceph-mon: set fsid to 12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:39:35.317 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: RocksDB version: 6.8.1 2020-06-27T04:39:35.317 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-06-27T04:39:35.317 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2020-06-27T04:39:35.319 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Compile date Jun 26 2020 2020-06-27T04:39:35.320 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: DB SUMMARY 2020-06-27T04:39:35.320 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-06-27T04:39:35.320 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2020-06-27T04:39:35.320 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-06-27T04:39:35.320 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6742665767669678, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.321 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2020-06-27T04:39:35.321 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-06-27T04:39:35.321 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.error_if_exists: 0 2020-06-27T04:39:35.321 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.create_if_missing: 1 2020-06-27T04:39:35.322 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.paranoid_checks: 1 2020-06-27T04:39:35.322 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.env: 0x55d70908f720 2020-06-27T04:39:35.322 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.fs: Posix File System 2020-06-27T04:39:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.info_log: 0x55d70aadeb20 2020-06-27T04:39:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.max_file_opening_threads: 16 2020-06-27T04:39:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6748394966125488, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.statistics: (nil) 2020-06-27T04:39:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.use_fsync: 0 2020-06-27T04:39:35.324 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.max_log_file_size: 0 2020-06-27T04:39:35.324 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2020-06-27T04:39:35.324 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.log_file_time_to_roll: 0 2020-06-27T04:39:35.324 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.keep_log_file_num: 1000 2020-06-27T04:39:35.324 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.recycle_log_file_num: 0 2020-06-27T04:39:35.325 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.allow_fallocate: 1 2020-06-27T04:39:35.325 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.allow_mmap_reads: 0 2020-06-27T04:39:35.325 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6753599643707275, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.325 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.allow_mmap_writes: 0 2020-06-27T04:39:35.325 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.use_direct_reads: 0 2020-06-27T04:39:35.326 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2020-06-27T04:39:35.326 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.create_missing_column_families: 0 2020-06-27T04:39:35.327 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.db_log_dir: 2020-06-27T04:39:35.327 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2020-06-27T04:39:35.327 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.table_cache_numshardbits: 6 2020-06-27T04:39:35.327 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.max_subcompactions: 1 2020-06-27T04:39:35.327 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.max_background_flushes: -1 2020-06-27T04:39:35.328 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6758830547332764, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.328 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.WAL_ttl_seconds: 0 2020-06-27T04:39:35.328 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.WAL_size_limit_MB: 0 2020-06-27T04:39:35.328 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2020-06-27T04:39:35.328 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2020-06-27T04:39:35.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.is_fd_close_on_exec: 1 2020-06-27T04:39:35.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.advise_random_on_open: 1 2020-06-27T04:39:35.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.db_write_buffer_size: 0 2020-06-27T04:39:35.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.write_buffer_manager: 0x55d70aa9ea20 2020-06-27T04:39:35.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2020-06-27T04:39:35.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6764030456542969, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2020-06-27T04:39:35.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2020-06-27T04:39:35.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.use_adaptive_mutex: 0 2020-06-27T04:39:35.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.rate_limiter: (nil) 2020-06-27T04:39:35.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2020-06-27T04:39:35.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.wal_recovery_mode: 2 2020-06-27T04:39:35.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.enable_thread_tracking: 0 2020-06-27T04:39:35.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.enable_pipelined_write: 0 2020-06-27T04:39:35.332 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.unordered_write: 0 2020-06-27T04:39:35.332 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6769168376922607, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.332 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2020-06-27T04:39:35.332 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2020-06-27T04:39:35.332 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2020-06-27T04:39:35.333 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2020-06-27T04:39:35.333 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.row_cache: None 2020-06-27T04:39:35.333 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.wal_filter: None 2020-06-27T04:39:35.333 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2020-06-27T04:39:35.334 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.allow_ingest_behind: 0 2020-06-27T04:39:35.334 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.preserve_deletes: 0 2020-06-27T04:39:35.334 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6774275302886963, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.334 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.two_write_queues: 0 2020-06-27T04:39:35.334 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.manual_wal_flush: 0 2020-06-27T04:39:35.335 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.atomic_flush: 0 2020-06-27T04:39:35.335 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2020-06-27T04:39:35.335 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.persist_stats_to_disk: 0 2020-06-27T04:39:35.335 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.write_dbid_to_manifest: 0 2020-06-27T04:39:35.335 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.log_readahead_size: 0 2020-06-27T04:39:35.336 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2020-06-27T04:39:35.336 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.max_background_jobs: 2 2020-06-27T04:39:35.336 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6779541969299316, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.336 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.max_background_compactions: -1 2020-06-27T04:39:35.336 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2020-06-27T04:39:35.337 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2020-06-27T04:39:35.337 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.delayed_write_rate : 16777216 2020-06-27T04:39:35.337 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.max_total_wal_size: 0 2020-06-27T04:39:35.337 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2020-06-27T04:39:35.338 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.stats_dump_period_sec: 600 2020-06-27T04:39:35.338 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.stats_persist_period_sec: 600 2020-06-27T04:39:35.338 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2020-06-27T04:39:35.338 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.678473711013794, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.338 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.max_open_files: -1 2020-06-27T04:39:35.339 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.bytes_per_sync: 0 2020-06-27T04:39:35.339 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.wal_bytes_per_sync: 0 2020-06-27T04:39:35.339 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.strict_bytes_per_sync: 0 2020-06-27T04:39:35.339 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Options.compaction_readahead_size: 0 2020-06-27T04:39:35.340 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Compression algorithms supported: 2020-06-27T04:39:35.340 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2020-06-27T04:39:35.340 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: kZSTD supported: 0 2020-06-27T04:39:35.340 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: kXpressCompression supported: 0 2020-06-27T04:39:35.340 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: kLZ4HCCompression supported: 1 2020-06-27T04:39:35.341 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6790387630462646, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.341 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: kLZ4Compression supported: 1 2020-06-27T04:39:35.341 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: kBZip2Compression supported: 0 2020-06-27T04:39:35.342 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: kZlibCompression supported: 1 2020-06-27T04:39:35.342 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: kSnappyCompression supported: 1 2020-06-27T04:39:35.342 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.198+0000 7fd825279700 4 rocksdb: Fast CRC32 supported: Supported on x86 2020-06-27T04:39:35.342 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2020-06-27T04:39:35.342 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-06-27T04:39:35.343 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2020-06-27T04:39:35.343 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-06-27T04:39:35.343 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2020-06-27T04:39:35.343 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-06-27T04:39:35.343 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2020-06-27T04:39:35.344 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6797187328338623, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.344 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.merge_operator: 2020-06-27T04:39:35.344 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compaction_filter: None 2020-06-27T04:39:35.344 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compaction_filter_factory: None 2020-06-27T04:39:35.344 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.memtable_factory: SkipListFactory 2020-06-27T04:39:35.345 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.table_factory: BlockBasedTable 2020-06-27T04:39:35.345 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d70a9f4230) 2020-06-27T04:39:35.345 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks: 1 2020-06-27T04:39:35.345 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks_with_high_priority: 1 2020-06-27T04:39:35.346 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_l0_filter_and_index_blocks_in_cache: 0 2020-06-27T04:39:35.346 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_top_level_index_and_filter: 1 2020-06-27T04:39:35.346 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_type: 0 2020-06-27T04:39:35.346 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_index_type: 0 2020-06-27T04:39:35.346 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_shortening: 1 2020-06-27T04:39:35.347 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_hash_table_util_ratio: 0.750000 2020-06-27T04:39:35.347 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr hash_index_allow_collision: 1 2020-06-27T04:39:35.347 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr checksum: 1 2020-06-27T04:39:35.347 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr no_block_cache: 0 2020-06-27T04:39:35.347 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache: 0x55d70aa2e510 2020-06-27T04:39:35.348 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6806790828704834, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.348 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_name: BinnedLRUCache 2020-06-27T04:39:35.348 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_options: 2020-06-27T04:39:35.348 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr capacity : 536870912 2020-06-27T04:39:35.348 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr num_shard_bits : 4 2020-06-27T04:39:35.348 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr strict_capacity_limit : 0 2020-06-27T04:39:35.349 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr high_pri_pool_ratio: 0.000 2020-06-27T04:39:35.349 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_compressed: (nil) 2020-06-27T04:39:35.349 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr persistent_cache: (nil) 2020-06-27T04:39:35.349 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size: 4096 2020-06-27T04:39:35.349 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size_deviation: 10 2020-06-27T04:39:35.350 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_restart_interval: 16 2020-06-27T04:39:35.350 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_block_restart_interval: 1 2020-06-27T04:39:35.350 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr metadata_block_size: 4096 2020-06-27T04:39:35.350 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr partition_filters: 0 2020-06-27T04:39:35.351 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr use_delta_encoding: 1 2020-06-27T04:39:35.351 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr filter_policy: rocksdb.BuiltinBloomFilter 2020-06-27T04:39:35.351 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr whole_key_filtering: 1 2020-06-27T04:39:35.352 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr verify_compression: 0 2020-06-27T04:39:35.352 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr read_amp_bytes_per_bit: 0 2020-06-27T04:39:35.352 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr format_version: 2 2020-06-27T04:39:35.352 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr enable_index_compression: 1 2020-06-27T04:39:35.352 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_align: 0 2020-06-27T04:39:35.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-06-27T04:39:35.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.write_buffer_size: 33554432 2020-06-27T04:39:35.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.max_write_buffer_number: 2 2020-06-27T04:39:35.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compression: NoCompression 2020-06-27T04:39:35.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.bottommost_compression: Disabled 2020-06-27T04:39:35.354 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6820657253265381, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.354 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.prefix_extractor: nullptr 2020-06-27T04:39:35.354 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2020-06-27T04:39:35.354 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.num_levels: 7 2020-06-27T04:39:35.354 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2020-06-27T04:39:35.355 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2020-06-27T04:39:35.355 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2020-06-27T04:39:35.355 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2020-06-27T04:39:35.355 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2020-06-27T04:39:35.355 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2020-06-27T04:39:35.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6825859546661377, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2020-06-27T04:39:35.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2020-06-27T04:39:35.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2020-06-27T04:39:35.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compression_opts.window_bits: -14 2020-06-27T04:39:35.357 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compression_opts.level: 32767 2020-06-27T04:39:35.357 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compression_opts.strategy: 0 2020-06-27T04:39:35.357 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2020-06-27T04:39:35.357 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2020-06-27T04:39:35.357 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.683063268661499, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compression_opts.enabled: false 2020-06-27T04:39:35.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2020-06-27T04:39:35.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2020-06-27T04:39:35.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2020-06-27T04:39:35.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.target_file_size_base: 67108864 2020-06-27T04:39:35.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.target_file_size_multiplier: 1 2020-06-27T04:39:35.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2020-06-27T04:39:35.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2020-06-27T04:39:35.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2020-06-27T04:39:35.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6835825443267822, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2020-06-27T04:39:35.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2020-06-27T04:39:35.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2020-06-27T04:39:35.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2020-06-27T04:39:35.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2020-06-27T04:39:35.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2020-06-27T04:39:35.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2020-06-27T04:39:35.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2020-06-27T04:39:35.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2020-06-27T04:39:35.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6841058731079102, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.arena_block_size: 4194304 2020-06-27T04:39:35.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2020-06-27T04:39:35.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2020-06-27T04:39:35.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2020-06-27T04:39:35.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.disable_auto_compactions: 0 2020-06-27T04:39:35.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2020-06-27T04:39:35.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2020-06-27T04:39:35.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2020-06-27T04:39:35.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6845715045928955, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2020-06-27T04:39:35.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2020-06-27T04:39:35.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2020-06-27T04:39:35.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2020-06-27T04:39:35.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2020-06-27T04:39:35.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2020-06-27T04:39:35.365 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2020-06-27T04:39:35.365 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.table_properties_collectors: 2020-06-27T04:39:35.365 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.inplace_update_support: 0 2020-06-27T04:39:35.365 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6850759983062744, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.inplace_update_num_locks: 10000 2020-06-27T04:39:35.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2020-06-27T04:39:35.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2020-06-27T04:39:35.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.memtable_huge_page_size: 0 2020-06-27T04:39:35.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.bloom_locality: 0 2020-06-27T04:39:35.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.max_successive_merges: 0 2020-06-27T04:39:35.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.optimize_filters_for_hits: 0 2020-06-27T04:39:35.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.paranoid_file_checks: 0 2020-06-27T04:39:35.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.force_consistency_checks: 0 2020-06-27T04:39:35.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6855151653289795, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.report_bg_io_stats: 0 2020-06-27T04:39:35.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.ttl: 2592000 2020-06-27T04:39:35.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.199+0000 7fd825279700 4 rocksdb: Options.periodic_compaction_seconds: 0 2020-06-27T04:39:35.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.200+0000 7fd825279700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2020-06-27T04:39:35.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-06-27T04:39:35.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.200+0000 7fd825279700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2020-06-27T04:39:35.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-06-27T04:39:35.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.201+0000 7fd825279700 4 rocksdb: DB pointer 0x55d70aa81800 2020-06-27T04:39:35.371 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.201+0000 7fd80e123700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2020-06-27T04:39:35.371 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6860289573669434, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.371 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.201+0000 7fd80e123700 4 rocksdb: [db_impl/db_impl.cc:851] 2020-06-27T04:39:35.371 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** DB Stats ** 2020-06-27T04:39:35.371 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2020-06-27T04:39:35.372 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2020-06-27T04:39:35.372 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2020-06-27T04:39:35.372 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2020-06-27T04:39:35.372 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2020-06-27T04:39:35.372 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2020-06-27T04:39:35.373 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2020-06-27T04:39:35.373 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-06-27T04:39:35.373 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2020-06-27T04:39:35.373 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-06-27T04:39:35.373 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-06-27T04:39:35.373 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6866476535797119, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.374 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-06-27T04:39:35.374 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-06-27T04:39:35.374 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-06-27T04:39:35.374 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2020-06-27T04:39:35.374 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-06-27T04:39:35.375 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-06-27T04:39:35.375 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2020-06-27T04:39:35.375 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2020-06-27T04:39:35.375 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2020-06-27T04:39:35.375 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2020-06-27T04:39:35.376 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2020-06-27T04:39:35.376 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2020-06-27T04:39:35.376 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6871547698974609, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.376 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-06-27T04:39:35.376 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-06-27T04:39:35.376 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-06-27T04:39:35.377 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-06-27T04:39:35.377 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2020-06-27T04:39:35.377 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-06-27T04:39:35.377 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2020-06-27T04:39:35.377 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-06-27T04:39:35.378 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-06-27T04:39:35.378 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-06-27T04:39:35.378 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6876835823059082, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.378 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-06-27T04:39:35.378 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-06-27T04:39:35.378 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2020-06-27T04:39:35.379 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-06-27T04:39:35.379 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-06-27T04:39:35.379 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2020-06-27T04:39:35.379 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2020-06-27T04:39:35.379 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2020-06-27T04:39:35.380 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2020-06-27T04:39:35.380 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2020-06-27T04:39:35.380 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2020-06-27T04:39:35.380 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-06-27T04:39:35.380 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-06-27T04:39:35.381 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6883163452148438, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.381 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-06-27T04:39:35.381 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-06-27T04:39:35.381 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2020-06-27T04:39:35.381 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-06-27T04:39:35.381 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.202+0000 7fd825279700 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2020-06-27T04:39:35.382 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.202+0000 7fd825279700 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2020-06-27T04:39:35.382 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-06-27T04:39:35.202+0000 7fd825279700 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2020-06-27T04:39:35.382 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=0.6886985301971436, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=1.177764892578125, stop=False, exit=0, reads=[6, 8] 2020-06-27T04:39:35.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:profile rt=1.1779403686523438, stop=True, exit=0, reads=[6, 8] 2020-06-27T04:39:35.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:39:35.798 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:install:profile rt=0.002863168716430664, stop=False, exit=None, reads=[6, 8] 2020-06-27T04:39:35.798 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:install:profile rt=0.003075122833251953, stop=True, exit=0, reads=[6, 8] 2020-06-27T04:39:35.799 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl disable ceph.target 2020-06-27T04:39:35.806 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2020-06-27T04:39:35.807 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.006603240966796875, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.890 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.08945226669311523, stop=False, exit=0, reads=[6, 8] 2020-06-27T04:39:35.890 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.08960843086242676, stop=True, exit=0, reads=[6, 8] 2020-06-27T04:39:35.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl enable ceph.target 2020-06-27T04:39:35.896 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2020-06-27T04:39:35.896 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.0049474239349365234, stop=False, exit=None, reads=[8] 2020-06-27T04:39:35.974 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.08330154418945312, stop=False, exit=0, reads=[6, 8] 2020-06-27T04:39:35.975 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.08345389366149902, stop=True, exit=0, reads=[6, 8] 2020-06-27T04:39:35.975 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl start ceph.target 2020-06-27T04:39:35.981 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.0055544376373291016, stop=False, exit=0, reads=[6, 8] 2020-06-27T04:39:35.982 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.00577998161315918, stop=True, exit=0, reads=[6, 8] 2020-06-27T04:39:35.982 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-12892ae2-b830-11ea-a06d-001a4aab830c.target 2020-06-27T04:39:35.987 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-12892ae2-b830-11ea-a06d-001a4aab830c.target → /etc/systemd/system/ceph-12892ae2-b830-11ea-a06d-001a4aab830c.target. 2020-06-27T04:39:35.988 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-12892ae2-b830-11ea-a06d-001a4aab830c.target → /etc/systemd/system/ceph-12892ae2-b830-11ea-a06d-001a4aab830c.target. 2020-06-27T04:39:35.988 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.005032539367675781, stop=False, exit=None, reads=[8] 2020-06-27T04:39:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.08088231086730957, stop=False, exit=0, reads=[6, 8] 2020-06-27T04:39:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.08103442192077637, stop=True, exit=0, reads=[6, 8] 2020-06-27T04:39:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl start ceph-12892ae2-b830-11ea-a06d-001a4aab830c.target 2020-06-27T04:39:36.070 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.005900382995605469, stop=False, exit=0, reads=[6, 8] 2020-06-27T04:39:36.071 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.006120204925537109, stop=True, exit=0, reads=[6, 8] 2020-06-27T04:39:36.071 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2020-06-27T04:39:36.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.08269691467285156, stop=False, exit=0, reads=[6, 8] 2020-06-27T04:39:36.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.08295154571533203, stop=True, exit=0, reads=[6, 8] 2020-06-27T04:39:36.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mon.a 2020-06-27T04:39:36.179 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.022430419921875, stop=False, exit=0, reads=[6, 8] 2020-06-27T04:39:36.179 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.02266407012939453, stop=True, exit=0, reads=[6, 8] 2020-06-27T04:39:36.179 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mon.a 2020-06-27T04:39:36.185 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mon.a.service: Unit ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mon.a.service not loaded. 2020-06-27T04:39:36.185 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.005034685134887695, stop=False, exit=None, reads=[8] 2020-06-27T04:39:36.185 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.005115032196044922, stop=True, exit=1, reads=[8] 2020-06-27T04:39:36.185 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mon.a 2020-06-27T04:39:36.192 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-12892ae2-b830-11ea-a06d-001a4aab830c.target.wants/ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-12892ae2-b830-11ea-a06d-001a4aab830c@.service. 2020-06-27T04:39:36.193 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.005519390106201172, stop=False, exit=None, reads=[8] 2020-06-27T04:39:36.266 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.07987713813781738, stop=False, exit=0, reads=[6, 8] 2020-06-27T04:39:36.266 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.08003425598144531, stop=True, exit=0, reads=[6, 8] 2020-06-27T04:39:36.266 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl start ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mon.a 2020-06-27T04:39:36.389 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.12141847610473633, stop=False, exit=0, reads=[6, 8] 2020-06-27T04:39:36.389 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.12176251411437988, stop=True, exit=0, reads=[6, 8] 2020-06-27T04:39:36.390 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl is-enabled firewalld.service 2020-06-27T04:39:36.397 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stdout disabled 2020-06-27T04:39:36.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.006799221038818359, stop=False, exit=1, reads=[6] 2020-06-27T04:39:36.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.006916999816894531, stop=True, exit=1, reads=[6] 2020-06-27T04:39:36.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl is-active firewalld.service 2020-06-27T04:39:36.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stdout inactive 2020-06-27T04:39:36.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.006012916564941406, stop=False, exit=3, reads=[6] 2020-06-27T04:39:36.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.006138801574707031, stop=True, exit=3, reads=[6] 2020-06-27T04:39:36.406 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:firewalld.service is not enabled 2020-06-27T04:39:36.407 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Waiting for mon to start... 2020-06-27T04:39:36.407 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Waiting for mon... 2020-06-27T04:39:36.407 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 status 2020-06-27T04:39:36.667 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:36 smithi031 systemd[1]: Started Ceph mon.a for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:39:36.667 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:36 smithi031 bash[17969]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a found: no such container 2020-06-27T04:39:36.668 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:36 smithi031 bash[17969]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a 2020-06-27T04:39:36.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:36 smithi031 bash[17969]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a" found: no such container 2020-06-27T04:39:37.399 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.189+0000 7ff888dfb700 1 Processor -- start 2020-06-27T04:39:37.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.189+0000 7ff888dfb700 1 -- start start 2020-06-27T04:39:37.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.189+0000 7ff888dfb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff884064730 0x7ff884064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:37.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.189+0000 7ff888dfb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8840651a0 con 0x7ff884064730 2020-06-27T04:39:37.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.190+0000 7ff882d9d700 1 -- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff884064730 msgr2=0x7ff884064b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.31:3300/0 2020-06-27T04:39:37.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.190+0000 7ff882d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff884064730 0x7ff884064b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2020-06-27T04:39:37.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9880993366241455, stop=False, exit=None, reads=[10] 2020-06-27T04:39:37.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.391+0000 7ff882d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff884064730 0x7ff884064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:37.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.391+0000 7ff882d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff884064730 0x7ff884064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38428/0 (socket says 172.21.15.31:38428) 2020-06-27T04:39:37.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.391+0000 7ff882d9d700 1 -- 172.21.15.31:0/2717747222 learned_addr learned my addr 172.21.15.31:0/2717747222 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:37.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.391+0000 7ff882d9d700 1 -- 172.21.15.31:0/2717747222 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff884065a20 con 0x7ff884064730 2020-06-27T04:39:37.402 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9883882999420166, stop=False, exit=None, reads=[10] 2020-06-27T04:39:37.402 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.391+0000 7ff882d9d700 1 --2- 172.21.15.31:0/2717747222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff884064730 0x7ff884064b50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7ff86c005750 tx=0x7ff86c009060).ready entity=mon.0 client_cookie=266877e00f8af172 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:37.402 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.391+0000 7ff881d9b700 1 -- 172.21.15.31:0/2717747222 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff86c005450 con 0x7ff884064730 2020-06-27T04:39:37.402 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.391+0000 7ff881d9b700 1 -- 172.21.15.31:0/2717747222 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c0036f0 con 0x7ff884064730 2020-06-27T04:39:37.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.391+0000 7ff881d9b700 1 -- 172.21.15.31:0/2717747222 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff86c0055b0 con 0x7ff884064730 2020-06-27T04:39:37.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.391+0000 7ff888dfb700 1 -- 172.21.15.31:0/2717747222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff884064730 msgr2=0x7ff884064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:37.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9885575771331787, stop=False, exit=None, reads=[10] 2020-06-27T04:39:37.404 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.391+0000 7ff888dfb700 1 --2- 172.21.15.31:0/2717747222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff884064730 0x7ff884064b50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7ff86c005750 tx=0x7ff86c009060).stop 2020-06-27T04:39:37.404 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.391+0000 7ff888dfb700 1 -- 172.21.15.31:0/2717747222 shutdown_connections 2020-06-27T04:39:37.404 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.391+0000 7ff888dfb700 1 --2- 172.21.15.31:0/2717747222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff884064730 0x7ff884064b50 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:37.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.391+0000 7ff888dfb700 1 -- 172.21.15.31:0/2717747222 >> 172.21.15.31:0/2717747222 conn(0x7ff88405ffe0 msgr2=0x7ff884062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:37.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.392+0000 7ff888dfb700 1 -- 172.21.15.31:0/2717747222 shutdown_connections 2020-06-27T04:39:37.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.392+0000 7ff888dfb700 1 -- 172.21.15.31:0/2717747222 wait complete. 2020-06-27T04:39:37.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.393+0000 7ff888dfb700 1 Processor -- start 2020-06-27T04:39:37.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.393+0000 7ff888dfb700 1 -- start start 2020-06-27T04:39:37.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9888134002685547, stop=False, exit=None, reads=[10] 2020-06-27T04:39:37.406 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.393+0000 7ff888dfb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8840774c0 0x7ff8840778e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:37.406 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.393+0000 7ff888dfb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff884077f30 con 0x7ff8840774c0 2020-06-27T04:39:37.406 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.393+0000 7ff882d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8840774c0 0x7ff8840778e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:37.411 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.393+0000 7ff882d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8840774c0 0x7ff8840778e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38430/0 (socket says 172.21.15.31:38430) 2020-06-27T04:39:37.411 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9889929294586182, stop=False, exit=None, reads=[10] 2020-06-27T04:39:37.411 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.393+0000 7ff882d9d700 1 -- 172.21.15.31:0/2270213484 learned_addr learned my addr 172.21.15.31:0/2270213484 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:37.411 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.989063024520874, stop=False, exit=None, reads=[10] 2020-06-27T04:39:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.394+0000 7ff882d9d700 1 -- 172.21.15.31:0/2270213484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff884078890 con 0x7ff8840774c0 2020-06-27T04:39:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9892561435699463, stop=False, exit=None, reads=[10] 2020-06-27T04:39:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.394+0000 7ff882d9d700 1 --2- 172.21.15.31:0/2270213484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8840774c0 0x7ff8840778e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7ff86c005750 tx=0x7ff86c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9893724918365479, stop=False, exit=None, reads=[10] 2020-06-27T04:39:37.419 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.394+0000 7ff87affd700 1 -- 172.21.15.31:0/2270213484 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff86c021070 con 0x7ff8840774c0 2020-06-27T04:39:37.419 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.394+0000 7ff87affd700 1 -- 172.21.15.31:0/2270213484 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c0059e0 con 0x7ff8840774c0 2020-06-27T04:39:37.419 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9896600246429443, stop=False, exit=None, reads=[10] 2020-06-27T04:39:37.419 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.394+0000 7ff888dfb700 1 -- 172.21.15.31:0/2270213484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff884078ae0 con 0x7ff8840774c0 2020-06-27T04:39:37.419 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.394+0000 7ff87affd700 1 -- 172.21.15.31:0/2270213484 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff86c005c80 con 0x7ff8840774c0 2020-06-27T04:39:37.420 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.394+0000 7ff888dfb700 1 -- 172.21.15.31:0/2270213484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff884078f70 con 0x7ff8840774c0 2020-06-27T04:39:37.420 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9898765087127686, stop=False, exit=None, reads=[10] 2020-06-27T04:39:37.420 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.394+0000 7ff87affd700 1 -- 172.21.15.31:0/2270213484 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7ff86c01a030 con 0x7ff8840774c0 2020-06-27T04:39:37.420 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.394+0000 7ff87affd700 1 -- 172.21.15.31:0/2270213484 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7ff86c026410 con 0x7ff8840774c0 2020-06-27T04:39:37.420 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9900519847869873, stop=False, exit=None, reads=[10] 2020-06-27T04:39:37.421 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.395+0000 7ff888dfb700 1 -- 172.21.15.31:0/2270213484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff884078070 con 0x7ff8840774c0 2020-06-27T04:39:37.421 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.990792989730835, stop=False, exit=None, reads=[10] 2020-06-27T04:39:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.398+0000 7ff87affd700 1 -- 172.21.15.31:0/2270213484 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67681 (secure 0 0 0) 0x7ff86c005e30 con 0x7ff8840774c0 2020-06-27T04:39:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9931087493896484, stop=False, exit=None, reads=[10] 2020-06-27T04:39:37.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:37 smithi031 podman[18018]: 2020-06-27 04:39:37.022356674 +0000 UTC m=+0.275103717 container create fac7f1984dfb53fd0756bfd7d686d453f71450bbebe19c52ce6712428b42d4cd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a) 2020-06-27T04:39:37.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:37 smithi031 podman[18018]: 2020-06-27 04:39:37.212143249 +0000 UTC m=+0.464890387 container init fac7f1984dfb53fd0756bfd7d686d453f71450bbebe19c52ce6712428b42d4cd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a) 2020-06-27T04:39:37.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:37 smithi031 podman[18018]: 2020-06-27 04:39:37.255634876 +0000 UTC m=+0.508381917 container start fac7f1984dfb53fd0756bfd7d686d453f71450bbebe19c52ce6712428b42d4cd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a) 2020-06-27T04:39:37.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:37 smithi031 podman[18018]: 2020-06-27 04:39:37.255726246 +0000 UTC m=+0.508473307 container attach fac7f1984dfb53fd0756bfd7d686d453f71450bbebe19c52ce6712428b42d4cd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a) 2020-06-27T04:39:37.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:37 smithi031 bash[17969]: cluster 2020-06-27T04:39:37.261162+0000 mon.a (mon.0) 0 : [INF] mkfs 12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:39:37.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:37 smithi031 bash[17969]: cluster 2020-06-27T04:39:37.249224+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2020-06-27T04:39:37.478 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.472+0000 7ff888dfb700 1 -- 172.21.15.31:0/2270213484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7ff884057340 con 0x7ff8840774c0 2020-06-27T04:39:37.478 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.472+0000 7ff87affd700 1 -- 172.21.15.31:0/2270213484 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7ff86c005fd0 con 0x7ff8840774c0 2020-06-27T04:39:37.478 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0677587985992432, stop=False, exit=None, reads=[10] 2020-06-27T04:39:37.478 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout cluster: 2020-06-27T04:39:37.478 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout id: 12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:39:37.479 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout health: HEALTH_OK 2020-06-27T04:39:37.479 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-06-27T04:39:37.479 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout services: 2020-06-27T04:39:37.479 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon: 1 daemons, quorum a (age 0.215173s) 2020-06-27T04:39:37.479 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr: no daemons active 2020-06-27T04:39:37.480 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd: 0 osds: 0 up, 0 in 2020-06-27T04:39:37.480 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-06-27T04:39:37.480 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout data: 2020-06-27T04:39:37.480 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pools: 0 pools, 0 pgs 2020-06-27T04:39:37.480 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout objects: 0 objects, 0 B 2020-06-27T04:39:37.481 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout usage: 0 B used, 0 B / 0 B avail 2020-06-27T04:39:37.481 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pgs: 2020-06-27T04:39:37.481 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-06-27T04:39:37.481 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0682008266448975, stop=False, exit=None, reads=[8] 2020-06-27T04:39:37.481 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.473+0000 7ff888dfb700 1 -- 172.21.15.31:0/2270213484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8840774c0 msgr2=0x7ff8840778e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:37.482 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.473+0000 7ff888dfb700 1 --2- 172.21.15.31:0/2270213484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8840774c0 0x7ff8840778e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7ff86c005750 tx=0x7ff86c015000).stop 2020-06-27T04:39:37.482 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0684115886688232, stop=False, exit=None, reads=[10] 2020-06-27T04:39:37.482 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.473+0000 7ff888dfb700 1 -- 172.21.15.31:0/2270213484 shutdown_connections 2020-06-27T04:39:37.483 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.473+0000 7ff888dfb700 1 --2- 172.21.15.31:0/2270213484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8840774c0 0x7ff8840778e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:37.483 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.473+0000 7ff888dfb700 1 -- 172.21.15.31:0/2270213484 >> 172.21.15.31:0/2270213484 conn(0x7ff88405ffe0 msgr2=0x7ff884062490 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:37.483 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.473+0000 7ff888dfb700 1 -- 172.21.15.31:0/2270213484 shutdown_connections 2020-06-27T04:39:37.483 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:37.473+0000 7ff888dfb700 1 -- 172.21.15.31:0/2270213484 wait complete. 2020-06-27T04:39:37.483 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0686838626861572, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.6918613910675049, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:39:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.692054271697998, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:39:38.101 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:mon is available 2020-06-27T04:39:38.101 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Assimilating anything we can from ceph.conf... 2020-06-27T04:39:38.101 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'config', 'assimilate-conf', '-i', '/var/lib/ceph/mon/ceph-a/config'] 2020-06-27T04:39:38.101 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z -v /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2020-06-27T04:39:38.357 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:38 smithi031 bash[17969]: cluster 2020-06-27T04:39:37.258502+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2020-06-27T04:39:38.358 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:38 smithi031 bash[17969]: cluster 2020-06-27T04:39:37.260686+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0]} 2020-06-27T04:39:38.358 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:38 smithi031 bash[17969]: cluster 2020-06-27T04:39:37.264820+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2020-06-27T04:39:38.358 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:38 smithi031 bash[17969]: cluster 2020-06-27T04:39:37.266620+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2020-06-27T04:39:38.358 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:38 smithi031 bash[17969]: cluster 2020-06-27T04:39:37.266978+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2020-06-27T04:39:38.358 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:38 smithi031 bash[17969]: audit 2020-06-27T04:39:37.473632+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.31:0/2270213484' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2020-06-27T04:39:38.713 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.705+0000 7f3fb42c2700 1 Processor -- start 2020-06-27T04:39:38.713 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.705+0000 7f3fb42c2700 1 -- start start 2020-06-27T04:39:38.713 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.705+0000 7f3fb42c2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fac064730 0x7f3fac064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:38.713 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.705+0000 7f3fb42c2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac0651a0 con 0x7f3fac064730 2020-06-27T04:39:38.714 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.705+0000 7f3fb285f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fac064730 0x7f3fac064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:38.714 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6068112850189209, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.714 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.705+0000 7f3fb285f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fac064730 0x7f3fac064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38432/0 (socket says 172.21.15.31:38432) 2020-06-27T04:39:38.714 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.705+0000 7f3fb285f700 1 -- 172.21.15.31:0/346781991 learned_addr learned my addr 172.21.15.31:0/346781991 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:38.715 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.705+0000 7f3fb285f700 1 -- 172.21.15.31:0/346781991 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac065a20 con 0x7f3fac064730 2020-06-27T04:39:38.715 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.705+0000 7f3fb285f700 1 --2- 172.21.15.31:0/346781991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fac064730 0x7f3fac064b50 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f3fa40032f0 tx=0x7f3fa40092b0).ready entity=mon.0 client_cookie=2f9883a34d736be2 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:38.715 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.705+0000 7f3fb185d700 1 -- 172.21.15.31:0/346781991 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f3fa400bc00 con 0x7f3fac064730 2020-06-27T04:39:38.715 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6070263385772705, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.715 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.705+0000 7f3fb185d700 1 -- 172.21.15.31:0/346781991 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa400bd60 con 0x7f3fac064730 2020-06-27T04:39:38.716 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.705+0000 7f3fb185d700 1 -- 172.21.15.31:0/346781991 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f3fa4011400 con 0x7f3fac064730 2020-06-27T04:39:38.716 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.705+0000 7f3fb42c2700 1 -- 172.21.15.31:0/346781991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fac064730 msgr2=0x7f3fac064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:38.716 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.705+0000 7f3fb42c2700 1 --2- 172.21.15.31:0/346781991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fac064730 0x7f3fac064b50 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f3fa40032f0 tx=0x7f3fa40092b0).stop 2020-06-27T04:39:38.716 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.706+0000 7f3fb42c2700 1 -- 172.21.15.31:0/346781991 shutdown_connections 2020-06-27T04:39:38.716 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6072113513946533, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.717 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.706+0000 7f3fb42c2700 1 --2- 172.21.15.31:0/346781991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fac064730 0x7f3fac064b50 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:38.717 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.706+0000 7f3fb42c2700 1 -- 172.21.15.31:0/346781991 >> 172.21.15.31:0/346781991 conn(0x7f3fac05ffe0 msgr2=0x7f3fac062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:38.717 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.706+0000 7f3fb42c2700 1 -- 172.21.15.31:0/346781991 shutdown_connections 2020-06-27T04:39:38.717 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.706+0000 7f3fb42c2700 1 -- 172.21.15.31:0/346781991 wait complete. 2020-06-27T04:39:38.718 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6073532104492188, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.719 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.707+0000 7f3fb42c2700 1 Processor -- start 2020-06-27T04:39:38.719 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.707+0000 7f3fb42c2700 1 -- start start 2020-06-27T04:39:38.719 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6074485778808594, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.719 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.707+0000 7f3fb42c2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fac07e300 0x7f3fac0613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:38.719 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6075630187988281, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.720 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.707+0000 7f3fb42c2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac061890 con 0x7f3fac07e300 2020-06-27T04:39:38.720 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6076583862304688, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.720 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.707+0000 7f3fb285f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fac07e300 0x7f3fac0613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:38.720 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.707+0000 7f3fb285f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fac07e300 0x7f3fac0613a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38434/0 (socket says 172.21.15.31:38434) 2020-06-27T04:39:38.720 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.707+0000 7f3fb285f700 1 -- 172.21.15.31:0/1518078272 learned_addr learned my addr 172.21.15.31:0/1518078272 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:38.721 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6077864170074463, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.721 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.707+0000 7f3fb285f700 1 -- 172.21.15.31:0/1518078272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac0619d0 con 0x7f3fac07e300 2020-06-27T04:39:38.721 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.607985258102417, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.721 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.707+0000 7f3fb285f700 1 --2- 172.21.15.31:0/1518078272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fac07e300 0x7f3fac0613a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f3fa40032f0 tx=0x7f3fa4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:38.722 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6081211566925049, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.722 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.708+0000 7f3faaffd700 1 -- 172.21.15.31:0/1518078272 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f3fa4010b80 con 0x7f3fac07e300 2020-06-27T04:39:38.722 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.708+0000 7f3faaffd700 1 -- 172.21.15.31:0/1518078272 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa4010ce0 con 0x7f3fac07e300 2020-06-27T04:39:38.722 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6083376407623291, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.722 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.708+0000 7f3fb42c2700 1 -- 172.21.15.31:0/1518078272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fac061bc0 con 0x7f3fac07e300 2020-06-27T04:39:38.723 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.708+0000 7f3faaffd700 1 -- 172.21.15.31:0/1518078272 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f3fa401c440 con 0x7f3fac07e300 2020-06-27T04:39:38.723 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.708+0000 7f3fb42c2700 1 -- 172.21.15.31:0/1518078272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fac062050 con 0x7f3fac07e300 2020-06-27T04:39:38.723 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.608536958694458, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.723 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.708+0000 7f3faaffd700 1 -- 172.21.15.31:0/1518078272 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7f3fa402c070 con 0x7f3fac07e300 2020-06-27T04:39:38.724 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.708+0000 7f3faaffd700 1 -- 172.21.15.31:0/1518078272 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f3fa40257c0 con 0x7f3fac07e300 2020-06-27T04:39:38.724 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6086301803588867, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.724 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.709+0000 7f3fb42c2700 1 -- 172.21.15.31:0/1518078272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fac062240 con 0x7f3fac07e300 2020-06-27T04:39:38.724 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6094045639038086, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.725 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.711+0000 7f3faaffd700 1 -- 172.21.15.31:0/1518078272 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67681 (secure 0 0 0) 0x7f3fa402a060 con 0x7f3fac07e300 2020-06-27T04:39:38.725 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6114761829376221, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.785 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.782+0000 7f3fb42c2700 1 -- 172.21.15.31:0/1518078272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f3fac057340 con 0x7f3fac07e300 2020-06-27T04:39:38.786 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.682476282119751, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.785+0000 7f3faaffd700 1 -- 172.21.15.31:0/1518078272 <== mon.0 v2:172.21.15.31:3300/0 7 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f3fa402f480 con 0x7f3fac07e300 2020-06-27T04:39:38.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.785+0000 7f3faaffd700 1 -- 172.21.15.31:0/1518078272 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+338 (secure 0 0 0) 0x7f3fa4020070 con 0x7f3fac07e300 2020-06-27T04:39:38.791 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6853785514831543, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.791 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-06-27T04:39:38.791 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [global] 2020-06-27T04:39:38.791 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout fsid = 12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:39:38.792 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_host = [v2:172.21.15.31:3300,v1:172.21.15.31:6789] 2020-06-27T04:39:38.792 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_pg_remap = true 2020-06-27T04:39:38.792 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_primary_affinity = true 2020-06-27T04:39:38.792 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_no_sortbitwise = false 2020-06-27T04:39:38.792 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_crush_chooseleaf_type = 0 2020-06-27T04:39:38.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-06-27T04:39:38.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [mgr] 2020-06-27T04:39:38.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr/telemetry/nag = false 2020-06-27T04:39:38.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-06-27T04:39:38.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [osd] 2020-06-27T04:39:38.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_map_max_advance = 10 2020-06-27T04:39:38.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_sloppy_crc = true 2020-06-27T04:39:38.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6857986450195312, stop=False, exit=None, reads=[8] 2020-06-27T04:39:38.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.785+0000 7f3fb42c2700 1 -- 172.21.15.31:0/1518078272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fac07e300 msgr2=0x7f3fac0613a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:38.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.785+0000 7f3fb42c2700 1 --2- 172.21.15.31:0/1518078272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fac07e300 0x7f3fac0613a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f3fa40032f0 tx=0x7f3fa4016000).stop 2020-06-27T04:39:38.795 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.686068058013916, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.795 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.785+0000 7f3fb42c2700 1 -- 172.21.15.31:0/1518078272 shutdown_connections 2020-06-27T04:39:38.795 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.785+0000 7f3fb42c2700 1 --2- 172.21.15.31:0/1518078272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fac07e300 0x7f3fac0613a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:38.796 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.785+0000 7f3fb42c2700 1 -- 172.21.15.31:0/1518078272 >> 172.21.15.31:0/1518078272 conn(0x7f3fac05ffe0 msgr2=0x7f3fac062490 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:38.796 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6861922740936279, stop=False, exit=None, reads=[10] 2020-06-27T04:39:38.796 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.786+0000 7f3fb42c2700 1 -- 172.21.15.31:0/1518078272 shutdown_connections 2020-06-27T04:39:38.797 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:38.786+0000 7f3fb42c2700 1 -- 172.21.15.31:0/1518078272 wait complete. 2020-06-27T04:39:38.797 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.686394453048706, stop=False, exit=None, reads=[10] 2020-06-27T04:39:39.179 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0758697986602783, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:39:39.179 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0760295391082764, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:39:39.179 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Generating new minimal ceph.conf... 2020-06-27T04:39:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'config', 'generate-minimal-conf', '-o', '/var/lib/ceph/mon/ceph-a/config'] 2020-06-27T04:39:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z -v /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2020-06-27T04:39:39.447 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:39 smithi031 bash[17969]: audit 2020-06-27T04:39:38.783625+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.31:0/1518078272' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2020-06-27T04:39:39.448 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:39 smithi031 bash[17969]: audit 2020-06-27T04:39:38.786236+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.31:0/1518078272' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2020-06-27T04:39:39.820 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.811+0000 7fd74987f700 1 Processor -- start 2020-06-27T04:39:39.820 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.811+0000 7fd74987f700 1 -- start start 2020-06-27T04:39:39.821 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.811+0000 7fd74987f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd744064730 0x7fd744064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:39.821 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.811+0000 7fd74987f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7440651a0 con 0x7fd744064730 2020-06-27T04:39:39.821 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.812+0000 7fd7437fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd744064730 0x7fd744064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:39.821 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6360948085784912, stop=False, exit=None, reads=[10] 2020-06-27T04:39:39.821 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.812+0000 7fd7437fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd744064730 0x7fd744064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38436/0 (socket says 172.21.15.31:38436) 2020-06-27T04:39:39.822 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.812+0000 7fd7437fe700 1 -- 172.21.15.31:0/442442186 learned_addr learned my addr 172.21.15.31:0/442442186 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:39.822 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.812+0000 7fd7437fe700 1 -- 172.21.15.31:0/442442186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd744065a20 con 0x7fd744064730 2020-06-27T04:39:39.822 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.812+0000 7fd7437fe700 1 --2- 172.21.15.31:0/442442186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd744064730 0x7fd744064b50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fd734002f70 tx=0x7fd734006ec0).ready entity=mon.0 client_cookie=5a28fff10ad3b1be server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:39.822 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.812+0000 7fd7427fc700 1 -- 172.21.15.31:0/442442186 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fd734009980 con 0x7fd744064730 2020-06-27T04:39:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6363568305969238, stop=False, exit=None, reads=[10] 2020-06-27T04:39:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.812+0000 7fd7427fc700 1 -- 172.21.15.31:0/442442186 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fd734000e90 con 0x7fd744064730 2020-06-27T04:39:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.812+0000 7fd7427fc700 1 -- 172.21.15.31:0/442442186 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fd734011c70 con 0x7fd744064730 2020-06-27T04:39:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.812+0000 7fd74987f700 1 -- 172.21.15.31:0/442442186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd744064730 msgr2=0x7fd744064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.812+0000 7fd74987f700 1 --2- 172.21.15.31:0/442442186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd744064730 0x7fd744064b50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fd734002f70 tx=0x7fd734006ec0).stop 2020-06-27T04:39:39.824 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.812+0000 7fd74987f700 1 -- 172.21.15.31:0/442442186 shutdown_connections 2020-06-27T04:39:39.824 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6366138458251953, stop=False, exit=None, reads=[10] 2020-06-27T04:39:39.824 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.812+0000 7fd74987f700 1 --2- 172.21.15.31:0/442442186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd744064730 0x7fd744064b50 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:39.824 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.812+0000 7fd74987f700 1 -- 172.21.15.31:0/442442186 >> 172.21.15.31:0/442442186 conn(0x7fd74405ffe0 msgr2=0x7fd744062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:39.824 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.812+0000 7fd74987f700 1 -- 172.21.15.31:0/442442186 shutdown_connections 2020-06-27T04:39:39.825 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.812+0000 7fd74987f700 1 -- 172.21.15.31:0/442442186 wait complete. 2020-06-27T04:39:39.825 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.813+0000 7fd74987f700 1 Processor -- start 2020-06-27T04:39:39.825 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.814+0000 7fd74987f700 1 -- start start 2020-06-27T04:39:39.825 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.814+0000 7fd74987f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7440785d0 0x7fd7440789f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:39.825 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.814+0000 7fd74987f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd744079040 con 0x7fd7440785d0 2020-06-27T04:39:39.826 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6370232105255127, stop=False, exit=None, reads=[10] 2020-06-27T04:39:39.826 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.814+0000 7fd7437fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7440785d0 0x7fd7440789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:39.826 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.814+0000 7fd7437fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7440785d0 0x7fd7440789f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38438/0 (socket says 172.21.15.31:38438) 2020-06-27T04:39:39.826 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.814+0000 7fd7437fe700 1 -- 172.21.15.31:0/1609752672 learned_addr learned my addr 172.21.15.31:0/1609752672 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:39.826 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.814+0000 7fd7437fe700 1 -- 172.21.15.31:0/1609752672 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7440799a0 con 0x7fd7440785d0 2020-06-27T04:39:39.827 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6372561454772949, stop=False, exit=None, reads=[10] 2020-06-27T04:39:39.827 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.814+0000 7fd7437fe700 1 --2- 172.21.15.31:0/1609752672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7440785d0 0x7fd7440789f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fd734006bb0 tx=0x7fd734006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:39.827 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.814+0000 7fd72b7fe700 1 -- 172.21.15.31:0/1609752672 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fd73401a820 con 0x7fd7440785d0 2020-06-27T04:39:39.827 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.814+0000 7fd74987f700 1 -- 172.21.15.31:0/1609752672 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd744079bf0 con 0x7fd7440785d0 2020-06-27T04:39:39.827 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6375024318695068, stop=False, exit=None, reads=[10] 2020-06-27T04:39:39.828 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.814+0000 7fd72b7fe700 1 -- 172.21.15.31:0/1609752672 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fd73401adc0 con 0x7fd7440785d0 2020-06-27T04:39:39.828 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.815+0000 7fd74987f700 1 -- 172.21.15.31:0/1609752672 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd74407a020 con 0x7fd7440785d0 2020-06-27T04:39:39.828 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6376781463623047, stop=False, exit=None, reads=[10] 2020-06-27T04:39:39.828 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.815+0000 7fd72b7fe700 1 -- 172.21.15.31:0/1609752672 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fd73401bcb0 con 0x7fd7440785d0 2020-06-27T04:39:39.829 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.815+0000 7fd72b7fe700 1 -- 172.21.15.31:0/1609752672 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7fd73400f070 con 0x7fd7440785d0 2020-06-27T04:39:39.829 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.815+0000 7fd72b7fe700 1 -- 172.21.15.31:0/1609752672 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fd7340243c0 con 0x7fd7440785d0 2020-06-27T04:39:39.829 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6381251811981201, stop=False, exit=None, reads=[10] 2020-06-27T04:39:39.829 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.815+0000 7fd74987f700 1 -- 172.21.15.31:0/1609752672 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd744079180 con 0x7fd7440785d0 2020-06-27T04:39:39.830 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6383333206176758, stop=False, exit=None, reads=[10] 2020-06-27T04:39:39.830 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.818+0000 7fd72b7fe700 1 -- 172.21.15.31:0/1609752672 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67681 (secure 0 0 0) 0x7fd73401a980 con 0x7fd7440785d0 2020-06-27T04:39:39.831 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6404032707214355, stop=False, exit=None, reads=[10] 2020-06-27T04:39:39.892 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.889+0000 7fd74987f700 1 -- 172.21.15.31:0/1609752672 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fd744057340 con 0x7fd7440785d0 2020-06-27T04:39:39.892 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7115333080291748, stop=False, exit=None, reads=[10] 2020-06-27T04:39:39.893 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.889+0000 7fd72b7fe700 1 -- 172.21.15.31:0/1609752672 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fd73401ab20 con 0x7fd7440785d0 2020-06-27T04:39:39.893 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7117910385131836, stop=False, exit=None, reads=[10] 2020-06-27T04:39:39.894 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.890+0000 7fd74987f700 1 -- 172.21.15.31:0/1609752672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7440785d0 msgr2=0x7fd7440789f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:39.894 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7124683856964111, stop=False, exit=None, reads=[10] 2020-06-27T04:39:39.895 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.890+0000 7fd74987f700 1 --2- 172.21.15.31:0/1609752672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7440785d0 0x7fd7440789f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fd734006bb0 tx=0x7fd734006ec0).stop 2020-06-27T04:39:39.895 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.890+0000 7fd74987f700 1 -- 172.21.15.31:0/1609752672 shutdown_connections 2020-06-27T04:39:39.895 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.890+0000 7fd74987f700 1 --2- 172.21.15.31:0/1609752672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7440785d0 0x7fd7440789f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:39.895 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.890+0000 7fd74987f700 1 -- 172.21.15.31:0/1609752672 >> 172.21.15.31:0/1609752672 conn(0x7fd74405ffe0 msgr2=0x7fd74406f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:39.896 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7126820087432861, stop=False, exit=None, reads=[10] 2020-06-27T04:39:39.896 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.890+0000 7fd74987f700 1 -- 172.21.15.31:0/1609752672 shutdown_connections 2020-06-27T04:39:39.896 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:39.890+0000 7fd74987f700 1 -- 172.21.15.31:0/1609752672 wait complete. 2020-06-27T04:39:39.896 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7127971649169922, stop=False, exit=None, reads=[10] 2020-06-27T04:39:40.297 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.1167035102844238, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:39:40.298 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.1168582439422607, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:39:40.298 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Restarting the monitor... 2020-06-27T04:39:40.298 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl restart ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mon.a 2020-06-27T04:39:40.634 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:40 smithi031 bash[17969]: audit 2020-06-27T04:39:39.890413+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.31:0/1609752672' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:39:40.635 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:40 smithi031 systemd[1]: Stopping Ceph mon.a for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:39:40.635 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:40 smithi031 bash[17969]: debug 2020-06-27T04:39:40.348+0000 7f37381d3700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-06-27T04:39:40.635 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:40 smithi031 bash[17969]: debug 2020-06-27T04:39:40.348+0000 7f37381d3700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2020-06-27T04:39:40.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:40 smithi031 podman[18363]: 2020-06-27 04:39:40.632244674 +0000 UTC m=+0.316521205 container died fac7f1984dfb53fd0756bfd7d686d453f71450bbebe19c52ce6712428b42d4cd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a) 2020-06-27T04:39:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:40 smithi031 podman[18363]: 2020-06-27 04:39:40.663425659 +0000 UTC m=+0.347702169 container stop fac7f1984dfb53fd0756bfd7d686d453f71450bbebe19c52ce6712428b42d4cd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a) 2020-06-27T04:39:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:40 smithi031 podman[18363]: fac7f1984dfb53fd0756bfd7d686d453f71450bbebe19c52ce6712428b42d4cd 2020-06-27T04:39:41.265 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:41 smithi031 systemd[1]: Stopped Ceph mon.a for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:39:41.265 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:41 smithi031 systemd[1]: Starting Ceph mon.a for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:39:41.271 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.9722564220428467, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:39:41.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.9725358486175537, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:39:41.272 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Setting mon public_network... 2020-06-27T04:39:41.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'config', 'set', 'mon', 'public_network', '172.21.0.0/20'] 2020-06-27T04:39:41.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 config set mon public_network 172.21.0.0/20 2020-06-27T04:39:41.524 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:41 smithi031 podman[18410]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a found: no such container 2020-06-27T04:39:41.524 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:41 smithi031 systemd[1]: Started Ceph mon.a for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:39:41.840 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:41 smithi031 bash[18426]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a found: no such container 2020-06-27T04:39:41.840 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:41 smithi031 bash[18426]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a 2020-06-27T04:39:41.840 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:41 smithi031 bash[18426]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a" found: no such container 2020-06-27T04:39:42.091 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:41 smithi031 podman[18484]: 2020-06-27 04:39:41.838218744 +0000 UTC m=+0.228916804 container create 61817385ac1b8aa58e06ce089d0b2b54f10fc25fa9acda0f7a1ef132a606b3e1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a) 2020-06-27T04:39:42.091 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 podman[18484]: 2020-06-27 04:39:42.029851548 +0000 UTC m=+0.420549630 container init 61817385ac1b8aa58e06ce089d0b2b54f10fc25fa9acda0f7a1ef132a606b3e1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a) 2020-06-27T04:39:42.091 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 podman[18484]: 2020-06-27 04:39:42.084559456 +0000 UTC m=+0.475257515 container start 61817385ac1b8aa58e06ce089d0b2b54f10fc25fa9acda0f7a1ef132a606b3e1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a) 2020-06-27T04:39:42.092 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 podman[18484]: 2020-06-27 04:39:42.084685846 +0000 UTC m=+0.475383950 container attach 61817385ac1b8aa58e06ce089d0b2b54f10fc25fa9acda0f7a1ef132a606b3e1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.a) 2020-06-27T04:39:42.092 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.053+0000 7f8765355700 0 set uid:gid to 167:167 (ceph:ceph) 2020-06-27T04:39:42.092 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.053+0000 7f8765355700 0 ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev), process ceph-mon, pid 1 2020-06-27T04:39:42.092 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.053+0000 7f8765355700 0 pidfile_write: ignore empty --pid-file 2020-06-27T04:39:42.092 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 0 load: jerasure load: lrc load: isa 2020-06-27T04:39:42.093 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: RocksDB version: 6.8.1 2020-06-27T04:39:42.093 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2020-06-27T04:39:42.093 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Compile date Jun 26 2020 2020-06-27T04:39:42.093 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: DB SUMMARY 2020-06-27T04:39:42.093 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: CURRENT file: CURRENT 2020-06-27T04:39:42.094 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: IDENTITY file: IDENTITY 2020-06-27T04:39:42.094 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2020-06-27T04:39:42.094 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2020-06-27T04:39:42.094 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 70962 ; 2020-06-27T04:39:42.094 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.error_if_exists: 0 2020-06-27T04:39:42.095 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.create_if_missing: 0 2020-06-27T04:39:42.095 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.paranoid_checks: 1 2020-06-27T04:39:42.095 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.env: 0x56382a201720 2020-06-27T04:39:42.095 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.fs: Posix File System 2020-06-27T04:39:42.096 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.info_log: 0x56382be04300 2020-06-27T04:39:42.096 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.max_file_opening_threads: 16 2020-06-27T04:39:42.096 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.statistics: (nil) 2020-06-27T04:39:42.096 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.use_fsync: 0 2020-06-27T04:39:42.096 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.max_log_file_size: 0 2020-06-27T04:39:42.096 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2020-06-27T04:39:42.097 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.log_file_time_to_roll: 0 2020-06-27T04:39:42.097 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.keep_log_file_num: 1000 2020-06-27T04:39:42.097 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.recycle_log_file_num: 0 2020-06-27T04:39:42.097 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.allow_fallocate: 1 2020-06-27T04:39:42.097 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.allow_mmap_reads: 0 2020-06-27T04:39:42.098 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.allow_mmap_writes: 0 2020-06-27T04:39:42.098 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.use_direct_reads: 0 2020-06-27T04:39:42.098 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2020-06-27T04:39:42.098 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.create_missing_column_families: 0 2020-06-27T04:39:42.098 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.db_log_dir: 2020-06-27T04:39:42.099 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2020-06-27T04:39:42.099 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.table_cache_numshardbits: 6 2020-06-27T04:39:42.099 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.max_subcompactions: 1 2020-06-27T04:39:42.099 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.max_background_flushes: -1 2020-06-27T04:39:42.099 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.WAL_ttl_seconds: 0 2020-06-27T04:39:42.099 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.WAL_size_limit_MB: 0 2020-06-27T04:39:42.100 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2020-06-27T04:39:42.100 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2020-06-27T04:39:42.100 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.is_fd_close_on_exec: 1 2020-06-27T04:39:42.100 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.advise_random_on_open: 1 2020-06-27T04:39:42.100 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.db_write_buffer_size: 0 2020-06-27T04:39:42.101 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.write_buffer_manager: 0x56382be512c0 2020-06-27T04:39:42.101 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2020-06-27T04:39:42.101 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2020-06-27T04:39:42.101 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2020-06-27T04:39:42.101 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.use_adaptive_mutex: 0 2020-06-27T04:39:42.111 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.rate_limiter: (nil) 2020-06-27T04:39:42.111 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2020-06-27T04:39:42.112 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.wal_recovery_mode: 2 2020-06-27T04:39:42.112 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.enable_thread_tracking: 0 2020-06-27T04:39:42.112 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.enable_pipelined_write: 0 2020-06-27T04:39:42.112 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.unordered_write: 0 2020-06-27T04:39:42.112 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2020-06-27T04:39:42.113 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2020-06-27T04:39:42.113 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2020-06-27T04:39:42.113 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2020-06-27T04:39:42.113 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.row_cache: None 2020-06-27T04:39:42.113 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.wal_filter: None 2020-06-27T04:39:42.114 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2020-06-27T04:39:42.114 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.058+0000 7f8765355700 4 rocksdb: Options.allow_ingest_behind: 0 2020-06-27T04:39:42.114 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.preserve_deletes: 0 2020-06-27T04:39:42.114 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.two_write_queues: 0 2020-06-27T04:39:42.114 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.manual_wal_flush: 0 2020-06-27T04:39:42.115 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.atomic_flush: 0 2020-06-27T04:39:42.115 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2020-06-27T04:39:42.115 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.persist_stats_to_disk: 0 2020-06-27T04:39:42.115 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.write_dbid_to_manifest: 0 2020-06-27T04:39:42.115 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.log_readahead_size: 0 2020-06-27T04:39:42.116 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2020-06-27T04:39:42.116 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_background_jobs: 2 2020-06-27T04:39:42.116 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_background_compactions: -1 2020-06-27T04:39:42.116 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2020-06-27T04:39:42.116 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2020-06-27T04:39:42.116 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.delayed_write_rate : 16777216 2020-06-27T04:39:42.117 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_total_wal_size: 0 2020-06-27T04:39:42.117 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2020-06-27T04:39:42.117 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.stats_dump_period_sec: 600 2020-06-27T04:39:42.117 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.stats_persist_period_sec: 600 2020-06-27T04:39:42.117 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2020-06-27T04:39:42.118 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_open_files: -1 2020-06-27T04:39:42.118 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.bytes_per_sync: 0 2020-06-27T04:39:42.118 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.wal_bytes_per_sync: 0 2020-06-27T04:39:42.118 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.strict_bytes_per_sync: 0 2020-06-27T04:39:42.118 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compaction_readahead_size: 0 2020-06-27T04:39:42.119 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Compression algorithms supported: 2020-06-27T04:39:42.119 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2020-06-27T04:39:42.119 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: kZSTD supported: 0 2020-06-27T04:39:42.119 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: kXpressCompression supported: 0 2020-06-27T04:39:42.119 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: kLZ4HCCompression supported: 1 2020-06-27T04:39:42.119 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: kLZ4Compression supported: 1 2020-06-27T04:39:42.120 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: kBZip2Compression supported: 0 2020-06-27T04:39:42.120 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: kZlibCompression supported: 1 2020-06-27T04:39:42.120 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: kSnappyCompression supported: 1 2020-06-27T04:39:42.121 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Fast CRC32 supported: Supported on x86 2020-06-27T04:39:42.121 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-06-27T04:39:42.121 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2020-06-27T04:39:42.121 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2020-06-27T04:39:42.123 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.merge_operator: 2020-06-27T04:39:42.123 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compaction_filter: None 2020-06-27T04:39:42.123 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compaction_filter_factory: None 2020-06-27T04:39:42.123 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.memtable_factory: SkipListFactory 2020-06-27T04:39:42.124 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.table_factory: BlockBasedTable 2020-06-27T04:39:42.124 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56382bda6238) 2020-06-27T04:39:42.124 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: cache_index_and_filter_blocks: 1 2020-06-27T04:39:42.124 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: cache_index_and_filter_blocks_with_high_priority: 1 2020-06-27T04:39:42.124 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: pin_l0_filter_and_index_blocks_in_cache: 0 2020-06-27T04:39:42.124 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: pin_top_level_index_and_filter: 1 2020-06-27T04:39:42.125 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: index_type: 0 2020-06-27T04:39:42.125 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: data_block_index_type: 0 2020-06-27T04:39:42.125 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: index_shortening: 1 2020-06-27T04:39:42.125 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: data_block_hash_table_util_ratio: 0.750000 2020-06-27T04:39:42.125 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: hash_index_allow_collision: 1 2020-06-27T04:39:42.126 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: checksum: 1 2020-06-27T04:39:42.126 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: no_block_cache: 0 2020-06-27T04:39:42.126 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: block_cache: 0x56382bde0610 2020-06-27T04:39:42.126 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: block_cache_name: BinnedLRUCache 2020-06-27T04:39:42.126 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: block_cache_options: 2020-06-27T04:39:42.126 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: capacity : 536870912 2020-06-27T04:39:42.127 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: num_shard_bits : 4 2020-06-27T04:39:42.127 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: strict_capacity_limit : 0 2020-06-27T04:39:42.127 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: high_pri_pool_ratio: 0.000 2020-06-27T04:39:42.127 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: block_cache_compressed: (nil) 2020-06-27T04:39:42.127 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: persistent_cache: (nil) 2020-06-27T04:39:42.128 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: block_size: 4096 2020-06-27T04:39:42.128 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: block_size_deviation: 10 2020-06-27T04:39:42.128 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: block_restart_interval: 16 2020-06-27T04:39:42.128 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: index_block_restart_interval: 1 2020-06-27T04:39:42.128 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: metadata_block_size: 4096 2020-06-27T04:39:42.129 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: partition_filters: 0 2020-06-27T04:39:42.129 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: use_delta_encoding: 1 2020-06-27T04:39:42.129 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: filter_policy: rocksdb.BuiltinBloomFilter 2020-06-27T04:39:42.130 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: whole_key_filtering: 1 2020-06-27T04:39:42.130 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: verify_compression: 0 2020-06-27T04:39:42.130 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: read_amp_bytes_per_bit: 0 2020-06-27T04:39:42.130 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: format_version: 2 2020-06-27T04:39:42.130 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: enable_index_compression: 1 2020-06-27T04:39:42.132 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: block_align: 0 2020-06-27T04:39:42.132 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.write_buffer_size: 33554432 2020-06-27T04:39:42.132 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_write_buffer_number: 2 2020-06-27T04:39:42.133 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compression: NoCompression 2020-06-27T04:39:42.133 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.bottommost_compression: Disabled 2020-06-27T04:39:42.133 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.prefix_extractor: nullptr 2020-06-27T04:39:42.133 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2020-06-27T04:39:42.133 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.num_levels: 7 2020-06-27T04:39:42.135 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2020-06-27T04:39:42.135 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2020-06-27T04:39:42.135 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2020-06-27T04:39:42.135 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2020-06-27T04:39:42.138 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2020-06-27T04:39:42.138 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2020-06-27T04:39:42.138 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2020-06-27T04:39:42.138 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2020-06-27T04:39:42.138 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2020-06-27T04:39:42.139 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compression_opts.window_bits: -14 2020-06-27T04:39:42.139 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compression_opts.level: 32767 2020-06-27T04:39:42.139 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compression_opts.strategy: 0 2020-06-27T04:39:42.139 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2020-06-27T04:39:42.139 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2020-06-27T04:39:42.140 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compression_opts.enabled: false 2020-06-27T04:39:42.140 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2020-06-27T04:39:42.140 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2020-06-27T04:39:42.140 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2020-06-27T04:39:42.140 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.target_file_size_base: 67108864 2020-06-27T04:39:42.141 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.target_file_size_multiplier: 1 2020-06-27T04:39:42.141 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2020-06-27T04:39:42.142 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2020-06-27T04:39:42.142 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2020-06-27T04:39:42.142 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2020-06-27T04:39:42.142 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2020-06-27T04:39:42.143 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2020-06-27T04:39:42.143 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2020-06-27T04:39:42.143 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2020-06-27T04:39:42.143 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2020-06-27T04:39:42.143 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2020-06-27T04:39:42.144 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2020-06-27T04:39:42.144 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2020-06-27T04:39:42.144 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.arena_block_size: 4194304 2020-06-27T04:39:42.144 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2020-06-27T04:39:42.145 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2020-06-27T04:39:42.145 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2020-06-27T04:39:42.145 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.disable_auto_compactions: 0 2020-06-27T04:39:42.145 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2020-06-27T04:39:42.145 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2020-06-27T04:39:42.146 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2020-06-27T04:39:42.146 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2020-06-27T04:39:42.146 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2020-06-27T04:39:42.146 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2020-06-27T04:39:42.146 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2020-06-27T04:39:42.147 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2020-06-27T04:39:42.147 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2020-06-27T04:39:42.147 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2020-06-27T04:39:42.147 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.table_properties_collectors: 2020-06-27T04:39:42.147 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.inplace_update_support: 0 2020-06-27T04:39:42.148 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.inplace_update_num_locks: 10000 2020-06-27T04:39:42.148 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2020-06-27T04:39:42.149 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2020-06-27T04:39:42.149 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.memtable_huge_page_size: 0 2020-06-27T04:39:42.149 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.bloom_locality: 0 2020-06-27T04:39:42.150 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.max_successive_merges: 0 2020-06-27T04:39:42.150 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.optimize_filters_for_hits: 0 2020-06-27T04:39:42.150 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.paranoid_file_checks: 0 2020-06-27T04:39:42.151 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.force_consistency_checks: 0 2020-06-27T04:39:42.151 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.report_bg_io_stats: 0 2020-06-27T04:39:42.151 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.ttl: 2592000 2020-06-27T04:39:42.151 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: Options.periodic_compaction_seconds: 0 2020-06-27T04:39:42.151 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2020-06-27T04:39:42.151 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2020-06-27T04:39:42.152 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1593232782060921, "job": 1, "event": "recovery_started", "log_files": [6]} 2020-06-27T04:39:42.152 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.059+0000 7f8765355700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2020-06-27T04:39:42.152 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.060+0000 7f8765355700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2020-06-27T04:39:42.152 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.060+0000 7f8765355700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1593232782061702, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 67809, "table_properties": {"data_size": 66096, "index_size": 318, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 581, "raw_key_size": 9149, "raw_average_key_size": 46, "raw_value_size": 60909, "raw_average_value_size": 312, "num_data_blocks": 10, "num_entries": 195, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1593232782, "oldest_key_time": 3, "file_creation_time": 0}} 2020-06-27T04:39:42.152 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.060+0000 7f8765355700 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2020-06-27T04:39:42.153 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.060+0000 7f8765355700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1593232782062097, "job": 1, "event": "recovery_finished"} 2020-06-27T04:39:42.153 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.061+0000 7f8765355700 4 rocksdb: DB pointer 0x56382be33800 2020-06-27T04:39:42.153 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.061+0000 7f874c179700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2020-06-27T04:39:42.153 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.061+0000 7f874c179700 4 rocksdb: [db_impl/db_impl.cc:851] 2020-06-27T04:39:42.153 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: ** DB Stats ** 2020-06-27T04:39:42.154 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Uptime(secs): 0.0 total, 0.0 interval 2020-06-27T04:39:42.154 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2020-06-27T04:39:42.154 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2020-06-27T04:39:42.154 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2020-06-27T04:39:42.155 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2020-06-27T04:39:42.155 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2020-06-27T04:39:42.155 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2020-06-27T04:39:42.155 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: ** Compaction Stats [default] ** 2020-06-27T04:39:42.155 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-06-27T04:39:42.156 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-06-27T04:39:42.156 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: L0 2/0 67.85 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.1 0.00 0.00 1 0.000 0 0 2020-06-27T04:39:42.156 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Sum 2/0 67.85 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.1 0.00 0.00 1 0.000 0 0 2020-06-27T04:39:42.156 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.1 0.00 0.00 1 0.000 0 0 2020-06-27T04:39:42.156 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: ** Compaction Stats [default] ** 2020-06-27T04:39:42.156 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-06-27T04:39:42.157 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-06-27T04:39:42.157 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 133.1 0.00 0.00 1 0.000 0 0 2020-06-27T04:39:42.157 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Uptime(secs): 0.0 total, 0.0 interval 2020-06-27T04:39:42.157 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Flush(GB): cumulative 0.000, interval 0.000 2020-06-27T04:39:42.157 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: AddFile(GB): cumulative 0.000, interval 0.000 2020-06-27T04:39:42.158 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: AddFile(Total Files): cumulative 0, interval 0 2020-06-27T04:39:42.158 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: AddFile(L0 Files): cumulative 0, interval 0 2020-06-27T04:39:42.158 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: AddFile(Keys): cumulative 0, interval 0 2020-06-27T04:39:42.158 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Cumulative compaction: 0.00 GB write, 25.87 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-06-27T04:39:42.158 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Interval compaction: 0.00 GB write, 25.87 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-06-27T04:39:42.159 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-06-27T04:39:42.159 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: ** File Read Latency Histogram By Level [default] ** 2020-06-27T04:39:42.159 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: ** Compaction Stats [default] ** 2020-06-27T04:39:42.159 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-06-27T04:39:42.160 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-06-27T04:39:42.160 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: L0 2/0 67.85 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.1 0.00 0.00 1 0.000 0 0 2020-06-27T04:39:42.160 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Sum 2/0 67.85 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.1 0.00 0.00 1 0.000 0 0 2020-06-27T04:39:42.160 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-06-27T04:39:42.160 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: ** Compaction Stats [default] ** 2020-06-27T04:39:42.161 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-06-27T04:39:42.161 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-06-27T04:39:42.161 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 133.1 0.00 0.00 1 0.000 0 0 2020-06-27T04:39:42.161 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Uptime(secs): 0.0 total, 0.0 interval 2020-06-27T04:39:42.161 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Flush(GB): cumulative 0.000, interval 0.000 2020-06-27T04:39:42.161 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: AddFile(GB): cumulative 0.000, interval 0.000 2020-06-27T04:39:42.162 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: AddFile(Total Files): cumulative 0, interval 0 2020-06-27T04:39:42.162 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: AddFile(L0 Files): cumulative 0, interval 0 2020-06-27T04:39:42.162 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: AddFile(Keys): cumulative 0, interval 0 2020-06-27T04:39:42.162 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Cumulative compaction: 0.00 GB write, 25.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-06-27T04:39:42.162 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-06-27T04:39:42.163 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-06-27T04:39:42.163 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: ** File Read Latency Histogram By Level [default] ** 2020-06-27T04:39:42.163 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.062+0000 7f8765355700 0 starting mon.a rank 0 at public addrs [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] at bind addrs [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:39:42.163 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.063+0000 7f8765355700 1 mon.a@-1(???) e1 preinit fsid 12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:39:42.163 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.063+0000 7f8765355700 0 mon.a@-1(???).mds e1 new map 2020-06-27T04:39:42.164 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.063+0000 7f8765355700 0 mon.a@-1(???).mds e1 print_map 2020-06-27T04:39:42.164 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: e1 2020-06-27T04:39:42.164 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: enable_multiple, ever_enabled_multiple: 0,0 2020-06-27T04:39:42.164 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2020-06-27T04:39:42.164 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: legacy client fscid: -1 2020-06-27T04:39:42.164 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: 2020-06-27T04:39:42.165 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: No filesystems configured 2020-06-27T04:39:42.165 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.063+0000 7f8765355700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2020-06-27T04:39:42.165 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.063+0000 7f8765355700 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2020-06-27T04:39:42.165 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.063+0000 7f8765355700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2020-06-27T04:39:42.165 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: audit 2020-06-27T04:39:39.890413+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.31:0/1609752672' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:39:42.166 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.063+0000 7f8765355700 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2020-06-27T04:39:42.166 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.064+0000 7f8765355700 20 expand_channel_meta expand map: {default=false} 2020-06-27T04:39:42.166 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.064+0000 7f8765355700 20 expand_channel_meta from 'false' to 'false' 2020-06-27T04:39:42.166 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.064+0000 7f8765355700 20 expand_channel_meta expanded map: {default=false} 2020-06-27T04:39:42.166 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.064+0000 7f8765355700 20 expand_channel_meta expand map: {default=info} 2020-06-27T04:39:42.167 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.064+0000 7f8765355700 20 expand_channel_meta from 'info' to 'info' 2020-06-27T04:39:42.167 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.064+0000 7f8765355700 20 expand_channel_meta expanded map: {default=info} 2020-06-27T04:39:42.167 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.064+0000 7f8765355700 20 expand_channel_meta expand map: {default=daemon} 2020-06-27T04:39:42.167 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.064+0000 7f8765355700 20 expand_channel_meta from 'daemon' to 'daemon' 2020-06-27T04:39:42.167 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.064+0000 7f8765355700 20 expand_channel_meta expanded map: {default=daemon} 2020-06-27T04:39:42.168 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.064+0000 7f8765355700 20 expand_channel_meta expand map: {default=debug} 2020-06-27T04:39:42.168 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.064+0000 7f8765355700 20 expand_channel_meta from 'debug' to 'debug' 2020-06-27T04:39:42.168 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: debug 2020-06-27T04:39:42.064+0000 7f8765355700 20 expand_channel_meta expanded map: {default=debug} 2020-06-27T04:39:42.252 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.042+0000 7fb2a6da9700 1 Processor -- start 2020-06-27T04:39:42.252 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.042+0000 7fb2a6da9700 1 -- start start 2020-06-27T04:39:42.252 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.042+0000 7fb2a6da9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a0064730 0x7fb2a0064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:42.252 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.042+0000 7fb2a6da9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a00651a0 con 0x7fb2a0064730 2020-06-27T04:39:42.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.043+0000 7fb2a5346700 1 -- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a0064730 msgr2=0x7fb2a0064b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.31:3300/0 2020-06-27T04:39:42.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.043+0000 7fb2a5346700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a0064730 0x7fb2a0064b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2020-06-27T04:39:42.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.974553108215332, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.244+0000 7fb2a5346700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a0064730 0x7fb2a0064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:42.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.244+0000 7fb2a5346700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a0064730 0x7fb2a0064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38442/0 (socket says 172.21.15.31:38442) 2020-06-27T04:39:42.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.244+0000 7fb2a5346700 1 -- 172.21.15.31:0/2217170182 learned_addr learned my addr 172.21.15.31:0/2217170182 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:42.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.244+0000 7fb2a5346700 1 -- 172.21.15.31:0/2217170182 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a0065a20 con 0x7fb2a0064730 2020-06-27T04:39:42.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9747388362884521, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.244+0000 7fb2a5346700 1 --2- 172.21.15.31:0/2217170182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a0064730 0x7fb2a0064b50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fb29c005750 tx=0x7fb29c009060).ready entity=mon.0 client_cookie=6b4d5aa799c1a13a server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:42.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.244+0000 7fb293fff700 1 -- 172.21.15.31:0/2217170182 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fb29c005450 con 0x7fb2a0064730 2020-06-27T04:39:42.255 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.244+0000 7fb293fff700 1 -- 172.21.15.31:0/2217170182 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fb29c0055b0 con 0x7fb2a0064730 2020-06-27T04:39:42.256 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.244+0000 7fb293fff700 1 -- 172.21.15.31:0/2217170182 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fb29c00bb40 con 0x7fb2a0064730 2020-06-27T04:39:42.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.244+0000 7fb2a6da9700 1 -- 172.21.15.31:0/2217170182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a0064730 msgr2=0x7fb2a0064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:42.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9749062061309814, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.244+0000 7fb2a6da9700 1 --2- 172.21.15.31:0/2217170182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a0064730 0x7fb2a0064b50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fb29c005750 tx=0x7fb29c009060).stop 2020-06-27T04:39:42.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.244+0000 7fb2a6da9700 1 -- 172.21.15.31:0/2217170182 shutdown_connections 2020-06-27T04:39:42.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.244+0000 7fb2a6da9700 1 --2- 172.21.15.31:0/2217170182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a0064730 0x7fb2a0064b50 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:42.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.244+0000 7fb2a6da9700 1 -- 172.21.15.31:0/2217170182 >> 172.21.15.31:0/2217170182 conn(0x7fb2a005ffe0 msgr2=0x7fb2a0062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:42.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.244+0000 7fb2a6da9700 1 -- 172.21.15.31:0/2217170182 shutdown_connections 2020-06-27T04:39:42.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.245+0000 7fb2a6da9700 1 -- 172.21.15.31:0/2217170182 wait complete. 2020-06-27T04:39:42.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9751136302947998, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.246+0000 7fb2a6da9700 1 Processor -- start 2020-06-27T04:39:42.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.246+0000 7fb2a6da9700 1 -- start start 2020-06-27T04:39:42.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9752087593078613, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.246+0000 7fb2a6da9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a0061f20 0x7fb2a007d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:42.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.246+0000 7fb2a6da9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a007dbb0 con 0x7fb2a0061f20 2020-06-27T04:39:42.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9755525588989258, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.246+0000 7fb2a5346700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a0061f20 0x7fb2a007d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:42.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.246+0000 7fb2a5346700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a0061f20 0x7fb2a007d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38444/0 (socket says 172.21.15.31:38444) 2020-06-27T04:39:42.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.246+0000 7fb2a5346700 1 -- 172.21.15.31:0/997537280 learned_addr learned my addr 172.21.15.31:0/997537280 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:42.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9757437705993652, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.247+0000 7fb2a5346700 1 -- 172.21.15.31:0/997537280 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a007dcf0 con 0x7fb2a0061f20 2020-06-27T04:39:42.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9759094715118408, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.247+0000 7fb2a5346700 1 --2- 172.21.15.31:0/997537280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a0061f20 0x7fb2a007d6c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7fb29c003640 tx=0x7fb29c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:42.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9760370254516602, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.247+0000 7fb2917fa700 1 -- 172.21.15.31:0/997537280 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fb29c012620 con 0x7fb2a0061f20 2020-06-27T04:39:42.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9762234687805176, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.247+0000 7fb2a6da9700 1 -- 172.21.15.31:0/997537280 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a007dee0 con 0x7fb2a0061f20 2020-06-27T04:39:42.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9763576984405518, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.247+0000 7fb2917fa700 1 -- 172.21.15.31:0/997537280 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fb29c012bc0 con 0x7fb2a0061f20 2020-06-27T04:39:42.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.247+0000 7fb2917fa700 1 -- 172.21.15.31:0/997537280 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fb29c01ba10 con 0x7fb2a0061f20 2020-06-27T04:39:42.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.247+0000 7fb2a6da9700 1 -- 172.21.15.31:0/997537280 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a007e370 con 0x7fb2a0061f20 2020-06-27T04:39:42.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.247+0000 7fb2917fa700 1 -- 172.21.15.31:0/997537280 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7fb29c00f030 con 0x7fb2a0061f20 2020-06-27T04:39:42.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9765429496765137, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.247+0000 7fb2917fa700 1 -- 172.21.15.31:0/997537280 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fb29c01cc10 con 0x7fb2a0061f20 2020-06-27T04:39:42.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9766223430633545, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.248+0000 7fb2a6da9700 1 -- 172.21.15.31:0/997537280 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a0057340 con 0x7fb2a0061f20 2020-06-27T04:39:42.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9772670269012451, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.264 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.250+0000 7fb2917fa700 1 -- 172.21.15.31:0/997537280 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67681 (secure 0 0 0) 0x7fb29c021070 con 0x7fb2a0061f20 2020-06-27T04:39:42.264 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.97940993309021, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.324 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.321+0000 7fb2a6da9700 1 -- 172.21.15.31:0/997537280 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"} v 0) v1 -- 0x7fb2a0043e80 con 0x7fb2a0061f20 2020-06-27T04:39:42.325 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.050029993057251, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.328 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.323+0000 7fb2917fa700 1 -- 172.21.15.31:0/997537280 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb29c01b460 con 0x7fb2a0061f20 2020-06-27T04:39:42.328 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0522494316101074, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.328 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.324+0000 7fb2a6da9700 1 -- 172.21.15.31:0/997537280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a0061f20 msgr2=0x7fb2a007d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:42.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.324+0000 7fb2a6da9700 1 --2- 172.21.15.31:0/997537280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a0061f20 0x7fb2a007d6c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7fb29c003640 tx=0x7fb29c009060).stop 2020-06-27T04:39:42.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0528697967529297, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.324+0000 7fb2a6da9700 1 -- 172.21.15.31:0/997537280 shutdown_connections 2020-06-27T04:39:42.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.324+0000 7fb2a6da9700 1 --2- 172.21.15.31:0/997537280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a0061f20 0x7fb2a007d6c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:42.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.324+0000 7fb2a6da9700 1 -- 172.21.15.31:0/997537280 >> 172.21.15.31:0/997537280 conn(0x7fb2a005ffe0 msgr2=0x7fb2a0062460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:42.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0530357360839844, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.324+0000 7fb2a6da9700 1 -- 172.21.15.31:0/997537280 shutdown_connections 2020-06-27T04:39:42.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:42.324+0000 7fb2a6da9700 1 -- 172.21.15.31:0/997537280 wait complete. 2020-06-27T04:39:42.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0531809329986572, stop=False, exit=None, reads=[10] 2020-06-27T04:39:42.348 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: cluster 2020-06-27T04:39:42.068000+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2020-06-27T04:39:42.349 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: cluster 2020-06-27T04:39:42.068043+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0]} 2020-06-27T04:39:42.349 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: cluster 2020-06-27T04:39:42.068092+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2020-06-27T04:39:42.349 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: cluster 2020-06-27T04:39:42.068113+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2020-06-27T04:39:42.349 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:42 smithi031 bash[18426]: cluster 2020-06-27T04:39:42.068430+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2020-06-27T04:39:42.890 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.6162312030792236, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:39:42.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.6163983345031738, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:39:42.891 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Creating mgr... 2020-06-27T04:39:42.892 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2020-06-27T04:39:42.982 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.08780026435852051, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:39:42.983 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.0880591869354248, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:39:42.983 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mgr.y 2020-06-27T04:39:43.006 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.02158808708190918, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:39:43.006 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.02182602882385254, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:39:43.006 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mgr.y 2020-06-27T04:39:43.011 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mgr.y.service: Unit ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mgr.y.service not loaded. 2020-06-27T04:39:43.012 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.005055904388427734, stop=False, exit=None, reads=[10] 2020-06-27T04:39:43.012 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.005142927169799805, stop=True, exit=1, reads=[10] 2020-06-27T04:39:43.012 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mgr.y 2020-06-27T04:39:43.018 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-12892ae2-b830-11ea-a06d-001a4aab830c.target.wants/ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mgr.y.service → /etc/systemd/system/ceph-12892ae2-b830-11ea-a06d-001a4aab830c@.service. 2020-06-27T04:39:43.018 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.005303859710693359, stop=False, exit=None, reads=[10] 2020-06-27T04:39:43.098 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.08492088317871094, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:39:43.098 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.08508014678955078, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:39:43.098 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl start ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mgr.y 2020-06-27T04:39:43.142 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:43 smithi031 bash[18426]: audit 2020-06-27T04:39:42.322579+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.31:0/997537280' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]: dispatch 2020-06-27T04:39:43.143 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:43 smithi031 bash[18426]: audit 2020-06-27T04:39:42.324592+0000 mon.a (mon.0) 7 : audit [INF] from='client.? 172.21.15.31:0/997537280' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]': finished 2020-06-27T04:39:43.143 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:39:43 smithi031 systemd[1]: Starting Ceph mgr.y for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:39:43.145 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.04620051383972168, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:39:43.145 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.046562910079956055, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:39:43.146 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl is-enabled firewalld.service 2020-06-27T04:39:43.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stdout disabled 2020-06-27T04:39:43.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.00728297233581543, stop=False, exit=1, reads=[8] 2020-06-27T04:39:43.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.0074367523193359375, stop=True, exit=1, reads=[8] 2020-06-27T04:39:43.156 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: systemctl is-active firewalld.service 2020-06-27T04:39:43.162 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:stdout inactive 2020-06-27T04:39:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.005845785140991211, stop=False, exit=3, reads=[8] 2020-06-27T04:39:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:systemctl:profile rt=0.005990743637084961, stop=True, exit=3, reads=[8] 2020-06-27T04:39:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:firewalld.service is not enabled 2020-06-27T04:39:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2020-06-27T04:39:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Wrote config to /etc/ceph/ceph.conf 2020-06-27T04:39:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Waiting for mgr to start... 2020-06-27T04:39:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Waiting for mgr... 2020-06-27T04:39:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'status', '-f', 'json-pretty'] 2020-06-27T04:39:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 status -f json-pretty 2020-06-27T04:39:43.398 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:39:43 smithi031 podman[18674]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.y found: no such container 2020-06-27T04:39:43.399 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:39:43 smithi031 systemd[1]: Started Ceph mgr.y for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:39:43.399 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:39:43 smithi031 bash[18687]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.y" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.y found: no such container 2020-06-27T04:39:43.399 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:39:43 smithi031 bash[18687]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.y 2020-06-27T04:39:43.399 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:39:43 smithi031 bash[18687]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.y" found: no such container 2020-06-27T04:39:43.898 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.888+0000 7f6e650a9700 1 Processor -- start 2020-06-27T04:39:43.899 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.888+0000 7f6e650a9700 1 -- start start 2020-06-27T04:39:43.899 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.888+0000 7f6e650a9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e60064730 0x7f6e60064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:43.899 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.888+0000 7f6e650a9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e600651a0 con 0x7f6e60064730 2020-06-27T04:39:43.899 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.888+0000 7f6e5f59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e60064730 0x7f6e60064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:43.899 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.727715015411377, stop=False, exit=None, reads=[10] 2020-06-27T04:39:43.900 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.888+0000 7f6e5f59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e60064730 0x7f6e60064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38446/0 (socket says 172.21.15.31:38446) 2020-06-27T04:39:43.900 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.888+0000 7f6e5f59e700 1 -- 172.21.15.31:0/3935300254 learned_addr learned my addr 172.21.15.31:0/3935300254 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:43.900 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.889+0000 7f6e5f59e700 1 -- 172.21.15.31:0/3935300254 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e60065a20 con 0x7f6e60064730 2020-06-27T04:39:43.900 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.889+0000 7f6e5f59e700 1 --2- 172.21.15.31:0/3935300254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e60064730 0x7f6e60064b50 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f6e580032f0 tx=0x7f6e580092b0).ready entity=mon.0 client_cookie=fac88abd1cfd773 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:43.900 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.889+0000 7f6e5e59c700 1 -- 172.21.15.31:0/3935300254 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6e5800bc00 con 0x7f6e60064730 2020-06-27T04:39:43.901 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7279384136199951, stop=False, exit=None, reads=[10] 2020-06-27T04:39:43.901 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.889+0000 7f6e5e59c700 1 -- 172.21.15.31:0/3935300254 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f6e5800bd60 con 0x7f6e60064730 2020-06-27T04:39:43.901 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.889+0000 7f6e5e59c700 1 -- 172.21.15.31:0/3935300254 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6e58010510 con 0x7f6e60064730 2020-06-27T04:39:43.901 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.889+0000 7f6e650a9700 1 -- 172.21.15.31:0/3935300254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e60064730 msgr2=0x7f6e60064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:43.901 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.889+0000 7f6e650a9700 1 --2- 172.21.15.31:0/3935300254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e60064730 0x7f6e60064b50 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f6e580032f0 tx=0x7f6e580092b0).stop 2020-06-27T04:39:43.902 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.889+0000 7f6e650a9700 1 -- 172.21.15.31:0/3935300254 shutdown_connections 2020-06-27T04:39:43.902 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7281620502471924, stop=False, exit=None, reads=[10] 2020-06-27T04:39:43.902 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.889+0000 7f6e650a9700 1 --2- 172.21.15.31:0/3935300254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e60064730 0x7f6e60064b50 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:43.902 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.889+0000 7f6e650a9700 1 -- 172.21.15.31:0/3935300254 >> 172.21.15.31:0/3935300254 conn(0x7f6e6005ffe0 msgr2=0x7f6e60062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:43.902 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.889+0000 7f6e650a9700 1 -- 172.21.15.31:0/3935300254 shutdown_connections 2020-06-27T04:39:43.902 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.889+0000 7f6e650a9700 1 -- 172.21.15.31:0/3935300254 wait complete. 2020-06-27T04:39:43.903 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.890+0000 7f6e650a9700 1 Processor -- start 2020-06-27T04:39:43.903 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.890+0000 7f6e650a9700 1 -- start start 2020-06-27T04:39:43.903 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.891+0000 7f6e650a9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e6007e110 0x7f6e600613e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:43.903 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.891+0000 7f6e650a9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e600618d0 con 0x7f6e6007e110 2020-06-27T04:39:43.903 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7285544872283936, stop=False, exit=None, reads=[10] 2020-06-27T04:39:43.904 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.891+0000 7f6e5f59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e6007e110 0x7f6e600613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:43.904 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.891+0000 7f6e5f59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e6007e110 0x7f6e600613e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38448/0 (socket says 172.21.15.31:38448) 2020-06-27T04:39:43.904 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.891+0000 7f6e5f59e700 1 -- 172.21.15.31:0/1245366340 learned_addr learned my addr 172.21.15.31:0/1245366340 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:43.904 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.891+0000 7f6e5f59e700 1 -- 172.21.15.31:0/1245366340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e60061a10 con 0x7f6e6007e110 2020-06-27T04:39:43.905 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7287781238555908, stop=False, exit=None, reads=[10] 2020-06-27T04:39:43.905 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.891+0000 7f6e5f59e700 1 --2- 172.21.15.31:0/1245366340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e6007e110 0x7f6e600613e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f6e580032f0 tx=0x7f6e580092b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:43.905 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7288818359375, stop=False, exit=None, reads=[10] 2020-06-27T04:39:43.905 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.891+0000 7f6e577fe700 1 -- 172.21.15.31:0/1245366340 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6e58011b70 con 0x7f6e6007e110 2020-06-27T04:39:43.905 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.891+0000 7f6e577fe700 1 -- 172.21.15.31:0/1245366340 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f6e5801b8a0 con 0x7f6e6007e110 2020-06-27T04:39:43.906 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.891+0000 7f6e650a9700 1 -- 172.21.15.31:0/1245366340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e60061c60 con 0x7f6e6007e110 2020-06-27T04:39:43.906 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7291159629821777, stop=False, exit=None, reads=[10] 2020-06-27T04:39:43.906 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.891+0000 7f6e577fe700 1 -- 172.21.15.31:0/1245366340 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6e5801a6b0 con 0x7f6e6007e110 2020-06-27T04:39:43.906 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.892+0000 7f6e650a9700 1 -- 172.21.15.31:0/1245366340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e60062120 con 0x7f6e6007e110 2020-06-27T04:39:43.906 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7292923927307129, stop=False, exit=None, reads=[10] 2020-06-27T04:39:43.907 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.892+0000 7f6e577fe700 1 -- 172.21.15.31:0/1245366340 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7f6e58017040 con 0x7f6e6007e110 2020-06-27T04:39:43.907 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.892+0000 7f6e577fe700 1 -- 172.21.15.31:0/1245366340 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f6e58025980 con 0x7f6e6007e110 2020-06-27T04:39:43.907 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.72939133644104, stop=False, exit=None, reads=[10] 2020-06-27T04:39:43.907 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.893+0000 7f6e650a9700 1 -- 172.21.15.31:0/1245366340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e60057340 con 0x7f6e6007e110 2020-06-27T04:39:43.907 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7303659915924072, stop=False, exit=None, reads=[10] 2020-06-27T04:39:43.908 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.896+0000 7f6e577fe700 1 -- 172.21.15.31:0/1245366340 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67681 (secure 0 0 0) 0x7f6e58015020 con 0x7f6e6007e110 2020-06-27T04:39:43.908 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7339694499969482, stop=False, exit=None, reads=[10] 2020-06-27T04:39:43.972 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:39:43 smithi031 podman[18731]: 2020-06-27 04:39:43.705957807 +0000 UTC m=+0.295762339 container create 5e1b087e86806b1fddeab2e8d05a148ad7d541e91256fc6a92bc3dfb7dff0ef7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.y) 2020-06-27T04:39:43.979 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.971+0000 7f6e650a9700 1 -- 172.21.15.31:0/1245366340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6e60043e80 con 0x7f6e6007e110 2020-06-27T04:39:43.980 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8085458278656006, stop=False, exit=None, reads=[10] 2020-06-27T04:39:43.980 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.971+0000 7f6e577fe700 1 -- 172.21.15.31:0/1245366340 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1222 (secure 0 0 0) 0x7f6e5801b460 con 0x7f6e6007e110 2020-06-27T04:39:43.980 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8088068962097168, stop=False, exit=None, reads=[10] 2020-06-27T04:39:43.980 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-06-27T04:39:43.980 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:43.981 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "12892ae2-b830-11ea-a06d-001a4aab830c", 2020-06-27T04:39:43.981 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2020-06-27T04:39:43.981 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2020-06-27T04:39:43.981 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2020-06-27T04:39:43.981 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2020-06-27T04:39:43.982 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:43.982 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2020-06-27T04:39:43.982 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2020-06-27T04:39:43.982 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2020-06-27T04:39:43.982 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:43.982 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2020-06-27T04:39:43.983 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2020-06-27T04:39:43.983 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:43.983 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 1, 2020-06-27T04:39:43.983 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2020-06-27T04:39:43.983 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-06-27T04:39:43.984 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "pacific", 2020-06-27T04:39:43.984 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2020-06-27T04:39:43.984 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:43.984 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2020-06-27T04:39:43.984 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-06-27T04:39:43.984 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2020-06-27T04:39:43.985 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2020-06-27T04:39:43.985 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2020-06-27T04:39:43.985 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2020-06-27T04:39:43.985 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2020-06-27T04:39:43.985 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2020-06-27T04:39:43.986 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:43.986 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2020-06-27T04:39:43.986 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2020-06-27T04:39:43.986 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2020-06-27T04:39:43.986 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2020-06-27T04:39:43.986 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2020-06-27T04:39:43.987 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2020-06-27T04:39:43.987 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2020-06-27T04:39:43.987 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2020-06-27T04:39:43.987 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2020-06-27T04:39:43.987 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:43.988 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2020-06-27T04:39:43.988 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-06-27T04:39:43.988 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2020-06-27T04:39:43.988 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2020-06-27T04:39:43.988 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:43.988 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2020-06-27T04:39:43.989 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2020-06-27T04:39:43.989 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2020-06-27T04:39:43.989 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2020-06-27T04:39:43.989 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2020-06-27T04:39:43.989 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8105545043945312, stop=False, exit=None, reads=[8] 2020-06-27T04:39:43.989 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2020-06-27T04:39:43.990 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:43.990 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2020-06-27T04:39:43.990 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:43.990 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2020-06-27T04:39:43.990 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-06-27T04:39:43.991 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2020-06-27T04:39:37.261517+0000", 2020-06-27T04:39:43.991 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2020-06-27T04:39:43.991 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:43.991 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2020-06-27T04:39:43.991 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:43.991 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.972+0000 7f6e650a9700 1 -- 172.21.15.31:0/1245366340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e6007e110 msgr2=0x7f6e600613e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:43.992 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.972+0000 7f6e650a9700 1 --2- 172.21.15.31:0/1245366340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e6007e110 0x7f6e600613e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f6e580032f0 tx=0x7f6e580092b0).stop 2020-06-27T04:39:43.992 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.972+0000 7f6e650a9700 1 -- 172.21.15.31:0/1245366340 shutdown_connections 2020-06-27T04:39:43.992 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.972+0000 7f6e650a9700 1 --2- 172.21.15.31:0/1245366340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e6007e110 0x7f6e600613e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:43.992 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.972+0000 7f6e650a9700 1 -- 172.21.15.31:0/1245366340 >> 172.21.15.31:0/1245366340 conn(0x7f6e6005ffe0 msgr2=0x7f6e600624f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:43.992 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.811002254486084, stop=False, exit=None, reads=[8, 10] 2020-06-27T04:39:43.993 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.972+0000 7f6e650a9700 1 -- 172.21.15.31:0/1245366340 shutdown_connections 2020-06-27T04:39:43.993 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:43.972+0000 7f6e650a9700 1 -- 172.21.15.31:0/1245366340 wait complete. 2020-06-27T04:39:43.993 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8110976219177246, stop=False, exit=None, reads=[10] 2020-06-27T04:39:44.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:44 smithi031 bash[18426]: audit 2020-06-27T04:39:43.972720+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.31:0/1245366340' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2020-06-27T04:39:44.473 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:39:44 smithi031 podman[18731]: 2020-06-27 04:39:44.01616333 +0000 UTC m=+0.605967881 container init 5e1b087e86806b1fddeab2e8d05a148ad7d541e91256fc6a92bc3dfb7dff0ef7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.y) 2020-06-27T04:39:44.473 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:39:44 smithi031 podman[18731]: 2020-06-27 04:39:44.062839169 +0000 UTC m=+0.652643699 container start 5e1b087e86806b1fddeab2e8d05a148ad7d541e91256fc6a92bc3dfb7dff0ef7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.y) 2020-06-27T04:39:44.473 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:39:44 smithi031 podman[18731]: 2020-06-27 04:39:44.062915087 +0000 UTC m=+0.652719659 container attach 5e1b087e86806b1fddeab2e8d05a148ad7d541e91256fc6a92bc3dfb7dff0ef7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.y) 2020-06-27T04:39:44.630 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.464371919631958, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:39:44.631 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.4645977020263672, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:39:44.631 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:mgr not available, waiting (1/10)... 2020-06-27T04:39:45.632 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'status', '-f', 'json-pretty'] 2020-06-27T04:39:45.632 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 status -f json-pretty 2020-06-27T04:39:46.269 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.261+0000 7f7140bd8700 1 Processor -- start 2020-06-27T04:39:46.270 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.261+0000 7f7140bd8700 1 -- start start 2020-06-27T04:39:46.270 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.261+0000 7f7140bd8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f713c064730 0x7f713c064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:46.270 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.261+0000 7f7140bd8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0651a0 con 0x7f713c064730 2020-06-27T04:39:46.270 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.261+0000 7f713ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f713c064730 0x7f713c064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:46.270 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6319549083709717, stop=False, exit=None, reads=[10] 2020-06-27T04:39:46.271 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.261+0000 7f713ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f713c064730 0x7f713c064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38454/0 (socket says 172.21.15.31:38454) 2020-06-27T04:39:46.271 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.261+0000 7f713ad9d700 1 -- 172.21.15.31:0/2521928994 learned_addr learned my addr 172.21.15.31:0/2521928994 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:46.271 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.262+0000 7f713ad9d700 1 -- 172.21.15.31:0/2521928994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c065a20 con 0x7f713c064730 2020-06-27T04:39:46.271 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.262+0000 7f713ad9d700 1 --2- 172.21.15.31:0/2521928994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f713c064730 0x7f713c064b50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f712c002f70 tx=0x7f712c006ec0).ready entity=mon.0 client_cookie=4e81398451cac4ed server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:46.271 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.262+0000 7f713a59c700 1 -- 172.21.15.31:0/2521928994 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f712c009980 con 0x7f713c064730 2020-06-27T04:39:46.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.632314920425415, stop=False, exit=None, reads=[10] 2020-06-27T04:39:46.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.262+0000 7f713a59c700 1 -- 172.21.15.31:0/2521928994 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f712c000e90 con 0x7f713c064730 2020-06-27T04:39:46.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.262+0000 7f713a59c700 1 -- 172.21.15.31:0/2521928994 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f712c011c70 con 0x7f713c064730 2020-06-27T04:39:46.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.262+0000 7f7140bd8700 1 -- 172.21.15.31:0/2521928994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f713c064730 msgr2=0x7f713c064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:46.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.262+0000 7f7140bd8700 1 --2- 172.21.15.31:0/2521928994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f713c064730 0x7f713c064b50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f712c002f70 tx=0x7f712c006ec0).stop 2020-06-27T04:39:46.273 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.262+0000 7f7140bd8700 1 -- 172.21.15.31:0/2521928994 shutdown_connections 2020-06-27T04:39:46.273 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6326384544372559, stop=False, exit=None, reads=[10] 2020-06-27T04:39:46.273 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.262+0000 7f7140bd8700 1 --2- 172.21.15.31:0/2521928994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f713c064730 0x7f713c064b50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:46.273 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.262+0000 7f7140bd8700 1 -- 172.21.15.31:0/2521928994 >> 172.21.15.31:0/2521928994 conn(0x7f713c05ffe0 msgr2=0x7f713c062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:46.274 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.262+0000 7f7140bd8700 1 -- 172.21.15.31:0/2521928994 shutdown_connections 2020-06-27T04:39:46.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.262+0000 7f7140bd8700 1 -- 172.21.15.31:0/2521928994 wait complete. 2020-06-27T04:39:46.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.263+0000 7f7140bd8700 1 Processor -- start 2020-06-27T04:39:46.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.263+0000 7f7140bd8700 1 -- start start 2020-06-27T04:39:46.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.263+0000 7f7140bd8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f713c077560 0x7f713c077980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:46.276 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.263+0000 7f7140bd8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c077fd0 con 0x7f713c077560 2020-06-27T04:39:46.276 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6330780982971191, stop=False, exit=None, reads=[10] 2020-06-27T04:39:46.276 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.264+0000 7f713ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f713c077560 0x7f713c077980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:46.276 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.264+0000 7f713ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f713c077560 0x7f713c077980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38456/0 (socket says 172.21.15.31:38456) 2020-06-27T04:39:46.284 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.264+0000 7f713ad9d700 1 -- 172.21.15.31:0/1187892123 learned_addr learned my addr 172.21.15.31:0/1187892123 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:46.284 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.264+0000 7f713ad9d700 1 -- 172.21.15.31:0/1187892123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c078890 con 0x7f713c077560 2020-06-27T04:39:46.285 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6333460807800293, stop=False, exit=None, reads=[10] 2020-06-27T04:39:46.285 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.264+0000 7f713ad9d700 1 --2- 172.21.15.31:0/1187892123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f713c077560 0x7f713c077980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f712c006bb0 tx=0x7f712c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:46.286 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.264+0000 7f7132ffd700 1 -- 172.21.15.31:0/1187892123 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f712c01a820 con 0x7f713c077560 2020-06-27T04:39:46.286 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.264+0000 7f7132ffd700 1 -- 172.21.15.31:0/1187892123 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f712c01adc0 con 0x7f713c077560 2020-06-27T04:39:46.286 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.264+0000 7f7132ffd700 1 -- 172.21.15.31:0/1187892123 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f712c01bcb0 con 0x7f713c077560 2020-06-27T04:39:46.286 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.264+0000 7f7140bd8700 1 -- 172.21.15.31:0/1187892123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c078ae0 con 0x7f713c077560 2020-06-27T04:39:46.286 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6336643695831299, stop=False, exit=None, reads=[10] 2020-06-27T04:39:46.287 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.264+0000 7f7140bd8700 1 -- 172.21.15.31:0/1187892123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c078f10 con 0x7f713c077560 2020-06-27T04:39:46.287 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.265+0000 7f7132ffd700 1 -- 172.21.15.31:0/1187892123 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7f712c00f070 con 0x7f713c077560 2020-06-27T04:39:46.287 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.265+0000 7f7132ffd700 1 -- 172.21.15.31:0/1187892123 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f712c0243c0 con 0x7f713c077560 2020-06-27T04:39:46.287 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6338808536529541, stop=False, exit=None, reads=[10] 2020-06-27T04:39:46.287 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.265+0000 7f7140bd8700 1 -- 172.21.15.31:0/1187892123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c078110 con 0x7f713c077560 2020-06-27T04:39:46.288 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6344866752624512, stop=False, exit=None, reads=[10] 2020-06-27T04:39:46.288 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.267+0000 7f7132ffd700 1 -- 172.21.15.31:0/1187892123 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67681 (secure 0 0 0) 0x7f712c01b610 con 0x7f713c077560 2020-06-27T04:39:46.288 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6366455554962158, stop=False, exit=None, reads=[10] 2020-06-27T04:39:46.352 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.342+0000 7f7140bd8700 1 -- 172.21.15.31:0/1187892123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f713c057340 con 0x7f713c077560 2020-06-27T04:39:46.352 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7113845348358154, stop=False, exit=None, reads=[10] 2020-06-27T04:39:46.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.343+0000 7f7132ffd700 1 -- 172.21.15.31:0/1187892123 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1222 (secure 0 0 0) 0x7f712c01a980 con 0x7f713c077560 2020-06-27T04:39:46.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.711674690246582, stop=False, exit=None, reads=[10] 2020-06-27T04:39:46.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-06-27T04:39:46.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:46.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "12892ae2-b830-11ea-a06d-001a4aab830c", 2020-06-27T04:39:46.355 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2020-06-27T04:39:46.355 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2020-06-27T04:39:46.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2020-06-27T04:39:46.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2020-06-27T04:39:46.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:46.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2020-06-27T04:39:46.357 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2020-06-27T04:39:46.357 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2020-06-27T04:39:46.357 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:46.357 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2020-06-27T04:39:46.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2020-06-27T04:39:46.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:46.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 4, 2020-06-27T04:39:46.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2020-06-27T04:39:46.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-06-27T04:39:46.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "pacific", 2020-06-27T04:39:46.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2020-06-27T04:39:46.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:46.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2020-06-27T04:39:46.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-06-27T04:39:46.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2020-06-27T04:39:46.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2020-06-27T04:39:46.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2020-06-27T04:39:46.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2020-06-27T04:39:46.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2020-06-27T04:39:46.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2020-06-27T04:39:46.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:46.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2020-06-27T04:39:46.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2020-06-27T04:39:46.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2020-06-27T04:39:46.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2020-06-27T04:39:46.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2020-06-27T04:39:46.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2020-06-27T04:39:46.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2020-06-27T04:39:46.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2020-06-27T04:39:46.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2020-06-27T04:39:46.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:46.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2020-06-27T04:39:46.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-06-27T04:39:46.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2020-06-27T04:39:46.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2020-06-27T04:39:46.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:46.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2020-06-27T04:39:46.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2020-06-27T04:39:46.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2020-06-27T04:39:46.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2020-06-27T04:39:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2020-06-27T04:39:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7137265205383301, stop=False, exit=None, reads=[8] 2020-06-27T04:39:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2020-06-27T04:39:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2020-06-27T04:39:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:46.367 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2020-06-27T04:39:46.367 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-06-27T04:39:46.367 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2020-06-27T04:39:37.261517+0000", 2020-06-27T04:39:46.367 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2020-06-27T04:39:46.367 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:46.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2020-06-27T04:39:46.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:46.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.344+0000 7f7140bd8700 1 -- 172.21.15.31:0/1187892123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f713c077560 msgr2=0x7f713c077980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:46.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.344+0000 7f7140bd8700 1 --2- 172.21.15.31:0/1187892123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f713c077560 0x7f713c077980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f712c006bb0 tx=0x7f712c006ec0).stop 2020-06-27T04:39:46.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.344+0000 7f7140bd8700 1 -- 172.21.15.31:0/1187892123 shutdown_connections 2020-06-27T04:39:46.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.344+0000 7f7140bd8700 1 --2- 172.21.15.31:0/1187892123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f713c077560 0x7f713c077980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:46.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.344+0000 7f7140bd8700 1 -- 172.21.15.31:0/1187892123 >> 172.21.15.31:0/1187892123 conn(0x7f713c05ffe0 msgr2=0x7f713c062460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:46.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7144503593444824, stop=False, exit=None, reads=[8, 10] 2020-06-27T04:39:46.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.344+0000 7f7140bd8700 1 -- 172.21.15.31:0/1187892123 shutdown_connections 2020-06-27T04:39:46.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:46.344+0000 7f7140bd8700 1 -- 172.21.15.31:0/1187892123 wait complete. 2020-06-27T04:39:46.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7146224975585938, stop=False, exit=None, reads=[10] 2020-06-27T04:39:46.424 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:46 smithi031 bash[18426]: audit 2020-06-27T04:39:46.344004+0000 mon.a (mon.0) 9 : audit [DBG] from='client.? 172.21.15.31:0/1187892123' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2020-06-27T04:39:46.867 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.2329306602478027, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:39:46.868 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.2330944538116455, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:39:46.868 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:mgr not available, waiting (2/10)... 2020-06-27T04:39:47.869 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'status', '-f', 'json-pretty'] 2020-06-27T04:39:47.869 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 status -f json-pretty 2020-06-27T04:39:48.378 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:48 smithi031 bash[18426]: cluster 2020-06-27T04:39:47.914033+0000 mon.a (mon.0) 10 : cluster [INF] Activating manager daemon y 2020-06-27T04:39:48.378 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:48 smithi031 bash[18426]: cluster 2020-06-27T04:39:47.916409+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00247173s) 2020-06-27T04:39:48.378 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:48 smithi031 bash[18426]: audit 2020-06-27T04:39:47.917025+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14102 172.21.15.31:0/1967956069' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-06-27T04:39:48.379 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:48 smithi031 bash[18426]: audit 2020-06-27T04:39:47.917202+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14102 172.21.15.31:0/1967956069' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-06-27T04:39:48.379 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:48 smithi031 bash[18426]: audit 2020-06-27T04:39:47.917331+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14102 172.21.15.31:0/1967956069' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-06-27T04:39:48.379 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:48 smithi031 bash[18426]: audit 2020-06-27T04:39:47.917691+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14102 172.21.15.31:0/1967956069' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2020-06-27T04:39:48.379 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:48 smithi031 bash[18426]: audit 2020-06-27T04:39:47.917933+0000 mon.a (mon.0) 16 : audit [DBG] from='mgr.14102 172.21.15.31:0/1967956069' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-06-27T04:39:48.379 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:48 smithi031 bash[18426]: cluster 2020-06-27T04:39:47.919864+0000 mon.a (mon.0) 17 : cluster [INF] Manager daemon y is now available 2020-06-27T04:39:48.486 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.477+0000 7fcdfa2b3700 1 Processor -- start 2020-06-27T04:39:48.486 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.477+0000 7fcdfa2b3700 1 -- start start 2020-06-27T04:39:48.486 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.477+0000 7fcdfa2b3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf4064730 0x7fcdf4064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:48.486 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.477+0000 7fcdfa2b3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf40651a0 con 0x7fcdf4064730 2020-06-27T04:39:48.487 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.478+0000 7fcdf8850700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf4064730 0x7fcdf4064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:48.487 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6119716167449951, stop=False, exit=None, reads=[10] 2020-06-27T04:39:48.487 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.478+0000 7fcdf8850700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf4064730 0x7fcdf4064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38472/0 (socket says 172.21.15.31:38472) 2020-06-27T04:39:48.487 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.478+0000 7fcdf8850700 1 -- 172.21.15.31:0/4249199750 learned_addr learned my addr 172.21.15.31:0/4249199750 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:48.487 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.478+0000 7fcdf8850700 1 -- 172.21.15.31:0/4249199750 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf4065a20 con 0x7fcdf4064730 2020-06-27T04:39:48.488 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.478+0000 7fcdf8850700 1 --2- 172.21.15.31:0/4249199750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf4064730 0x7fcdf4064b50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fcde4002f70 tx=0x7fcde4006ec0).ready entity=mon.0 client_cookie=f03db0a4833d059d server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:48.488 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.478+0000 7fcdf37fe700 1 -- 172.21.15.31:0/4249199750 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fcde4009980 con 0x7fcdf4064730 2020-06-27T04:39:48.488 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6121811866760254, stop=False, exit=None, reads=[10] 2020-06-27T04:39:48.488 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.478+0000 7fcdf37fe700 1 -- 172.21.15.31:0/4249199750 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fcde4000e90 con 0x7fcdf4064730 2020-06-27T04:39:48.488 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.478+0000 7fcdf37fe700 1 -- 172.21.15.31:0/4249199750 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fcde4011c70 con 0x7fcdf4064730 2020-06-27T04:39:48.489 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.478+0000 7fcdfa2b3700 1 -- 172.21.15.31:0/4249199750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf4064730 msgr2=0x7fcdf4064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:48.489 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.478+0000 7fcdfa2b3700 1 --2- 172.21.15.31:0/4249199750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf4064730 0x7fcdf4064b50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fcde4002f70 tx=0x7fcde4006ec0).stop 2020-06-27T04:39:48.489 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.478+0000 7fcdfa2b3700 1 -- 172.21.15.31:0/4249199750 shutdown_connections 2020-06-27T04:39:48.489 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6123640537261963, stop=False, exit=None, reads=[10] 2020-06-27T04:39:48.489 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.478+0000 7fcdfa2b3700 1 --2- 172.21.15.31:0/4249199750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf4064730 0x7fcdf4064b50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:48.490 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.478+0000 7fcdfa2b3700 1 -- 172.21.15.31:0/4249199750 >> 172.21.15.31:0/4249199750 conn(0x7fcdf405ffe0 msgr2=0x7fcdf4062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:48.490 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.478+0000 7fcdfa2b3700 1 -- 172.21.15.31:0/4249199750 shutdown_connections 2020-06-27T04:39:48.490 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.478+0000 7fcdfa2b3700 1 -- 172.21.15.31:0/4249199750 wait complete. 2020-06-27T04:39:48.490 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.479+0000 7fcdfa2b3700 1 Processor -- start 2020-06-27T04:39:48.490 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.479+0000 7fcdfa2b3700 1 -- start start 2020-06-27T04:39:48.490 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6125936508178711, stop=False, exit=None, reads=[10] 2020-06-27T04:39:48.491 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.480+0000 7fcdfa2b3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf40775a0 0x7fcdf40779c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:48.491 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.480+0000 7fcdfa2b3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf4078010 con 0x7fcdf40775a0 2020-06-27T04:39:48.491 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6126906871795654, stop=False, exit=None, reads=[10] 2020-06-27T04:39:48.491 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.480+0000 7fcdf8850700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf40775a0 0x7fcdf40779c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:48.491 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.480+0000 7fcdf8850700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf40775a0 0x7fcdf40779c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38474/0 (socket says 172.21.15.31:38474) 2020-06-27T04:39:48.492 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.480+0000 7fcdf8850700 1 -- 172.21.15.31:0/1064516884 learned_addr learned my addr 172.21.15.31:0/1064516884 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:48.492 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.612802267074585, stop=False, exit=None, reads=[10] 2020-06-27T04:39:48.492 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.480+0000 7fcdf8850700 1 -- 172.21.15.31:0/1064516884 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf40788d0 con 0x7fcdf40775a0 2020-06-27T04:39:48.492 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6129879951477051, stop=False, exit=None, reads=[10] 2020-06-27T04:39:48.492 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.480+0000 7fcdf8850700 1 --2- 172.21.15.31:0/1064516884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf40775a0 0x7fcdf40779c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fcde4006bb0 tx=0x7fcde4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:48.493 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6131343841552734, stop=False, exit=None, reads=[10] 2020-06-27T04:39:48.493 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.480+0000 7fcdf0ff9700 1 -- 172.21.15.31:0/1064516884 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fcde401a820 con 0x7fcdf40775a0 2020-06-27T04:39:48.493 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.613269567489624, stop=False, exit=None, reads=[10] 2020-06-27T04:39:48.493 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.480+0000 7fcdfa2b3700 1 -- 172.21.15.31:0/1064516884 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf4078b20 con 0x7fcdf40775a0 2020-06-27T04:39:48.493 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.480+0000 7fcdf0ff9700 1 -- 172.21.15.31:0/1064516884 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fcde401adc0 con 0x7fcdf40775a0 2020-06-27T04:39:48.494 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.480+0000 7fcdf0ff9700 1 -- 172.21.15.31:0/1064516884 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fcde401bcb0 con 0x7fcdf40775a0 2020-06-27T04:39:48.494 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.480+0000 7fcdfa2b3700 1 -- 172.21.15.31:0/1064516884 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf4078f50 con 0x7fcdf40775a0 2020-06-27T04:39:48.494 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6134650707244873, stop=False, exit=None, reads=[10] 2020-06-27T04:39:48.494 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.481+0000 7fcdfa2b3700 1 -- 172.21.15.31:0/1064516884 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf4078150 con 0x7fcdf40775a0 2020-06-27T04:39:48.495 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6142928600311279, stop=False, exit=None, reads=[10] 2020-06-27T04:39:48.495 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.481+0000 7fcdf0ff9700 1 -- 172.21.15.31:0/1064516884 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 2) v1 ==== 31624+0+0 (secure 0 0 0) 0x7fcde400f070 con 0x7fcdf40775a0 2020-06-27T04:39:48.495 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6144077777862549, stop=False, exit=None, reads=[10] 2020-06-27T04:39:48.495 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.481+0000 7fcdf0ff9700 1 -- 172.21.15.31:0/1064516884 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 1130+0+0 (secure 0 0 0) 0x7fcde403b890 con 0x7fcdf40775a0 2020-06-27T04:39:48.495 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6145057678222656, stop=False, exit=None, reads=[10] 2020-06-27T04:39:48.496 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.483+0000 7fcdf0ff9700 1 -- 172.21.15.31:0/1064516884 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67681 (secure 0 0 0) 0x7fcde401b610 con 0x7fcdf40775a0 2020-06-27T04:39:48.496 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6165146827697754, stop=False, exit=None, reads=[10] 2020-06-27T04:39:48.566 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.557+0000 7fcdfa2b3700 1 -- 172.21.15.31:0/1064516884 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fcdf4057340 con 0x7fcdf40775a0 2020-06-27T04:39:48.566 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.690385103225708, stop=False, exit=None, reads=[10] 2020-06-27T04:39:48.566 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.558+0000 7fcdf0ff9700 1 -- 172.21.15.31:0/1064516884 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1222 (secure 0 0 0) 0x7fcde400f300 con 0x7fcdf40775a0 2020-06-27T04:39:48.567 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6906037330627441, stop=False, exit=None, reads=[10] 2020-06-27T04:39:48.567 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-06-27T04:39:48.567 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:48.567 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "12892ae2-b830-11ea-a06d-001a4aab830c", 2020-06-27T04:39:48.567 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2020-06-27T04:39:48.568 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2020-06-27T04:39:48.568 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2020-06-27T04:39:48.568 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2020-06-27T04:39:48.568 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:48.568 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2020-06-27T04:39:48.569 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2020-06-27T04:39:48.569 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2020-06-27T04:39:48.569 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:48.569 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2020-06-27T04:39:48.569 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2020-06-27T04:39:48.570 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:48.570 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 6, 2020-06-27T04:39:48.570 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2020-06-27T04:39:48.570 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-06-27T04:39:48.570 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "pacific", 2020-06-27T04:39:48.570 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2020-06-27T04:39:48.571 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:48.571 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2020-06-27T04:39:48.571 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 2, 2020-06-27T04:39:48.571 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2020-06-27T04:39:48.571 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2020-06-27T04:39:48.571 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2020-06-27T04:39:48.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2020-06-27T04:39:48.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2020-06-27T04:39:48.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2020-06-27T04:39:48.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:48.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2020-06-27T04:39:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2020-06-27T04:39:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2020-06-27T04:39:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2020-06-27T04:39:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2020-06-27T04:39:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2020-06-27T04:39:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2020-06-27T04:39:48.574 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2020-06-27T04:39:48.574 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2020-06-27T04:39:48.574 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:48.574 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2020-06-27T04:39:48.574 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-06-27T04:39:48.575 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2020-06-27T04:39:48.575 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2020-06-27T04:39:48.575 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:48.575 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2020-06-27T04:39:48.575 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2020-06-27T04:39:48.575 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2020-06-27T04:39:48.576 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2020-06-27T04:39:48.576 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2020-06-27T04:39:48.576 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6919219493865967, stop=False, exit=None, reads=[8] 2020-06-27T04:39:48.576 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2020-06-27T04:39:48.576 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:48.576 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2020-06-27T04:39:48.577 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:48.577 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2020-06-27T04:39:48.577 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-06-27T04:39:48.577 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2020-06-27T04:39:37.261517+0000", 2020-06-27T04:39:48.577 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2020-06-27T04:39:48.578 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:48.578 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2020-06-27T04:39:48.578 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:48.578 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.558+0000 7fcdfa2b3700 1 -- 172.21.15.31:0/1064516884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf40775a0 msgr2=0x7fcdf40779c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:48.578 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.558+0000 7fcdfa2b3700 1 --2- 172.21.15.31:0/1064516884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf40775a0 0x7fcdf40779c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fcde4006bb0 tx=0x7fcde4006ec0).stop 2020-06-27T04:39:48.578 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.558+0000 7fcdfa2b3700 1 -- 172.21.15.31:0/1064516884 shutdown_connections 2020-06-27T04:39:48.579 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.558+0000 7fcdfa2b3700 1 --2- 172.21.15.31:0/1064516884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf40775a0 0x7fcdf40779c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:48.579 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.558+0000 7fcdfa2b3700 1 -- 172.21.15.31:0/1064516884 >> 172.21.15.31:0/1064516884 conn(0x7fcdf405ffe0 msgr2=0x7fcdf4061c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:48.579 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6923236846923828, stop=False, exit=None, reads=[8, 10] 2020-06-27T04:39:48.579 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.558+0000 7fcdfa2b3700 1 -- 172.21.15.31:0/1064516884 shutdown_connections 2020-06-27T04:39:48.579 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:48.558+0000 7fcdfa2b3700 1 -- 172.21.15.31:0/1064516884 wait complete. 2020-06-27T04:39:48.580 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.692425012588501, stop=False, exit=None, reads=[10] 2020-06-27T04:39:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.1256182193756104, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:39:48.999 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.1257812976837158, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:39:48.999 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:mgr not available, waiting (3/10)... 2020-06-27T04:39:49.997 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'status', '-f', 'json-pretty'] 2020-06-27T04:39:49.998 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 status -f json-pretty 2020-06-27T04:39:50.555 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:50 smithi031 bash[18426]: audit 2020-06-27T04:39:47.930331+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14102 172.21.15.31:0/1967956069' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2020-06-27T04:39:50.556 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:50 smithi031 bash[18426]: audit 2020-06-27T04:39:48.371710+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14102 172.21.15.31:0/1967956069' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2020-06-27T04:39:50.556 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:50 smithi031 bash[18426]: cluster 2020-06-27T04:39:48.371759+0000 mon.a (mon.0) 20 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2020-06-27T04:39:50.556 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:50 smithi031 bash[18426]: audit 2020-06-27T04:39:48.373180+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14102 172.21.15.31:0/1967956069' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2020-06-27T04:39:50.557 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:50 smithi031 bash[18426]: audit 2020-06-27T04:39:48.377126+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.14102 172.21.15.31:0/1967956069' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"afec4806-b2ed-452c-84b7-c9b9e555d455"}]: dispatch 2020-06-27T04:39:50.557 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:50 smithi031 bash[18426]: audit 2020-06-27T04:39:48.381825+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14102 172.21.15.31:0/1967956069' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"afec4806-b2ed-452c-84b7-c9b9e555d455"}]': finished 2020-06-27T04:39:50.557 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:50 smithi031 bash[18426]: audit 2020-06-27T04:39:48.382284+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14102 172.21.15.31:0/1967956069' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"4d8c10d8-4f56-44cf-a8d8-10bc50d2eee9"}]: dispatch 2020-06-27T04:39:50.557 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:50 smithi031 bash[18426]: audit 2020-06-27T04:39:48.386704+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14102 172.21.15.31:0/1967956069' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"4d8c10d8-4f56-44cf-a8d8-10bc50d2eee9"}]': finished 2020-06-27T04:39:50.557 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:50 smithi031 bash[18426]: audit 2020-06-27T04:39:48.559063+0000 mon.a (mon.0) 26 : audit [DBG] from='client.? 172.21.15.31:0/1064516884' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2020-06-27T04:39:50.558 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:50 smithi031 bash[18426]: cluster 2020-06-27T04:39:48.918901+0000 mon.a (mon.0) 27 : cluster [DBG] mgrmap e3: y(active, since 1.00497s) 2020-06-27T04:39:50.558 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:50 smithi031 bash[18426]: audit 2020-06-27T04:39:49.372073+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.14102 172.21.15.31:0/1967956069' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2020-06-27T04:39:50.558 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:50 smithi031 bash[18426]: cluster 2020-06-27T04:39:49.372136+0000 mon.a (mon.0) 29 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2020-06-27T04:39:50.558 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:50 smithi031 bash[18426]: audit 2020-06-27T04:39:49.374065+0000 mon.a (mon.0) 30 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2020-06-27T04:39:50.558 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:50 smithi031 bash[18426]: audit 2020-06-27T04:39:50.248322+0000 mon.a (mon.0) 31 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2020-06-27T04:39:50.652 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.643+0000 7f816f3c7700 1 Processor -- start 2020-06-27T04:39:50.653 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.644+0000 7f816f3c7700 1 -- start start 2020-06-27T04:39:50.653 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.644+0000 7f816f3c7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8168064730 0x7f8168064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:50.653 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.644+0000 7f816f3c7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81680651a0 con 0x7f8168064730 2020-06-27T04:39:50.653 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.644+0000 7f816d964700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8168064730 0x7f8168064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:50.654 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6498246192932129, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.654 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.644+0000 7f816d964700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8168064730 0x7f8168064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38488/0 (socket says 172.21.15.31:38488) 2020-06-27T04:39:50.655 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.644+0000 7f816d964700 1 -- 172.21.15.31:0/936853789 learned_addr learned my addr 172.21.15.31:0/936853789 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:50.655 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.644+0000 7f816d964700 1 -- 172.21.15.31:0/936853789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8168065a20 con 0x7f8168064730 2020-06-27T04:39:50.655 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.644+0000 7f816d964700 1 --2- 172.21.15.31:0/936853789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8168064730 0x7f8168064b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f81640032f0 tx=0x7f81640092b0).ready entity=mon.0 client_cookie=963fe55ba0d8849c server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:50.655 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.644+0000 7f816c962700 1 -- 172.21.15.31:0/936853789 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f816400bc00 con 0x7f8168064730 2020-06-27T04:39:50.655 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6500401496887207, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.656 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.645+0000 7f816c962700 1 -- 172.21.15.31:0/936853789 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f816400bd60 con 0x7f8168064730 2020-06-27T04:39:50.656 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.645+0000 7f816c962700 1 -- 172.21.15.31:0/936853789 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f8164010510 con 0x7f8168064730 2020-06-27T04:39:50.656 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.645+0000 7f816f3c7700 1 -- 172.21.15.31:0/936853789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8168064730 msgr2=0x7f8168064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:50.656 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.645+0000 7f816f3c7700 1 --2- 172.21.15.31:0/936853789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8168064730 0x7f8168064b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f81640032f0 tx=0x7f81640092b0).stop 2020-06-27T04:39:50.656 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.645+0000 7f816f3c7700 1 -- 172.21.15.31:0/936853789 shutdown_connections 2020-06-27T04:39:50.657 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6502282619476318, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.657 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.645+0000 7f816f3c7700 1 --2- 172.21.15.31:0/936853789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8168064730 0x7f8168064b50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:50.657 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.645+0000 7f816f3c7700 1 -- 172.21.15.31:0/936853789 >> 172.21.15.31:0/936853789 conn(0x7f816805ffe0 msgr2=0x7f8168062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:50.657 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.645+0000 7f816f3c7700 1 -- 172.21.15.31:0/936853789 shutdown_connections 2020-06-27T04:39:50.657 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.645+0000 7f816f3c7700 1 -- 172.21.15.31:0/936853789 wait complete. 2020-06-27T04:39:50.658 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.646+0000 7f816f3c7700 1 Processor -- start 2020-06-27T04:39:50.658 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.646+0000 7f816f3c7700 1 -- start start 2020-06-27T04:39:50.658 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6504454612731934, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.658 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.646+0000 7f816f3c7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8168061fc0 0x7f816807b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:50.658 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.646+0000 7f816f3c7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816807b9a0 con 0x7f8168061fc0 2020-06-27T04:39:50.659 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6505732536315918, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.659 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.646+0000 7f816d964700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8168061fc0 0x7f816807b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:50.659 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.646+0000 7f816d964700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8168061fc0 0x7f816807b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38490/0 (socket says 172.21.15.31:38490) 2020-06-27T04:39:50.659 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.646+0000 7f816d964700 1 -- 172.21.15.31:0/3335795334 learned_addr learned my addr 172.21.15.31:0/3335795334 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:50.659 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6506917476654053, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.659 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.646+0000 7f816d964700 1 -- 172.21.15.31:0/3335795334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816807bae0 con 0x7f8168061fc0 2020-06-27T04:39:50.660 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6508398056030273, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.660 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.646+0000 7f816d964700 1 --2- 172.21.15.31:0/3335795334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8168061fc0 0x7f816807b350 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f81640032f0 tx=0x7f81640092b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:50.666 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6509647369384766, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.666 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.647+0000 7f815dffb700 1 -- 172.21.15.31:0/3335795334 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f816401b460 con 0x7f8168061fc0 2020-06-27T04:39:50.666 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6512143611907959, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.666 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.647+0000 7f816f3c7700 1 -- 172.21.15.31:0/3335795334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816807bd30 con 0x7f8168061fc0 2020-06-27T04:39:50.666 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.647+0000 7f815dffb700 1 -- 172.21.15.31:0/3335795334 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f816401ba00 con 0x7f8168061fc0 2020-06-27T04:39:50.667 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.647+0000 7f815dffb700 1 -- 172.21.15.31:0/3335795334 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f816401a6b0 con 0x7f8168061fc0 2020-06-27T04:39:50.668 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6514434814453125, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.668 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.647+0000 7f816f3c7700 1 -- 172.21.15.31:0/3335795334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816807c140 con 0x7f8168061fc0 2020-06-27T04:39:50.669 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6515190601348877, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.669 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.647+0000 7f815dffb700 1 -- 172.21.15.31:0/3335795334 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 31779+0+0 (secure 0 0 0) 0x7f8164017040 con 0x7f8168061fc0 2020-06-27T04:39:50.669 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6519625186920166, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.669 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.648+0000 7f815dffb700 1 --2- 172.21.15.31:0/3335795334 >> v2:172.21.15.31:6800/769686724 conn(0x7f814402aa30 0x7f814402cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:50.669 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6521220207214355, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.670 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.648+0000 7f815dffb700 1 -- 172.21.15.31:0/3335795334 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1154+0+0 (secure 0 0 0) 0x7f816403bee0 con 0x7f8168061fc0 2020-06-27T04:39:50.670 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.648+0000 7f816d163700 1 --2- 172.21.15.31:0/3335795334 >> v2:172.21.15.31:6800/769686724 conn(0x7f814402aa30 0x7f814402cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:50.671 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6523349285125732, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.672 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.648+0000 7f816f3c7700 1 -- 172.21.15.31:0/3335795334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8168057340 con 0x7f8168061fc0 2020-06-27T04:39:50.672 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6524202823638916, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.672 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.648+0000 7f816d163700 1 --2- 172.21.15.31:0/3335795334 >> v2:172.21.15.31:6800/769686724 conn(0x7f814402aa30 0x7f814402cef0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f8158002f70 tx=0x7f8158006b20).ready entity=mgr.14102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:50.672 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6526198387145996, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.673 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.652+0000 7f815dffb700 1 -- 172.21.15.31:0/3335795334 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f8164019d20 con 0x7f8168061fc0 2020-06-27T04:39:50.673 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6565144062042236, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.872 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.867+0000 7f816f3c7700 1 -- 172.21.15.31:0/3335795334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f8168043e80 con 0x7f8168061fc0 2020-06-27T04:39:50.873 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8720183372497559, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.873 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.868+0000 7f815dffb700 1 -- 172.21.15.31:0/3335795334 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1221 (secure 0 0 0) 0x7f8164019b40 con 0x7f8168061fc0 2020-06-27T04:39:50.873 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8722269535064697, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.873 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-06-27T04:39:50.874 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:50.874 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "12892ae2-b830-11ea-a06d-001a4aab830c", 2020-06-27T04:39:50.874 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2020-06-27T04:39:50.874 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2020-06-27T04:39:50.874 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2020-06-27T04:39:50.875 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2020-06-27T04:39:50.875 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:50.875 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2020-06-27T04:39:50.875 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2020-06-27T04:39:50.875 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2020-06-27T04:39:50.875 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2020-06-27T04:39:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2020-06-27T04:39:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 8, 2020-06-27T04:39:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2020-06-27T04:39:50.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-06-27T04:39:50.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "pacific", 2020-06-27T04:39:50.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2020-06-27T04:39:50.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:50.882 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2020-06-27T04:39:50.882 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 3, 2020-06-27T04:39:50.882 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2020-06-27T04:39:50.882 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2020-06-27T04:39:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2020-06-27T04:39:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2020-06-27T04:39:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2020-06-27T04:39:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2020-06-27T04:39:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2020-06-27T04:39:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2020-06-27T04:39:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2020-06-27T04:39:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2020-06-27T04:39:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2020-06-27T04:39:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2020-06-27T04:39:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2020-06-27T04:39:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2020-06-27T04:39:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2020-06-27T04:39:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2020-06-27T04:39:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-06-27T04:39:50.886 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2020-06-27T04:39:50.886 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2020-06-27T04:39:50.886 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:50.886 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2020-06-27T04:39:50.886 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2020-06-27T04:39:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2020-06-27T04:39:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2020-06-27T04:39:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2020-06-27T04:39:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.873326301574707, stop=False, exit=None, reads=[8] 2020-06-27T04:39:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2020-06-27T04:39:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2020-06-27T04:39:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2020-06-27T04:39:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-06-27T04:39:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2020-06-27T04:39:37.261517+0000", 2020-06-27T04:39:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2020-06-27T04:39:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2020-06-27T04:39:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8736097812652588, stop=False, exit=None, reads=[8] 2020-06-27T04:39:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.870+0000 7f816f3c7700 1 -- 172.21.15.31:0/3335795334 >> v2:172.21.15.31:6800/769686724 conn(0x7f814402aa30 msgr2=0x7f814402cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:50.890 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.870+0000 7f816f3c7700 1 --2- 172.21.15.31:0/3335795334 >> v2:172.21.15.31:6800/769686724 conn(0x7f814402aa30 0x7f814402cef0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f8158002f70 tx=0x7f8158006b20).stop 2020-06-27T04:39:50.890 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.870+0000 7f816f3c7700 1 -- 172.21.15.31:0/3335795334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8168061fc0 msgr2=0x7f816807b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:50.890 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.870+0000 7f816f3c7700 1 --2- 172.21.15.31:0/3335795334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8168061fc0 0x7f816807b350 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f81640032f0 tx=0x7f81640092b0).stop 2020-06-27T04:39:50.890 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8743643760681152, stop=False, exit=None, reads=[10] 2020-06-27T04:39:50.890 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.870+0000 7f816f3c7700 1 -- 172.21.15.31:0/3335795334 shutdown_connections 2020-06-27T04:39:50.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.870+0000 7f816f3c7700 1 --2- 172.21.15.31:0/3335795334 >> v2:172.21.15.31:6800/769686724 conn(0x7f814402aa30 0x7f814402cef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:50.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.870+0000 7f816f3c7700 1 --2- 172.21.15.31:0/3335795334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8168061fc0 0x7f816807b350 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:50.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.870+0000 7f816f3c7700 1 -- 172.21.15.31:0/3335795334 >> 172.21.15.31:0/3335795334 conn(0x7f816805ffe0 msgr2=0x7f8168062460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:50.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.870+0000 7f816f3c7700 1 -- 172.21.15.31:0/3335795334 shutdown_connections 2020-06-27T04:39:50.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:50.870+0000 7f816f3c7700 1 -- 172.21.15.31:0/3335795334 wait complete. 2020-06-27T04:39:50.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8747007846832275, stop=False, exit=None, reads=[10] 2020-06-27T04:39:51.316 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.3174002170562744, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:39:51.317 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.317565679550171, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:39:51.317 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:mgr is available 2020-06-27T04:39:51.317 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Enabling cephadm module... 2020-06-27T04:39:51.318 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'mgr', 'module', 'enable', 'cephadm'] 2020-06-27T04:39:51.318 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 mgr module enable cephadm 2020-06-27T04:39:51.589 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:51 smithi031 bash[18426]: cluster 2020-06-27T04:39:50.373500+0000 mon.a (mon.0) 32 : cluster [DBG] mgrmap e4: y(active, since 2s) 2020-06-27T04:39:51.589 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:51 smithi031 bash[18426]: audit 2020-06-27T04:39:50.869189+0000 mon.a (mon.0) 33 : audit [DBG] from='client.? 172.21.15.31:0/3335795334' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2020-06-27T04:39:51.911 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.902+0000 7fdf1f537700 1 Processor -- start 2020-06-27T04:39:51.912 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.902+0000 7fdf1f537700 1 -- start start 2020-06-27T04:39:51.912 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.902+0000 7fdf1f537700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf18064730 0x7fdf18064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:51.912 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.902+0000 7fdf1f537700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf180651a0 con 0x7fdf18064730 2020-06-27T04:39:51.912 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.902+0000 7fdf1dad4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf18064730 0x7fdf18064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:51.912 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.5900137424468994, stop=False, exit=None, reads=[10] 2020-06-27T04:39:51.913 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.902+0000 7fdf1dad4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf18064730 0x7fdf18064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38494/0 (socket says 172.21.15.31:38494) 2020-06-27T04:39:51.913 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.902+0000 7fdf1dad4700 1 -- 172.21.15.31:0/1361939329 learned_addr learned my addr 172.21.15.31:0/1361939329 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:51.913 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.903+0000 7fdf1dad4700 1 -- 172.21.15.31:0/1361939329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf18065a20 con 0x7fdf18064730 2020-06-27T04:39:51.913 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.903+0000 7fdf1dad4700 1 --2- 172.21.15.31:0/1361939329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf18064730 0x7fdf18064b50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fdf080032f0 tx=0x7fdf080092b0).ready entity=mon.0 client_cookie=17a1ebaf30694920 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:51.913 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.903+0000 7fdf1cad2700 1 -- 172.21.15.31:0/1361939329 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fdf0800bc00 con 0x7fdf18064730 2020-06-27T04:39:51.914 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.5903923511505127, stop=False, exit=None, reads=[10] 2020-06-27T04:39:51.914 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.903+0000 7fdf1cad2700 1 -- 172.21.15.31:0/1361939329 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fdf0800bd60 con 0x7fdf18064730 2020-06-27T04:39:51.914 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.903+0000 7fdf1cad2700 1 -- 172.21.15.31:0/1361939329 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fdf08010510 con 0x7fdf18064730 2020-06-27T04:39:51.914 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.903+0000 7fdf1f537700 1 -- 172.21.15.31:0/1361939329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf18064730 msgr2=0x7fdf18064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:51.914 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.903+0000 7fdf1f537700 1 --2- 172.21.15.31:0/1361939329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf18064730 0x7fdf18064b50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fdf080032f0 tx=0x7fdf080092b0).stop 2020-06-27T04:39:51.915 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.903+0000 7fdf1f537700 1 -- 172.21.15.31:0/1361939329 shutdown_connections 2020-06-27T04:39:51.915 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.5906739234924316, stop=False, exit=None, reads=[10] 2020-06-27T04:39:51.919 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.903+0000 7fdf1f537700 1 --2- 172.21.15.31:0/1361939329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf18064730 0x7fdf18064b50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:51.919 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.903+0000 7fdf1f537700 1 -- 172.21.15.31:0/1361939329 >> 172.21.15.31:0/1361939329 conn(0x7fdf1805ffe0 msgr2=0x7fdf18062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:51.920 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.903+0000 7fdf1f537700 1 -- 172.21.15.31:0/1361939329 shutdown_connections 2020-06-27T04:39:51.920 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.903+0000 7fdf1f537700 1 -- 172.21.15.31:0/1361939329 wait complete. 2020-06-27T04:39:51.920 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.904+0000 7fdf1f537700 1 Processor -- start 2020-06-27T04:39:51.921 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.904+0000 7fdf1f537700 1 -- start start 2020-06-27T04:39:51.923 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.904+0000 7fdf1f537700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf18078be0 0x7fdf18079000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:51.923 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.904+0000 7fdf1f537700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf18079650 con 0x7fdf18078be0 2020-06-27T04:39:51.923 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.5909733772277832, stop=False, exit=None, reads=[10] 2020-06-27T04:39:51.923 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.904+0000 7fdf1dad4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf18078be0 0x7fdf18079000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:51.924 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.904+0000 7fdf1dad4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf18078be0 0x7fdf18079000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38496/0 (socket says 172.21.15.31:38496) 2020-06-27T04:39:51.924 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.904+0000 7fdf1dad4700 1 -- 172.21.15.31:0/4172730682 learned_addr learned my addr 172.21.15.31:0/4172730682 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:51.924 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.905+0000 7fdf1dad4700 1 -- 172.21.15.31:0/4172730682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf18079790 con 0x7fdf18078be0 2020-06-27T04:39:51.925 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.5911977291107178, stop=False, exit=None, reads=[10] 2020-06-27T04:39:51.926 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.905+0000 7fdf1dad4700 1 --2- 172.21.15.31:0/4172730682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf18078be0 0x7fdf18079000 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fdf080032f0 tx=0x7fdf080092b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:51.926 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.905+0000 7fdf15ffb700 1 -- 172.21.15.31:0/4172730682 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fdf0801b460 con 0x7fdf18078be0 2020-06-27T04:39:51.926 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.905+0000 7fdf15ffb700 1 -- 172.21.15.31:0/4172730682 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fdf0801ba00 con 0x7fdf18078be0 2020-06-27T04:39:51.926 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.905+0000 7fdf1f537700 1 -- 172.21.15.31:0/4172730682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf18077990 con 0x7fdf18078be0 2020-06-27T04:39:51.926 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.905+0000 7fdf15ffb700 1 -- 172.21.15.31:0/4172730682 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fdf0801a6b0 con 0x7fdf18078be0 2020-06-27T04:39:51.927 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.5914516448974609, stop=False, exit=None, reads=[10] 2020-06-27T04:39:51.927 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.905+0000 7fdf1f537700 1 -- 172.21.15.31:0/4172730682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf18077e20 con 0x7fdf18078be0 2020-06-27T04:39:51.927 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.5915319919586182, stop=False, exit=None, reads=[10] 2020-06-27T04:39:51.927 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.906+0000 7fdf15ffb700 1 -- 172.21.15.31:0/4172730682 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 31779+0+0 (secure 0 0 0) 0x7fdf08017040 con 0x7fdf18078be0 2020-06-27T04:39:51.927 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.5917825698852539, stop=False, exit=None, reads=[10] 2020-06-27T04:39:51.928 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.906+0000 7fdf15ffb700 1 --2- 172.21.15.31:0/4172730682 >> v2:172.21.15.31:6800/769686724 conn(0x7fdef002aa30 0x7fdef002cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:51.928 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.906+0000 7fdf15ffb700 1 -- 172.21.15.31:0/4172730682 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1154+0+0 (secure 0 0 0) 0x7fdf0803c1f0 con 0x7fdf18078be0 2020-06-27T04:39:51.928 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.5919408798217773, stop=False, exit=None, reads=[10] 2020-06-27T04:39:51.928 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.906+0000 7fdf1d2d3700 1 --2- 172.21.15.31:0/4172730682 >> v2:172.21.15.31:6800/769686724 conn(0x7fdef002aa30 0x7fdef002cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:51.928 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.5921139717102051, stop=False, exit=None, reads=[10] 2020-06-27T04:39:51.929 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.906+0000 7fdf1f537700 1 -- 172.21.15.31:0/4172730682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf18057340 con 0x7fdf18078be0 2020-06-27T04:39:51.929 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.5923221111297607, stop=False, exit=None, reads=[10] 2020-06-27T04:39:51.929 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.907+0000 7fdf1d2d3700 1 --2- 172.21.15.31:0/4172730682 >> v2:172.21.15.31:6800/769686724 conn(0x7fdef002aa30 0x7fdef002cef0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fdf00002f70 tx=0x7fdf00006b20).ready entity=mgr.14102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:51.930 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.5924646854400635, stop=False, exit=None, reads=[10] 2020-06-27T04:39:51.930 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:51.910+0000 7fdf15ffb700 1 -- 172.21.15.31:0/4172730682 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fdf0801a920 con 0x7fdf18078be0 2020-06-27T04:39:51.931 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.5959632396697998, stop=False, exit=None, reads=[10] 2020-06-27T04:39:52.108 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:52.105+0000 7fdf1f537700 1 -- 172.21.15.31:0/4172730682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fdf18043e80 con 0x7fdf18078be0 2020-06-27T04:39:52.109 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7910592555999756, stop=False, exit=None, reads=[10] 2020-06-27T04:39:53.074 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:53.071+0000 7fdf15ffb700 1 -- 172.21.15.31:0/4172730682 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 5) v1 ==== 31790+0+0 (secure 0 0 0) 0x7fdf0800f070 con 0x7fdf18078be0 2020-06-27T04:39:53.075 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.757091999053955, stop=False, exit=None, reads=[10] 2020-06-27T04:39:53.076 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:53.072+0000 7fdf15ffb700 1 -- 172.21.15.31:0/4172730682 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fdf08018760 con 0x7fdf18078be0 2020-06-27T04:39:53.076 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.7583143711090088, stop=False, exit=None, reads=[10] 2020-06-27T04:39:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:53.075+0000 7fdf1f537700 1 -- 172.21.15.31:0/4172730682 >> v2:172.21.15.31:6800/769686724 conn(0x7fdef002aa30 msgr2=0x7fdef002cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:53.085 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:53.075+0000 7fdf1f537700 1 --2- 172.21.15.31:0/4172730682 >> v2:172.21.15.31:6800/769686724 conn(0x7fdef002aa30 0x7fdef002cef0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fdf00002f70 tx=0x7fdf00006b20).stop 2020-06-27T04:39:53.085 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:53.075+0000 7fdf1f537700 1 -- 172.21.15.31:0/4172730682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf18078be0 msgr2=0x7fdf18079000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:53.085 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:53.075+0000 7fdf1f537700 1 --2- 172.21.15.31:0/4172730682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf18078be0 0x7fdf18079000 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fdf080032f0 tx=0x7fdf080092b0).stop 2020-06-27T04:39:53.088 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.7606630325317383, stop=False, exit=None, reads=[10] 2020-06-27T04:39:53.089 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:53.075+0000 7fdf1f537700 1 -- 172.21.15.31:0/4172730682 shutdown_connections 2020-06-27T04:39:53.090 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:53.075+0000 7fdf1f537700 1 --2- 172.21.15.31:0/4172730682 >> v2:172.21.15.31:6800/769686724 conn(0x7fdef002aa30 0x7fdef002cef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:53.090 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:53.075+0000 7fdf1f537700 1 --2- 172.21.15.31:0/4172730682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf18078be0 0x7fdf18079000 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:53.091 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:53.075+0000 7fdf1f537700 1 -- 172.21.15.31:0/4172730682 >> 172.21.15.31:0/4172730682 conn(0x7fdf1805ffe0 msgr2=0x7fdf18062500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:53.091 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:53.075+0000 7fdf1f537700 1 -- 172.21.15.31:0/4172730682 shutdown_connections 2020-06-27T04:39:53.091 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:53.075+0000 7fdf1f537700 1 -- 172.21.15.31:0/4172730682 wait complete. 2020-06-27T04:39:53.091 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.7610995769500732, stop=False, exit=None, reads=[10] 2020-06-27T04:39:53.452 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:53 smithi031 bash[18426]: audit 2020-06-27T04:39:52.107027+0000 mon.a (mon.0) 34 : audit [INF] from='client.? 172.21.15.31:0/4172730682' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2020-06-27T04:39:53.452 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:39:53 smithi031 bash[18687]: ignoring --setuser ceph since I am not root 2020-06-27T04:39:53.452 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:39:53 smithi031 bash[18687]: ignoring --setgroup ceph since I am not root 2020-06-27T04:39:53.452 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:39:53 smithi031 bash[18687]: debug 2020-06-27T04:39:53.102+0000 7effcaf11380 1 -- 172.21.15.31:0/2686147869 shutdown_connections 2020-06-27T04:39:53.453 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:39:53 smithi031 bash[18687]: debug 2020-06-27T04:39:53.102+0000 7effcaf11380 1 --2- 172.21.15.31:0/2686147869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555b7e652c00 0x555b7e6d5400 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:53.453 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:39:53 smithi031 bash[18687]: debug 2020-06-27T04:39:53.102+0000 7effcaf11380 1 -- 172.21.15.31:0/2686147869 >> 172.21.15.31:0/2686147869 conn(0x555b7e652800 msgr2=0x555b7f2c2800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:53.453 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:39:53 smithi031 bash[18687]: debug 2020-06-27T04:39:53.102+0000 7effcaf11380 1 -- 172.21.15.31:0/2686147869 shutdown_connections 2020-06-27T04:39:53.453 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:39:53 smithi031 bash[18687]: debug 2020-06-27T04:39:53.102+0000 7effcaf11380 1 -- 172.21.15.31:0/2686147869 wait complete. 2020-06-27T04:39:53.454 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=2.135658025741577, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:39:53.455 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=2.1358132362365723, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:39:53.455 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'mgr', 'dump'] 2020-06-27T04:39:53.455 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 mgr dump 2020-06-27T04:39:54.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.148+0000 7f98d2b60700 1 Processor -- start 2020-06-27T04:39:54.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.148+0000 7f98d2b60700 1 -- start start 2020-06-27T04:39:54.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.149+0000 7f98d2b60700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98cc0646c0 0x7f98cc064ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:54.156 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.149+0000 7f98d2b60700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc065130 con 0x7f98cc0646c0 2020-06-27T04:39:54.156 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.149+0000 7f98d235f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98cc0646c0 0x7f98cc064ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:54.156 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6991262435913086, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.156 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.149+0000 7f98d235f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98cc0646c0 0x7f98cc064ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38510/0 (socket says 172.21.15.31:38510) 2020-06-27T04:39:54.156 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.149+0000 7f98d235f700 1 -- 172.21.15.31:0/3046764066 learned_addr learned my addr 172.21.15.31:0/3046764066 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:54.157 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.149+0000 7f98d235f700 1 -- 172.21.15.31:0/3046764066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc065270 con 0x7f98cc0646c0 2020-06-27T04:39:54.157 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.150+0000 7f98d235f700 1 --2- 172.21.15.31:0/3046764066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98cc0646c0 0x7f98cc064ae0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f98c40032f0 tx=0x7f98c40092b0).ready entity=mon.0 client_cookie=a04394aee8a0f785 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:54.157 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.150+0000 7f98d135d700 1 -- 172.21.15.31:0/3046764066 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f98c400bc00 con 0x7f98cc0646c0 2020-06-27T04:39:54.157 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6993591785430908, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.161 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.150+0000 7f98d135d700 1 -- 172.21.15.31:0/3046764066 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f98c400bd60 con 0x7f98cc0646c0 2020-06-27T04:39:54.161 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.150+0000 7f98d135d700 1 -- 172.21.15.31:0/3046764066 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f98c4010510 con 0x7f98cc0646c0 2020-06-27T04:39:54.162 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.150+0000 7f98d2b60700 1 -- 172.21.15.31:0/3046764066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98cc0646c0 msgr2=0x7f98cc064ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:54.162 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.150+0000 7f98d2b60700 1 --2- 172.21.15.31:0/3046764066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98cc0646c0 0x7f98cc064ae0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f98c40032f0 tx=0x7f98c40092b0).stop 2020-06-27T04:39:54.162 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.150+0000 7f98d2b60700 1 -- 172.21.15.31:0/3046764066 shutdown_connections 2020-06-27T04:39:54.162 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6995556354522705, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.150+0000 7f98d2b60700 1 --2- 172.21.15.31:0/3046764066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98cc0646c0 0x7f98cc064ae0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:54.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.150+0000 7f98d2b60700 1 -- 172.21.15.31:0/3046764066 >> 172.21.15.31:0/3046764066 conn(0x7f98cc0252f0 msgr2=0x7f98cc0256d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:54.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.150+0000 7f98d2b60700 1 -- 172.21.15.31:0/3046764066 shutdown_connections 2020-06-27T04:39:54.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.150+0000 7f98d2b60700 1 -- 172.21.15.31:0/3046764066 wait complete. 2020-06-27T04:39:54.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6998248100280762, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.164 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.152+0000 7f98d2b60700 1 Processor -- start 2020-06-27T04:39:54.164 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7000772953033447, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.164 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.152+0000 7f98d2b60700 1 -- start start 2020-06-27T04:39:54.164 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7001829147338867, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.164 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.152+0000 7f98d2b60700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98cc0713f0 0x7f98cc06f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:54.165 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.152+0000 7f98d2b60700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc07e4b0 con 0x7f98cc0713f0 2020-06-27T04:39:54.165 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7003786563873291, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.165 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.152+0000 7f98d235f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98cc0713f0 0x7f98cc06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:54.165 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.152+0000 7f98d235f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98cc0713f0 0x7f98cc06f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38512/0 (socket says 172.21.15.31:38512) 2020-06-27T04:39:54.165 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.152+0000 7f98d235f700 1 -- 172.21.15.31:0/1350871160 learned_addr learned my addr 172.21.15.31:0/1350871160 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:54.172 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7005360126495361, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.172 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.152+0000 7f98d235f700 1 -- 172.21.15.31:0/1350871160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc06fd00 con 0x7f98cc0713f0 2020-06-27T04:39:54.172 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7007095813751221, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.172 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.152+0000 7f98d235f700 1 --2- 172.21.15.31:0/1350871160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98cc0713f0 0x7f98cc06f810 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f98c40032f0 tx=0x7f98c40092b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:54.173 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7008824348449707, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.173 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.153+0000 7f98c27fc700 1 -- 172.21.15.31:0/1350871160 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f98c4011b70 con 0x7f98cc0713f0 2020-06-27T04:39:54.173 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7011244297027588, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.173 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.153+0000 7f98c27fc700 1 -- 172.21.15.31:0/1350871160 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f98c401b8a0 con 0x7f98cc0713f0 2020-06-27T04:39:54.173 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.153+0000 7f98d2b60700 1 -- 172.21.15.31:0/1350871160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98cc06ff50 con 0x7f98cc0713f0 2020-06-27T04:39:54.174 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.153+0000 7f98c27fc700 1 -- 172.21.15.31:0/1350871160 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f98c401a6b0 con 0x7f98cc0713f0 2020-06-27T04:39:54.174 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.153+0000 7f98d2b60700 1 -- 172.21.15.31:0/1350871160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98cc0703e0 con 0x7f98cc0713f0 2020-06-27T04:39:54.174 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7013692855834961, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.174 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.153+0000 7f98c27fc700 1 -- 172.21.15.31:0/1350871160 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 31790+0+0 (secure 0 0 0) 0x7f98c4017040 con 0x7f98cc0713f0 2020-06-27T04:39:54.174 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7019100189208984, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.175 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.154+0000 7f98c27fc700 1 --2- 172.21.15.31:0/1350871160 >> v2:172.21.15.31:6800/769686724 conn(0x7f98a802aad0 0x7f98a802cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:54.175 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7020609378814697, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.175 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.154+0000 7f98c27fc700 1 -- 172.21.15.31:0/1350871160 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1154+0+0 (secure 0 0 0) 0x7f98c403cfa0 con 0x7f98cc0713f0 2020-06-27T04:39:54.175 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.154+0000 7f98d1b5e700 1 -- 172.21.15.31:0/1350871160 >> v2:172.21.15.31:6800/769686724 conn(0x7f98a802aad0 msgr2=0x7f98a802cf90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/769686724 2020-06-27T04:39:54.175 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.154+0000 7f98d1b5e700 1 --2- 172.21.15.31:0/1350871160 >> v2:172.21.15.31:6800/769686724 conn(0x7f98a802aad0 0x7f98a802cf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2020-06-27T04:39:54.176 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7022006511688232, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.176 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.154+0000 7f98d2b60700 1 -- 172.21.15.31:0/1350871160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98cc057340 con 0x7f98cc0713f0 2020-06-27T04:39:54.176 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7026045322418213, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.176 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.158+0000 7f98c27fc700 1 -- 172.21.15.31:0/1350871160 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f98c4022310 con 0x7f98cc0713f0 2020-06-27T04:39:54.176 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7064540386199951, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.355+0000 7f98d1b5e700 1 -- 172.21.15.31:0/1350871160 >> v2:172.21.15.31:6800/769686724 conn(0x7f98a802aad0 msgr2=0x7f98a802cf90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/769686724 2020-06-27T04:39:54.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.355+0000 7f98d1b5e700 1 --2- 172.21.15.31:0/1350871160 >> v2:172.21.15.31:6800/769686724 conn(0x7f98a802aad0 0x7f98a802cf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2020-06-27T04:39:54.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9033114910125732, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.372 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.369+0000 7f98d2b60700 1 -- 172.21.15.31:0/1350871160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr dump"} v 0) v1 -- 0x7f98cc043e80 con 0x7f98cc0713f0 2020-06-27T04:39:54.372 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9174365997314453, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.764 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.371+0000 7f98c27fc700 1 -- 172.21.15.31:0/1350871160 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump"}]=0 v5) v1 ==== 56+0+161344 (secure 0 0 0) 0x7f98c4022310 con 0x7f98cc0713f0 2020-06-27T04:39:54.764 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9196655750274658, stop=False, exit=None, reads=[10] 2020-06-27T04:39:54.765 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:54.765 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 5, 2020-06-27T04:39:54.765 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14102, 2020-06-27T04:39:54.765 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2020-06-27T04:39:54.765 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2020-06-27T04:39:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2020-06-27T04:39:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2020-06-27T04:39:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.31:6800", 2020-06-27T04:39:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 769686724 2020-06-27T04:39:54.767 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:54.767 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-06-27T04:39:54.767 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.767 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.15.31:6800/769686724", 2020-06-27T04:39:54.767 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2020-06-27T04:39:47.913925+0000", 2020-06-27T04:39:54.767 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292837744639, 2020-06-27T04:39:54.768 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2020-06-27T04:39:54.768 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2020-06-27T04:39:54.768 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2020-06-27T04:39:54.768 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2020-06-27T04:39:54.768 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2020-06-27T04:39:54.769 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2020-06-27T04:39:54.769 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:54.769 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2020-06-27T04:39:54.769 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:54.769 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2020-06-27T04:39:54.770 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:54.770 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:54.770 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:54.770 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-06-27T04:39:54.770 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-06-27T04:39:54.770 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:39:54.771 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.771 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.771 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2020-06-27T04:39:54.771 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.771 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.772 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9213681221008301, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.772 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.772 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2020-06-27T04:39:54.772 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.772 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.772 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.773 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.773 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:54.773 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:54.773 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.773 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.774 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.774 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:54.774 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.774 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.774 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:54.774 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:54.775 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:54.775 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:54.775 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:54.775 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:54.775 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:54.775 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:54.776 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.776 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.776 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.776 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.776 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.777 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:54.777 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:54.777 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.777 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9224987030029297, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.777 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.777 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.778 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:54.778 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.778 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.778 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.778 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.779 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.779 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.779 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.779 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.779 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:54.779 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:54.780 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.780 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.780 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.780 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:54.780 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.781 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.781 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:54.781 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:54.781 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:54.781 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:54.781 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:54.782 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:54.782 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:54.782 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:54.782 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.782 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.783 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9232144355773926, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.783 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.783 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.783 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.783 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:54.783 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:54.784 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.784 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.784 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.784 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:54.784 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.785 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.785 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.785 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.785 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.785 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.785 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.786 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.786 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2020-06-27T04:39:54.786 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2020-06-27T04:39:54.786 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.786 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.787 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.787 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:54.787 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.787 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.787 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.788 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2020-06-27T04:39:54.788 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.788 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.788 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9239344596862793, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.788 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.788 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.789 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2020-06-27T04:39:54.789 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2020-06-27T04:39:54.789 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.789 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.789 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2020-06-27T04:39:54.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2020-06-27T04:39:54.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.791 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.791 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.791 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.791 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2020-06-27T04:39:54.791 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2020-06-27T04:39:54.792 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.792 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.792 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.792 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:54.792 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.792 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2020-06-27T04:39:54.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9246277809143066, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2020-06-27T04:39:54.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2020-06-27T04:39:54.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.795 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.795 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:54.795 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.795 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.795 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.796 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2020-06-27T04:39:54.796 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.796 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.796 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.796 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.796 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2020-06-27T04:39:54.797 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2020-06-27T04:39:54.797 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:54.797 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.797 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.797 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2020-06-27T04:39:54.798 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.798 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.798 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.798 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2020-06-27T04:39:54.798 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.798 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.799 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.799 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.799 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9252879619598389, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.799 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2020-06-27T04:39:54.799 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2020-06-27T04:39:54.799 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.800 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.800 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.800 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:54.800 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.800 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.801 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.801 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2020-06-27T04:39:54.801 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.801 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.801 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.802 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.802 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2020-06-27T04:39:54.802 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2020-06-27T04:39:54.802 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.803 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.803 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.803 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:54.803 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.803 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.803 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.804 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2020-06-27T04:39:54.804 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.804 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.804 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.804 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.805 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9259469509124756, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.805 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2020-06-27T04:39:54.805 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2020-06-27T04:39:54.805 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.805 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.805 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.806 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:54.806 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.806 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.806 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.806 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2020-06-27T04:39:54.807 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.807 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.807 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.807 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:54.808 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:54.808 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.808 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:54.808 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2020-06-27T04:39:54.808 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:54.809 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:54.809 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:54.809 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2020-06-27T04:39:54.809 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2020-06-27T04:39:54.809 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.809 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.810 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.810 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:54.810 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.810 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.810 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.811 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9266142845153809, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.811 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2020-06-27T04:39:54.811 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.811 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.811 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.811 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.812 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2020-06-27T04:39:54.812 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2020-06-27T04:39:54.812 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.812 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.812 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.813 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2020-06-27T04:39:54.813 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.813 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.813 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.813 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2020-06-27T04:39:54.813 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2020-06-27T04:39:54.814 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.814 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.814 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.814 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2020-06-27T04:39:54.814 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2020-06-27T04:39:54.815 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2020-06-27T04:39:54.815 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.815 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.815 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2020-06-27T04:39:54.815 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2020-06-27T04:39:54.815 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2020-06-27T04:39:54.816 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9272427558898926, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.816 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.816 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2020-06-27T04:39:54.816 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2020-06-27T04:39:54.817 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.818 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.818 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.818 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2020-06-27T04:39:54.818 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2020-06-27T04:39:54.818 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2020-06-27T04:39:54.819 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.819 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.819 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2020-06-27T04:39:54.819 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2020-06-27T04:39:54.819 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2020-06-27T04:39:54.819 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.820 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2020-06-27T04:39:54.820 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.820 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.820 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.820 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.821 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2020-06-27T04:39:54.821 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2020-06-27T04:39:54.821 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.821 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.821 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.927793025970459, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.821 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.822 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2020-06-27T04:39:54.822 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.822 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.822 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.822 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2020-06-27T04:39:54.823 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2020-06-27T04:39:54.823 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.823 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.823 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.823 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2020-06-27T04:39:54.824 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2020-06-27T04:39:54.824 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2020-06-27T04:39:54.824 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.824 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.824 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2020-06-27T04:39:54.824 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2020-06-27T04:39:54.825 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2020-06-27T04:39:54.825 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.825 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2020-06-27T04:39:54.825 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2020-06-27T04:39:54.825 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9282965660095215, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.826 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.826 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.826 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.826 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2020-06-27T04:39:54.826 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2020-06-27T04:39:54.826 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.827 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.827 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.827 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2020-06-27T04:39:54.827 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.827 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.827 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.828 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2020-06-27T04:39:54.828 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2020-06-27T04:39:54.828 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.828 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.829 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.829 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2020-06-27T04:39:54.829 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2020-06-27T04:39:54.829 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2020-06-27T04:39:54.829 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.829 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.830 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2020-06-27T04:39:54.830 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2020-06-27T04:39:54.830 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2020-06-27T04:39:54.830 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.830 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9288945198059082, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.831 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2020-06-27T04:39:54.831 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2020-06-27T04:39:54.831 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.831 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.831 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.832 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:54.832 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:54.832 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.832 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.833 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.833 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:54.833 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.833 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.833 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:54.833 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:54.834 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:54.834 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:54.834 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:54.834 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:54.834 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:54.835 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:54.835 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.835 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.835 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.835 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.836 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.836 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:54.836 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:54.836 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.836 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9295592308044434, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.837 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.837 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.837 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:54.837 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.837 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.838 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.838 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.838 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.838 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.838 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.838 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.839 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:54.839 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:54.839 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.839 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.839 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.840 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:54.840 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.840 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.840 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:54.840 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:54.840 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:54.841 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:54.841 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:54.841 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:54.841 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:54.841 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:54.842 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.842 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.842 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9302210807800293, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.842 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.842 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.842 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.843 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:54.843 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:54.843 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.843 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.843 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.844 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:54.844 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.844 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.844 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.844 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.844 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.845 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.845 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.845 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.845 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2020-06-27T04:39:54.846 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2020-06-27T04:39:54.846 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2020-06-27T04:39:54.846 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.847 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.847 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2020-06-27T04:39:54.847 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.847 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.847 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.847 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2020-06-27T04:39:54.848 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.848 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9308452606201172, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.848 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.848 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.848 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.849 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2020-06-27T04:39:54.849 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2020-06-27T04:39:54.849 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.849 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.849 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.849 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "upmap", 2020-06-27T04:39:54.850 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.850 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.850 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:54.850 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2020-06-27T04:39:54.850 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2020-06-27T04:39:54.851 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2020-06-27T04:39:54.851 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:54.851 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2020-06-27T04:39:54.851 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.852 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.852 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.852 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.852 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2020-06-27T04:39:54.852 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2020-06-27T04:39:54.853 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.853 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.853 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.853 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:54.853 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.854 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.854 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.854 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9315121173858643, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.854 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2020-06-27T04:39:54.854 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.855 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.855 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.855 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.855 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2020-06-27T04:39:54.855 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-06-27T04:39:54.855 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:39:54.856 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.856 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.856 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2020-06-27T04:39:54.856 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.856 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.857 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.857 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2020-06-27T04:39:54.857 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.857 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.857 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.857 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.858 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2020-06-27T04:39:54.858 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2020-06-27T04:39:54.858 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:54.858 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.858 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.859 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2020-06-27T04:39:54.859 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2020-06-27T04:39:54.859 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9321095943450928, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.859 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.859 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.859 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2020-06-27T04:39:54.860 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2020-06-27T04:39:54.860 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.860 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.860 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.860 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2020-06-27T04:39:54.861 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2020-06-27T04:39:54.861 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2020-06-27T04:39:54.861 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.861 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.861 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2020-06-27T04:39:54.862 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.862 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.862 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.862 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2020-06-27T04:39:54.862 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.862 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.863 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.863 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:54.863 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:54.863 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.863 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:54.864 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2020-06-27T04:39:54.864 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:54.864 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:54.864 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.932746410369873, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.864 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:54.864 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2020-06-27T04:39:54.865 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2020-06-27T04:39:54.865 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.865 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.865 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.865 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:54.866 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.866 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.866 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.866 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2020-06-27T04:39:54.866 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2020-06-27T04:39:54.866 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.867 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.867 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.867 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_dashboard": { 2020-06-27T04:39:54.867 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_dashboard", 2020-06-27T04:39:54.868 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.868 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.868 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.868 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:54.869 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.869 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.869 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9333019256591797, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.869 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.869 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "manage configs like API endpoints in Dashboard.", 2020-06-27T04:39:54.869 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.870 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.870 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.870 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.870 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_alertmanager": { 2020-06-27T04:39:54.870 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_alertmanager", 2020-06-27T04:39:54.871 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.871 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.871 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.871 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prom/alertmanager:v0.20.0", 2020-06-27T04:39:54.872 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.872 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.872 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.872 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Prometheus container image", 2020-06-27T04:39:54.872 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.872 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.873 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.873 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.873 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2020-06-27T04:39:54.873 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2020-06-27T04:39:54.873 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.874 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.874 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.874 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.93387770652771, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.874 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "docker.io/ceph/ceph", 2020-06-27T04:39:54.874 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.874 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.875 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.875 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2020-06-27T04:39:54.875 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.875 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.876 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.876 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.876 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_grafana": { 2020-06-27T04:39:54.876 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_grafana", 2020-06-27T04:39:54.876 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph-grafana:6.6.2", 2020-06-27T04:39:54.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.878 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.878 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Prometheus container image", 2020-06-27T04:39:54.878 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.878 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.878 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.878 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.879 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_node_exporter": { 2020-06-27T04:39:54.879 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_node_exporter", 2020-06-27T04:39:54.879 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9344577789306641, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.879 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.879 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prom/node-exporter:v0.18.1", 2020-06-27T04:39:54.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Prometheus container image", 2020-06-27T04:39:54.881 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.881 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.881 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.881 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.881 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_prometheus": { 2020-06-27T04:39:54.882 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_prometheus", 2020-06-27T04:39:54.882 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.882 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.882 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.882 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prom/prometheus:v2.18.1", 2020-06-27T04:39:54.882 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.883 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.883 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.883 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Prometheus container image", 2020-06-27T04:39:54.883 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.883 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.884 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.884 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.884 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9350681304931641, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.884 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2020-06-27T04:39:54.884 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2020-06-27T04:39:54.884 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:39:54.885 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.885 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.885 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2020-06-27T04:39:54.885 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.885 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.885 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.886 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2020-06-27T04:39:54.886 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.886 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.886 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.886 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.887 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2020-06-27T04:39:54.887 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2020-06-27T04:39:54.887 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:39:54.887 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.887 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.887 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2020-06-27T04:39:54.888 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.888 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.888 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.888 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2020-06-27T04:39:54.888 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.889 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.889 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9356575012207031, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.889 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.889 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.889 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2020-06-27T04:39:54.889 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2020-06-27T04:39:54.890 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:39:54.890 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.890 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.890 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2020-06-27T04:39:54.890 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2020-06-27T04:39:54.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.892 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.892 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.892 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:54.892 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:54.892 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.892 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.893 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.893 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:54.893 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.893 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.893 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:54.894 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:54.894 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:54.894 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:54.894 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9363036155700684, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.894 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:54.895 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:54.895 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:54.895 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:54.895 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.895 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.895 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.896 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.896 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.896 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:54.896 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:54.896 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.896 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.897 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.897 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:54.897 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.897 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.897 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.898 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2020-06-27T04:39:54.898 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.898 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.898 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.898 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.898 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:54.899 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:54.899 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.899 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.899 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.899 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9369399547576904, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.900 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:54.900 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.900 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.900 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:54.900 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:54.900 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:54.901 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:54.901 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:54.901 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:54.901 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:54.901 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:54.902 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.902 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.902 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.902 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.902 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.902 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:54.903 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:54.903 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.903 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.903 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.903 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:54.904 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.904 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.904 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.904 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.904 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.904 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.905 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.905 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.905 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "migration_current": { 2020-06-27T04:39:54.905 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9376263618469238, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.905 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "migration_current", 2020-06-27T04:39:54.906 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:54.906 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.906 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.907 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:39:54.907 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.907 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "internal - do not modify", 2020-06-27T04:39:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.909 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.909 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2020-06-27T04:39:54.909 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2020-06-27T04:39:54.909 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.909 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.909 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2020-06-27T04:39:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2020-06-27T04:39:54.911 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2020-06-27T04:39:54.911 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:54.911 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2020-06-27T04:39:54.911 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.911 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.911 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9382627010345459, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.912 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.912 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.912 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prometheus_alerts_path": { 2020-06-27T04:39:54.912 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus_alerts_path", 2020-06-27T04:39:54.912 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2020-06-27T04:39:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "location of alerts to include in prometheus deployments", 2020-06-27T04:39:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.915 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2020-06-27T04:39:54.915 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2020-06-27T04:39:54.915 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.915 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.915 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.916 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:39:54.916 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.916 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.916 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.916 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.938828706741333, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.916 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2020-06-27T04:39:54.917 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.917 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.917 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.917 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.917 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2020-06-27T04:39:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2020-06-27T04:39:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.919 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.919 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.919 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2020-06-27T04:39:54.919 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.919 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.920 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.920 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.920 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2020-06-27T04:39:54.920 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2020-06-27T04:39:54.920 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.920 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.921 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.921 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:54.921 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.921 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9394283294677734, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.921 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.922 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.922 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2020-06-27T04:39:54.922 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.922 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.922 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.922 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2020-06-27T04:39:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2020-06-27T04:39:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.924 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:54.924 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.924 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.924 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.924 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2020-06-27T04:39:54.924 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.925 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.925 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.925 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:54.925 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:54.925 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.926 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:54.926 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2020-06-27T04:39:54.926 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:54.926 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:54.926 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9400548934936523, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.926 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:54.927 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:54.927 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:54.927 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.927 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.927 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.928 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:54.928 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.928 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.928 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:54.928 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:54.928 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:54.929 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:54.929 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:54.929 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:54.929 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:54.929 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:54.930 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.930 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.930 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.930 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.930 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.930 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:54.931 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:54.931 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.931 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.931 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.931 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:54.932 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.932 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.932 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9407253265380859, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.932 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.933 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.933 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.933 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.933 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.933 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.933 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:54.934 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:54.934 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.934 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.934 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.934 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:54.935 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.935 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.935 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:54.935 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:54.935 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:54.936 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:54.936 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:54.936 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:54.936 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:54.936 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:54.936 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.937 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.937 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.937 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.937 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.938 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:54.938 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:54.938 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.938 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9414057731628418, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.938 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.938 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.939 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:54.939 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.939 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.939 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.939 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.940 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.940 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.940 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.940 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.940 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2020-06-27T04:39:54.940 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2020-06-27T04:39:54.941 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:39:54.941 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.941 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.941 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2020-06-27T04:39:54.941 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.942 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.942 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.942 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2020-06-27T04:39:54.942 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.942 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.942 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.943 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.943 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2020-06-27T04:39:54.943 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2020-06-27T04:39:54.943 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9420211315155029, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.943 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:39:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2020-06-27T04:39:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.945 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2020-06-27T04:39:54.945 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.945 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.945 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.945 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:54.946 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:54.946 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.946 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:54.946 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2020-06-27T04:39:54.946 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:54.946 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:54.947 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:54.947 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2020-06-27T04:39:54.947 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2020-06-27T04:39:54.947 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.947 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.948 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.948 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:54.948 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.948 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.948 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.948 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.949 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.949 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9427144527435303, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.949 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.949 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.949 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.950 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2020-06-27T04:39:54.950 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2020-06-27T04:39:54.950 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.950 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.950 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.950 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:54.951 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.951 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.951 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.951 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.951 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.951 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.952 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.952 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.952 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2020-06-27T04:39:54.952 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2020-06-27T04:39:54.952 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.953 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.953 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.953 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:54.953 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.953 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.953 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.954 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.954 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.954 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9433727264404297, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.954 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.954 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.955 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.955 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2020-06-27T04:39:54.955 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2020-06-27T04:39:54.955 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.955 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.955 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.956 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:54.956 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.956 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.956 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.956 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.957 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.957 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.957 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.957 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.957 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2020-06-27T04:39:54.957 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2020-06-27T04:39:54.958 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.958 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.958 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.958 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:54.958 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.959 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.959 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.959 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.959 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.959 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.959 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9440343379974365, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.960 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.960 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.960 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2020-06-27T04:39:54.960 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2020-06-27T04:39:54.960 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.961 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.961 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.961 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:54.961 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.961 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.961 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.962 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.962 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.962 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.962 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.962 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.963 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2020-06-27T04:39:54.963 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2020-06-27T04:39:54.963 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.963 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.963 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.963 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:54.964 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.964 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.964 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.964 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.964 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.965 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.965 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9446876049041748, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.965 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.965 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.965 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2020-06-27T04:39:54.965 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2020-06-27T04:39:54.966 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.966 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.966 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.966 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:54.966 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.967 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.967 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.967 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.967 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.967 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.968 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.968 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.968 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2020-06-27T04:39:54.968 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2020-06-27T04:39:54.968 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.969 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.969 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.969 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:54.969 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.969 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.969 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.970 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.970 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.970 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.970 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9454221725463867, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.970 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.971 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.971 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2020-06-27T04:39:54.971 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2020-06-27T04:39:54.971 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.971 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.971 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.972 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:54.972 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.972 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.972 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.973 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.973 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.973 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.973 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.973 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.973 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2020-06-27T04:39:54.974 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2020-06-27T04:39:54.974 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.974 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.974 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.974 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:54.975 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.975 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.975 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.975 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.975 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.975 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.976 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9460933208465576, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.976 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.976 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.976 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2020-06-27T04:39:54.976 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2020-06-27T04:39:54.977 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.977 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.977 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.977 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2020-06-27T04:39:54.977 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.978 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.978 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.978 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.978 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.978 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.978 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.979 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.979 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2020-06-27T04:39:54.979 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2020-06-27T04:39:54.979 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.979 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.979 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.980 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:54.980 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.980 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.980 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.980 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.981 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.981 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.981 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9467597007751465, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.981 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.981 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.982 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2020-06-27T04:39:54.982 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2020-06-27T04:39:54.982 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.982 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.982 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.982 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:54.983 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.983 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.983 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.983 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.983 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.983 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.984 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.984 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.984 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2020-06-27T04:39:54.984 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2020-06-27T04:39:54.984 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.985 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.985 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.985 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2020-06-27T04:39:54.985 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.985 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.985 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.986 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.986 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.986 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.986 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.986 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.987 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9474520683288574, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.987 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2020-06-27T04:39:54.987 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2020-06-27T04:39:54.987 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.987 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.987 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.988 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:54.988 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.988 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.988 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.988 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.988 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.989 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.989 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.989 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.989 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2020-06-27T04:39:54.989 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2020-06-27T04:39:54.990 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.990 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.990 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.990 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:54.990 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.990 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.991 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.991 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.991 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.991 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.991 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.992 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9480750560760498, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.992 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.992 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2020-06-27T04:39:54.992 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2020-06-27T04:39:54.992 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:54.992 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.993 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.993 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:54.993 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.993 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.993 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.994 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.994 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.994 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.994 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.994 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.994 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2020-06-27T04:39:54.995 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2020-06-27T04:39:54.995 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.995 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.995 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.995 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:54.995 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.996 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.996 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.996 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.996 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.996 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.997 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:54.997 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9487240314483643, stop=False, exit=None, reads=[8] 2020-06-27T04:39:54.997 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:54.997 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2020-06-27T04:39:54.997 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2020-06-27T04:39:54.998 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:54.998 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:54.998 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:54.998 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:54.998 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:54.998 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:54.999 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:54.999 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:54.999 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:54.999 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:54.999 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.000 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.000 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2020-06-27T04:39:55.000 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2020-06-27T04:39:55.000 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.000 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.000 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.001 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:55.001 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.001 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.001 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.001 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.002 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.002 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9493241310119629, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.002 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.002 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.002 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.002 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2020-06-27T04:39:55.003 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2020-06-27T04:39:55.003 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.003 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.003 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.003 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:55.004 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.004 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.004 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.004 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.004 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.004 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.005 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.005 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.005 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2020-06-27T04:39:55.005 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2020-06-27T04:39:55.005 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.006 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.006 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.006 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.006 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.006 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.006 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.007 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.007 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9499454498291016, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.007 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.007 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.008 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.008 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.008 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2020-06-27T04:39:55.008 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2020-06-27T04:39:55.008 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.009 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.009 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.009 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.009 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.009 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.009 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.010 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.010 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.010 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.010 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.010 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.011 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2020-06-27T04:39:55.011 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2020-06-27T04:39:55.011 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.011 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.011 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.011 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.012 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.012 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.012 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9505598545074463, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.012 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.012 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.012 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.013 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.013 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.013 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.013 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2020-06-27T04:39:55.013 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2020-06-27T04:39:55.014 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.014 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.014 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.014 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:55.014 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.014 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.015 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.015 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.015 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.015 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.015 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2020-06-27T04:39:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2020-06-27T04:39:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.017 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2020-06-27T04:39:55.017 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9511682987213135, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.017 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.017 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.017 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.018 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.018 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.018 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.018 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.018 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.019 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2020-06-27T04:39:55.019 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2020-06-27T04:39:55.019 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.019 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.019 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.019 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2020-06-27T04:39:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.021 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.021 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.021 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.021 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2020-06-27T04:39:55.021 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2020-06-27T04:39:55.022 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.022 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.022 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.022 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2020-06-27T04:39:55.022 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.022 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9518435001373291, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.023 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.023 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.023 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.023 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.023 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.024 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.024 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.024 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2020-06-27T04:39:55.024 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2020-06-27T04:39:55.024 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.024 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.025 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.025 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2020-06-27T04:39:55.025 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.025 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.025 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.026 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.026 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.026 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.026 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.026 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.026 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2020-06-27T04:39:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2020-06-27T04:39:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.028 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9524872303009033, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.028 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.028 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.028 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.028 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.029 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.029 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.029 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.029 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2020-06-27T04:39:55.029 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2020-06-27T04:39:55.029 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.030 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.030 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.030 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2020-06-27T04:39:55.030 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.030 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.031 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.031 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.031 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.031 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.031 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.031 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.032 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2020-06-27T04:39:55.032 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2020-06-27T04:39:55.032 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.032 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.032 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.033 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.033 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.033 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.033 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9531495571136475, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.034 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.034 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.034 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.034 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.034 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.034 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.035 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2020-06-27T04:39:55.035 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2020-06-27T04:39:55.035 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.035 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.035 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.036 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2020-06-27T04:39:55.036 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.036 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.036 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.036 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.036 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.037 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.037 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.037 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.037 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2020-06-27T04:39:55.038 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2020-06-27T04:39:55.038 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.038 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.038 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.038 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2020-06-27T04:39:55.038 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.039 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.039 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.039 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.039 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9538404941558838, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.039 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.040 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.040 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.040 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.040 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2020-06-27T04:39:55.040 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2020-06-27T04:39:55.040 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.041 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.041 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.041 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.041 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.041 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.042 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.042 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.042 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.042 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.042 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.042 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.043 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2020-06-27T04:39:55.043 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2020-06-27T04:39:55.043 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.043 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.043 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.044 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:55.044 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.044 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.044 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.044 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.044 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9544854164123535, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.045 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.045 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.045 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.045 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.045 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2020-06-27T04:39:55.046 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2020-06-27T04:39:55.046 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.046 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.046 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.046 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.046 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.047 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.047 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.047 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.047 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.047 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.047 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.048 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.048 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2020-06-27T04:39:55.048 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2020-06-27T04:39:55.048 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.048 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.049 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.049 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2020-06-27T04:39:55.049 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.049 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.049 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.049 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.050 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.050 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9551501274108887, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.050 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.050 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.050 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.051 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2020-06-27T04:39:55.051 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2020-06-27T04:39:55.051 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.051 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.051 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.051 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2020-06-27T04:39:55.052 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.052 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.052 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.052 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.052 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.053 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.053 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.053 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.053 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2020-06-27T04:39:55.053 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2020-06-27T04:39:55.053 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.054 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.054 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.054 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2020-06-27T04:39:55.054 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.054 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.054 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.055 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.055 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.055 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9557833671569824, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.055 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.055 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.056 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.056 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2020-06-27T04:39:55.056 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2020-06-27T04:39:55.056 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.056 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.056 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.057 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.057 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.057 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.057 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.057 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.058 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.058 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.058 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.058 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.058 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2020-06-27T04:39:55.058 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2020-06-27T04:39:55.059 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.059 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.059 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.059 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.059 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2020-06-27T04:39:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9564409255981445, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.061 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.061 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.061 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2020-06-27T04:39:55.061 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2020-06-27T04:39:55.061 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.062 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.062 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.062 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2020-06-27T04:39:55.062 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.062 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.062 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.063 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.063 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.063 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.063 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.063 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.064 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2020-06-27T04:39:55.064 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2020-06-27T04:39:55.064 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.064 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.064 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.064 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.065 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.065 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.065 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.065 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.065 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.066 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.066 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.066 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.066 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9571475982666016, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.066 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.066 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.067 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.067 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.067 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.067 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.067 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.068 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.068 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.068 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.069 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.069 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.070 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.070 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.070 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.070 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.070 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.071 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.071 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.071 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.071 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.071 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.071 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.072 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.072 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.072 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.072 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.072 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.073 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.073 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.073 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9578351974487305, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.073 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.073 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.074 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.074 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.074 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.074 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.074 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.074 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.075 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.075 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.075 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.075 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.075 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.077 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.077 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.077 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.077 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.077 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.078 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.078 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.078 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.078 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.078 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.078 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.079 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.958521842956543, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.079 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.079 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.079 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.079 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.080 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.080 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.080 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.080 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.080 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.080 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.081 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2020-06-27T04:39:55.081 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2020-06-27T04:39:55.081 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.081 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.081 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.082 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.082 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.082 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.082 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.082 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.083 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.083 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.083 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.083 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.083 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2020-06-27T04:39:55.083 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2020-06-27T04:39:55.084 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.084 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.084 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.084 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9591889381408691, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.084 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2020-06-27T04:39:55.085 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.085 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.085 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.085 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.086 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.086 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.086 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.086 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.087 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2020-06-27T04:39:55.087 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2020-06-27T04:39:55.087 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.087 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.087 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.088 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2020-06-27T04:39:55.088 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.088 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.088 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.088 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.089 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.089 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.089 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.089 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.090 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2020-06-27T04:39:55.090 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2020-06-27T04:39:55.090 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.091 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.091 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.091 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:55.092 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.092 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9598817825317383, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.092 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.092 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.092 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.093 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.093 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.093 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.093 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.093 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2020-06-27T04:39:55.094 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2020-06-27T04:39:55.094 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.094 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.094 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.094 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2020-06-27T04:39:55.094 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.095 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.095 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.095 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.095 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.096 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.096 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.096 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.096 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2020-06-27T04:39:55.096 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2020-06-27T04:39:55.097 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.097 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.097 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.097 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2020-06-27T04:39:55.097 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.097 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.098 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9605343341827393, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.098 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.098 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.098 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2020-06-27T04:39:55.098 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.099 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.099 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.099 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.099 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.099 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.100 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2020-06-27T04:39:55.100 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2020-06-27T04:39:55.100 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.100 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.100 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.100 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2020-06-27T04:39:55.101 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2020-06-27T04:39:55.101 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2020-06-27T04:39:55.101 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.101 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.101 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2020-06-27T04:39:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2020-06-27T04:39:55.103 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.103 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.103 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.103 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.103 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9611897468566895, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.104 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.104 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.104 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.111 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.112 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.112 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.112 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.112 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.112 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2020-06-27T04:39:55.113 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2020-06-27T04:39:55.113 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.113 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.113 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.113 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.114 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.114 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.114 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.114 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.114 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.115 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.115 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.116 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.116 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.116 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.116 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.116 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2020-06-27T04:39:55.116 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2020-06-27T04:39:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2020-06-27T04:39:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.118 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9619131088256836, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.123 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.123 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.123 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:55.123 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.123 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.124 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.124 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2020-06-27T04:39:55.124 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.124 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.124 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.125 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.125 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.125 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.125 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.125 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.127 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.127 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.127 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.127 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.127 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.128 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.128 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.128 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.128 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.128 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.962609052658081, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.128 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.132 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.132 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.132 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.132 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.132 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.133 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.133 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.133 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.133 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.133 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.133 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.134 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9632894992828369, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.134 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.134 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.134 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.134 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.135 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.135 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.135 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.135 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.135 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.135 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.136 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.136 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.136 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.136 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.136 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.136 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.137 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.137 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.137 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.137 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.137 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.138 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.138 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2020-06-27T04:39:55.138 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2020-06-27T04:39:55.138 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:39:55.138 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.138 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.139 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2020-06-27T04:39:55.139 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.139 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9639408588409424, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.139 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.139 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.140 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2020-06-27T04:39:55.140 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.140 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.140 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.140 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.141 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2020-06-27T04:39:55.141 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2020-06-27T04:39:55.141 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.141 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.141 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.141 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2020-06-27T04:39:55.142 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.142 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.142 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.142 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2020-06-27T04:39:55.142 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.143 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.143 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.143 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.143 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2020-06-27T04:39:55.143 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2020-06-27T04:39:55.143 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:39:55.144 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.144 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.144 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9645302295684814, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.144 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2020-06-27T04:39:55.144 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.145 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.145 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.145 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2020-06-27T04:39:55.145 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.145 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.145 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.146 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.146 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2020-06-27T04:39:55.146 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2020-06-27T04:39:55.146 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:39:55.146 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.147 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.147 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2020-06-27T04:39:55.147 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.147 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.147 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.147 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2020-06-27T04:39:55.148 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.148 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.148 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.148 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.148 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2020-06-27T04:39:55.149 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2020-06-27T04:39:55.149 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.149 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.149 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9652395248413086, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.149 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2020-06-27T04:39:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.151 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.151 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.151 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.151 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2020-06-27T04:39:55.151 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-06-27T04:39:55.151 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:39:55.152 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.152 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.152 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2020-06-27T04:39:55.152 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.152 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.153 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.153 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2020-06-27T04:39:55.153 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.153 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.153 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.153 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2020-06-27T04:39:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2020-06-27T04:39:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9658286571502686, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:39:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2020-06-27T04:39:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2020-06-27T04:39:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.157 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.157 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.157 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2020-06-27T04:39:55.157 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.157 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.157 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.158 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.158 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.158 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.158 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.158 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.159 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.159 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.159 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.159 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.159 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.159 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.160 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9665091037750244, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.160 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.160 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.160 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.160 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.161 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.161 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.161 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.161 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.161 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.161 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.162 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.162 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.162 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.162 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.162 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.164 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.164 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.164 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.164 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.164 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.165 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.165 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.165 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.165 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9671809673309326, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.165 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.165 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.166 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.166 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.166 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.166 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.166 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.167 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.167 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.167 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.167 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.167 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.167 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.168 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.168 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.168 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.168 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.168 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.169 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.169 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.169 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.169 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.169 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.170 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.170 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.170 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.170 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.170 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.171 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.171 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.171 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2020-06-27T04:39:55.171 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9679098129272461, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.171 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2020-06-27T04:39:55.172 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.172 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.172 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.172 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2020-06-27T04:39:55.172 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.172 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.173 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.173 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.173 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.173 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.173 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.173 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.174 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2020-06-27T04:39:55.174 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2020-06-27T04:39:55.174 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.174 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.174 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.175 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2020-06-27T04:39:55.175 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.175 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.175 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.175 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.175 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.176 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.176 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.176 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.176 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2020-06-27T04:39:55.176 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9685509204864502, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.177 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-06-27T04:39:55.177 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.177 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.177 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.177 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2020-06-27T04:39:55.177 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.178 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.178 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.178 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.178 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.178 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.178 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.179 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.179 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.179 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.179 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.179 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2020-06-27T04:39:55.180 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2020-06-27T04:39:55.180 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2020-06-27T04:39:55.180 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.180 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2020-06-27T04:39:55.180 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2020-06-27T04:39:55.180 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.181 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.181 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.181 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2020-06-27T04:39:55.181 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.181 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.182 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.182 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.182 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.182 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9692575931549072, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.182 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.183 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.183 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.183 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2020-06-27T04:39:55.183 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2020-06-27T04:39:55.183 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.183 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.184 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.184 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2020-06-27T04:39:55.184 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.184 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.184 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.184 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.185 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.185 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.185 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.185 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.185 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2020-06-27T04:39:55.186 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2020-06-27T04:39:55.186 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.186 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.186 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.186 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:39:55.186 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.187 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.187 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.187 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.187 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.187 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.188 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.188 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.96994948387146, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.188 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.188 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-06-27T04:39:55.188 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-06-27T04:39:55.188 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.189 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.189 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.189 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2020-06-27T04:39:55.189 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.189 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.190 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.190 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.190 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.190 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.191 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.191 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.191 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.191 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.191 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.192 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.192 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.192 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.192 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.192 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.192 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.193 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.193 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.193 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.193 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.193 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.193 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.194 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.194 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9706456661224365, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.194 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.194 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.194 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.195 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.195 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.195 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.195 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.195 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.195 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.196 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.196 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.196 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.196 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.196 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.197 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.197 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.197 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.197 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.197 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.197 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.198 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.198 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.198 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.198 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.198 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.199 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.199 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.199 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.199 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.199 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9713077545166016, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.199 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.200 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.200 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.200 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.200 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.200 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.201 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.201 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.201 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.201 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.201 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.201 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.202 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.202 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.202 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.202 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.202 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.202 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.203 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.203 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.203 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.203 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.203 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.204 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.204 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.204 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2020-06-27T04:39:55.204 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2020-06-27T04:39:55.204 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.204 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.205 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.205 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9719882011413574, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.205 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:39:55.205 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.205 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.206 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.206 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.206 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.206 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.206 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.206 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.207 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2020-06-27T04:39:55.207 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2020-06-27T04:39:55.207 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.207 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.207 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.208 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2020-06-27T04:39:55.208 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.208 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.208 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.208 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.208 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.209 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.209 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.209 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.209 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2020-06-27T04:39:55.209 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2020-06-27T04:39:55.210 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.210 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.210 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.210 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2020-06-27T04:39:55.210 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.210 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.972665548324585, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.211 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.211 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.211 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.211 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.211 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.211 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.212 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.212 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2020-06-27T04:39:55.212 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2020-06-27T04:39:55.212 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.212 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.213 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.213 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2020-06-27T04:39:55.213 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.213 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.214 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.214 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.214 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.214 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.214 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.214 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.215 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2020-06-27T04:39:55.226 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2020-06-27T04:39:55.226 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.226 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.226 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.227 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:39:55.227 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.227 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.227 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.227 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9733703136444092, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.228 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.228 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.228 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.228 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.228 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.228 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2020-06-27T04:39:55.229 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2020-06-27T04:39:55.229 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.229 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.229 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.229 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2020-06-27T04:39:55.230 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.230 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.230 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.230 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.230 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.230 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.231 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.231 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.231 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.231 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.231 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.232 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2020-06-27T04:39:55.232 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.232 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.232 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.232 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.232 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.233 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.233 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.233 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.233 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.233 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9740872383117676, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.234 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.234 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.234 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.234 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.234 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.234 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.235 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.235 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.235 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.235 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.235 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.236 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.236 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.236 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.236 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.236 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.237 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.237 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.237 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.237 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.237 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.237 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.238 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.238 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.238 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.238 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.239 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.239 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.239 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.239 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.239 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9747598171234131, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.240 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.240 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.240 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.240 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.240 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.240 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.241 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.241 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.241 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.241 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.241 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.242 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.242 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.242 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.242 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.242 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.243 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.243 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.243 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.243 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.243 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.243 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.244 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.244 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.244 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.244 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.244 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.245 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.245 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.245 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.245 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9754514694213867, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.245 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.245 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.246 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.246 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.246 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.246 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.246 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.247 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2020-06-27T04:39:55.247 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.247 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.247 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.247 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.247 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.248 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.248 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.248 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.248 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.248 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.248 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.249 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.249 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.249 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.249 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.249 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.250 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.250 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.250 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.250 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.250 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.250 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9761996269226074, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.252 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.252 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.252 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.252 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.252 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.252 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.255 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.255 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.255 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.255 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.255 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.256 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.256 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.256 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.256 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.256 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.256 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9768548011779785, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2020-06-27T04:39:55.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2020-06-27T04:39:55.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2020-06-27T04:39:55.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9775593280792236, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2020-06-27T04:39:55.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2020-06-27T04:39:55.264 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.264 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.264 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.264 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.264 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2020-06-27T04:39:55.265 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2020-06-27T04:39:55.265 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.265 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.265 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.265 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2020-06-27T04:39:55.265 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2020-06-27T04:39:55.266 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.266 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.266 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2020-06-27T04:39:55.266 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.266 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.267 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.267 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.267 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.267 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.267 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.267 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.268 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9782288074493408, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.268 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.268 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.268 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.268 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.269 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.269 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.269 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.269 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.270 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.270 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.270 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.270 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.270 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.270 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.271 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.271 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.271 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.271 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.271 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.273 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.273 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.273 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.273 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.273 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.274 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9789547920227051, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.274 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.274 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.274 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.274 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.274 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.276 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.276 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.276 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.276 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.277 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.277 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.277 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.277 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.278 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.278 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.278 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.278 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.278 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.278 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.279 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.279 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.279 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.279 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.279 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.280 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.280 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.97963547706604, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.280 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.280 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.280 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.280 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.281 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.281 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.281 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.281 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.281 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.282 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2020-06-27T04:39:55.282 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.282 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.282 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.282 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2020-06-27T04:39:55.283 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2020-06-27T04:39:55.283 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.283 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.283 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.283 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2020-06-27T04:39:55.283 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.284 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.284 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.284 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2020-06-27T04:39:55.284 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.284 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.284 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.285 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.285 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.285 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.285 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.285 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9803073406219482, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.286 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.286 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.286 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.286 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.286 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.286 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.287 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.287 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.287 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.287 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.287 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.288 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.288 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.288 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.288 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.288 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.288 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.289 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.289 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.289 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.289 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.289 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.290 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.290 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.290 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.290 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.290 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.291 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.291 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.291 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.291 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9809927940368652, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.291 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.291 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.292 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.292 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.292 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.292 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.292 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.292 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.293 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.293 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.293 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.293 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.293 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.294 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.294 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.294 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.294 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.294 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.294 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.295 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.295 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.295 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.295 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.295 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.296 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.296 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.296 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.296 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.296 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.296 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.297 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9816634654998779, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.297 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.297 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.297 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.297 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.298 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.298 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.298 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.298 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2020-06-27T04:39:55.298 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2020-06-27T04:39:55.299 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.299 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.299 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.299 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.299 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.299 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2020-06-27T04:39:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.301 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2020-06-27T04:39:55.301 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2020-06-27T04:39:55.301 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.301 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.301 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.302 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2020-06-27T04:39:55.302 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.302 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.302 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9823331832885742, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.302 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.303 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2020-06-27T04:39:55.303 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.303 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.303 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.303 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.303 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2020-06-27T04:39:55.304 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2020-06-27T04:39:55.304 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.304 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.304 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.304 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2020-06-27T04:39:55.305 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.305 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.305 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.305 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2020-06-27T04:39:55.305 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.305 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.306 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.306 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.306 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2020-06-27T04:39:55.306 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2020-06-27T04:39:55.306 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.307 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.307 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.307 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.307 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.307 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9829530715942383, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.307 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.308 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.308 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2020-06-27T04:39:55.308 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.308 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.308 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.309 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.309 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2020-06-27T04:39:55.309 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2020-06-27T04:39:55.309 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.310 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.310 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.310 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2020-06-27T04:39:55.310 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.310 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.310 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.311 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2020-06-27T04:39:55.311 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.311 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.311 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.311 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.312 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.312 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.312 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.312 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2020-06-27T04:39:55.312 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.312 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.313 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.313 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.313 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.313 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9836297035217285, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.313 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.314 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.314 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.314 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.314 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.314 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.314 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.315 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.315 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.315 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.315 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.315 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.316 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.316 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.316 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.316 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.316 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.316 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.317 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.317 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.317 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.317 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.317 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.318 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.318 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.318 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.318 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.318 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.318 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.319 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.319 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9843735694885254, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.319 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.319 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.319 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.319 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.320 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.320 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.320 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.320 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.320 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.321 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.321 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.321 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.321 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.321 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.321 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.322 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.322 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.322 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.322 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.323 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.323 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.323 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.323 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.323 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.324 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.324 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.324 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.324 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.324 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.324 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.325 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.374+0000 7f98d2b60700 1 -- 172.21.15.31:0/1350871160 >> v2:172.21.15.31:6800/769686724 conn(0x7f98a802aad0 msgr2=0x7f98a802cf90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-06-27T04:39:55.325 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.374+0000 7f98d2b60700 1 --2- 172.21.15.31:0/1350871160 >> v2:172.21.15.31:6800/769686724 conn(0x7f98a802aad0 0x7f98a802cf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-06-27T04:39:55.325 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.374+0000 7f98d2b60700 1 -- 172.21.15.31:0/1350871160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98cc0713f0 msgr2=0x7f98cc06f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:55.325 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.374+0000 7f98d2b60700 1 --2- 172.21.15.31:0/1350871160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98cc0713f0 0x7f98cc06f810 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f98c40032f0 tx=0x7f98c40092b0).stop 2020-06-27T04:39:55.325 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.374+0000 7f98d2b60700 1 -- 172.21.15.31:0/1350871160 shutdown_connections 2020-06-27T04:39:55.326 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9852607250213623, stop=False, exit=None, reads=[8, 10] 2020-06-27T04:39:55.326 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.326 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.326 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.326 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.327 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.327 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.327 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.327 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.327 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2020-06-27T04:39:55.327 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2020-06-27T04:39:55.328 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.328 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.328 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.328 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:39:55.328 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2020-06-27T04:39:55.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2020-06-27T04:39:55.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2020-06-27T04:39:55.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2020-06-27T04:39:55.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2020-06-27T04:39:55.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.332 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.374+0000 7f98d2b60700 1 --2- 172.21.15.31:0/1350871160 >> v2:172.21.15.31:6800/769686724 conn(0x7f98a802aad0 0x7f98a802cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-06-27T04:39:55.332 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.374+0000 7f98d2b60700 1 --2- 172.21.15.31:0/1350871160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98cc0713f0 0x7f98cc06f810 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:55.332 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.374+0000 7f98d2b60700 1 -- 172.21.15.31:0/1350871160 >> 172.21.15.31:0/1350871160 conn(0x7f98cc0252f0 msgr2=0x7f98cc0635d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:55.332 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.374+0000 7f98d2b60700 1 -- 172.21.15.31:0/1350871160 shutdown_connections 2020-06-27T04:39:55.332 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:54.374+0000 7f98d2b60700 1 -- 172.21.15.31:0/1350871160 wait complete. 2020-06-27T04:39:55.333 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9861958026885986, stop=False, exit=None, reads=[8, 10] 2020-06-27T04:39:55.333 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.333 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.333 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.333 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.334 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.334 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.334 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.334 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.334 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.334 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.335 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.335 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.335 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.335 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.335 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.335 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.336 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.336 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.336 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.336 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.336 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.337 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.337 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.337 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.337 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.337 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.337 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.338 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.338 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.338 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.338 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9869523048400879, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.338 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.339 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.339 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.339 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.339 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.339 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.339 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.340 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.340 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.340 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.340 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.340 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.341 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.341 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.341 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.341 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.341 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.342 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.342 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.342 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.342 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.342 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.342 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.343 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.343 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.343 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.343 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.343 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.344 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.344 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.344 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9876828193664551, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.344 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.344 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.344 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.345 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.345 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.345 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.345 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.345 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.346 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.346 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.346 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.346 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.346 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.346 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.347 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2020-06-27T04:39:55.347 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.347 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.347 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.347 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.348 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.348 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.348 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.348 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.348 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.348 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.349 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.349 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.349 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.349 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.349 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.350 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.350 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.350 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9884283542633057, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.350 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.350 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.350 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.351 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.351 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.351 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.351 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.351 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.351 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.352 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.352 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.352 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.352 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.352 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.355 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.355 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.355 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.355 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.355 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9891698360443115, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.357 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.357 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.357 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.357 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.357 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2020-06-27T04:39:55.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-06-27T04:39:55.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9898793697357178, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2020-06-27T04:39:55.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.365 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.365 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2020-06-27T04:39:55.365 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.365 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.365 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.367 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.367 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.367 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.367 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.367 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.990628719329834, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.371 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.371 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.371 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.371 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.371 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.372 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.372 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.372 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.372 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.372 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.372 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.373 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.373 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.373 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.373 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.373 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.374 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.374 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.991321325302124, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.374 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.374 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.374 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.375 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.375 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.375 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.375 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.375 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.375 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.376 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.376 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.376 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.376 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.376 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.377 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.377 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.377 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.377 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.377 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.378 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.378 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.378 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.378 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.378 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.379 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.379 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.379 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2020-06-27T04:39:55.379 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2020-06-27T04:39:55.379 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.380 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9919919967651367, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.380 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.380 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.380 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2020-06-27T04:39:55.380 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.380 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.381 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.381 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2020-06-27T04:39:55.381 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.381 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.381 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.382 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.382 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2020-06-27T04:39:55.382 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2020-06-27T04:39:55.382 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:39:55.382 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.382 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.383 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2020-06-27T04:39:55.383 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.383 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.383 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.383 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2020-06-27T04:39:55.384 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.384 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.384 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.384 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.384 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.384 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.385 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.385 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2020-06-27T04:39:55.385 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.385 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9926884174346924, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.385 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.387 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.387 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.387 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.387 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.387 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.387 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.388 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.388 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.388 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.388 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.388 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.389 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.389 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.389 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.389 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.389 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.389 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.390 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.390 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.390 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.390 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.390 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.391 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.391 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.391 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9933915138244629, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.391 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.391 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.391 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.392 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.392 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.392 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.392 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.392 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.393 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.393 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.393 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.393 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.393 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.393 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.394 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.394 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.394 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.394 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.394 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.395 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.395 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.395 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.395 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.395 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.395 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.396 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.396 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.396 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.396 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.396 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.397 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9940662384033203, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.397 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.397 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.397 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.397 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.397 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.399 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.399 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.399 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2020-06-27T04:39:55.399 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2020-06-27T04:39:55.399 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.399 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2020-06-27T04:39:55.402 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2020-06-27T04:39:55.402 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9947142601013184, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.402 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.402 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.402 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "300", 2020-06-27T04:39:55.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.404 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.404 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.404 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.404 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2020-06-27T04:39:55.404 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2020-06-27T04:39:55.404 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.406 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.406 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.406 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.406 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.407 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.407 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.407 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2020-06-27T04:39:55.407 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2020-06-27T04:39:55.407 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.408 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9953835010528564, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.408 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.408 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.408 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.408 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.408 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.409 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.409 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.409 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.409 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.409 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.410 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.410 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2020-06-27T04:39:55.410 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2020-06-27T04:39:55.410 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.410 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.410 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.411 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.411 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.411 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.411 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.411 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.412 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.412 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.412 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.412 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.412 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "stale_cache_strategy": { 2020-06-27T04:39:55.412 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "stale_cache_strategy", 2020-06-27T04:39:55.413 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.413 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.413 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9960401058197021, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.413 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.413 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.414 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.414 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.414 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.414 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.414 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.414 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.415 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.415 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.415 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.415 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.415 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.416 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2020-06-27T04:39:55.416 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.416 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.416 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.416 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.416 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.418 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.418 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.418 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.418 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.418 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.418 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.419 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.419 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.419 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.419 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9967803955078125, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.419 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.420 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.420 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.420 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.420 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.420 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.420 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.421 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.421 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.421 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.421 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.421 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.422 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.422 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.422 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.422 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.422 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.422 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.423 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.423 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.423 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.423 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.423 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.424 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.424 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.424 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.424 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.424 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.424 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.425 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9974572658538818, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.425 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.425 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.425 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.425 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.426 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.426 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.426 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.426 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.426 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.426 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.427 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.427 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.427 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.427 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.427 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.428 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.428 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.428 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.428 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.428 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.428 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.429 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.429 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.429 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.429 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.429 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2020-06-27T04:39:55.430 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2020-06-27T04:39:55.430 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.430 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.430 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9981441497802734, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.430 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.431 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.432 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.432 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.432 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.432 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.432 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.433 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.433 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.433 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.433 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2020-06-27T04:39:55.433 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2020-06-27T04:39:55.434 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.434 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.434 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.434 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.434 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.434 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.435 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.435 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.435 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.435 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.435 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.436 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.436 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.436 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.436 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.436 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2020-06-27T04:39:55.437 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.438 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.438 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.438 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_auth": { 2020-06-27T04:39:55.438 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9988839626312256, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.438 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_auth", 2020-06-27T04:39:55.439 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.439 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.439 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.439 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:55.439 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.439 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.440 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.440 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.440 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.440 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.440 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.441 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.441 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2020-06-27T04:39:55.441 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2020-06-27T04:39:55.441 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.441 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.442 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.442 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.442 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.442 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.442 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.443 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.443 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.443 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.443 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.443 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.444 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.444 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.444 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.444 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.999565839767456, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.444 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.444 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.445 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.445 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.445 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.445 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.445 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.446 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.446 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.446 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.446 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.446 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.447 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.448 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.448 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.448 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.448 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.448 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.449 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.449 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.449 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.449 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.449 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.449 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.450 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.450 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.450 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.450 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.450 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.451 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.451 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.000258445739746, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.451 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.451 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.451 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.451 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.452 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.452 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.452 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.452 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.453 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.453 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.454 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.455 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.455 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.455 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.455 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.456 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.456 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.456 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.456 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.456 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.457 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.457 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.457 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.457 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.457 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.458 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.458 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.458 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.458 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.458 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.459 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0010426044464111, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.459 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.459 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.459 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.459 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.460 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.460 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.460 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.460 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2020-06-27T04:39:55.460 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2020-06-27T04:39:55.461 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.461 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.461 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.461 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.461 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.462 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.462 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.462 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.462 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.462 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.463 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.463 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.463 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2020-06-27T04:39:55.463 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2020-06-27T04:39:55.463 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.464 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.464 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.464 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.464 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.465 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.465 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0018839836120605, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.465 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.465 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.465 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.466 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.466 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.466 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.466 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.466 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.467 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.467 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2020-06-27T04:39:55.467 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.467 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.467 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.468 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.468 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.468 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.469 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.469 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.469 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.470 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.470 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.470 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.470 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.471 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.471 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.471 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.471 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.471 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.471 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.472 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.472 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.472 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.472 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.472 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.473 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.002704381942749, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.473 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.473 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.473 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.473 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.473 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.474 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.474 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.474 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.474 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.474 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.475 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.475 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.475 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.475 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.475 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.475 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.476 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.476 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.476 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.476 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.476 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.477 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.477 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.477 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.477 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.477 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.477 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.478 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.478 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.003352403640747, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.478 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.478 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.479 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.479 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.479 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.479 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.479 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.480 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.480 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.480 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.480 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.480 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.481 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.481 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.481 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.481 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.481 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.482 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.482 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.482 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.482 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.482 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.482 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.483 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.483 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2020-06-27T04:39:55.483 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.483 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.483 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.484 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.484 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.484 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.484 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.484 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.484 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0041203498840332, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.485 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.485 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.485 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.485 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.485 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.486 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.486 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.486 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.486 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.486 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.486 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.487 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.487 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.487 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.487 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.487 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.487 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.488 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.488 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.488 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.488 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.488 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.489 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.489 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.489 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.489 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.489 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.489 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.490 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.490 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.490 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0048062801361084, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.490 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.490 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.491 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.491 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.491 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.491 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.491 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.491 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.492 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.492 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.492 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.492 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.492 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.493 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.493 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.493 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.493 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.493 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.493 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.494 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.494 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.494 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.494 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.494 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.495 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.495 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.495 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.495 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.495 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.495 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.496 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.005497932434082, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.496 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.496 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.496 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.496 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.497 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.497 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2020-06-27T04:39:55.497 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2020-06-27T04:39:55.497 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.497 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.497 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.498 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.498 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.498 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.498 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.498 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.498 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.499 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.499 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.501 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.501 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2020-06-27T04:39:55.501 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2020-06-27T04:39:55.501 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.502 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.502 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.502 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2020-06-27T04:39:55.502 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.502 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.503 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.503 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.503 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.503 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0062010288238525, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.503 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.503 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.504 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.504 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2020-06-27T04:39:55.504 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2020-06-27T04:39:55.504 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.504 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.505 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.505 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.505 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.505 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.505 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.505 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.506 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.506 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.506 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.506 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.506 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2020-06-27T04:39:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2020-06-27T04:39:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.508 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.508 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.508 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.508 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.508 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.509 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.509 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.007115364074707, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.509 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.509 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2020-06-27T04:39:55.509 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2020-06-27T04:39:55.509 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2020-06-27T04:39:55.510 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.510 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.510 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.510 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.510 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2020-06-27T04:39:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2020-06-27T04:39:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2020-06-27T04:39:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.008049726486206, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2020-06-27T04:39:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2020-06-27T04:39:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2020-06-27T04:39:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.519 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.519 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.519 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.519 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.519 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.519 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2020-06-27T04:39:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2020-06-27T04:39:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0087382793426514, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.521 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.521 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.521 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.521 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.521 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2020-06-27T04:39:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2020-06-27T04:39:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.524 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.524 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.524 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.524 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.524 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.524 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.525 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2020-06-27T04:39:55.525 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2020-06-27T04:39:55.525 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.525 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.525 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.526 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0094447135925293, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.526 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.526 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.526 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.526 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.526 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.527 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.527 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.527 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.527 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.527 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.528 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.528 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.528 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2020-06-27T04:39:55.528 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.528 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.528 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.529 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.529 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.529 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.529 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.529 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.530 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.530 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.530 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.530 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.530 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.530 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.534 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.535 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.535 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.535 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.535 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.535 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0101814270019531, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.536 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.536 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.536 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.536 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.536 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.537 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.537 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.537 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.537 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.537 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.538 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.538 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.538 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.538 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.538 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.539 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.539 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.539 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.539 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.539 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.539 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.540 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.540 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.540 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.540 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.540 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.541 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.541 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.541 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.541 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0110485553741455, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.541 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.542 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.542 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.542 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.542 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.542 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.542 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.543 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.543 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.543 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.543 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.543 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.544 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.544 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.544 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.544 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.544 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.544 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.545 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.545 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.545 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.545 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.545 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.545 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.546 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.546 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.546 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.546 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.546 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2020-06-27T04:39:55.547 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.547 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.547 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.547 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2020-06-27T04:39:55.547 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.012436866760254, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.547 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2020-06-27T04:39:55.548 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.548 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.548 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.548 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2020-06-27T04:39:55.548 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.549 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.549 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.549 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.549 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.549 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.550 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.550 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.550 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-06-27T04:39:55.550 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-06-27T04:39:55.550 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:39:55.550 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.551 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.551 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2020-06-27T04:39:55.551 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.551 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.551 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.552 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.552 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.552 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.552 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.552 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.552 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.553 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.553 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0138421058654785, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.553 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.553 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.553 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.554 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.554 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.554 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.554 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.554 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.554 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.555 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.555 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.555 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.555 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.555 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.556 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.556 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.556 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.556 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.556 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.556 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.557 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.557 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.557 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.557 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.557 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.558 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.558 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.558 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.558 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.558 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.558 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.01527738571167, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.559 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.559 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.559 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.559 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.559 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.560 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.560 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.560 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.560 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.560 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.560 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.561 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.561 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.561 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.561 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.562 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.562 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.562 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.562 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.562 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.563 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.563 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.563 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.563 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.563 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.563 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.564 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.564 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.564 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.564 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.564 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0166964530944824, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.565 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.565 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.565 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.565 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.565 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.565 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.566 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.566 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.566 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.566 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.566 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.567 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2020-06-27T04:39:55.567 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.567 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.567 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.567 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2020-06-27T04:39:55.567 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2020-06-27T04:39:55.568 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.568 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.568 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.568 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:55.568 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.569 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.569 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.569 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2020-06-27T04:39:55.569 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.569 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.569 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.570 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.570 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2020-06-27T04:39:55.570 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0177009105682373, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.570 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2020-06-27T04:39:55.570 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.571 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.571 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.571 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:55.571 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.573 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.573 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2020-06-27T04:39:55.573 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2020-06-27T04:39:55.573 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.573 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.574 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.574 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:39:55.574 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.574 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.574 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.574 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.575 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.575 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.575 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.575 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.575 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2020-06-27T04:39:55.576 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2020-06-27T04:39:55.576 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.576 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0183889865875244, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.576 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.576 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.576 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.577 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.577 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.577 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.577 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.577 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.578 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.578 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.578 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.578 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2020-06-27T04:39:55.578 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2020-06-27T04:39:55.578 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.579 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.579 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.579 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:39:55.579 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.579 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.580 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.580 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.580 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.580 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.580 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.580 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.581 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2020-06-27T04:39:55.581 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2020-06-27T04:39:55.581 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.581 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.581 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.019054889678955, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.581 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.582 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:39:55.582 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.582 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.582 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.582 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.583 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.583 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.583 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.583 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.583 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2020-06-27T04:39:55.583 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2020-06-27T04:39:55.584 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.584 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.584 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.584 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2020-06-27T04:39:55.584 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.585 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.585 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.585 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.585 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.585 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.585 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.586 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.586 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2020-06-27T04:39:55.586 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2020-06-27T04:39:55.586 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.586 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.586 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.587 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0197069644927979, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.587 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.587 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.587 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.587 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.588 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.588 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.588 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.588 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.588 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.588 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-06-27T04:39:55.589 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-06-27T04:39:55.589 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.589 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.589 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.589 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2020-06-27T04:39:55.590 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2020-06-27T04:39:55.590 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.590 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.590 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.590 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.590 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.591 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.591 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.591 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2020-06-27T04:39:55.591 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2020-06-27T04:39:55.591 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.592 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.592 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.592 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2020-06-27T04:39:55.592 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0204343795776367, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.592 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.592 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.593 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.593 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.593 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.593 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.593 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.594 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.594 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2020-06-27T04:39:55.594 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2020-06-27T04:39:55.594 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.594 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.594 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.595 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.595 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.595 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.595 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.595 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.596 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.596 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.596 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.596 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.596 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.596 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.598 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.598 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0211842060089111, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.598 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.598 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.598 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.598 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.599 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.599 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.599 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.599 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.599 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.600 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.600 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.600 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.600 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.600 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.601 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.601 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.601 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.601 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.601 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.602 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.602 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.602 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.602 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.602 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.603 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.603 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.603 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.603 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.603 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.603 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.604 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0219378471374512, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.604 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.604 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.604 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.604 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.604 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.605 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.605 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.605 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.605 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.605 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.606 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.606 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.606 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.606 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.606 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.606 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.607 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.607 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.607 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.607 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.607 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.608 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.608 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.608 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.608 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.608 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.608 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.609 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.609 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.609 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.609 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0226781368255615, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.609 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.610 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.610 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2020-06-27T04:39:55.610 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2020-06-27T04:39:55.610 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.610 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.610 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.611 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:39:55.612 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.612 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.612 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.612 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.612 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.613 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.613 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.613 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.613 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2020-06-27T04:39:55.613 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2020-06-27T04:39:55.614 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.614 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.614 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.614 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:39:55.614 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.615 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.615 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.615 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.615 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.615 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.615 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.616 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.616 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0234277248382568, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.616 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2020-06-27T04:39:55.616 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2020-06-27T04:39:55.616 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2020-06-27T04:39:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.618 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.618 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.618 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.618 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.618 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.619 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.619 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.619 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.619 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2020-06-27T04:39:55.619 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.619 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.620 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.620 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.620 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.620 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.620 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.621 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.621 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.621 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.621 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.621 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.622 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.622 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0241777896881104, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.622 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.622 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.622 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.622 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.623 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.623 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.623 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.623 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.623 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.624 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.624 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.624 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.624 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.624 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.624 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.625 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.625 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.625 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.625 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.625 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.626 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.626 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.626 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.626 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.626 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.626 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.627 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.627 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.627 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.627 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.627 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0248711109161377, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.628 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.628 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.628 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.628 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.628 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.629 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.629 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.629 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.630 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.630 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.630 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.630 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.630 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.630 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.631 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.631 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.631 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.631 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.631 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.632 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.632 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.632 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.632 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.632 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.632 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.634 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.634 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0255823135375977, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.634 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.634 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.634 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2020-06-27T04:39:55.635 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.635 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.635 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.635 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.636 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.636 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.636 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.636 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.636 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.637 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.637 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.637 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.637 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.637 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0263001918792725, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.641 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.641 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.641 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.641 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.641 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.645 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.645 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.645 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.645 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.645 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.646 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.646 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.646 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0269834995269775, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.646 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.646 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.646 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2020-06-27T04:39:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:39:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:39:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:39:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2020-06-27T04:39:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2020-06-27T04:39:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.651 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.651 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2020-06-27T04:39:55.651 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.651 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.651 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.651 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.652 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0276825428009033, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.652 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.652 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.652 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.652 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.653 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2020-06-27T04:39:55.653 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2020-06-27T04:39:55.653 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.653 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.653 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.654 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.654 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.654 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.654 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.655 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.655 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.655 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.655 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.655 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.656 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-06-27T04:39:55.656 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-06-27T04:39:55.656 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:39:55.656 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.656 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.657 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2020-06-27T04:39:55.657 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.657 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.657 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.658 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.658 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.658 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.658 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0283606052398682, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.658 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.659 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.659 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:39:55.659 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:39:55.659 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.659 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.659 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.660 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:39:55.660 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.660 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.660 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.660 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.661 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.661 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.661 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.661 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.661 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.661 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.662 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.662 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.662 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.662 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.662 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.663 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:39:55.663 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:39:55.663 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.663 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.663 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.663 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.664 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.664 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.029036045074463, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.664 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.664 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.664 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.665 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.665 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.665 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.665 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.665 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:39:55.665 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:39:55.666 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.666 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.666 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.666 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:39:55.666 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.667 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.667 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:39:55.667 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:39:55.667 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:39:55.667 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:39:55.667 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:39:55.668 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:39:55.668 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:39:55.668 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.668 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.668 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.669 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.669 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.669 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.669 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:39:55.669 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:39:55.670 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0297131538391113, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.670 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:39:55.670 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.670 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:39:55.670 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:39:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.672 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.672 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.672 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.672 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2020-06-27T04:39:55.672 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2020-06-27T04:39:55.672 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.673 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.673 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.674 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:39:55.675 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.675 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.675 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.675 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.675 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.675 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.676 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.676 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.676 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2020-06-27T04:39:55.676 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2020-06-27T04:39:55.676 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:39:55.677 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0303738117218018, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.677 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.677 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.677 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2020-06-27T04:39:55.677 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.678 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.678 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.678 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.678 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.678 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.678 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.679 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.679 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2020-06-27T04:39:55.679 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2020-06-27T04:39:55.679 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:39:55.679 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:39:55.679 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:39:55.680 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2020-06-27T04:39:55.680 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:39:55.680 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:39:55.680 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:39:55.680 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:39:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:39:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:39:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:39:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.682 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.682 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2020-06-27T04:39:55.682 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2020-06-27T04:39:55.682 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2020-06-27T04:39:55.682 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2020-06-27T04:39:55.683 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2020-06-27T04:39:55.683 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0311143398284912, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.683 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2020-06-27T04:39:55.683 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2020-06-27T04:39:55.683 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2020-06-27T04:39:55.683 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2020-06-27T04:39:55.684 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2020-06-27T04:39:55.684 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2020-06-27T04:39:55.684 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.684 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2020-06-27T04:39:55.684 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2020-06-27T04:39:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2020-06-27T04:39:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2020-06-27T04:39:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2020-06-27T04:39:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2020-06-27T04:39:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2020-06-27T04:39:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2020-06-27T04:39:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2020-06-27T04:39:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2020-06-27T04:39:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2020-06-27T04:39:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2020-06-27T04:39:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pacific": [ 2020-06-27T04:39:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2020-06-27T04:39:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2020-06-27T04:39:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2020-06-27T04:39:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2020-06-27T04:39:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2020-06-27T04:39:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2020-06-27T04:39:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2020-06-27T04:39:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2020-06-27T04:39:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2020-06-27T04:39:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2020-06-27T04:39:55.689 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2020-06-27T04:39:55.689 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:39:55.689 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 0, 2020-06-27T04:39:55.689 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2020-06-27T04:39:55.689 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.689 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2020-06-27T04:39:55.690 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.690 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2020-06-27T04:39:55.690 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.31:0", 2020-06-27T04:39:55.690 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0320074558258057, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.690 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1159003614 2020-06-27T04:39:55.691 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.691 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-06-27T04:39:55.691 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.691 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.691 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2020-06-27T04:39:55.692 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.692 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2020-06-27T04:39:55.693 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.31:0", 2020-06-27T04:39:55.693 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 4226471217 2020-06-27T04:39:55.693 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.693 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-06-27T04:39:55.693 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:39:55.694 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.694 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2020-06-27T04:39:55.694 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:55.694 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2020-06-27T04:39:55.694 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.31:0", 2020-06-27T04:39:55.695 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 121410604 2020-06-27T04:39:55.695 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.695 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-06-27T04:39:55.695 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.695 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-06-27T04:39:55.695 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.696 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:55.696 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0325829982757568, stop=False, exit=None, reads=[8] 2020-06-27T04:39:55.696 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:54 smithi031 bash[18426]: audit 2020-06-27T04:39:53.073989+0000 mon.a (mon.0) 35 : audit [INF] from='client.? 172.21.15.31:0/4172730682' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2020-06-27T04:39:55.696 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:54 smithi031 bash[18426]: cluster 2020-06-27T04:39:53.074045+0000 mon.a (mon.0) 36 : cluster [DBG] mgrmap e5: y(active, since 5s) 2020-06-27T04:39:55.703 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.4529690742492676, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:39:55.703 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.4531822204589844, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:39:55.703 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Waiting for the mgr to restart... 2020-06-27T04:39:55.704 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Waiting for mgr epoch 5... 2020-06-27T04:39:55.704 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'tell', 'mgr', 'mgr_status'] 2020-06-27T04:39:55.704 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 tell mgr mgr_status 2020-06-27T04:39:55.704 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.543+0000 7fe72a0be700 1 Processor -- start 2020-06-27T04:39:55.704 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.543+0000 7fe72a0be700 1 -- start start 2020-06-27T04:39:55.705 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.543+0000 7fe72a0be700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe724064730 0x7fe724064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:55.705 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.543+0000 7fe72a0be700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240651a0 con 0x7fe724064730 2020-06-27T04:39:55.705 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.543+0000 7fe723fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe724064730 0x7fe724064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:55.705 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6373260021209717, stop=False, exit=None, reads=[10] 2020-06-27T04:39:55.705 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.544+0000 7fe723fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe724064730 0x7fe724064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38520/0 (socket says 172.21.15.31:38520) 2020-06-27T04:39:55.706 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.544+0000 7fe723fff700 1 -- 172.21.15.31:0/3615781835 learned_addr learned my addr 172.21.15.31:0/3615781835 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:55.706 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.544+0000 7fe723fff700 1 -- 172.21.15.31:0/3615781835 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe724065a20 con 0x7fe724064730 2020-06-27T04:39:55.706 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.544+0000 7fe723fff700 1 --2- 172.21.15.31:0/3615781835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe724064730 0x7fe724064b50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fe714002f70 tx=0x7fe714006ec0).ready entity=mon.0 client_cookie=6f89a4a52d0bc159 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:55.706 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.544+0000 7fe722ffd700 1 -- 172.21.15.31:0/3615781835 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fe714009980 con 0x7fe724064730 2020-06-27T04:39:55.706 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6376504898071289, stop=False, exit=None, reads=[10] 2020-06-27T04:39:55.706 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.544+0000 7fe722ffd700 1 -- 172.21.15.31:0/3615781835 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fe714000e90 con 0x7fe724064730 2020-06-27T04:39:55.707 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.544+0000 7fe722ffd700 1 -- 172.21.15.31:0/3615781835 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fe714011c70 con 0x7fe724064730 2020-06-27T04:39:55.707 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.544+0000 7fe72a0be700 1 -- 172.21.15.31:0/3615781835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe724064730 msgr2=0x7fe724064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:55.707 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.544+0000 7fe72a0be700 1 --2- 172.21.15.31:0/3615781835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe724064730 0x7fe724064b50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fe714002f70 tx=0x7fe714006ec0).stop 2020-06-27T04:39:55.707 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.544+0000 7fe72a0be700 1 -- 172.21.15.31:0/3615781835 shutdown_connections 2020-06-27T04:39:55.707 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6378748416900635, stop=False, exit=None, reads=[10] 2020-06-27T04:39:55.708 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.544+0000 7fe72a0be700 1 --2- 172.21.15.31:0/3615781835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe724064730 0x7fe724064b50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:55.708 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.544+0000 7fe72a0be700 1 -- 172.21.15.31:0/3615781835 >> 172.21.15.31:0/3615781835 conn(0x7fe72405ffe0 msgr2=0x7fe724062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:55.708 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.544+0000 7fe72a0be700 1 -- 172.21.15.31:0/3615781835 shutdown_connections 2020-06-27T04:39:55.708 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.544+0000 7fe72a0be700 1 -- 172.21.15.31:0/3615781835 wait complete. 2020-06-27T04:39:55.708 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.545+0000 7fe72a0be700 1 Processor -- start 2020-06-27T04:39:55.709 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6381239891052246, stop=False, exit=None, reads=[10] 2020-06-27T04:39:55.709 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.546+0000 7fe72a0be700 1 -- start start 2020-06-27T04:39:55.709 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6382312774658203, stop=False, exit=None, reads=[10] 2020-06-27T04:39:55.709 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.546+0000 7fe72a0be700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7240785e0 0x7fe724078a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:55.709 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.546+0000 7fe72a0be700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe724079050 con 0x7fe7240785e0 2020-06-27T04:39:55.709 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6383745670318604, stop=False, exit=None, reads=[10] 2020-06-27T04:39:55.710 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.546+0000 7fe723fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7240785e0 0x7fe724078a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:55.710 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.546+0000 7fe723fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7240785e0 0x7fe724078a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38522/0 (socket says 172.21.15.31:38522) 2020-06-27T04:39:55.710 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.546+0000 7fe723fff700 1 -- 172.21.15.31:0/333520326 learned_addr learned my addr 172.21.15.31:0/333520326 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:55.710 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6385769844055176, stop=False, exit=None, reads=[10] 2020-06-27T04:39:55.710 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.546+0000 7fe723fff700 1 -- 172.21.15.31:0/333520326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7240799b0 con 0x7fe7240785e0 2020-06-27T04:39:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6386914253234863, stop=False, exit=None, reads=[10] 2020-06-27T04:39:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.546+0000 7fe723fff700 1 --2- 172.21.15.31:0/333520326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7240785e0 0x7fe724078a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe714002f70 tx=0x7fe714006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.638775110244751, stop=False, exit=None, reads=[10] 2020-06-27T04:39:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.546+0000 7fe70bfff700 1 -- 172.21.15.31:0/333520326 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fe714010940 con 0x7fe7240785e0 2020-06-27T04:39:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.546+0000 7fe70bfff700 1 -- 172.21.15.31:0/333520326 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fe714010ee0 con 0x7fe7240785e0 2020-06-27T04:39:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6390345096588135, stop=False, exit=None, reads=[10] 2020-06-27T04:39:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.547+0000 7fe72a0be700 1 -- 172.21.15.31:0/333520326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe724079c00 con 0x7fe7240785e0 2020-06-27T04:39:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.547+0000 7fe70bfff700 1 -- 172.21.15.31:0/333520326 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fe71401bc90 con 0x7fe7240785e0 2020-06-27T04:39:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.547+0000 7fe72a0be700 1 -- 172.21.15.31:0/333520326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72407a030 con 0x7fe7240785e0 2020-06-27T04:39:55.713 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6392405033111572, stop=False, exit=None, reads=[10] 2020-06-27T04:39:55.713 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.547+0000 7fe70bfff700 1 -- 172.21.15.31:0/333520326 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 31790+0+0 (secure 0 0 0) 0x7fe71400f070 con 0x7fe7240785e0 2020-06-27T04:39:55.713 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6398708820343018, stop=False, exit=None, reads=[10] 2020-06-27T04:39:55.713 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.548+0000 7fe70bfff700 1 --2- 172.21.15.31:0/333520326 >> v2:172.21.15.31:6800/769686724 conn(0x7fe70402aad0 0x7fe70402cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:55.713 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6400344371795654, stop=False, exit=None, reads=[10] 2020-06-27T04:39:55.713 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.548+0000 7fe72a0be700 1 -- 172.21.15.31:0/333520326 --> v2:172.21.15.31:6800/769686724 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe724079190 con 0x7fe70402aad0 2020-06-27T04:39:55.714 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.548+0000 7fe70bfff700 1 -- 172.21.15.31:0/333520326 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1154+0+0 (secure 0 0 0) 0x7fe71403b7b0 con 0x7fe7240785e0 2020-06-27T04:39:55.714 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.548+0000 7fe7237fe700 1 -- 172.21.15.31:0/333520326 >> v2:172.21.15.31:6800/769686724 conn(0x7fe70402aad0 msgr2=0x7fe70402cf90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/769686724 2020-06-27T04:39:55.714 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.548+0000 7fe7237fe700 1 --2- 172.21.15.31:0/333520326 >> v2:172.21.15.31:6800/769686724 conn(0x7fe70402aad0 0x7fe70402cf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2020-06-27T04:39:55.714 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6402096748352051, stop=False, exit=None, reads=[10] 2020-06-27T04:39:55.715 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:55 smithi031 bash[18426]: audit 2020-06-27T04:39:54.370763+0000 mon.a (mon.0) 37 : audit [DBG] from='client.? 172.21.15.31:0/1350871160' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2020-06-27T04:39:55.753 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.749+0000 7fe7237fe700 1 -- 172.21.15.31:0/333520326 >> v2:172.21.15.31:6800/769686724 conn(0x7fe70402aad0 msgr2=0x7fe70402cf90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/769686724 2020-06-27T04:39:55.753 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:55.749+0000 7fe7237fe700 1 --2- 172.21.15.31:0/333520326 >> v2:172.21.15.31:6800/769686724 conn(0x7fe70402aad0 0x7fe70402cf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2020-06-27T04:39:55.753 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8413023948669434, stop=False, exit=None, reads=[10] 2020-06-27T04:39:56.153 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:56.150+0000 7fe7237fe700 1 -- 172.21.15.31:0/333520326 >> v2:172.21.15.31:6800/769686724 conn(0x7fe70402aad0 msgr2=0x7fe70402cf90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/769686724 2020-06-27T04:39:56.153 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:56.150+0000 7fe7237fe700 1 --2- 172.21.15.31:0/333520326 >> v2:172.21.15.31:6800/769686724 conn(0x7fe70402aad0 0x7fe70402cf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2020-06-27T04:39:56.154 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.2423088550567627, stop=False, exit=None, reads=[10] 2020-06-27T04:39:56.954 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:56.951+0000 7fe7237fe700 1 -- 172.21.15.31:0/333520326 >> v2:172.21.15.31:6800/769686724 conn(0x7fe70402aad0 msgr2=0x7fe70402cf90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/769686724 2020-06-27T04:39:56.954 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:56.951+0000 7fe7237fe700 1 --2- 172.21.15.31:0/333520326 >> v2:172.21.15.31:6800/769686724 conn(0x7fe70402aad0 0x7fe70402cf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2020-06-27T04:39:56.955 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=2.0433223247528076, stop=False, exit=None, reads=[10] 2020-06-27T04:39:57.104 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:57.100+0000 7fe70bfff700 1 -- 172.21.15.31:0/333520326 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mgrmap(e 6) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fe714025640 con 0x7fe7240785e0 2020-06-27T04:39:57.104 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=2.192739963531494, stop=False, exit=None, reads=[10] 2020-06-27T04:39:57.104 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:57.100+0000 7fe70bfff700 1 -- 172.21.15.31:0/333520326 >> v2:172.21.15.31:6800/769686724 conn(0x7fe70402aad0 msgr2=0x7fe70402cf90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-06-27T04:39:57.104 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:57.100+0000 7fe70bfff700 1 --2- 172.21.15.31:0/333520326 >> v2:172.21.15.31:6800/769686724 conn(0x7fe70402aad0 0x7fe70402cf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-06-27T04:39:57.105 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=2.192936897277832, stop=False, exit=None, reads=[10] 2020-06-27T04:39:57.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:57 smithi031 bash[18426]: cluster 2020-06-27T04:39:57.049148+0000 mon.a (mon.0) 38 : cluster [INF] Active manager daemon y restarted 2020-06-27T04:39:57.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:57 smithi031 bash[18426]: cluster 2020-06-27T04:39:57.049555+0000 mon.a (mon.0) 39 : cluster [INF] Activating manager daemon y 2020-06-27T04:39:57.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:57 smithi031 bash[18426]: cluster 2020-06-27T04:39:57.051742+0000 mon.a (mon.0) 40 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2020-06-27T04:39:58.108 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.104+0000 7fe70bfff700 1 -- 172.21.15.31:0/333520326 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 7) v1 ==== 31670+0+0 (secure 0 0 0) 0x7fe714010aa0 con 0x7fe7240785e0 2020-06-27T04:39:58.109 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.19695782661438, stop=False, exit=None, reads=[10] 2020-06-27T04:39:58.109 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.104+0000 7fe70bfff700 1 --2- 172.21.15.31:0/333520326 >> v2:172.21.15.31:6800/4294292023 conn(0x7fe70402e2d0 0x7fe7040306c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:58.109 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.104+0000 7fe70bfff700 1 -- 172.21.15.31:0/333520326 --> v2:172.21.15.31:6800/4294292023 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe724079190 con 0x7fe70402e2d0 2020-06-27T04:39:58.109 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.197153091430664, stop=False, exit=None, reads=[10] 2020-06-27T04:39:58.110 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.105+0000 7fe7237fe700 1 --2- 172.21.15.31:0/333520326 >> v2:172.21.15.31:6800/4294292023 conn(0x7fe70402e2d0 0x7fe7040306c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:58.110 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.1975438594818115, stop=False, exit=None, reads=[10] 2020-06-27T04:39:58.110 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.105+0000 7fe7237fe700 1 --2- 172.21.15.31:0/333520326 >> v2:172.21.15.31:6800/4294292023 conn(0x7fe70402e2d0 0x7fe7040306c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fe718003680 tx=0x7fe718006d00).ready entity=mgr.14119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:58.110 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.1978025436401367, stop=False, exit=None, reads=[10] 2020-06-27T04:39:58.111 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.106+0000 7fe70bfff700 1 -- 172.21.15.31:0/333520326 <== mgr.14119 v2:172.21.15.31:6800/4294292023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6306 (secure 0 0 0) 0x7fe724079190 con 0x7fe70402e2d0 2020-06-27T04:39:58.111 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.198263645172119, stop=False, exit=None, reads=[10] 2020-06-27T04:39:58.118 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.115+0000 7fe72a0be700 1 -- 172.21.15.31:0/333520326 --> v2:172.21.15.31:6800/4294292023 -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fe7240797d0 con 0x7fe70402e2d0 2020-06-27T04:39:58.118 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.207247734069824, stop=False, exit=None, reads=[10] 2020-06-27T04:39:58.119 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.115+0000 7fe70bfff700 1 -- 172.21.15.31:0/333520326 <== mgr.14119 v2:172.21.15.31:6800/4294292023 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fe7240797d0 con 0x7fe70402e2d0 2020-06-27T04:39:58.119 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.207362651824951, stop=False, exit=None, reads=[10] 2020-06-27T04:39:58.119 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:39:58.119 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 7, 2020-06-27T04:39:58.119 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2020-06-27T04:39:58.120 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:39:58.120 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.2076923847198486, stop=False, exit=None, reads=[8] 2020-06-27T04:39:58.121 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.115+0000 7fe72a0be700 1 -- 172.21.15.31:0/333520326 >> v2:172.21.15.31:6800/4294292023 conn(0x7fe70402e2d0 msgr2=0x7fe7040306c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:58.121 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.2078166007995605, stop=False, exit=None, reads=[10] 2020-06-27T04:39:58.121 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.115+0000 7fe72a0be700 1 --2- 172.21.15.31:0/333520326 >> v2:172.21.15.31:6800/4294292023 conn(0x7fe70402e2d0 0x7fe7040306c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fe718003680 tx=0x7fe718006d00).stop 2020-06-27T04:39:58.121 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.20790696144104, stop=False, exit=None, reads=[10] 2020-06-27T04:39:58.121 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.115+0000 7fe72a0be700 1 -- 172.21.15.31:0/333520326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7240785e0 msgr2=0x7fe724078a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:58.122 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.115+0000 7fe72a0be700 1 --2- 172.21.15.31:0/333520326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7240785e0 0x7fe724078a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe714002f70 tx=0x7fe714006ec0).stop 2020-06-27T04:39:58.122 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.115+0000 7fe72a0be700 1 -- 172.21.15.31:0/333520326 shutdown_connections 2020-06-27T04:39:58.122 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.2080540657043457, stop=False, exit=None, reads=[10] 2020-06-27T04:39:58.122 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.115+0000 7fe72a0be700 1 --2- 172.21.15.31:0/333520326 >> v2:172.21.15.31:6800/4294292023 conn(0x7fe70402e2d0 0x7fe7040306c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:58.122 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.115+0000 7fe72a0be700 1 --2- 172.21.15.31:0/333520326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7240785e0 0x7fe724078a00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:58.123 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.115+0000 7fe72a0be700 1 --2- 172.21.15.31:0/333520326 >> v2:172.21.15.31:6800/769686724 conn(0x7fe70402aad0 0x7fe70402cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-06-27T04:39:58.123 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.115+0000 7fe72a0be700 1 -- 172.21.15.31:0/333520326 >> 172.21.15.31:0/333520326 conn(0x7fe72405ffe0 msgr2=0x7fe724061c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:58.123 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.2082831859588623, stop=False, exit=None, reads=[10] 2020-06-27T04:39:58.123 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.116+0000 7fe72a0be700 1 -- 172.21.15.31:0/333520326 shutdown_connections 2020-06-27T04:39:58.123 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:58.116+0000 7fe72a0be700 1 -- 172.21.15.31:0/333520326 wait complete. 2020-06-27T04:39:58.124 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.208413600921631, stop=False, exit=None, reads=[10] 2020-06-27T04:39:58.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:58 smithi031 bash[18426]: cluster 2020-06-27T04:39:57.102713+0000 mon.a (mon.0) 41 : cluster [DBG] mgrmap e6: y(active, starting, since 0.0532302s) 2020-06-27T04:39:58.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:58 smithi031 bash[18426]: audit 2020-06-27T04:39:57.105397+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2020-06-27T04:39:58.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:58 smithi031 bash[18426]: audit 2020-06-27T04:39:57.105629+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-06-27T04:39:58.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:58 smithi031 bash[18426]: audit 2020-06-27T04:39:57.105769+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-06-27T04:39:58.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:58 smithi031 bash[18426]: audit 2020-06-27T04:39:57.105926+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-06-27T04:39:58.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:58 smithi031 bash[18426]: audit 2020-06-27T04:39:57.106297+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-06-27T04:39:58.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:58 smithi031 bash[18426]: audit 2020-06-27T04:39:57.106928+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2020-06-27T04:39:58.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:58 smithi031 bash[18426]: audit 2020-06-27T04:39:57.107147+0000 mon.a (mon.0) 48 : audit [DBG] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2020-06-27T04:39:58.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:58 smithi031 bash[18426]: cluster 2020-06-27T04:39:57.108612+0000 mon.a (mon.0) 49 : cluster [INF] Manager daemon y is now available 2020-06-27T04:39:58.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:58 smithi031 bash[18426]: audit 2020-06-27T04:39:57.114849+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2020-06-27T04:39:58.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:58 smithi031 bash[18426]: audit 2020-06-27T04:39:57.117987+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2020-06-27T04:39:58.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:58 smithi031 bash[18426]: audit 2020-06-27T04:39:57.118514+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2020-06-27T04:39:58.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:58 smithi031 bash[18426]: audit 2020-06-27T04:39:57.121228+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2020-06-27T04:39:58.571 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.660309314727783, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:39:58.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.66047739982605, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:39:58.572 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:mgr epoch 5 is available 2020-06-27T04:39:58.572 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Setting orchestrator backend to cephadm... 2020-06-27T04:39:58.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'orch', 'set', 'backend', 'cephadm'] 2020-06-27T04:39:58.573 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 orch set backend cephadm 2020-06-27T04:39:59.214 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.202+0000 7fde153dd700 1 Processor -- start 2020-06-27T04:39:59.215 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.202+0000 7fde153dd700 1 -- start start 2020-06-27T04:39:59.215 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.202+0000 7fde153dd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde10064730 0x7fde10064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:59.215 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.202+0000 7fde153dd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde100651a0 con 0x7fde10064730 2020-06-27T04:39:59.215 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.202+0000 7fde0f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde10064730 0x7fde10064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:59.215 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6340405941009521, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.216 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.202+0000 7fde0f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde10064730 0x7fde10064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38564/0 (socket says 172.21.15.31:38564) 2020-06-27T04:39:59.216 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.202+0000 7fde0f7fe700 1 -- 172.21.15.31:0/1722590495 learned_addr learned my addr 172.21.15.31:0/1722590495 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:59.216 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.203+0000 7fde0f7fe700 1 -- 172.21.15.31:0/1722590495 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde10065a20 con 0x7fde10064730 2020-06-27T04:39:59.216 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.203+0000 7fde0f7fe700 1 --2- 172.21.15.31:0/1722590495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde10064730 0x7fde10064b50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fde00002f70 tx=0x7fde00006ec0).ready entity=mon.0 client_cookie=b0fd4ceb47978150 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:59.216 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.203+0000 7fde0e7fc700 1 -- 172.21.15.31:0/1722590495 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fde00009980 con 0x7fde10064730 2020-06-27T04:39:59.217 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6342642307281494, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.217 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.203+0000 7fde0e7fc700 1 -- 172.21.15.31:0/1722590495 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fde00000e90 con 0x7fde10064730 2020-06-27T04:39:59.217 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.203+0000 7fde0e7fc700 1 -- 172.21.15.31:0/1722590495 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fde00011c70 con 0x7fde10064730 2020-06-27T04:39:59.217 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.203+0000 7fde153dd700 1 -- 172.21.15.31:0/1722590495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde10064730 msgr2=0x7fde10064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:59.217 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.203+0000 7fde153dd700 1 --2- 172.21.15.31:0/1722590495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde10064730 0x7fde10064b50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fde00002f70 tx=0x7fde00006ec0).stop 2020-06-27T04:39:59.218 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.203+0000 7fde153dd700 1 -- 172.21.15.31:0/1722590495 shutdown_connections 2020-06-27T04:39:59.218 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6344799995422363, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.218 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.203+0000 7fde153dd700 1 --2- 172.21.15.31:0/1722590495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde10064730 0x7fde10064b50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:59.218 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.203+0000 7fde153dd700 1 -- 172.21.15.31:0/1722590495 >> 172.21.15.31:0/1722590495 conn(0x7fde1005ffe0 msgr2=0x7fde10062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:59.218 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.203+0000 7fde153dd700 1 -- 172.21.15.31:0/1722590495 shutdown_connections 2020-06-27T04:39:59.219 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.203+0000 7fde153dd700 1 -- 172.21.15.31:0/1722590495 wait complete. 2020-06-27T04:39:59.219 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.204+0000 7fde153dd700 1 Processor -- start 2020-06-27T04:39:59.219 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.204+0000 7fde153dd700 1 -- start start 2020-06-27T04:39:59.219 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.634723424911499, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.219 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.205+0000 7fde153dd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde10062000 0x7fde1007b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:59.220 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.205+0000 7fde153dd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1007b960 con 0x7fde10062000 2020-06-27T04:39:59.220 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6348609924316406, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.220 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.205+0000 7fde0f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde10062000 0x7fde1007b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:59.220 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.205+0000 7fde0f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde10062000 0x7fde1007b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38566/0 (socket says 172.21.15.31:38566) 2020-06-27T04:39:59.220 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.205+0000 7fde0f7fe700 1 -- 172.21.15.31:0/3019581622 learned_addr learned my addr 172.21.15.31:0/3019581622 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:39:59.220 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6349875926971436, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.221 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.205+0000 7fde0f7fe700 1 -- 172.21.15.31:0/3019581622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1007baa0 con 0x7fde10062000 2020-06-27T04:39:59.221 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.635073184967041, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.221 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.205+0000 7fde0f7fe700 1 --2- 172.21.15.31:0/3019581622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde10062000 0x7fde1007b310 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fde00006bb0 tx=0x7fde00006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:59.221 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6351988315582275, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.221 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.205+0000 7fddf77fe700 1 -- 172.21.15.31:0/3019581622 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fde0001a820 con 0x7fde10062000 2020-06-27T04:39:59.222 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.635427713394165, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.222 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.205+0000 7fde153dd700 1 -- 172.21.15.31:0/3019581622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde1007bcf0 con 0x7fde10062000 2020-06-27T04:39:59.222 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.205+0000 7fde153dd700 1 -- 172.21.15.31:0/3019581622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde1007c120 con 0x7fde10062000 2020-06-27T04:39:59.223 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6355593204498291, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.223 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.206+0000 7fddf77fe700 1 -- 172.21.15.31:0/3019581622 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fde0001adc0 con 0x7fde10062000 2020-06-27T04:39:59.223 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.206+0000 7fddf77fe700 1 -- 172.21.15.31:0/3019581622 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fde0001bcb0 con 0x7fde10062000 2020-06-27T04:39:59.223 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6357738971710205, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.223 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.206+0000 7fddf77fe700 1 -- 172.21.15.31:0/3019581622 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 31790+0+0 (secure 0 0 0) 0x7fde0000f070 con 0x7fde10062000 2020-06-27T04:39:59.224 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6361522674560547, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.224 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.206+0000 7fddf77fe700 1 --2- 172.21.15.31:0/3019581622 >> v2:172.21.15.31:6800/4294292023 conn(0x7fddec02aad0 0x7fddec02cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:39:59.224 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6363704204559326, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.224 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.206+0000 7fde153dd700 1 -- 172.21.15.31:0/3019581622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde10057340 con 0x7fde10062000 2020-06-27T04:39:59.225 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.206+0000 7fddf77fe700 1 -- 172.21.15.31:0/3019581622 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1326+0+0 (secure 0 0 0) 0x7fde0003c750 con 0x7fde10062000 2020-06-27T04:39:59.225 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6365773677825928, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.225 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.206+0000 7fde0effd700 1 --2- 172.21.15.31:0/3019581622 >> v2:172.21.15.31:6800/4294292023 conn(0x7fddec02aad0 0x7fddec02cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:39:59.225 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6367239952087402, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.225 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.207+0000 7fde0effd700 1 --2- 172.21.15.31:0/3019581622 >> v2:172.21.15.31:6800/4294292023 conn(0x7fddec02aad0 0x7fddec02cf90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fde04002f70 tx=0x7fde04006b20).ready entity=mgr.14119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:39:59.226 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6368112564086914, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.226 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.210+0000 7fddf77fe700 1 -- 172.21.15.31:0/3019581622 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fde00025460 con 0x7fde10062000 2020-06-27T04:39:59.226 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6404528617858887, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.395+0000 7fde153dd700 1 -- 172.21.15.31:0/3019581622 --> v2:172.21.15.31:6800/4294292023 -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fde10043e80 con 0x7fddec02aad0 2020-06-27T04:39:59.399 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8252251148223877, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.402+0000 7fddf77fe700 1 -- 172.21.15.31:0/3019581622 <== mgr.14119 v2:172.21.15.31:6800/4294292023 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fde10043e80 con 0x7fddec02aad0 2020-06-27T04:39:59.406 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8323395252227783, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.407 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.404+0000 7fde153dd700 1 -- 172.21.15.31:0/3019581622 >> v2:172.21.15.31:6800/4294292023 conn(0x7fddec02aad0 msgr2=0x7fddec02cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:59.408 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.404+0000 7fde153dd700 1 --2- 172.21.15.31:0/3019581622 >> v2:172.21.15.31:6800/4294292023 conn(0x7fddec02aad0 0x7fddec02cf90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fde04002f70 tx=0x7fde04006b20).stop 2020-06-27T04:39:59.408 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.404+0000 7fde153dd700 1 -- 172.21.15.31:0/3019581622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde10062000 msgr2=0x7fde1007b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:39:59.408 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.404+0000 7fde153dd700 1 --2- 172.21.15.31:0/3019581622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde10062000 0x7fde1007b310 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fde00006bb0 tx=0x7fde00006ec0).stop 2020-06-27T04:39:59.408 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8338761329650879, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.408 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.404+0000 7fde153dd700 1 -- 172.21.15.31:0/3019581622 shutdown_connections 2020-06-27T04:39:59.409 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.404+0000 7fde153dd700 1 --2- 172.21.15.31:0/3019581622 >> v2:172.21.15.31:6800/4294292023 conn(0x7fddec02aad0 0x7fddec02cf90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:59.409 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.404+0000 7fde153dd700 1 --2- 172.21.15.31:0/3019581622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde10062000 0x7fde1007b310 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:39:59.409 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.404+0000 7fde153dd700 1 -- 172.21.15.31:0/3019581622 >> 172.21.15.31:0/3019581622 conn(0x7fde1005ffe0 msgr2=0x7fde10062460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:39:59.409 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.404+0000 7fde153dd700 1 -- 172.21.15.31:0/3019581622 shutdown_connections 2020-06-27T04:39:59.410 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:39:59.404+0000 7fde153dd700 1 -- 172.21.15.31:0/3019581622 wait complete. 2020-06-27T04:39:59.410 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8341779708862305, stop=False, exit=None, reads=[10] 2020-06-27T04:39:59.429 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:59 smithi031 bash[18426]: audit 2020-06-27T04:39:57.236671+0000 mon.a (mon.0) 54 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2020-06-27T04:39:59.429 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:59 smithi031 bash[18426]: audit 2020-06-27T04:39:58.103620+0000 mon.a (mon.0) 55 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2020-06-27T04:39:59.429 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:59 smithi031 bash[18426]: audit 2020-06-27T04:39:58.107097+0000 mgr.y (mgr.14119) 1 : audit [DBG] from='client.14123 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2020-06-27T04:39:59.430 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:59 smithi031 bash[18426]: cluster 2020-06-27T04:39:58.107910+0000 mon.a (mon.0) 56 : cluster [DBG] mgrmap e7: y(active, since 1.05843s) 2020-06-27T04:39:59.430 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:39:59 smithi031 bash[18426]: audit 2020-06-27T04:39:58.116414+0000 mgr.y (mgr.14119) 2 : audit [DBG] from='client.14123 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2020-06-27T04:39:59.867 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.293086051940918, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:39:59.867 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.2932500839233398, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:39:59.867 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Generating ssh key... 2020-06-27T04:39:59.867 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'cephadm', 'generate-key'] 2020-06-27T04:39:59.868 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 cephadm generate-key 2020-06-27T04:40:00.117 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18426]: cluster 2020-06-27T04:39:59.113407+0000 mon.a (mon.0) 57 : cluster [DBG] mgrmap e8: y(active, since 2s) 2020-06-27T04:40:00.118 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18426]: audit 2020-06-27T04:39:59.397317+0000 mgr.y (mgr.14119) 3 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:40:00.118 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18426]: audit 2020-06-27T04:39:59.398439+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd=[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]: dispatch 2020-06-27T04:40:00.118 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18426]: audit 2020-06-27T04:39:59.403571+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd='[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]': finished 2020-06-27T04:40:00.543 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.533+0000 7fd5c3e98700 1 Processor -- start 2020-06-27T04:40:00.543 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.533+0000 7fd5c3e98700 1 -- start start 2020-06-27T04:40:00.544 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.534+0000 7fd5c3e98700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5bc064730 0x7fd5bc064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:00.544 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.534+0000 7fd5c3e98700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc0651a0 con 0x7fd5bc064730 2020-06-27T04:40:00.544 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.534+0000 7fd5c2435700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5bc064730 0x7fd5bc064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:00.544 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6709022521972656, stop=False, exit=None, reads=[10] 2020-06-27T04:40:00.544 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.534+0000 7fd5c2435700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5bc064730 0x7fd5bc064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38570/0 (socket says 172.21.15.31:38570) 2020-06-27T04:40:00.545 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.534+0000 7fd5c2435700 1 -- 172.21.15.31:0/661541766 learned_addr learned my addr 172.21.15.31:0/661541766 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:00.545 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.534+0000 7fd5c2435700 1 -- 172.21.15.31:0/661541766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc065a20 con 0x7fd5bc064730 2020-06-27T04:40:00.545 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.534+0000 7fd5c2435700 1 --2- 172.21.15.31:0/661541766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5bc064730 0x7fd5bc064b50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd5b8002f70 tx=0x7fd5b8006ec0).ready entity=mon.0 client_cookie=e66312324af696e8 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:00.545 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.534+0000 7fd5c1433700 1 -- 172.21.15.31:0/661541766 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fd5b8009980 con 0x7fd5bc064730 2020-06-27T04:40:00.545 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6712160110473633, stop=False, exit=None, reads=[10] 2020-06-27T04:40:00.546 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.534+0000 7fd5c1433700 1 -- 172.21.15.31:0/661541766 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fd5b8000e90 con 0x7fd5bc064730 2020-06-27T04:40:00.546 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.534+0000 7fd5c1433700 1 -- 172.21.15.31:0/661541766 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fd5b8011c70 con 0x7fd5bc064730 2020-06-27T04:40:00.546 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.535+0000 7fd5c3e98700 1 -- 172.21.15.31:0/661541766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5bc064730 msgr2=0x7fd5bc064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:00.546 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.535+0000 7fd5c3e98700 1 --2- 172.21.15.31:0/661541766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5bc064730 0x7fd5bc064b50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd5b8002f70 tx=0x7fd5b8006ec0).stop 2020-06-27T04:40:00.546 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.535+0000 7fd5c3e98700 1 -- 172.21.15.31:0/661541766 shutdown_connections 2020-06-27T04:40:00.546 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6715054512023926, stop=False, exit=None, reads=[10] 2020-06-27T04:40:00.547 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.535+0000 7fd5c3e98700 1 --2- 172.21.15.31:0/661541766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5bc064730 0x7fd5bc064b50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:00.547 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.535+0000 7fd5c3e98700 1 -- 172.21.15.31:0/661541766 >> 172.21.15.31:0/661541766 conn(0x7fd5bc05ffe0 msgr2=0x7fd5bc062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:00.547 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.535+0000 7fd5c3e98700 1 -- 172.21.15.31:0/661541766 shutdown_connections 2020-06-27T04:40:00.547 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.535+0000 7fd5c3e98700 1 -- 172.21.15.31:0/661541766 wait complete. 2020-06-27T04:40:00.547 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.536+0000 7fd5c3e98700 1 Processor -- start 2020-06-27T04:40:00.548 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.536+0000 7fd5c3e98700 1 -- start start 2020-06-27T04:40:00.548 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.536+0000 7fd5c3e98700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5bc078670 0x7fd5bc078a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:00.548 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.536+0000 7fd5c3e98700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc0790e0 con 0x7fd5bc078670 2020-06-27T04:40:00.548 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6718080043792725, stop=False, exit=None, reads=[10] 2020-06-27T04:40:00.548 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.536+0000 7fd5c2435700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5bc078670 0x7fd5bc078a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:00.549 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.536+0000 7fd5c2435700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5bc078670 0x7fd5bc078a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38572/0 (socket says 172.21.15.31:38572) 2020-06-27T04:40:00.549 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.536+0000 7fd5c2435700 1 -- 172.21.15.31:0/3624626104 learned_addr learned my addr 172.21.15.31:0/3624626104 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:00.549 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.536+0000 7fd5c2435700 1 -- 172.21.15.31:0/3624626104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc0799a0 con 0x7fd5bc078670 2020-06-27T04:40:00.549 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.672034502029419, stop=False, exit=None, reads=[10] 2020-06-27T04:40:00.549 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.536+0000 7fd5c2435700 1 --2- 172.21.15.31:0/3624626104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5bc078670 0x7fd5bc078a90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd5b8006bb0 tx=0x7fd5b8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:00.550 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.536+0000 7fd5ae7fc700 1 -- 172.21.15.31:0/3624626104 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fd5b801a820 con 0x7fd5bc078670 2020-06-27T04:40:00.550 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.536+0000 7fd5ae7fc700 1 -- 172.21.15.31:0/3624626104 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fd5b801adc0 con 0x7fd5bc078670 2020-06-27T04:40:00.550 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.537+0000 7fd5c3e98700 1 -- 172.21.15.31:0/3624626104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5bc079bf0 con 0x7fd5bc078670 2020-06-27T04:40:00.550 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.537+0000 7fd5ae7fc700 1 -- 172.21.15.31:0/3624626104 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fd5b801bcb0 con 0x7fd5bc078670 2020-06-27T04:40:00.550 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.672236442565918, stop=False, exit=None, reads=[10] 2020-06-27T04:40:00.550 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.537+0000 7fd5c3e98700 1 -- 172.21.15.31:0/3624626104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5bc07a020 con 0x7fd5bc078670 2020-06-27T04:40:00.551 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.672311544418335, stop=False, exit=None, reads=[10] 2020-06-27T04:40:00.551 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.537+0000 7fd5ae7fc700 1 -- 172.21.15.31:0/3624626104 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 31790+0+0 (secure 0 0 0) 0x7fd5b800f070 con 0x7fd5bc078670 2020-06-27T04:40:00.551 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6727352142333984, stop=False, exit=None, reads=[10] 2020-06-27T04:40:00.551 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.537+0000 7fd5ae7fc700 1 --2- 172.21.15.31:0/3624626104 >> v2:172.21.15.31:6800/4294292023 conn(0x7fd59802aad0 0x7fd59802cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:00.551 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6728410720825195, stop=False, exit=None, reads=[10] 2020-06-27T04:40:00.552 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.537+0000 7fd5ae7fc700 1 -- 172.21.15.31:0/3624626104 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1326+0+0 (secure 0 0 0) 0x7fd5b803bb30 con 0x7fd5bc078670 2020-06-27T04:40:00.552 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6729636192321777, stop=False, exit=None, reads=[10] 2020-06-27T04:40:00.552 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.537+0000 7fd5c1c34700 1 --2- 172.21.15.31:0/3624626104 >> v2:172.21.15.31:6800/4294292023 conn(0x7fd59802aad0 0x7fd59802cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:00.552 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6730945110321045, stop=False, exit=None, reads=[10] 2020-06-27T04:40:00.555 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.538+0000 7fd5c3e98700 1 -- 172.21.15.31:0/3624626104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5bc079220 con 0x7fd5bc078670 2020-06-27T04:40:00.555 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6732149124145508, stop=False, exit=None, reads=[10] 2020-06-27T04:40:00.555 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.538+0000 7fd5c1c34700 1 --2- 172.21.15.31:0/3624626104 >> v2:172.21.15.31:6800/4294292023 conn(0x7fd59802aad0 0x7fd59802cf90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fd5b0002f70 tx=0x7fd5b0006b20).ready entity=mgr.14119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:00.555 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6733055114746094, stop=False, exit=None, reads=[10] 2020-06-27T04:40:00.556 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.541+0000 7fd5ae7fc700 1 -- 172.21.15.31:0/3624626104 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fd5b8025460 con 0x7fd5bc078670 2020-06-27T04:40:00.556 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6769740581512451, stop=False, exit=None, reads=[10] 2020-06-27T04:40:00.699 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.696+0000 7fd5c3e98700 1 -- 172.21.15.31:0/3624626104 --> v2:172.21.15.31:6800/4294292023 -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5bc057340 con 0x7fd59802aad0 2020-06-27T04:40:00.699 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8315269947052002, stop=False, exit=None, reads=[10] 2020-06-27T04:40:00.952 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.949+0000 7fd5ae7fc700 1 -- 172.21.15.31:0/3624626104 <== mgr.14119 v2:172.21.15.31:6800/4294292023 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd5bc057340 con 0x7fd59802aad0 2020-06-27T04:40:00.952 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0843915939331055, stop=False, exit=None, reads=[10] 2020-06-27T04:40:00.954 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.950+0000 7fd5c3e98700 1 -- 172.21.15.31:0/3624626104 >> v2:172.21.15.31:6800/4294292023 conn(0x7fd59802aad0 msgr2=0x7fd59802cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:00.954 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.950+0000 7fd5c3e98700 1 --2- 172.21.15.31:0/3624626104 >> v2:172.21.15.31:6800/4294292023 conn(0x7fd59802aad0 0x7fd59802cf90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fd5b0002f70 tx=0x7fd5b0006b20).stop 2020-06-27T04:40:00.954 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.950+0000 7fd5c3e98700 1 -- 172.21.15.31:0/3624626104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5bc078670 msgr2=0x7fd5bc078a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:00.955 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.950+0000 7fd5c3e98700 1 --2- 172.21.15.31:0/3624626104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5bc078670 0x7fd5bc078a90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd5b8006bb0 tx=0x7fd5b8006ec0).stop 2020-06-27T04:40:00.955 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0859243869781494, stop=False, exit=None, reads=[10] 2020-06-27T04:40:00.955 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.950+0000 7fd5c3e98700 1 -- 172.21.15.31:0/3624626104 shutdown_connections 2020-06-27T04:40:00.955 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.950+0000 7fd5c3e98700 1 --2- 172.21.15.31:0/3624626104 >> v2:172.21.15.31:6800/4294292023 conn(0x7fd59802aad0 0x7fd59802cf90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:00.962 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.950+0000 7fd5c3e98700 1 --2- 172.21.15.31:0/3624626104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5bc078670 0x7fd5bc078a90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:00.962 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.950+0000 7fd5c3e98700 1 -- 172.21.15.31:0/3624626104 >> 172.21.15.31:0/3624626104 conn(0x7fd5bc05ffe0 msgr2=0x7fd5bc06f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:00.963 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.950+0000 7fd5c3e98700 1 -- 172.21.15.31:0/3624626104 shutdown_connections 2020-06-27T04:40:00.963 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:00.950+0000 7fd5c3e98700 1 -- 172.21.15.31:0/3624626104 wait complete. 2020-06-27T04:40:00.963 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.0861899852752686, stop=False, exit=None, reads=[10] 2020-06-27T04:40:01.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:01 smithi031 bash[18426]: audit 2020-06-27T04:40:00.697779+0000 mgr.y (mgr.14119) 4 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:40:01.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:01 smithi031 bash[18426]: cephadm 2020-06-27T04:40:00.697983+0000 mgr.y (mgr.14119) 5 : cephadm [INF] Generating ssh key... 2020-06-27T04:40:01.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:01 smithi031 bash[18426]: audit 2020-06-27T04:40:00.942766+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEA8BvihFtx5pedQ/YTmF5Reak7Vsi8kfpig7brZgQWJlKqa9lRtYd/\nVv+XROnHgADXroHCcFuLBqWqnqy+SW06iqxf4ML8jHeMD6ei90RjoZ+OYPe59lJCXHEYr4\nTiyPeVSD3NxB9UFlwugZZmEWRisV4MnL+bdmDtuJtvopeFUMUKNh48pQFSz/ezQ5lrSWyk\n6iZeL+Jmjnp3PtdiAb6ZZ8TwhK0Q+X9W1J9ImyhbZwGS/KyPt2yOSmWgT6PO6tb5pi3M2U\nVbPyT9q7mo5XL3/lYdeNUJsY4Xh/7xvgtdciy97Zw/CVerWzITCtbmP/PSXAZrlHFArpWl\nHtF/sONFREVj29IdjHmr30W7Nw0wt0wVZ+iF5oEtf7zlyWGxdeab/A0dtD6oz6HI0ggVqq\nlvUhoXDy5qvjh0Aq/2/l1m6TFUxAGwHjrgrDqHQImlxb+QkCbzGnagaZPsQxf0z6S6dktj\nfKISS1tkDVxfX7ppatylgGqt0fg4sM9H2Uxr5PjpAAAFoApeQUAKXkFAAAAAB3NzaC1yc2\nEAAAGBAPAb4oRbceaXnUP2E5heUXmpO1bIvJH6YoO262YEFiZSqmvZUbWHf1b/l0Tpx4AA\n166BwnBbiwalqp6svkltOoqsX+DC/Ix3jA+novdEY6GfjmD3ufZSQlxxGK+E4sj3lUg9zc\nQfVBZcLoGWZhFkYrFeDJy/m3Zg7bibb6KXhVDFCjYePKUBUs/3s0OZa0lspOomXi/iZo56\ndz7XYgG+mWfE8IStEPl/VtSfSJsoW2cBkvysj7dsjkploE+jzurW+aYtzNlFWz8k/au5qO\nVy9/5WHXjVCbGOF4f+8b4LXXIsve2cPwlXq1syEwrW5j/z0lwGa5RxQK6VpR7Rf7DjRURF\nY9vSHYx5q99FuzcNMLdMFWfoheaBLX+85clhsXXmm/wNHbQ+qM+hyNIIFaqpb1IaFw8uar\n44dAKv9v5dZukxVMQBsB464Kw6h0CJpcW/kJAm8xp2oGmT7EMX9M+kunZLY3yiEktbZA1c\nX1+6aWrcpYBqrdH4OLDPR9lMa+T46QAAAAMBAAEAAAGBAONxhqDZ/orwE4jNEMLElWkpZY\nxPmlCtXaRnIZUBSfoDVGvU8BGEyJsggapFyTT3l1c2k3jbPlaNl5G3EIl9bnbt0eSWz6Q/\nme06XqTbo4T2H2i7QOyT/0iR2VBqEGlOHZrQ8JlXE9AagfM/BHB1JwfcjxXsatc3+fdlRd\no+rYpVG9cnzUqAdnGJscXXDkn/IDitH4s8aumMGGjunWgJpEcnxq3nQq0Ucqv2NlDDadGp\nLBMtYvXdXuwaWEEYamkKOJvncD0TAwBuPrIr45UW0Twi3PJ+prq/leA+d/UoZpbW8BCvjY\na4GKe6bzVKZUdfbqmahjEp50IC/gB65J3BIgp25Rl6WKJXnFhtDQlJb/YsmaOe+vaYOhG/\nbAh2EJqe5yvPjFtoDp4QOPSn8edvbLoxVKg9IXKQLP1rZ5X6OUv6eXL0v//r5cWhKrbNuS\n1BFQezOLZouvSo8cY+g4g21g/HOT0ra1lz/q3ZwjolYC67VZ4jsN8Kp6jrXh072WfIAQAA\nAMAP/m/C3iZEPxAvfyz5hfXlMPZeXUkqu80OG/8HcwInfkaYXTmJxq7BmrsAA0/tFYGqV8\n/+7q27Iv4/5t/jKntXJXVi59bRWjjq9dxeWjuAqrc5NAzAuyXbZVMEFvFFBpSzLY3w6one\nlVCTlaCA7RK/YGPLipZXUfNPIasZkuPJGFZGmXMk7IOyoCNFGWBootY74QWHt/F4En2KQC\nbCnFd8boV8Rs49gE/ZXByXCL/UbXaHG1X45sO5i0uZ3zwNdc0AAADBAPytcotpndL3Q0+S\nb1+U6wGjHlBaxZgc+mDtown48ic7x9WmoBZCXW86AZlmPacWaP7z5Shgj22t8V265Zt3w1\nzqtGo5dKN1K8yqP10lLX5VXzETyatK5uMKlFdJp1vyD/zp8tmCL4dvF3vw2eiur5NTlGkV\npxCXSXxyDb5p58dkKps7Y8YPVSAQvsdFf+U1cd8zEnOduVAgVZT9XE25a1qmmckXpUZ3jz\nJaBJ26uleYshVAIRr/PN/IxZ1vmw4RhQAAAMEA80QhJbq/+0hjIi3/MW/Wzkx+Rz39If49\nv0Odqm/+02WVma0u0yBCcSssbgkX5aU8/PfvrVGD8Uqr0olAxyUK1D/VYV4gnEhVHrV1B3\niqz86H9jOelWSGTpqTIO48tGo/Jwb15NAYIpg0v0IXzTDE2hlRt/hDN7e7n3oyFdlOSB6x\nXJNqekxhHdEr3ytn4JAuOeROAX87KvxnPogUyO+rtzv5t1krjCaAykgYKyN31WUvwCzc7z\nSZ9E/ZSojtuTUVAAAAKWNlcGgtMTI4OTJhZTItYjgzMC0xMWVhLWEwNmQtMDAxYTRhYWI4\nMzBjAQ==\n-----END OPENSSH PRIVATE KEY-----\n"}]: dispatch 2020-06-27T04:40:01.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:01 smithi031 bash[18426]: audit 2020-06-27T04:40:00.944558+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEA8BvihFtx5pedQ/YTmF5Reak7Vsi8kfpig7brZgQWJlKqa9lRtYd/\nVv+XROnHgADXroHCcFuLBqWqnqy+SW06iqxf4ML8jHeMD6ei90RjoZ+OYPe59lJCXHEYr4\nTiyPeVSD3NxB9UFlwugZZmEWRisV4MnL+bdmDtuJtvopeFUMUKNh48pQFSz/ezQ5lrSWyk\n6iZeL+Jmjnp3PtdiAb6ZZ8TwhK0Q+X9W1J9ImyhbZwGS/KyPt2yOSmWgT6PO6tb5pi3M2U\nVbPyT9q7mo5XL3/lYdeNUJsY4Xh/7xvgtdciy97Zw/CVerWzITCtbmP/PSXAZrlHFArpWl\nHtF/sONFREVj29IdjHmr30W7Nw0wt0wVZ+iF5oEtf7zlyWGxdeab/A0dtD6oz6HI0ggVqq\nlvUhoXDy5qvjh0Aq/2/l1m6TFUxAGwHjrgrDqHQImlxb+QkCbzGnagaZPsQxf0z6S6dktj\nfKISS1tkDVxfX7ppatylgGqt0fg4sM9H2Uxr5PjpAAAFoApeQUAKXkFAAAAAB3NzaC1yc2\nEAAAGBAPAb4oRbceaXnUP2E5heUXmpO1bIvJH6YoO262YEFiZSqmvZUbWHf1b/l0Tpx4AA\n166BwnBbiwalqp6svkltOoqsX+DC/Ix3jA+novdEY6GfjmD3ufZSQlxxGK+E4sj3lUg9zc\nQfVBZcLoGWZhFkYrFeDJy/m3Zg7bibb6KXhVDFCjYePKUBUs/3s0OZa0lspOomXi/iZo56\ndz7XYgG+mWfE8IStEPl/VtSfSJsoW2cBkvysj7dsjkploE+jzurW+aYtzNlFWz8k/au5qO\nVy9/5WHXjVCbGOF4f+8b4LXXIsve2cPwlXq1syEwrW5j/z0lwGa5RxQK6VpR7Rf7DjRURF\nY9vSHYx5q99FuzcNMLdMFWfoheaBLX+85clhsXXmm/wNHbQ+qM+hyNIIFaqpb1IaFw8uar\n44dAKv9v5dZukxVMQBsB464Kw6h0CJpcW/kJAm8xp2oGmT7EMX9M+kunZLY3yiEktbZA1c\nX1+6aWrcpYBqrdH4OLDPR9lMa+T46QAAAAMBAAEAAAGBAONxhqDZ/orwE4jNEMLElWkpZY\nxPmlCtXaRnIZUBSfoDVGvU8BGEyJsggapFyTT3l1c2k3jbPlaNl5G3EIl9bnbt0eSWz6Q/\nme06XqTbo4T2H2i7QOyT/0iR2VBqEGlOHZrQ8JlXE9AagfM/BHB1JwfcjxXsatc3+fdlRd\no+rYpVG9cnzUqAdnGJscXXDkn/IDitH4s8aumMGGjunWgJpEcnxq3nQq0Ucqv2NlDDadGp\nLBMtYvXdXuwaWEEYamkKOJvncD0TAwBuPrIr45UW0Twi3PJ+prq/leA+d/UoZpbW8BCvjY\na4GKe6bzVKZUdfbqmahjEp50IC/gB65J3BIgp25Rl6WKJXnFhtDQlJb/YsmaOe+vaYOhG/\nbAh2EJqe5yvPjFtoDp4QOPSn8edvbLoxVKg9IXKQLP1rZ5X6OUv6eXL0v//r5cWhKrbNuS\n1BFQezOLZouvSo8cY+g4g21g/HOT0ra1lz/q3ZwjolYC67VZ4jsN8Kp6jrXh072WfIAQAA\nAMAP/m/C3iZEPxAvfyz5hfXlMPZeXUkqu80OG/8HcwInfkaYXTmJxq7BmrsAA0/tFYGqV8\n/+7q27Iv4/5t/jKntXJXVi59bRWjjq9dxeWjuAqrc5NAzAuyXbZVMEFvFFBpSzLY3w6one\nlVCTlaCA7RK/YGPLipZXUfNPIasZkuPJGFZGmXMk7IOyoCNFGWBootY74QWHt/F4En2KQC\nbCnFd8boV8Rs49gE/ZXByXCL/UbXaHG1X45sO5i0uZ3zwNdc0AAADBAPytcotpndL3Q0+S\nb1+U6wGjHlBaxZgc+mDtown48ic7x9WmoBZCXW86AZlmPacWaP7z5Shgj22t8V265Zt3w1\nzqtGo5dKN1K8yqP10lLX5VXzETyatK5uMKlFdJp1vyD/zp8tmCL4dvF3vw2eiur5NTlGkV\npxCXSXxyDb5p58dkKps7Y8YPVSAQvsdFf+U1cd8zEnOduVAgVZT9XE25a1qmmckXpUZ3jz\nJaBJ26uleYshVAIRr/PN/IxZ1vmw4RhQAAAMEA80QhJbq/+0hjIi3/MW/Wzkx+Rz39If49\nv0Odqm/+02WVma0u0yBCcSssbgkX5aU8/PfvrVGD8Uqr0olAxyUK1D/VYV4gnEhVHrV1B3\niqz86H9jOelWSGTpqTIO48tGo/Jwb15NAYIpg0v0IXzTDE2hlRt/hDN7e7n3oyFdlOSB6x\nXJNqekxhHdEr3ytn4JAuOeROAX87KvxnPogUyO+rtzv5t1krjCaAykgYKyN31WUvwCzc7z\nSZ9E/ZSojtuTUVAAAAKWNlcGgtMTI4OTJhZTItYjgzMC0xMWVhLWEwNmQtMDAxYTRhYWI4\nMzBjAQ==\n-----END OPENSSH PRIVATE KEY-----\n"}]': finished 2020-06-27T04:40:01.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:01 smithi031 bash[18426]: audit 2020-06-27T04:40:00.944888+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDwG+KEW3Hml51D9hOYXlF5qTtWyLyR+mKDtutmBBYmUqpr2VG1h39W/5dE6ceAANeugcJwW4sGpaqerL5JbTqKrF/gwvyMd4wPp6L3RGOhn45g97n2UkJccRivhOLI95VIPc3EH1QWXC6BlmYRZGKxXgycv5t2YO24m2+il4VQxQo2HjylAVLP97NDmWtJbKTqJl4v4maOenc+12IBvplnxPCErRD5f1bUn0ibKFtnAZL8rI+3bI5KZaBPo87q1vmmLczZRVs/JP2ruajlcvf+Vh141QmxjheH/vG+C11yLL3tnD8JV6tbMhMK1uY/89JcBmuUcUCulaUe0X+w40VERWPb0h2MeavfRbs3DTC3TBVn6IXmgS1/vOXJYbF15pv8DR20PqjPocjSCBWqqW9SGhcPLmq+OHQCr/b+XWbpMVTEAbAeOuCsOodAiaXFv5CQJvMadqBpk+xDF/TPpLp2S2N8ohJLW2QNXF9fumlq3KWAaq3R+Diwz0fZTGvk+Ok= ceph-12892ae2-b830-11ea-a06d-001a4aab830c\n"}]: dispatch 2020-06-27T04:40:01.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:01 smithi031 bash[18426]: audit 2020-06-27T04:40:00.949454+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDwG+KEW3Hml51D9hOYXlF5qTtWyLyR+mKDtutmBBYmUqpr2VG1h39W/5dE6ceAANeugcJwW4sGpaqerL5JbTqKrF/gwvyMd4wPp6L3RGOhn45g97n2UkJccRivhOLI95VIPc3EH1QWXC6BlmYRZGKxXgycv5t2YO24m2+il4VQxQo2HjylAVLP97NDmWtJbKTqJl4v4maOenc+12IBvplnxPCErRD5f1bUn0ibKFtnAZL8rI+3bI5KZaBPo87q1vmmLczZRVs/JP2ruajlcvf+Vh141QmxjheH/vG+C11yLL3tnD8JV6tbMhMK1uY/89JcBmuUcUCulaUe0X+w40VERWPb0h2MeavfRbs3DTC3TBVn6IXmgS1/vOXJYbF15pv8DR20PqjPocjSCBWqqW9SGhcPLmq+OHQCr/b+XWbpMVTEAbAeOuCsOodAiaXFv5CQJvMadqBpk+xDF/TPpLp2S2N8ohJLW2QNXF9fumlq3KWAaq3R+Diwz0fZTGvk+Ok= ceph-12892ae2-b830-11ea-a06d-001a4aab830c\n"}]': finished 2020-06-27T04:40:01.224 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18687]: Generating public/private rsa key pair. 2020-06-27T04:40:01.224 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18687]: Your identification has been saved in /tmp/tmp_ir0i_jz/key. 2020-06-27T04:40:01.225 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18687]: Your public key has been saved in /tmp/tmp_ir0i_jz/key.pub. 2020-06-27T04:40:01.225 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18687]: The key fingerprint is: 2020-06-27T04:40:01.225 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18687]: SHA256:ZKTcuwU8RJX6Uod+CvluKaMfsaqmDgn27HIENeDaHJc ceph-12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:40:01.225 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18687]: The key's randomart image is: 2020-06-27T04:40:01.225 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18687]: +---[RSA 3072]----+ 2020-06-27T04:40:01.226 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18687]: | .. .+... | 2020-06-27T04:40:01.226 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18687]: |. o o * . | 2020-06-27T04:40:01.226 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18687]: | .o E o B. . | 2020-06-27T04:40:01.226 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18687]: |.+ o o.+o . | 2020-06-27T04:40:01.226 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18687]: |o.+ S=.. | 2020-06-27T04:40:01.226 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18687]: |o.o. +=o . | 2020-06-27T04:40:01.227 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18687]: |o .o ++ + | 2020-06-27T04:40:01.227 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18687]: | o... .o.= | 2020-06-27T04:40:01.227 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18687]: | .=+..oo.=. | 2020-06-27T04:40:01.227 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:00 smithi031 bash[18687]: +----[SHA256]-----+ 2020-06-27T04:40:01.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.4945440292358398, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:40:01.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.4947090148925781, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:40:01.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'cephadm', 'get-pub-key'] 2020-06-27T04:40:01.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 cephadm get-pub-key 2020-06-27T04:40:01.999 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.990+0000 7fa6c51a7700 1 Processor -- start 2020-06-27T04:40:01.999 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.990+0000 7fa6c51a7700 1 -- start start 2020-06-27T04:40:02.000 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.990+0000 7fa6c51a7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c0064730 0x7fa6c0064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:02.000 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.990+0000 7fa6c51a7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c00651a0 con 0x7fa6c0064730 2020-06-27T04:40:02.000 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.990+0000 7fa6bf59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c0064730 0x7fa6c0064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:02.000 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6310405731201172, stop=False, exit=None, reads=[10] 2020-06-27T04:40:02.000 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.990+0000 7fa6bf59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c0064730 0x7fa6c0064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38576/0 (socket says 172.21.15.31:38576) 2020-06-27T04:40:02.001 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.990+0000 7fa6bf59e700 1 -- 172.21.15.31:0/1259258957 learned_addr learned my addr 172.21.15.31:0/1259258957 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:02.001 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.991+0000 7fa6bf59e700 1 -- 172.21.15.31:0/1259258957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c0065a20 con 0x7fa6c0064730 2020-06-27T04:40:02.001 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.991+0000 7fa6bf59e700 1 --2- 172.21.15.31:0/1259258957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c0064730 0x7fa6c0064b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fa6b0002f70 tx=0x7fa6b0006ec0).ready entity=mon.0 client_cookie=4eeb4fc039d5a50c server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:02.001 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.991+0000 7fa6be59c700 1 -- 172.21.15.31:0/1259258957 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa6b0009980 con 0x7fa6c0064730 2020-06-27T04:40:02.001 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6312906742095947, stop=False, exit=None, reads=[10] 2020-06-27T04:40:02.002 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.991+0000 7fa6be59c700 1 -- 172.21.15.31:0/1259258957 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fa6b0000e90 con 0x7fa6c0064730 2020-06-27T04:40:02.002 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.991+0000 7fa6be59c700 1 -- 172.21.15.31:0/1259258957 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa6b0011c70 con 0x7fa6c0064730 2020-06-27T04:40:02.002 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.991+0000 7fa6c51a7700 1 -- 172.21.15.31:0/1259258957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c0064730 msgr2=0x7fa6c0064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:02.002 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.991+0000 7fa6c51a7700 1 --2- 172.21.15.31:0/1259258957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c0064730 0x7fa6c0064b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fa6b0002f70 tx=0x7fa6b0006ec0).stop 2020-06-27T04:40:02.002 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.991+0000 7fa6c51a7700 1 -- 172.21.15.31:0/1259258957 shutdown_connections 2020-06-27T04:40:02.003 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6315920352935791, stop=False, exit=None, reads=[10] 2020-06-27T04:40:02.003 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.991+0000 7fa6c51a7700 1 --2- 172.21.15.31:0/1259258957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c0064730 0x7fa6c0064b50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:02.003 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.991+0000 7fa6c51a7700 1 -- 172.21.15.31:0/1259258957 >> 172.21.15.31:0/1259258957 conn(0x7fa6c005ffe0 msgr2=0x7fa6c0062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:02.003 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.991+0000 7fa6c51a7700 1 -- 172.21.15.31:0/1259258957 shutdown_connections 2020-06-27T04:40:02.003 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.991+0000 7fa6c51a7700 1 -- 172.21.15.31:0/1259258957 wait complete. 2020-06-27T04:40:02.004 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.992+0000 7fa6c51a7700 1 Processor -- start 2020-06-27T04:40:02.004 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.992+0000 7fa6c51a7700 1 -- start start 2020-06-27T04:40:02.004 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.992+0000 7fa6c51a7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c0061fc0 0x7fa6c007b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:02.004 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.992+0000 7fa6c51a7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c007b9a0 con 0x7fa6c0061fc0 2020-06-27T04:40:02.004 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.631948709487915, stop=False, exit=None, reads=[10] 2020-06-27T04:40:02.004 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.992+0000 7fa6bf59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c0061fc0 0x7fa6c007b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:02.005 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.993+0000 7fa6bf59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c0061fc0 0x7fa6c007b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38578/0 (socket says 172.21.15.31:38578) 2020-06-27T04:40:02.005 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.993+0000 7fa6bf59e700 1 -- 172.21.15.31:0/805120123 learned_addr learned my addr 172.21.15.31:0/805120123 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:02.005 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6321239471435547, stop=False, exit=None, reads=[10] 2020-06-27T04:40:02.005 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.993+0000 7fa6bf59e700 1 -- 172.21.15.31:0/805120123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c007bae0 con 0x7fa6c0061fc0 2020-06-27T04:40:02.005 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.993+0000 7fa6bf59e700 1 --2- 172.21.15.31:0/805120123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c0061fc0 0x7fa6c007b350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fa6b0006bb0 tx=0x7fa6b0006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:02.006 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6323032379150391, stop=False, exit=None, reads=[10] 2020-06-27T04:40:02.006 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.993+0000 7fa6a77fe700 1 -- 172.21.15.31:0/805120123 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa6b001a820 con 0x7fa6c0061fc0 2020-06-27T04:40:02.006 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.993+0000 7fa6a77fe700 1 -- 172.21.15.31:0/805120123 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fa6b001adc0 con 0x7fa6c0061fc0 2020-06-27T04:40:02.006 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.993+0000 7fa6c51a7700 1 -- 172.21.15.31:0/805120123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c007bd30 con 0x7fa6c0061fc0 2020-06-27T04:40:02.006 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6325283050537109, stop=False, exit=None, reads=[10] 2020-06-27T04:40:02.007 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.993+0000 7fa6a77fe700 1 -- 172.21.15.31:0/805120123 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa6b001bcb0 con 0x7fa6c0061fc0 2020-06-27T04:40:02.007 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.993+0000 7fa6c51a7700 1 -- 172.21.15.31:0/805120123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c007c0e0 con 0x7fa6c0061fc0 2020-06-27T04:40:02.007 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6329519748687744, stop=False, exit=None, reads=[10] 2020-06-27T04:40:02.007 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.994+0000 7fa6a77fe700 1 -- 172.21.15.31:0/805120123 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 31790+0+0 (secure 0 0 0) 0x7fa6b000f070 con 0x7fa6c0061fc0 2020-06-27T04:40:02.007 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6330747604370117, stop=False, exit=None, reads=[10] 2020-06-27T04:40:02.008 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.994+0000 7fa6a77fe700 1 --2- 172.21.15.31:0/805120123 >> v2:172.21.15.31:6800/4294292023 conn(0x7fa69c02ab20 0x7fa69c02cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:02.008 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6332476139068604, stop=False, exit=None, reads=[10] 2020-06-27T04:40:02.008 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.994+0000 7fa6a77fe700 1 -- 172.21.15.31:0/805120123 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1326+0+0 (secure 0 0 0) 0x7fa6b003bb40 con 0x7fa6c0061fc0 2020-06-27T04:40:02.008 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6333780288696289, stop=False, exit=None, reads=[10] 2020-06-27T04:40:02.008 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.994+0000 7fa6bed9d700 1 --2- 172.21.15.31:0/805120123 >> v2:172.21.15.31:6800/4294292023 conn(0x7fa69c02ab20 0x7fa69c02cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:02.008 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.994+0000 7fa6c51a7700 1 -- 172.21.15.31:0/805120123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c0057340 con 0x7fa6c0061fc0 2020-06-27T04:40:02.009 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6335022449493408, stop=False, exit=None, reads=[10] 2020-06-27T04:40:02.009 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.994+0000 7fa6bed9d700 1 --2- 172.21.15.31:0/805120123 >> v2:172.21.15.31:6800/4294292023 conn(0x7fa69c02ab20 0x7fa69c02cfe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fa6b4002f70 tx=0x7fa6b4006b20).ready entity=mgr.14119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:02.009 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6337339878082275, stop=False, exit=None, reads=[10] 2020-06-27T04:40:02.010 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:01.998+0000 7fa6a77fe700 1 -- 172.21.15.31:0/805120123 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fa6b0025460 con 0x7fa6c0061fc0 2020-06-27T04:40:02.010 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6371560096740723, stop=False, exit=None, reads=[10] 2020-06-27T04:40:02.156 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:02.153+0000 7fa6c51a7700 1 -- 172.21.15.31:0/805120123 --> v2:172.21.15.31:6800/4294292023 -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6c0043e80 con 0x7fa69c02ab20 2020-06-27T04:40:02.157 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7922697067260742, stop=False, exit=None, reads=[10] 2020-06-27T04:40:02.157 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:02.153+0000 7fa6a77fe700 1 -- 172.21.15.31:0/805120123 <== mgr.14119 v2:172.21.15.31:6800/4294292023 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fa6c0043e80 con 0x7fa69c02ab20 2020-06-27T04:40:02.157 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7926273345947266, stop=False, exit=None, reads=[10] 2020-06-27T04:40:02.157 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDwG+KEW3Hml51D9hOYXlF5qTtWyLyR+mKDtutmBBYmUqpr2VG1h39W/5dE6ceAANeugcJwW4sGpaqerL5JbTqKrF/gwvyMd4wPp6L3RGOhn45g97n2UkJccRivhOLI95VIPc3EH1QWXC6BlmYRZGKxXgycv5t2YO24m2+il4VQxQo2HjylAVLP97NDmWtJbKTqJl4v4maOenc+12IBvplnxPCErRD5f1bUn0ibKFtnAZL8rI+3bI5KZaBPo87q1vmmLczZRVs/JP2ruajlcvf+Vh141QmxjheH/vG+C11yLL3tnD8JV6tbMhMK1uY/89JcBmuUcUCulaUe0X+w40VERWPb0h2MeavfRbs3DTC3TBVn6IXmgS1/vOXJYbF15pv8DR20PqjPocjSCBWqqW9SGhcPLmq+OHQCr/b+XWbpMVTEAbAeOuCsOodAiaXFv5CQJvMadqBpk+xDF/TPpLp2S2N8ohJLW2QNXF9fumlq3KWAaq3R+Diwz0fZTGvk+Ok= ceph-12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:40:02.158 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7927343845367432, stop=False, exit=None, reads=[8] 2020-06-27T04:40:02.159 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:02.155+0000 7fa6c51a7700 1 -- 172.21.15.31:0/805120123 >> v2:172.21.15.31:6800/4294292023 conn(0x7fa69c02ab20 msgr2=0x7fa69c02cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:02.159 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:02.155+0000 7fa6c51a7700 1 --2- 172.21.15.31:0/805120123 >> v2:172.21.15.31:6800/4294292023 conn(0x7fa69c02ab20 0x7fa69c02cfe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fa6b4002f70 tx=0x7fa6b4006b20).stop 2020-06-27T04:40:02.160 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:02.155+0000 7fa6c51a7700 1 -- 172.21.15.31:0/805120123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c0061fc0 msgr2=0x7fa6c007b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:02.160 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:02.155+0000 7fa6c51a7700 1 --2- 172.21.15.31:0/805120123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c0061fc0 0x7fa6c007b350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fa6b0006bb0 tx=0x7fa6b0006ec0).stop 2020-06-27T04:40:02.160 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7940487861633301, stop=False, exit=None, reads=[10] 2020-06-27T04:40:02.160 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:02.155+0000 7fa6c51a7700 1 -- 172.21.15.31:0/805120123 shutdown_connections 2020-06-27T04:40:02.160 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:02.155+0000 7fa6c51a7700 1 --2- 172.21.15.31:0/805120123 >> v2:172.21.15.31:6800/4294292023 conn(0x7fa69c02ab20 0x7fa69c02cfe0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:02.161 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:02.155+0000 7fa6c51a7700 1 --2- 172.21.15.31:0/805120123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6c0061fc0 0x7fa6c007b350 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:02.161 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:02.155+0000 7fa6c51a7700 1 -- 172.21.15.31:0/805120123 >> 172.21.15.31:0/805120123 conn(0x7fa6c005ffe0 msgr2=0x7fa6c0062460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:02.161 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:02.155+0000 7fa6c51a7700 1 -- 172.21.15.31:0/805120123 shutdown_connections 2020-06-27T04:40:02.161 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:02.155+0000 7fa6c51a7700 1 -- 172.21.15.31:0/805120123 wait complete. 2020-06-27T04:40:02.161 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.794245719909668, stop=False, exit=None, reads=[10] 2020-06-27T04:40:02.608 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.2436349391937256, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:40:02.608 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.2438077926635742, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:40:02.609 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2020-06-27T04:40:02.609 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Adding key to root@localhost's authorized_keys... 2020-06-27T04:40:02.609 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Adding host smithi031... 2020-06-27T04:40:02.610 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'orch', 'host', 'add', 'smithi031'] 2020-06-27T04:40:02.610 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 orch host add smithi031 2020-06-27T04:40:03.274 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.265+0000 7ff018344700 1 Processor -- start 2020-06-27T04:40:03.274 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.265+0000 7ff018344700 1 -- start start 2020-06-27T04:40:03.274 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.265+0000 7ff018344700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff010064730 0x7ff010064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:03.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.265+0000 7ff018344700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100651a0 con 0x7ff010064730 2020-06-27T04:40:03.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.265+0000 7ff0168e1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff010064730 0x7ff010064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:03.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6597716808319092, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.265+0000 7ff0168e1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff010064730 0x7ff010064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38582/0 (socket says 172.21.15.31:38582) 2020-06-27T04:40:03.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.265+0000 7ff0168e1700 1 -- 172.21.15.31:0/4105870503 learned_addr learned my addr 172.21.15.31:0/4105870503 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:03.276 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.265+0000 7ff0168e1700 1 -- 172.21.15.31:0/4105870503 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff010065a20 con 0x7ff010064730 2020-06-27T04:40:03.276 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.266+0000 7ff0168e1700 1 --2- 172.21.15.31:0/4105870503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff010064730 0x7ff010064b50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff00c002f70 tx=0x7ff00c006ec0).ready entity=mon.0 client_cookie=b89f8d60837a09f6 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:03.276 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.266+0000 7ff0158df700 1 -- 172.21.15.31:0/4105870503 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff00c009980 con 0x7ff010064730 2020-06-27T04:40:03.276 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6599719524383545, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.276 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.266+0000 7ff0158df700 1 -- 172.21.15.31:0/4105870503 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7ff00c000e90 con 0x7ff010064730 2020-06-27T04:40:03.277 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.266+0000 7ff0158df700 1 -- 172.21.15.31:0/4105870503 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff00c011c70 con 0x7ff010064730 2020-06-27T04:40:03.277 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.266+0000 7ff018344700 1 -- 172.21.15.31:0/4105870503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff010064730 msgr2=0x7ff010064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:03.277 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.266+0000 7ff018344700 1 --2- 172.21.15.31:0/4105870503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff010064730 0x7ff010064b50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff00c002f70 tx=0x7ff00c006ec0).stop 2020-06-27T04:40:03.277 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.266+0000 7ff018344700 1 -- 172.21.15.31:0/4105870503 shutdown_connections 2020-06-27T04:40:03.277 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6601381301879883, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.278 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.266+0000 7ff018344700 1 --2- 172.21.15.31:0/4105870503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff010064730 0x7ff010064b50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:03.278 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.266+0000 7ff018344700 1 -- 172.21.15.31:0/4105870503 >> 172.21.15.31:0/4105870503 conn(0x7ff01005ffe0 msgr2=0x7ff010062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:03.278 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.266+0000 7ff018344700 1 -- 172.21.15.31:0/4105870503 shutdown_connections 2020-06-27T04:40:03.278 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.266+0000 7ff018344700 1 -- 172.21.15.31:0/4105870503 wait complete. 2020-06-27T04:40:03.278 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6602768898010254, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.278 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.267+0000 7ff018344700 1 Processor -- start 2020-06-27T04:40:03.279 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6607034206390381, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.279 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.267+0000 7ff018344700 1 -- start start 2020-06-27T04:40:03.279 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6608037948608398, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.279 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.268+0000 7ff018344700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff01007a7f0 0x7ff01007ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:03.279 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.268+0000 7ff018344700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01007b260 con 0x7ff01007a7f0 2020-06-27T04:40:03.280 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6609821319580078, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.280 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.268+0000 7ff0168e1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff01007a7f0 0x7ff01007ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:03.280 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.268+0000 7ff0168e1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff01007a7f0 0x7ff01007ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38584/0 (socket says 172.21.15.31:38584) 2020-06-27T04:40:03.280 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.268+0000 7ff0168e1700 1 -- 172.21.15.31:0/1140631340 learned_addr learned my addr 172.21.15.31:0/1140631340 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:03.280 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6612193584442139, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.281 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.268+0000 7ff0168e1700 1 -- 172.21.15.31:0/1140631340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01007bbc0 con 0x7ff01007a7f0 2020-06-27T04:40:03.281 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.661353349685669, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.281 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.268+0000 7ff0168e1700 1 --2- 172.21.15.31:0/1140631340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff01007a7f0 0x7ff01007ac10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff00c006bb0 tx=0x7ff00c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:03.281 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6614627838134766, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.281 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.268+0000 7feffeffd700 1 -- 172.21.15.31:0/1140631340 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff00c01a820 con 0x7ff01007a7f0 2020-06-27T04:40:03.288 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6616055965423584, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.288 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.268+0000 7feffeffd700 1 -- 172.21.15.31:0/1140631340 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7ff00c01adc0 con 0x7ff01007a7f0 2020-06-27T04:40:03.288 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.268+0000 7ff018344700 1 -- 172.21.15.31:0/1140631340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01007be10 con 0x7ff01007a7f0 2020-06-27T04:40:03.288 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.268+0000 7feffeffd700 1 -- 172.21.15.31:0/1140631340 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff00c01bcb0 con 0x7ff01007a7f0 2020-06-27T04:40:03.289 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6617727279663086, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.289 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.268+0000 7ff018344700 1 -- 172.21.15.31:0/1140631340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01007c240 con 0x7ff01007a7f0 2020-06-27T04:40:03.289 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6619124412536621, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.289 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.269+0000 7feffeffd700 1 -- 172.21.15.31:0/1140631340 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 31790+0+0 (secure 0 0 0) 0x7ff00c00f070 con 0x7ff01007a7f0 2020-06-27T04:40:03.290 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6622836589813232, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.290 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.269+0000 7feffeffd700 1 --2- 172.21.15.31:0/1140631340 >> v2:172.21.15.31:6800/4294292023 conn(0x7feff402aad0 0x7feff402cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:03.290 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6625010967254639, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.290 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.269+0000 7feffeffd700 1 -- 172.21.15.31:0/1140631340 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1326+0+0 (secure 0 0 0) 0x7ff00c03bb30 con 0x7ff01007a7f0 2020-06-27T04:40:03.290 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6626138687133789, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.291 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.269+0000 7ff0160e0700 1 --2- 172.21.15.31:0/1140631340 >> v2:172.21.15.31:6800/4294292023 conn(0x7feff402aad0 0x7feff402cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:03.291 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6626920700073242, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.291 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.270+0000 7ff018344700 1 -- 172.21.15.31:0/1140631340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01007b3a0 con 0x7ff01007a7f0 2020-06-27T04:40:03.291 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.270+0000 7ff0160e0700 1 --2- 172.21.15.31:0/1140631340 >> v2:172.21.15.31:6800/4294292023 conn(0x7feff402aad0 0x7feff402cf90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff000002f70 tx=0x7ff000006b20).ready entity=mgr.14119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:03.291 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6629688739776611, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.292 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.273+0000 7feffeffd700 1 -- 172.21.15.31:0/1140631340 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7ff00c0243c0 con 0x7ff01007a7f0 2020-06-27T04:40:03.292 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.666790246963501, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.451 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:03.447+0000 7ff018344700 1 -- 172.21.15.31:0/1140631340 --> v2:172.21.15.31:6800/4294292023 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi031", "target": ["mon-mgr", ""]}) v1 -- 0x7ff010057340 con 0x7feff402aad0 2020-06-27T04:40:03.451 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8408243656158447, stop=False, exit=None, reads=[10] 2020-06-27T04:40:03.471 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:03 smithi031 bash[18426]: audit 2020-06-27T04:40:02.154832+0000 mgr.y (mgr.14119) 6 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:40:03.722 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:03 smithi031 bash[18687]: Warning: Permanently added 'smithi031,172.21.15.31' (ECDSA) to the list of known hosts. 2020-06-27T04:40:04.032 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Added host 'smithi031' 2020-06-27T04:40:04.032 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.4215898513793945, stop=False, exit=None, reads=[8] 2020-06-27T04:40:04.032 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:04.027+0000 7feffeffd700 1 -- 172.21.15.31:0/1140631340 <== mgr.14119 v2:172.21.15.31:6800/4294292023 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7ff010057340 con 0x7feff402aad0 2020-06-27T04:40:04.032 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.4216880798339844, stop=False, exit=None, reads=[10] 2020-06-27T04:40:04.034 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:04.029+0000 7ff018344700 1 -- 172.21.15.31:0/1140631340 >> v2:172.21.15.31:6800/4294292023 conn(0x7feff402aad0 msgr2=0x7feff402cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:04.034 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:04.029+0000 7ff018344700 1 --2- 172.21.15.31:0/1140631340 >> v2:172.21.15.31:6800/4294292023 conn(0x7feff402aad0 0x7feff402cf90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff000002f70 tx=0x7ff000006b20).stop 2020-06-27T04:40:04.034 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.422318935394287, stop=False, exit=None, reads=[10] 2020-06-27T04:40:04.035 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:04.029+0000 7ff018344700 1 -- 172.21.15.31:0/1140631340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff01007a7f0 msgr2=0x7ff01007ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:04.035 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:04.029+0000 7ff018344700 1 --2- 172.21.15.31:0/1140631340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff01007a7f0 0x7ff01007ac10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff00c006bb0 tx=0x7ff00c006ec0).stop 2020-06-27T04:40:04.035 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.4224889278411865, stop=False, exit=None, reads=[10] 2020-06-27T04:40:04.035 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:04.029+0000 7ff018344700 1 -- 172.21.15.31:0/1140631340 shutdown_connections 2020-06-27T04:40:04.035 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:04.029+0000 7ff018344700 1 --2- 172.21.15.31:0/1140631340 >> v2:172.21.15.31:6800/4294292023 conn(0x7feff402aad0 0x7feff402cf90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:04.036 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:04.029+0000 7ff018344700 1 --2- 172.21.15.31:0/1140631340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff01007a7f0 0x7ff01007ac10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:04.036 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:04.029+0000 7ff018344700 1 -- 172.21.15.31:0/1140631340 >> 172.21.15.31:0/1140631340 conn(0x7ff01005ffe0 msgr2=0x7ff01006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:04.036 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.422722578048706, stop=False, exit=None, reads=[10] 2020-06-27T04:40:04.036 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:04.029+0000 7ff018344700 1 -- 172.21.15.31:0/1140631340 shutdown_connections 2020-06-27T04:40:04.036 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:04.029+0000 7ff018344700 1 -- 172.21.15.31:0/1140631340 wait complete. 2020-06-27T04:40:04.037 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.4228835105895996, stop=False, exit=None, reads=[10] 2020-06-27T04:40:04.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:04 smithi031 bash[18426]: audit 2020-06-27T04:40:03.449522+0000 mgr.y (mgr.14119) 7 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi031", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:40:04.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:04 smithi031 bash[18426]: audit 2020-06-27T04:40:04.025213+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi031\": {\"hostname\": \"smithi031\", \"addr\": \"smithi031\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2020-06-27T04:40:04.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:04 smithi031 bash[18426]: audit 2020-06-27T04:40:04.027084+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi031\": {\"hostname\": \"smithi031\", \"addr\": \"smithi031\", \"labels\": [], \"status\": \"\"}}"}]': finished 2020-06-27T04:40:04.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:04 smithi031 bash[18426]: cephadm 2020-06-27T04:40:04.027414+0000 mgr.y (mgr.14119) 8 : cephadm [INF] Added host smithi031 2020-06-27T04:40:04.540 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.93003249168396, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:40:04.541 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.930201768875122, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:40:04.541 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Enabling the dashboard module... 2020-06-27T04:40:04.541 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'mgr', 'module', 'enable', 'dashboard'] 2020-06-27T04:40:04.541 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 mgr module enable dashboard 2020-06-27T04:40:05.190 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.181+0000 7fd972cb0700 1 Processor -- start 2020-06-27T04:40:05.190 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.181+0000 7fd972cb0700 1 -- start start 2020-06-27T04:40:05.190 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.181+0000 7fd972cb0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96c064730 0x7fd96c064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:05.191 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.181+0000 7fd972cb0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c0651a0 con 0x7fd96c064730 2020-06-27T04:40:05.191 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.181+0000 7fd97124d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96c064730 0x7fd96c064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:05.191 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6446452140808105, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.191 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.181+0000 7fd97124d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96c064730 0x7fd96c064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38590/0 (socket says 172.21.15.31:38590) 2020-06-27T04:40:05.191 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.181+0000 7fd97124d700 1 -- 172.21.15.31:0/2401887216 learned_addr learned my addr 172.21.15.31:0/2401887216 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:05.192 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.182+0000 7fd97124d700 1 -- 172.21.15.31:0/2401887216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c065a20 con 0x7fd96c064730 2020-06-27T04:40:05.192 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.182+0000 7fd97124d700 1 --2- 172.21.15.31:0/2401887216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96c064730 0x7fd96c064b50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd968002f70 tx=0x7fd968006ec0).ready entity=mon.0 client_cookie=dea1e982354ebc14 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:05.192 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.182+0000 7fd963fff700 1 -- 172.21.15.31:0/2401887216 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fd968009980 con 0x7fd96c064730 2020-06-27T04:40:05.192 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6449120044708252, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.192 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.182+0000 7fd963fff700 1 -- 172.21.15.31:0/2401887216 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fd968000e90 con 0x7fd96c064730 2020-06-27T04:40:05.193 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.182+0000 7fd963fff700 1 -- 172.21.15.31:0/2401887216 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fd968011c70 con 0x7fd96c064730 2020-06-27T04:40:05.193 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.182+0000 7fd972cb0700 1 -- 172.21.15.31:0/2401887216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96c064730 msgr2=0x7fd96c064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:05.193 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.182+0000 7fd972cb0700 1 --2- 172.21.15.31:0/2401887216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96c064730 0x7fd96c064b50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd968002f70 tx=0x7fd968006ec0).stop 2020-06-27T04:40:05.193 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.182+0000 7fd972cb0700 1 -- 172.21.15.31:0/2401887216 shutdown_connections 2020-06-27T04:40:05.193 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6452558040618896, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.194 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.182+0000 7fd972cb0700 1 --2- 172.21.15.31:0/2401887216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96c064730 0x7fd96c064b50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:05.194 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.182+0000 7fd972cb0700 1 -- 172.21.15.31:0/2401887216 >> 172.21.15.31:0/2401887216 conn(0x7fd96c05ffe0 msgr2=0x7fd96c062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:05.194 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.182+0000 7fd972cb0700 1 -- 172.21.15.31:0/2401887216 shutdown_connections 2020-06-27T04:40:05.194 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.182+0000 7fd972cb0700 1 -- 172.21.15.31:0/2401887216 wait complete. 2020-06-27T04:40:05.194 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.183+0000 7fd972cb0700 1 Processor -- start 2020-06-27T04:40:05.195 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.183+0000 7fd972cb0700 1 -- start start 2020-06-27T04:40:05.195 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6456634998321533, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.195 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.184+0000 7fd972cb0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96c062000 0x7fd96c07b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:05.195 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6457781791687012, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.195 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.184+0000 7fd972cb0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c07b960 con 0x7fd96c062000 2020-06-27T04:40:05.195 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6459035873413086, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.184+0000 7fd97124d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96c062000 0x7fd96c07b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.184+0000 7fd97124d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96c062000 0x7fd96c07b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38592/0 (socket says 172.21.15.31:38592) 2020-06-27T04:40:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.184+0000 7fd97124d700 1 -- 172.21.15.31:0/2599745261 learned_addr learned my addr 172.21.15.31:0/2599745261 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6461210250854492, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.184+0000 7fd97124d700 1 -- 172.21.15.31:0/2599745261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c07baa0 con 0x7fd96c062000 2020-06-27T04:40:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6463150978088379, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.184+0000 7fd97124d700 1 --2- 172.21.15.31:0/2599745261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96c062000 0x7fd96c07b310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd968006bb0 tx=0x7fd968006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6464293003082275, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.185+0000 7fd9617fa700 1 -- 172.21.15.31:0/2599745261 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fd96801a820 con 0x7fd96c062000 2020-06-27T04:40:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.185+0000 7fd9617fa700 1 -- 172.21.15.31:0/2599745261 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fd96801adc0 con 0x7fd96c062000 2020-06-27T04:40:05.198 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.646730899810791, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.198 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.185+0000 7fd972cb0700 1 -- 172.21.15.31:0/2599745261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96c07bcf0 con 0x7fd96c062000 2020-06-27T04:40:05.198 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.185+0000 7fd9617fa700 1 -- 172.21.15.31:0/2599745261 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fd96801bcb0 con 0x7fd96c062000 2020-06-27T04:40:05.198 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.185+0000 7fd972cb0700 1 -- 172.21.15.31:0/2599745261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96c07c120 con 0x7fd96c062000 2020-06-27T04:40:05.198 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6468691825866699, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.199 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.186+0000 7fd972cb0700 1 -- 172.21.15.31:0/2599745261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96c057340 con 0x7fd96c062000 2020-06-27T04:40:05.199 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6476538181304932, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.199 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.186+0000 7fd9617fa700 1 -- 172.21.15.31:0/2599745261 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 31790+0+0 (secure 0 0 0) 0x7fd96800f070 con 0x7fd96c062000 2020-06-27T04:40:05.199 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6478245258331299, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.199 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.186+0000 7fd9617fa700 1 --2- 172.21.15.31:0/2599745261 >> v2:172.21.15.31:6800/4294292023 conn(0x7fd94802aad0 0x7fd94802cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:05.199 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.647991418838501, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.200 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.186+0000 7fd9617fa700 1 -- 172.21.15.31:0/2599745261 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1326+0+0 (secure 0 0 0) 0x7fd96803b800 con 0x7fd96c062000 2020-06-27T04:40:05.200 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6481218338012695, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.200 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.186+0000 7fd970a4c700 1 --2- 172.21.15.31:0/2599745261 >> v2:172.21.15.31:6800/4294292023 conn(0x7fd94802aad0 0x7fd94802cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:05.200 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6482501029968262, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.200 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.187+0000 7fd970a4c700 1 --2- 172.21.15.31:0/2599745261 >> v2:172.21.15.31:6800/4294292023 conn(0x7fd94802aad0 0x7fd94802cf90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fd95c002f70 tx=0x7fd95c006b20).ready entity=mgr.14119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:05.201 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.648552417755127, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.201 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.190+0000 7fd9617fa700 1 -- 172.21.15.31:0/2599745261 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fd968025460 con 0x7fd96c062000 2020-06-27T04:40:05.202 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6517336368560791, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.387 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:05.384+0000 7fd972cb0700 1 -- 172.21.15.31:0/2599745261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fd96c043e80 con 0x7fd96c062000 2020-06-27T04:40:05.388 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8462378978729248, stop=False, exit=None, reads=[10] 2020-06-27T04:40:05.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:05 smithi031 bash[18426]: audit 2020-06-27T04:40:04.294443+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:40:05.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:05 smithi031 bash[18426]: audit 2020-06-27T04:40:04.296377+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:40:05.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:05 smithi031 bash[18426]: audit 2020-06-27T04:40:04.296924+0000 mon.a (mon.0) 68 : audit [DBG] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:40:05.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:05 smithi031 bash[18426]: audit 2020-06-27T04:40:05.150498+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:40:05.147703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:40:05.149858\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-06-27T04:40:05.149994\", \"networks\": {}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:40:05.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:05 smithi031 bash[18426]: audit 2020-06-27T04:40:05.152260+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:40:05.147703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:40:05.149858\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-06-27T04:40:05.149994\", \"networks\": {}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:40:05.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:05 smithi031 bash[18426]: audit 2020-06-27T04:40:05.152856+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.14119 172.21.15.31:0/3667018094' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:40:06.181 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:06.164+0000 7fd9617fa700 1 -- 172.21.15.31:0/2599745261 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 9) v1 ==== 31803+0+0 (secure 0 0 0) 0x7fd968025640 con 0x7fd96c062000 2020-06-27T04:40:06.182 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.6263742446899414, stop=False, exit=None, reads=[10] 2020-06-27T04:40:06.182 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:06.166+0000 7fd9617fa700 1 -- 172.21.15.31:0/2599745261 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fd9680224f0 con 0x7fd96c062000 2020-06-27T04:40:06.182 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.6276733875274658, stop=False, exit=None, reads=[10] 2020-06-27T04:40:06.182 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:06.167+0000 7fd972cb0700 1 -- 172.21.15.31:0/2599745261 >> v2:172.21.15.31:6800/4294292023 conn(0x7fd94802aad0 msgr2=0x7fd94802cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:06.183 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:06.167+0000 7fd972cb0700 1 --2- 172.21.15.31:0/2599745261 >> v2:172.21.15.31:6800/4294292023 conn(0x7fd94802aad0 0x7fd94802cf90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fd95c002f70 tx=0x7fd95c006b20).stop 2020-06-27T04:40:06.183 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:06.167+0000 7fd972cb0700 1 -- 172.21.15.31:0/2599745261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96c062000 msgr2=0x7fd96c07b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:06.183 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:06.167+0000 7fd972cb0700 1 --2- 172.21.15.31:0/2599745261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96c062000 0x7fd96c07b310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd968006bb0 tx=0x7fd968006ec0).stop 2020-06-27T04:40:06.183 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.62955641746521, stop=False, exit=None, reads=[10] 2020-06-27T04:40:06.183 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:06.168+0000 7fd972cb0700 1 -- 172.21.15.31:0/2599745261 shutdown_connections 2020-06-27T04:40:06.183 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:06.168+0000 7fd972cb0700 1 --2- 172.21.15.31:0/2599745261 >> v2:172.21.15.31:6800/4294292023 conn(0x7fd94802aad0 0x7fd94802cf90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:06.184 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:06.168+0000 7fd972cb0700 1 --2- 172.21.15.31:0/2599745261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96c062000 0x7fd96c07b310 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:06.184 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:06.168+0000 7fd972cb0700 1 -- 172.21.15.31:0/2599745261 >> 172.21.15.31:0/2599745261 conn(0x7fd96c05ffe0 msgr2=0x7fd96c062460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:06.184 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:06.168+0000 7fd972cb0700 1 -- 172.21.15.31:0/2599745261 shutdown_connections 2020-06-27T04:40:06.184 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:06.168+0000 7fd972cb0700 1 -- 172.21.15.31:0/2599745261 wait complete. 2020-06-27T04:40:06.184 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.6297576427459717, stop=False, exit=None, reads=[10] 2020-06-27T04:40:06.222 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:06 smithi031 bash[18426]: audit 2020-06-27T04:40:05.386091+0000 mon.a (mon.0) 72 : audit [INF] from='client.? 172.21.15.31:0/2599745261' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2020-06-27T04:40:06.223 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:06 smithi031 bash[18687]: ignoring --setuser ceph since I am not root 2020-06-27T04:40:06.223 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:06 smithi031 bash[18687]: ignoring --setgroup ceph since I am not root 2020-06-27T04:40:06.223 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:06 smithi031 bash[18687]: debug 2020-06-27T04:40:06.194+0000 7f9d2de80380 1 -- 172.21.15.31:0/3209794150 shutdown_connections 2020-06-27T04:40:06.223 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:06 smithi031 bash[18687]: debug 2020-06-27T04:40:06.194+0000 7f9d2de80380 1 --2- 172.21.15.31:0/3209794150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56168c3d4c00 0x56168c457400 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:06.224 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:06 smithi031 bash[18687]: debug 2020-06-27T04:40:06.194+0000 7f9d2de80380 1 -- 172.21.15.31:0/3209794150 >> 172.21.15.31:0/3209794150 conn(0x56168c3d4800 msgr2=0x56168d044800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:06.224 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:06 smithi031 bash[18687]: debug 2020-06-27T04:40:06.194+0000 7f9d2de80380 1 -- 172.21.15.31:0/3209794150 shutdown_connections 2020-06-27T04:40:06.224 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:06 smithi031 bash[18687]: debug 2020-06-27T04:40:06.194+0000 7f9d2de80380 1 -- 172.21.15.31:0/3209794150 wait complete. 2020-06-27T04:40:06.771 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=2.2296175956726074, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:40:06.772 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=2.229774236679077, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:40:06.772 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'mgr', 'dump'] 2020-06-27T04:40:06.772 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 mgr dump 2020-06-27T04:40:07.340 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:07 smithi031 bash[18426]: audit 2020-06-27T04:40:06.167262+0000 mon.a (mon.0) 73 : audit [INF] from='client.? 172.21.15.31:0/2599745261' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2020-06-27T04:40:07.341 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:07 smithi031 bash[18426]: cluster 2020-06-27T04:40:06.167305+0000 mon.a (mon.0) 74 : cluster [DBG] mgrmap e9: y(active, since 9s) 2020-06-27T04:40:07.441 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.432+0000 7f19afad5700 1 Processor -- start 2020-06-27T04:40:07.441 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.432+0000 7f19afad5700 1 -- start start 2020-06-27T04:40:07.441 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.432+0000 7f19afad5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a8064730 0x7f19a8064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:07.441 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.432+0000 7f19afad5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a80651a0 con 0x7f19a8064730 2020-06-27T04:40:07.442 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.432+0000 7f19ae072700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a8064730 0x7f19a8064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:07.442 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.664290189743042, stop=False, exit=None, reads=[10] 2020-06-27T04:40:07.442 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.432+0000 7f19ae072700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a8064730 0x7f19a8064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38606/0 (socket says 172.21.15.31:38606) 2020-06-27T04:40:07.442 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.432+0000 7f19ae072700 1 -- 172.21.15.31:0/258690348 learned_addr learned my addr 172.21.15.31:0/258690348 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:07.442 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.432+0000 7f19ae072700 1 -- 172.21.15.31:0/258690348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a8065a20 con 0x7f19a8064730 2020-06-27T04:40:07.443 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.433+0000 7f19ae072700 1 --2- 172.21.15.31:0/258690348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a8064730 0x7f19a8064b50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f19a4002f70 tx=0x7f19a4006ec0).ready entity=mon.0 client_cookie=b8e808c42f919f9 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:07.443 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.433+0000 7f19ad070700 1 -- 172.21.15.31:0/258690348 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f19a4009980 con 0x7f19a8064730 2020-06-27T04:40:07.443 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6645987033843994, stop=False, exit=None, reads=[10] 2020-06-27T04:40:07.443 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.433+0000 7f19ad070700 1 -- 172.21.15.31:0/258690348 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f19a4000e90 con 0x7f19a8064730 2020-06-27T04:40:07.443 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.433+0000 7f19ad070700 1 -- 172.21.15.31:0/258690348 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f19a4011c70 con 0x7f19a8064730 2020-06-27T04:40:07.444 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.433+0000 7f19afad5700 1 -- 172.21.15.31:0/258690348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a8064730 msgr2=0x7f19a8064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:07.444 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.433+0000 7f19afad5700 1 --2- 172.21.15.31:0/258690348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a8064730 0x7f19a8064b50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f19a4002f70 tx=0x7f19a4006ec0).stop 2020-06-27T04:40:07.444 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.433+0000 7f19afad5700 1 -- 172.21.15.31:0/258690348 shutdown_connections 2020-06-27T04:40:07.444 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.664879560470581, stop=False, exit=None, reads=[10] 2020-06-27T04:40:07.444 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.433+0000 7f19afad5700 1 --2- 172.21.15.31:0/258690348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a8064730 0x7f19a8064b50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:07.445 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.433+0000 7f19afad5700 1 -- 172.21.15.31:0/258690348 >> 172.21.15.31:0/258690348 conn(0x7f19a805ffe0 msgr2=0x7f19a8062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:07.445 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.433+0000 7f19afad5700 1 -- 172.21.15.31:0/258690348 shutdown_connections 2020-06-27T04:40:07.445 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.433+0000 7f19afad5700 1 -- 172.21.15.31:0/258690348 wait complete. 2020-06-27T04:40:07.445 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.434+0000 7f19afad5700 1 Processor -- start 2020-06-27T04:40:07.445 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.434+0000 7f19afad5700 1 -- start start 2020-06-27T04:40:07.446 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.434+0000 7f19afad5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a8076860 0x7f19a8078c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:07.446 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.434+0000 7f19afad5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a80623a0 con 0x7f19a8076860 2020-06-27T04:40:07.446 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6652712821960449, stop=False, exit=None, reads=[10] 2020-06-27T04:40:07.446 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.434+0000 7f19ae072700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a8076860 0x7f19a8078c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:07.446 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.434+0000 7f19ae072700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a8076860 0x7f19a8078c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38608/0 (socket says 172.21.15.31:38608) 2020-06-27T04:40:07.447 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.434+0000 7f19ae072700 1 -- 172.21.15.31:0/463112027 learned_addr learned my addr 172.21.15.31:0/463112027 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:07.447 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.434+0000 7f19ae072700 1 -- 172.21.15.31:0/463112027 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a8079180 con 0x7f19a8076860 2020-06-27T04:40:07.447 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.665534257888794, stop=False, exit=None, reads=[10] 2020-06-27T04:40:07.447 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.435+0000 7f19ae072700 1 --2- 172.21.15.31:0/463112027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a8076860 0x7f19a8078c90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f19a4002f70 tx=0x7f19a4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:07.447 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.435+0000 7f199e7fc700 1 -- 172.21.15.31:0/463112027 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f19a4010940 con 0x7f19a8076860 2020-06-27T04:40:07.448 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.435+0000 7f19afad5700 1 -- 172.21.15.31:0/463112027 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a80793d0 con 0x7f19a8076860 2020-06-27T04:40:07.448 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.435+0000 7f199e7fc700 1 -- 172.21.15.31:0/463112027 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f19a4010ee0 con 0x7f19a8076860 2020-06-27T04:40:07.448 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.435+0000 7f199e7fc700 1 -- 172.21.15.31:0/463112027 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f19a401bc90 con 0x7f19a8076860 2020-06-27T04:40:07.448 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6658735275268555, stop=False, exit=None, reads=[10] 2020-06-27T04:40:07.448 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.435+0000 7f19afad5700 1 -- 172.21.15.31:0/463112027 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a8079800 con 0x7f19a8076860 2020-06-27T04:40:07.449 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6660258769989014, stop=False, exit=None, reads=[10] 2020-06-27T04:40:07.449 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.436+0000 7f199e7fc700 1 -- 172.21.15.31:0/463112027 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 9) v1 ==== 31803+0+0 (secure 0 0 0) 0x7f19a400f070 con 0x7f19a8076860 2020-06-27T04:40:07.449 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6662795543670654, stop=False, exit=None, reads=[10] 2020-06-27T04:40:07.449 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.436+0000 7f199e7fc700 1 --2- 172.21.15.31:0/463112027 >> v2:172.21.15.31:6800/4294292023 conn(0x7f198402ab20 0x7f198402cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:07.449 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6664342880249023, stop=False, exit=None, reads=[10] 2020-06-27T04:40:07.450 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.436+0000 7f199e7fc700 1 -- 172.21.15.31:0/463112027 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1326+0+0 (secure 0 0 0) 0x7f19a403bb10 con 0x7f19a8076860 2020-06-27T04:40:07.450 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.436+0000 7f19ad871700 1 -- 172.21.15.31:0/463112027 >> v2:172.21.15.31:6800/4294292023 conn(0x7f198402ab20 msgr2=0x7f198402cfe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/4294292023 2020-06-27T04:40:07.450 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.436+0000 7f19ad871700 1 --2- 172.21.15.31:0/463112027 >> v2:172.21.15.31:6800/4294292023 conn(0x7f198402ab20 0x7f198402cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2020-06-27T04:40:07.450 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6666722297668457, stop=False, exit=None, reads=[10] 2020-06-27T04:40:07.450 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.436+0000 7f19afad5700 1 -- 172.21.15.31:0/463112027 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a8057340 con 0x7f19a8076860 2020-06-27T04:40:07.451 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6667883396148682, stop=False, exit=None, reads=[10] 2020-06-27T04:40:07.451 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.440+0000 7f199e7fc700 1 -- 172.21.15.31:0/463112027 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f19a4025460 con 0x7f19a8076860 2020-06-27T04:40:07.452 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6706140041351318, stop=False, exit=None, reads=[10] 2020-06-27T04:40:07.637 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.633+0000 7f19afad5700 1 -- 172.21.15.31:0/463112027 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr dump"} v 0) v1 -- 0x7f19a805b1a0 con 0x7f19a8076860 2020-06-27T04:40:07.637 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8639047145843506, stop=False, exit=None, reads=[10] 2020-06-27T04:40:08.015 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.635+0000 7f199e7fc700 1 -- 172.21.15.31:0/463112027 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump"}]=0 v9) v1 ==== 56+0+161366 (secure 0 0 0) 0x7f19a400f300 con 0x7f19a8076860 2020-06-27T04:40:08.015 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.865994930267334, stop=False, exit=None, reads=[10] 2020-06-27T04:40:08.015 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.016 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 9, 2020-06-27T04:40:08.016 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14119, 2020-06-27T04:40:08.016 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2020-06-27T04:40:08.016 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2020-06-27T04:40:08.016 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2020-06-27T04:40:08.017 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.017 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2020-06-27T04:40:08.017 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.31:6800", 2020-06-27T04:40:08.017 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 4294292023 2020-06-27T04:40:08.017 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.018 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-06-27T04:40:08.018 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.018 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.15.31:6800/4294292023", 2020-06-27T04:40:08.018 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2020-06-27T04:39:57.049473+0000", 2020-06-27T04:40:08.018 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292837744639, 2020-06-27T04:40:08.018 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2020-06-27T04:40:08.019 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2020-06-27T04:40:08.019 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2020-06-27T04:40:08.019 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2020-06-27T04:40:08.019 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "dashboard", 2020-06-27T04:40:08.019 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2020-06-27T04:40:08.020 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2020-06-27T04:40:08.020 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.020 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2020-06-27T04:40:08.020 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.020 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2020-06-27T04:40:08.020 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.021 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.021 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.021 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-06-27T04:40:08.021 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-06-27T04:40:08.021 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:40:08.022 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.022 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.022 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2020-06-27T04:40:08.022 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.022 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.022 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8672769069671631, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.023 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.023 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2020-06-27T04:40:08.023 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.023 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.023 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.024 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.024 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.024 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.024 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.024 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.024 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.025 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.025 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.025 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.025 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.025 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.026 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.026 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.026 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.026 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.026 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.027 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.027 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.027 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.027 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.027 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.027 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.028 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.028 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.028 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.867915153503418, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.028 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.028 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.028 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.029 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.029 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.029 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.029 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.029 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.030 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.030 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.030 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.030 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.030 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.030 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.031 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.031 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.031 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.031 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.031 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.032 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.032 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.032 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.032 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.032 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.032 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.033 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.033 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.033 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.033 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.033 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.034 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8687541484832764, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.034 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.034 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.034 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.034 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.034 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.035 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.035 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.035 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.035 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.035 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.035 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.036 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.036 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.036 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.036 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.036 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.037 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.037 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2020-06-27T04:40:08.037 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2020-06-27T04:40:08.037 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.037 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.038 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.038 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.038 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.038 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.038 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.038 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2020-06-27T04:40:08.039 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.039 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8695113658905029, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.039 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.039 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.039 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.040 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2020-06-27T04:40:08.040 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2020-06-27T04:40:08.040 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.040 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.040 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.040 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2020-06-27T04:40:08.041 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.041 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.041 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.041 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2020-06-27T04:40:08.041 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.042 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.042 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.042 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.042 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2020-06-27T04:40:08.042 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2020-06-27T04:40:08.042 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.043 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.043 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.043 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.043 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.043 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.044 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.044 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2020-06-27T04:40:08.044 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.044 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.044 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8701767921447754, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.044 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.045 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.045 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2020-06-27T04:40:08.045 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2020-06-27T04:40:08.045 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.046 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.046 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.046 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.046 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.046 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.047 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.047 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2020-06-27T04:40:08.047 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.047 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.047 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.047 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.048 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2020-06-27T04:40:08.048 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2020-06-27T04:40:08.048 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.048 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.048 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.049 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2020-06-27T04:40:08.049 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.049 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.049 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.049 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2020-06-27T04:40:08.049 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.050 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.050 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8709285259246826, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.050 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.050 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.050 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2020-06-27T04:40:08.051 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2020-06-27T04:40:08.051 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.051 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.051 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.051 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.051 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.052 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.052 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.052 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2020-06-27T04:40:08.052 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.052 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.052 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.053 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.053 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2020-06-27T04:40:08.053 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2020-06-27T04:40:08.053 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.053 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.054 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.054 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.054 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.054 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.054 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.054 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2020-06-27T04:40:08.055 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.055 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.055 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.055 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.871596097946167, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.055 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.056 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2020-06-27T04:40:08.056 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2020-06-27T04:40:08.056 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.056 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.056 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.056 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.057 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.057 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.057 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.057 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2020-06-27T04:40:08.057 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.058 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.058 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.058 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.058 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.058 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.058 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.059 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2020-06-27T04:40:08.059 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.059 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.059 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.059 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2020-06-27T04:40:08.060 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2020-06-27T04:40:08.060 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.060 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.060 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.060 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.060 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.061 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.061 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.061 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8723034858703613, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.061 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2020-06-27T04:40:08.061 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.062 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.062 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.062 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.062 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2020-06-27T04:40:08.062 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2020-06-27T04:40:08.062 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.063 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.063 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.063 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2020-06-27T04:40:08.063 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.064 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.064 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.064 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2020-06-27T04:40:08.064 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2020-06-27T04:40:08.064 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.065 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.065 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.065 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2020-06-27T04:40:08.065 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2020-06-27T04:40:08.065 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2020-06-27T04:40:08.065 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.066 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.066 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2020-06-27T04:40:08.066 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2020-06-27T04:40:08.066 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8728961944580078, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.066 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2020-06-27T04:40:08.067 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.067 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2020-06-27T04:40:08.067 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2020-06-27T04:40:08.067 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.067 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.067 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.068 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2020-06-27T04:40:08.068 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2020-06-27T04:40:08.068 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2020-06-27T04:40:08.068 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.068 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.069 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2020-06-27T04:40:08.069 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2020-06-27T04:40:08.069 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2020-06-27T04:40:08.069 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.069 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2020-06-27T04:40:08.069 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.070 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.070 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.070 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.070 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2020-06-27T04:40:08.070 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2020-06-27T04:40:08.070 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.071 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.87345290184021, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.071 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.071 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.071 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2020-06-27T04:40:08.071 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.072 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.072 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.072 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2020-06-27T04:40:08.072 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2020-06-27T04:40:08.072 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.072 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.073 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.073 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2020-06-27T04:40:08.073 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2020-06-27T04:40:08.073 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2020-06-27T04:40:08.073 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.074 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.074 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2020-06-27T04:40:08.074 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2020-06-27T04:40:08.074 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2020-06-27T04:40:08.074 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.074 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2020-06-27T04:40:08.075 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.873938798904419, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.075 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2020-06-27T04:40:08.075 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.075 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.075 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.076 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2020-06-27T04:40:08.076 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2020-06-27T04:40:08.076 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.076 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.076 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.076 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2020-06-27T04:40:08.077 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.077 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.077 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.077 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2020-06-27T04:40:08.077 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2020-06-27T04:40:08.078 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.078 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.078 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.078 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2020-06-27T04:40:08.078 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2020-06-27T04:40:08.078 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2020-06-27T04:40:08.079 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.079 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.079 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2020-06-27T04:40:08.079 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2020-06-27T04:40:08.079 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2020-06-27T04:40:08.080 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.080 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8745496273040771, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.080 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2020-06-27T04:40:08.080 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2020-06-27T04:40:08.080 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.080 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.082 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.082 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.082 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.082 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.082 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.082 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.083 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.083 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.083 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.083 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.083 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8751864433288574, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.087 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.087 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.087 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.087 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.087 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.087 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.088 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.088 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.088 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.088 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.088 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.089 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.089 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.089 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.089 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.089 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.089 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.090 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.090 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.090 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.090 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.090 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8758342266082764, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.090 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.091 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.091 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.091 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.091 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.091 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.092 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.092 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.092 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.092 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.092 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.092 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.093 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.093 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.093 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.093 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.093 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.094 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.094 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2020-06-27T04:40:08.094 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2020-06-27T04:40:08.094 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2020-06-27T04:40:08.094 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.094 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.095 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2020-06-27T04:40:08.095 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.095 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.095 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.095 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2020-06-27T04:40:08.095 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8764691352844238, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.096 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.096 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.097 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.097 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.098 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2020-06-27T04:40:08.098 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2020-06-27T04:40:08.098 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.098 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.098 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.099 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "upmap", 2020-06-27T04:40:08.099 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.099 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.099 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.099 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2020-06-27T04:40:08.100 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2020-06-27T04:40:08.100 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2020-06-27T04:40:08.100 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.100 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2020-06-27T04:40:08.100 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.101 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.101 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.101 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.101 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2020-06-27T04:40:08.101 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2020-06-27T04:40:08.101 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.102 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.102 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.102 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.102 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.102 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.103 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.103 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8771624565124512, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.103 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2020-06-27T04:40:08.103 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.103 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.104 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.104 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.104 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2020-06-27T04:40:08.104 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-06-27T04:40:08.104 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:40:08.105 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.105 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.105 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2020-06-27T04:40:08.105 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.105 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.106 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.106 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2020-06-27T04:40:08.106 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.106 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.106 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.107 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.107 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2020-06-27T04:40:08.107 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2020-06-27T04:40:08.107 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.107 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.107 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.108 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2020-06-27T04:40:08.108 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2020-06-27T04:40:08.108 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8777451515197754, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.108 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.108 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.109 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2020-06-27T04:40:08.109 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2020-06-27T04:40:08.109 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.109 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.109 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2020-06-27T04:40:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2020-06-27T04:40:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2020-06-27T04:40:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.111 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2020-06-27T04:40:08.111 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.111 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.111 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.111 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2020-06-27T04:40:08.111 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.112 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.112 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.112 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.112 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.112 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.113 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.113 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2020-06-27T04:40:08.113 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.113 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.878338098526001, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.113 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.113 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.114 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2020-06-27T04:40:08.114 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2020-06-27T04:40:08.114 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.114 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.114 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2020-06-27T04:40:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2020-06-27T04:40:08.116 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.116 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.116 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.116 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_dashboard": { 2020-06-27T04:40:08.116 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_dashboard", 2020-06-27T04:40:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8788585662841797, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.118 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.118 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.118 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "manage configs like API endpoints in Dashboard.", 2020-06-27T04:40:08.118 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.118 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.118 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.119 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.119 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_alertmanager": { 2020-06-27T04:40:08.119 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_alertmanager", 2020-06-27T04:40:08.119 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.119 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.120 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.120 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prom/alertmanager:v0.20.0", 2020-06-27T04:40:08.120 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.120 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.120 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.121 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Prometheus container image", 2020-06-27T04:40:08.121 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.121 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.121 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.121 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.121 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2020-06-27T04:40:08.122 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2020-06-27T04:40:08.122 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.122 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.122 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8794288635253906, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.122 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.123 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "docker.io/ceph/ceph", 2020-06-27T04:40:08.123 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.123 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.123 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.123 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2020-06-27T04:40:08.123 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.124 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.124 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.124 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.124 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_grafana": { 2020-06-27T04:40:08.124 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_grafana", 2020-06-27T04:40:08.125 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.125 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.125 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.125 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph-grafana:6.6.2", 2020-06-27T04:40:08.125 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.125 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.126 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.126 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Prometheus container image", 2020-06-27T04:40:08.126 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.126 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.126 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.127 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.127 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_node_exporter": { 2020-06-27T04:40:08.127 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8800034523010254, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.127 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_node_exporter", 2020-06-27T04:40:08.127 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.127 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.128 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.129 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prom/node-exporter:v0.18.1", 2020-06-27T04:40:08.129 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.129 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.131 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.132 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Prometheus container image", 2020-06-27T04:40:08.132 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.132 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.132 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.132 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.132 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_prometheus": { 2020-06-27T04:40:08.133 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_prometheus", 2020-06-27T04:40:08.133 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.133 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.133 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.133 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prom/prometheus:v2.18.1", 2020-06-27T04:40:08.134 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.134 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.134 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.134 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Prometheus container image", 2020-06-27T04:40:08.134 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.135 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.135 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.135 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.135 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8806030750274658, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.135 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2020-06-27T04:40:08.135 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2020-06-27T04:40:08.136 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:40:08.136 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.136 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.136 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2020-06-27T04:40:08.136 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.137 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.137 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.137 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2020-06-27T04:40:08.137 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.137 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.137 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.138 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.138 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2020-06-27T04:40:08.138 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2020-06-27T04:40:08.138 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:40:08.138 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.139 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.139 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2020-06-27T04:40:08.139 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.139 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.139 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.139 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2020-06-27T04:40:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8811750411987305, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.141 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2020-06-27T04:40:08.141 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2020-06-27T04:40:08.141 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:40:08.141 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.141 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.141 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2020-06-27T04:40:08.142 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.142 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.142 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.142 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2020-06-27T04:40:08.142 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.143 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.143 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.143 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.143 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.143 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.144 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.144 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.144 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.144 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.144 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.144 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.145 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.145 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.145 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.145 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.145 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.881828784942627, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.146 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.146 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.146 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.146 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.146 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.146 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.147 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.147 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.147 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.147 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.147 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.148 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.148 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.148 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.148 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.148 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.148 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.149 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.149 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2020-06-27T04:40:08.149 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.149 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.149 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.150 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.150 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.150 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.150 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.150 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.151 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.151 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8824634552001953, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.151 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.151 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.151 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.152 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.152 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.152 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.152 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.152 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.152 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.153 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.153 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.153 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.153 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.153 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.154 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.154 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.154 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.154 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.154 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.154 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.155 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.156 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.156 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.156 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.156 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.156 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.156 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8831658363342285, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.157 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "migration_current": { 2020-06-27T04:40:08.157 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "migration_current", 2020-06-27T04:40:08.157 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.158 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.158 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.158 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:40:08.158 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.158 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.158 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.159 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "internal - do not modify", 2020-06-27T04:40:08.159 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.159 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.159 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.159 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.160 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2020-06-27T04:40:08.160 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2020-06-27T04:40:08.160 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.160 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.160 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.160 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2020-06-27T04:40:08.161 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.161 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.161 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.161 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2020-06-27T04:40:08.161 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2020-06-27T04:40:08.162 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.162 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2020-06-27T04:40:08.162 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.162 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8843545913696289, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.162 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.162 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prometheus_alerts_path": { 2020-06-27T04:40:08.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus_alerts_path", 2020-06-27T04:40:08.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.163 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2020-06-27T04:40:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "location of alerts to include in prometheus deployments", 2020-06-27T04:40:08.165 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.165 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.165 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.165 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.165 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2020-06-27T04:40:08.166 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2020-06-27T04:40:08.166 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.166 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.166 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.166 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:40:08.166 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.167 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.167 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.167 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.885441780090332, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.167 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2020-06-27T04:40:08.167 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.168 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.168 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.168 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.168 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2020-06-27T04:40:08.168 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2020-06-27T04:40:08.168 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.169 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.169 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.169 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.169 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.169 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.169 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.170 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2020-06-27T04:40:08.170 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.170 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.170 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.170 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.171 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2020-06-27T04:40:08.171 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2020-06-27T04:40:08.171 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.171 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.171 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.171 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.172 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8864943981170654, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.172 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.172 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.172 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.172 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2020-06-27T04:40:08.173 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.173 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.173 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.173 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.173 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2020-06-27T04:40:08.173 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2020-06-27T04:40:08.174 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.174 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.174 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.174 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.174 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.175 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.175 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.175 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2020-06-27T04:40:08.175 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.175 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.175 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.176 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.176 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.176 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.176 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.176 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2020-06-27T04:40:08.176 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.177 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8875889778137207, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.177 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.177 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.177 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.177 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.179 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.179 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.179 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.179 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.179 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.180 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.180 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.180 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.180 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.180 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.180 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.181 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.181 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.181 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.181 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.181 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.182 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.182 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.182 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.182 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.182 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.182 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8888351917266846, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.183 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.183 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.183 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.183 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.183 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.183 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.184 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.184 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.184 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.184 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.184 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.185 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.185 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.185 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.185 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.185 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.186 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.186 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.186 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.186 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.186 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.186 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.187 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.187 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.187 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.187 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.187 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.187 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.188 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.188 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.188 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8900909423828125, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.188 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.188 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.189 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.189 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.189 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.189 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.189 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.189 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.190 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.195 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.195 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.195 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.195 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2020-06-27T04:40:08.196 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2020-06-27T04:40:08.196 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:40:08.196 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.196 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.196 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2020-06-27T04:40:08.196 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.197 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.197 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.197 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2020-06-27T04:40:08.197 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.197 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.198 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.198 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.198 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2020-06-27T04:40:08.198 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8911347389221191, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.198 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2020-06-27T04:40:08.198 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:40:08.199 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.199 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.199 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2020-06-27T04:40:08.199 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.199 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.200 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.200 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2020-06-27T04:40:08.200 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.200 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.200 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.200 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.201 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.201 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.201 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.201 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2020-06-27T04:40:08.201 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.201 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.202 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.202 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2020-06-27T04:40:08.202 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2020-06-27T04:40:08.202 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.202 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.203 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.203 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.203 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.203 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.203 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.203 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.204 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8918170928955078, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.204 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.204 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.204 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.204 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.205 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2020-06-27T04:40:08.205 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2020-06-27T04:40:08.205 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.205 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.205 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.205 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.206 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.206 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.206 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.206 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.206 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.206 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.207 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.207 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.207 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2020-06-27T04:40:08.207 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2020-06-27T04:40:08.207 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.208 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.208 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.208 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.208 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.208 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.208 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.209 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.209 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8924593925476074, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.209 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.209 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.209 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.210 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.210 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2020-06-27T04:40:08.210 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2020-06-27T04:40:08.210 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.210 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.210 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.211 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.211 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.211 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.211 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.211 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.212 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.212 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.212 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.212 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.212 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2020-06-27T04:40:08.212 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2020-06-27T04:40:08.213 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.213 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.213 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.213 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.213 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8931193351745605, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.215 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.215 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.215 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2020-06-27T04:40:08.215 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2020-06-27T04:40:08.215 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.215 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.216 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.216 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.216 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.216 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.216 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.217 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.217 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.217 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.217 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.217 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.217 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2020-06-27T04:40:08.218 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2020-06-27T04:40:08.218 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.218 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.218 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.218 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.219 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.219 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.219 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.219 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.220 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.221 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8937513828277588, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.221 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.221 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.221 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.221 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2020-06-27T04:40:08.222 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2020-06-27T04:40:08.222 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.222 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.222 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.222 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.222 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.223 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.223 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.223 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.223 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.223 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.224 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.224 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.224 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2020-06-27T04:40:08.224 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2020-06-27T04:40:08.224 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.224 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.225 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.225 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.225 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.225 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.225 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.226 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.226 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.226 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.226 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8944189548492432, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.226 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.226 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.227 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2020-06-27T04:40:08.227 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2020-06-27T04:40:08.227 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.227 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.227 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.228 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.228 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.228 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.228 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.228 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.228 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.229 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.229 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.229 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.229 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2020-06-27T04:40:08.229 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2020-06-27T04:40:08.230 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.230 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.230 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.230 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.230 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.231 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.231 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.231 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.231 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.231 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8950350284576416, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.232 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.232 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.232 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.232 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2020-06-27T04:40:08.232 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2020-06-27T04:40:08.232 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.233 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.233 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.233 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2020-06-27T04:40:08.233 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.233 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.234 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.234 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.234 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.234 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.234 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.234 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.235 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2020-06-27T04:40:08.235 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2020-06-27T04:40:08.235 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.235 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.235 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.236 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.236 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.236 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.236 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.236 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.236 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.237 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.237 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8956806659698486, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.237 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.237 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.237 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2020-06-27T04:40:08.238 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2020-06-27T04:40:08.238 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.238 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.238 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.238 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.238 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.240 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.240 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2020-06-27T04:40:08.240 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2020-06-27T04:40:08.240 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.240 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.241 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.241 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2020-06-27T04:40:08.241 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.241 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.241 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.241 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.242 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.242 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.242 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8963191509246826, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.242 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.242 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.243 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2020-06-27T04:40:08.243 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2020-06-27T04:40:08.243 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.243 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.243 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.243 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.244 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.245 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.245 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.245 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.245 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.245 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.246 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.246 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.246 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2020-06-27T04:40:08.246 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2020-06-27T04:40:08.246 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.247 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.247 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.247 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.247 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.247 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.248 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.248 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.248 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.248 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.248 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8969504833221436, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2020-06-27T04:40:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2020-06-27T04:40:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.250 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.250 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.250 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.250 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.250 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.251 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.251 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.251 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.251 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.251 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.251 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2020-06-27T04:40:08.252 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2020-06-27T04:40:08.252 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.252 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.252 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.252 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.897580623626709, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2020-06-27T04:40:08.255 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2020-06-27T04:40:08.255 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.255 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.255 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.255 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.256 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.256 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.256 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.256 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.256 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2020-06-27T04:40:08.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2020-06-27T04:40:08.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8981735706329346, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2020-06-27T04:40:08.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2020-06-27T04:40:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2020-06-27T04:40:08.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2020-06-27T04:40:08.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.264 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.264 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.264 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.264 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.264 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8987784385681152, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.266 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.266 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.266 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.266 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.266 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.267 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2020-06-27T04:40:08.267 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2020-06-27T04:40:08.267 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.267 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.267 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.268 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.268 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.268 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.268 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.268 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.268 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.269 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.269 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.269 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.269 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2020-06-27T04:40:08.269 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2020-06-27T04:40:08.270 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.270 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.270 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.270 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.270 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.270 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.271 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8994076251983643, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.271 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.271 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.271 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.271 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2020-06-27T04:40:08.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2020-06-27T04:40:08.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.272 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.273 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.273 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.273 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.273 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.273 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.274 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.274 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.274 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.274 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.274 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.274 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2020-06-27T04:40:08.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2020-06-27T04:40:08.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.275 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2020-06-27T04:40:08.276 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9000053405761719, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.276 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.276 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.276 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.276 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.277 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.277 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.277 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.277 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.277 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2020-06-27T04:40:08.277 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2020-06-27T04:40:08.278 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.278 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.278 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.278 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2020-06-27T04:40:08.278 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.279 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.279 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.279 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.279 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.279 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.279 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.280 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.280 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2020-06-27T04:40:08.280 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2020-06-27T04:40:08.280 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.280 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.281 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.281 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2020-06-27T04:40:08.281 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9006366729736328, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.281 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.281 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.281 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.282 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.282 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.282 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.282 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.282 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.283 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2020-06-27T04:40:08.283 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2020-06-27T04:40:08.283 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.283 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.283 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.283 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2020-06-27T04:40:08.284 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.284 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.284 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.284 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.284 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.285 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.285 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.285 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.285 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2020-06-27T04:40:08.285 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2020-06-27T04:40:08.285 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.286 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.286 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.286 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.286 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.286 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9012908935546875, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.287 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.287 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.287 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.287 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.287 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.287 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.288 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.288 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2020-06-27T04:40:08.288 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2020-06-27T04:40:08.288 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.288 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.289 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.289 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2020-06-27T04:40:08.289 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.289 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.289 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.289 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.290 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.290 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.290 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.290 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.290 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2020-06-27T04:40:08.290 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2020-06-27T04:40:08.291 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.291 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.291 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.291 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.291 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.292 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.293 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9019465446472168, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.293 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.293 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.293 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.294 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.294 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.294 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.294 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2020-06-27T04:40:08.294 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2020-06-27T04:40:08.295 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.295 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.295 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.295 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2020-06-27T04:40:08.295 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.296 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.296 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.296 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.296 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.296 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2020-06-27T04:40:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2020-06-27T04:40:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.298 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.298 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2020-06-27T04:40:08.298 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.298 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.298 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.299 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9025986194610596, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.299 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.299 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.299 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.299 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.299 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.300 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2020-06-27T04:40:08.300 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2020-06-27T04:40:08.300 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.300 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.300 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.302 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.302 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.302 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.302 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2020-06-27T04:40:08.302 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2020-06-27T04:40:08.303 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.303 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.303 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.303 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.303 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.303 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.304 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.304 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.304 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9032580852508545, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.304 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.304 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.305 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.305 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.305 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2020-06-27T04:40:08.305 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2020-06-27T04:40:08.305 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.305 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.306 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.306 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.306 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.306 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.306 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.307 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.307 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.307 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.307 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.307 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.307 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2020-06-27T04:40:08.308 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2020-06-27T04:40:08.308 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.308 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.308 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.308 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2020-06-27T04:40:08.308 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.309 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.309 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.309 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.309 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9038898944854736, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.309 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.310 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.310 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.310 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.310 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2020-06-27T04:40:08.310 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2020-06-27T04:40:08.310 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.311 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.311 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.311 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2020-06-27T04:40:08.311 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.311 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.313 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2020-06-27T04:40:08.313 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2020-06-27T04:40:08.313 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.313 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.313 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.314 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2020-06-27T04:40:08.314 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.314 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.314 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.314 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.314 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9045288562774658, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2020-06-27T04:40:08.316 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2020-06-27T04:40:08.316 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.316 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.316 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.316 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.316 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.318 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.318 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.318 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2020-06-27T04:40:08.318 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2020-06-27T04:40:08.318 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.318 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.319 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.319 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.319 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.319 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.319 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.320 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2020-06-27T04:40:08.320 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.320 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9051902294158936, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.320 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.320 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.320 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.321 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2020-06-27T04:40:08.321 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2020-06-27T04:40:08.321 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.321 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.321 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.322 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2020-06-27T04:40:08.322 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.322 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.323 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.323 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.323 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.324 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.324 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.325 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.325 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2020-06-27T04:40:08.325 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2020-06-27T04:40:08.326 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.326 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.326 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.326 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.326 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.327 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.327 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.327 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.327 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.327 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.328 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.328 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9058637619018555, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.328 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.328 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.329 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.330 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.331 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.332 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.332 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.332 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.332 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.332 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.332 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.333 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.333 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.333 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.333 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.333 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.334 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.334 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9065413475036621, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.334 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.334 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.334 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.334 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.335 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.335 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.335 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.335 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.335 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.336 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.336 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.336 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.336 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.336 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.336 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.337 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.337 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.337 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.337 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.337 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.338 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.338 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.338 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.338 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.338 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.338 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.339 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.339 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.339 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.339 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.339 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9072265625, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.339 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.340 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.340 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.340 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.340 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.340 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.341 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.341 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.341 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.341 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.341 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.341 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2020-06-27T04:40:08.342 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2020-06-27T04:40:08.342 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.342 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.342 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.342 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.343 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.343 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.343 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.343 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.343 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.343 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.344 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.344 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.344 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2020-06-27T04:40:08.344 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2020-06-27T04:40:08.344 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.345 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.345 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.345 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9078962802886963, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.345 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2020-06-27T04:40:08.345 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.345 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.346 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.346 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.346 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.346 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.346 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.347 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.347 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2020-06-27T04:40:08.347 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2020-06-27T04:40:08.348 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.348 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.348 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.348 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2020-06-27T04:40:08.349 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.349 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.349 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.349 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.349 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.350 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.350 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.350 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.350 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2020-06-27T04:40:08.350 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2020-06-27T04:40:08.350 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.351 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.351 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.351 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.351 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.351 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9085772037506104, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.352 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.352 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.352 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.352 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.352 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.352 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2020-06-27T04:40:08.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2020-06-27T04:40:08.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.353 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.354 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.354 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2020-06-27T04:40:08.354 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.354 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.354 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.354 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.355 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.355 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.355 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.355 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.355 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2020-06-27T04:40:08.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2020-06-27T04:40:08.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2020-06-27T04:40:08.356 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.357 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.357 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9092381000518799, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2020-06-27T04:40:08.358 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.359 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2020-06-27T04:40:08.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2020-06-27T04:40:08.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.360 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2020-06-27T04:40:08.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2020-06-27T04:40:08.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2020-06-27T04:40:08.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.361 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2020-06-27T04:40:08.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2020-06-27T04:40:08.362 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9098601341247559, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.363 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.364 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.365 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.365 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.365 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2020-06-27T04:40:08.365 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2020-06-27T04:40:08.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.366 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.367 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.367 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.367 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.367 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.367 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.368 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2020-06-27T04:40:08.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2020-06-27T04:40:08.369 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2020-06-27T04:40:08.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9105956554412842, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.370 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2020-06-27T04:40:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.372 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.372 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.372 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.372 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.373 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.374 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.374 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.374 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.374 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.374 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.375 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.375 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.375 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.375 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.375 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.376 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.376 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.376 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.376 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.376 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9112520217895508, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.377 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.377 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.377 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.377 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.377 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.378 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.378 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.378 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.378 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.378 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.378 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.379 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.379 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.379 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.379 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.379 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.380 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.380 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.380 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.380 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.380 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.380 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.381 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.381 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.381 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.381 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.381 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.382 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.382 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.382 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9119012355804443, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.382 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.382 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.382 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.383 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.383 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.383 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.383 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.383 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.384 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.384 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.384 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.384 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.384 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.385 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.385 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.385 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.385 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.385 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.386 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.386 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.386 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.386 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.386 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.386 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2020-06-27T04:40:08.387 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2020-06-27T04:40:08.387 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:40:08.387 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.387 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.387 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2020-06-27T04:40:08.388 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9126508235931396, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.388 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.388 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.388 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.388 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2020-06-27T04:40:08.388 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.389 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.389 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.389 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.389 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2020-06-27T04:40:08.389 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2020-06-27T04:40:08.390 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.391 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.391 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.391 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2020-06-27T04:40:08.392 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.392 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.392 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.392 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2020-06-27T04:40:08.392 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.393 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.393 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.393 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.393 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2020-06-27T04:40:08.393 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2020-06-27T04:40:08.394 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:40:08.394 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.394 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9132473468780518, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.394 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.394 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2020-06-27T04:40:08.395 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.395 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.395 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.395 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2020-06-27T04:40:08.395 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.396 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.396 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.396 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.396 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2020-06-27T04:40:08.396 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2020-06-27T04:40:08.396 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:40:08.397 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.397 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.397 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2020-06-27T04:40:08.397 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.397 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2020-06-27T04:40:08.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.399 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2020-06-27T04:40:08.399 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2020-06-27T04:40:08.399 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.399 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9138591289520264, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.399 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2020-06-27T04:40:08.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2020-06-27T04:40:08.402 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-06-27T04:40:08.402 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:40:08.402 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.402 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.402 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2020-06-27T04:40:08.402 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2020-06-27T04:40:08.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.404 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.404 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.404 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2020-06-27T04:40:08.404 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9144601821899414, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.404 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2020-06-27T04:40:08.404 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:40:08.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2020-06-27T04:40:08.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.406 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2020-06-27T04:40:08.406 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.406 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.406 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.406 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.407 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.407 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.407 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.407 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2020-06-27T04:40:08.407 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.407 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.408 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.408 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.408 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.408 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.408 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.409 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.409 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.409 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.409 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.409 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.409 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.410 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9151396751403809, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.410 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.410 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.410 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.410 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.411 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.411 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.411 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.411 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.411 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.411 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.412 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.412 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.412 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.412 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.412 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.413 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.413 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.413 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.413 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.413 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.413 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.414 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.414 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.414 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.414 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.414 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.415 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.415 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.415 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.415 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.415 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9158055782318115, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.415 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.416 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.416 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.416 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.416 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.416 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.417 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.417 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.417 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.417 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.417 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.417 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.418 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.418 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.418 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.418 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.418 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.419 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.419 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.419 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.419 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.419 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.419 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.420 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.420 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.420 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.420 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.420 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.421 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.421 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.421 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9164860248565674, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.421 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2020-06-27T04:40:08.421 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2020-06-27T04:40:08.421 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.422 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.422 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.422 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2020-06-27T04:40:08.422 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.422 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.423 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.423 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.423 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.423 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.423 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.423 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.424 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2020-06-27T04:40:08.424 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2020-06-27T04:40:08.424 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.424 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.424 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.424 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2020-06-27T04:40:08.425 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.425 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.425 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.425 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.425 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.426 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.426 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.426 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.426 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2020-06-27T04:40:08.426 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9171466827392578, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.426 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-06-27T04:40:08.427 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.427 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.427 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.427 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2020-06-27T04:40:08.427 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.427 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.428 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.428 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.428 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.428 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.428 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.429 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.429 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.429 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.429 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.429 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2020-06-27T04:40:08.429 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2020-06-27T04:40:08.430 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2020-06-27T04:40:08.430 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.430 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2020-06-27T04:40:08.430 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2020-06-27T04:40:08.430 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.431 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.431 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.431 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2020-06-27T04:40:08.431 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.431 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.431 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.432 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.432 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9178071022033691, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.432 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.432 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.432 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.433 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.433 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2020-06-27T04:40:08.433 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2020-06-27T04:40:08.433 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.433 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.433 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.434 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2020-06-27T04:40:08.434 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.434 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.434 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.434 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.435 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.435 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.435 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.435 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.435 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2020-06-27T04:40:08.435 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2020-06-27T04:40:08.436 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.436 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.436 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.436 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:40:08.437 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.437 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.437 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.437 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.437 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.438 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.438 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.918532133102417, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.438 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.438 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.438 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-06-27T04:40:08.438 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-06-27T04:40:08.439 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.439 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.439 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.439 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2020-06-27T04:40:08.439 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.440 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.440 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.440 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.440 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.440 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.440 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.441 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.441 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.441 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.441 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.441 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.442 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.442 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.442 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.442 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.442 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.442 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.443 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.443 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.443 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.443 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.443 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.443 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9192867279052734, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.444 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.444 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.444 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.444 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.444 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.445 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.445 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.445 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.445 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.445 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.446 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.446 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.446 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.446 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.446 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.446 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.447 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.447 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.447 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.447 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.447 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.448 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.448 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.448 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.448 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.448 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.448 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.449 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.449 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.449 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9199545383453369, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.449 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.449 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.449 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.450 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.450 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.450 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.450 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.450 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.451 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.451 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.451 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.451 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.451 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.451 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.452 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.452 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.452 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.452 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.452 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.452 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.453 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.453 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.453 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.453 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.453 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.454 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.454 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2020-06-27T04:40:08.454 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2020-06-27T04:40:08.454 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.454 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.455 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9206278324127197, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.455 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.455 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:40:08.455 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.455 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.455 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.456 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.456 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.456 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.456 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.456 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.456 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2020-06-27T04:40:08.457 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2020-06-27T04:40:08.457 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.457 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.457 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.457 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2020-06-27T04:40:08.458 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.458 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.458 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.458 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.458 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.458 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.459 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.459 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.459 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2020-06-27T04:40:08.459 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2020-06-27T04:40:08.459 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.460 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.460 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.460 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2020-06-27T04:40:08.460 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9213049411773682, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.460 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.460 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.461 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.461 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.461 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.461 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.461 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.462 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.462 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2020-06-27T04:40:08.462 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2020-06-27T04:40:08.462 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.462 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.462 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.463 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2020-06-27T04:40:08.463 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.463 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.463 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.463 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.464 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.464 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.464 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.464 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.464 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2020-06-27T04:40:08.464 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2020-06-27T04:40:08.465 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.465 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.465 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.465 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:40:08.465 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.466 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.466 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9219861030578613, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.466 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.466 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.466 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.466 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.467 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.467 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.467 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2020-06-27T04:40:08.467 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2020-06-27T04:40:08.467 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.467 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.468 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.468 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2020-06-27T04:40:08.468 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.468 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.468 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.469 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.469 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.469 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.469 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.469 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.470 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.470 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.470 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.470 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2020-06-27T04:40:08.470 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.471 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.471 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.471 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.471 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.471 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.472 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.472 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.472 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.472 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.637+0000 7f19ad871700 1 -- 172.21.15.31:0/463112027 >> v2:172.21.15.31:6800/4294292023 conn(0x7f198402ab20 msgr2=0x7f198402cfe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/4294292023 2020-06-27T04:40:08.472 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.637+0000 7f19ad871700 1 --2- 172.21.15.31:0/463112027 >> v2:172.21.15.31:6800/4294292023 conn(0x7f198402ab20 0x7f198402cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2020-06-27T04:40:08.472 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9227750301361084, stop=False, exit=None, reads=[8, 10] 2020-06-27T04:40:08.473 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.473 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.473 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.473 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.473 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.474 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.474 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.474 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.474 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.474 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.475 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.475 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.475 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.475 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.475 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.475 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.476 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.476 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.476 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.476 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.476 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.477 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.477 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.477 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.477 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.477 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.477 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.478 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.478 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.478 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.478 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9234545230865479, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.478 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.479 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.479 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.479 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.479 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.479 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.479 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.480 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.480 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.480 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.480 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.480 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.481 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.481 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.481 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.481 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.481 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.481 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.482 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.482 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.482 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.482 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.482 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.483 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.483 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.483 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.483 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.483 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.483 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.484 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9241242408752441, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.484 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.484 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.484 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.484 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.484 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.485 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.485 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.485 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.485 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2020-06-27T04:40:08.485 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.486 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.486 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.486 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.486 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.486 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.486 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.487 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.487 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.487 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.487 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.487 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.488 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.488 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.488 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.488 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.488 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.488 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.489 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.489 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.489 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.489 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.489 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.489 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.490 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.490 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9248781204223633, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.490 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.490 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.490 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.491 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.491 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.491 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.491 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.491 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.491 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.492 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.492 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.492 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.492 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.492 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.493 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.493 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.493 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.493 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.493 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.493 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.494 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.494 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.494 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.494 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.494 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9255378246307373, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.498 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.498 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.498 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.498 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.498 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.498 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.499 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.499 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.499 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.499 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.499 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2020-06-27T04:40:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2020-06-27T04:40:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2020-06-27T04:40:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.501 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.501 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.501 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9262416362762451, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.501 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2020-06-27T04:40:08.501 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.502 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.502 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.502 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2020-06-27T04:40:08.502 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.502 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.502 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.503 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.503 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2020-06-27T04:40:08.503 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2020-06-27T04:40:08.503 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.503 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.504 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.504 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2020-06-27T04:40:08.504 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2020-06-27T04:40:08.504 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.504 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.504 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2020-06-27T04:40:08.505 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.505 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.505 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.505 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.505 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.505 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.506 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.506 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9268326759338379, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.506 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.506 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.506 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.507 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.507 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.507 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.507 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.507 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.507 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.508 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.508 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.508 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.508 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.508 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.508 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.509 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.509 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.509 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.509 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.509 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.510 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.510 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.510 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.510 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.510 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.510 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.511 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.511 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.511 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.511 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.511 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9275097846984863, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.512 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.512 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.512 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.512 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.512 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.512 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.513 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.513 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.513 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.513 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.513 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.513 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.514 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.514 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.514 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.514 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.514 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.515 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.515 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.515 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.515 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.516 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.516 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.516 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.516 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.516 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.517 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.517 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.517 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.517 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.517 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9281902313232422, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.517 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.518 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.518 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.518 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.518 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.518 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.519 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.519 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.519 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.519 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.519 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2020-06-27T04:40:08.519 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.520 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.520 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.520 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2020-06-27T04:40:08.520 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2020-06-27T04:40:08.520 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.521 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.521 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.521 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2020-06-27T04:40:08.521 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.521 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.521 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.522 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2020-06-27T04:40:08.522 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.522 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.522 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.522 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.522 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9288890361785889, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.524 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.524 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.524 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.524 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.524 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.524 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.525 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.525 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.525 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.525 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.525 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.528 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.528 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.528 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.528 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.528 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.529 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9295713901519775, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.529 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.529 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.529 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.529 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.529 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.530 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.530 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.530 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.530 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.530 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.531 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.531 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.531 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.531 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.531 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.531 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.532 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.532 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.532 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.532 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.532 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.532 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.533 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.533 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.533 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.533 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.533 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.534 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.534 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.534 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9302346706390381, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.534 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.534 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.534 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.535 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.535 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.535 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.535 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.535 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.536 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2020-06-27T04:40:08.536 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2020-06-27T04:40:08.536 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.536 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.536 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.536 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.537 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.537 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.537 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.537 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2020-06-27T04:40:08.538 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.538 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.538 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.538 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.538 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2020-06-27T04:40:08.539 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2020-06-27T04:40:08.539 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.539 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.539 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.539 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2020-06-27T04:40:08.539 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.540 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9308938980102539, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.540 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.540 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.540 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2020-06-27T04:40:08.540 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.541 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.541 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.541 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.541 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2020-06-27T04:40:08.541 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2020-06-27T04:40:08.541 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2020-06-27T04:40:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2020-06-27T04:40:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.544 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2020-06-27T04:40:08.544 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2020-06-27T04:40:08.544 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.544 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.544 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.545 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.545 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.545 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.931530237197876, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.545 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.545 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.545 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2020-06-27T04:40:08.546 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.546 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.546 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.546 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.546 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2020-06-27T04:40:08.547 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2020-06-27T04:40:08.547 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.547 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.547 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.547 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2020-06-27T04:40:08.547 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.548 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.548 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.548 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2020-06-27T04:40:08.548 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.548 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.548 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.549 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.549 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.549 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.549 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.549 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2020-06-27T04:40:08.550 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.550 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.550 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.550 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.550 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.550 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9322147369384766, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.551 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.551 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.551 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.551 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.551 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.552 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.552 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.552 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.552 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.552 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.552 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.553 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.553 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.553 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.553 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.553 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.553 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.554 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.554 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.554 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.554 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.554 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.555 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.555 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.555 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.555 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.555 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.555 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.556 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.556 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.556 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9328944683074951, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.556 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.556 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.556 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.557 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.557 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.557 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.557 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.557 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.558 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.558 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.558 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.558 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.558 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.559 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.559 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.559 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.559 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.559 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.560 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.560 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.560 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.560 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.560 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.560 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.561 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.561 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.561 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.561 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.561 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.562 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.638+0000 7f19afad5700 1 -- 172.21.15.31:0/463112027 >> v2:172.21.15.31:6800/4294292023 conn(0x7f198402ab20 msgr2=0x7f198402cfe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-06-27T04:40:08.562 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.638+0000 7f19afad5700 1 --2- 172.21.15.31:0/463112027 >> v2:172.21.15.31:6800/4294292023 conn(0x7f198402ab20 0x7f198402cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-06-27T04:40:08.562 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.638+0000 7f19afad5700 1 -- 172.21.15.31:0/463112027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a8076860 msgr2=0x7f19a8078c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:08.562 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.638+0000 7f19afad5700 1 --2- 172.21.15.31:0/463112027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a8076860 0x7f19a8078c90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f19a4002f70 tx=0x7f19a4006ec0).stop 2020-06-27T04:40:08.562 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.638+0000 7f19afad5700 1 -- 172.21.15.31:0/463112027 shutdown_connections 2020-06-27T04:40:08.562 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9336791038513184, stop=False, exit=None, reads=[8, 10] 2020-06-27T04:40:08.563 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.563 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.563 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.563 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.563 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.564 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.564 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.564 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.564 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.564 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2020-06-27T04:40:08.564 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2020-06-27T04:40:08.565 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.565 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.565 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.565 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:40:08.565 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.566 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.566 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.566 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2020-06-27T04:40:08.566 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2020-06-27T04:40:08.566 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2020-06-27T04:40:08.566 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.567 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2020-06-27T04:40:08.567 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.567 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.567 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.567 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.567 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.568 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.568 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.568 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2020-06-27T04:40:08.568 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.568 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.638+0000 7f19afad5700 1 --2- 172.21.15.31:0/463112027 >> v2:172.21.15.31:6800/4294292023 conn(0x7f198402ab20 0x7f198402cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-06-27T04:40:08.569 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.638+0000 7f19afad5700 1 --2- 172.21.15.31:0/463112027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a8076860 0x7f19a8078c90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:08.569 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.638+0000 7f19afad5700 1 -- 172.21.15.31:0/463112027 >> 172.21.15.31:0/463112027 conn(0x7f19a805ffe0 msgr2=0x7f19a8062500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:08.569 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.638+0000 7f19afad5700 1 -- 172.21.15.31:0/463112027 shutdown_connections 2020-06-27T04:40:08.569 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:07.638+0000 7f19afad5700 1 -- 172.21.15.31:0/463112027 wait complete. 2020-06-27T04:40:08.569 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9345791339874268, stop=False, exit=None, reads=[8, 10] 2020-06-27T04:40:08.570 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.570 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.570 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.570 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.570 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.570 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.571 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.571 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.571 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.571 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.572 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.573 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.573 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.573 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.573 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.573 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.574 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.574 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.574 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.574 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.574 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.574 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.575 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.575 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.575 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.575 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9352827072143555, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.575 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.576 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.576 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.576 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.576 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.576 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.576 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.577 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.577 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.577 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.577 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.577 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.578 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.578 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.578 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.578 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.578 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.578 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.579 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.579 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.579 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.579 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.579 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.580 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.580 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.580 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.580 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.580 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.580 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.581 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.581 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9359643459320068, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.581 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.581 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.581 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.582 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.582 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.582 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.582 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.582 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.582 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.583 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.583 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.583 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.583 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.583 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.583 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.584 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2020-06-27T04:40:08.584 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.584 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.584 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.584 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.585 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.585 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.585 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.585 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.585 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.585 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.586 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.586 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.586 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.586 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.586 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.587 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.587 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9366774559020996, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.587 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.587 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.587 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.587 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.588 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.588 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.588 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.588 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.588 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.588 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.589 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.589 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.589 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.589 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.589 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.590 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.590 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.590 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.590 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.590 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.590 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.591 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.591 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.591 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.591 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.591 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.591 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.592 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.592 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.592 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9373350143432617, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.592 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.592 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.593 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.593 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.593 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.593 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.593 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.593 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.594 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.594 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.594 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.594 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.594 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.594 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.595 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.595 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.595 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.595 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.595 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.596 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.596 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.596 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.596 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.596 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.596 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.597 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.597 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.597 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.597 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2020-06-27T04:40:08.597 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-06-27T04:40:08.598 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9384310245513916, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.602 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.603 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.603 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.603 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2020-06-27T04:40:08.603 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.603 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.603 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.604 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.604 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.604 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.604 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.604 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.605 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.605 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.605 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.605 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2020-06-27T04:40:08.605 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.605 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.606 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.606 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.606 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.606 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.606 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.607 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.607 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.607 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.607 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.607 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.607 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.608 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.608 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.608 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.608 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.608 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9398617744445801, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.609 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.609 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.609 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.609 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.609 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.609 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.610 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.610 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.610 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.610 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.610 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.610 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.613 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.613 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.613 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.613 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.613 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.614 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.614 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9411368370056152, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.614 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.614 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.614 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.614 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.617 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.617 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.617 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.617 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.617 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.617 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.618 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.618 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.618 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.618 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.618 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.619 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.619 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2020-06-27T04:40:08.619 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2020-06-27T04:40:08.619 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.619 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9424440860748291, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.619 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.620 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.620 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2020-06-27T04:40:08.620 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.620 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.620 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.620 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2020-06-27T04:40:08.621 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.621 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.621 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.621 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.621 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2020-06-27T04:40:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2020-06-27T04:40:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:40:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2020-06-27T04:40:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2020-06-27T04:40:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.624 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.624 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.624 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.624 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.624 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.624 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2020-06-27T04:40:08.625 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9437196254730225, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.625 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.625 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.625 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.625 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.627 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.627 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.627 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.627 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.627 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.628 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.628 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.628 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.628 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.628 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.628 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.629 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.629 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.629 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.629 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.629 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.630 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.630 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.630 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.630 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.630 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9450507164001465, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.630 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.631 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.631 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.631 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.631 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.631 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.631 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.632 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.632 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.632 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.632 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.632 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.633 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.633 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.633 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.633 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.633 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.633 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.634 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.634 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.634 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.634 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.634 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.635 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.635 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.635 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.635 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.635 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.635 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.636 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.636 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9463865756988525, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.636 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.636 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.636 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.636 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.637 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.637 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.637 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.637 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.637 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.638 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.638 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.638 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.638 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.638 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2020-06-27T04:40:08.638 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2020-06-27T04:40:08.639 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.639 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.639 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.639 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.639 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.640 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.640 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.640 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.640 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.640 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.640 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.641 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.641 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2020-06-27T04:40:08.641 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9476215839385986, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.641 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2020-06-27T04:40:08.641 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.641 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "300", 2020-06-27T04:40:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.643 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.643 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.643 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.643 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.643 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.643 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2020-06-27T04:40:08.644 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2020-06-27T04:40:08.644 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.644 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.644 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.644 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.645 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.645 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.645 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.645 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.645 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.645 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.646 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.646 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.646 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2020-06-27T04:40:08.646 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2020-06-27T04:40:08.646 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.646 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9489531517028809, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.647 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.647 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.647 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.647 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.647 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.648 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.648 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.648 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.648 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.648 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.648 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.649 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2020-06-27T04:40:08.649 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2020-06-27T04:40:08.649 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.649 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.649 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.650 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.650 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.650 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.650 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.650 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.650 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.651 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.651 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.651 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.651 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "stale_cache_strategy": { 2020-06-27T04:40:08.651 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "stale_cache_strategy", 2020-06-27T04:40:08.651 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.652 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.652 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9502334594726562, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.652 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.652 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.652 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.653 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.653 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.653 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.653 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.653 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.653 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.654 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.654 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.654 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.654 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.654 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2020-06-27T04:40:08.655 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.655 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.655 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.655 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.655 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.655 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.656 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.656 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.656 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.656 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.656 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.656 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.657 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.657 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.657 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.657 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.657 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.658 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.658 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9516496658325195, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.658 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.658 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.658 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.658 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.659 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.659 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.659 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.659 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.659 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.659 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.660 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.660 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.660 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.660 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.660 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.661 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.661 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.661 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.661 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.661 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.661 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.662 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.662 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.662 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.662 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.662 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.663 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.663 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.663 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.663 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9529414176940918, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.663 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.663 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.664 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.664 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.664 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.664 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.664 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.664 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.665 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.665 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.665 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.665 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.665 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.666 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.666 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.666 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.666 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.666 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.666 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.667 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.667 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.667 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.667 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.667 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2020-06-27T04:40:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2020-06-27T04:40:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.669 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.954272985458374, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.669 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.669 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.669 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.669 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.670 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.670 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.670 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.670 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.670 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.670 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.671 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2020-06-27T04:40:08.671 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2020-06-27T04:40:08.671 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.671 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.671 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.671 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.672 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.672 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.672 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.672 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.672 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.673 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.673 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.673 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.673 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.673 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.673 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.674 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2020-06-27T04:40:08.674 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.674 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.674 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.674 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_auth": { 2020-06-27T04:40:08.675 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9556472301483154, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.675 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_auth", 2020-06-27T04:40:08.675 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.675 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.675 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.675 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.676 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.676 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.676 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.676 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.676 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.676 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.677 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.677 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.677 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2020-06-27T04:40:08.677 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2020-06-27T04:40:08.677 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.678 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.678 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.678 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.678 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.678 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.678 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.679 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.679 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.679 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.679 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.679 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.680 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.680 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.680 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9569132328033447, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.680 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.680 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.680 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.681 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.681 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.681 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.681 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.681 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.681 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.682 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.682 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.682 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.682 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.682 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.683 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.683 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.683 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.683 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.683 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.683 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.684 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.684 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.684 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.684 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.684 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.684 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.685 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.685 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.685 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.685 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.685 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9582793712615967, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.686 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.686 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.686 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.686 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.686 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.687 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.687 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.687 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.687 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.687 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.687 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.688 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.688 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.688 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.688 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.688 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.688 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.689 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.689 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.689 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.689 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.689 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.690 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.690 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.690 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.690 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.690 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.690 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.691 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.691 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.691 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9596652984619141, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.691 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.691 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.692 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.692 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.692 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.692 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.692 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.692 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.693 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2020-06-27T04:40:08.693 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2020-06-27T04:40:08.693 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.693 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.693 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.693 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.694 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.694 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.694 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.694 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.694 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.695 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.695 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.695 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.695 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2020-06-27T04:40:08.695 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2020-06-27T04:40:08.695 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.696 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.696 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.696 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.696 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.696 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.696 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9610648155212402, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.697 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.697 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.697 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.697 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.697 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.698 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.698 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.698 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.698 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.698 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2020-06-27T04:40:08.698 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.699 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.699 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.699 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.699 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.699 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.700 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.700 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.700 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.700 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.700 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.700 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.701 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.701 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.701 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.701 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.701 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.701 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.702 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.702 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.702 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.702 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.702 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.703 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9624509811401367, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.703 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.703 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.703 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.703 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.703 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.704 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.704 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.704 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.704 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.704 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.704 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.705 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.705 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.705 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.705 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.705 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.706 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.706 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.706 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.706 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.706 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.706 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.707 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.707 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.707 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.707 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.707 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.708 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.708 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.708 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9632387161254883, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.708 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.708 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.708 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.711 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.711 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.711 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.711 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.711 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.711 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.712 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.712 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.712 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.712 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.712 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2020-06-27T04:40:08.713 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.713 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.713 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.713 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.713 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.713 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.714 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.714 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9642236232757568, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.714 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.714 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.714 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.714 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.715 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.715 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.715 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.715 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.715 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.716 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.716 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.716 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.716 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.716 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.716 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.717 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.717 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.717 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.717 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.717 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.718 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.718 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.718 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.718 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.718 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.718 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.719 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.719 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.719 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.719 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.719 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.719 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9649198055267334, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.720 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.720 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.720 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.720 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.720 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.721 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.721 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.721 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.721 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.721 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.721 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.722 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.722 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.722 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.722 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.722 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.722 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.723 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.723 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.723 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.723 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.723 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.724 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.724 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.724 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.724 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.724 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.724 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.725 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.725 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9655838012695312, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.725 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.725 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.725 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.725 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.726 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.726 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.726 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2020-06-27T04:40:08.726 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2020-06-27T04:40:08.726 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.727 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.727 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.727 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.727 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.727 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.727 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.728 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.728 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.728 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.728 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.728 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.729 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2020-06-27T04:40:08.729 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2020-06-27T04:40:08.729 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.729 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.729 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.729 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2020-06-27T04:40:08.730 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.730 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.730 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.730 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.730 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9662621021270752, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.731 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.731 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.731 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.731 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.731 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2020-06-27T04:40:08.731 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2020-06-27T04:40:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.734 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.734 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2020-06-27T04:40:08.734 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2020-06-27T04:40:08.734 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.734 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.734 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.735 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.735 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.735 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.735 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.735 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.736 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.736 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.736 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9669842720031738, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.736 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.736 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.736 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2020-06-27T04:40:08.737 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2020-06-27T04:40:08.737 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2020-06-27T04:40:08.737 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.737 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.737 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.738 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.738 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.738 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.738 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.738 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.738 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.739 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.739 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.739 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2020-06-27T04:40:08.739 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2020-06-27T04:40:08.739 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.739 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.740 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.740 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.740 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.740 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.740 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.741 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.741 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.741 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.741 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.741 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.741 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9676570892333984, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.742 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2020-06-27T04:40:08.742 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2020-06-27T04:40:08.742 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.742 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.742 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.742 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.743 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.743 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.743 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.743 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.743 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.744 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.744 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.744 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.744 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2020-06-27T04:40:08.744 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2020-06-27T04:40:08.744 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.745 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.745 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.745 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.745 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.745 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.746 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.746 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.746 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.746 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.746 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.746 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.747 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2020-06-27T04:40:08.747 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2020-06-27T04:40:08.747 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9683458805084229, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.747 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.747 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.747 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.748 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.748 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.748 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.748 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.748 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2020-06-27T04:40:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2020-06-27T04:40:08.750 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.750 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.750 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.750 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.750 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.751 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.751 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.751 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.751 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.751 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.751 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.752 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.752 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2020-06-27T04:40:08.752 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2020-06-27T04:40:08.752 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.752 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.753 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9690263271331787, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.753 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.753 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.753 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.753 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.753 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.754 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.754 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.754 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.754 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.754 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.755 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.755 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.755 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.755 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2020-06-27T04:40:08.755 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.755 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.756 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.756 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.756 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.756 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.756 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.757 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.757 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.757 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.757 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.757 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.757 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.758 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.758 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.758 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.758 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.758 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.759 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.759 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.969759464263916, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.759 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.759 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.759 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.759 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.760 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.760 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.760 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.760 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.760 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.760 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.761 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.761 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.761 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.761 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.761 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.762 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.762 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.762 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.762 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.762 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.762 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.763 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.763 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.763 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.763 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.763 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.764 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.764 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.764 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.764 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9704241752624512, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.764 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.765 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.765 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.765 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.765 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.765 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.766 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.766 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.766 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.766 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.766 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.766 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.767 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.767 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.767 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.767 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.767 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.768 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.768 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.768 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.768 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.768 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.768 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.769 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.769 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.769 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.769 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.769 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.770 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2020-06-27T04:40:08.770 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.770 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.770 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.770 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2020-06-27T04:40:08.770 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9711661338806152, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.771 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2020-06-27T04:40:08.771 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.771 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.771 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.771 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2020-06-27T04:40:08.772 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.772 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.772 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.772 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.772 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.772 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-06-27T04:40:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-06-27T04:40:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:40:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.774 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.774 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2020-06-27T04:40:08.774 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.774 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.774 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.775 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.775 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.775 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.775 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.775 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.775 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.776 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.776 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9718215465545654, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.776 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.776 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.776 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.777 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.777 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.777 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.777 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.777 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.777 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.778 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.778 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.778 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.778 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.778 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.778 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.779 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.779 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.779 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.779 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.779 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.780 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.780 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.780 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.780 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.780 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.780 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.781 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.781 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.781 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.781 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.781 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9724991321563721, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.782 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.782 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.782 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.782 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.782 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.782 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.783 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.783 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.783 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.783 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.783 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.783 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.784 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.784 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.784 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.784 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.784 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.785 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.785 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.785 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.785 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.785 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.785 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.786 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.786 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.786 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.786 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.786 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.786 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.787 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9731621742248535, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.787 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.787 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.787 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.787 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.788 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.788 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.788 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.788 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.788 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.788 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.789 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.789 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.789 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2020-06-27T04:40:08.789 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.789 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2020-06-27T04:40:08.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2020-06-27T04:40:08.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.791 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.791 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.791 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.791 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.791 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2020-06-27T04:40:08.791 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.792 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.792 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.792 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.792 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2020-06-27T04:40:08.792 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9738526344299316, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2020-06-27T04:40:08.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.793 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.794 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.795 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.795 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.795 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2020-06-27T04:40:08.795 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2020-06-27T04:40:08.795 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.795 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.796 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.796 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-06-27T04:40:08.796 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.796 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.796 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.797 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.797 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.797 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.797 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.797 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.797 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2020-06-27T04:40:08.798 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2020-06-27T04:40:08.798 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9745092391967773, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.798 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.798 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.798 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.798 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.799 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.799 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.799 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.799 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.799 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.800 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.800 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.800 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.800 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2020-06-27T04:40:08.800 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2020-06-27T04:40:08.800 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.801 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.801 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.801 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:40:08.801 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.801 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.802 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.802 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.802 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.802 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.802 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.802 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.803 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2020-06-27T04:40:08.803 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2020-06-27T04:40:08.803 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.803 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9751715660095215, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.803 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.803 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.804 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:40:08.804 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.804 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.804 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.804 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.805 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.805 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.805 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.805 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.805 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2020-06-27T04:40:08.805 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2020-06-27T04:40:08.806 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.806 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.806 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.806 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2020-06-27T04:40:08.806 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.807 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.807 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.807 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.807 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.807 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.807 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.808 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.808 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2020-06-27T04:40:08.808 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2020-06-27T04:40:08.808 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.808 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.808 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9758243560791016, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.809 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.809 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.809 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.809 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.809 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.810 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.810 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.810 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.810 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.810 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.810 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-06-27T04:40:08.811 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-06-27T04:40:08.811 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.811 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.811 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.811 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2020-06-27T04:40:08.811 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2020-06-27T04:40:08.812 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.812 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.812 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.812 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.812 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.813 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.813 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.813 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2020-06-27T04:40:08.813 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2020-06-27T04:40:08.813 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.813 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.814 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.814 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2020-06-27T04:40:08.814 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.97650146484375, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.814 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.814 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.815 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.815 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.815 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.815 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.815 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.815 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.816 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2020-06-27T04:40:08.816 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2020-06-27T04:40:08.816 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.816 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.816 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.817 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.817 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.817 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.817 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.817 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.817 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.818 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.818 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.818 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.818 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.818 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.818 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.819 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.819 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.819 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.819 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.819 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9771561622619629, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.820 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.820 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.820 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.820 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.820 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.820 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.824 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.824 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.824 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.824 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.824 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9778265953063965, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.827 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.827 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.827 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.827 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.827 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.827 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.828 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.828 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.828 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.828 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.828 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.828 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.829 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.829 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.829 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.829 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.829 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.830 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.830 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.830 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.830 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.830 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.830 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9785041809082031, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.831 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.831 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.831 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.831 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2020-06-27T04:40:08.831 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2020-06-27T04:40:08.831 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.832 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.832 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.832 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:40:08.832 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.832 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.834 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2020-06-27T04:40:08.834 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2020-06-27T04:40:08.834 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.834 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.834 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.835 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:40:08.835 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.835 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.835 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.835 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.835 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.836 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.836 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.836 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9791836738586426, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.836 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.836 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2020-06-27T04:40:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2020-06-27T04:40:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2020-06-27T04:40:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.838 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.838 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.838 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.838 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.838 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.838 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.839 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.839 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.839 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.839 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.839 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2020-06-27T04:40:08.840 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.840 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.840 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.840 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.840 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.840 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.841 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.841 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.841 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.841 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.841 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.842 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.842 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.842 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9799003601074219, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.842 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.842 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.842 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.843 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.843 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.843 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.843 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.843 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.843 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.844 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.844 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.844 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.844 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.844 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.845 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.845 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.845 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.845 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.845 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.845 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.846 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.846 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.846 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.846 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.846 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.846 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.847 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.847 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.847 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.847 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9805521965026855, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.847 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.848 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.848 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.848 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.848 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.848 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.848 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.849 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.849 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.849 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.849 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.849 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.850 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.850 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.850 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.850 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.850 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.850 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.851 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.851 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.851 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.851 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.851 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.852 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.852 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.852 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.852 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.852 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.853 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.853 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.853 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.853 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9812572002410889, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.853 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.853 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.854 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.854 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2020-06-27T04:40:08.854 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.854 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.854 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.855 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.855 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.855 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.855 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.855 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.855 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.856 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.856 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.856 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.856 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.856 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.856 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.857 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.857 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.857 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.857 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.857 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.858 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.858 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.858 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.858 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.858 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.858 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.859 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.859 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.859 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.981992244720459, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.859 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.859 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.860 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.860 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.860 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.860 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.860 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.860 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.861 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.861 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.861 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.861 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.862 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.862 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.862 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.862 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.862 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.863 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.863 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.863 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.863 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.863 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.863 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.864 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.864 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.864 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.864 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.864 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.864 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.865 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9826436042785645, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.865 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.865 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.865 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.865 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.866 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.866 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.866 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.866 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.866 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.866 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.867 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.867 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.867 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.867 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.867 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.868 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.868 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.868 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.868 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.868 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2020-06-27T04:40:08.868 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-06-27T04:40:08.869 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-06-27T04:40:08.869 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-06-27T04:40:08.869 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2020-06-27T04:40:08.869 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2020-06-27T04:40:08.869 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.870 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.870 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.870 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2020-06-27T04:40:08.870 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.870 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.870 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.871 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9833669662475586, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.871 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.871 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.871 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.871 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.871 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.872 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2020-06-27T04:40:08.872 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2020-06-27T04:40:08.872 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.872 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.872 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.873 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.873 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.873 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.873 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.873 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.873 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.874 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.874 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.874 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.874 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-06-27T04:40:08.874 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-06-27T04:40:08.874 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-06-27T04:40:08.875 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.875 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.875 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2020-06-27T04:40:08.875 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.875 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.876 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.876 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.876 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.876 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9840538501739502, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.876 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.876 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-06-27T04:40:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-06-27T04:40:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-06-27T04:40:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.879 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.879 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.879 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.879 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.879 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.881 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-06-27T04:40:08.881 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-06-27T04:40:08.881 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.881 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.881 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.881 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.882 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9847886562347412, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.882 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.882 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.882 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.882 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.883 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.883 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.883 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.883 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.883 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-06-27T04:40:08.883 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-06-27T04:40:08.884 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.884 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.884 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.884 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-06-27T04:40:08.884 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.885 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.885 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-06-27T04:40:08.885 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-06-27T04:40:08.885 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-06-27T04:40:08.885 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-06-27T04:40:08.885 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-06-27T04:40:08.886 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-06-27T04:40:08.886 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-06-27T04:40:08.886 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.886 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.886 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.886 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.887 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.887 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.887 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-06-27T04:40:08.887 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.985471248626709, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.887 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-06-27T04:40:08.888 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-06-27T04:40:08.888 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.888 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-06-27T04:40:08.888 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-06-27T04:40:08.888 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.888 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.889 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.889 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.889 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.889 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.889 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.889 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.890 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2020-06-27T04:40:08.890 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2020-06-27T04:40:08.890 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.890 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.890 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-06-27T04:40:08.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.891 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.892 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.892 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.892 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.892 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2020-06-27T04:40:08.892 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2020-06-27T04:40:08.892 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-06-27T04:40:08.893 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9861469268798828, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.893 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.893 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.893 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2020-06-27T04:40:08.893 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.894 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.894 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.894 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.894 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.894 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.894 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.895 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.895 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2020-06-27T04:40:08.895 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2020-06-27T04:40:08.895 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-06-27T04:40:08.895 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-06-27T04:40:08.895 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-06-27T04:40:08.896 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2020-06-27T04:40:08.896 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-06-27T04:40:08.896 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-06-27T04:40:08.896 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-06-27T04:40:08.896 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-06-27T04:40:08.897 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-06-27T04:40:08.897 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-06-27T04:40:08.897 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-06-27T04:40:08.897 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.897 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.897 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.898 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.898 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2020-06-27T04:40:08.898 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2020-06-27T04:40:08.898 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2020-06-27T04:40:08.898 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2020-06-27T04:40:08.899 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9868600368499756, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.899 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2020-06-27T04:40:08.899 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2020-06-27T04:40:08.899 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2020-06-27T04:40:08.899 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2020-06-27T04:40:08.899 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2020-06-27T04:40:08.900 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2020-06-27T04:40:08.900 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2020-06-27T04:40:08.900 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.900 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2020-06-27T04:40:08.900 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2020-06-27T04:40:08.900 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2020-06-27T04:40:08.901 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2020-06-27T04:40:08.901 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2020-06-27T04:40:08.901 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2020-06-27T04:40:08.901 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2020-06-27T04:40:08.901 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2020-06-27T04:40:08.902 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2020-06-27T04:40:08.902 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2020-06-27T04:40:08.902 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2020-06-27T04:40:08.902 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2020-06-27T04:40:08.902 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.902 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pacific": [ 2020-06-27T04:40:08.903 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2020-06-27T04:40:08.903 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2020-06-27T04:40:08.903 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2020-06-27T04:40:08.903 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2020-06-27T04:40:08.903 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2020-06-27T04:40:08.903 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2020-06-27T04:40:08.904 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2020-06-27T04:40:08.904 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2020-06-27T04:40:08.904 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2020-06-27T04:40:08.904 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2020-06-27T04:40:08.904 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2020-06-27T04:40:08.905 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-06-27T04:40:08.905 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 4, 2020-06-27T04:40:08.905 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2020-06-27T04:40:08.905 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.905 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2020-06-27T04:40:08.905 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2020-06-27T04:40:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.31:0", 2020-06-27T04:40:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9877855777740479, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 620485409 2020-06-27T04:40:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-06-27T04:40:08.907 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.907 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.907 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2020-06-27T04:40:08.907 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.907 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2020-06-27T04:40:08.908 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.31:0", 2020-06-27T04:40:08.908 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1723866722 2020-06-27T04:40:08.908 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.908 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-06-27T04:40:08.908 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-06-27T04:40:08.908 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.909 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2020-06-27T04:40:08.909 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:08.909 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2020-06-27T04:40:08.909 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.31:0", 2020-06-27T04:40:08.909 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 163335024 2020-06-27T04:40:08.910 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.910 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-06-27T04:40:08.910 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.910 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-06-27T04:40:08.910 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.910 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:08.911 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9883639812469482, stop=False, exit=None, reads=[8] 2020-06-27T04:40:08.916 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.3104772567749023, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:40:08.916 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.310633659362793, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:40:08.916 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Waiting for the mgr to restart... 2020-06-27T04:40:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Waiting for mgr epoch 9... 2020-06-27T04:40:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'tell', 'mgr', 'mgr_status'] 2020-06-27T04:40:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 tell mgr mgr_status 2020-06-27T04:40:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.771+0000 7feac114b700 1 Processor -- start 2020-06-27T04:40:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.771+0000 7feac114b700 1 -- start start 2020-06-27T04:40:08.918 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.771+0000 7feac114b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feabc064730 0x7feabc064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:08.918 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.771+0000 7feac114b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc0651a0 con 0x7feabc064730 2020-06-27T04:40:08.918 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.771+0000 7feabb59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feabc064730 0x7feabc064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:08.918 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6906085014343262, stop=False, exit=None, reads=[10] 2020-06-27T04:40:08.918 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.772+0000 7feabb59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feabc064730 0x7feabc064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38616/0 (socket says 172.21.15.31:38616) 2020-06-27T04:40:08.919 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.772+0000 7feabb59e700 1 -- 172.21.15.31:0/1830736026 learned_addr learned my addr 172.21.15.31:0/1830736026 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:08.919 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.772+0000 7feabb59e700 1 -- 172.21.15.31:0/1830736026 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc065a20 con 0x7feabc064730 2020-06-27T04:40:08.919 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.772+0000 7feabb59e700 1 --2- 172.21.15.31:0/1830736026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feabc064730 0x7feabc064b50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7feaa4002f70 tx=0x7feaa4006ec0).ready entity=mon.0 client_cookie=c36ad562a8166ee9 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:08.919 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.772+0000 7feaba59c700 1 -- 172.21.15.31:0/1830736026 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7feaa4009980 con 0x7feabc064730 2020-06-27T04:40:08.919 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6909148693084717, stop=False, exit=None, reads=[10] 2020-06-27T04:40:08.920 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.772+0000 7feaba59c700 1 -- 172.21.15.31:0/1830736026 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7feaa4000e90 con 0x7feabc064730 2020-06-27T04:40:08.920 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.772+0000 7feaba59c700 1 -- 172.21.15.31:0/1830736026 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7feaa4011c70 con 0x7feabc064730 2020-06-27T04:40:08.920 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.772+0000 7feac114b700 1 -- 172.21.15.31:0/1830736026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feabc064730 msgr2=0x7feabc064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:08.920 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.772+0000 7feac114b700 1 --2- 172.21.15.31:0/1830736026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feabc064730 0x7feabc064b50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7feaa4002f70 tx=0x7feaa4006ec0).stop 2020-06-27T04:40:08.920 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.772+0000 7feac114b700 1 -- 172.21.15.31:0/1830736026 shutdown_connections 2020-06-27T04:40:08.921 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6912603378295898, stop=False, exit=None, reads=[10] 2020-06-27T04:40:08.921 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.772+0000 7feac114b700 1 --2- 172.21.15.31:0/1830736026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feabc064730 0x7feabc064b50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:08.921 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.772+0000 7feac114b700 1 -- 172.21.15.31:0/1830736026 >> 172.21.15.31:0/1830736026 conn(0x7feabc05ffe0 msgr2=0x7feabc062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:08.921 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.772+0000 7feac114b700 1 -- 172.21.15.31:0/1830736026 shutdown_connections 2020-06-27T04:40:08.921 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.772+0000 7feac114b700 1 -- 172.21.15.31:0/1830736026 wait complete. 2020-06-27T04:40:08.921 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.774+0000 7feac114b700 1 Processor -- start 2020-06-27T04:40:08.922 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6915879249572754, stop=False, exit=None, reads=[10] 2020-06-27T04:40:08.922 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.774+0000 7feac114b700 1 -- start start 2020-06-27T04:40:08.922 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.774+0000 7feac114b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feabc07e2e0 0x7feabc061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:08.922 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.774+0000 7feac114b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc061860 con 0x7feabc07e2e0 2020-06-27T04:40:08.922 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6917366981506348, stop=False, exit=None, reads=[10] 2020-06-27T04:40:08.923 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.774+0000 7feabb59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feabc07e2e0 0x7feabc061370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:08.923 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.774+0000 7feabb59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feabc07e2e0 0x7feabc061370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38618/0 (socket says 172.21.15.31:38618) 2020-06-27T04:40:08.923 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.774+0000 7feabb59e700 1 -- 172.21.15.31:0/1731622970 learned_addr learned my addr 172.21.15.31:0/1731622970 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:08.923 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6919021606445312, stop=False, exit=None, reads=[10] 2020-06-27T04:40:08.923 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.774+0000 7feabb59e700 1 -- 172.21.15.31:0/1731622970 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc0619a0 con 0x7feabc07e2e0 2020-06-27T04:40:08.924 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6921546459197998, stop=False, exit=None, reads=[10] 2020-06-27T04:40:08.924 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.775+0000 7feabb59e700 1 --2- 172.21.15.31:0/1731622970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feabc07e2e0 0x7feabc061370 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7feaa4006bb0 tx=0x7feaa4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:08.924 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6922616958618164, stop=False, exit=None, reads=[10] 2020-06-27T04:40:08.924 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.775+0000 7feab37fe700 1 -- 172.21.15.31:0/1731622970 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7feaa401a820 con 0x7feabc07e2e0 2020-06-27T04:40:08.924 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6924483776092529, stop=False, exit=None, reads=[10] 2020-06-27T04:40:08.924 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.775+0000 7feac114b700 1 -- 172.21.15.31:0/1731622970 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feabc061b90 con 0x7feabc07e2e0 2020-06-27T04:40:08.925 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.775+0000 7feac114b700 1 -- 172.21.15.31:0/1731622970 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feabc061ff0 con 0x7feabc07e2e0 2020-06-27T04:40:08.925 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6926202774047852, stop=False, exit=None, reads=[10] 2020-06-27T04:40:08.925 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.775+0000 7feab37fe700 1 -- 172.21.15.31:0/1731622970 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7feaa401adc0 con 0x7feabc07e2e0 2020-06-27T04:40:08.925 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.775+0000 7feab37fe700 1 -- 172.21.15.31:0/1731622970 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7feaa4025c40 con 0x7feabc07e2e0 2020-06-27T04:40:08.925 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.775+0000 7feab37fe700 1 -- 172.21.15.31:0/1731622970 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 9) v1 ==== 31803+0+0 (secure 0 0 0) 0x7feaa400f070 con 0x7feabc07e2e0 2020-06-27T04:40:08.926 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6933457851409912, stop=False, exit=None, reads=[10] 2020-06-27T04:40:08.926 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.776+0000 7feab37fe700 1 --2- 172.21.15.31:0/1731622970 >> v2:172.21.15.31:6800/4294292023 conn(0x7fea9402aad0 0x7fea9402cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:08.926 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.776+0000 7feab37fe700 1 -- 172.21.15.31:0/1731622970 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1326+0+0 (secure 0 0 0) 0x7feaa4025610 con 0x7feabc07e2e0 2020-06-27T04:40:08.926 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.776+0000 7feabad9d700 1 -- 172.21.15.31:0/1731622970 >> v2:172.21.15.31:6800/4294292023 conn(0x7fea9402aad0 msgr2=0x7fea9402cf90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/4294292023 2020-06-27T04:40:08.926 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.776+0000 7feabad9d700 1 --2- 172.21.15.31:0/1731622970 >> v2:172.21.15.31:6800/4294292023 conn(0x7fea9402aad0 0x7fea9402cf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2020-06-27T04:40:08.927 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6936149597167969, stop=False, exit=None, reads=[10] 2020-06-27T04:40:08.927 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.776+0000 7feac114b700 1 -- 172.21.15.31:0/1731622970 --> v2:172.21.15.31:6800/4294292023 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7feabc0621e0 con 0x7fea9402aad0 2020-06-27T04:40:08.927 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6937229633331299, stop=False, exit=None, reads=[10] 2020-06-27T04:40:08.927 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:08 smithi031 bash[18426]: audit 2020-06-27T04:40:07.635111+0000 mon.a (mon.0) 75 : audit [DBG] from='client.? 172.21.15.31:0/463112027' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2020-06-27T04:40:08.980 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.977+0000 7feabad9d700 1 -- 172.21.15.31:0/1731622970 >> v2:172.21.15.31:6800/4294292023 conn(0x7fea9402aad0 msgr2=0x7fea9402cf90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/4294292023 2020-06-27T04:40:08.980 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:08.977+0000 7feabad9d700 1 --2- 172.21.15.31:0/1731622970 >> v2:172.21.15.31:6800/4294292023 conn(0x7fea9402aad0 0x7fea9402cf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2020-06-27T04:40:08.981 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.8945116996765137, stop=False, exit=None, reads=[10] 2020-06-27T04:40:09.381 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:09.378+0000 7feabad9d700 1 -- 172.21.15.31:0/1731622970 >> v2:172.21.15.31:6800/4294292023 conn(0x7fea9402aad0 msgr2=0x7fea9402cf90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/4294292023 2020-06-27T04:40:09.381 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:09.378+0000 7feabad9d700 1 --2- 172.21.15.31:0/1731622970 >> v2:172.21.15.31:6800/4294292023 conn(0x7fea9402aad0 0x7fea9402cf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2020-06-27T04:40:09.382 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.295553207397461, stop=False, exit=None, reads=[10] 2020-06-27T04:40:10.147 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:10.144+0000 7feab37fe700 1 -- 172.21.15.31:0/1731622970 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mgrmap(e 10) v1 ==== 31648+0+0 (secure 0 0 0) 0x7feaa400fd90 con 0x7feabc07e2e0 2020-06-27T04:40:10.148 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=2.0614984035491943, stop=False, exit=None, reads=[10] 2020-06-27T04:40:10.148 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:10.144+0000 7feab37fe700 1 -- 172.21.15.31:0/1731622970 >> v2:172.21.15.31:6800/4294292023 conn(0x7fea9402aad0 msgr2=0x7fea9402cf90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-06-27T04:40:10.148 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:10.144+0000 7feab37fe700 1 --2- 172.21.15.31:0/1731622970 >> v2:172.21.15.31:6800/4294292023 conn(0x7fea9402aad0 0x7fea9402cf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-06-27T04:40:10.148 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=2.0616800785064697, stop=False, exit=None, reads=[10] 2020-06-27T04:40:10.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:10 smithi031 bash[18426]: cluster 2020-06-27T04:40:10.090923+0000 mon.a (mon.0) 76 : cluster [INF] Active manager daemon y restarted 2020-06-27T04:40:10.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:10 smithi031 bash[18426]: cluster 2020-06-27T04:40:10.091323+0000 mon.a (mon.0) 77 : cluster [INF] Activating manager daemon y 2020-06-27T04:40:10.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:10 smithi031 bash[18426]: cluster 2020-06-27T04:40:10.095339+0000 mon.a (mon.0) 78 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2020-06-27T04:40:10.473 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:40:10 smithi031 bash[18687]: Warning: Permanently added 'smithi031,172.21.15.31' (ECDSA) to the list of known hosts. 2020-06-27T04:40:11.157 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.152+0000 7feab37fe700 1 -- 172.21.15.31:0/1731622970 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 11) v1 ==== 31683+0+0 (secure 0 0 0) 0x7feaa401b640 con 0x7feabc07e2e0 2020-06-27T04:40:11.158 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.152+0000 7feab37fe700 1 --2- 172.21.15.31:0/1731622970 >> v2:172.21.15.31:6800/1241213118 conn(0x7fea9402e410 0x7fea94030800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:11.158 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.152+0000 7feab37fe700 1 -- 172.21.15.31:0/1731622970 --> v2:172.21.15.31:6800/1241213118 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7feabc0621e0 con 0x7fea9402e410 2020-06-27T04:40:11.158 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.153+0000 7feabad9d700 1 --2- 172.21.15.31:0/1731622970 >> v2:172.21.15.31:6800/1241213118 conn(0x7fea9402e410 0x7fea94030800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:11.159 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.071540594100952, stop=False, exit=None, reads=[10] 2020-06-27T04:40:11.159 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.153+0000 7feabad9d700 1 --2- 172.21.15.31:0/1731622970 >> v2:172.21.15.31:6800/1241213118 conn(0x7fea9402e410 0x7fea94030800 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7feaac000b60 tx=0x7feaac006c80).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:11.159 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.153+0000 7feab37fe700 1 -- 172.21.15.31:0/1731622970 <== mgr.14142 v2:172.21.15.31:6800/1241213118 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6306 (secure 0 0 0) 0x7feabc0621e0 con 0x7fea9402e410 2020-06-27T04:40:11.159 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.071686267852783, stop=False, exit=None, reads=[10] 2020-06-27T04:40:11.167 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.163+0000 7feac114b700 1 -- 172.21.15.31:0/1731622970 --> v2:172.21.15.31:6800/1241213118 -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7feabc07dbe0 con 0x7fea9402e410 2020-06-27T04:40:11.167 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.0805211067199707, stop=False, exit=None, reads=[10] 2020-06-27T04:40:11.168 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.163+0000 7feab37fe700 1 -- 172.21.15.31:0/1731622970 <== mgr.14142 v2:172.21.15.31:6800/1241213118 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7feabc07dbe0 con 0x7fea9402e410 2020-06-27T04:40:11.168 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.0807173252105713, stop=False, exit=None, reads=[10] 2020-06-27T04:40:11.168 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-06-27T04:40:11.168 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 11, 2020-06-27T04:40:11.168 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2020-06-27T04:40:11.168 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-06-27T04:40:11.169 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.080944538116455, stop=False, exit=None, reads=[8] 2020-06-27T04:40:11.169 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.163+0000 7feac114b700 1 -- 172.21.15.31:0/1731622970 >> v2:172.21.15.31:6800/1241213118 conn(0x7fea9402e410 msgr2=0x7fea94030800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:11.169 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.163+0000 7feac114b700 1 --2- 172.21.15.31:0/1731622970 >> v2:172.21.15.31:6800/1241213118 conn(0x7fea9402e410 0x7fea94030800 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7feaac000b60 tx=0x7feaac006c80).stop 2020-06-27T04:40:11.169 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.163+0000 7feac114b700 1 -- 172.21.15.31:0/1731622970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feabc07e2e0 msgr2=0x7feabc061370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:11.169 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.163+0000 7feac114b700 1 --2- 172.21.15.31:0/1731622970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feabc07e2e0 0x7feabc061370 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7feaa4006bb0 tx=0x7feaa4006ec0).stop 2020-06-27T04:40:11.170 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.0811920166015625, stop=False, exit=None, reads=[10] 2020-06-27T04:40:11.170 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.163+0000 7feac114b700 1 -- 172.21.15.31:0/1731622970 shutdown_connections 2020-06-27T04:40:11.170 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.163+0000 7feac114b700 1 --2- 172.21.15.31:0/1731622970 >> v2:172.21.15.31:6800/1241213118 conn(0x7fea9402e410 0x7fea94030800 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:11.170 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.163+0000 7feac114b700 1 --2- 172.21.15.31:0/1731622970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feabc07e2e0 0x7feabc061370 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:11.170 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.163+0000 7feac114b700 1 --2- 172.21.15.31:0/1731622970 >> v2:172.21.15.31:6800/4294292023 conn(0x7fea9402aad0 0x7fea9402cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-06-27T04:40:11.171 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.163+0000 7feac114b700 1 -- 172.21.15.31:0/1731622970 >> 172.21.15.31:0/1731622970 conn(0x7feabc05ffe0 msgr2=0x7feabc062460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:11.171 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.163+0000 7feac114b700 1 -- 172.21.15.31:0/1731622970 shutdown_connections 2020-06-27T04:40:11.171 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.081366539001465, stop=False, exit=None, reads=[10] 2020-06-27T04:40:11.171 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:11.163+0000 7feac114b700 1 -- 172.21.15.31:0/1731622970 wait complete. 2020-06-27T04:40:11.171 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.0814318656921387, stop=False, exit=None, reads=[10] 2020-06-27T04:40:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:11 smithi031 bash[18426]: cluster 2020-06-27T04:40:10.146076+0000 mon.a (mon.0) 79 : cluster [DBG] mgrmap e10: y(active, starting, since 0.0548295s) 2020-06-27T04:40:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:11 smithi031 bash[18426]: audit 2020-06-27T04:40:10.149895+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2020-06-27T04:40:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:11 smithi031 bash[18426]: audit 2020-06-27T04:40:10.150107+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-06-27T04:40:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:11 smithi031 bash[18426]: audit 2020-06-27T04:40:10.150249+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-06-27T04:40:11.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:11 smithi031 bash[18426]: audit 2020-06-27T04:40:10.150374+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-06-27T04:40:11.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:11 smithi031 bash[18426]: audit 2020-06-27T04:40:10.150645+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-06-27T04:40:11.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:11 smithi031 bash[18426]: audit 2020-06-27T04:40:10.151243+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi031"}]: dispatch 2020-06-27T04:40:11.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:11 smithi031 bash[18426]: audit 2020-06-27T04:40:10.151456+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2020-06-27T04:40:11.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:11 smithi031 bash[18426]: audit 2020-06-27T04:40:10.151640+0000 mon.a (mon.0) 87 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2020-06-27T04:40:11.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:11 smithi031 bash[18426]: audit 2020-06-27T04:40:10.151823+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2020-06-27T04:40:11.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:11 smithi031 bash[18426]: audit 2020-06-27T04:40:10.152023+0000 mon.a (mon.0) 89 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2020-06-27T04:40:11.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:11 smithi031 bash[18426]: audit 2020-06-27T04:40:10.152226+0000 mon.a (mon.0) 90 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2020-06-27T04:40:11.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:11 smithi031 bash[18426]: cluster 2020-06-27T04:40:10.153690+0000 mon.a (mon.0) 91 : cluster [INF] Manager daemon y is now available 2020-06-27T04:40:11.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:11 smithi031 bash[18426]: audit 2020-06-27T04:40:10.275419+0000 mon.a (mon.0) 92 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2020-06-27T04:40:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.5409352779388428, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:40:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=3.541092872619629, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:40:11.628 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:mgr epoch 9 is available 2020-06-27T04:40:11.628 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Generating a dashboard self-signed certificate... 2020-06-27T04:40:11.628 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'dashboard', 'create-self-signed-cert'] 2020-06-27T04:40:11.628 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 dashboard create-self-signed-cert 2020-06-27T04:40:12.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:12 smithi031 bash[18426]: audit 2020-06-27T04:40:11.151287+0000 mon.a (mon.0) 93 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2020-06-27T04:40:12.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:12 smithi031 bash[18426]: audit 2020-06-27T04:40:11.152447+0000 mon.a (mon.0) 94 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:40:12.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:12 smithi031 bash[18426]: audit 2020-06-27T04:40:11.154795+0000 mgr.y (mgr.14142) 1 : audit [DBG] from='client.14146 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2020-06-27T04:40:12.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:12 smithi031 bash[18426]: cluster 2020-06-27T04:40:11.155446+0000 mon.a (mon.0) 95 : cluster [DBG] mgrmap e11: y(active, since 1.0642s) 2020-06-27T04:40:12.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:12 smithi031 bash[18426]: audit 2020-06-27T04:40:11.164502+0000 mgr.y (mgr.14142) 2 : audit [DBG] from='client.14146 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2020-06-27T04:40:12.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:12 smithi031 bash[18426]: audit 2020-06-27T04:40:12.053882+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:40:12.053242\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:40:12.053350\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-06-27T04:40:12.053441\", \"networks\": {}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:40:12.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:12 smithi031 bash[18426]: audit 2020-06-27T04:40:12.055703+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:40:12.053242\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:40:12.053350\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-06-27T04:40:12.053441\", \"networks\": {}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:40:12.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:12 smithi031 bash[18426]: audit 2020-06-27T04:40:12.056156+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:40:12.389 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.380+0000 7feb9725c700 1 Processor -- start 2020-06-27T04:40:12.390 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.380+0000 7feb9725c700 1 -- start start 2020-06-27T04:40:12.390 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.380+0000 7feb9725c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90064730 0x7feb90064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:12.390 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.380+0000 7feb9725c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb900651a0 con 0x7feb90064730 2020-06-27T04:40:12.390 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.381+0000 7feb957f9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90064730 0x7feb90064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:12.391 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7571210861206055, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.391 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.381+0000 7feb957f9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90064730 0x7feb90064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38660/0 (socket says 172.21.15.31:38660) 2020-06-27T04:40:12.391 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.381+0000 7feb957f9700 1 -- 172.21.15.31:0/600450330 learned_addr learned my addr 172.21.15.31:0/600450330 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:12.391 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.381+0000 7feb957f9700 1 -- 172.21.15.31:0/600450330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90065a20 con 0x7feb90064730 2020-06-27T04:40:12.391 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.381+0000 7feb957f9700 1 --2- 172.21.15.31:0/600450330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90064730 0x7feb90064b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7feb8c002f70 tx=0x7feb8c006ec0).ready entity=mon.0 client_cookie=4a662c63ca41122c server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:12.392 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.381+0000 7feb87fff700 1 -- 172.21.15.31:0/600450330 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7feb8c009980 con 0x7feb90064730 2020-06-27T04:40:12.392 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7573175430297852, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.392 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.381+0000 7feb87fff700 1 -- 172.21.15.31:0/600450330 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7feb8c000e90 con 0x7feb90064730 2020-06-27T04:40:12.392 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.381+0000 7feb87fff700 1 -- 172.21.15.31:0/600450330 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7feb8c011c70 con 0x7feb90064730 2020-06-27T04:40:12.392 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.381+0000 7feb9725c700 1 -- 172.21.15.31:0/600450330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90064730 msgr2=0x7feb90064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:12.393 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.381+0000 7feb9725c700 1 --2- 172.21.15.31:0/600450330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90064730 0x7feb90064b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7feb8c002f70 tx=0x7feb8c006ec0).stop 2020-06-27T04:40:12.393 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.381+0000 7feb9725c700 1 -- 172.21.15.31:0/600450330 shutdown_connections 2020-06-27T04:40:12.393 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7574858665466309, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.393 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.381+0000 7feb9725c700 1 --2- 172.21.15.31:0/600450330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90064730 0x7feb90064b50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:12.393 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.381+0000 7feb9725c700 1 -- 172.21.15.31:0/600450330 >> 172.21.15.31:0/600450330 conn(0x7feb9005ffe0 msgr2=0x7feb90062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:12.397 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.381+0000 7feb9725c700 1 -- 172.21.15.31:0/600450330 shutdown_connections 2020-06-27T04:40:12.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.381+0000 7feb9725c700 1 -- 172.21.15.31:0/600450330 wait complete. 2020-06-27T04:40:12.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7576394081115723, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.383+0000 7feb9725c700 1 Processor -- start 2020-06-27T04:40:12.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.383+0000 7feb9725c700 1 -- start start 2020-06-27T04:40:12.398 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7577505111694336, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.399 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.383+0000 7feb9725c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90077560 0x7feb90077980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:12.399 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.383+0000 7feb9725c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb90077fd0 con 0x7feb90077560 2020-06-27T04:40:12.399 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7581167221069336, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.399 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.383+0000 7feb957f9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90077560 0x7feb90077980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:12.399 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.383+0000 7feb957f9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90077560 0x7feb90077980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38662/0 (socket says 172.21.15.31:38662) 2020-06-27T04:40:12.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.383+0000 7feb957f9700 1 -- 172.21.15.31:0/3233489335 learned_addr learned my addr 172.21.15.31:0/3233489335 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:12.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7583250999450684, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.383+0000 7feb957f9700 1 -- 172.21.15.31:0/3233489335 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90078890 con 0x7feb90077560 2020-06-27T04:40:12.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.758530855178833, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.400 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.383+0000 7feb957f9700 1 --2- 172.21.15.31:0/3233489335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90077560 0x7feb90077980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7feb8c006bb0 tx=0x7feb8c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:12.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7586596012115479, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.384+0000 7feb857fa700 1 -- 172.21.15.31:0/3233489335 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7feb8c01a820 con 0x7feb90077560 2020-06-27T04:40:12.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7588596343994141, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.384+0000 7feb857fa700 1 -- 172.21.15.31:0/3233489335 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7feb8c01adc0 con 0x7feb90077560 2020-06-27T04:40:12.401 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.384+0000 7feb9725c700 1 -- 172.21.15.31:0/3233489335 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb90078ae0 con 0x7feb90077560 2020-06-27T04:40:12.402 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.384+0000 7feb857fa700 1 -- 172.21.15.31:0/3233489335 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7feb8c01bcb0 con 0x7feb90077560 2020-06-27T04:40:12.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7590301036834717, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.384+0000 7feb9725c700 1 -- 172.21.15.31:0/3233489335 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb90078f10 con 0x7feb90077560 2020-06-27T04:40:12.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7591283321380615, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.384+0000 7feb857fa700 1 -- 172.21.15.31:0/3233489335 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 31683+0+0 (secure 0 0 0) 0x7feb8c00f070 con 0x7feb90077560 2020-06-27T04:40:12.403 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7596380710601807, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.404 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.385+0000 7feb857fa700 1 --2- 172.21.15.31:0/3233489335 >> v2:172.21.15.31:6800/1241213118 conn(0x7feb6c02aa40 0x7feb6c02cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:12.404 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7598621845245361, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.404 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.385+0000 7feb857fa700 1 -- 172.21.15.31:0/3233489335 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1498+0+0 (secure 0 0 0) 0x7feb8c03b7d0 con 0x7feb90077560 2020-06-27T04:40:12.405 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.385+0000 7feb9725c700 1 -- 172.21.15.31:0/3233489335 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb90078110 con 0x7feb90077560 2020-06-27T04:40:12.406 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.385+0000 7feb94ff8700 1 --2- 172.21.15.31:0/3233489335 >> v2:172.21.15.31:6800/1241213118 conn(0x7feb6c02aa40 0x7feb6c02cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:12.406 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7600760459899902, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.406 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.385+0000 7feb94ff8700 1 --2- 172.21.15.31:0/3233489335 >> v2:172.21.15.31:6800/1241213118 conn(0x7feb6c02aa40 0x7feb6c02cf00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7feb80002f70 tx=0x7feb80006b20).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:12.406 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.76025390625, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.407 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.389+0000 7feb857fa700 1 -- 172.21.15.31:0/3233489335 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7feb8c01a980 con 0x7feb90077560 2020-06-27T04:40:12.407 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7639079093933105, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.544+0000 7feb9725c700 1 -- 172.21.15.31:0/3233489335 --> v2:172.21.15.31:6800/1241213118 -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7feb90057340 con 0x7feb6c02aa40 2020-06-27T04:40:12.548 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9191434383392334, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.787 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.775+0000 7feb857fa700 1 -- 172.21.15.31:0/3233489335 <== mgr.14142 v2:172.21.15.31:6800/1241213118 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7feb90057340 con 0x7feb6c02aa40 2020-06-27T04:40:12.788 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.1503162384033203, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.788 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Self-signed certificate created 2020-06-27T04:40:12.788 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.1504185199737549, stop=False, exit=None, reads=[8] 2020-06-27T04:40:12.788 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.777+0000 7feb9725c700 1 -- 172.21.15.31:0/3233489335 >> v2:172.21.15.31:6800/1241213118 conn(0x7feb6c02aa40 msgr2=0x7feb6c02cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:12.788 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.777+0000 7feb9725c700 1 --2- 172.21.15.31:0/3233489335 >> v2:172.21.15.31:6800/1241213118 conn(0x7feb6c02aa40 0x7feb6c02cf00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7feb80002f70 tx=0x7feb80006b20).stop 2020-06-27T04:40:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.777+0000 7feb9725c700 1 -- 172.21.15.31:0/3233489335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90077560 msgr2=0x7feb90077980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.777+0000 7feb9725c700 1 --2- 172.21.15.31:0/3233489335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90077560 0x7feb90077980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7feb8c006bb0 tx=0x7feb8c006ec0).stop 2020-06-27T04:40:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.151902198791504, stop=False, exit=None, reads=[10] 2020-06-27T04:40:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.777+0000 7feb9725c700 1 -- 172.21.15.31:0/3233489335 shutdown_connections 2020-06-27T04:40:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.777+0000 7feb9725c700 1 --2- 172.21.15.31:0/3233489335 >> v2:172.21.15.31:6800/1241213118 conn(0x7feb6c02aa40 0x7feb6c02cf00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:12.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.777+0000 7feb9725c700 1 --2- 172.21.15.31:0/3233489335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90077560 0x7feb90077980 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:12.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.777+0000 7feb9725c700 1 -- 172.21.15.31:0/3233489335 >> 172.21.15.31:0/3233489335 conn(0x7feb9005ffe0 msgr2=0x7feb90062460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:12.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.777+0000 7feb9725c700 1 -- 172.21.15.31:0/3233489335 shutdown_connections 2020-06-27T04:40:12.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:12.777+0000 7feb9725c700 1 -- 172.21.15.31:0/3233489335 wait complete. 2020-06-27T04:40:12.790 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.152235746383667, stop=False, exit=None, reads=[10] 2020-06-27T04:40:13.321 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.6926519870758057, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:40:13.322 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.6928155422210693, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:40:13.322 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Creating initial admin user... 2020-06-27T04:40:13.322 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'dashboard', 'ac-user-create', 'admin', 'qf4wlvbnvu', 'administrator', '--force-password', '--pwd-update-required'] 2020-06-27T04:40:13.322 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 dashboard ac-user-create admin qf4wlvbnvu administrator --force-password --pwd-update-required 2020-06-27T04:40:13.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:13 smithi031 bash[18426]: audit 2020-06-27T04:40:12.772764+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIICzzCCAbcCEEw0Ev/BT0t7qTF/+YRLmncwDQYJKoZIhvcNAQENBQAwJjELMAkG\nA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgtZGFzaGJvYXJkMB4XDTIwMDYyNzA0NDAx\nMloXDTMwMDYyNTA0NDAxMlowJjELMAkGA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgt\nZGFzaGJvYXJkMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAo4nWLkwP\nqQBt53KoCPn+DqD3kX7ynCEdkyK3VCJSG6Xu91CTqjH/KdsRboCNETQ6FJNtx6L9\nXGzWPLEr4ug77ul2DeszbZkn9VGDzZimbU+pCNGmza41i9ojuxjzeRz6OfdgicLy\nLhn8G4E8ZNd0XsCbyXPJGH1f9Hm2EL6N8AX6PSTxwHJItVHKX/3COD/bP8YGhsXQ\n25dq8+0AluV/moAdh4C4TqA0spvXai8IgD6P2TmyX31xm9jZS+TGSxHElspoq+lO\nbkqXqbcPH6/Je/ZcHD/ZgflHMq4ZizLfPV05azkF9eJWr/8A9M+FDhR/6VKN3HHM\nJuCiMYWLj12j+wIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBJu/RUuIHRJaMizC30\nkPsQNUxvHFMKjeLlfrSF7FWFnXi9Zcrnb4NxBxL/IXhdlPsUeZKG2TK072xjOfXr\njWOGkNk1lfWz54tp8W7oTaPJuPg3jXndmNcIIfo6WNPWWFQUIcbwMx9queDHPykm\nlRNFaQPJ9FtZm1rikDgI+ovIMtVKFnpwoCCiPJYas1oUVJ0aUmqOm2rQG2ug7N2S\n+Jg/pwak/X6EtzG6wJLvCgUbcPLAzbagBTjiRigroE2uLT0AA4TEStfHprky+ksM\n7o3Nhj/bkC5iom1Kg0YcfE2Uz1vtjV12nQ93sDkpRYw+fYB2v9SZcChs3GsHtSn9\nabNr\n-----END CERTIFICATE-----\n"}]: dispatch 2020-06-27T04:40:13.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:13 smithi031 bash[18426]: audit 2020-06-27T04:40:12.774529+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIICzzCCAbcCEEw0Ev/BT0t7qTF/+YRLmncwDQYJKoZIhvcNAQENBQAwJjELMAkG\nA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgtZGFzaGJvYXJkMB4XDTIwMDYyNzA0NDAx\nMloXDTMwMDYyNTA0NDAxMlowJjELMAkGA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgt\nZGFzaGJvYXJkMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAo4nWLkwP\nqQBt53KoCPn+DqD3kX7ynCEdkyK3VCJSG6Xu91CTqjH/KdsRboCNETQ6FJNtx6L9\nXGzWPLEr4ug77ul2DeszbZkn9VGDzZimbU+pCNGmza41i9ojuxjzeRz6OfdgicLy\nLhn8G4E8ZNd0XsCbyXPJGH1f9Hm2EL6N8AX6PSTxwHJItVHKX/3COD/bP8YGhsXQ\n25dq8+0AluV/moAdh4C4TqA0spvXai8IgD6P2TmyX31xm9jZS+TGSxHElspoq+lO\nbkqXqbcPH6/Je/ZcHD/ZgflHMq4ZizLfPV05azkF9eJWr/8A9M+FDhR/6VKN3HHM\nJuCiMYWLj12j+wIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBJu/RUuIHRJaMizC30\nkPsQNUxvHFMKjeLlfrSF7FWFnXi9Zcrnb4NxBxL/IXhdlPsUeZKG2TK072xjOfXr\njWOGkNk1lfWz54tp8W7oTaPJuPg3jXndmNcIIfo6WNPWWFQUIcbwMx9queDHPykm\nlRNFaQPJ9FtZm1rikDgI+ovIMtVKFnpwoCCiPJYas1oUVJ0aUmqOm2rQG2ug7N2S\n+Jg/pwak/X6EtzG6wJLvCgUbcPLAzbagBTjiRigroE2uLT0AA4TEStfHprky+ksM\n7o3Nhj/bkC5iom1Kg0YcfE2Uz1vtjV12nQ93sDkpRYw+fYB2v9SZcChs3GsHtSn9\nabNr\n-----END CERTIFICATE-----\n"}]': finished 2020-06-27T04:40:13.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:13 smithi031 bash[18426]: audit 2020-06-27T04:40:12.774923+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEwAIBADANBgkqhkiG9w0BAQEFAASCBKowggSmAgEAAoIBAQCjidYuTA+pAG3n\ncqgI+f4OoPeRfvKcIR2TIrdUIlIbpe73UJOqMf8p2xFugI0RNDoUk23Hov1cbNY8\nsSvi6Dvu6XYN6zNtmSf1UYPNmKZtT6kI0abNrjWL2iO7GPN5HPo592CJwvIuGfwb\ngTxk13RewJvJc8kYfV/0ebYQvo3wBfo9JPHAcki1Ucpf/cI4P9s/xgaGxdDbl2rz\n7QCW5X+agB2HgLhOoDSym9dqLwiAPo/ZObJffXGb2NlL5MZLEcSWymir6U5uSpep\ntw8fr8l79lwcP9mB+UcyrhmLMt89XTlrOQX14lav/wD0z4UOFH/pUo3cccwm4KIx\nhYuPXaP7AgMBAAECggEBAIFf28bIeWMTad69v91KGAhuoyvBKCEHuaPaxPmUJSym\nOsQARLFR2DC+k629mNvRW1lHwIM8l/70Qw/EgZmCa1d37eLY/NhpX0kdcY3Gg3La\noDjP0ovIk6fNrJKpDIP1vqb44rBZPsnl2KHRvXtxTyhea2AVbzMmjDCV0MiyVwtY\nC2gk0L4zBps5ZvTC696tpJuicFUJAWUlCEv/Zm5cF4X/qnm4TAZN1MZV2lh3b/34\nqEMRblamfznu5E57GAEIUdsi90Nev+DIqwgHcMtDNa4VVe1ZOY6hw5F2q5hlf4AX\nCz6AGcY6u8lawDnQnDjxdWe++xnISewoNb6JNUMwZAECgYEA0ZOallj3mrOORwUi\nZm1I7Fhy4FMV5s6LHrJIvvB5sSmKLpzm2JD3SVCLFULGanOfxHOedCqc+eyq+j3b\nYJwS47c8rZ6TjCiV1qAP1E0cK42LH+KJWnKzjCDA8DKLpij20gjOD69/DdrmLqsX\ngfGuSa2lmVzJ2TGOQRnpQOxVbwECgYEAx8OPoEo9Qrgkf58HATUv0a0OBYbcbjFl\ns9+3+bqN8j03s3q6jY4IEElftXjr2WxR0IsYTtigaAofBHxWiBQ3hPIilKKXe76W\nkNywLsVnH6NpA2OeTpeG0YpWA2ZVynosVvvQzj+SQHeu0iqqmeaPZoILuaCsKtTD\nDt2vxE9HzvsCgYEAqCyYCjnOR3f6ngcCucrMj8vSMyy5EIOBo9pRAdea741z8z+5\nBuQda9mUIjV5Xwb1mAFnj7R6TxuZgEGO/xF/Hvh1WqU7pWcUBixfR2+xQUnN8IIq\n0kfkyHeoG5eT9Hw+xACIypF7lTSpLZ3huUalIz6S+mQ5HW7kxlzyjkSXsgECgYEA\npuVqP78Gw5FZXQ6eKZIoK4Pr7Q4paB75G3jUGl6UbUhcGyV0awO5FPJYdiNa2MI4\n8ITlgCpYidO66mJ/YR2S7Q3neksFSKuI2+qlf84JRFOgTuaRwpOyXaq4BgsfrhS4\nqsukPky6ggX8FzbyZbZNJJWN+j6U2Qv9E5R/XwHlurUCgYEAjFiDtLlSPEWmGUo2\nIoWgEoKSD7vN+HNNZgJS2/Olk5DW9nNCO6m15IOShSD7ZICnuX7/5ESw28qLb82O\nH7Y2IdfxKJuWnMB3yWwR8fk0IWC73QSDdYJcVd7qJMoVWvWd2Pe4o7DvVxebFLul\nbuAsPc5C7jZ3Hp1nYs2DzFPwFF4=\n-----END PRIVATE KEY-----\n"}]: dispatch 2020-06-27T04:40:13.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:13 smithi031 bash[18426]: audit 2020-06-27T04:40:12.776416+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEwAIBADANBgkqhkiG9w0BAQEFAASCBKowggSmAgEAAoIBAQCjidYuTA+pAG3n\ncqgI+f4OoPeRfvKcIR2TIrdUIlIbpe73UJOqMf8p2xFugI0RNDoUk23Hov1cbNY8\nsSvi6Dvu6XYN6zNtmSf1UYPNmKZtT6kI0abNrjWL2iO7GPN5HPo592CJwvIuGfwb\ngTxk13RewJvJc8kYfV/0ebYQvo3wBfo9JPHAcki1Ucpf/cI4P9s/xgaGxdDbl2rz\n7QCW5X+agB2HgLhOoDSym9dqLwiAPo/ZObJffXGb2NlL5MZLEcSWymir6U5uSpep\ntw8fr8l79lwcP9mB+UcyrhmLMt89XTlrOQX14lav/wD0z4UOFH/pUo3cccwm4KIx\nhYuPXaP7AgMBAAECggEBAIFf28bIeWMTad69v91KGAhuoyvBKCEHuaPaxPmUJSym\nOsQARLFR2DC+k629mNvRW1lHwIM8l/70Qw/EgZmCa1d37eLY/NhpX0kdcY3Gg3La\noDjP0ovIk6fNrJKpDIP1vqb44rBZPsnl2KHRvXtxTyhea2AVbzMmjDCV0MiyVwtY\nC2gk0L4zBps5ZvTC696tpJuicFUJAWUlCEv/Zm5cF4X/qnm4TAZN1MZV2lh3b/34\nqEMRblamfznu5E57GAEIUdsi90Nev+DIqwgHcMtDNa4VVe1ZOY6hw5F2q5hlf4AX\nCz6AGcY6u8lawDnQnDjxdWe++xnISewoNb6JNUMwZAECgYEA0ZOallj3mrOORwUi\nZm1I7Fhy4FMV5s6LHrJIvvB5sSmKLpzm2JD3SVCLFULGanOfxHOedCqc+eyq+j3b\nYJwS47c8rZ6TjCiV1qAP1E0cK42LH+KJWnKzjCDA8DKLpij20gjOD69/DdrmLqsX\ngfGuSa2lmVzJ2TGOQRnpQOxVbwECgYEAx8OPoEo9Qrgkf58HATUv0a0OBYbcbjFl\ns9+3+bqN8j03s3q6jY4IEElftXjr2WxR0IsYTtigaAofBHxWiBQ3hPIilKKXe76W\nkNywLsVnH6NpA2OeTpeG0YpWA2ZVynosVvvQzj+SQHeu0iqqmeaPZoILuaCsKtTD\nDt2vxE9HzvsCgYEAqCyYCjnOR3f6ngcCucrMj8vSMyy5EIOBo9pRAdea741z8z+5\nBuQda9mUIjV5Xwb1mAFnj7R6TxuZgEGO/xF/Hvh1WqU7pWcUBixfR2+xQUnN8IIq\n0kfkyHeoG5eT9Hw+xACIypF7lTSpLZ3huUalIz6S+mQ5HW7kxlzyjkSXsgECgYEA\npuVqP78Gw5FZXQ6eKZIoK4Pr7Q4paB75G3jUGl6UbUhcGyV0awO5FPJYdiNa2MI4\n8ITlgCpYidO66mJ/YR2S7Q3neksFSKuI2+qlf84JRFOgTuaRwpOyXaq4BgsfrhS4\nqsukPky6ggX8FzbyZbZNJJWN+j6U2Qv9E5R/XwHlurUCgYEAjFiDtLlSPEWmGUo2\nIoWgEoKSD7vN+HNNZgJS2/Olk5DW9nNCO6m15IOShSD7ZICnuX7/5ESw28qLb82O\nH7Y2IdfxKJuWnMB3yWwR8fk0IWC73QSDdYJcVd7qJMoVWvWd2Pe4o7DvVxebFLul\nbuAsPc5C7jZ3Hp1nYs2DzFPwFF4=\n-----END PRIVATE KEY-----\n"}]': finished 2020-06-27T04:40:13.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:13 smithi031 bash[18426]: cluster 2020-06-27T04:40:13.076206+0000 mon.a (mon.0) 103 : cluster [DBG] mgrmap e12: y(active, since 2s) 2020-06-27T04:40:14.252 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.244+0000 7f7ae9bda700 1 Processor -- start 2020-06-27T04:40:14.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.244+0000 7f7ae9bda700 1 -- start start 2020-06-27T04:40:14.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.244+0000 7f7ae9bda700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae4064730 0x7f7ae4064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:14.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.244+0000 7f7ae9bda700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae40651a0 con 0x7f7ae4064730 2020-06-27T04:40:14.253 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.244+0000 7f7ae3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae4064730 0x7f7ae4064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:14.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9272012710571289, stop=False, exit=None, reads=[10] 2020-06-27T04:40:14.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.244+0000 7f7ae3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae4064730 0x7f7ae4064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38666/0 (socket says 172.21.15.31:38666) 2020-06-27T04:40:14.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.244+0000 7f7ae3fff700 1 -- 172.21.15.31:0/2064978027 learned_addr learned my addr 172.21.15.31:0/2064978027 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:14.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.245+0000 7f7ae3fff700 1 -- 172.21.15.31:0/2064978027 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae4065a20 con 0x7f7ae4064730 2020-06-27T04:40:14.254 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.245+0000 7f7ae3fff700 1 --2- 172.21.15.31:0/2064978027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae4064730 0x7f7ae4064b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f7ad4002f70 tx=0x7f7ad4006ec0).ready entity=mon.0 client_cookie=f65b9290127bdc76 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:14.255 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.245+0000 7f7ae37fe700 1 -- 172.21.15.31:0/2064978027 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f7ad4009980 con 0x7f7ae4064730 2020-06-27T04:40:14.255 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9274108409881592, stop=False, exit=None, reads=[10] 2020-06-27T04:40:14.255 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.245+0000 7f7ae37fe700 1 -- 172.21.15.31:0/2064978027 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f7ad4000e90 con 0x7f7ae4064730 2020-06-27T04:40:14.255 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.245+0000 7f7ae37fe700 1 -- 172.21.15.31:0/2064978027 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f7ad4011c70 con 0x7f7ae4064730 2020-06-27T04:40:14.255 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.245+0000 7f7ae9bda700 1 -- 172.21.15.31:0/2064978027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae4064730 msgr2=0x7f7ae4064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:14.256 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.245+0000 7f7ae9bda700 1 --2- 172.21.15.31:0/2064978027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae4064730 0x7f7ae4064b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f7ad4002f70 tx=0x7f7ad4006ec0).stop 2020-06-27T04:40:14.256 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.245+0000 7f7ae9bda700 1 -- 172.21.15.31:0/2064978027 shutdown_connections 2020-06-27T04:40:14.256 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9276762008666992, stop=False, exit=None, reads=[10] 2020-06-27T04:40:14.256 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.245+0000 7f7ae9bda700 1 --2- 172.21.15.31:0/2064978027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae4064730 0x7f7ae4064b50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:14.256 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.245+0000 7f7ae9bda700 1 -- 172.21.15.31:0/2064978027 >> 172.21.15.31:0/2064978027 conn(0x7f7ae405ffe0 msgr2=0x7f7ae4062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:14.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.245+0000 7f7ae9bda700 1 -- 172.21.15.31:0/2064978027 shutdown_connections 2020-06-27T04:40:14.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.245+0000 7f7ae9bda700 1 -- 172.21.15.31:0/2064978027 wait complete. 2020-06-27T04:40:14.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.246+0000 7f7ae9bda700 1 Processor -- start 2020-06-27T04:40:14.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.246+0000 7f7ae9bda700 1 -- start start 2020-06-27T04:40:14.257 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.246+0000 7f7ae9bda700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae4078600 0x7f7ae4078a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:14.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.246+0000 7f7ae9bda700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae4079070 con 0x7f7ae4078600 2020-06-27T04:40:14.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9280564785003662, stop=False, exit=None, reads=[10] 2020-06-27T04:40:14.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.247+0000 7f7ae3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae4078600 0x7f7ae4078a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:14.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.247+0000 7f7ae3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae4078600 0x7f7ae4078a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38668/0 (socket says 172.21.15.31:38668) 2020-06-27T04:40:14.258 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.247+0000 7f7ae3fff700 1 -- 172.21.15.31:0/1897016394 learned_addr learned my addr 172.21.15.31:0/1897016394 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:14.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.247+0000 7f7ae3fff700 1 -- 172.21.15.31:0/1897016394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae4079980 con 0x7f7ae4078600 2020-06-27T04:40:14.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9282729625701904, stop=False, exit=None, reads=[10] 2020-06-27T04:40:14.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.247+0000 7f7ae3fff700 1 --2- 172.21.15.31:0/1897016394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae4078600 0x7f7ae4078a20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7ad4006bb0 tx=0x7f7ad4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:14.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.247+0000 7f7ae0ff9700 1 -- 172.21.15.31:0/1897016394 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f7ad401a820 con 0x7f7ae4078600 2020-06-27T04:40:14.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.247+0000 7f7ae0ff9700 1 -- 172.21.15.31:0/1897016394 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f7ad401adc0 con 0x7f7ae4078600 2020-06-27T04:40:14.259 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.247+0000 7f7ae0ff9700 1 -- 172.21.15.31:0/1897016394 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f7ad401bcb0 con 0x7f7ae4078600 2020-06-27T04:40:14.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.247+0000 7f7ae9bda700 1 -- 172.21.15.31:0/1897016394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae4079bd0 con 0x7f7ae4078600 2020-06-27T04:40:14.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9286026954650879, stop=False, exit=None, reads=[10] 2020-06-27T04:40:14.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.247+0000 7f7ae9bda700 1 -- 172.21.15.31:0/1897016394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae407a000 con 0x7f7ae4078600 2020-06-27T04:40:14.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9287393093109131, stop=False, exit=None, reads=[10] 2020-06-27T04:40:14.260 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.248+0000 7f7ae0ff9700 1 -- 172.21.15.31:0/1897016394 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 12) v1 ==== 31803+0+0 (secure 0 0 0) 0x7f7ad400f070 con 0x7f7ae4078600 2020-06-27T04:40:14.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9290225505828857, stop=False, exit=None, reads=[10] 2020-06-27T04:40:14.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.248+0000 7f7ae0ff9700 1 --2- 172.21.15.31:0/1897016394 >> v2:172.21.15.31:6800/1241213118 conn(0x7f7abc02aad0 0x7f7abc02cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:14.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.929175853729248, stop=False, exit=None, reads=[10] 2020-06-27T04:40:14.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.248+0000 7f7ae0ff9700 1 -- 172.21.15.31:0/1897016394 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1498+0+0 (secure 0 0 0) 0x7f7ad403bbd0 con 0x7f7ae4078600 2020-06-27T04:40:14.261 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.248+0000 7f7adbfff700 1 --2- 172.21.15.31:0/1897016394 >> v2:172.21.15.31:6800/1241213118 conn(0x7f7abc02aad0 0x7f7abc02cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:14.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9293782711029053, stop=False, exit=None, reads=[10] 2020-06-27T04:40:14.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.248+0000 7f7adbfff700 1 --2- 172.21.15.31:0/1897016394 >> v2:172.21.15.31:6800/1241213118 conn(0x7f7abc02aad0 0x7f7abc02cf90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f7acc002f70 tx=0x7f7acc006b20).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:14.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9295828342437744, stop=False, exit=None, reads=[10] 2020-06-27T04:40:14.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.249+0000 7f7ae9bda700 1 -- 172.21.15.31:0/1897016394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae40791b0 con 0x7f7ae4078600 2020-06-27T04:40:14.262 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9297604560852051, stop=False, exit=None, reads=[10] 2020-06-27T04:40:14.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.252+0000 7f7ae0ff9700 1 -- 172.21.15.31:0/1897016394 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f7ad401b610 con 0x7f7ae4078600 2020-06-27T04:40:14.263 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.9335098266601562, stop=False, exit=None, reads=[10] 2020-06-27T04:40:14.425 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.421+0000 7f7ae9bda700 1 -- 172.21.15.31:0/1897016394 --> v2:172.21.15.31:6800/1241213118 -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "password": "qf4wlvbnvu", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f7ae4057340 con 0x7f7abc02aad0 2020-06-27T04:40:14.425 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.102731466293335, stop=False, exit=None, reads=[10] 2020-06-27T04:40:14.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:14 smithi031 bash[18426]: audit 2020-06-27T04:40:12.545906+0000 mgr.y (mgr.14142) 3 : audit [DBG] from='client.14155 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:40:14.670 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.667+0000 7f7ae0ff9700 1 -- 172.21.15.31:0/1897016394 <== mgr.14142 v2:172.21.15.31:6800/1241213118 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f7ae4057340 con 0x7f7abc02aad0 2020-06-27T04:40:14.670 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.3478350639343262, stop=False, exit=None, reads=[10] 2020-06-27T04:40:14.671 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout {"username": "admin", "password": "$2b$12$JkoedCzTozQ22P1XVg4T6uswWzFDH28/roaIa73jZHUsRucBWmaV.", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1593232814, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2020-06-27T04:40:14.671 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.347973346710205, stop=False, exit=None, reads=[8] 2020-06-27T04:40:14.672 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.668+0000 7f7ae9bda700 1 -- 172.21.15.31:0/1897016394 >> v2:172.21.15.31:6800/1241213118 conn(0x7f7abc02aad0 msgr2=0x7f7abc02cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:14.672 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.668+0000 7f7ae9bda700 1 --2- 172.21.15.31:0/1897016394 >> v2:172.21.15.31:6800/1241213118 conn(0x7f7abc02aad0 0x7f7abc02cf90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f7acc002f70 tx=0x7f7acc006b20).stop 2020-06-27T04:40:14.673 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.668+0000 7f7ae9bda700 1 -- 172.21.15.31:0/1897016394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae4078600 msgr2=0x7f7ae4078a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:14.673 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.668+0000 7f7ae9bda700 1 --2- 172.21.15.31:0/1897016394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae4078600 0x7f7ae4078a20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7ad4006bb0 tx=0x7f7ad4006ec0).stop 2020-06-27T04:40:14.673 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.349621295928955, stop=False, exit=None, reads=[10] 2020-06-27T04:40:14.673 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.668+0000 7f7ae9bda700 1 -- 172.21.15.31:0/1897016394 shutdown_connections 2020-06-27T04:40:14.673 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.668+0000 7f7ae9bda700 1 --2- 172.21.15.31:0/1897016394 >> v2:172.21.15.31:6800/1241213118 conn(0x7f7abc02aad0 0x7f7abc02cf90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:14.674 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.668+0000 7f7ae9bda700 1 --2- 172.21.15.31:0/1897016394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae4078600 0x7f7ae4078a20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:14.674 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.668+0000 7f7ae9bda700 1 -- 172.21.15.31:0/1897016394 >> 172.21.15.31:0/1897016394 conn(0x7f7ae405ffe0 msgr2=0x7f7ae4061ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:14.674 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.668+0000 7f7ae9bda700 1 -- 172.21.15.31:0/1897016394 shutdown_connections 2020-06-27T04:40:14.674 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:14.668+0000 7f7ae9bda700 1 -- 172.21.15.31:0/1897016394 wait complete. 2020-06-27T04:40:14.674 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.3499715328216553, stop=False, exit=None, reads=[10] 2020-06-27T04:40:15.099 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.776731252670288, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:40:15.100 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.7768917083740234, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:40:15.100 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Fetching dashboard port number... 2020-06-27T04:40:15.100 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '--ipc=host', '-e', 'CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', '-e', 'NODE_NAME=smithi031', '-v', '/var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'config', 'get', 'mgr', 'mgr/dashboard/ssl_server_port'] 2020-06-27T04:40:15.100 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host --ipc=host -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 -e NODE_NAME=smithi031 -v /var/log/ceph/12892ae2-b830-11ea-a06d-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp7yyrzka:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpa4j1fgvv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 config get mgr mgr/dashboard/ssl_server_port 2020-06-27T04:40:15.364 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:15 smithi031 bash[18426]: audit 2020-06-27T04:40:14.666111+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$JkoedCzTozQ22P1XVg4T6uswWzFDH28/roaIa73jZHUsRucBWmaV.\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1593232814, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]: dispatch 2020-06-27T04:40:15.365 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:15 smithi031 bash[18426]: audit 2020-06-27T04:40:14.667983+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$JkoedCzTozQ22P1XVg4T6uswWzFDH28/roaIa73jZHUsRucBWmaV.\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1593232814, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]': finished 2020-06-27T04:40:15.720 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.711+0000 7fe6a609b700 1 Processor -- start 2020-06-27T04:40:15.720 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.711+0000 7fe6a609b700 1 -- start start 2020-06-27T04:40:15.720 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.711+0000 7fe6a609b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a0064730 0x7fe6a0064b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:15.720 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.711+0000 7fe6a609b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a00651a0 con 0x7fe6a0064730 2020-06-27T04:40:15.721 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.711+0000 7fe69ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a0064730 0x7fe6a0064b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:15.721 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6153335571289062, stop=False, exit=None, reads=[10] 2020-06-27T04:40:15.721 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.711+0000 7fe69ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a0064730 0x7fe6a0064b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38676/0 (socket says 172.21.15.31:38676) 2020-06-27T04:40:15.721 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.712+0000 7fe69ffff700 1 -- 172.21.15.31:0/1294341234 learned_addr learned my addr 172.21.15.31:0/1294341234 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:15.721 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.712+0000 7fe69ffff700 1 -- 172.21.15.31:0/1294341234 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a0065a20 con 0x7fe6a0064730 2020-06-27T04:40:15.722 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.712+0000 7fe69ffff700 1 --2- 172.21.15.31:0/1294341234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a0064730 0x7fe6a0064b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fe690002f70 tx=0x7fe690006ec0).ready entity=mon.0 client_cookie=639933ee2fdd7b34 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:15.722 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.712+0000 7fe69effd700 1 -- 172.21.15.31:0/1294341234 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fe690009980 con 0x7fe6a0064730 2020-06-27T04:40:15.722 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6156682968139648, stop=False, exit=None, reads=[10] 2020-06-27T04:40:15.722 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.712+0000 7fe69effd700 1 -- 172.21.15.31:0/1294341234 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fe690000e90 con 0x7fe6a0064730 2020-06-27T04:40:15.722 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.712+0000 7fe69effd700 1 -- 172.21.15.31:0/1294341234 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fe690011c70 con 0x7fe6a0064730 2020-06-27T04:40:15.723 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.712+0000 7fe6a609b700 1 -- 172.21.15.31:0/1294341234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a0064730 msgr2=0x7fe6a0064b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:15.723 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.712+0000 7fe6a609b700 1 --2- 172.21.15.31:0/1294341234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a0064730 0x7fe6a0064b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fe690002f70 tx=0x7fe690006ec0).stop 2020-06-27T04:40:15.723 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.712+0000 7fe6a609b700 1 -- 172.21.15.31:0/1294341234 shutdown_connections 2020-06-27T04:40:15.723 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6159648895263672, stop=False, exit=None, reads=[10] 2020-06-27T04:40:15.723 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.712+0000 7fe6a609b700 1 --2- 172.21.15.31:0/1294341234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a0064730 0x7fe6a0064b50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:15.723 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.712+0000 7fe6a609b700 1 -- 172.21.15.31:0/1294341234 >> 172.21.15.31:0/1294341234 conn(0x7fe6a005ffe0 msgr2=0x7fe6a0062400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:15.724 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.712+0000 7fe6a609b700 1 -- 172.21.15.31:0/1294341234 shutdown_connections 2020-06-27T04:40:15.724 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.712+0000 7fe6a609b700 1 -- 172.21.15.31:0/1294341234 wait complete. 2020-06-27T04:40:15.724 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.713+0000 7fe6a609b700 1 Processor -- start 2020-06-27T04:40:15.724 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.713+0000 7fe6a609b700 1 -- start start 2020-06-27T04:40:15.724 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.713+0000 7fe6a609b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a006ee30 0x7fe6a006d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.713+0000 7fe6a609b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a006f3b0 con 0x7fe6a006ee30 2020-06-27T04:40:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6164078712463379, stop=False, exit=None, reads=[10] 2020-06-27T04:40:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.714+0000 7fe69ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a006ee30 0x7fe6a006d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.714+0000 7fe69ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a006ee30 0x7fe6a006d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38678/0 (socket says 172.21.15.31:38678) 2020-06-27T04:40:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.714+0000 7fe69ffff700 1 -- 172.21.15.31:0/1220656312 learned_addr learned my addr 172.21.15.31:0/1220656312 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:15.742 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.714+0000 7fe69ffff700 1 -- 172.21.15.31:0/1220656312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a006f4f0 con 0x7fe6a006ee30 2020-06-27T04:40:15.742 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6166760921478271, stop=False, exit=None, reads=[10] 2020-06-27T04:40:15.742 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.714+0000 7fe69ffff700 1 --2- 172.21.15.31:0/1220656312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a006ee30 0x7fe6a006d6e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fe690002f70 tx=0x7fe690006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:15.742 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.714+0000 7fe687fff700 1 -- 172.21.15.31:0/1220656312 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fe690010940 con 0x7fe6a006ee30 2020-06-27T04:40:15.743 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.714+0000 7fe6a609b700 1 -- 172.21.15.31:0/1220656312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a006dbd0 con 0x7fe6a006ee30 2020-06-27T04:40:15.743 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.714+0000 7fe687fff700 1 -- 172.21.15.31:0/1220656312 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fe690010ee0 con 0x7fe6a006ee30 2020-06-27T04:40:15.743 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.714+0000 7fe687fff700 1 -- 172.21.15.31:0/1220656312 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fe69001bc90 con 0x7fe6a006ee30 2020-06-27T04:40:15.743 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6169710159301758, stop=False, exit=None, reads=[10] 2020-06-27T04:40:15.743 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.714+0000 7fe6a609b700 1 -- 172.21.15.31:0/1220656312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a006e060 con 0x7fe6a006ee30 2020-06-27T04:40:15.744 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6170847415924072, stop=False, exit=None, reads=[10] 2020-06-27T04:40:15.744 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.715+0000 7fe687fff700 1 -- 172.21.15.31:0/1220656312 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 12) v1 ==== 31803+0+0 (secure 0 0 0) 0x7fe69000f070 con 0x7fe6a006ee30 2020-06-27T04:40:15.744 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6174328327178955, stop=False, exit=None, reads=[10] 2020-06-27T04:40:15.744 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.715+0000 7fe687fff700 1 --2- 172.21.15.31:0/1220656312 >> v2:172.21.15.31:6800/1241213118 conn(0x7fe68002aad0 0x7fe68002cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:15.744 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.617633581161499, stop=False, exit=None, reads=[10] 2020-06-27T04:40:15.745 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.715+0000 7fe687fff700 1 -- 172.21.15.31:0/1220656312 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1498+0+0 (secure 0 0 0) 0x7fe69003ba80 con 0x7fe6a006ee30 2020-06-27T04:40:15.745 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.715+0000 7fe6a609b700 1 -- 172.21.15.31:0/1220656312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe678004dc0 con 0x7fe6a006ee30 2020-06-27T04:40:15.745 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6177840232849121, stop=False, exit=None, reads=[10] 2020-06-27T04:40:15.745 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.715+0000 7fe69f7fe700 1 --2- 172.21.15.31:0/1220656312 >> v2:172.21.15.31:6800/1241213118 conn(0x7fe68002aad0 0x7fe68002cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:15.745 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6178889274597168, stop=False, exit=None, reads=[10] 2020-06-27T04:40:15.745 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.715+0000 7fe69f7fe700 1 --2- 172.21.15.31:0/1220656312 >> v2:172.21.15.31:6800/1241213118 conn(0x7fe68002aad0 0x7fe68002cf90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fe694002f70 tx=0x7fe694006b20).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:15.746 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.618088960647583, stop=False, exit=None, reads=[10] 2020-06-27T04:40:15.746 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.719+0000 7fe687fff700 1 -- 172.21.15.31:0/1220656312 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fe69000f4e0 con 0x7fe6a006ee30 2020-06-27T04:40:15.747 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.6214849948883057, stop=False, exit=None, reads=[10] 2020-06-27T04:40:15.876 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.873+0000 7fe6a609b700 1 -- 172.21.15.31:0/1220656312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fe678000e00 con 0x7fe6a006ee30 2020-06-27T04:40:15.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7754795551300049, stop=False, exit=None, reads=[10] 2020-06-27T04:40:15.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.873+0000 7fe687fff700 1 -- 172.21.15.31:0/1220656312 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v6) v1 ==== 112+0+5 (secure 0 0 0) 0x7fe69000f300 con 0x7fe6a006ee30 2020-06-27T04:40:15.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7756991386413574, stop=False, exit=None, reads=[10] 2020-06-27T04:40:15.877 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 8443 2020-06-27T04:40:15.878 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7757997512817383, stop=False, exit=None, reads=[8] 2020-06-27T04:40:15.879 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.874+0000 7fe6a609b700 1 -- 172.21.15.31:0/1220656312 >> v2:172.21.15.31:6800/1241213118 conn(0x7fe68002aad0 msgr2=0x7fe68002cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:15.879 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.874+0000 7fe6a609b700 1 --2- 172.21.15.31:0/1220656312 >> v2:172.21.15.31:6800/1241213118 conn(0x7fe68002aad0 0x7fe68002cf90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fe694002f70 tx=0x7fe694006b20).stop 2020-06-27T04:40:15.879 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.874+0000 7fe6a609b700 1 -- 172.21.15.31:0/1220656312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a006ee30 msgr2=0x7fe6a006d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:15.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.874+0000 7fe6a609b700 1 --2- 172.21.15.31:0/1220656312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a006ee30 0x7fe6a006d6e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fe690002f70 tx=0x7fe690006ec0).stop 2020-06-27T04:40:15.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7771596908569336, stop=False, exit=None, reads=[10] 2020-06-27T04:40:15.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.875+0000 7fe6a609b700 1 -- 172.21.15.31:0/1220656312 shutdown_connections 2020-06-27T04:40:15.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.875+0000 7fe6a609b700 1 --2- 172.21.15.31:0/1220656312 >> v2:172.21.15.31:6800/1241213118 conn(0x7fe68002aad0 0x7fe68002cf90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:15.880 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.875+0000 7fe6a609b700 1 --2- 172.21.15.31:0/1220656312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a006ee30 0x7fe6a006d6e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:15.881 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.875+0000 7fe6a609b700 1 -- 172.21.15.31:0/1220656312 >> 172.21.15.31:0/1220656312 conn(0x7fe6a005ffe0 msgr2=0x7fe6a0060ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:15.881 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.875+0000 7fe6a609b700 1 -- 172.21.15.31:0/1220656312 shutdown_connections 2020-06-27T04:40:15.881 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:stderr 2020-06-27T04:40:15.875+0000 7fe6a609b700 1 -- 172.21.15.31:0/1220656312 wait complete. 2020-06-27T04:40:15.881 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=0.7773940563201904, stop=False, exit=None, reads=[10] 2020-06-27T04:40:16.337 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.2358372211456299, stop=False, exit=0, reads=[8, 10] 2020-06-27T04:40:16.337 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:/usr/bin/ceph:profile rt=1.236004114151001, stop=True, exit=0, reads=[8, 10] 2020-06-27T04:40:16.339 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Ceph Dashboard is now available at: 2020-06-27T04:40:16.340 INFO:teuthology.orchestra.run.smithi031.stderr: 2020-06-27T04:40:16.340 INFO:teuthology.orchestra.run.smithi031.stderr: URL: https://smithi031:8443/ 2020-06-27T04:40:16.340 INFO:teuthology.orchestra.run.smithi031.stderr: User: admin 2020-06-27T04:40:16.340 INFO:teuthology.orchestra.run.smithi031.stderr: Password: qf4wlvbnvu 2020-06-27T04:40:16.340 INFO:teuthology.orchestra.run.smithi031.stderr: 2020-06-27T04:40:16.340 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:You can access the Ceph CLI with: 2020-06-27T04:40:16.341 INFO:teuthology.orchestra.run.smithi031.stderr: 2020-06-27T04:40:16.341 INFO:teuthology.orchestra.run.smithi031.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2020-06-27T04:40:16.341 INFO:teuthology.orchestra.run.smithi031.stderr: 2020-06-27T04:40:16.341 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Please consider enabling telemetry to help improve Ceph: 2020-06-27T04:40:16.341 INFO:teuthology.orchestra.run.smithi031.stderr: 2020-06-27T04:40:16.342 INFO:teuthology.orchestra.run.smithi031.stderr: ceph telemetry on 2020-06-27T04:40:16.342 INFO:teuthology.orchestra.run.smithi031.stderr: 2020-06-27T04:40:16.342 INFO:teuthology.orchestra.run.smithi031.stderr:For more information see: 2020-06-27T04:40:16.342 INFO:teuthology.orchestra.run.smithi031.stderr: 2020-06-27T04:40:16.342 INFO:teuthology.orchestra.run.smithi031.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2020-06-27T04:40:16.343 INFO:teuthology.orchestra.run.smithi031.stderr: 2020-06-27T04:40:16.343 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Bootstrap complete. 2020-06-27T04:40:16.343 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Releasing lock 140449376975896 on /run/cephadm/12892ae2-b830-11ea-a06d-001a4aab830c.lock 2020-06-27T04:40:16.343 INFO:teuthology.orchestra.run.smithi031.stderr:DEBUG:cephadm:Lock 140449376975896 released on /run/cephadm/12892ae2-b830-11ea-a06d-001a4aab830c.lock 2020-06-27T04:40:16.376 INFO:tasks.cephadm:Fetching config... 2020-06-27T04:40:16.434 DEBUG:teuthology.orchestra.remote:smithi031:/etc/ceph/ceph.conf is 175B 2020-06-27T04:40:16.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:16 smithi031 bash[18426]: audit 2020-06-27T04:40:14.423648+0000 mgr.y (mgr.14142) 4 : audit [DBG] from='client.14157 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "password": "qf4wlvbnvu", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:40:16.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:16 smithi031 bash[18426]: audit 2020-06-27T04:40:15.874599+0000 mon.a (mon.0) 106 : audit [DBG] from='client.? 172.21.15.31:0/1220656312' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2020-06-27T04:40:16.477 INFO:tasks.cephadm:Fetching client.admin keyring... 2020-06-27T04:40:16.522 DEBUG:teuthology.orchestra.remote:smithi031:/etc/ceph/ceph.client.admin.keyring is 63B 2020-06-27T04:40:16.568 INFO:tasks.cephadm:Fetching mon keyring... 2020-06-27T04:40:16.568 INFO:teuthology.orchestra.run.smithi031:> mktemp 2020-06-27T04:40:16.582 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.2LRKBE4F6I 2020-06-27T04:40:16.583 INFO:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/keyring /tmp/tmp.2LRKBE4F6I 2020-06-27T04:40:16.661 INFO:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.2LRKBE4F6I 2020-06-27T04:40:16.801 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.2LRKBE4F6I is 77B 2020-06-27T04:40:16.848 INFO:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.2LRKBE4F6I 2020-06-27T04:40:16.862 INFO:tasks.cephadm:Fetching pub ssh key... 2020-06-27T04:40:16.918 DEBUG:teuthology.orchestra.remote:smithi031:/home/ubuntu/cephtest/ceph.pub is 595B 2020-06-27T04:40:16.937 INFO:tasks.cephadm:Installing pub ssh key for root users... 2020-06-27T04:40:16.938 INFO:teuthology.orchestra.run.smithi031:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDwG+KEW3Hml51D9hOYXlF5qTtWyLyR+mKDtutmBBYmUqpr2VG1h39W/5dE6ceAANeugcJwW4sGpaqerL5JbTqKrF/gwvyMd4wPp6L3RGOhn45g97n2UkJccRivhOLI95VIPc3EH1QWXC6BlmYRZGKxXgycv5t2YO24m2+il4VQxQo2HjylAVLP97NDmWtJbKTqJl4v4maOenc+12IBvplnxPCErRD5f1bUn0ibKFtnAZL8rI+3bI5KZaBPo87q1vmmLczZRVs/JP2ruajlcvf+Vh141QmxjheH/vG+C11yLL3tnD8JV6tbMhMK1uY/89JcBmuUcUCulaUe0X+w40VERWPb0h2MeavfRbs3DTC3TBVn6IXmgS1/vOXJYbF15pv8DR20PqjPocjSCBWqqW9SGhcPLmq+OHQCr/b+XWbpMVTEAbAeOuCsOodAiaXFv5CQJvMadqBpk+xDF/TPpLp2S2N8ohJLW2QNXF9fumlq3KWAaq3R+Diwz0fZTGvk+Ok= ceph-12892ae2-b830-11ea-a06d-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2020-06-27T04:40:16.987 INFO:teuthology.orchestra.run.smithi031.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDwG+KEW3Hml51D9hOYXlF5qTtWyLyR+mKDtutmBBYmUqpr2VG1h39W/5dE6ceAANeugcJwW4sGpaqerL5JbTqKrF/gwvyMd4wPp6L3RGOhn45g97n2UkJccRivhOLI95VIPc3EH1QWXC6BlmYRZGKxXgycv5t2YO24m2+il4VQxQo2HjylAVLP97NDmWtJbKTqJl4v4maOenc+12IBvplnxPCErRD5f1bUn0ibKFtnAZL8rI+3bI5KZaBPo87q1vmmLczZRVs/JP2ruajlcvf+Vh141QmxjheH/vG+C11yLL3tnD8JV6tbMhMK1uY/89JcBmuUcUCulaUe0X+w40VERWPb0h2MeavfRbs3DTC3TBVn6IXmgS1/vOXJYbF15pv8DR20PqjPocjSCBWqqW9SGhcPLmq+OHQCr/b+XWbpMVTEAbAeOuCsOodAiaXFv5CQJvMadqBpk+xDF/TPpLp2S2N8ohJLW2QNXF9fumlq3KWAaq3R+Diwz0fZTGvk+Ok= ceph-12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:40:17.006 INFO:teuthology.orchestra.run.smithi051:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDwG+KEW3Hml51D9hOYXlF5qTtWyLyR+mKDtutmBBYmUqpr2VG1h39W/5dE6ceAANeugcJwW4sGpaqerL5JbTqKrF/gwvyMd4wPp6L3RGOhn45g97n2UkJccRivhOLI95VIPc3EH1QWXC6BlmYRZGKxXgycv5t2YO24m2+il4VQxQo2HjylAVLP97NDmWtJbKTqJl4v4maOenc+12IBvplnxPCErRD5f1bUn0ibKFtnAZL8rI+3bI5KZaBPo87q1vmmLczZRVs/JP2ruajlcvf+Vh141QmxjheH/vG+C11yLL3tnD8JV6tbMhMK1uY/89JcBmuUcUCulaUe0X+w40VERWPb0h2MeavfRbs3DTC3TBVn6IXmgS1/vOXJYbF15pv8DR20PqjPocjSCBWqqW9SGhcPLmq+OHQCr/b+XWbpMVTEAbAeOuCsOodAiaXFv5CQJvMadqBpk+xDF/TPpLp2S2N8ohJLW2QNXF9fumlq3KWAaq3R+Diwz0fZTGvk+Ok= ceph-12892ae2-b830-11ea-a06d-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2020-06-27T04:40:17.063 INFO:teuthology.orchestra.run.smithi051.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDwG+KEW3Hml51D9hOYXlF5qTtWyLyR+mKDtutmBBYmUqpr2VG1h39W/5dE6ceAANeugcJwW4sGpaqerL5JbTqKrF/gwvyMd4wPp6L3RGOhn45g97n2UkJccRivhOLI95VIPc3EH1QWXC6BlmYRZGKxXgycv5t2YO24m2+il4VQxQo2HjylAVLP97NDmWtJbKTqJl4v4maOenc+12IBvplnxPCErRD5f1bUn0ibKFtnAZL8rI+3bI5KZaBPo87q1vmmLczZRVs/JP2ruajlcvf+Vh141QmxjheH/vG+C11yLL3tnD8JV6tbMhMK1uY/89JcBmuUcUCulaUe0X+w40VERWPb0h2MeavfRbs3DTC3TBVn6IXmgS1/vOXJYbF15pv8DR20PqjPocjSCBWqqW9SGhcPLmq+OHQCr/b+XWbpMVTEAbAeOuCsOodAiaXFv5CQJvMadqBpk+xDF/TPpLp2S2N8ohJLW2QNXF9fumlq3KWAaq3R+Diwz0fZTGvk+Ok= ceph-12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:40:17.082 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2020-06-27T04:40:17.222 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:17 smithi031 bash[18426]: cluster 2020-06-27T04:40:16.165395+0000 mon.a (mon.0) 107 : cluster [DBG] mgrmap e13: y(active, since 6s) 2020-06-27T04:40:18.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:18 smithi031 bash[18426]: audit 2020-06-27T04:40:18.114378+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:40:19.130 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.126+0000 7f219adca700 1 Processor -- start 2020-06-27T04:40:19.131 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.126+0000 7f219adca700 1 -- start start 2020-06-27T04:40:19.131 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.127+0000 7f219adca700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f219406a200 0x7f21940770d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:19.131 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.127+0000 7f219adca700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21940775c0 con 0x7f219406a200 2020-06-27T04:40:19.131 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.127+0000 7f2199367700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f219406a200 0x7f21940770d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:19.132 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.127+0000 7f2199367700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f219406a200 0x7f21940770d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38684/0 (socket says 172.21.15.31:38684) 2020-06-27T04:40:19.132 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.127+0000 7f2199367700 1 -- 172.21.15.31:0/3789029060 learned_addr learned my addr 172.21.15.31:0/3789029060 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:40:19.132 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.127+0000 7f2199367700 1 -- 172.21.15.31:0/3789029060 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2194077700 con 0x7f219406a200 2020-06-27T04:40:19.132 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.127+0000 7f2199367700 1 --2- 172.21.15.31:0/3789029060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f219406a200 0x7f21940770d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f2190002f10 tx=0x7f2190009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:19.132 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.127+0000 7f21897fa700 1 -- 172.21.15.31:0/3789029060 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f219000e030 con 0x7f219406a200 2020-06-27T04:40:19.133 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.127+0000 7f21897fa700 1 -- 172.21.15.31:0/3789029060 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f2190013ac0 con 0x7f219406a200 2020-06-27T04:40:19.133 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.127+0000 7f219adca700 1 -- 172.21.15.31:0/3789029060 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21940778f0 con 0x7f219406a200 2020-06-27T04:40:19.133 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.127+0000 7f21897fa700 1 -- 172.21.15.31:0/3789029060 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f2190018070 con 0x7f219406a200 2020-06-27T04:40:19.133 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.127+0000 7f219adca700 1 -- 172.21.15.31:0/3789029060 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2194077db0 con 0x7f219406a200 2020-06-27T04:40:19.134 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.128+0000 7f21897fa700 1 -- 172.21.15.31:0/3789029060 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f219001da10 con 0x7f219406a200 2020-06-27T04:40:19.134 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.128+0000 7f21897fa700 1 --2- 172.21.15.31:0/3789029060 >> v2:172.21.15.31:6800/1241213118 conn(0x7f217002ab60 0x7f217002d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:40:19.135 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.128+0000 7f21897fa700 1 -- 172.21.15.31:0/3789029060 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1498+0+0 (secure 0 0 0) 0x7f219003b890 con 0x7f219406a200 2020-06-27T04:40:19.135 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.128+0000 7f2198b66700 1 --2- 172.21.15.31:0/3789029060 >> v2:172.21.15.31:6800/1241213118 conn(0x7f217002ab60 0x7f217002d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:40:19.135 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.129+0000 7f2198b66700 1 --2- 172.21.15.31:0/3789029060 >> v2:172.21.15.31:6800/1241213118 conn(0x7f217002ab60 0x7f217002d020 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f2184002f70 tx=0x7f2184006b20).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:40:19.135 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.129+0000 7f219adca700 1 -- 172.21.15.31:0/3789029060 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2194057340 con 0x7f219406a200 2020-06-27T04:40:19.136 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.133+0000 7f21897fa700 1 -- 172.21.15.31:0/3789029060 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f219001dcf0 con 0x7f219406a200 2020-06-27T04:40:19.290 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.287+0000 7f219adca700 1 -- 172.21.15.31:0/3789029060 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/allow_ptrace", "value": "true"} v 0) v1 -- 0x7f2194043e80 con 0x7f219406a200 2020-06-27T04:40:19.294 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.291+0000 7f21897fa700 1 -- 172.21.15.31:0/3789029060 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/allow_ptrace", "value": "true"}]=0 v7) v1 ==== 125+0+0 (secure 0 0 0) 0x7f21900123d0 con 0x7f219406a200 2020-06-27T04:40:19.295 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.292+0000 7f219adca700 1 -- 172.21.15.31:0/3789029060 >> v2:172.21.15.31:6800/1241213118 conn(0x7f217002ab60 msgr2=0x7f217002d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:19.296 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.292+0000 7f219adca700 1 --2- 172.21.15.31:0/3789029060 >> v2:172.21.15.31:6800/1241213118 conn(0x7f217002ab60 0x7f217002d020 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f2184002f70 tx=0x7f2184006b20).stop 2020-06-27T04:40:19.296 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.292+0000 7f219adca700 1 -- 172.21.15.31:0/3789029060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f219406a200 msgr2=0x7f21940770d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:40:19.296 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.292+0000 7f219adca700 1 --2- 172.21.15.31:0/3789029060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f219406a200 0x7f21940770d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f2190002f10 tx=0x7f2190009b30).stop 2020-06-27T04:40:19.296 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.293+0000 7f219adca700 1 -- 172.21.15.31:0/3789029060 shutdown_connections 2020-06-27T04:40:19.297 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.293+0000 7f219adca700 1 --2- 172.21.15.31:0/3789029060 >> v2:172.21.15.31:6800/1241213118 conn(0x7f217002ab60 0x7f217002d020 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:19.297 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.293+0000 7f219adca700 1 --2- 172.21.15.31:0/3789029060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f219406a200 0x7f21940770d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:40:19.297 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.293+0000 7f219adca700 1 -- 172.21.15.31:0/3789029060 >> 172.21.15.31:0/3789029060 conn(0x7f2194061430 msgr2=0x7f219406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:40:19.297 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.293+0000 7f219adca700 1 -- 172.21.15.31:0/3789029060 shutdown_connections 2020-06-27T04:40:19.299 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:40:19.293+0000 7f219adca700 1 -- 172.21.15.31:0/3789029060 wait complete. 2020-06-27T04:40:19.464 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:19 smithi031 bash[18426]: audit 2020-06-27T04:40:18.363974+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:40:12.053242\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:40:12.053350\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-06-27T04:40:12.053441\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:40:19.464 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:19 smithi031 bash[18426]: audit 2020-06-27T04:40:18.365810+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:40:12.053242\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:40:12.053350\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-06-27T04:40:12.053441\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:40:19.465 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:19 smithi031 bash[18426]: audit 2020-06-27T04:40:18.367889+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-06-27T04:40:19.465 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:19 smithi031 bash[18426]: audit 2020-06-27T04:40:18.368459+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:40:19.465 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:19 smithi031 bash[18426]: audit 2020-06-27T04:40:18.369259+0000 mon.a (mon.0) 113 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-06-27T04:40:19.898 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi051 2020-06-27T04:40:19.899 INFO:teuthology.orchestra.run.smithi051:> cat > /etc/ceph/ceph.conf 2020-06-27T04:40:19.944 INFO:teuthology.orchestra.run.smithi051:> cat > /etc/ceph/ceph.client.admin.keyring 2020-06-27T04:40:20.029 INFO:tasks.cephadm:Adding host smithi051 to orchestrator... 2020-06-27T04:40:20.029 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph orch host add smithi051 2020-06-27T04:40:20.417 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:20 smithi031 bash[18426]: cephadm 2020-06-27T04:40:18.367669+0000 mgr.y (mgr.14142) 5 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2020-06-27T04:40:20.418 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:20 smithi031 bash[18426]: cephadm 2020-06-27T04:40:18.368925+0000 mgr.y (mgr.14142) 6 : cephadm [INF] Reconfiguring daemon mon.a on smithi031 2020-06-27T04:40:20.418 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:20 smithi031 bash[18426]: audit 2020-06-27T04:40:19.288992+0000 mon.a (mon.0) 114 : audit [INF] from='client.? 172.21.15.31:0/3789029060' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/allow_ptrace", "value": "true"}]: dispatch 2020-06-27T04:40:20.418 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:20 smithi031 bash[18426]: audit 2020-06-27T04:40:19.292233+0000 mon.a (mon.0) 115 : audit [INF] from='client.? 172.21.15.31:0/3789029060' entity='client.admin' cmd='[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/allow_ptrace", "value": "true"}]': finished 2020-06-27T04:40:21.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:21 smithi031 bash[18426]: audit 2020-06-27T04:40:21.201428+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:40:12.053350\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:18.367684\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:40:21.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:21 smithi031 bash[18426]: audit 2020-06-27T04:40:21.203315+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:40:12.053350\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:18.367684\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:40:21.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:21 smithi031 bash[18426]: audit 2020-06-27T04:40:21.203787+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2020-06-27T04:40:21.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:21 smithi031 bash[18426]: audit 2020-06-27T04:40:21.204344+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:40:21.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:21 smithi031 bash[18426]: audit 2020-06-27T04:40:21.205133+0000 mon.a (mon.0) 120 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-06-27T04:40:23.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:23 smithi031 bash[18426]: cephadm 2020-06-27T04:40:21.203607+0000 mgr.y (mgr.14142) 7 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2020-06-27T04:40:23.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:23 smithi031 bash[18426]: cephadm 2020-06-27T04:40:21.204794+0000 mgr.y (mgr.14142) 8 : cephadm [INF] Reconfiguring daemon mgr.y on smithi031 2020-06-27T04:40:23.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:23 smithi031 bash[18426]: audit 2020-06-27T04:40:22.487093+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:18.367684\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:40:23.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:23 smithi031 bash[18426]: audit 2020-06-27T04:40:22.491513+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:18.367684\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:40:23.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:23 smithi031 bash[18426]: audit 2020-06-27T04:40:22.492675+0000 mon.a (mon.0) 123 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:40:24.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:24 smithi031 bash[18426]: audit 2020-06-27T04:40:23.106553+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:40:23.105889\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:40:23.105962\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:18.367684\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}}, \"last_daemon_update\": \"2020-06-27T04:40:23.106037\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:40:24.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:24 smithi031 bash[18426]: audit 2020-06-27T04:40:23.108352+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:40:23.105889\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:40:23.105962\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:18.367684\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}}, \"last_daemon_update\": \"2020-06-27T04:40:23.106037\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:40:31.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:31 smithi031 bash[18426]: cluster 2020-06-27T04:40:30.150519+0000 mgr.y (mgr.14142) 9 : cluster [DBG] pgmap v3: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:40:33.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:33 smithi031 bash[18426]: cluster 2020-06-27T04:40:32.150807+0000 mgr.y (mgr.14142) 10 : cluster [DBG] pgmap v4: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:40:34.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:34 smithi031 bash[18426]: cluster 2020-06-27T04:40:34.151162+0000 mgr.y (mgr.14142) 11 : cluster [DBG] pgmap v5: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:40:36.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:36 smithi031 bash[18426]: cluster 2020-06-27T04:40:36.151601+0000 mgr.y (mgr.14142) 12 : cluster [DBG] pgmap v6: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:40:38.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:38 smithi031 bash[18426]: cluster 2020-06-27T04:40:38.151997+0000 mgr.y (mgr.14142) 13 : cluster [DBG] pgmap v7: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:40:40.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:40 smithi031 bash[18426]: cluster 2020-06-27T04:40:40.152437+0000 mgr.y (mgr.14142) 14 : cluster [DBG] pgmap v8: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:40:43.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:43 smithi031 bash[18426]: cluster 2020-06-27T04:40:42.152829+0000 mgr.y (mgr.14142) 15 : cluster [DBG] pgmap v9: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:40:44.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:44 smithi031 bash[18426]: cluster 2020-06-27T04:40:44.153245+0000 mgr.y (mgr.14142) 16 : cluster [DBG] pgmap v10: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:40:46.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:46 smithi031 bash[18426]: cluster 2020-06-27T04:40:46.153625+0000 mgr.y (mgr.14142) 17 : cluster [DBG] pgmap v11: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:40:48.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:48 smithi031 bash[18426]: cluster 2020-06-27T04:40:48.153944+0000 mgr.y (mgr.14142) 18 : cluster [DBG] pgmap v12: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:40:50.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:50 smithi031 bash[18426]: cluster 2020-06-27T04:40:50.154230+0000 mgr.y (mgr.14142) 19 : cluster [DBG] pgmap v13: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:40:53.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:53 smithi031 bash[18426]: cluster 2020-06-27T04:40:52.154584+0000 mgr.y (mgr.14142) 20 : cluster [DBG] pgmap v14: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:40:54.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:54 smithi031 bash[18426]: cluster 2020-06-27T04:40:54.154974+0000 mgr.y (mgr.14142) 21 : cluster [DBG] pgmap v15: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:40:56.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:56 smithi031 bash[18426]: cluster 2020-06-27T04:40:56.155350+0000 mgr.y (mgr.14142) 22 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:40:58.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:40:58 smithi031 bash[18426]: cluster 2020-06-27T04:40:58.155652+0000 mgr.y (mgr.14142) 23 : cluster [DBG] pgmap v17: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:00.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:00 smithi031 bash[18426]: cluster 2020-06-27T04:41:00.156007+0000 mgr.y (mgr.14142) 24 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:03.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:03 smithi031 bash[18426]: cluster 2020-06-27T04:41:02.156330+0000 mgr.y (mgr.14142) 25 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:04.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:04 smithi031 bash[18426]: cluster 2020-06-27T04:41:04.156673+0000 mgr.y (mgr.14142) 26 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:06.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:06 smithi031 bash[18426]: cluster 2020-06-27T04:41:06.157077+0000 mgr.y (mgr.14142) 27 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:08.378 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.374+0000 7f8863d59700 1 Processor -- start 2020-06-27T04:41:08.379 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.374+0000 7f8863d59700 1 -- start start 2020-06-27T04:41:08.379 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.374+0000 7f8863d59700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f885c0699e0 0x7f885c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:08.379 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.374+0000 7f8863d59700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c06a450 con 0x7f885c0699e0 2020-06-27T04:41:08.379 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.374+0000 7f88622f6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f885c0699e0 0x7f885c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:08.380 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.374+0000 7f88622f6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f885c0699e0 0x7f885c069e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.51:34144/0 (socket says 172.21.15.51:34144) 2020-06-27T04:41:08.380 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.374+0000 7f88622f6700 1 -- 172.21.15.51:0/3110682364 learned_addr learned my addr 172.21.15.51:0/3110682364 (peer_addr_for_me v2:172.21.15.51:0/0) 2020-06-27T04:41:08.380 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.375+0000 7f88622f6700 1 -- 172.21.15.51:0/3110682364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c0734c0 con 0x7f885c0699e0 2020-06-27T04:41:08.380 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.375+0000 7f88622f6700 1 --2- 172.21.15.51:0/3110682364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f885c0699e0 0x7f885c069e00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8858002f10 tx=0x7f8858009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:08.380 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.375+0000 7f88527fc700 1 -- 172.21.15.51:0/3110682364 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f885800e030 con 0x7f885c0699e0 2020-06-27T04:41:08.381 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.375+0000 7f8863d59700 1 -- 172.21.15.51:0/3110682364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c073710 con 0x7f885c0699e0 2020-06-27T04:41:08.381 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.375+0000 7f88527fc700 1 -- 172.21.15.51:0/3110682364 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f8858013ac0 con 0x7f885c0699e0 2020-06-27T04:41:08.381 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.375+0000 7f88527fc700 1 -- 172.21.15.51:0/3110682364 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f8858018070 con 0x7f885c0699e0 2020-06-27T04:41:08.381 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.375+0000 7f8863d59700 1 -- 172.21.15.51:0/3110682364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885c073ba0 con 0x7f885c0699e0 2020-06-27T04:41:08.383 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.376+0000 7f88527fc700 1 -- 172.21.15.51:0/3110682364 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f8858013c30 con 0x7f885c0699e0 2020-06-27T04:41:08.383 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.376+0000 7f88527fc700 1 --2- 172.21.15.51:0/3110682364 >> v2:172.21.15.31:6800/1241213118 conn(0x7f883802ab60 0x7f883802d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:08.384 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.376+0000 7f88527fc700 1 -- 172.21.15.51:0/3110682364 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1498+0+0 (secure 0 0 0) 0x7f885803b8a0 con 0x7f885c0699e0 2020-06-27T04:41:08.384 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.376+0000 7f8863d59700 1 -- 172.21.15.51:0/3110682364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885c057340 con 0x7f885c0699e0 2020-06-27T04:41:08.384 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.376+0000 7f8861af5700 1 --2- 172.21.15.51:0/3110682364 >> v2:172.21.15.31:6800/1241213118 conn(0x7f883802ab60 0x7f883802d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:08.388 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.377+0000 7f8861af5700 1 --2- 172.21.15.51:0/3110682364 >> v2:172.21.15.31:6800/1241213118 conn(0x7f883802ab60 0x7f883802d020 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f884c002f70 tx=0x7f884c006b20).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:08.389 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.380+0000 7f88527fc700 1 -- 172.21.15.51:0/3110682364 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f8858013680 con 0x7f885c0699e0 2020-06-27T04:41:08.558 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:08.555+0000 7f8863d59700 1 -- 172.21.15.51:0/3110682364 --> v2:172.21.15.31:6800/1241213118 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi051", "target": ["mon-mgr", ""]}) v1 -- 0x7f885c06a590 con 0x7f883802ab60 2020-06-27T04:41:08.592 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:08 smithi031 bash[18426]: cluster 2020-06-27T04:41:08.157358+0000 mgr.y (mgr.14142) 28 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:08.972 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:41:08 smithi031 bash[18687]: Warning: Permanently added 'smithi051,172.21.15.51' (ECDSA) to the list of known hosts. 2020-06-27T04:41:09.152 INFO:teuthology.orchestra.run.smithi051.stdout:Added host 'smithi051' 2020-06-27T04:41:09.153 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:09.147+0000 7f88527fc700 1 -- 172.21.15.51:0/3110682364 <== mgr.14142 v2:172.21.15.31:6800/1241213118 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7f884c00c070 con 0x7f883802ab60 2020-06-27T04:41:09.154 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:09.150+0000 7f8863d59700 1 -- 172.21.15.51:0/3110682364 >> v2:172.21.15.31:6800/1241213118 conn(0x7f883802ab60 msgr2=0x7f883802d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:09.154 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:09.150+0000 7f8863d59700 1 --2- 172.21.15.51:0/3110682364 >> v2:172.21.15.31:6800/1241213118 conn(0x7f883802ab60 0x7f883802d020 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f884c002f70 tx=0x7f884c006b20).stop 2020-06-27T04:41:09.154 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:09.150+0000 7f8863d59700 1 -- 172.21.15.51:0/3110682364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f885c0699e0 msgr2=0x7f885c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:09.155 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:09.150+0000 7f8863d59700 1 --2- 172.21.15.51:0/3110682364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f885c0699e0 0x7f885c069e00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8858002f10 tx=0x7f8858009b30).stop 2020-06-27T04:41:09.155 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:09.150+0000 7f8863d59700 1 -- 172.21.15.51:0/3110682364 shutdown_connections 2020-06-27T04:41:09.155 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:09.150+0000 7f8863d59700 1 --2- 172.21.15.51:0/3110682364 >> v2:172.21.15.31:6800/1241213118 conn(0x7f883802ab60 0x7f883802d020 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:09.155 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:09.150+0000 7f8863d59700 1 --2- 172.21.15.51:0/3110682364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f885c0699e0 0x7f885c069e00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:09.155 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:09.150+0000 7f8863d59700 1 -- 172.21.15.51:0/3110682364 >> 172.21.15.51:0/3110682364 conn(0x7f885c061430 msgr2=0x7f885c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:41:09.155 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:09.150+0000 7f8863d59700 1 -- 172.21.15.51:0/3110682364 shutdown_connections 2020-06-27T04:41:09.156 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:09.150+0000 7f8863d59700 1 -- 172.21.15.51:0/3110682364 wait complete. 2020-06-27T04:41:09.609 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:09 smithi031 bash[18426]: audit 2020-06-27T04:41:08.557763+0000 mgr.y (mgr.14142) 29 : audit [DBG] from='client.14163 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi051", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:41:09.609 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:09 smithi031 bash[18426]: audit 2020-06-27T04:41:09.144973+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi031\": {\"hostname\": \"smithi031\", \"addr\": \"smithi031\", \"labels\": [], \"status\": \"\"}, \"smithi051\": {\"hostname\": \"smithi051\", \"addr\": \"smithi051\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2020-06-27T04:41:09.609 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:09 smithi031 bash[18426]: audit 2020-06-27T04:41:09.147343+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi031\": {\"hostname\": \"smithi031\", \"addr\": \"smithi031\", \"labels\": [], \"status\": \"\"}, \"smithi051\": {\"hostname\": \"smithi051\", \"addr\": \"smithi051\", \"labels\": [], \"status\": \"\"}}"}]': finished 2020-06-27T04:41:09.610 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:09 smithi031 bash[18426]: cephadm 2020-06-27T04:41:09.147800+0000 mgr.y (mgr.14142) 30 : cephadm [INF] Added host smithi051 2020-06-27T04:41:09.610 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:09 smithi031 bash[18426]: audit 2020-06-27T04:41:09.149588+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:41:09.693 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph orch host ls --format=json 2020-06-27T04:41:10.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:10 smithi031 bash[18426]: audit 2020-06-27T04:41:09.415307+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:10.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:10 smithi031 bash[18426]: audit 2020-06-27T04:41:09.417913+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:10.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:10 smithi031 bash[18426]: audit 2020-06-27T04:41:09.418387+0000 mon.a (mon.0) 131 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:41:10.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:10 smithi031 bash[18426]: audit 2020-06-27T04:41:09.656001+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-06-27T04:41:09.655649\", \"networks\": {}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:10.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:10 smithi031 bash[18426]: audit 2020-06-27T04:41:09.657799+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-06-27T04:41:09.655649\", \"networks\": {}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:10.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:10 smithi031 bash[18426]: audit 2020-06-27T04:41:09.658225+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:41:10.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:10 smithi031 bash[18426]: audit 2020-06-27T04:41:09.805495+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:09.804773\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:09.804876\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:18.367684\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}}, \"last_daemon_update\": \"2020-06-27T04:41:09.804962\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:10.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:10 smithi031 bash[18426]: audit 2020-06-27T04:41:09.807344+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:09.804773\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:09.804876\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:18.367684\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}}, \"last_daemon_update\": \"2020-06-27T04:41:09.804962\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:10.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:10 smithi031 bash[18426]: cluster 2020-06-27T04:41:10.157648+0000 mgr.y (mgr.14142) 31 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:11.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:11 smithi031 bash[18426]: cluster 2020-06-27T04:41:10.806108+0000 mon.a (mon.0) 137 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2020-06-27T04:41:11.895 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.890+0000 7f647922d700 1 Processor -- start 2020-06-27T04:41:11.895 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.891+0000 7f647922d700 1 -- start start 2020-06-27T04:41:11.895 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.891+0000 7f647922d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64740742c0 0x7f6474078840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:11.895 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.891+0000 7f647922d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64740746e0 con 0x7f64740742c0 2020-06-27T04:41:11.896 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.891+0000 7f6478a2c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64740742c0 0x7f6474078840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:11.896 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.891+0000 7f6478a2c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64740742c0 0x7f6474078840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.51:34150/0 (socket says 172.21.15.51:34150) 2020-06-27T04:41:11.896 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.891+0000 7f6478a2c700 1 -- 172.21.15.51:0/3421413166 learned_addr learned my addr 172.21.15.51:0/3421413166 (peer_addr_for_me v2:172.21.15.51:0/0) 2020-06-27T04:41:11.896 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.891+0000 7f6478a2c700 1 -- 172.21.15.51:0/3421413166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6474074820 con 0x7f64740742c0 2020-06-27T04:41:11.896 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.892+0000 7f6478a2c700 1 --2- 172.21.15.51:0/3421413166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64740742c0 0x7f6474078840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6468002f10 tx=0x7f6468009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:11.898 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.892+0000 7f6470ff9700 1 -- 172.21.15.51:0/3421413166 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f646800e030 con 0x7f64740742c0 2020-06-27T04:41:11.898 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.892+0000 7f6470ff9700 1 -- 172.21.15.51:0/3421413166 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f6468013ac0 con 0x7f64740742c0 2020-06-27T04:41:11.901 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.892+0000 7f647922d700 1 -- 172.21.15.51:0/3421413166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6474074a70 con 0x7f64740742c0 2020-06-27T04:41:11.902 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.892+0000 7f6470ff9700 1 -- 172.21.15.51:0/3421413166 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6468018070 con 0x7f64740742c0 2020-06-27T04:41:11.902 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.892+0000 7f647922d700 1 -- 172.21.15.51:0/3421413166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64740755f0 con 0x7f64740742c0 2020-06-27T04:41:11.902 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.893+0000 7f6470ff9700 1 -- 172.21.15.51:0/3421413166 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f646801d800 con 0x7f64740742c0 2020-06-27T04:41:11.902 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.893+0000 7f6470ff9700 1 --2- 172.21.15.51:0/3421413166 >> v2:172.21.15.31:6800/1241213118 conn(0x7f645002abb0 0x7f645002d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:11.902 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.893+0000 7f6470ff9700 1 -- 172.21.15.51:0/3421413166 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1498+0+0 (secure 0 0 0) 0x7f646803c440 con 0x7f64740742c0 2020-06-27T04:41:11.903 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.893+0000 7f6473fff700 1 --2- 172.21.15.51:0/3421413166 >> v2:172.21.15.31:6800/1241213118 conn(0x7f645002abb0 0x7f645002d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:11.903 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.893+0000 7f647922d700 1 -- 172.21.15.51:0/3421413166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6474057340 con 0x7f64740742c0 2020-06-27T04:41:11.903 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.894+0000 7f6473fff700 1 --2- 172.21.15.51:0/3421413166 >> v2:172.21.15.31:6800/1241213118 conn(0x7f645002abb0 0x7f645002d070 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f6460002f70 tx=0x7f6460006b20).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:11.904 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:11.898+0000 7f6470ff9700 1 -- 172.21.15.51:0/3421413166 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f646801dae0 con 0x7f64740742c0 2020-06-27T04:41:12.092 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:12.088+0000 7f647922d700 1 -- 172.21.15.51:0/3421413166 --> v2:172.21.15.31:6800/1241213118 -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6474074f00 con 0x7f645002abb0 2020-06-27T04:41:12.093 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:12.090+0000 7f6470ff9700 1 -- 172.21.15.51:0/3421413166 <== mgr.14142 v2:172.21.15.31:6800/1241213118 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+153 (secure 0 0 0) 0x7f6474074f00 con 0x7f645002abb0 2020-06-27T04:41:12.094 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:41:12.094 INFO:teuthology.orchestra.run.smithi051.stdout:[{"addr": "smithi031", "hostname": "smithi031", "labels": [], "status": ""}, {"addr": "smithi051", "hostname": "smithi051", "labels": [], "status": ""}] 2020-06-27T04:41:12.095 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:12.092+0000 7f647922d700 1 -- 172.21.15.51:0/3421413166 >> v2:172.21.15.31:6800/1241213118 conn(0x7f645002abb0 msgr2=0x7f645002d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:12.095 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:12.092+0000 7f647922d700 1 --2- 172.21.15.51:0/3421413166 >> v2:172.21.15.31:6800/1241213118 conn(0x7f645002abb0 0x7f645002d070 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f6460002f70 tx=0x7f6460006b20).stop 2020-06-27T04:41:12.095 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:12.092+0000 7f647922d700 1 -- 172.21.15.51:0/3421413166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64740742c0 msgr2=0x7f6474078840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:12.096 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:12.092+0000 7f647922d700 1 --2- 172.21.15.51:0/3421413166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64740742c0 0x7f6474078840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6468002f10 tx=0x7f6468009b30).stop 2020-06-27T04:41:12.096 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:12.092+0000 7f647922d700 1 -- 172.21.15.51:0/3421413166 shutdown_connections 2020-06-27T04:41:12.096 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:12.092+0000 7f647922d700 1 --2- 172.21.15.51:0/3421413166 >> v2:172.21.15.31:6800/1241213118 conn(0x7f645002abb0 0x7f645002d070 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:12.096 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:12.092+0000 7f647922d700 1 --2- 172.21.15.51:0/3421413166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64740742c0 0x7f6474078840 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:12.096 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:12.092+0000 7f647922d700 1 -- 172.21.15.51:0/3421413166 >> 172.21.15.51:0/3421413166 conn(0x7f6474025510 msgr2=0x7f64740640a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:41:12.097 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:12.092+0000 7f647922d700 1 -- 172.21.15.51:0/3421413166 shutdown_connections 2020-06-27T04:41:12.097 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:12.092+0000 7f647922d700 1 -- 172.21.15.51:0/3421413166 wait complete. 2020-06-27T04:41:12.707 INFO:tasks.cephadm:Setting crush tunables to default 2020-06-27T04:41:12.708 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph osd crush tunables default 2020-06-27T04:41:13.450 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:13 smithi031 bash[18426]: audit 2020-06-27T04:41:12.090982+0000 mgr.y (mgr.14142) 32 : audit [DBG] from='client.14165 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-06-27T04:41:13.450 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:13 smithi031 bash[18426]: cluster 2020-06-27T04:41:12.158015+0000 mgr.y (mgr.14142) 33 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:14.089 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:41:13 smithi031 bash[18687]: debug 2020-06-27T04:41:13.791+0000 7f9cf2c9f700 -1 ceph_set_health_checks check CEPHADM_REFRESH_FAILED detail item 0 not a [unicode] string 2020-06-27T04:41:14.371 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.367+0000 7f8f9b457700 1 Processor -- start 2020-06-27T04:41:14.372 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.367+0000 7f8f9b457700 1 -- start start 2020-06-27T04:41:14.372 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.367+0000 7f8f9b457700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f94072120 0x7f8f94072540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:14.372 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.367+0000 7f8f9b457700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f94072b90 con 0x7f8f94072120 2020-06-27T04:41:14.372 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.368+0000 7f8f999f4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f94072120 0x7f8f94072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:14.372 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.368+0000 7f8f999f4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f94072120 0x7f8f94072540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38692/0 (socket says 172.21.15.31:38692) 2020-06-27T04:41:14.373 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.368+0000 7f8f999f4700 1 -- 172.21.15.31:0/3019296780 learned_addr learned my addr 172.21.15.31:0/3019296780 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:41:14.373 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.368+0000 7f8f999f4700 1 -- 172.21.15.31:0/3019296780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f940734a0 con 0x7f8f94072120 2020-06-27T04:41:14.373 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.368+0000 7f8f999f4700 1 --2- 172.21.15.31:0/3019296780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f94072120 0x7f8f94072540 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f8f90002f10 tx=0x7f8f90009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:14.373 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.368+0000 7f8f89ffb700 1 -- 172.21.15.31:0/3019296780 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f8f9000e030 con 0x7f8f94072120 2020-06-27T04:41:14.373 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.368+0000 7f8f89ffb700 1 -- 172.21.15.31:0/3019296780 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f8f90013ac0 con 0x7f8f94072120 2020-06-27T04:41:14.373 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.368+0000 7f8f9b457700 1 -- 172.21.15.31:0/3019296780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f940736f0 con 0x7f8f94072120 2020-06-27T04:41:14.374 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.368+0000 7f8f89ffb700 1 -- 172.21.15.31:0/3019296780 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f8f90018070 con 0x7f8f94072120 2020-06-27T04:41:14.374 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.368+0000 7f8f9b457700 1 -- 172.21.15.31:0/3019296780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f94073b80 con 0x7f8f94072120 2020-06-27T04:41:14.375 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.369+0000 7f8f89ffb700 1 -- 172.21.15.31:0/3019296780 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f8f9001d9c0 con 0x7f8f94072120 2020-06-27T04:41:14.375 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.369+0000 7f8f89ffb700 1 --2- 172.21.15.31:0/3019296780 >> v2:172.21.15.31:6800/1241213118 conn(0x7f8f7002abb0 0x7f8f7002d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:14.375 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.369+0000 7f8f89ffb700 1 -- 172.21.15.31:0/3019296780 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1498+0+0 (secure 0 0 0) 0x7f8f9003b830 con 0x7f8f94072120 2020-06-27T04:41:14.375 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.369+0000 7f8f991f3700 1 --2- 172.21.15.31:0/3019296780 >> v2:172.21.15.31:6800/1241213118 conn(0x7f8f7002abb0 0x7f8f7002d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:14.376 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.369+0000 7f8f9b457700 1 -- 172.21.15.31:0/3019296780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f94072cd0 con 0x7f8f94072120 2020-06-27T04:41:14.376 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.370+0000 7f8f991f3700 1 --2- 172.21.15.31:0/3019296780 >> v2:172.21.15.31:6800/1241213118 conn(0x7f8f7002abb0 0x7f8f7002d070 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8f84002f70 tx=0x7f8f84006b20).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:14.376 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.373+0000 7f8f89ffb700 1 -- 172.21.15.31:0/3019296780 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f8f90013680 con 0x7f8f94072120 2020-06-27T04:41:14.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:14 smithi031 bash[18426]: audit 2020-06-27T04:41:13.542464+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:41:14.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:14 smithi031 bash[18426]: audit 2020-06-27T04:41:13.787907+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-06-27T04:41:09.655649\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:14.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:14 smithi031 bash[18426]: audit 2020-06-27T04:41:13.789754+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-06-27T04:41:09.655649\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:14.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:14 smithi031 bash[18426]: audit 2020-06-27T04:41:13.790404+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-06-27T04:41:09.655649\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:14.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:14 smithi031 bash[18426]: audit 2020-06-27T04:41:13.792522+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-06-27T04:41:09.655649\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:14.534 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:14.531+0000 7f8f9b457700 1 -- 172.21.15.31:0/3019296780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f8f94057340 con 0x7f8f94072120 2020-06-27T04:41:15.094 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:15.091+0000 7f8f89ffb700 1 -- 172.21.15.31:0/3019296780 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v6) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8f90012bc0 con 0x7f8f94072120 2020-06-27T04:41:15.095 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:15.092+0000 7f8f9b457700 1 -- 172.21.15.31:0/3019296780 >> v2:172.21.15.31:6800/1241213118 conn(0x7f8f7002abb0 msgr2=0x7f8f7002d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:15.096 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:15.092+0000 7f8f9b457700 1 --2- 172.21.15.31:0/3019296780 >> v2:172.21.15.31:6800/1241213118 conn(0x7f8f7002abb0 0x7f8f7002d070 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8f84002f70 tx=0x7f8f84006b20).stop 2020-06-27T04:41:15.096 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:15.092+0000 7f8f9b457700 1 -- 172.21.15.31:0/3019296780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f94072120 msgr2=0x7f8f94072540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:15.096 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:15.092+0000 7f8f9b457700 1 --2- 172.21.15.31:0/3019296780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f94072120 0x7f8f94072540 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f8f90002f10 tx=0x7f8f90009b30).stop 2020-06-27T04:41:15.096 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:15.092+0000 7f8f9b457700 1 -- 172.21.15.31:0/3019296780 shutdown_connections 2020-06-27T04:41:15.096 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:15.092+0000 7f8f9b457700 1 --2- 172.21.15.31:0/3019296780 >> v2:172.21.15.31:6800/1241213118 conn(0x7f8f7002abb0 0x7f8f7002d070 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:15.097 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:15.092+0000 7f8f9b457700 1 --2- 172.21.15.31:0/3019296780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f94072120 0x7f8f94072540 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:15.097 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:15.092+0000 7f8f9b457700 1 -- 172.21.15.31:0/3019296780 >> 172.21.15.31:0/3019296780 conn(0x7f8f94061430 msgr2=0x7f8f94069960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:41:15.097 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:15.092+0000 7f8f9b457700 1 -- 172.21.15.31:0/3019296780 shutdown_connections 2020-06-27T04:41:15.097 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:15.093+0000 7f8f9b457700 1 -- 172.21.15.31:0/3019296780 wait complete. 2020-06-27T04:41:15.098 INFO:teuthology.orchestra.run.smithi031.stderr:adjusted tunables profile to default 2020-06-27T04:41:15.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:15 smithi031 bash[18426]: cluster 2020-06-27T04:41:13.792960+0000 mgr.y (mgr.14142) 34 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:15.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:15 smithi031 bash[18426]: audit 2020-06-27T04:41:14.532459+0000 mon.a (mon.0) 143 : audit [INF] from='client.? 172.21.15.31:0/3019296780' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2020-06-27T04:41:15.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:15 smithi031 bash[18426]: cluster 2020-06-27T04:41:14.791700+0000 mon.a (mon.0) 144 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2020-06-27T04:41:15.712 INFO:tasks.cephadm:Adding mon.c on smithi031 2020-06-27T04:41:15.712 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph orch daemon add mon 'smithi031:[v2:172.21.15.31:3301,v1:172.21.15.31:6790]=c' 2020-06-27T04:41:16.449 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:16 smithi031 bash[18426]: audit 2020-06-27T04:41:15.092106+0000 mon.a (mon.0) 145 : audit [INF] from='client.? 172.21.15.31:0/3019296780' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2020-06-27T04:41:16.450 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:16 smithi031 bash[18426]: cluster 2020-06-27T04:41:15.092145+0000 mon.a (mon.0) 146 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2020-06-27T04:41:17.182 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:17 smithi031 bash[18426]: cluster 2020-06-27T04:41:15.793296+0000 mgr.y (mgr.14142) 35 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:17.399 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.395+0000 7f1e4abe1700 1 Processor -- start 2020-06-27T04:41:17.399 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.395+0000 7f1e4abe1700 1 -- start start 2020-06-27T04:41:17.399 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.395+0000 7f1e4abe1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e44071fc0 0x7f1e440723e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:17.400 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.395+0000 7f1e4abe1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e44072960 con 0x7f1e44071fc0 2020-06-27T04:41:17.400 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.395+0000 7f1e4a3e0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e44071fc0 0x7f1e440723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:17.400 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.395+0000 7f1e4a3e0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e44071fc0 0x7f1e440723e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38698/0 (socket says 172.21.15.31:38698) 2020-06-27T04:41:17.400 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.395+0000 7f1e4a3e0700 1 -- 172.21.15.31:0/384227328 learned_addr learned my addr 172.21.15.31:0/384227328 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:41:17.400 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.395+0000 7f1e4a3e0700 1 -- 172.21.15.31:0/384227328 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e44072aa0 con 0x7f1e44071fc0 2020-06-27T04:41:17.401 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.395+0000 7f1e4a3e0700 1 --2- 172.21.15.31:0/384227328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e44071fc0 0x7f1e440723e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f1e40002f10 tx=0x7f1e40009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:17.401 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.396+0000 7f1e3a7fc700 1 -- 172.21.15.31:0/384227328 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f1e4000e030 con 0x7f1e44071fc0 2020-06-27T04:41:17.401 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.396+0000 7f1e4abe1700 1 -- 172.21.15.31:0/384227328 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e44073390 con 0x7f1e44071fc0 2020-06-27T04:41:17.401 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.396+0000 7f1e3a7fc700 1 -- 172.21.15.31:0/384227328 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f1e40013ac0 con 0x7f1e44071fc0 2020-06-27T04:41:17.401 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.396+0000 7f1e3a7fc700 1 -- 172.21.15.31:0/384227328 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f1e40018070 con 0x7f1e44071fc0 2020-06-27T04:41:17.402 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.396+0000 7f1e4abe1700 1 -- 172.21.15.31:0/384227328 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e44073850 con 0x7f1e44071fc0 2020-06-27T04:41:17.402 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.396+0000 7f1e3a7fc700 1 -- 172.21.15.31:0/384227328 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f1e4001d9e0 con 0x7f1e44071fc0 2020-06-27T04:41:17.403 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.396+0000 7f1e3a7fc700 1 --2- 172.21.15.31:0/384227328 >> v2:172.21.15.31:6800/1241213118 conn(0x7f1e2002ab60 0x7f1e2002d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:17.403 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.396+0000 7f1e3a7fc700 1 -- 172.21.15.31:0/384227328 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1498+0+0 (secure 0 0 0) 0x7f1e4003b820 con 0x7f1e44071fc0 2020-06-27T04:41:17.403 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.397+0000 7f1e49bdf700 1 --2- 172.21.15.31:0/384227328 >> v2:172.21.15.31:6800/1241213118 conn(0x7f1e2002ab60 0x7f1e2002d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:17.403 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.397+0000 7f1e4abe1700 1 -- 172.21.15.31:0/384227328 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e44057340 con 0x7f1e44071fc0 2020-06-27T04:41:17.404 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.397+0000 7f1e49bdf700 1 --2- 172.21.15.31:0/384227328 >> v2:172.21.15.31:6800/1241213118 conn(0x7f1e2002ab60 0x7f1e2002d020 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f1e34002f70 tx=0x7f1e34006b20).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:17.404 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.400+0000 7f1e3a7fc700 1 -- 172.21.15.31:0/384227328 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f1e40012c30 con 0x7f1e44071fc0 2020-06-27T04:41:17.587 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:17.584+0000 7f1e4abe1700 1 -- 172.21.15.31:0/384227328 --> v2:172.21.15.31:6800/1241213118 -- mgr_command(tid 0: {"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi031:[v2:172.21.15.31:3301,v1:172.21.15.31:6790]=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e44043e80 con 0x7f1e2002ab60 2020-06-27T04:41:18.382 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:18 smithi031 bash[18426]: audit 2020-06-27T04:41:17.587507+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-06-27T04:41:18.383 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:18 smithi031 bash[18426]: audit 2020-06-27T04:41:17.588089+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:18.383 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:18 smithi031 bash[18426]: audit 2020-06-27T04:41:17.588734+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2020-06-27T04:41:19.424 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:19 smithi031 bash[18426]: audit 2020-06-27T04:41:17.585952+0000 mgr.y (mgr.14142) 36 : audit [DBG] from='client.14169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi031:[v2:172.21.15.31:3301,v1:172.21.15.31:6790]=c", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:41:19.424 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:19 smithi031 bash[18426]: cephadm 2020-06-27T04:41:17.588506+0000 mgr.y (mgr.14142) 37 : cephadm [INF] Deploying daemon mon.c on smithi031 2020-06-27T04:41:19.424 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:19 smithi031 bash[18426]: cluster 2020-06-27T04:41:17.793577+0000 mgr.y (mgr.14142) 38 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:20.277 INFO:teuthology.orchestra.run.smithi031.stdout:Deployed mon.c on host 'smithi031' 2020-06-27T04:41:20.278 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:20.273+0000 7f1e3a7fc700 1 -- 172.21.15.31:0/384227328 <== mgr.14142 v2:172.21.15.31:6800/1241213118 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+35 (secure 0 0 0) 0x7f1e44043e80 con 0x7f1e2002ab60 2020-06-27T04:41:20.279 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:20.275+0000 7f1e4abe1700 1 -- 172.21.15.31:0/384227328 >> v2:172.21.15.31:6800/1241213118 conn(0x7f1e2002ab60 msgr2=0x7f1e2002d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:20.279 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:20.275+0000 7f1e4abe1700 1 --2- 172.21.15.31:0/384227328 >> v2:172.21.15.31:6800/1241213118 conn(0x7f1e2002ab60 0x7f1e2002d020 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f1e34002f70 tx=0x7f1e34006b20).stop 2020-06-27T04:41:20.279 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:20.276+0000 7f1e4abe1700 1 -- 172.21.15.31:0/384227328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e44071fc0 msgr2=0x7f1e440723e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:20.280 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:20.276+0000 7f1e4abe1700 1 --2- 172.21.15.31:0/384227328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e44071fc0 0x7f1e440723e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f1e40002f10 tx=0x7f1e40009b30).stop 2020-06-27T04:41:20.280 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:20.276+0000 7f1e4abe1700 1 -- 172.21.15.31:0/384227328 shutdown_connections 2020-06-27T04:41:20.280 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:20.276+0000 7f1e4abe1700 1 --2- 172.21.15.31:0/384227328 >> v2:172.21.15.31:6800/1241213118 conn(0x7f1e2002ab60 0x7f1e2002d020 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:20.280 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:20.276+0000 7f1e4abe1700 1 --2- 172.21.15.31:0/384227328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e44071fc0 0x7f1e440723e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:20.280 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:20.276+0000 7f1e4abe1700 1 -- 172.21.15.31:0/384227328 >> 172.21.15.31:0/384227328 conn(0x7f1e44025510 msgr2=0x7f1e44064030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:41:20.281 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:20.276+0000 7f1e4abe1700 1 -- 172.21.15.31:0/384227328 shutdown_connections 2020-06-27T04:41:20.281 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:20.276+0000 7f1e4abe1700 1 -- 172.21.15.31:0/384227328 wait complete. 2020-06-27T04:41:20.823 INFO:teuthology.orchestra.run.smithi031:mon.c> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mon.c.service 2020-06-27T04:41:20.826 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2020-06-27T04:41:20.827 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph mon dump -f json 2020-06-27T04:41:20.860 INFO:ceph.mon.c.smithi031.stdout:-- Logs begin at Sat 2020-06-27 04:33:08 UTC. -- 2020-06-27T04:41:21.373 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[18426]: cluster 2020-06-27T04:41:19.793927+0000 mgr.y (mgr.14142) 39 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:21.373 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[18426]: audit 2020-06-27T04:41:20.271391+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:09.804773\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:09.804876\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:18.367684\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:21.373 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[18426]: audit 2020-06-27T04:41:20.271822+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:41:21.374 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[18426]: audit 2020-06-27T04:41:20.273416+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:09.804773\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:09.804876\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:18.367684\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:21.374 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 podman[22636]: 2020-06-27 04:41:21.118946405 +0000 UTC m=+0.772898617 container create 5fcf9eda8bfde47124c094c6679466d812ce896217a6c72e11edac086ddd0cdd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.c) 2020-06-27T04:41:21.665 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 podman[22636]: 2020-06-27 04:41:21.399252149 +0000 UTC m=+1.053204371 container init 5fcf9eda8bfde47124c094c6679466d812ce896217a6c72e11edac086ddd0cdd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.c) 2020-06-27T04:41:21.666 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 podman[22636]: 2020-06-27 04:41:21.44660404 +0000 UTC m=+1.100556168 container start 5fcf9eda8bfde47124c094c6679466d812ce896217a6c72e11edac086ddd0cdd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.c) 2020-06-27T04:41:21.666 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 podman[22636]: 2020-06-27 04:41:21.446679394 +0000 UTC m=+1.100631512 container attach 5fcf9eda8bfde47124c094c6679466d812ce896217a6c72e11edac086ddd0cdd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.c) 2020-06-27T04:41:21.666 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.423+0000 7f2fc78e8700 0 set uid:gid to 167:167 (ceph:ceph) 2020-06-27T04:41:21.666 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.423+0000 7f2fc78e8700 0 ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev), process ceph-mon, pid 1 2020-06-27T04:41:21.667 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.424+0000 7f2fc78e8700 0 pidfile_write: ignore empty --pid-file 2020-06-27T04:41:21.667 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 0 load: jerasure load: lrc load: isa 2020-06-27T04:41:21.667 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: RocksDB version: 6.8.1 2020-06-27T04:41:21.667 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2020-06-27T04:41:21.667 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Compile date Jun 26 2020 2020-06-27T04:41:21.667 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: DB SUMMARY 2020-06-27T04:41:21.668 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: CURRENT file: CURRENT 2020-06-27T04:41:21.668 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: IDENTITY file: IDENTITY 2020-06-27T04:41:21.668 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2020-06-27T04:41:21.668 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2020-06-27T04:41:21.668 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000003.log size: 489 ; 2020-06-27T04:41:21.669 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.error_if_exists: 0 2020-06-27T04:41:21.669 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.create_if_missing: 0 2020-06-27T04:41:21.669 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.paranoid_checks: 1 2020-06-27T04:41:21.669 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.env: 0x55a8b0574720 2020-06-27T04:41:21.669 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.fs: Posix File System 2020-06-27T04:41:21.670 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.info_log: 0x55a8b130c300 2020-06-27T04:41:21.670 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.max_file_opening_threads: 16 2020-06-27T04:41:21.670 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.statistics: (nil) 2020-06-27T04:41:21.670 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.use_fsync: 0 2020-06-27T04:41:21.670 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.max_log_file_size: 0 2020-06-27T04:41:21.671 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2020-06-27T04:41:21.671 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.log_file_time_to_roll: 0 2020-06-27T04:41:21.671 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.keep_log_file_num: 1000 2020-06-27T04:41:21.671 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.recycle_log_file_num: 0 2020-06-27T04:41:21.671 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.allow_fallocate: 1 2020-06-27T04:41:21.671 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.allow_mmap_reads: 0 2020-06-27T04:41:21.672 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.allow_mmap_writes: 0 2020-06-27T04:41:21.672 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.use_direct_reads: 0 2020-06-27T04:41:21.672 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2020-06-27T04:41:21.672 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.create_missing_column_families: 0 2020-06-27T04:41:21.672 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.db_log_dir: 2020-06-27T04:41:21.673 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2020-06-27T04:41:21.673 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.table_cache_numshardbits: 6 2020-06-27T04:41:21.673 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.max_subcompactions: 1 2020-06-27T04:41:21.673 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.max_background_flushes: -1 2020-06-27T04:41:21.673 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.WAL_ttl_seconds: 0 2020-06-27T04:41:21.674 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.WAL_size_limit_MB: 0 2020-06-27T04:41:21.674 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2020-06-27T04:41:21.674 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2020-06-27T04:41:21.674 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.is_fd_close_on_exec: 1 2020-06-27T04:41:21.674 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.advise_random_on_open: 1 2020-06-27T04:41:21.674 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.db_write_buffer_size: 0 2020-06-27T04:41:21.675 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.write_buffer_manager: 0x55a8b13592f0 2020-06-27T04:41:21.675 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2020-06-27T04:41:21.675 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2020-06-27T04:41:21.677 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2020-06-27T04:41:21.677 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.use_adaptive_mutex: 0 2020-06-27T04:41:21.678 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.rate_limiter: (nil) 2020-06-27T04:41:21.678 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2020-06-27T04:41:21.678 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.wal_recovery_mode: 2 2020-06-27T04:41:21.678 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.enable_thread_tracking: 0 2020-06-27T04:41:21.678 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.enable_pipelined_write: 0 2020-06-27T04:41:21.679 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.unordered_write: 0 2020-06-27T04:41:21.679 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2020-06-27T04:41:21.679 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2020-06-27T04:41:21.679 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2020-06-27T04:41:21.679 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2020-06-27T04:41:21.680 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.row_cache: None 2020-06-27T04:41:21.680 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.wal_filter: None 2020-06-27T04:41:21.680 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2020-06-27T04:41:21.680 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.allow_ingest_behind: 0 2020-06-27T04:41:21.680 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.preserve_deletes: 0 2020-06-27T04:41:21.680 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.two_write_queues: 0 2020-06-27T04:41:21.681 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.manual_wal_flush: 0 2020-06-27T04:41:21.681 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.atomic_flush: 0 2020-06-27T04:41:21.681 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2020-06-27T04:41:21.681 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.persist_stats_to_disk: 0 2020-06-27T04:41:21.681 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.write_dbid_to_manifest: 0 2020-06-27T04:41:21.682 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.log_readahead_size: 0 2020-06-27T04:41:21.682 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2020-06-27T04:41:21.682 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.max_background_jobs: 2 2020-06-27T04:41:21.682 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.max_background_compactions: -1 2020-06-27T04:41:21.682 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2020-06-27T04:41:21.682 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2020-06-27T04:41:21.683 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.delayed_write_rate : 16777216 2020-06-27T04:41:21.683 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.max_total_wal_size: 0 2020-06-27T04:41:21.683 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2020-06-27T04:41:21.683 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.stats_dump_period_sec: 600 2020-06-27T04:41:21.683 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.stats_persist_period_sec: 600 2020-06-27T04:41:21.684 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2020-06-27T04:41:21.684 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.max_open_files: -1 2020-06-27T04:41:21.684 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.bytes_per_sync: 0 2020-06-27T04:41:21.684 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.wal_bytes_per_sync: 0 2020-06-27T04:41:21.684 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.strict_bytes_per_sync: 0 2020-06-27T04:41:21.684 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Options.compaction_readahead_size: 0 2020-06-27T04:41:21.685 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Compression algorithms supported: 2020-06-27T04:41:21.685 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2020-06-27T04:41:21.685 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: kZSTD supported: 0 2020-06-27T04:41:21.685 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: kXpressCompression supported: 0 2020-06-27T04:41:21.685 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: kLZ4HCCompression supported: 1 2020-06-27T04:41:21.686 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: kLZ4Compression supported: 1 2020-06-27T04:41:21.686 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: kBZip2Compression supported: 0 2020-06-27T04:41:21.686 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: kZlibCompression supported: 1 2020-06-27T04:41:21.686 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: kSnappyCompression supported: 1 2020-06-27T04:41:21.686 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.428+0000 7f2fc78e8700 4 rocksdb: Fast CRC32 supported: Supported on x86 2020-06-27T04:41:21.687 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 2020-06-27T04:41:21.687 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2020-06-27T04:41:21.687 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2020-06-27T04:41:21.687 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.merge_operator: 2020-06-27T04:41:21.687 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compaction_filter: None 2020-06-27T04:41:21.687 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compaction_filter_factory: None 2020-06-27T04:41:21.688 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.memtable_factory: SkipListFactory 2020-06-27T04:41:21.688 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.table_factory: BlockBasedTable 2020-06-27T04:41:21.688 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a8b12ae238) 2020-06-27T04:41:21.688 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: cache_index_and_filter_blocks: 1 2020-06-27T04:41:21.688 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: cache_index_and_filter_blocks_with_high_priority: 1 2020-06-27T04:41:21.689 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: pin_l0_filter_and_index_blocks_in_cache: 0 2020-06-27T04:41:21.689 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: pin_top_level_index_and_filter: 1 2020-06-27T04:41:21.689 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: index_type: 0 2020-06-27T04:41:21.689 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: data_block_index_type: 0 2020-06-27T04:41:21.689 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: index_shortening: 1 2020-06-27T04:41:21.689 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: data_block_hash_table_util_ratio: 0.750000 2020-06-27T04:41:21.690 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: hash_index_allow_collision: 1 2020-06-27T04:41:21.690 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: checksum: 1 2020-06-27T04:41:21.690 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: no_block_cache: 0 2020-06-27T04:41:21.690 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: block_cache: 0x55a8b12e8610 2020-06-27T04:41:21.690 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: block_cache_name: BinnedLRUCache 2020-06-27T04:41:21.691 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: block_cache_options: 2020-06-27T04:41:21.691 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: capacity : 536870912 2020-06-27T04:41:21.691 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: num_shard_bits : 4 2020-06-27T04:41:21.691 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: strict_capacity_limit : 0 2020-06-27T04:41:21.691 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: high_pri_pool_ratio: 0.000 2020-06-27T04:41:21.691 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: block_cache_compressed: (nil) 2020-06-27T04:41:21.692 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: persistent_cache: (nil) 2020-06-27T04:41:21.692 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: block_size: 4096 2020-06-27T04:41:21.692 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: block_size_deviation: 10 2020-06-27T04:41:21.692 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: block_restart_interval: 16 2020-06-27T04:41:21.692 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: index_block_restart_interval: 1 2020-06-27T04:41:21.692 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: metadata_block_size: 4096 2020-06-27T04:41:21.693 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: partition_filters: 0 2020-06-27T04:41:21.693 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: use_delta_encoding: 1 2020-06-27T04:41:21.693 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: filter_policy: rocksdb.BuiltinBloomFilter 2020-06-27T04:41:21.693 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: whole_key_filtering: 1 2020-06-27T04:41:21.693 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: verify_compression: 0 2020-06-27T04:41:21.693 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: read_amp_bytes_per_bit: 0 2020-06-27T04:41:21.694 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: format_version: 2 2020-06-27T04:41:21.694 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: enable_index_compression: 1 2020-06-27T04:41:21.694 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: block_align: 0 2020-06-27T04:41:21.694 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.write_buffer_size: 33554432 2020-06-27T04:41:21.694 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.max_write_buffer_number: 2 2020-06-27T04:41:21.695 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compression: NoCompression 2020-06-27T04:41:21.695 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.bottommost_compression: Disabled 2020-06-27T04:41:21.695 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.prefix_extractor: nullptr 2020-06-27T04:41:21.695 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2020-06-27T04:41:21.695 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.num_levels: 7 2020-06-27T04:41:21.695 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2020-06-27T04:41:21.696 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2020-06-27T04:41:21.696 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2020-06-27T04:41:21.696 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2020-06-27T04:41:21.696 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2020-06-27T04:41:21.696 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2020-06-27T04:41:21.697 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2020-06-27T04:41:21.697 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2020-06-27T04:41:21.697 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2020-06-27T04:41:21.697 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compression_opts.window_bits: -14 2020-06-27T04:41:21.697 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compression_opts.level: 32767 2020-06-27T04:41:21.698 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compression_opts.strategy: 0 2020-06-27T04:41:21.698 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2020-06-27T04:41:21.698 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2020-06-27T04:41:21.698 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compression_opts.enabled: false 2020-06-27T04:41:21.698 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2020-06-27T04:41:21.698 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2020-06-27T04:41:21.699 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2020-06-27T04:41:21.699 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.target_file_size_base: 67108864 2020-06-27T04:41:21.699 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.target_file_size_multiplier: 1 2020-06-27T04:41:21.699 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2020-06-27T04:41:21.699 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2020-06-27T04:41:21.699 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2020-06-27T04:41:21.700 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2020-06-27T04:41:21.700 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2020-06-27T04:41:21.700 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2020-06-27T04:41:21.700 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2020-06-27T04:41:21.700 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2020-06-27T04:41:21.701 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2020-06-27T04:41:21.701 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2020-06-27T04:41:21.701 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2020-06-27T04:41:21.701 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2020-06-27T04:41:21.701 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.arena_block_size: 4194304 2020-06-27T04:41:21.702 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2020-06-27T04:41:21.702 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2020-06-27T04:41:21.702 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2020-06-27T04:41:21.702 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.disable_auto_compactions: 0 2020-06-27T04:41:21.702 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2020-06-27T04:41:21.702 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2020-06-27T04:41:21.703 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2020-06-27T04:41:21.703 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2020-06-27T04:41:21.703 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2020-06-27T04:41:21.703 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2020-06-27T04:41:21.703 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2020-06-27T04:41:21.704 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2020-06-27T04:41:21.704 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2020-06-27T04:41:21.704 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2020-06-27T04:41:21.704 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.table_properties_collectors: 2020-06-27T04:41:21.704 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.inplace_update_support: 0 2020-06-27T04:41:21.704 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.inplace_update_num_locks: 10000 2020-06-27T04:41:21.705 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2020-06-27T04:41:21.705 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2020-06-27T04:41:21.705 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.memtable_huge_page_size: 0 2020-06-27T04:41:21.705 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.bloom_locality: 0 2020-06-27T04:41:21.705 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.max_successive_merges: 0 2020-06-27T04:41:21.706 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.optimize_filters_for_hits: 0 2020-06-27T04:41:21.706 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.paranoid_file_checks: 0 2020-06-27T04:41:21.706 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.force_consistency_checks: 0 2020-06-27T04:41:21.706 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.report_bg_io_stats: 0 2020-06-27T04:41:21.706 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.ttl: 2592000 2020-06-27T04:41:21.706 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: Options.periodic_compaction_seconds: 0 2020-06-27T04:41:21.707 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2020-06-27T04:41:21.707 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2020-06-27T04:41:21.707 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1593232881430957, "job": 1, "event": "recovery_started", "log_files": [3]} 2020-06-27T04:41:21.707 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2020-06-27T04:41:21.707 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.429+0000 7f2fc78e8700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2020-06-27T04:41:21.708 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.430+0000 7f2fc78e8700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1593232881431418, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1415, "table_properties": {"data_size": 501, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 379, "raw_average_value_size": 75, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1593232881, "oldest_key_time": 3, "file_creation_time": 0}} 2020-06-27T04:41:21.708 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.430+0000 7f2fc78e8700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2020-06-27T04:41:21.708 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.430+0000 7f2fc78e8700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1593232881431806, "job": 1, "event": "recovery_finished"} 2020-06-27T04:41:21.708 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.431+0000 7f2fc78e8700 4 rocksdb: DB pointer 0x55a8b133b800 2020-06-27T04:41:21.708 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.431+0000 7f2fae70c700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2020-06-27T04:41:21.709 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.431+0000 7f2fae70c700 4 rocksdb: [db_impl/db_impl.cc:851] 2020-06-27T04:41:21.709 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: ** DB Stats ** 2020-06-27T04:41:21.709 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Uptime(secs): 0.0 total, 0.0 interval 2020-06-27T04:41:21.709 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2020-06-27T04:41:21.709 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2020-06-27T04:41:21.710 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2020-06-27T04:41:21.710 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2020-06-27T04:41:21.710 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2020-06-27T04:41:21.710 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2020-06-27T04:41:21.710 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: ** Compaction Stats [default] ** 2020-06-27T04:41:21.711 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-06-27T04:41:21.711 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-06-27T04:41:21.711 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: L0 1/0 1.38 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2020-06-27T04:41:21.711 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Sum 1/0 1.38 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2020-06-27T04:41:21.711 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2020-06-27T04:41:21.712 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: ** Compaction Stats [default] ** 2020-06-27T04:41:21.712 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-06-27T04:41:21.712 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-06-27T04:41:21.712 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2020-06-27T04:41:21.712 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Uptime(secs): 0.0 total, 0.0 interval 2020-06-27T04:41:21.712 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Flush(GB): cumulative 0.000, interval 0.000 2020-06-27T04:41:21.713 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: AddFile(GB): cumulative 0.000, interval 0.000 2020-06-27T04:41:21.713 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: AddFile(Total Files): cumulative 0, interval 0 2020-06-27T04:41:21.713 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: AddFile(L0 Files): cumulative 0, interval 0 2020-06-27T04:41:21.713 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: AddFile(Keys): cumulative 0, interval 0 2020-06-27T04:41:21.713 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Cumulative compaction: 0.00 GB write, 0.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-06-27T04:41:21.714 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Interval compaction: 0.00 GB write, 0.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-06-27T04:41:21.714 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-06-27T04:41:21.714 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: ** File Read Latency Histogram By Level [default] ** 2020-06-27T04:41:21.714 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: ** Compaction Stats [default] ** 2020-06-27T04:41:21.714 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-06-27T04:41:21.714 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-06-27T04:41:21.715 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: L0 1/0 1.38 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2020-06-27T04:41:21.715 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Sum 1/0 1.38 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2020-06-27T04:41:21.715 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-06-27T04:41:21.715 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: ** Compaction Stats [default] ** 2020-06-27T04:41:21.715 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-06-27T04:41:21.716 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-06-27T04:41:21.716 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2020-06-27T04:41:21.716 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Uptime(secs): 0.0 total, 0.0 interval 2020-06-27T04:41:21.716 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Flush(GB): cumulative 0.000, interval 0.000 2020-06-27T04:41:21.716 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: AddFile(GB): cumulative 0.000, interval 0.000 2020-06-27T04:41:21.717 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: AddFile(Total Files): cumulative 0, interval 0 2020-06-27T04:41:21.717 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: AddFile(L0 Files): cumulative 0, interval 0 2020-06-27T04:41:21.717 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: AddFile(Keys): cumulative 0, interval 0 2020-06-27T04:41:21.717 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Cumulative compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-06-27T04:41:21.717 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-06-27T04:41:21.718 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-06-27T04:41:21.718 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: ** File Read Latency Histogram By Level [default] ** 2020-06-27T04:41:21.718 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.431+0000 7f2fc78e8700 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2020-06-27T04:41:21.718 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.431+0000 7f2fc78e8700 0 using public_addrv [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 2020-06-27T04:41:21.718 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.432+0000 7f2fc78e8700 0 starting mon.c rank -1 at public addrs [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] at bind addrs [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:41:21.719 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.433+0000 7f2fc78e8700 1 mon.c@-1(???) e0 preinit fsid 12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:41:21.719 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.466+0000 7f2fb0f11700 0 mon.c@-1(synchronizing).mds e1 new map 2020-06-27T04:41:21.719 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.466+0000 7f2fb0f11700 0 mon.c@-1(synchronizing).mds e1 print_map 2020-06-27T04:41:21.719 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: e1 2020-06-27T04:41:21.719 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: enable_multiple, ever_enabled_multiple: 0,0 2020-06-27T04:41:21.720 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2020-06-27T04:41:21.720 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: legacy client fscid: -1 2020-06-27T04:41:21.720 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: 2020-06-27T04:41:21.720 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: No filesystems configured 2020-06-27T04:41:21.721 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.466+0000 7f2fb0f11700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2020-06-27T04:41:21.721 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.467+0000 7f2fb0f11700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2020-06-27T04:41:21.721 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.467+0000 7f2fb0f11700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2020-06-27T04:41:21.721 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.467+0000 7f2fb0f11700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2020-06-27T04:41:21.721 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.467+0000 7f2fb0f11700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2020-06-27T04:41:21.721 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.467+0000 7f2fb0f11700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2020-06-27T04:41:21.722 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.467+0000 7f2fb0f11700 1 mon.c@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2020-06-27T04:41:21.722 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.467+0000 7f2fb0f11700 1 mon.c@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2020-06-27T04:41:21.722 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.467+0000 7f2fb0f11700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2020-06-27T04:41:21.722 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.467+0000 7f2fb0f11700 0 mon.c@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2020-06-27T04:41:21.722 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.467+0000 7f2fb0f11700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2020-06-27T04:41:21.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: cluster 2020-06-27T04:41:19.793927+0000 mgr.y (mgr.14142) 39 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:21.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: audit 2020-06-27T04:41:20.271391+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:09.804773\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:09.804876\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:18.367684\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:21.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: audit 2020-06-27T04:41:20.271822+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:41:21.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: audit 2020-06-27T04:41:20.273416+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:09.804773\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:09.804876\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:18.367684\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:21.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.468+0000 7f2fb0f11700 1 mon.c@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2020-06-27T04:41:21.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.469+0000 7f2fb0f11700 10 mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2020-06-27T04:41:21.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.469+0000 7f2fb0f11700 20 expand_channel_meta expand map: {default=false} 2020-06-27T04:41:21.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.469+0000 7f2fb0f11700 20 expand_channel_meta from 'false' to 'false' 2020-06-27T04:41:21.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.469+0000 7f2fb0f11700 20 expand_channel_meta expanded map: {default=false} 2020-06-27T04:41:21.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.469+0000 7f2fb0f11700 20 expand_channel_meta expand map: {default=info} 2020-06-27T04:41:21.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.469+0000 7f2fb0f11700 20 expand_channel_meta from 'info' to 'info' 2020-06-27T04:41:21.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.469+0000 7f2fb0f11700 20 expand_channel_meta expanded map: {default=info} 2020-06-27T04:41:21.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.469+0000 7f2fb0f11700 20 expand_channel_meta expand map: {default=daemon} 2020-06-27T04:41:21.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.469+0000 7f2fb0f11700 20 expand_channel_meta from 'daemon' to 'daemon' 2020-06-27T04:41:21.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.469+0000 7f2fb0f11700 20 expand_channel_meta expanded map: {default=daemon} 2020-06-27T04:41:21.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.469+0000 7f2fb0f11700 20 expand_channel_meta expand map: {default=debug} 2020-06-27T04:41:21.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.469+0000 7f2fb0f11700 20 expand_channel_meta from 'debug' to 'debug' 2020-06-27T04:41:21.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:21 smithi031 bash[22603]: debug 2020-06-27T04:41:21.469+0000 7f2fb0f11700 20 expand_channel_meta expanded map: {default=debug} 2020-06-27T04:41:26.613 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.609+0000 7f25d4b24700 1 Processor -- start 2020-06-27T04:41:26.613 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.609+0000 7f25d4b24700 1 -- start start 2020-06-27T04:41:26.613 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.609+0000 7f25d4b24700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25d006a540 0x7f25d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:26.614 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.609+0000 7f25d4b24700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d0068e50 con 0x7f25d006a540 2020-06-27T04:41:26.614 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.609+0000 7f25ced9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25d006a540 0x7f25d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:26.614 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.609+0000 7f25ced9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25d006a540 0x7f25d0068960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38734/0 (socket says 172.21.15.31:38734) 2020-06-27T04:41:26.614 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.609+0000 7f25ced9d700 1 -- 172.21.15.31:0/938827332 learned_addr learned my addr 172.21.15.31:0/938827332 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:41:26.614 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.610+0000 7f25ced9d700 1 -- 172.21.15.31:0/938827332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d0068f90 con 0x7f25d006a540 2020-06-27T04:41:26.615 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.610+0000 7f25ced9d700 1 --2- 172.21.15.31:0/938827332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25d006a540 0x7f25d0068960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f25c0000b60 tx=0x7f25c000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:26.615 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.610+0000 7f25b6ffd700 1 -- 172.21.15.31:0/938827332 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 283+0+0 (secure 0 0 0) 0x7f25c0028070 con 0x7f25d006a540 2020-06-27T04:41:26.615 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.610+0000 7f25d4b24700 1 -- 172.21.15.31:0/938827332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d00691e0 con 0x7f25d006a540 2020-06-27T04:41:26.615 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.610+0000 7f25b6ffd700 1 -- 172.21.15.31:0/938827332 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f25c000f040 con 0x7f25d006a540 2020-06-27T04:41:26.615 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.610+0000 7f25b6ffd700 1 -- 172.21.15.31:0/938827332 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 283+0+0 (secure 0 0 0) 0x7f25c002d5b0 con 0x7f25d006a540 2020-06-27T04:41:26.616 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.610+0000 7f25d4b24700 1 -- 172.21.15.31:0/938827332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d0069670 con 0x7f25d006a540 2020-06-27T04:41:26.617 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.611+0000 7f25b6ffd700 1 -- 172.21.15.31:0/938827332 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f25c002d870 con 0x7f25d006a540 2020-06-27T04:41:26.617 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.611+0000 7f25b6ffd700 1 --2- 172.21.15.31:0/938827332 >> v2:172.21.15.31:6800/1241213118 conn(0x7f25a802ad40 0x7f25a802d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:26.617 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.611+0000 7f25b6ffd700 1 -- 172.21.15.31:0/938827332 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1498+0+0 (secure 0 0 0) 0x7f25c0001b30 con 0x7f25d006a540 2020-06-27T04:41:26.617 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.611+0000 7f25ce59c700 1 --2- 172.21.15.31:0/938827332 >> v2:172.21.15.31:6800/1241213118 conn(0x7f25a802ad40 0x7f25a802d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:26.618 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.612+0000 7f25d4b24700 1 -- 172.21.15.31:0/938827332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d0057340 con 0x7f25d006a540 2020-06-27T04:41:26.618 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.612+0000 7f25ce59c700 1 --2- 172.21.15.31:0/938827332 >> v2:172.21.15.31:6800/1241213118 conn(0x7f25a802ad40 0x7f25a802d200 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f25c4002f70 tx=0x7f25c4006b20).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:26.618 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.616+0000 7f25b6ffd700 1 -- 172.21.15.31:0/938827332 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f25c002db00 con 0x7f25d006a540 2020-06-27T04:41:26.833 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.830+0000 7f25d4b24700 1 -- 172.21.15.31:0/938827332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f25d0043e80 con 0x7f25d006a540 2020-06-27T04:41:26.833 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.831+0000 7f25b6ffd700 1 -- 172.21.15.31:0/938827332 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+817 (secure 0 0 0) 0x7f25c0000e90 con 0x7f25d006a540 2020-06-27T04:41:26.834 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:41:26.834 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":2,"fsid":"12892ae2-b830-11ea-a06d-001a4aab830c","modified":"2020-06-27T04:41:21.473121Z","created":"2020-06-27T04:39:34.169049Z","min_mon_release":16,"min_mon_release_name":"pacific","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3301","nonce":0},{"type":"v1","addr":"172.21.15.31:6790","nonce":0}]},"addr":"172.21.15.31:6790/0","public_addr":"172.21.15.31:6790/0","priority":0,"weight":0}],"quorum":[0,1]} 2020-06-27T04:41:26.835 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.832+0000 7f25d4b24700 1 -- 172.21.15.31:0/938827332 >> v2:172.21.15.31:6800/1241213118 conn(0x7f25a802ad40 msgr2=0x7f25a802d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:26.835 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.832+0000 7f25d4b24700 1 --2- 172.21.15.31:0/938827332 >> v2:172.21.15.31:6800/1241213118 conn(0x7f25a802ad40 0x7f25a802d200 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f25c4002f70 tx=0x7f25c4006b20).stop 2020-06-27T04:41:26.835 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.832+0000 7f25d4b24700 1 -- 172.21.15.31:0/938827332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25d006a540 msgr2=0x7f25d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:26.835 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.832+0000 7f25d4b24700 1 --2- 172.21.15.31:0/938827332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25d006a540 0x7f25d0068960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f25c0000b60 tx=0x7f25c000b040).stop 2020-06-27T04:41:26.836 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.832+0000 7f25d4b24700 1 -- 172.21.15.31:0/938827332 shutdown_connections 2020-06-27T04:41:26.836 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.832+0000 7f25d4b24700 1 --2- 172.21.15.31:0/938827332 >> v2:172.21.15.31:6800/1241213118 conn(0x7f25a802ad40 0x7f25a802d200 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:26.836 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.832+0000 7f25d4b24700 1 --2- 172.21.15.31:0/938827332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25d006a540 0x7f25d0068960 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:26.836 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.832+0000 7f25d4b24700 1 -- 172.21.15.31:0/938827332 >> 172.21.15.31:0/938827332 conn(0x7f25d0061430 msgr2=0x7f25d00639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:41:26.836 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.832+0000 7f25d4b24700 1 -- 172.21.15.31:0/938827332 shutdown_connections 2020-06-27T04:41:26.837 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:26.833+0000 7f25d4b24700 1 -- 172.21.15.31:0/938827332 wait complete. 2020-06-27T04:41:26.837 INFO:teuthology.orchestra.run.smithi031.stderr:dumped monmap epoch 2 2020-06-27T04:41:26.855 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[22603]: cluster 2020-06-27T04:41:21.473151+0000 mgr.y (mgr.14142) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:26.856 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[22603]: cluster 2020-06-27T04:41:21.475238+0000 mon.a (mon.0) 156 : cluster [INF] mon.a calling monitor election 2020-06-27T04:41:26.856 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[22603]: audit 2020-06-27T04:41:22.472162+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-06-27T04:41:26.856 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[22603]: audit 2020-06-27T04:41:23.472552+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-06-27T04:41:26.856 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[22603]: cluster 2020-06-27T04:41:23.473400+0000 mgr.y (mgr.14142) 41 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:26.857 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[22603]: cluster 2020-06-27T04:41:23.474013+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2020-06-27T04:41:26.857 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[22603]: audit 2020-06-27T04:41:24.472695+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-06-27T04:41:26.857 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[22603]: audit 2020-06-27T04:41:25.472661+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-06-27T04:41:26.857 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[22603]: cluster 2020-06-27T04:41:25.473629+0000 mgr.y (mgr.14142) 42 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:26.858 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[22603]: audit 2020-06-27T04:41:26.472818+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-06-27T04:41:26.858 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[22603]: cluster 2020-06-27T04:41:26.478014+0000 mon.a (mon.0) 162 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2020-06-27T04:41:26.858 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[22603]: cluster 2020-06-27T04:41:26.481103+0000 mon.a (mon.0) 163 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0],c=[v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0]} 2020-06-27T04:41:26.858 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[22603]: cluster 2020-06-27T04:41:26.481162+0000 mon.a (mon.0) 164 : cluster [DBG] fsmap 2020-06-27T04:41:26.858 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[22603]: cluster 2020-06-27T04:41:26.481214+0000 mon.a (mon.0) 165 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2020-06-27T04:41:26.859 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[22603]: cluster 2020-06-27T04:41:26.481453+0000 mon.a (mon.0) 166 : cluster [DBG] mgrmap e13: y(active, since 76s) 2020-06-27T04:41:26.859 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[22603]: cluster 2020-06-27T04:41:26.484640+0000 mon.a (mon.0) 167 : cluster [WRN] overall HEALTH_WARN failed to probe daemons or devices; Reduced data availability: 1 pg inactive 2020-06-27T04:41:26.859 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[18426]: cluster 2020-06-27T04:41:21.473151+0000 mgr.y (mgr.14142) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:26.859 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[18426]: cluster 2020-06-27T04:41:21.475238+0000 mon.a (mon.0) 156 : cluster [INF] mon.a calling monitor election 2020-06-27T04:41:26.860 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[18426]: audit 2020-06-27T04:41:22.472162+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-06-27T04:41:26.860 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[18426]: audit 2020-06-27T04:41:23.472552+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-06-27T04:41:26.860 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[18426]: cluster 2020-06-27T04:41:23.473400+0000 mgr.y (mgr.14142) 41 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:26.860 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[18426]: cluster 2020-06-27T04:41:23.474013+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2020-06-27T04:41:26.860 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[18426]: audit 2020-06-27T04:41:24.472695+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-06-27T04:41:26.861 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[18426]: audit 2020-06-27T04:41:25.472661+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-06-27T04:41:26.861 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[18426]: cluster 2020-06-27T04:41:25.473629+0000 mgr.y (mgr.14142) 42 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:26.861 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[18426]: audit 2020-06-27T04:41:26.472818+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-06-27T04:41:26.861 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[18426]: cluster 2020-06-27T04:41:26.478014+0000 mon.a (mon.0) 162 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2020-06-27T04:41:26.861 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[18426]: cluster 2020-06-27T04:41:26.481103+0000 mon.a (mon.0) 163 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0],c=[v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0]} 2020-06-27T04:41:26.862 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[18426]: cluster 2020-06-27T04:41:26.481162+0000 mon.a (mon.0) 164 : cluster [DBG] fsmap 2020-06-27T04:41:26.862 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[18426]: cluster 2020-06-27T04:41:26.481214+0000 mon.a (mon.0) 165 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2020-06-27T04:41:26.862 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[18426]: cluster 2020-06-27T04:41:26.481453+0000 mon.a (mon.0) 166 : cluster [DBG] mgrmap e13: y(active, since 76s) 2020-06-27T04:41:26.862 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:26 smithi031 bash[18426]: cluster 2020-06-27T04:41:26.484640+0000 mon.a (mon.0) 167 : cluster [WRN] overall HEALTH_WARN failed to probe daemons or devices; Reduced data availability: 1 pg inactive 2020-06-27T04:41:27.344 INFO:tasks.cephadm:Adding mon.b on smithi051 2020-06-27T04:41:27.344 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph orch daemon add mon smithi051:172.21.15.51=b 2020-06-27T04:41:27.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:27 smithi031 bash[22603]: cluster 2020-06-27T04:41:26.532473+0000 mon.a (mon.0) 168 : cluster [INF] Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2020-06-27T04:41:27.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:27 smithi031 bash[22603]: audit 2020-06-27T04:41:26.831366+0000 mon.a (mon.0) 169 : audit [DBG] from='client.? 172.21.15.31:0/938827332' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2020-06-27T04:41:27.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:27 smithi031 bash[22603]: audit 2020-06-27T04:41:27.473042+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-06-27T04:41:27.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:27 smithi031 bash[18426]: cluster 2020-06-27T04:41:26.532473+0000 mon.a (mon.0) 168 : cluster [INF] Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2020-06-27T04:41:27.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:27 smithi031 bash[18426]: audit 2020-06-27T04:41:26.831366+0000 mon.a (mon.0) 169 : audit [DBG] from='client.? 172.21.15.31:0/938827332' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2020-06-27T04:41:27.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:27 smithi031 bash[18426]: audit 2020-06-27T04:41:27.473042+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-06-27T04:41:29.038 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.035+0000 7f7b660eb700 1 Processor -- start 2020-06-27T04:41:29.039 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.035+0000 7f7b660eb700 1 -- start start 2020-06-27T04:41:29.039 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.036+0000 7f7b660eb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b60071df0 0x7f7b60072210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:29.039 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.036+0000 7f7b660eb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b60072860 con 0x7f7b60071df0 2020-06-27T04:41:29.039 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.036+0000 7f7b5ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b60071df0 0x7f7b60072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:29.040 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.036+0000 7f7b5ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b60071df0 0x7f7b60072210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.51:34156/0 (socket says 172.21.15.51:34156) 2020-06-27T04:41:29.040 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.036+0000 7f7b5ffff700 1 -- 172.21.15.51:0/2183243289 learned_addr learned my addr 172.21.15.51:0/2183243289 (peer_addr_for_me v2:172.21.15.51:0/0) 2020-06-27T04:41:29.040 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.036+0000 7f7b5ffff700 1 -- 172.21.15.51:0/2183243289 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b600731c0 con 0x7f7b60071df0 2020-06-27T04:41:29.040 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.036+0000 7f7b5ffff700 1 --2- 172.21.15.51:0/2183243289 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b60071df0 0x7f7b60072210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f7b50002f10 tx=0x7f7b50009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:29.041 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.036+0000 7f7b5cff9700 1 -- 172.21.15.51:0/2183243289 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 283+0+0 (secure 0 0 0) 0x7f7b5000e030 con 0x7f7b60071df0 2020-06-27T04:41:29.042 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.036+0000 7f7b660eb700 1 -- 172.21.15.51:0/2183243289 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b60073410 con 0x7f7b60071df0 2020-06-27T04:41:29.042 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.036+0000 7f7b5cff9700 1 -- 172.21.15.51:0/2183243289 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f7b5000beb0 con 0x7f7b60071df0 2020-06-27T04:41:29.044 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.036+0000 7f7b5cff9700 1 -- 172.21.15.51:0/2183243289 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 283+0+0 (secure 0 0 0) 0x7f7b50018070 con 0x7f7b60071df0 2020-06-27T04:41:29.044 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.037+0000 7f7b660eb700 1 -- 172.21.15.51:0/2183243289 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b600738a0 con 0x7f7b60071df0 2020-06-27T04:41:29.044 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.037+0000 7f7b5cff9700 1 -- 172.21.15.51:0/2183243289 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f7b50013470 con 0x7f7b60071df0 2020-06-27T04:41:29.044 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.037+0000 7f7b660eb700 1 -- 172.21.15.51:0/2183243289 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b600729a0 con 0x7f7b60071df0 2020-06-27T04:41:29.044 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.037+0000 7f7b5cff9700 1 --2- 172.21.15.51:0/2183243289 >> v2:172.21.15.31:6800/1241213118 conn(0x7f7b3802ad30 0x7f7b3802d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:29.045 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.037+0000 7f7b5cff9700 1 -- 172.21.15.51:0/2183243289 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1498+0+0 (secure 0 0 0) 0x7f7b5003b540 con 0x7f7b60071df0 2020-06-27T04:41:29.045 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.038+0000 7f7b577fe700 1 --2- 172.21.15.51:0/2183243289 >> v2:172.21.15.31:6800/1241213118 conn(0x7f7b3802ad30 0x7f7b3802d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:29.045 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.038+0000 7f7b577fe700 1 --2- 172.21.15.51:0/2183243289 >> v2:172.21.15.31:6800/1241213118 conn(0x7f7b3802ad30 0x7f7b3802d1f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7b48002f70 tx=0x7f7b48006b20).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:29.046 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.042+0000 7f7b5cff9700 1 -- 172.21.15.51:0/2183243289 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f7b50013b10 con 0x7f7b60071df0 2020-06-27T04:41:29.222 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:29.219+0000 7f7b660eb700 1 -- 172.21.15.51:0/2183243289 --> v2:172.21.15.31:6800/1241213118 -- mgr_command(tid 0: {"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi051:172.21.15.51=b", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b6005ded0 con 0x7f7b3802ad30 2020-06-27T04:41:29.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:29 smithi031 bash[22603]: cluster 2020-06-27T04:41:27.473842+0000 mgr.y (mgr.14142) 43 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:29.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:29 smithi031 bash[18426]: cluster 2020-06-27T04:41:27.473842+0000 mgr.y (mgr.14142) 43 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:30.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:30 smithi031 bash[22603]: audit 2020-06-27T04:41:29.222393+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-06-27T04:41:30.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:30 smithi031 bash[22603]: audit 2020-06-27T04:41:29.223201+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:30.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:30 smithi031 bash[22603]: audit 2020-06-27T04:41:29.224115+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2020-06-27T04:41:30.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:30 smithi031 bash[18426]: audit 2020-06-27T04:41:29.222393+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-06-27T04:41:30.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:30 smithi031 bash[18426]: audit 2020-06-27T04:41:29.223201+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:30.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:30 smithi031 bash[18426]: audit 2020-06-27T04:41:29.224115+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2020-06-27T04:41:31.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:31 smithi031 bash[22603]: audit 2020-06-27T04:41:29.221028+0000 mgr.y (mgr.14142) 44 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi051:172.21.15.51=b", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:41:31.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:31 smithi031 bash[22603]: cephadm 2020-06-27T04:41:29.223783+0000 mgr.y (mgr.14142) 45 : cephadm [INF] Deploying daemon mon.b on smithi051 2020-06-27T04:41:31.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:31 smithi031 bash[22603]: cluster 2020-06-27T04:41:29.474284+0000 mgr.y (mgr.14142) 46 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:31.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:31 smithi031 bash[18426]: audit 2020-06-27T04:41:29.221028+0000 mgr.y (mgr.14142) 44 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi051:172.21.15.51=b", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:41:31.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:31 smithi031 bash[18426]: cephadm 2020-06-27T04:41:29.223783+0000 mgr.y (mgr.14142) 45 : cephadm [INF] Deploying daemon mon.b on smithi051 2020-06-27T04:41:31.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:31 smithi031 bash[18426]: cluster 2020-06-27T04:41:29.474284+0000 mgr.y (mgr.14142) 46 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:32.183 INFO:teuthology.orchestra.run.smithi051.stdout:Deployed mon.b on host 'smithi051' 2020-06-27T04:41:32.183 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:32.179+0000 7f7b5cff9700 1 -- 172.21.15.51:0/2183243289 <== mgr.14142 v2:172.21.15.31:6800/1241213118 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+35 (secure 0 0 0) 0x7f7b4800c070 con 0x7f7b3802ad30 2020-06-27T04:41:32.184 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:32.181+0000 7f7b660eb700 1 -- 172.21.15.51:0/2183243289 >> v2:172.21.15.31:6800/1241213118 conn(0x7f7b3802ad30 msgr2=0x7f7b3802d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:32.184 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:32.181+0000 7f7b660eb700 1 --2- 172.21.15.51:0/2183243289 >> v2:172.21.15.31:6800/1241213118 conn(0x7f7b3802ad30 0x7f7b3802d1f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7b48002f70 tx=0x7f7b48006b20).stop 2020-06-27T04:41:32.184 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:32.181+0000 7f7b660eb700 1 -- 172.21.15.51:0/2183243289 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b60071df0 msgr2=0x7f7b60072210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:32.185 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:32.181+0000 7f7b660eb700 1 --2- 172.21.15.51:0/2183243289 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b60071df0 0x7f7b60072210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f7b50002f10 tx=0x7f7b50009b30).stop 2020-06-27T04:41:32.185 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:32.181+0000 7f7b660eb700 1 -- 172.21.15.51:0/2183243289 shutdown_connections 2020-06-27T04:41:32.185 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:32.181+0000 7f7b660eb700 1 --2- 172.21.15.51:0/2183243289 >> v2:172.21.15.31:6800/1241213118 conn(0x7f7b3802ad30 0x7f7b3802d1f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:32.185 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:32.181+0000 7f7b660eb700 1 --2- 172.21.15.51:0/2183243289 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b60071df0 0x7f7b60072210 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:32.185 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:32.181+0000 7f7b660eb700 1 -- 172.21.15.51:0/2183243289 >> 172.21.15.51:0/2183243289 conn(0x7f7b60061430 msgr2=0x7f7b60069780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:41:32.186 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:32.181+0000 7f7b660eb700 1 -- 172.21.15.51:0/2183243289 shutdown_connections 2020-06-27T04:41:32.186 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:32.181+0000 7f7b660eb700 1 -- 172.21.15.51:0/2183243289 wait complete. 2020-06-27T04:41:32.744 INFO:teuthology.orchestra.run.smithi051:mon.b> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mon.b.service 2020-06-27T04:41:32.747 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2020-06-27T04:41:32.747 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph mon dump -f json 2020-06-27T04:41:32.780 INFO:ceph.mon.b.smithi051.stdout:-- Logs begin at Sat 2020-06-27 04:33:02 UTC. -- 2020-06-27T04:41:33.360 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 podman[18444]: 2020-06-27 04:41:33.103805956 +0000 UTC m=+0.864749522 container create adf72351f403fb2339c7bdb62845ed8685676e7dbc2884cba555b25bb5d9f424 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.b) 2020-06-27T04:41:33.360 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 podman[18444]: 2020-06-27 04:41:33.288328038 +0000 UTC m=+1.049271495 container init adf72351f403fb2339c7bdb62845ed8685676e7dbc2884cba555b25bb5d9f424 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.b) 2020-06-27T04:41:33.360 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 podman[18444]: 2020-06-27 04:41:33.336980409 +0000 UTC m=+1.097923853 container start adf72351f403fb2339c7bdb62845ed8685676e7dbc2884cba555b25bb5d9f424 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.b) 2020-06-27T04:41:33.361 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 podman[18444]: 2020-06-27 04:41:33.337058578 +0000 UTC m=+1.098002041 container attach adf72351f403fb2339c7bdb62845ed8685676e7dbc2884cba555b25bb5d9f424 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mon.b) 2020-06-27T04:41:33.361 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.313+0000 7f5189700700 0 set uid:gid to 167:167 (ceph:ceph) 2020-06-27T04:41:33.361 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.313+0000 7f5189700700 0 ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev), process ceph-mon, pid 1 2020-06-27T04:41:33.361 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.313+0000 7f5189700700 0 pidfile_write: ignore empty --pid-file 2020-06-27T04:41:33.361 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.317+0000 7f5189700700 0 load: jerasure load: lrc load: isa 2020-06-27T04:41:33.362 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: RocksDB version: 6.8.1 2020-06-27T04:41:33.362 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2020-06-27T04:41:33.362 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Compile date Jun 26 2020 2020-06-27T04:41:33.362 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: DB SUMMARY 2020-06-27T04:41:33.362 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: CURRENT file: CURRENT 2020-06-27T04:41:33.363 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: IDENTITY file: IDENTITY 2020-06-27T04:41:33.363 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2020-06-27T04:41:33.363 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2020-06-27T04:41:33.363 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000003.log size: 610 ; 2020-06-27T04:41:33.363 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.error_if_exists: 0 2020-06-27T04:41:33.364 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.create_if_missing: 0 2020-06-27T04:41:33.364 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.paranoid_checks: 1 2020-06-27T04:41:33.364 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.env: 0x55a4ca441720 2020-06-27T04:41:33.364 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.fs: Posix File System 2020-06-27T04:41:33.364 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.info_log: 0x55a4cad70300 2020-06-27T04:41:33.365 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_file_opening_threads: 16 2020-06-27T04:41:33.365 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.statistics: (nil) 2020-06-27T04:41:33.365 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.use_fsync: 0 2020-06-27T04:41:33.365 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_log_file_size: 0 2020-06-27T04:41:33.365 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2020-06-27T04:41:33.365 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.log_file_time_to_roll: 0 2020-06-27T04:41:33.366 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.keep_log_file_num: 1000 2020-06-27T04:41:33.366 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.recycle_log_file_num: 0 2020-06-27T04:41:33.366 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.allow_fallocate: 1 2020-06-27T04:41:33.366 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.allow_mmap_reads: 0 2020-06-27T04:41:33.366 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.allow_mmap_writes: 0 2020-06-27T04:41:33.367 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.use_direct_reads: 0 2020-06-27T04:41:33.367 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2020-06-27T04:41:33.367 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.create_missing_column_families: 0 2020-06-27T04:41:33.367 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.db_log_dir: 2020-06-27T04:41:33.367 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2020-06-27T04:41:33.368 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.table_cache_numshardbits: 6 2020-06-27T04:41:33.368 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_subcompactions: 1 2020-06-27T04:41:33.368 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_background_flushes: -1 2020-06-27T04:41:33.368 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.WAL_ttl_seconds: 0 2020-06-27T04:41:33.369 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.WAL_size_limit_MB: 0 2020-06-27T04:41:33.369 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2020-06-27T04:41:33.369 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2020-06-27T04:41:33.369 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.is_fd_close_on_exec: 1 2020-06-27T04:41:33.369 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.advise_random_on_open: 1 2020-06-27T04:41:33.369 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.db_write_buffer_size: 0 2020-06-27T04:41:33.370 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.write_buffer_manager: 0x55a4cadbd260 2020-06-27T04:41:33.370 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2020-06-27T04:41:33.370 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2020-06-27T04:41:33.370 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2020-06-27T04:41:33.370 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.use_adaptive_mutex: 0 2020-06-27T04:41:33.371 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.rate_limiter: (nil) 2020-06-27T04:41:33.371 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2020-06-27T04:41:33.371 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.wal_recovery_mode: 2 2020-06-27T04:41:33.371 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.enable_thread_tracking: 0 2020-06-27T04:41:33.371 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.enable_pipelined_write: 0 2020-06-27T04:41:33.372 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.unordered_write: 0 2020-06-27T04:41:33.372 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2020-06-27T04:41:33.372 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2020-06-27T04:41:33.372 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2020-06-27T04:41:33.372 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2020-06-27T04:41:33.373 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.row_cache: None 2020-06-27T04:41:33.373 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.wal_filter: None 2020-06-27T04:41:33.373 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2020-06-27T04:41:33.373 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.allow_ingest_behind: 0 2020-06-27T04:41:33.373 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.preserve_deletes: 0 2020-06-27T04:41:33.373 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.two_write_queues: 0 2020-06-27T04:41:33.374 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.manual_wal_flush: 0 2020-06-27T04:41:33.374 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.atomic_flush: 0 2020-06-27T04:41:33.374 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2020-06-27T04:41:33.374 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.persist_stats_to_disk: 0 2020-06-27T04:41:33.374 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.write_dbid_to_manifest: 0 2020-06-27T04:41:33.375 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.log_readahead_size: 0 2020-06-27T04:41:33.375 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2020-06-27T04:41:33.375 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_background_jobs: 2 2020-06-27T04:41:33.375 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_background_compactions: -1 2020-06-27T04:41:33.375 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2020-06-27T04:41:33.375 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2020-06-27T04:41:33.376 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.delayed_write_rate : 16777216 2020-06-27T04:41:33.376 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_total_wal_size: 0 2020-06-27T04:41:33.376 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2020-06-27T04:41:33.376 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.stats_dump_period_sec: 600 2020-06-27T04:41:33.376 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.stats_persist_period_sec: 600 2020-06-27T04:41:33.377 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2020-06-27T04:41:33.377 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_open_files: -1 2020-06-27T04:41:33.377 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.bytes_per_sync: 0 2020-06-27T04:41:33.377 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.wal_bytes_per_sync: 0 2020-06-27T04:41:33.377 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.strict_bytes_per_sync: 0 2020-06-27T04:41:33.380 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compaction_readahead_size: 0 2020-06-27T04:41:33.380 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Compression algorithms supported: 2020-06-27T04:41:33.381 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2020-06-27T04:41:33.381 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: kZSTD supported: 0 2020-06-27T04:41:33.381 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: kXpressCompression supported: 0 2020-06-27T04:41:33.381 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: kLZ4HCCompression supported: 1 2020-06-27T04:41:33.381 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: kLZ4Compression supported: 1 2020-06-27T04:41:33.382 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: kBZip2Compression supported: 0 2020-06-27T04:41:33.382 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: kZlibCompression supported: 1 2020-06-27T04:41:33.382 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: kSnappyCompression supported: 1 2020-06-27T04:41:33.382 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Fast CRC32 supported: Supported on x86 2020-06-27T04:41:33.383 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 2020-06-27T04:41:33.383 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2020-06-27T04:41:33.383 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2020-06-27T04:41:33.386 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.merge_operator: 2020-06-27T04:41:33.386 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compaction_filter: None 2020-06-27T04:41:33.386 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compaction_filter_factory: None 2020-06-27T04:41:33.387 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.memtable_factory: SkipListFactory 2020-06-27T04:41:33.387 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.table_factory: BlockBasedTable 2020-06-27T04:41:33.387 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a4cad12238) 2020-06-27T04:41:33.387 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: cache_index_and_filter_blocks: 1 2020-06-27T04:41:33.387 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: cache_index_and_filter_blocks_with_high_priority: 1 2020-06-27T04:41:33.387 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: pin_l0_filter_and_index_blocks_in_cache: 0 2020-06-27T04:41:33.388 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: pin_top_level_index_and_filter: 1 2020-06-27T04:41:33.388 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: index_type: 0 2020-06-27T04:41:33.388 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: data_block_index_type: 0 2020-06-27T04:41:33.388 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: index_shortening: 1 2020-06-27T04:41:33.388 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: data_block_hash_table_util_ratio: 0.750000 2020-06-27T04:41:33.389 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: hash_index_allow_collision: 1 2020-06-27T04:41:33.389 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: checksum: 1 2020-06-27T04:41:33.389 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: no_block_cache: 0 2020-06-27T04:41:33.389 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: block_cache: 0x55a4cad4c610 2020-06-27T04:41:33.389 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: block_cache_name: BinnedLRUCache 2020-06-27T04:41:33.389 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: block_cache_options: 2020-06-27T04:41:33.390 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: capacity : 536870912 2020-06-27T04:41:33.390 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: num_shard_bits : 4 2020-06-27T04:41:33.390 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: strict_capacity_limit : 0 2020-06-27T04:41:33.390 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: high_pri_pool_ratio: 0.000 2020-06-27T04:41:33.390 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: block_cache_compressed: (nil) 2020-06-27T04:41:33.391 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: persistent_cache: (nil) 2020-06-27T04:41:33.391 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: block_size: 4096 2020-06-27T04:41:33.391 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: block_size_deviation: 10 2020-06-27T04:41:33.391 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: block_restart_interval: 16 2020-06-27T04:41:33.392 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: index_block_restart_interval: 1 2020-06-27T04:41:33.392 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: metadata_block_size: 4096 2020-06-27T04:41:33.392 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: partition_filters: 0 2020-06-27T04:41:33.392 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: use_delta_encoding: 1 2020-06-27T04:41:33.392 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: filter_policy: rocksdb.BuiltinBloomFilter 2020-06-27T04:41:33.392 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: whole_key_filtering: 1 2020-06-27T04:41:33.393 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: verify_compression: 0 2020-06-27T04:41:33.393 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: read_amp_bytes_per_bit: 0 2020-06-27T04:41:33.393 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: format_version: 2 2020-06-27T04:41:33.393 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: enable_index_compression: 1 2020-06-27T04:41:33.394 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: block_align: 0 2020-06-27T04:41:33.394 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.write_buffer_size: 33554432 2020-06-27T04:41:33.394 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_write_buffer_number: 2 2020-06-27T04:41:33.394 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compression: NoCompression 2020-06-27T04:41:33.394 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.bottommost_compression: Disabled 2020-06-27T04:41:33.395 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.prefix_extractor: nullptr 2020-06-27T04:41:33.395 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2020-06-27T04:41:33.395 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.num_levels: 7 2020-06-27T04:41:33.395 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2020-06-27T04:41:33.395 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2020-06-27T04:41:33.395 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2020-06-27T04:41:33.396 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2020-06-27T04:41:33.396 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2020-06-27T04:41:33.396 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2020-06-27T04:41:33.396 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2020-06-27T04:41:33.396 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2020-06-27T04:41:33.397 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2020-06-27T04:41:33.397 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compression_opts.window_bits: -14 2020-06-27T04:41:33.397 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compression_opts.level: 32767 2020-06-27T04:41:33.397 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compression_opts.strategy: 0 2020-06-27T04:41:33.397 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2020-06-27T04:41:33.397 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2020-06-27T04:41:33.398 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compression_opts.enabled: false 2020-06-27T04:41:33.398 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2020-06-27T04:41:33.398 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2020-06-27T04:41:33.398 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2020-06-27T04:41:33.398 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.target_file_size_base: 67108864 2020-06-27T04:41:33.399 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.target_file_size_multiplier: 1 2020-06-27T04:41:33.399 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2020-06-27T04:41:33.399 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2020-06-27T04:41:33.399 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2020-06-27T04:41:33.399 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2020-06-27T04:41:33.399 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2020-06-27T04:41:33.400 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2020-06-27T04:41:33.400 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2020-06-27T04:41:33.400 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2020-06-27T04:41:33.400 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2020-06-27T04:41:33.400 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2020-06-27T04:41:33.401 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2020-06-27T04:41:33.401 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2020-06-27T04:41:33.401 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.arena_block_size: 4194304 2020-06-27T04:41:33.401 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2020-06-27T04:41:33.401 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2020-06-27T04:41:33.402 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2020-06-27T04:41:33.402 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.disable_auto_compactions: 0 2020-06-27T04:41:33.402 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2020-06-27T04:41:33.402 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2020-06-27T04:41:33.402 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2020-06-27T04:41:33.402 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2020-06-27T04:41:33.403 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2020-06-27T04:41:33.403 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2020-06-27T04:41:33.403 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2020-06-27T04:41:33.403 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2020-06-27T04:41:33.403 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2020-06-27T04:41:33.404 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2020-06-27T04:41:33.404 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.table_properties_collectors: 2020-06-27T04:41:33.404 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.inplace_update_support: 0 2020-06-27T04:41:33.404 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.inplace_update_num_locks: 10000 2020-06-27T04:41:33.404 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2020-06-27T04:41:33.404 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2020-06-27T04:41:33.405 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.memtable_huge_page_size: 0 2020-06-27T04:41:33.405 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.bloom_locality: 0 2020-06-27T04:41:33.405 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.max_successive_merges: 0 2020-06-27T04:41:33.405 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.optimize_filters_for_hits: 0 2020-06-27T04:41:33.405 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.paranoid_file_checks: 0 2020-06-27T04:41:33.406 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.force_consistency_checks: 0 2020-06-27T04:41:33.406 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.report_bg_io_stats: 0 2020-06-27T04:41:33.406 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.ttl: 2592000 2020-06-27T04:41:33.406 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: Options.periodic_compaction_seconds: 0 2020-06-27T04:41:33.406 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2020-06-27T04:41:33.407 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2020-06-27T04:41:33.407 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1593232893319350, "job": 1, "event": "recovery_started", "log_files": [3]} 2020-06-27T04:41:33.407 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.318+0000 7f5189700700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2020-06-27T04:41:33.407 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.319+0000 7f5189700700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2020-06-27T04:41:33.407 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.319+0000 7f5189700700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1593232893319780, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1536, "table_properties": {"data_size": 622, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 500, "raw_average_value_size": 100, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1593232893, "oldest_key_time": 3, "file_creation_time": 0}} 2020-06-27T04:41:33.407 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.319+0000 7f5189700700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2020-06-27T04:41:33.408 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.319+0000 7f5189700700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1593232893320148, "job": 1, "event": "recovery_finished"} 2020-06-27T04:41:33.408 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.320+0000 7f5189700700 4 rocksdb: DB pointer 0x55a4cad9f800 2020-06-27T04:41:33.408 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.320+0000 7f5189700700 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2020-06-27T04:41:33.408 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.320+0000 7f5170524700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2020-06-27T04:41:33.408 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.320+0000 7f5170524700 4 rocksdb: [db_impl/db_impl.cc:851] 2020-06-27T04:41:33.409 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: ** DB Stats ** 2020-06-27T04:41:33.409 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Uptime(secs): 0.0 total, 0.0 interval 2020-06-27T04:41:33.409 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2020-06-27T04:41:33.409 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2020-06-27T04:41:33.409 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2020-06-27T04:41:33.410 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2020-06-27T04:41:33.410 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2020-06-27T04:41:33.410 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2020-06-27T04:41:33.410 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: ** Compaction Stats [default] ** 2020-06-27T04:41:33.410 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-06-27T04:41:33.410 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-06-27T04:41:33.411 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: L0 1/0 1.50 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2020-06-27T04:41:33.411 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Sum 1/0 1.50 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2020-06-27T04:41:33.411 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2020-06-27T04:41:33.411 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: ** Compaction Stats [default] ** 2020-06-27T04:41:33.411 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-06-27T04:41:33.412 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-06-27T04:41:33.412 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2020-06-27T04:41:33.412 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Uptime(secs): 0.0 total, 0.0 interval 2020-06-27T04:41:33.412 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Flush(GB): cumulative 0.000, interval 0.000 2020-06-27T04:41:33.412 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: AddFile(GB): cumulative 0.000, interval 0.000 2020-06-27T04:41:33.412 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: AddFile(Total Files): cumulative 0, interval 0 2020-06-27T04:41:33.413 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: AddFile(L0 Files): cumulative 0, interval 0 2020-06-27T04:41:33.413 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: AddFile(Keys): cumulative 0, interval 0 2020-06-27T04:41:33.413 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Cumulative compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-06-27T04:41:33.413 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Interval compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-06-27T04:41:33.413 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-06-27T04:41:33.414 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: ** File Read Latency Histogram By Level [default] ** 2020-06-27T04:41:33.414 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: ** Compaction Stats [default] ** 2020-06-27T04:41:33.414 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-06-27T04:41:33.414 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-06-27T04:41:33.415 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: L0 1/0 1.50 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2020-06-27T04:41:33.415 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Sum 1/0 1.50 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2020-06-27T04:41:33.415 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-06-27T04:41:33.415 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: ** Compaction Stats [default] ** 2020-06-27T04:41:33.415 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-06-27T04:41:33.415 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-06-27T04:41:33.416 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2020-06-27T04:41:33.416 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Uptime(secs): 0.0 total, 0.0 interval 2020-06-27T04:41:33.416 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Flush(GB): cumulative 0.000, interval 0.000 2020-06-27T04:41:33.416 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: AddFile(GB): cumulative 0.000, interval 0.000 2020-06-27T04:41:33.416 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: AddFile(Total Files): cumulative 0, interval 0 2020-06-27T04:41:33.417 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: AddFile(L0 Files): cumulative 0, interval 0 2020-06-27T04:41:33.417 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: AddFile(Keys): cumulative 0, interval 0 2020-06-27T04:41:33.417 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Cumulative compaction: 0.00 GB write, 0.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-06-27T04:41:33.417 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-06-27T04:41:33.417 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-06-27T04:41:33.417 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: ** File Read Latency Histogram By Level [default] ** 2020-06-27T04:41:33.418 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.320+0000 7f5189700700 0 using public_addr v2:172.21.15.51:0/0 -> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 2020-06-27T04:41:33.418 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.321+0000 7f5189700700 0 starting mon.b rank -1 at public addrs [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] at bind addrs [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:41:33.418 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.322+0000 7f5189700700 1 mon.b@-1(???) e0 preinit fsid 12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:41:33.418 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.356+0000 7f5172d29700 0 mon.b@-1(synchronizing).mds e1 new map 2020-06-27T04:41:33.418 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.356+0000 7f5172d29700 0 mon.b@-1(synchronizing).mds e1 print_map 2020-06-27T04:41:33.419 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: e1 2020-06-27T04:41:33.419 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: enable_multiple, ever_enabled_multiple: 0,0 2020-06-27T04:41:33.419 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2020-06-27T04:41:33.419 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: legacy client fscid: -1 2020-06-27T04:41:33.419 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: 2020-06-27T04:41:33.420 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: No filesystems configured 2020-06-27T04:41:33.420 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.356+0000 7f5172d29700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2020-06-27T04:41:33.420 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.356+0000 7f5172d29700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2020-06-27T04:41:33.420 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.356+0000 7f5172d29700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2020-06-27T04:41:33.420 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.356+0000 7f5172d29700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2020-06-27T04:41:33.420 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.356+0000 7f5172d29700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2020-06-27T04:41:33.421 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.356+0000 7f5172d29700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2020-06-27T04:41:33.421 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.356+0000 7f5172d29700 1 mon.b@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2020-06-27T04:41:33.421 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.356+0000 7f5172d29700 1 mon.b@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2020-06-27T04:41:33.421 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.358+0000 7f5172d29700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2020-06-27T04:41:33.421 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.358+0000 7f5172d29700 0 mon.b@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2020-06-27T04:41:33.422 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.358+0000 7f5172d29700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2020-06-27T04:41:33.422 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: cluster 2020-06-27T04:41:31.474611+0000 mgr.y (mgr.14142) 47 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:33.422 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: audit 2020-06-27T04:41:32.174464+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:29.222978\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:33.422 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: audit 2020-06-27T04:41:32.175048+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:41:33.422 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: audit 2020-06-27T04:41:32.177551+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:29.222978\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:33.423 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: audit 2020-06-27T04:41:32.940344+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:32.939711\", \"created\": \"2020-06-27T04:41:32.144284\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:29.222978\"}}, \"last_daemon_update\": \"2020-06-27T04:41:32.939838\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:33.423 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: audit 2020-06-27T04:41:32.943151+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:32.939711\", \"created\": \"2020-06-27T04:41:32.144284\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:29.222978\"}}, \"last_daemon_update\": \"2020-06-27T04:41:32.939838\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:33.423 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: audit 2020-06-27T04:41:32.944489+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-06-27T04:41:33.424 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: audit 2020-06-27T04:41:32.945238+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:33.424 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: audit 2020-06-27T04:41:32.946436+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-06-27T04:41:33.424 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.359+0000 7f5172d29700 1 mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2020-06-27T04:41:33.439 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:33 smithi031 bash[18426]: cluster 2020-06-27T04:41:31.474611+0000 mgr.y (mgr.14142) 47 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:33.439 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:33 smithi031 bash[18426]: audit 2020-06-27T04:41:32.174464+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:29.222978\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:33.439 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:33 smithi031 bash[18426]: audit 2020-06-27T04:41:32.175048+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:41:33.440 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:33 smithi031 bash[18426]: audit 2020-06-27T04:41:32.177551+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:29.222978\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:33.440 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:33 smithi031 bash[18426]: audit 2020-06-27T04:41:32.940344+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:32.939711\", \"created\": \"2020-06-27T04:41:32.144284\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:29.222978\"}}, \"last_daemon_update\": \"2020-06-27T04:41:32.939838\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:33.440 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:33 smithi031 bash[18426]: audit 2020-06-27T04:41:32.943151+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:32.939711\", \"created\": \"2020-06-27T04:41:32.144284\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:29.222978\"}}, \"last_daemon_update\": \"2020-06-27T04:41:32.939838\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:33.440 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:33 smithi031 bash[18426]: audit 2020-06-27T04:41:32.944489+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-06-27T04:41:33.441 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:33 smithi031 bash[18426]: audit 2020-06-27T04:41:32.945238+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:33.441 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:33 smithi031 bash[18426]: audit 2020-06-27T04:41:32.946436+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-06-27T04:41:33.441 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:33 smithi031 bash[22603]: cluster 2020-06-27T04:41:31.474611+0000 mgr.y (mgr.14142) 47 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:33.441 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:33 smithi031 bash[22603]: audit 2020-06-27T04:41:32.174464+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:29.222978\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:33.442 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:33 smithi031 bash[22603]: audit 2020-06-27T04:41:32.175048+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:41:33.442 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:33 smithi031 bash[22603]: audit 2020-06-27T04:41:32.177551+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:29.222978\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:33.442 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:33 smithi031 bash[22603]: audit 2020-06-27T04:41:32.940344+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:32.939711\", \"created\": \"2020-06-27T04:41:32.144284\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:29.222978\"}}, \"last_daemon_update\": \"2020-06-27T04:41:32.939838\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:33.442 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:33 smithi031 bash[22603]: audit 2020-06-27T04:41:32.943151+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:32.939711\", \"created\": \"2020-06-27T04:41:32.144284\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:29.222978\"}}, \"last_daemon_update\": \"2020-06-27T04:41:32.939838\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:33.442 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:33 smithi031 bash[22603]: audit 2020-06-27T04:41:32.944489+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-06-27T04:41:33.443 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:33 smithi031 bash[22603]: audit 2020-06-27T04:41:32.945238+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:33.443 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:33 smithi031 bash[22603]: audit 2020-06-27T04:41:32.946436+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-06-27T04:41:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.361+0000 7f5172d29700 10 mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2020-06-27T04:41:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.361+0000 7f5172d29700 20 expand_channel_meta expand map: {default=false} 2020-06-27T04:41:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.361+0000 7f5172d29700 20 expand_channel_meta from 'false' to 'false' 2020-06-27T04:41:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.361+0000 7f5172d29700 20 expand_channel_meta expanded map: {default=false} 2020-06-27T04:41:33.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.361+0000 7f5172d29700 20 expand_channel_meta expand map: {default=info} 2020-06-27T04:41:33.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.361+0000 7f5172d29700 20 expand_channel_meta from 'info' to 'info' 2020-06-27T04:41:33.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.361+0000 7f5172d29700 20 expand_channel_meta expanded map: {default=info} 2020-06-27T04:41:33.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.361+0000 7f5172d29700 20 expand_channel_meta expand map: {default=daemon} 2020-06-27T04:41:33.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.361+0000 7f5172d29700 20 expand_channel_meta from 'daemon' to 'daemon' 2020-06-27T04:41:33.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.361+0000 7f5172d29700 20 expand_channel_meta expanded map: {default=daemon} 2020-06-27T04:41:33.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.361+0000 7f5172d29700 20 expand_channel_meta expand map: {default=debug} 2020-06-27T04:41:33.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.361+0000 7f5172d29700 20 expand_channel_meta from 'debug' to 'debug' 2020-06-27T04:41:33.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:33 smithi051 bash[18409]: debug 2020-06-27T04:41:33.361+0000 7f5172d29700 20 expand_channel_meta expanded map: {default=debug} 2020-06-27T04:41:38.446 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: cluster 2020-06-27T04:41:33.366599+0000 mon.a (mon.0) 183 : cluster [INF] mon.a calling monitor election 2020-06-27T04:41:38.446 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: cluster 2020-06-27T04:41:33.366965+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2020-06-27T04:41:38.446 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: cluster 2020-06-27T04:41:33.474920+0000 mgr.y (mgr.14142) 50 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:38.447 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: audit 2020-06-27T04:41:34.268528+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467892\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467953\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:38.447 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: audit 2020-06-27T04:41:34.364085+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-06-27T04:41:38.447 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: audit 2020-06-27T04:41:35.363680+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-06-27T04:41:38.447 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: cluster 2020-06-27T04:41:35.365003+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2020-06-27T04:41:38.447 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: cluster 2020-06-27T04:41:35.475477+0000 mgr.y (mgr.14142) 51 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:38.448 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: audit 2020-06-27T04:41:36.363851+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-06-27T04:41:38.448 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: audit 2020-06-27T04:41:37.364112+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-06-27T04:41:38.448 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: cluster 2020-06-27T04:41:37.475956+0000 mgr.y (mgr.14142) 52 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:38.448 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: audit 2020-06-27T04:41:38.364146+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-06-27T04:41:38.448 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: cluster 2020-06-27T04:41:38.380350+0000 mon.a (mon.0) 190 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2020-06-27T04:41:38.449 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: cluster 2020-06-27T04:41:38.386411+0000 mon.a (mon.0) 191 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0],b=[v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0],c=[v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0]} 2020-06-27T04:41:38.449 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: cluster 2020-06-27T04:41:38.386468+0000 mon.a (mon.0) 192 : cluster [DBG] fsmap 2020-06-27T04:41:38.449 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: cluster 2020-06-27T04:41:38.386510+0000 mon.a (mon.0) 193 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2020-06-27T04:41:38.449 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: cluster 2020-06-27T04:41:38.386744+0000 mon.a (mon.0) 194 : cluster [DBG] mgrmap e13: y(active, since 88s) 2020-06-27T04:41:38.449 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: audit 2020-06-27T04:41:38.387531+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467892\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467953\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:38.450 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: cluster 2020-06-27T04:41:38.390468+0000 mon.a (mon.0) 196 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2020-06-27T04:41:38.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: cluster 2020-06-27T04:41:33.366599+0000 mon.a (mon.0) 183 : cluster [INF] mon.a calling monitor election 2020-06-27T04:41:38.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: cluster 2020-06-27T04:41:33.366965+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2020-06-27T04:41:38.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: cluster 2020-06-27T04:41:33.474920+0000 mgr.y (mgr.14142) 50 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:38.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: audit 2020-06-27T04:41:34.268528+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467892\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467953\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:38.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: audit 2020-06-27T04:41:34.364085+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-06-27T04:41:38.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: audit 2020-06-27T04:41:35.363680+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-06-27T04:41:38.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: cluster 2020-06-27T04:41:35.365003+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2020-06-27T04:41:38.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: cluster 2020-06-27T04:41:35.475477+0000 mgr.y (mgr.14142) 51 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:38.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: audit 2020-06-27T04:41:36.363851+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-06-27T04:41:38.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: audit 2020-06-27T04:41:37.364112+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-06-27T04:41:38.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: cluster 2020-06-27T04:41:37.475956+0000 mgr.y (mgr.14142) 52 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:38.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: audit 2020-06-27T04:41:38.364146+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-06-27T04:41:38.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: cluster 2020-06-27T04:41:38.380350+0000 mon.a (mon.0) 190 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2020-06-27T04:41:38.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: cluster 2020-06-27T04:41:38.386411+0000 mon.a (mon.0) 191 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0],b=[v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0],c=[v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0]} 2020-06-27T04:41:38.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: cluster 2020-06-27T04:41:38.386468+0000 mon.a (mon.0) 192 : cluster [DBG] fsmap 2020-06-27T04:41:38.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: cluster 2020-06-27T04:41:38.386510+0000 mon.a (mon.0) 193 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2020-06-27T04:41:38.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: cluster 2020-06-27T04:41:38.386744+0000 mon.a (mon.0) 194 : cluster [DBG] mgrmap e13: y(active, since 88s) 2020-06-27T04:41:38.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: audit 2020-06-27T04:41:38.387531+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467892\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467953\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:38.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: cluster 2020-06-27T04:41:38.390468+0000 mon.a (mon.0) 196 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2020-06-27T04:41:38.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: audit 2020-06-27T04:41:38.392638+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467892\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467953\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:38.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: audit 2020-06-27T04:41:38.393404+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2020-06-27T04:41:38.723 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: audit 2020-06-27T04:41:38.394190+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:38.723 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:38 smithi051 bash[18409]: audit 2020-06-27T04:41:38.395075+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-06-27T04:41:38.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: cluster 2020-06-27T04:41:33.366599+0000 mon.a (mon.0) 183 : cluster [INF] mon.a calling monitor election 2020-06-27T04:41:38.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: cluster 2020-06-27T04:41:33.366965+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2020-06-27T04:41:38.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: cluster 2020-06-27T04:41:33.474920+0000 mgr.y (mgr.14142) 50 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:38.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: audit 2020-06-27T04:41:34.268528+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467892\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467953\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:38.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: audit 2020-06-27T04:41:34.364085+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-06-27T04:41:38.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: audit 2020-06-27T04:41:35.363680+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-06-27T04:41:38.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: cluster 2020-06-27T04:41:35.365003+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2020-06-27T04:41:38.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: cluster 2020-06-27T04:41:35.475477+0000 mgr.y (mgr.14142) 51 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:38.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: audit 2020-06-27T04:41:36.363851+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-06-27T04:41:38.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: audit 2020-06-27T04:41:37.364112+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-06-27T04:41:38.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: cluster 2020-06-27T04:41:37.475956+0000 mgr.y (mgr.14142) 52 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:38.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: audit 2020-06-27T04:41:38.364146+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-06-27T04:41:38.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: cluster 2020-06-27T04:41:38.380350+0000 mon.a (mon.0) 190 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2020-06-27T04:41:38.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: cluster 2020-06-27T04:41:38.386411+0000 mon.a (mon.0) 191 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0],b=[v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0],c=[v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0]} 2020-06-27T04:41:38.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: cluster 2020-06-27T04:41:38.386468+0000 mon.a (mon.0) 192 : cluster [DBG] fsmap 2020-06-27T04:41:38.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: cluster 2020-06-27T04:41:38.386510+0000 mon.a (mon.0) 193 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2020-06-27T04:41:38.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: cluster 2020-06-27T04:41:38.386744+0000 mon.a (mon.0) 194 : cluster [DBG] mgrmap e13: y(active, since 88s) 2020-06-27T04:41:38.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: audit 2020-06-27T04:41:38.387531+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467892\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467953\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:38.729 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: cluster 2020-06-27T04:41:38.390468+0000 mon.a (mon.0) 196 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2020-06-27T04:41:38.729 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: audit 2020-06-27T04:41:38.392638+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467892\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467953\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:38.729 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: audit 2020-06-27T04:41:38.393404+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2020-06-27T04:41:38.729 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: audit 2020-06-27T04:41:38.394190+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:38.730 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[22603]: audit 2020-06-27T04:41:38.395075+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-06-27T04:41:38.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: audit 2020-06-27T04:41:38.392638+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467892\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467953\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:40:21.203620\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:38.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: audit 2020-06-27T04:41:38.393404+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2020-06-27T04:41:38.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: audit 2020-06-27T04:41:38.394190+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:38.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:38 smithi031 bash[18426]: audit 2020-06-27T04:41:38.395075+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-06-27T04:41:38.873 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.869+0000 7f3029261700 1 Processor -- start 2020-06-27T04:41:38.873 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.869+0000 7f3029261700 1 -- start start 2020-06-27T04:41:38.873 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.869+0000 7f3029261700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3024068500 0x7f3024120ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:38.873 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.869+0000 7f3029261700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3024121220 con 0x7f3024068500 2020-06-27T04:41:38.874 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.869+0000 7f30237fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3024068500 0x7f3024120ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:38.874 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.869+0000 7f30237fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3024068500 0x7f3024120ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.51:34196/0 (socket says 172.21.15.51:34196) 2020-06-27T04:41:38.874 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.869+0000 7f30237fe700 1 -- 172.21.15.51:0/3880015577 learned_addr learned my addr 172.21.15.51:0/3880015577 (peer_addr_for_me v2:172.21.15.51:0/0) 2020-06-27T04:41:38.874 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.870+0000 7f30237fe700 1 -- 172.21.15.51:0/3880015577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3024121360 con 0x7f3024068500 2020-06-27T04:41:38.874 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.870+0000 7f30237fe700 1 --2- 172.21.15.51:0/3880015577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3024068500 0x7f3024120ca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f300c001ea0 tx=0x7f300c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:38.875 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.870+0000 7f301b7fe700 1 -- 172.21.15.51:0/3880015577 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f300c023630 con 0x7f3024068500 2020-06-27T04:41:38.875 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.870+0000 7f301b7fe700 1 -- 172.21.15.51:0/3880015577 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f300c00f040 con 0x7f3024068500 2020-06-27T04:41:38.875 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.870+0000 7f3029261700 1 -- 172.21.15.51:0/3880015577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30241215b0 con 0x7f3024068500 2020-06-27T04:41:38.875 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.870+0000 7f301b7fe700 1 -- 172.21.15.51:0/3880015577 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f300c019900 con 0x7f3024068500 2020-06-27T04:41:38.875 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.870+0000 7f3029261700 1 -- 172.21.15.51:0/3880015577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30241219e0 con 0x7f3024068500 2020-06-27T04:41:38.876 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.871+0000 7f301b7fe700 1 -- 172.21.15.51:0/3880015577 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f300c034070 con 0x7f3024068500 2020-06-27T04:41:38.877 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.871+0000 7f301b7fe700 1 --2- 172.21.15.51:0/3880015577 >> v2:172.21.15.31:6800/1241213118 conn(0x7f2ffc02af90 0x7f2ffc02d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:38.877 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.871+0000 7f301b7fe700 1 -- 172.21.15.51:0/3880015577 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1498+0+0 (secure 0 0 0) 0x7f300c03e6b0 con 0x7f3024068500 2020-06-27T04:41:38.877 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.871+0000 7f3022ffd700 1 --2- 172.21.15.51:0/3880015577 >> v2:172.21.15.31:6800/1241213118 conn(0x7f2ffc02af90 0x7f2ffc02d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:38.877 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.871+0000 7f3029261700 1 -- 172.21.15.51:0/3880015577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3024057340 con 0x7f3024068500 2020-06-27T04:41:38.877 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.872+0000 7f3022ffd700 1 --2- 172.21.15.51:0/3880015577 >> v2:172.21.15.31:6800/1241213118 conn(0x7f2ffc02af90 0x7f2ffc02d450 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f3014002f70 tx=0x7f3014006b20).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:38.878 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:38.876+0000 7f301b7fe700 1 -- 172.21.15.51:0/3880015577 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f300c021d70 con 0x7f3024068500 2020-06-27T04:41:39.094 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:39.091+0000 7f3029261700 1 -- 172.21.15.51:0/3880015577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3024043e80 con 0x7f3024068500 2020-06-27T04:41:39.094 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:39.091+0000 7f301b7fe700 1 -- 172.21.15.51:0/3880015577 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1061 (secure 0 0 0) 0x7f300c021330 con 0x7f3024068500 2020-06-27T04:41:39.095 INFO:teuthology.orchestra.run.smithi051.stdout: 2020-06-27T04:41:39.095 INFO:teuthology.orchestra.run.smithi051.stdout:{"epoch":3,"fsid":"12892ae2-b830-11ea-a06d-001a4aab830c","modified":"2020-06-27T04:41:33.363912Z","created":"2020-06-27T04:39:34.169049Z","min_mon_release":16,"min_mon_release_name":"pacific","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3301","nonce":0},{"type":"v1","addr":"172.21.15.31:6790","nonce":0}]},"addr":"172.21.15.31:6790/0","public_addr":"172.21.15.31:6790/0","priority":0,"weight":0},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:3300","nonce":0},{"type":"v1","addr":"172.21.15.51:6789","nonce":0}]},"addr":"172.21.15.51:6789/0","public_addr":"172.21.15.51:6789/0","priority":0,"weight":0}],"quorum":[0,1,2]} 2020-06-27T04:41:39.097 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:39.093+0000 7f3029261700 1 -- 172.21.15.51:0/3880015577 >> v2:172.21.15.31:6800/1241213118 conn(0x7f2ffc02af90 msgr2=0x7f2ffc02d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:39.097 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:39.093+0000 7f3029261700 1 --2- 172.21.15.51:0/3880015577 >> v2:172.21.15.31:6800/1241213118 conn(0x7f2ffc02af90 0x7f2ffc02d450 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f3014002f70 tx=0x7f3014006b20).stop 2020-06-27T04:41:39.097 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:39.093+0000 7f3029261700 1 -- 172.21.15.51:0/3880015577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3024068500 msgr2=0x7f3024120ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:39.098 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:39.093+0000 7f3029261700 1 --2- 172.21.15.51:0/3880015577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3024068500 0x7f3024120ca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f300c001ea0 tx=0x7f300c009040).stop 2020-06-27T04:41:39.098 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:39.093+0000 7f3029261700 1 -- 172.21.15.51:0/3880015577 shutdown_connections 2020-06-27T04:41:39.098 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:39.093+0000 7f3029261700 1 --2- 172.21.15.51:0/3880015577 >> v2:172.21.15.31:6800/1241213118 conn(0x7f2ffc02af90 0x7f2ffc02d450 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:39.099 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:39.093+0000 7f3029261700 1 --2- 172.21.15.51:0/3880015577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3024068500 0x7f3024120ca0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:39.099 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:39.093+0000 7f3029261700 1 -- 172.21.15.51:0/3880015577 >> 172.21.15.51:0/3880015577 conn(0x7f3024061430 msgr2=0x7f3024063ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:41:39.099 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:39.093+0000 7f3029261700 1 -- 172.21.15.51:0/3880015577 shutdown_connections 2020-06-27T04:41:39.100 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:39.093+0000 7f3029261700 1 -- 172.21.15.51:0/3880015577 wait complete. 2020-06-27T04:41:39.100 INFO:teuthology.orchestra.run.smithi051.stderr:dumped monmap epoch 3 2020-06-27T04:41:39.659 INFO:tasks.cephadm:Generating final ceph.conf file... 2020-06-27T04:41:39.660 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph config generate-minimal-conf 2020-06-27T04:41:39.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:39 smithi051 bash[18409]: cephadm 2020-06-27T04:41:38.393139+0000 mgr.y (mgr.14142) 53 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2020-06-27T04:41:39.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:39 smithi051 bash[18409]: cephadm 2020-06-27T04:41:38.394774+0000 mgr.y (mgr.14142) 54 : cephadm [INF] Reconfiguring daemon mgr.y on smithi031 2020-06-27T04:41:39.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:39 smithi051 bash[18409]: audit 2020-06-27T04:41:39.091895+0000 mon.a (mon.0) 201 : audit [DBG] from='client.? 172.21.15.51:0/3880015577' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2020-06-27T04:41:39.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:39 smithi051 bash[18409]: audit 2020-06-27T04:41:39.364512+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-06-27T04:41:39.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:39 smithi031 bash[18426]: cephadm 2020-06-27T04:41:38.393139+0000 mgr.y (mgr.14142) 53 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2020-06-27T04:41:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:39 smithi031 bash[18426]: cephadm 2020-06-27T04:41:38.394774+0000 mgr.y (mgr.14142) 54 : cephadm [INF] Reconfiguring daemon mgr.y on smithi031 2020-06-27T04:41:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:39 smithi031 bash[18426]: audit 2020-06-27T04:41:39.091895+0000 mon.a (mon.0) 201 : audit [DBG] from='client.? 172.21.15.51:0/3880015577' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2020-06-27T04:41:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:39 smithi031 bash[18426]: audit 2020-06-27T04:41:39.364512+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-06-27T04:41:39.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:39 smithi031 bash[22603]: cephadm 2020-06-27T04:41:38.393139+0000 mgr.y (mgr.14142) 53 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2020-06-27T04:41:39.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:39 smithi031 bash[22603]: cephadm 2020-06-27T04:41:38.394774+0000 mgr.y (mgr.14142) 54 : cephadm [INF] Reconfiguring daemon mgr.y on smithi031 2020-06-27T04:41:39.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:39 smithi031 bash[22603]: audit 2020-06-27T04:41:39.091895+0000 mon.a (mon.0) 201 : audit [DBG] from='client.? 172.21.15.51:0/3880015577' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2020-06-27T04:41:39.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:39 smithi031 bash[22603]: audit 2020-06-27T04:41:39.364512+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-06-27T04:41:40.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:40 smithi051 bash[18409]: cluster 2020-06-27T04:41:39.476388+0000 mgr.y (mgr.14142) 55 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:40.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:40 smithi051 bash[18409]: audit 2020-06-27T04:41:39.636093+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467953\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:40.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:40 smithi051 bash[18409]: audit 2020-06-27T04:41:39.640909+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467953\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:40.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:40 smithi051 bash[18409]: cephadm 2020-06-27T04:41:39.641235+0000 mgr.y (mgr.14142) 56 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2020-06-27T04:41:40.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:40 smithi051 bash[18409]: audit 2020-06-27T04:41:39.641430+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-06-27T04:41:40.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:40 smithi051 bash[18409]: audit 2020-06-27T04:41:39.641970+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:40.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:40 smithi051 bash[18409]: cephadm 2020-06-27T04:41:39.642381+0000 mgr.y (mgr.14142) 57 : cephadm [INF] Reconfiguring daemon mon.c on smithi031 2020-06-27T04:41:40.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:40 smithi051 bash[18409]: audit 2020-06-27T04:41:39.642710+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2020-06-27T04:41:40.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:40 smithi031 bash[18426]: cluster 2020-06-27T04:41:39.476388+0000 mgr.y (mgr.14142) 55 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:40.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:40 smithi031 bash[18426]: audit 2020-06-27T04:41:39.636093+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467953\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:40.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:40 smithi031 bash[18426]: audit 2020-06-27T04:41:39.640909+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467953\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:40.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:40 smithi031 bash[18426]: cephadm 2020-06-27T04:41:39.641235+0000 mgr.y (mgr.14142) 56 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2020-06-27T04:41:40.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:40 smithi031 bash[18426]: audit 2020-06-27T04:41:39.641430+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-06-27T04:41:40.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:40 smithi031 bash[18426]: audit 2020-06-27T04:41:39.641970+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:40.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:40 smithi031 bash[18426]: cephadm 2020-06-27T04:41:39.642381+0000 mgr.y (mgr.14142) 57 : cephadm [INF] Reconfiguring daemon mon.c on smithi031 2020-06-27T04:41:40.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:40 smithi031 bash[18426]: audit 2020-06-27T04:41:39.642710+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2020-06-27T04:41:40.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:40 smithi031 bash[22603]: cluster 2020-06-27T04:41:39.476388+0000 mgr.y (mgr.14142) 55 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:40.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:40 smithi031 bash[22603]: audit 2020-06-27T04:41:39.636093+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467953\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:40.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:40 smithi031 bash[22603]: audit 2020-06-27T04:41:39.640909+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:21.467953\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:17.587914\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:40.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:40 smithi031 bash[22603]: cephadm 2020-06-27T04:41:39.641235+0000 mgr.y (mgr.14142) 56 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2020-06-27T04:41:40.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:40 smithi031 bash[22603]: audit 2020-06-27T04:41:39.641430+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-06-27T04:41:40.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:40 smithi031 bash[22603]: audit 2020-06-27T04:41:39.641970+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:40.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:40 smithi031 bash[22603]: cephadm 2020-06-27T04:41:39.642381+0000 mgr.y (mgr.14142) 57 : cephadm [INF] Reconfiguring daemon mon.c on smithi031 2020-06-27T04:41:40.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:40 smithi031 bash[22603]: audit 2020-06-27T04:41:39.642710+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2020-06-27T04:41:41.372 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.370+0000 7fc44398c700 1 Processor -- start 2020-06-27T04:41:41.373 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.370+0000 7fc44398c700 1 -- start start 2020-06-27T04:41:41.373 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.370+0000 7fc44398c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc43c073100 0x7fc43c073520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:41.373 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.370+0000 7fc44398c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c073aa0 con 0x7fc43c073100 2020-06-27T04:41:41.374 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.370+0000 7fc441f29700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc43c073100 0x7fc43c073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:41.374 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.370+0000 7fc441f29700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc43c073100 0x7fc43c073520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.51:34206/0 (socket says 172.21.15.51:34206) 2020-06-27T04:41:41.374 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.370+0000 7fc441f29700 1 -- 172.21.15.51:0/3621388528 learned_addr learned my addr 172.21.15.51:0/3621388528 (peer_addr_for_me v2:172.21.15.51:0/0) 2020-06-27T04:41:41.374 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.370+0000 7fc441f29700 1 -- 172.21.15.51:0/3621388528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c073be0 con 0x7fc43c073100 2020-06-27T04:41:41.375 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.371+0000 7fc441f29700 1 --2- 172.21.15.51:0/3621388528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc43c073100 0x7fc43c073520 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc4300032f0 tx=0x7fc430004cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:41.376 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.371+0000 7fc42dffb700 1 -- 172.21.15.51:0/3621388528 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc43000e070 con 0x7fc43c073100 2020-06-27T04:41:41.376 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.371+0000 7fc44398c700 1 -- 172.21.15.51:0/3621388528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43c074570 con 0x7fc43c073100 2020-06-27T04:41:41.376 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.371+0000 7fc42dffb700 1 -- 172.21.15.51:0/3621388528 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fc4300094d0 con 0x7fc43c073100 2020-06-27T04:41:41.376 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.371+0000 7fc42dffb700 1 -- 172.21.15.51:0/3621388528 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc430018070 con 0x7fc43c073100 2020-06-27T04:41:41.377 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.371+0000 7fc44398c700 1 -- 172.21.15.51:0/3621388528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c074a00 con 0x7fc43c073100 2020-06-27T04:41:41.377 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.372+0000 7fc42dffb700 1 -- 172.21.15.51:0/3621388528 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 31843+0+0 (secure 0 0 0) 0x7fc430024060 con 0x7fc43c073100 2020-06-27T04:41:41.377 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.372+0000 7fc42dffb700 1 --2- 172.21.15.51:0/3621388528 >> v2:172.21.15.31:6800/1241213118 conn(0x7fc41802af40 0x7fc41802d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:41.377 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.372+0000 7fc42dffb700 1 -- 172.21.15.51:0/3621388528 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1498+0+0 (secure 0 0 0) 0x7fc43003bb00 con 0x7fc43c073100 2020-06-27T04:41:41.377 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.372+0000 7fc44398c700 1 -- 172.21.15.51:0/3621388528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43c073d70 con 0x7fc43c073100 2020-06-27T04:41:41.378 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.372+0000 7fc441728700 1 --2- 172.21.15.51:0/3621388528 >> v2:172.21.15.31:6800/1241213118 conn(0x7fc41802af40 0x7fc41802d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:41.378 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.372+0000 7fc441728700 1 --2- 172.21.15.51:0/3621388528 >> v2:172.21.15.31:6800/1241213118 conn(0x7fc41802af40 0x7fc41802d400 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fc438002f70 tx=0x7fc438006b20).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:41.381 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.379+0000 7fc42dffb700 1 -- 172.21.15.51:0/3621388528 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fc430003330 con 0x7fc43c073100 2020-06-27T04:41:41.533 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.530+0000 7fc44398c700 1 -- 172.21.15.51:0/3621388528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fc43c057340 con 0x7fc43c073100 2020-06-27T04:41:41.533 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.531+0000 7fc42dffb700 1 -- 172.21.15.51:0/3621388528 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v7) v1 ==== 76+0+271 (secure 0 0 0) 0x7fc430003330 con 0x7fc43c073100 2020-06-27T04:41:41.534 INFO:teuthology.orchestra.run.smithi051.stdout:# minimal ceph.conf for 12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:41:41.534 INFO:teuthology.orchestra.run.smithi051.stdout:[global] 2020-06-27T04:41:41.534 INFO:teuthology.orchestra.run.smithi051.stdout: fsid = 12892ae2-b830-11ea-a06d-001a4aab830c 2020-06-27T04:41:41.534 INFO:teuthology.orchestra.run.smithi051.stdout: mon_host = [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 2020-06-27T04:41:41.535 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.532+0000 7fc44398c700 1 -- 172.21.15.51:0/3621388528 >> v2:172.21.15.31:6800/1241213118 conn(0x7fc41802af40 msgr2=0x7fc41802d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:41.536 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.532+0000 7fc44398c700 1 --2- 172.21.15.51:0/3621388528 >> v2:172.21.15.31:6800/1241213118 conn(0x7fc41802af40 0x7fc41802d400 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fc438002f70 tx=0x7fc438006b20).stop 2020-06-27T04:41:41.536 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.533+0000 7fc44398c700 1 -- 172.21.15.51:0/3621388528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc43c073100 msgr2=0x7fc43c073520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:41.536 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.533+0000 7fc44398c700 1 --2- 172.21.15.51:0/3621388528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc43c073100 0x7fc43c073520 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc4300032f0 tx=0x7fc430004cf0).stop 2020-06-27T04:41:41.536 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.533+0000 7fc44398c700 1 -- 172.21.15.51:0/3621388528 shutdown_connections 2020-06-27T04:41:41.536 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.533+0000 7fc44398c700 1 --2- 172.21.15.51:0/3621388528 >> v2:172.21.15.31:6800/1241213118 conn(0x7fc41802af40 0x7fc41802d400 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:41.537 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.533+0000 7fc44398c700 1 --2- 172.21.15.51:0/3621388528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc43c073100 0x7fc43c073520 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:41.537 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.533+0000 7fc44398c700 1 -- 172.21.15.51:0/3621388528 >> 172.21.15.51:0/3621388528 conn(0x7fc43c061430 msgr2=0x7fc43c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:41:41.537 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.533+0000 7fc44398c700 1 -- 172.21.15.51:0/3621388528 shutdown_connections 2020-06-27T04:41:41.537 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:41.533+0000 7fc44398c700 1 -- 172.21.15.51:0/3621388528 wait complete. 2020-06-27T04:41:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:41 smithi051 bash[18409]: audit 2020-06-27T04:41:40.932198+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:41 smithi051 bash[18409]: audit 2020-06-27T04:41:40.936958+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:41 smithi051 bash[18409]: audit 2020-06-27T04:41:40.937784+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:41:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:41 smithi031 bash[18426]: audit 2020-06-27T04:41:40.932198+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:41 smithi031 bash[18426]: audit 2020-06-27T04:41:40.936958+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:41 smithi031 bash[18426]: audit 2020-06-27T04:41:40.937784+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:41:41.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:41 smithi031 bash[22603]: audit 2020-06-27T04:41:40.932198+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:41.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:41 smithi031 bash[22603]: audit 2020-06-27T04:41:40.936958+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:41.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:41 smithi031 bash[22603]: audit 2020-06-27T04:41:40.937784+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:41:42.011 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2020-06-27T04:41:42.011 INFO:teuthology.orchestra.run.smithi031:> sudo sh -c 'cat > /etc/ceph/ceph.conf' 2020-06-27T04:41:42.057 INFO:teuthology.orchestra.run.smithi031:> sudo sh -c 'cat > /etc/ceph/ceph.client.admin.keyring' 2020-06-27T04:41:42.142 INFO:teuthology.orchestra.run.smithi051:> sudo sh -c 'cat > /etc/ceph/ceph.conf' 2020-06-27T04:41:42.187 INFO:teuthology.orchestra.run.smithi051:> sudo sh -c 'cat > /etc/ceph/ceph.client.admin.keyring' 2020-06-27T04:41:42.274 INFO:tasks.cephadm:Adding mgr.x on smithi051 2020-06-27T04:41:42.275 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph orch apply mgr '2;smithi051=x' 2020-06-27T04:41:42.468 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:42 smithi031 bash[18426]: cluster 2020-06-27T04:41:41.476692+0000 mgr.y (mgr.14142) 58 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:42.468 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:42 smithi031 bash[18426]: audit 2020-06-27T04:41:41.531618+0000 mon.a (mon.0) 211 : audit [DBG] from='client.? 172.21.15.51:0/3621388528' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:42.468 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:42 smithi031 bash[18426]: audit 2020-06-27T04:41:41.691467+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690718\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690791\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690825\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:41:41.690895\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:42.468 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:42 smithi031 bash[18426]: audit 2020-06-27T04:41:41.695850+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690718\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690791\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690825\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:41:41.690895\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:42.469 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:42 smithi031 bash[18426]: cephadm 2020-06-27T04:41:41.696567+0000 mgr.y (mgr.14142) 59 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2020-06-27T04:41:42.469 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:42 smithi031 bash[18426]: audit 2020-06-27T04:41:41.696777+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-06-27T04:41:42.469 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:42 smithi031 bash[18426]: audit 2020-06-27T04:41:41.697402+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:42.469 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:42 smithi031 bash[18426]: cephadm 2020-06-27T04:41:41.697880+0000 mgr.y (mgr.14142) 60 : cephadm [INF] Reconfiguring daemon mon.a on smithi031 2020-06-27T04:41:42.470 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:42 smithi031 bash[18426]: audit 2020-06-27T04:41:41.698230+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-06-27T04:41:42.663 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:42 smithi051 bash[18409]: cluster 2020-06-27T04:41:41.476692+0000 mgr.y (mgr.14142) 58 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:42.663 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:42 smithi051 bash[18409]: audit 2020-06-27T04:41:41.531618+0000 mon.a (mon.0) 211 : audit [DBG] from='client.? 172.21.15.51:0/3621388528' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:42.663 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:42 smithi051 bash[18409]: audit 2020-06-27T04:41:41.691467+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690718\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690791\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690825\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:41:41.690895\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:42.664 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:42 smithi051 bash[18409]: audit 2020-06-27T04:41:41.695850+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690718\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690791\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690825\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:41:41.690895\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:42.664 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:42 smithi051 bash[18409]: cephadm 2020-06-27T04:41:41.696567+0000 mgr.y (mgr.14142) 59 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2020-06-27T04:41:42.664 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:42 smithi051 bash[18409]: audit 2020-06-27T04:41:41.696777+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-06-27T04:41:42.664 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:42 smithi051 bash[18409]: audit 2020-06-27T04:41:41.697402+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:42.665 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:42 smithi051 bash[18409]: cephadm 2020-06-27T04:41:41.697880+0000 mgr.y (mgr.14142) 60 : cephadm [INF] Reconfiguring daemon mon.a on smithi031 2020-06-27T04:41:42.665 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:42 smithi051 bash[18409]: audit 2020-06-27T04:41:41.698230+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-06-27T04:41:42.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:42 smithi031 bash[22603]: cluster 2020-06-27T04:41:41.476692+0000 mgr.y (mgr.14142) 58 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:42.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:42 smithi031 bash[22603]: audit 2020-06-27T04:41:41.531618+0000 mon.a (mon.0) 211 : audit [DBG] from='client.? 172.21.15.51:0/3621388528' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:42.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:42 smithi031 bash[22603]: audit 2020-06-27T04:41:41.691467+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690718\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690791\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690825\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:41:41.690895\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:42.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:42 smithi031 bash[22603]: audit 2020-06-27T04:41:41.695850+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690718\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690791\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690825\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:32.944269\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:41:41.690895\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:42.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:42 smithi031 bash[22603]: cephadm 2020-06-27T04:41:41.696567+0000 mgr.y (mgr.14142) 59 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2020-06-27T04:41:42.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:42 smithi031 bash[22603]: audit 2020-06-27T04:41:41.696777+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-06-27T04:41:42.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:42 smithi031 bash[22603]: audit 2020-06-27T04:41:41.697402+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:42.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:42 smithi031 bash[22603]: cephadm 2020-06-27T04:41:41.697880+0000 mgr.y (mgr.14142) 60 : cephadm [INF] Reconfiguring daemon mon.a on smithi031 2020-06-27T04:41:42.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:42 smithi031 bash[22603]: audit 2020-06-27T04:41:41.698230+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-06-27T04:41:43.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:43 smithi031 bash[18426]: audit 2020-06-27T04:41:43.067391+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690791\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690825\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:43.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:43 smithi031 bash[18426]: audit 2020-06-27T04:41:43.070109+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690791\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690825\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:43.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:43 smithi031 bash[18426]: cephadm 2020-06-27T04:41:43.070431+0000 mgr.y (mgr.14142) 61 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2020-06-27T04:41:43.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:43 smithi031 bash[18426]: audit 2020-06-27T04:41:43.070614+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-06-27T04:41:43.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:43 smithi031 bash[18426]: audit 2020-06-27T04:41:43.071151+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:43.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:43 smithi031 bash[18426]: cephadm 2020-06-27T04:41:43.071599+0000 mgr.y (mgr.14142) 62 : cephadm [INF] Reconfiguring daemon mon.b on smithi051 2020-06-27T04:41:43.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:43 smithi031 bash[18426]: audit 2020-06-27T04:41:43.071855+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2020-06-27T04:41:43.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:43 smithi031 bash[22603]: audit 2020-06-27T04:41:43.067391+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690791\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690825\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:43.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:43 smithi031 bash[22603]: audit 2020-06-27T04:41:43.070109+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690791\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690825\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:43.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:43 smithi031 bash[22603]: cephadm 2020-06-27T04:41:43.070431+0000 mgr.y (mgr.14142) 61 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2020-06-27T04:41:43.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:43 smithi031 bash[22603]: audit 2020-06-27T04:41:43.070614+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-06-27T04:41:43.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:43 smithi031 bash[22603]: audit 2020-06-27T04:41:43.071151+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:43.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:43 smithi031 bash[22603]: cephadm 2020-06-27T04:41:43.071599+0000 mgr.y (mgr.14142) 62 : cephadm [INF] Reconfiguring daemon mon.b on smithi051 2020-06-27T04:41:43.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:43 smithi031 bash[22603]: audit 2020-06-27T04:41:43.071855+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2020-06-27T04:41:43.728 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:43 smithi051 bash[18409]: audit 2020-06-27T04:41:43.067391+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690791\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690825\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:43.729 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:43 smithi051 bash[18409]: audit 2020-06-27T04:41:43.070109+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690791\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:41.690825\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:43.729 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:43 smithi051 bash[18409]: cephadm 2020-06-27T04:41:43.070431+0000 mgr.y (mgr.14142) 61 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2020-06-27T04:41:43.729 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:43 smithi051 bash[18409]: audit 2020-06-27T04:41:43.070614+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-06-27T04:41:43.729 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:43 smithi051 bash[18409]: audit 2020-06-27T04:41:43.071151+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:43.730 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:43 smithi051 bash[18409]: cephadm 2020-06-27T04:41:43.071599+0000 mgr.y (mgr.14142) 62 : cephadm [INF] Reconfiguring daemon mon.b on smithi051 2020-06-27T04:41:43.730 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:43 smithi051 bash[18409]: audit 2020-06-27T04:41:43.071855+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2020-06-27T04:41:44.164 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.160+0000 7fc83ee76700 1 Processor -- start 2020-06-27T04:41:44.164 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.160+0000 7fc83ee76700 1 -- start start 2020-06-27T04:41:44.164 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.160+0000 7fc83ee76700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc838066360 0x7fc838073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:44.165 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.160+0000 7fc83ee76700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc83806be30 0x7fc8380787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:44.165 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.160+0000 7fc83ee76700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc838073910 0x7fc838120ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:44.165 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.160+0000 7fc83ee76700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc838121190 con 0x7fc838073910 2020-06-27T04:41:44.165 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.160+0000 7fc83ee76700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8381212d0 con 0x7fc83806be30 2020-06-27T04:41:44.165 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.160+0000 7fc83ee76700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc838121410 con 0x7fc838066360 2020-06-27T04:41:44.166 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.160+0000 7fc83cc12700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc83806be30 0x7fc8380787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:44.166 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.161+0000 7fc83cc12700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc83806be30 0x7fc8380787e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.51:3300/0 says I am v2:172.21.15.51:49748/0 (socket says 172.21.15.51:49748) 2020-06-27T04:41:44.166 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.161+0000 7fc83cc12700 1 -- 172.21.15.51:0/126563798 learned_addr learned my addr 172.21.15.51:0/126563798 (peer_addr_for_me v2:172.21.15.51:0/0) 2020-06-27T04:41:44.166 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.161+0000 7fc83dc14700 1 --2- 172.21.15.51:0/126563798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc838073910 0x7fc838120ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:44.167 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.161+0000 7fc83d413700 1 --2- 172.21.15.51:0/126563798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc838066360 0x7fc838073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:44.167 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.161+0000 7fc83cc12700 1 -- 172.21.15.51:0/126563798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc838066360 msgr2=0x7fc838073220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:44.167 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.161+0000 7fc83cc12700 1 --2- 172.21.15.51:0/126563798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc838066360 0x7fc838073220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:44.167 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.161+0000 7fc83cc12700 1 -- 172.21.15.51:0/126563798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc838073910 msgr2=0x7fc838120ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:44.167 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.161+0000 7fc83cc12700 1 --2- 172.21.15.51:0/126563798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc838073910 0x7fc838120ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:44.168 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.161+0000 7fc83cc12700 1 -- 172.21.15.51:0/126563798 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc838121580 con 0x7fc83806be30 2020-06-27T04:41:44.168 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.161+0000 7fc83cc12700 1 --2- 172.21.15.51:0/126563798 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc83806be30 0x7fc8380787e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fc82c004370 tx=0x7fc82c00b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:44.168 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.161+0000 7fc8357fa700 1 -- 172.21.15.51:0/126563798 <== mon.2 v2:172.21.15.51:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc82c0094d0 con 0x7fc83806be30 2020-06-27T04:41:44.168 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.161+0000 7fc8357fa700 1 -- 172.21.15.51:0/126563798 <== mon.2 v2:172.21.15.51:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fc82c00f040 con 0x7fc83806be30 2020-06-27T04:41:44.169 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.161+0000 7fc83ee76700 1 -- 172.21.15.51:0/126563798 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8381217d0 con 0x7fc83806be30 2020-06-27T04:41:44.169 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.161+0000 7fc8357fa700 1 -- 172.21.15.51:0/126563798 <== mon.2 v2:172.21.15.51:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc82c00ca60 con 0x7fc83806be30 2020-06-27T04:41:44.169 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.161+0000 7fc83ee76700 1 -- 172.21.15.51:0/126563798 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc838121d40 con 0x7fc83806be30 2020-06-27T04:41:44.170 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.162+0000 7fc8357fa700 1 -- 172.21.15.51:0/126563798 <== mon.2 v2:172.21.15.51:3300/0 4 ==== mgrmap(e 13) v1 ==== 31843+0+0 (secure 0 0 0) 0x7fc82c00cbc0 con 0x7fc83806be30 2020-06-27T04:41:44.170 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.162+0000 7fc8357fa700 1 --2- 172.21.15.51:0/126563798 >> v2:172.21.15.31:6800/1241213118 conn(0x7fc81402ab50 0x7fc81402d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:44.170 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.162+0000 7fc8357fa700 1 -- 172.21.15.51:0/126563798 <== mon.2 v2:172.21.15.51:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1498+0+0 (secure 0 0 0) 0x7fc82c039a30 con 0x7fc83806be30 2020-06-27T04:41:44.171 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.162+0000 7fc83d413700 1 --2- 172.21.15.51:0/126563798 >> v2:172.21.15.31:6800/1241213118 conn(0x7fc81402ab50 0x7fc81402d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:44.171 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.162+0000 7fc83ee76700 1 -- 172.21.15.51:0/126563798 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83805e210 con 0x7fc83806be30 2020-06-27T04:41:44.171 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.163+0000 7fc83d413700 1 --2- 172.21.15.51:0/126563798 >> v2:172.21.15.31:6800/1241213118 conn(0x7fc81402ab50 0x7fc81402d010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fc828016000 tx=0x7fc828004cf0).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:44.171 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.166+0000 7fc8357fa700 1 -- 172.21.15.51:0/126563798 <== mon.2 v2:172.21.15.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fc82c019030 con 0x7fc83806be30 2020-06-27T04:41:44.349 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.346+0000 7fc83ee76700 1 -- 172.21.15.51:0/126563798 --> v2:172.21.15.31:6800/1241213118 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi051=x", "target": ["mon-mgr", ""]}) v1 -- 0x7fc83805f390 con 0x7fc81402ab50 2020-06-27T04:41:44.354 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.352+0000 7fc8357fa700 1 -- 172.21.15.51:0/126563798 <== mgr.14142 v2:172.21.15.31:6800/1241213118 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc8280092e0 con 0x7fc81402ab50 2020-06-27T04:41:44.355 INFO:teuthology.orchestra.run.smithi051.stdout:Scheduled mgr update... 2020-06-27T04:41:44.356 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.353+0000 7fc83ee76700 1 -- 172.21.15.51:0/126563798 >> v2:172.21.15.31:6800/1241213118 conn(0x7fc81402ab50 msgr2=0x7fc81402d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:44.356 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.353+0000 7fc83ee76700 1 --2- 172.21.15.51:0/126563798 >> v2:172.21.15.31:6800/1241213118 conn(0x7fc81402ab50 0x7fc81402d010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fc828016000 tx=0x7fc828004cf0).stop 2020-06-27T04:41:44.356 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.353+0000 7fc83ee76700 1 -- 172.21.15.51:0/126563798 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc83806be30 msgr2=0x7fc8380787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:44.357 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.353+0000 7fc83ee76700 1 --2- 172.21.15.51:0/126563798 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc83806be30 0x7fc8380787e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fc82c004370 tx=0x7fc82c00b040).stop 2020-06-27T04:41:44.357 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.353+0000 7fc83ee76700 1 -- 172.21.15.51:0/126563798 shutdown_connections 2020-06-27T04:41:44.357 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.353+0000 7fc83ee76700 1 --2- 172.21.15.51:0/126563798 >> v2:172.21.15.31:6800/1241213118 conn(0x7fc81402ab50 0x7fc81402d010 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:44.357 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.353+0000 7fc83ee76700 1 --2- 172.21.15.51:0/126563798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc838073910 0x7fc838120ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:44.357 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.353+0000 7fc83ee76700 1 --2- 172.21.15.51:0/126563798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc838066360 0x7fc838073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:44.358 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.353+0000 7fc83ee76700 1 --2- 172.21.15.51:0/126563798 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc83806be30 0x7fc8380787e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:44.358 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.353+0000 7fc83ee76700 1 -- 172.21.15.51:0/126563798 >> 172.21.15.51:0/126563798 conn(0x7fc838061830 msgr2=0x7fc83806b530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:41:44.358 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.354+0000 7fc83ee76700 1 -- 172.21.15.51:0/126563798 shutdown_connections 2020-06-27T04:41:44.358 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:41:44.354+0000 7fc83ee76700 1 -- 172.21.15.51:0/126563798 wait complete. 2020-06-27T04:41:44.680 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:44 smithi051 bash[18409]: cluster 2020-06-27T04:41:43.477101+0000 mgr.y (mgr.14142) 63 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:44.680 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:44 smithi051 bash[18409]: audit 2020-06-27T04:41:44.349259+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-06-27T04:41:44.348878\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"x\", \"network\": \"\"}]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2020-06-27T04:41:44.680 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:44 smithi051 bash[18409]: audit 2020-06-27T04:41:44.352241+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-06-27T04:41:44.348878\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"x\", \"network\": \"\"}]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2020-06-27T04:41:44.972 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:44 smithi031 bash[22603]: cluster 2020-06-27T04:41:43.477101+0000 mgr.y (mgr.14142) 63 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:44 smithi031 bash[22603]: audit 2020-06-27T04:41:44.349259+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-06-27T04:41:44.348878\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"x\", \"network\": \"\"}]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2020-06-27T04:41:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:44 smithi031 bash[22603]: audit 2020-06-27T04:41:44.352241+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-06-27T04:41:44.348878\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"x\", \"network\": \"\"}]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2020-06-27T04:41:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:44 smithi031 bash[18426]: cluster 2020-06-27T04:41:43.477101+0000 mgr.y (mgr.14142) 63 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:44.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:44 smithi031 bash[18426]: audit 2020-06-27T04:41:44.349259+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-06-27T04:41:44.348878\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"x\", \"network\": \"\"}]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2020-06-27T04:41:44.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:44 smithi031 bash[18426]: audit 2020-06-27T04:41:44.352241+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-06-27T04:41:44.348878\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"x\", \"network\": \"\"}]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2020-06-27T04:41:44.979 INFO:teuthology.orchestra.run.smithi051:mgr.x> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@mgr.x.service 2020-06-27T04:41:44.981 INFO:tasks.cephadm:Deploying OSDs... 2020-06-27T04:41:44.999 DEBUG:teuthology.orchestra.remote:smithi031:/scratch_devs is 72B 2020-06-27T04:41:45.015 INFO:ceph.mgr.x.smithi051.stdout:-- Logs begin at Sat 2020-06-27 04:33:02 UTC. -- 2020-06-27T04:41:45.049 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-06-27T04:41:45.049 INFO:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-06-27T04:41:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-06-27T04:41:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-27T04:41:45.064 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 53973 Links: 1 2020-06-27T04:41:45.064 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-27T04:41:45.064 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2020-06-27T04:41:45.065 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2020-06-27 04:41:20.154226767 +0000 2020-06-27T04:41:45.065 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2020-06-27 04:36:09.956570176 +0000 2020-06-27T04:41:45.065 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2020-06-27 04:36:09.956570176 +0000 2020-06-27T04:41:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2020-06-27T04:41:45.082 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2020-06-27T04:41:45.082 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2020-06-27T04:41:45.083 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000243728 s, 2.1 MB/s 2020-06-27T04:41:45.085 INFO:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-06-27T04:41:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-06-27T04:41:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-27T04:41:45.142 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 60663 Links: 1 2020-06-27T04:41:45.142 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-27T04:41:45.143 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2020-06-27T04:41:45.143 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2020-06-27 04:41:20.154226767 +0000 2020-06-27T04:41:45.143 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2020-06-27 04:36:10.398562954 +0000 2020-06-27T04:41:45.143 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2020-06-27 04:36:10.398562954 +0000 2020-06-27T04:41:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2020-06-27T04:41:45.160 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2020-06-27T04:41:45.161 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2020-06-27T04:41:45.161 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000217235 s, 2.4 MB/s 2020-06-27T04:41:45.165 INFO:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-06-27T04:41:45.220 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-06-27T04:41:45.220 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-27T04:41:45.220 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 60722 Links: 1 2020-06-27T04:41:45.221 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-27T04:41:45.221 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2020-06-27T04:41:45.221 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2020-06-27 04:41:20.154226767 +0000 2020-06-27T04:41:45.221 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2020-06-27 04:36:10.752557171 +0000 2020-06-27T04:41:45.221 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2020-06-27 04:36:10.752557171 +0000 2020-06-27T04:41:45.222 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2020-06-27T04:41:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2020-06-27T04:41:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2020-06-27T04:41:45.238 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.00021103 s, 2.4 MB/s 2020-06-27T04:41:45.241 INFO:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-06-27T04:41:45.297 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-06-27T04:41:45.297 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-27T04:41:45.297 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 57053 Links: 1 2020-06-27T04:41:45.298 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-27T04:41:45.298 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2020-06-27T04:41:45.298 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2020-06-27 04:41:20.154226767 +0000 2020-06-27T04:41:45.298 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2020-06-27 04:36:11.133550945 +0000 2020-06-27T04:41:45.303 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2020-06-27 04:36:11.133550945 +0000 2020-06-27T04:41:45.303 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2020-06-27T04:41:45.318 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2020-06-27T04:41:45.319 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2020-06-27T04:41:45.320 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000185646 s, 2.8 MB/s 2020-06-27T04:41:45.340 DEBUG:teuthology.orchestra.remote:smithi051:/scratch_devs is 72B 2020-06-27T04:41:45.404 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-06-27T04:41:45.405 INFO:teuthology.orchestra.run.smithi051:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-06-27T04:41:45.432 INFO:teuthology.orchestra.run.smithi051.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-06-27T04:41:45.432 INFO:teuthology.orchestra.run.smithi051.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-27T04:41:45.432 INFO:teuthology.orchestra.run.smithi051.stdout:Device: 6h/6d Inode: 58718 Links: 1 2020-06-27T04:41:45.432 INFO:teuthology.orchestra.run.smithi051.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-27T04:41:45.432 INFO:teuthology.orchestra.run.smithi051.stdout:Context: system_u:object_r:device_t:s0 2020-06-27T04:41:45.433 INFO:teuthology.orchestra.run.smithi051.stdout:Access: 2020-06-27 04:41:32.067284731 +0000 2020-06-27T04:41:45.433 INFO:teuthology.orchestra.run.smithi051.stdout:Modify: 2020-06-27 04:36:09.937039889 +0000 2020-06-27T04:41:45.433 INFO:teuthology.orchestra.run.smithi051.stdout:Change: 2020-06-27 04:36:09.937039889 +0000 2020-06-27T04:41:45.433 INFO:teuthology.orchestra.run.smithi051.stdout: Birth: - 2020-06-27T04:41:45.449 INFO:teuthology.orchestra.run.smithi051.stderr:1+0 records in 2020-06-27T04:41:45.450 INFO:teuthology.orchestra.run.smithi051.stderr:1+0 records out 2020-06-27T04:41:45.450 INFO:teuthology.orchestra.run.smithi051.stderr:512 bytes copied, 0.000264571 s, 1.9 MB/s 2020-06-27T04:41:45.453 INFO:teuthology.orchestra.run.smithi051:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-06-27T04:41:45.508 INFO:teuthology.orchestra.run.smithi051.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-06-27T04:41:45.508 INFO:teuthology.orchestra.run.smithi051.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-27T04:41:45.508 INFO:teuthology.orchestra.run.smithi051.stdout:Device: 6h/6d Inode: 57025 Links: 1 2020-06-27T04:41:45.508 INFO:teuthology.orchestra.run.smithi051.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-27T04:41:45.509 INFO:teuthology.orchestra.run.smithi051.stdout:Context: system_u:object_r:device_t:s0 2020-06-27T04:41:45.509 INFO:teuthology.orchestra.run.smithi051.stdout:Access: 2020-06-27 04:41:32.067284731 +0000 2020-06-27T04:41:45.509 INFO:teuthology.orchestra.run.smithi051.stdout:Modify: 2020-06-27 04:36:10.304033927 +0000 2020-06-27T04:41:45.509 INFO:teuthology.orchestra.run.smithi051.stdout:Change: 2020-06-27 04:36:10.304033927 +0000 2020-06-27T04:41:45.509 INFO:teuthology.orchestra.run.smithi051.stdout: Birth: - 2020-06-27T04:41:45.524 INFO:teuthology.orchestra.run.smithi051.stderr:1+0 records in 2020-06-27T04:41:45.525 INFO:teuthology.orchestra.run.smithi051.stderr:1+0 records out 2020-06-27T04:41:45.525 INFO:teuthology.orchestra.run.smithi051.stderr:512 bytes copied, 0.000224259 s, 2.3 MB/s 2020-06-27T04:41:45.527 INFO:teuthology.orchestra.run.smithi051:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-06-27T04:41:45.582 INFO:teuthology.orchestra.run.smithi051.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-06-27T04:41:45.582 INFO:teuthology.orchestra.run.smithi051.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-27T04:41:45.582 INFO:teuthology.orchestra.run.smithi051.stdout:Device: 6h/6d Inode: 59856 Links: 1 2020-06-27T04:41:45.582 INFO:teuthology.orchestra.run.smithi051.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-27T04:41:45.583 INFO:teuthology.orchestra.run.smithi051.stdout:Context: system_u:object_r:device_t:s0 2020-06-27T04:41:45.583 INFO:teuthology.orchestra.run.smithi051.stdout:Access: 2020-06-27 04:41:32.067284731 +0000 2020-06-27T04:41:45.583 INFO:teuthology.orchestra.run.smithi051.stdout:Modify: 2020-06-27 04:36:10.658028176 +0000 2020-06-27T04:41:45.583 INFO:teuthology.orchestra.run.smithi051.stdout:Change: 2020-06-27 04:36:10.658028176 +0000 2020-06-27T04:41:45.583 INFO:teuthology.orchestra.run.smithi051.stdout: Birth: - 2020-06-27T04:41:45.597 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:45 smithi051 bash[18409]: audit 2020-06-27T04:41:44.348006+0000 mgr.y (mgr.14142) 64 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi051=x", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:41:45.597 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:45 smithi051 bash[18409]: cephadm 2020-06-27T04:41:44.348866+0000 mgr.y (mgr.14142) 65 : cephadm [INF] Saving service mgr spec with placement count:2 smithi051=x 2020-06-27T04:41:45.598 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:45 smithi051 bash[18409]: audit 2020-06-27T04:41:44.834210+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:45.599 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:45 smithi051 bash[18409]: audit 2020-06-27T04:41:44.837106+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:45.599 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:45 smithi051 bash[18409]: audit 2020-06-27T04:41:44.838239+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:41:45.599 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:45 smithi051 bash[18409]: audit 2020-06-27T04:41:44.838492+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:41:45.599 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:45 smithi051 bash[18409]: audit 2020-06-27T04:41:45.374957+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.374369\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}}, \"last_daemon_update\": \"2020-06-27T04:41:45.374481\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:45.600 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:45 smithi051 bash[18409]: audit 2020-06-27T04:41:45.377766+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.374369\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}}, \"last_daemon_update\": \"2020-06-27T04:41:45.374481\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:45.600 INFO:teuthology.orchestra.run.smithi051.stderr:1+0 records in 2020-06-27T04:41:45.601 INFO:teuthology.orchestra.run.smithi051.stderr:1+0 records out 2020-06-27T04:41:45.601 INFO:teuthology.orchestra.run.smithi051.stderr:512 bytes copied, 0.000214383 s, 2.4 MB/s 2020-06-27T04:41:45.604 INFO:teuthology.orchestra.run.smithi051:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-06-27T04:41:45.659 INFO:teuthology.orchestra.run.smithi051.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-06-27T04:41:45.659 INFO:teuthology.orchestra.run.smithi051.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-27T04:41:45.660 INFO:teuthology.orchestra.run.smithi051.stdout:Device: 6h/6d Inode: 55247 Links: 1 2020-06-27T04:41:45.660 INFO:teuthology.orchestra.run.smithi051.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-27T04:41:45.660 INFO:teuthology.orchestra.run.smithi051.stdout:Context: system_u:object_r:device_t:s0 2020-06-27T04:41:45.660 INFO:teuthology.orchestra.run.smithi051.stdout:Access: 2020-06-27 04:41:32.068284714 +0000 2020-06-27T04:41:45.660 INFO:teuthology.orchestra.run.smithi051.stdout:Modify: 2020-06-27 04:36:11.026022197 +0000 2020-06-27T04:41:45.661 INFO:teuthology.orchestra.run.smithi051.stdout:Change: 2020-06-27 04:36:11.026022197 +0000 2020-06-27T04:41:45.661 INFO:teuthology.orchestra.run.smithi051.stdout: Birth: - 2020-06-27T04:41:45.676 INFO:teuthology.orchestra.run.smithi051.stderr:1+0 records in 2020-06-27T04:41:45.677 INFO:teuthology.orchestra.run.smithi051.stderr:1+0 records out 2020-06-27T04:41:45.677 INFO:teuthology.orchestra.run.smithi051.stderr:512 bytes copied, 0.000231868 s, 2.2 MB/s 2020-06-27T04:41:45.680 INFO:tasks.cephadm:Deploying osd.0 on smithi031 with /dev/vg_nvme/lv_4... 2020-06-27T04:41:45.680 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2020-06-27T04:41:45.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:45 smithi031 bash[18426]: audit 2020-06-27T04:41:44.348006+0000 mgr.y (mgr.14142) 64 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi051=x", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:41:45.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:45 smithi031 bash[18426]: cephadm 2020-06-27T04:41:44.348866+0000 mgr.y (mgr.14142) 65 : cephadm [INF] Saving service mgr spec with placement count:2 smithi051=x 2020-06-27T04:41:45.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:45 smithi031 bash[18426]: audit 2020-06-27T04:41:44.834210+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:45.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:45 smithi031 bash[18426]: audit 2020-06-27T04:41:44.837106+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:45.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:45 smithi031 bash[18426]: audit 2020-06-27T04:41:44.838239+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:41:45.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:45 smithi031 bash[18426]: audit 2020-06-27T04:41:44.838492+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:41:45.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:45 smithi031 bash[18426]: audit 2020-06-27T04:41:45.374957+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.374369\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}}, \"last_daemon_update\": \"2020-06-27T04:41:45.374481\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:45.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:45 smithi031 bash[18426]: audit 2020-06-27T04:41:45.377766+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.374369\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}}, \"last_daemon_update\": \"2020-06-27T04:41:45.374481\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:45.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:45 smithi031 bash[22603]: audit 2020-06-27T04:41:44.348006+0000 mgr.y (mgr.14142) 64 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi051=x", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:41:45.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:45 smithi031 bash[22603]: cephadm 2020-06-27T04:41:44.348866+0000 mgr.y (mgr.14142) 65 : cephadm [INF] Saving service mgr spec with placement count:2 smithi051=x 2020-06-27T04:41:45.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:45 smithi031 bash[22603]: audit 2020-06-27T04:41:44.834210+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:45.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:45 smithi031 bash[22603]: audit 2020-06-27T04:41:44.837106+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:45.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:45 smithi031 bash[22603]: audit 2020-06-27T04:41:44.838239+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:41:45.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:45 smithi031 bash[22603]: audit 2020-06-27T04:41:44.838492+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:41:45.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:45 smithi031 bash[22603]: audit 2020-06-27T04:41:45.374957+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.374369\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}}, \"last_daemon_update\": \"2020-06-27T04:41:45.374481\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:45.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:45 smithi031 bash[22603]: audit 2020-06-27T04:41:45.377766+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.374369\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}}, \"last_daemon_update\": \"2020-06-27T04:41:45.374481\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:46.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:46 smithi051 bash[18409]: cluster 2020-06-27T04:41:45.477378+0000 mgr.y (mgr.14142) 66 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:46.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:46 smithi051 bash[18409]: audit 2020-06-27T04:41:45.558051+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.557277\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.557351\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.557385\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:41:45.557462\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:46.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:46 smithi051 bash[18409]: audit 2020-06-27T04:41:45.560709+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.557277\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.557351\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.557385\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:41:45.557462\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:46.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:46 smithi051 bash[18409]: audit 2020-06-27T04:41:45.561751+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2020-06-27T04:41:46.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:46 smithi051 bash[18409]: audit 2020-06-27T04:41:45.563868+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2020-06-27T04:41:46.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:46 smithi051 bash[18409]: audit 2020-06-27T04:41:45.564459+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:46.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:46 smithi051 bash[18409]: cephadm 2020-06-27T04:41:45.564921+0000 mgr.y (mgr.14142) 67 : cephadm [INF] Deploying daemon mgr.x on smithi051 2020-06-27T04:41:46.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:46 smithi051 bash[18409]: audit 2020-06-27T04:41:45.565221+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2020-06-27T04:41:46.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:46 smithi031 bash[18426]: cluster 2020-06-27T04:41:45.477378+0000 mgr.y (mgr.14142) 66 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:46.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:46 smithi031 bash[18426]: audit 2020-06-27T04:41:45.558051+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.557277\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.557351\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.557385\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:41:45.557462\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:46.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:46 smithi031 bash[18426]: audit 2020-06-27T04:41:45.560709+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.557277\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.557351\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.557385\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:41:45.557462\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:46.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:46 smithi031 bash[18426]: audit 2020-06-27T04:41:45.561751+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2020-06-27T04:41:46.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:46 smithi031 bash[18426]: audit 2020-06-27T04:41:45.563868+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2020-06-27T04:41:46.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:46 smithi031 bash[18426]: audit 2020-06-27T04:41:45.564459+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:46.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:46 smithi031 bash[18426]: cephadm 2020-06-27T04:41:45.564921+0000 mgr.y (mgr.14142) 67 : cephadm [INF] Deploying daemon mgr.x on smithi051 2020-06-27T04:41:46.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:46 smithi031 bash[18426]: audit 2020-06-27T04:41:45.565221+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2020-06-27T04:41:46.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:46 smithi031 bash[22603]: cluster 2020-06-27T04:41:45.477378+0000 mgr.y (mgr.14142) 66 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-06-27T04:41:46.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:46 smithi031 bash[22603]: audit 2020-06-27T04:41:45.558051+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.557277\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.557351\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.557385\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:41:45.557462\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:41:46.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:46 smithi031 bash[22603]: audit 2020-06-27T04:41:45.560709+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.557277\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi031\", \"container_id\": \"5e1b087e8680\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.557351\", \"created\": \"2020-06-27T04:39:43.143828\", \"started\": \"2020-06-27T04:39:43.541879\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.557385\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:41:45.557462\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:41:46.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:46 smithi031 bash[22603]: audit 2020-06-27T04:41:45.561751+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2020-06-27T04:41:46.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:46 smithi031 bash[22603]: audit 2020-06-27T04:41:45.563868+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2020-06-27T04:41:46.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:46 smithi031 bash[22603]: audit 2020-06-27T04:41:45.564459+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:41:46.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:46 smithi031 bash[22603]: cephadm 2020-06-27T04:41:45.564921+0000 mgr.y (mgr.14142) 67 : cephadm [INF] Deploying daemon mgr.x on smithi051 2020-06-27T04:41:46.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:46 smithi031 bash[22603]: audit 2020-06-27T04:41:45.565221+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2020-06-27T04:41:47.123 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:41:47 smithi051 systemd[1]: Starting Ceph mgr.x for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:41:47.437 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:41:47 smithi051 podman[19558]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.x found: no such container 2020-06-27T04:41:47.437 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:41:47 smithi051 systemd[1]: Started Ceph mgr.x for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:41:47.438 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:41:47 smithi051 bash[19573]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.x" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.x found: no such container 2020-06-27T04:41:47.438 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:41:47 smithi051 bash[19573]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.x 2020-06-27T04:41:47.438 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:41:47 smithi051 bash[19573]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.x" found: no such container 2020-06-27T04:41:47.655 INFO:teuthology.orchestra.run.smithi031.stderr:--> Zapping: /dev/vg_nvme/lv_4 2020-06-27T04:41:47.655 INFO:teuthology.orchestra.run.smithi031.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2020-06-27T04:41:47.655 INFO:teuthology.orchestra.run.smithi031.stderr: stderr: 10+0 records in 2020-06-27T04:41:47.656 INFO:teuthology.orchestra.run.smithi031.stderr:10+0 records out 2020-06-27T04:41:47.656 INFO:teuthology.orchestra.run.smithi031.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111423 s, 941 MB/s 2020-06-27T04:41:47.656 INFO:teuthology.orchestra.run.smithi031.stderr:--> Zapping successful for: 2020-06-27T04:41:47.681 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:41:47 smithi031 systemd[1]: Stopping Ceph mgr.y for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:41:47.682 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:41:47 smithi031 podman[23896]: 2020-06-27 04:41:47.610241897 +0000 UTC m=+0.189121047 container died 5e1b087e86806b1fddeab2e8d05a148ad7d541e91256fc6a92bc3dfb7dff0ef7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.y) 2020-06-27T04:41:47.682 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:41:47 smithi031 podman[23896]: 2020-06-27 04:41:47.642236411 +0000 UTC m=+0.221115579 container stop 5e1b087e86806b1fddeab2e8d05a148ad7d541e91256fc6a92bc3dfb7dff0ef7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.y) 2020-06-27T04:41:47.682 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:41:47 smithi031 podman[23896]: 5e1b087e86806b1fddeab2e8d05a148ad7d541e91256fc6a92bc3dfb7dff0ef7 2020-06-27T04:41:47.718 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:41:47 smithi051 podman[19604]: 2020-06-27 04:41:47.434821118 +0000 UTC m=+0.219687076 container create 1d3fecae2b9d64188d2b6a3e9519d389918cc352769fbfe2028055714888c82f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.x) 2020-06-27T04:41:48.093 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:41:47 smithi051 podman[19604]: 2020-06-27 04:41:47.759825967 +0000 UTC m=+0.544692035 container init 1d3fecae2b9d64188d2b6a3e9519d389918cc352769fbfe2028055714888c82f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.x) 2020-06-27T04:41:48.093 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:41:47 smithi051 podman[19604]: 2020-06-27 04:41:47.793022804 +0000 UTC m=+0.577888773 container start 1d3fecae2b9d64188d2b6a3e9519d389918cc352769fbfe2028055714888c82f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.x) 2020-06-27T04:41:48.093 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:41:47 smithi051 podman[19604]: 2020-06-27 04:41:47.79313724 +0000 UTC m=+0.578003191 container attach 1d3fecae2b9d64188d2b6a3e9519d389918cc352769fbfe2028055714888c82f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.x) 2020-06-27T04:41:48.094 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:41:47 smithi051 bash[19573]: debug 2020-06-27T04:41:47.785+0000 7f81a625d380 1 -- 172.21.15.51:0/4191959688 shutdown_connections 2020-06-27T04:41:48.094 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:41:47 smithi051 bash[19573]: debug 2020-06-27T04:41:47.785+0000 7f81a625d380 1 --2- 172.21.15.51:0/4191959688 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55b5e43cb400 0x55b5e444e300 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:48.094 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:41:47 smithi051 bash[19573]: debug 2020-06-27T04:41:47.785+0000 7f81a625d380 1 --2- 172.21.15.51:0/4191959688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5e43cac00 0x55b5e444d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:48.094 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:41:47 smithi051 bash[19573]: debug 2020-06-27T04:41:47.785+0000 7f81a625d380 1 --2- 172.21.15.51:0/4191959688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55b5e43cb000 0x55b5e444de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:48.095 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:41:47 smithi051 bash[19573]: debug 2020-06-27T04:41:47.785+0000 7f81a625d380 1 -- 172.21.15.51:0/4191959688 >> 172.21.15.51:0/4191959688 conn(0x55b5e43ca800 msgr2=0x55b5e503a800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:41:48.095 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:41:47 smithi051 bash[19573]: debug 2020-06-27T04:41:47.785+0000 7f81a625d380 1 -- 172.21.15.51:0/4191959688 shutdown_connections 2020-06-27T04:41:48.095 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:41:47 smithi051 bash[19573]: debug 2020-06-27T04:41:47.785+0000 7f81a625d380 1 -- 172.21.15.51:0/4191959688 wait complete. 2020-06-27T04:41:48.456 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:41:48 smithi031 podman[18731]: 2020-06-27 04:41:48.143831038 +0000 UTC m=+124.733635608 container remove 5e1b087e86806b1fddeab2e8d05a148ad7d541e91256fc6a92bc3dfb7dff0ef7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-mgr.y) 2020-06-27T04:41:48.457 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:41:48 smithi031 bash[18687]: debug 2020-06-27T04:41:48.457 INFO:ceph.mgr.y.smithi031.stdout:Jun 27 04:41:48 smithi031 systemd[1]: Stopped Ceph mgr.y for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:41:48.457 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:48 smithi031 bash[22603]: audit 2020-06-27T04:41:47.153139+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.374369\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:48.458 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:48 smithi031 bash[22603]: audit 2020-06-27T04:41:47.155656+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.374369\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:48.458 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:48 smithi031 bash[22603]: cephadm 2020-06-27T04:41:47.155995+0000 mgr.y (mgr.14142) 68 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2020-06-27T04:41:48.458 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:48 smithi031 bash[22603]: cephadm 2020-06-27T04:41:47.156069+0000 mgr.y (mgr.14142) 69 : cephadm [INF] Removing daemon mgr.y from smithi031 2020-06-27T04:41:48.458 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:48 smithi031 bash[22603]: audit 2020-06-27T04:41:47.156366+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-06-27T04:41:48.459 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:48 smithi031 bash[18426]: audit 2020-06-27T04:41:47.153139+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.374369\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:48.459 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:48 smithi031 bash[18426]: audit 2020-06-27T04:41:47.155656+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.374369\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:48.459 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:48 smithi031 bash[18426]: cephadm 2020-06-27T04:41:47.155995+0000 mgr.y (mgr.14142) 68 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2020-06-27T04:41:48.459 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:48 smithi031 bash[18426]: cephadm 2020-06-27T04:41:47.156069+0000 mgr.y (mgr.14142) 69 : cephadm [INF] Removing daemon mgr.y from smithi031 2020-06-27T04:41:48.459 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:48 smithi031 bash[18426]: audit 2020-06-27T04:41:47.156366+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-06-27T04:41:48.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:48 smithi051 bash[18409]: audit 2020-06-27T04:41:47.153139+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.374369\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:41:48.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:48 smithi051 bash[18409]: audit 2020-06-27T04:41:47.155656+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:41:45.374369\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:41:48.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:48 smithi051 bash[18409]: cephadm 2020-06-27T04:41:47.155995+0000 mgr.y (mgr.14142) 68 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2020-06-27T04:41:48.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:48 smithi051 bash[18409]: cephadm 2020-06-27T04:41:47.156069+0000 mgr.y (mgr.14142) 69 : cephadm [INF] Removing daemon mgr.y from smithi031 2020-06-27T04:41:48.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:48 smithi051 bash[18409]: audit 2020-06-27T04:41:47.156366+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14142 172.21.15.31:0/1243015654' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-06-27T04:41:48.471 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph orch daemon add osd smithi031:vg_nvme/lv_4 2020-06-27T04:41:50.167 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.162+0000 7f6ef3fff700 1 Processor -- start 2020-06-27T04:41:50.167 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.162+0000 7f6ef3fff700 1 -- start start 2020-06-27T04:41:50.168 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ef40676c0 0x7f6ef406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:50.168 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef3fff700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f6ef406bc70 0x7f6ef406d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:50.168 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ef4078630 0x7f6ef41250b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:50.168 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef3fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef4078c10 con 0x7f6ef40676c0 2020-06-27T04:41:50.168 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef3fff700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef4078d80 con 0x7f6ef406bc70 2020-06-27T04:41:50.169 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef3fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef4125620 con 0x7f6ef4078630 2020-06-27T04:41:50.169 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ef40676c0 0x7f6ef406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:50.169 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef9400700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ef4078630 0x7f6ef41250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:50.169 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ef40676c0 0x7f6ef406cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38770/0 (socket says 172.21.15.31:38770) 2020-06-27T04:41:50.169 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef37fe700 1 -- 172.21.15.31:0/2706963154 learned_addr learned my addr 172.21.15.31:0/2706963154 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:41:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6eeaffd700 1 --2- 172.21.15.31:0/2706963154 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f6ef406bc70 0x7f6ef406d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:41:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef9400700 1 -- 172.21.15.31:0/2706963154 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f6ef406bc70 msgr2=0x7f6ef406d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef9400700 1 --2- 172.21.15.31:0/2706963154 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f6ef406bc70 0x7f6ef406d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef9400700 1 -- 172.21.15.31:0/2706963154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ef40676c0 msgr2=0x7f6ef406cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:41:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef9400700 1 --2- 172.21.15.31:0/2706963154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ef40676c0 0x7f6ef406cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:41:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef9400700 1 -- 172.21.15.31:0/2706963154 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef41257e0 con 0x7f6ef4078630 2020-06-27T04:41:50.171 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef37fe700 1 --2- 172.21.15.31:0/2706963154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ef40676c0 0x7f6ef406cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:41:50.171 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef9400700 1 --2- 172.21.15.31:0/2706963154 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ef4078630 0x7f6ef41250b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f6eec00c000 tx=0x7f6eec00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:41:50.171 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6eebfff700 1 -- 172.21.15.31:0/2706963154 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eec00c8d0 con 0x7f6ef4078630 2020-06-27T04:41:50.171 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6eebfff700 1 -- 172.21.15.31:0/2706963154 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f6eec00f040 con 0x7f6ef4078630 2020-06-27T04:41:50.171 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef3fff700 1 -- 172.21.15.31:0/2706963154 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef4125a30 con 0x7f6ef4078630 2020-06-27T04:41:50.172 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6eebfff700 1 -- 172.21.15.31:0/2706963154 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eec007d30 con 0x7f6ef4078630 2020-06-27T04:41:50.172 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.163+0000 7f6ef3fff700 1 -- 172.21.15.31:0/2706963154 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef4125fa0 con 0x7f6ef4078630 2020-06-27T04:41:50.172 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.164+0000 7f6eebfff700 1 -- 172.21.15.31:0/2706963154 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 13) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f6eec014460 con 0x7f6ef4078630 2020-06-27T04:41:50.173 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.164+0000 7f6eebfff700 1 --2- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 0x7f6ecc02cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:41:50.173 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.164+0000 7f6eebfff700 1 -- 172.21.15.31:0/2706963154 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1498+0+0 (secure 0 0 0) 0x7f6eec039e90 con 0x7f6ef4078630 2020-06-27T04:41:50.174 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.164+0000 7f6ef37fe700 1 -- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 msgr2=0x7f6ecc02cfc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/1241213118 2020-06-27T04:41:50.174 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.164+0000 7f6ef37fe700 1 --2- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 0x7f6ecc02cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2020-06-27T04:41:50.174 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.164+0000 7f6ef3fff700 1 -- 172.21.15.31:0/2706963154 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef405e210 con 0x7f6ef4078630 2020-06-27T04:41:50.174 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.168+0000 7f6eebfff700 1 -- 172.21.15.31:0/2706963154 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f6eec014cb0 con 0x7f6ef4078630 2020-06-27T04:41:50.347 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.344+0000 7f6ef3fff700 1 -- 172.21.15.31:0/2706963154 --> v2:172.21.15.31:6800/1241213118 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ef405f390 con 0x7f6ecc02ab00 2020-06-27T04:41:50.368 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.365+0000 7f6ef37fe700 1 -- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 msgr2=0x7f6ecc02cfc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/1241213118 2020-06-27T04:41:50.368 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.365+0000 7f6ef37fe700 1 --2- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 0x7f6ecc02cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2020-06-27T04:41:50.768 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.766+0000 7f6ef37fe700 1 -- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 msgr2=0x7f6ecc02cfc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/1241213118 2020-06-27T04:41:50.769 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:50.766+0000 7f6ef37fe700 1 --2- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 0x7f6ecc02cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2020-06-27T04:41:51.570 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:51.567+0000 7f6ef37fe700 1 -- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 msgr2=0x7f6ecc02cfc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/1241213118 2020-06-27T04:41:51.570 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:51.567+0000 7f6ef37fe700 1 --2- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 0x7f6ecc02cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2020-06-27T04:41:51.678 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:51.675+0000 7f6eebfff700 1 -- 172.21.15.31:0/2706963154 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mgrmap(e 14) v1 ==== 63345+0+0 (secure 0 0 0) 0x7f6eec0095a0 con 0x7f6ef4078630 2020-06-27T04:41:51.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:51 smithi051 bash[18409]: cluster 2020-06-27T04:41:51.622036+0000 mon.a (mon.0) 239 : cluster [DBG] Standby manager daemon x started 2020-06-27T04:41:51.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:51 smithi051 bash[18409]: audit 2020-06-27T04:41:51.622974+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-06-27T04:41:51.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:51 smithi051 bash[18409]: audit 2020-06-27T04:41:51.623910+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-06-27T04:41:51.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:51 smithi031 bash[18426]: cluster 2020-06-27T04:41:51.622036+0000 mon.a (mon.0) 239 : cluster [DBG] Standby manager daemon x started 2020-06-27T04:41:51.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:51 smithi031 bash[18426]: audit 2020-06-27T04:41:51.622974+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-06-27T04:41:51.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:51 smithi031 bash[18426]: audit 2020-06-27T04:41:51.623910+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-06-27T04:41:51.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:51 smithi031 bash[22603]: cluster 2020-06-27T04:41:51.622036+0000 mon.a (mon.0) 239 : cluster [DBG] Standby manager daemon x started 2020-06-27T04:41:51.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:51 smithi031 bash[22603]: audit 2020-06-27T04:41:51.622974+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-06-27T04:41:51.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:51 smithi031 bash[22603]: audit 2020-06-27T04:41:51.623910+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-06-27T04:41:52.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:41:52 smithi051 bash[18409]: cluster 2020-06-27T04:41:51.677427+0000 mon.a (mon.0) 240 : cluster [DBG] mgrmap e14: y(active, since 101s), standbys: x 2020-06-27T04:41:52.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:41:52 smithi031 bash[18426]: cluster 2020-06-27T04:41:51.677427+0000 mon.a (mon.0) 240 : cluster [DBG] mgrmap e14: y(active, since 101s), standbys: x 2020-06-27T04:41:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:41:52 smithi031 bash[22603]: cluster 2020-06-27T04:41:51.677427+0000 mon.a (mon.0) 240 : cluster [DBG] mgrmap e14: y(active, since 101s), standbys: x 2020-06-27T04:41:53.171 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:53.168+0000 7f6ef37fe700 1 -- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 msgr2=0x7f6ecc02cfc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/1241213118 2020-06-27T04:41:53.172 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:53.168+0000 7f6ef37fe700 1 --2- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 0x7f6ecc02cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2020-06-27T04:41:56.375 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:56.372+0000 7f6ef37fe700 1 -- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 msgr2=0x7f6ecc02cfc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/1241213118 2020-06-27T04:41:56.375 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:41:56.372+0000 7f6ef37fe700 1 --2- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 0x7f6ecc02cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 6.400000 2020-06-27T04:42:02.781 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:02.779+0000 7f6ef37fe700 1 -- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 msgr2=0x7f6ecc02cfc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/1241213118 2020-06-27T04:42:02.782 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:02.779+0000 7f6ef37fe700 1 --2- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 0x7f6ecc02cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 12.800000 2020-06-27T04:42:15.595 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:15.591+0000 7f6ef37fe700 1 -- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 msgr2=0x7f6ecc02cfc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/1241213118 2020-06-27T04:42:15.595 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:15.591+0000 7f6ef37fe700 1 --2- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 0x7f6ecc02cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 15.000000 2020-06-27T04:42:17.100 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:17.097+0000 7f6eebfff700 1 -- 172.21.15.31:0/2706963154 <== mon.1 v2:172.21.15.31:3301/0 8 ==== mgrmap(e 15) v1 ==== 31648+0+0 (secure 0 0 0) 0x7f6eec0146f0 con 0x7f6ef4078630 2020-06-27T04:42:17.101 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:17.097+0000 7f6eebfff700 1 -- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 msgr2=0x7f6ecc02cfc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-06-27T04:42:17.101 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:17.097+0000 7f6eebfff700 1 --2- 172.21.15.31:0/2706963154 >> v2:172.21.15.31:6800/1241213118 conn(0x7f6ecc02ab00 0x7f6ecc02cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-06-27T04:42:17.399 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: cluster 2020-06-27T04:42:17.091425+0000 mon.a (mon.0) 241 : cluster [INF] Manager daemon y is unresponsive, replacing it with standby daemon x 2020-06-27T04:42:17.400 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: cluster 2020-06-27T04:42:17.094886+0000 mon.a (mon.0) 242 : cluster [DBG] osdmap e7: 0 total, 0 up, 0 in 2020-06-27T04:42:17.400 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: cluster 2020-06-27T04:42:17.099699+0000 mon.a (mon.0) 243 : cluster [DBG] mgrmap e15: x(active, starting, since 0.00831698s) 2020-06-27T04:42:17.400 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: audit 2020-06-27T04:42:17.101710+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2020-06-27T04:42:17.400 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: audit 2020-06-27T04:42:17.102467+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-06-27T04:42:17.401 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: audit 2020-06-27T04:42:17.102660+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-06-27T04:42:17.401 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: audit 2020-06-27T04:42:17.102861+0000 mon.b (mon.2) 7 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-06-27T04:42:17.401 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: audit 2020-06-27T04:42:17.103363+0000 mon.b (mon.2) 8 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-06-27T04:42:17.401 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: audit 2020-06-27T04:42:17.104185+0000 mon.b (mon.2) 9 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi031"}]: dispatch 2020-06-27T04:42:17.401 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: audit 2020-06-27T04:42:17.104567+0000 mon.b (mon.2) 10 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi051"}]: dispatch 2020-06-27T04:42:17.402 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: audit 2020-06-27T04:42:17.104906+0000 mon.b (mon.2) 11 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2020-06-27T04:42:17.402 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: audit 2020-06-27T04:42:17.105220+0000 mon.b (mon.2) 12 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2020-06-27T04:42:17.402 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: audit 2020-06-27T04:42:17.105535+0000 mon.b (mon.2) 13 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2020-06-27T04:42:17.402 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: audit 2020-06-27T04:42:17.105857+0000 mon.b (mon.2) 14 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2020-06-27T04:42:17.402 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: audit 2020-06-27T04:42:17.106173+0000 mon.b (mon.2) 15 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2020-06-27T04:42:17.403 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: audit 2020-06-27T04:42:17.106484+0000 mon.b (mon.2) 16 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-06-27T04:42:17.403 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: audit 2020-06-27T04:42:17.106776+0000 mon.b (mon.2) 17 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-06-27T04:42:17.403 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: audit 2020-06-27T04:42:17.107071+0000 mon.b (mon.2) 18 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2020-06-27T04:42:17.403 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: audit 2020-06-27T04:42:17.107360+0000 mon.b (mon.2) 19 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2020-06-27T04:42:17.403 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[18426]: cluster 2020-06-27T04:42:17.123796+0000 mon.a (mon.0) 244 : cluster [INF] Manager daemon x is now available 2020-06-27T04:42:17.404 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: cluster 2020-06-27T04:42:17.091425+0000 mon.a (mon.0) 241 : cluster [INF] Manager daemon y is unresponsive, replacing it with standby daemon x 2020-06-27T04:42:17.404 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: cluster 2020-06-27T04:42:17.094886+0000 mon.a (mon.0) 242 : cluster [DBG] osdmap e7: 0 total, 0 up, 0 in 2020-06-27T04:42:17.404 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: cluster 2020-06-27T04:42:17.099699+0000 mon.a (mon.0) 243 : cluster [DBG] mgrmap e15: x(active, starting, since 0.00831698s) 2020-06-27T04:42:17.404 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: audit 2020-06-27T04:42:17.101710+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2020-06-27T04:42:17.404 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: audit 2020-06-27T04:42:17.102467+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-06-27T04:42:17.405 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: audit 2020-06-27T04:42:17.102660+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-06-27T04:42:17.405 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: audit 2020-06-27T04:42:17.102861+0000 mon.b (mon.2) 7 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-06-27T04:42:17.405 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: audit 2020-06-27T04:42:17.103363+0000 mon.b (mon.2) 8 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-06-27T04:42:17.405 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: audit 2020-06-27T04:42:17.104185+0000 mon.b (mon.2) 9 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi031"}]: dispatch 2020-06-27T04:42:17.405 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: audit 2020-06-27T04:42:17.104567+0000 mon.b (mon.2) 10 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi051"}]: dispatch 2020-06-27T04:42:17.406 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: audit 2020-06-27T04:42:17.104906+0000 mon.b (mon.2) 11 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2020-06-27T04:42:17.406 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: audit 2020-06-27T04:42:17.105220+0000 mon.b (mon.2) 12 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2020-06-27T04:42:17.406 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: audit 2020-06-27T04:42:17.105535+0000 mon.b (mon.2) 13 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2020-06-27T04:42:17.406 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: audit 2020-06-27T04:42:17.105857+0000 mon.b (mon.2) 14 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2020-06-27T04:42:17.406 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: audit 2020-06-27T04:42:17.106173+0000 mon.b (mon.2) 15 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2020-06-27T04:42:17.406 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: audit 2020-06-27T04:42:17.106484+0000 mon.b (mon.2) 16 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-06-27T04:42:17.407 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: audit 2020-06-27T04:42:17.106776+0000 mon.b (mon.2) 17 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-06-27T04:42:17.407 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: audit 2020-06-27T04:42:17.107071+0000 mon.b (mon.2) 18 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2020-06-27T04:42:17.407 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: audit 2020-06-27T04:42:17.107360+0000 mon.b (mon.2) 19 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2020-06-27T04:42:17.407 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:17 smithi031 bash[22603]: cluster 2020-06-27T04:42:17.123796+0000 mon.a (mon.0) 244 : cluster [INF] Manager daemon x is now available 2020-06-27T04:42:17.458 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[19573]: Warning: Permanently added 'smithi051,172.21.15.51' (ECDSA) to the list of known hosts. 2020-06-27T04:42:17.459 INFO:ceph.mgr.x.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[19573]: Warning: Permanently added 'smithi031,172.21.15.31' (ECDSA) to the list of known hosts. 2020-06-27T04:42:17.459 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: cluster 2020-06-27T04:42:17.091425+0000 mon.a (mon.0) 241 : cluster [INF] Manager daemon y is unresponsive, replacing it with standby daemon x 2020-06-27T04:42:17.459 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: cluster 2020-06-27T04:42:17.094886+0000 mon.a (mon.0) 242 : cluster [DBG] osdmap e7: 0 total, 0 up, 0 in 2020-06-27T04:42:17.459 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: cluster 2020-06-27T04:42:17.099699+0000 mon.a (mon.0) 243 : cluster [DBG] mgrmap e15: x(active, starting, since 0.00831698s) 2020-06-27T04:42:17.460 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: audit 2020-06-27T04:42:17.101710+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2020-06-27T04:42:17.460 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: audit 2020-06-27T04:42:17.102467+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-06-27T04:42:17.460 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: audit 2020-06-27T04:42:17.102660+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-06-27T04:42:17.460 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: audit 2020-06-27T04:42:17.102861+0000 mon.b (mon.2) 7 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-06-27T04:42:17.460 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: audit 2020-06-27T04:42:17.103363+0000 mon.b (mon.2) 8 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-06-27T04:42:17.461 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: audit 2020-06-27T04:42:17.104185+0000 mon.b (mon.2) 9 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi031"}]: dispatch 2020-06-27T04:42:17.461 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: audit 2020-06-27T04:42:17.104567+0000 mon.b (mon.2) 10 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi051"}]: dispatch 2020-06-27T04:42:17.461 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: audit 2020-06-27T04:42:17.104906+0000 mon.b (mon.2) 11 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2020-06-27T04:42:17.461 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: audit 2020-06-27T04:42:17.105220+0000 mon.b (mon.2) 12 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2020-06-27T04:42:17.461 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: audit 2020-06-27T04:42:17.105535+0000 mon.b (mon.2) 13 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2020-06-27T04:42:17.462 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: audit 2020-06-27T04:42:17.105857+0000 mon.b (mon.2) 14 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2020-06-27T04:42:17.462 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: audit 2020-06-27T04:42:17.106173+0000 mon.b (mon.2) 15 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2020-06-27T04:42:17.462 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: audit 2020-06-27T04:42:17.106484+0000 mon.b (mon.2) 16 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-06-27T04:42:17.462 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: audit 2020-06-27T04:42:17.106776+0000 mon.b (mon.2) 17 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-06-27T04:42:17.463 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: audit 2020-06-27T04:42:17.107071+0000 mon.b (mon.2) 18 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2020-06-27T04:42:17.463 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: audit 2020-06-27T04:42:17.107360+0000 mon.b (mon.2) 19 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2020-06-27T04:42:17.463 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:17 smithi051 bash[18409]: cluster 2020-06-27T04:42:17.123796+0000 mon.a (mon.0) 244 : cluster [INF] Manager daemon x is now available 2020-06-27T04:42:18.164 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:18.161+0000 7f6eebfff700 1 -- 172.21.15.31:0/2706963154 <== mon.1 v2:172.21.15.31:3301/0 9 ==== mgrmap(e 16) v1 ==== 31683+0+0 (secure 0 0 0) 0x7f6eec01e950 con 0x7f6ef4078630 2020-06-27T04:42:18.165 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:18.161+0000 7f6eebfff700 1 --2- 172.21.15.31:0/2706963154 >> v2:172.21.15.51:6800/950992045 conn(0x7f6ecc035870 0x7f6ecc053ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:42:18.165 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:18.161+0000 7f6eebfff700 1 -- 172.21.15.31:0/2706963154 --> v2:172.21.15.51:6800/950992045 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ecc053610 con 0x7f6ecc035870 2020-06-27T04:42:18.166 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:18.162+0000 7f6ef37fe700 1 --2- 172.21.15.31:0/2706963154 >> v2:172.21.15.51:6800/950992045 conn(0x7f6ecc035870 0x7f6ecc053ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:42:18.166 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:18.162+0000 7f6ef37fe700 1 --2- 172.21.15.31:0/2706963154 >> v2:172.21.15.51:6800/950992045 conn(0x7f6ecc035870 0x7f6ecc053ed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f6ee400c000 tx=0x7f6ee400b040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:42:18.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:18 smithi051 bash[18409]: audit 2020-06-27T04:42:17.259216+0000 mon.a (mon.0) 245 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2020-06-27T04:42:18.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:18 smithi051 bash[18409]: audit 2020-06-27T04:42:17.566527+0000 mon.b (mon.2) 20 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:42:18.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:18 smithi051 bash[18409]: audit 2020-06-27T04:42:17.574621+0000 mon.b (mon.2) 21 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:42:18.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:18 smithi051 bash[18409]: audit 2020-06-27T04:42:18.158718+0000 mon.a (mon.0) 246 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2020-06-27T04:42:18.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:18 smithi051 bash[18409]: cluster 2020-06-27T04:42:18.163310+0000 mon.a (mon.0) 247 : cluster [DBG] mgrmap e16: x(active, since 1.07194s) 2020-06-27T04:42:18.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:18 smithi051 bash[18409]: audit 2020-06-27T04:42:18.165801+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:42:18.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:18 smithi051 bash[18409]: audit 2020-06-27T04:42:18.167415+0000 mon.b (mon.2) 23 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:42:18.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:18 smithi051 bash[18409]: audit 2020-06-27T04:42:18.167983+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:42:18.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:18 smithi051 bash[18409]: audit 2020-06-27T04:42:18.168608+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:18.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:18 smithi031 bash[18426]: audit 2020-06-27T04:42:17.259216+0000 mon.a (mon.0) 245 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2020-06-27T04:42:18.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:18 smithi031 bash[18426]: audit 2020-06-27T04:42:17.566527+0000 mon.b (mon.2) 20 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:42:18.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:18 smithi031 bash[18426]: audit 2020-06-27T04:42:17.574621+0000 mon.b (mon.2) 21 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:42:18.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:18 smithi031 bash[18426]: audit 2020-06-27T04:42:18.158718+0000 mon.a (mon.0) 246 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2020-06-27T04:42:18.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:18 smithi031 bash[18426]: cluster 2020-06-27T04:42:18.163310+0000 mon.a (mon.0) 247 : cluster [DBG] mgrmap e16: x(active, since 1.07194s) 2020-06-27T04:42:18.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:18 smithi031 bash[18426]: audit 2020-06-27T04:42:18.165801+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:42:18.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:18 smithi031 bash[18426]: audit 2020-06-27T04:42:18.167415+0000 mon.b (mon.2) 23 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:42:18.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:18 smithi031 bash[18426]: audit 2020-06-27T04:42:18.167983+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:42:18.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:18 smithi031 bash[18426]: audit 2020-06-27T04:42:18.168608+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:18.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:18 smithi031 bash[22603]: audit 2020-06-27T04:42:17.259216+0000 mon.a (mon.0) 245 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2020-06-27T04:42:18.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:18 smithi031 bash[22603]: audit 2020-06-27T04:42:17.566527+0000 mon.b (mon.2) 20 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:42:18.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:18 smithi031 bash[22603]: audit 2020-06-27T04:42:17.574621+0000 mon.b (mon.2) 21 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:42:18.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:18 smithi031 bash[22603]: audit 2020-06-27T04:42:18.158718+0000 mon.a (mon.0) 246 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2020-06-27T04:42:18.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:18 smithi031 bash[22603]: cluster 2020-06-27T04:42:18.163310+0000 mon.a (mon.0) 247 : cluster [DBG] mgrmap e16: x(active, since 1.07194s) 2020-06-27T04:42:18.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:18 smithi031 bash[22603]: audit 2020-06-27T04:42:18.165801+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:42:18.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:18 smithi031 bash[22603]: audit 2020-06-27T04:42:18.167415+0000 mon.b (mon.2) 23 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:42:18.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:18 smithi031 bash[22603]: audit 2020-06-27T04:42:18.167983+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:42:18.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:18 smithi031 bash[22603]: audit 2020-06-27T04:42:18.168608+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:19.165 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:19.162+0000 7f6eebfff700 1 -- 172.21.15.31:0/2706963154 <== mon.1 v2:172.21.15.31:3301/0 10 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f6eec048480 con 0x7f6ef4078630 2020-06-27T04:42:19.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:19 smithi051 bash[18409]: audit 2020-06-27T04:42:18.164456+0000 mgr.x (mgr.34109) 1 : audit [DBG] from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:42:19.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:19 smithi051 bash[18409]: cephadm 2020-06-27T04:42:18.166424+0000 mgr.x (mgr.34109) 2 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:42:19.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:19 smithi051 bash[18409]: cephadm 2020-06-27T04:42:18.166491+0000 mgr.x (mgr.34109) 3 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:42:19.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:19 smithi051 bash[18409]: cephadm 2020-06-27T04:42:18.167074+0000 mgr.x (mgr.34109) 4 : cephadm [INF] Applying None on host smithi031... 2020-06-27T04:42:19.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:19 smithi051 bash[18409]: audit 2020-06-27T04:42:18.235049+0000 mon.b (mon.2) 26 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234291\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234390\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}}, \"last_daemon_update\": \"2020-06-27T04:42:18.234488\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:42:19.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:19 smithi051 bash[18409]: audit 2020-06-27T04:42:18.235566+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234291\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234390\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}}, \"last_daemon_update\": \"2020-06-27T04:42:18.234488\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:42:19.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:19 smithi051 bash[18409]: audit 2020-06-27T04:42:18.238115+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234291\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234390\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}}, \"last_daemon_update\": \"2020-06-27T04:42:18.234488\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:42:19.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:19 smithi051 bash[18409]: audit 2020-06-27T04:42:18.257282+0000 mon.b (mon.2) 27 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256782\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256838\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:42:18.256911\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:19.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:19 smithi051 bash[18409]: audit 2020-06-27T04:42:18.257798+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256782\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256838\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:42:18.256911\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:19.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:19 smithi051 bash[18409]: audit 2020-06-27T04:42:18.260260+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256782\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256838\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:42:18.256911\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:19.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:19 smithi051 bash[18409]: cluster 2020-06-27T04:42:19.164311+0000 mon.a (mon.0) 252 : cluster [DBG] mgrmap e17: x(active, since 2s) 2020-06-27T04:42:19.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[18426]: audit 2020-06-27T04:42:18.164456+0000 mgr.x (mgr.34109) 1 : audit [DBG] from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:42:19.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[18426]: cephadm 2020-06-27T04:42:18.166424+0000 mgr.x (mgr.34109) 2 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:42:19.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[18426]: cephadm 2020-06-27T04:42:18.166491+0000 mgr.x (mgr.34109) 3 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:42:19.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[18426]: cephadm 2020-06-27T04:42:18.167074+0000 mgr.x (mgr.34109) 4 : cephadm [INF] Applying None on host smithi031... 2020-06-27T04:42:19.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[18426]: audit 2020-06-27T04:42:18.235049+0000 mon.b (mon.2) 26 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234291\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234390\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}}, \"last_daemon_update\": \"2020-06-27T04:42:18.234488\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:42:19.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[18426]: audit 2020-06-27T04:42:18.235566+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234291\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234390\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}}, \"last_daemon_update\": \"2020-06-27T04:42:18.234488\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:42:19.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[18426]: audit 2020-06-27T04:42:18.238115+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234291\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234390\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}}, \"last_daemon_update\": \"2020-06-27T04:42:18.234488\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:42:19.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[18426]: audit 2020-06-27T04:42:18.257282+0000 mon.b (mon.2) 27 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256782\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256838\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:42:18.256911\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:19.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[18426]: audit 2020-06-27T04:42:18.257798+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256782\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256838\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:42:18.256911\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:19.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[18426]: audit 2020-06-27T04:42:18.260260+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256782\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256838\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:42:18.256911\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:19.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[18426]: cluster 2020-06-27T04:42:19.164311+0000 mon.a (mon.0) 252 : cluster [DBG] mgrmap e17: x(active, since 2s) 2020-06-27T04:42:19.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[22603]: audit 2020-06-27T04:42:18.164456+0000 mgr.x (mgr.34109) 1 : audit [DBG] from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:42:19.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[22603]: cephadm 2020-06-27T04:42:18.166424+0000 mgr.x (mgr.34109) 2 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:42:19.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[22603]: cephadm 2020-06-27T04:42:18.166491+0000 mgr.x (mgr.34109) 3 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:42:19.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[22603]: cephadm 2020-06-27T04:42:18.167074+0000 mgr.x (mgr.34109) 4 : cephadm [INF] Applying None on host smithi031... 2020-06-27T04:42:19.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[22603]: audit 2020-06-27T04:42:18.235049+0000 mon.b (mon.2) 26 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234291\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234390\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}}, \"last_daemon_update\": \"2020-06-27T04:42:18.234488\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:42:19.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[22603]: audit 2020-06-27T04:42:18.235566+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234291\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234390\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}}, \"last_daemon_update\": \"2020-06-27T04:42:18.234488\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:42:19.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[22603]: audit 2020-06-27T04:42:18.238115+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234291\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234390\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}}, \"last_daemon_update\": \"2020-06-27T04:42:18.234488\", \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:42:19.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[22603]: audit 2020-06-27T04:42:18.257282+0000 mon.b (mon.2) 27 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256782\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256838\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:42:18.256911\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:19.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[22603]: audit 2020-06-27T04:42:18.257798+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256782\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256838\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:42:18.256911\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:19.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[22603]: audit 2020-06-27T04:42:18.260260+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256782\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256838\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}}, \"last_daemon_update\": \"2020-06-27T04:42:18.256911\", \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:19.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:19 smithi031 bash[22603]: cluster 2020-06-27T04:42:19.164311+0000 mon.a (mon.0) 252 : cluster [DBG] mgrmap e17: x(active, since 2s) 2020-06-27T04:42:20.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:20 smithi051 bash[18409]: audit 2020-06-27T04:42:20.650117+0000 mon.c (mon.1) 3 : audit [INF] from='client.? 172.21.15.31:0/1497042733' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a82dbaf0-14e8-40a8-b0b8-6adfef817f3b"}]: dispatch 2020-06-27T04:42:20.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:20 smithi051 bash[18409]: audit 2020-06-27T04:42:20.650411+0000 mon.a (mon.0) 253 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a82dbaf0-14e8-40a8-b0b8-6adfef817f3b"}]: dispatch 2020-06-27T04:42:20.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:20 smithi051 bash[18409]: audit 2020-06-27T04:42:20.653654+0000 mon.a (mon.0) 254 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a82dbaf0-14e8-40a8-b0b8-6adfef817f3b"}]': finished 2020-06-27T04:42:20.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:20 smithi051 bash[18409]: cluster 2020-06-27T04:42:20.653699+0000 mon.a (mon.0) 255 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2020-06-27T04:42:20.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:20 smithi051 bash[18409]: audit 2020-06-27T04:42:20.656721+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:42:20.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:20 smithi031 bash[18426]: audit 2020-06-27T04:42:20.650117+0000 mon.c (mon.1) 3 : audit [INF] from='client.? 172.21.15.31:0/1497042733' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a82dbaf0-14e8-40a8-b0b8-6adfef817f3b"}]: dispatch 2020-06-27T04:42:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:20 smithi031 bash[18426]: audit 2020-06-27T04:42:20.650411+0000 mon.a (mon.0) 253 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a82dbaf0-14e8-40a8-b0b8-6adfef817f3b"}]: dispatch 2020-06-27T04:42:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:20 smithi031 bash[18426]: audit 2020-06-27T04:42:20.653654+0000 mon.a (mon.0) 254 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a82dbaf0-14e8-40a8-b0b8-6adfef817f3b"}]': finished 2020-06-27T04:42:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:20 smithi031 bash[18426]: cluster 2020-06-27T04:42:20.653699+0000 mon.a (mon.0) 255 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2020-06-27T04:42:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:20 smithi031 bash[18426]: audit 2020-06-27T04:42:20.656721+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:42:20.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:20 smithi031 bash[22603]: audit 2020-06-27T04:42:20.650117+0000 mon.c (mon.1) 3 : audit [INF] from='client.? 172.21.15.31:0/1497042733' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a82dbaf0-14e8-40a8-b0b8-6adfef817f3b"}]: dispatch 2020-06-27T04:42:20.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:20 smithi031 bash[22603]: audit 2020-06-27T04:42:20.650411+0000 mon.a (mon.0) 253 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a82dbaf0-14e8-40a8-b0b8-6adfef817f3b"}]: dispatch 2020-06-27T04:42:20.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:20 smithi031 bash[22603]: audit 2020-06-27T04:42:20.653654+0000 mon.a (mon.0) 254 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a82dbaf0-14e8-40a8-b0b8-6adfef817f3b"}]': finished 2020-06-27T04:42:20.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:20 smithi031 bash[22603]: cluster 2020-06-27T04:42:20.653699+0000 mon.a (mon.0) 255 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2020-06-27T04:42:20.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:20 smithi031 bash[22603]: audit 2020-06-27T04:42:20.656721+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:42:21.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:21 smithi051 bash[18409]: audit 2020-06-27T04:42:21.150554+0000 mon.a (mon.0) 256 : audit [DBG] from='client.? 172.21.15.31:0/1926220653' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:42:21.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:21 smithi031 bash[18426]: audit 2020-06-27T04:42:21.150554+0000 mon.a (mon.0) 256 : audit [DBG] from='client.? 172.21.15.31:0/1926220653' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:42:21.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:21 smithi031 bash[22603]: audit 2020-06-27T04:42:21.150554+0000 mon.a (mon.0) 256 : audit [DBG] from='client.? 172.21.15.31:0/1926220653' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:42:23.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:23 smithi051 bash[18409]: audit 2020-06-27T04:42:23.568399+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:23.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:23 smithi031 bash[18426]: audit 2020-06-27T04:42:23.568399+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:23.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:23 smithi031 bash[22603]: audit 2020-06-27T04:42:23.568399+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:26.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:26 smithi051 bash[18409]: audit 2020-06-27T04:42:26.389550+0000 mon.b (mon.2) 30 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2020-06-27T04:42:26.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:26 smithi051 bash[18409]: audit 2020-06-27T04:42:26.390370+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:42:26.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:26 smithi051 bash[18409]: audit 2020-06-27T04:42:26.391277+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2020-06-27T04:42:26.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:26 smithi031 bash[18426]: audit 2020-06-27T04:42:26.389550+0000 mon.b (mon.2) 30 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2020-06-27T04:42:26.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:26 smithi031 bash[18426]: audit 2020-06-27T04:42:26.390370+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:42:26.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:26 smithi031 bash[18426]: audit 2020-06-27T04:42:26.391277+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2020-06-27T04:42:26.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:26 smithi031 bash[22603]: audit 2020-06-27T04:42:26.389550+0000 mon.b (mon.2) 30 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2020-06-27T04:42:26.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:26 smithi031 bash[22603]: audit 2020-06-27T04:42:26.390370+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:42:26.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:26 smithi031 bash[22603]: audit 2020-06-27T04:42:26.391277+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2020-06-27T04:42:27.712 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:27 smithi031 bash[18426]: cephadm 2020-06-27T04:42:26.390993+0000 mgr.x (mgr.34109) 5 : cephadm [INF] Deploying daemon osd.0 on smithi031 2020-06-27T04:42:27.712 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:27 smithi031 bash[22603]: cephadm 2020-06-27T04:42:26.390993+0000 mgr.x (mgr.34109) 5 : cephadm [INF] Deploying daemon osd.0 on smithi031 2020-06-27T04:42:27.717 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:27 smithi051 bash[18409]: cephadm 2020-06-27T04:42:26.390993+0000 mgr.x (mgr.34109) 5 : cephadm [INF] Deploying daemon osd.0 on smithi031 2020-06-27T04:42:28.017 INFO:teuthology.orchestra.run.smithi031.stdout:Created osd(s) 0 on host 'smithi031' 2020-06-27T04:42:28.018 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:28.013+0000 7f6eebfff700 1 -- 172.21.15.31:0/2706963154 <== mgr.34109 v2:172.21.15.51:6800/950992045 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6ecc053610 con 0x7f6ecc035870 2020-06-27T04:42:28.018 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:28.015+0000 7f6ef3fff700 1 -- 172.21.15.31:0/2706963154 >> v2:172.21.15.51:6800/950992045 conn(0x7f6ecc035870 msgr2=0x7f6ecc053ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:42:28.019 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:28.015+0000 7f6ef3fff700 1 --2- 172.21.15.31:0/2706963154 >> v2:172.21.15.51:6800/950992045 conn(0x7f6ecc035870 0x7f6ecc053ed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f6ee400c000 tx=0x7f6ee400b040).stop 2020-06-27T04:42:28.019 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:28.016+0000 7f6ef3fff700 1 -- 172.21.15.31:0/2706963154 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ef4078630 msgr2=0x7f6ef41250b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:42:28.019 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:28.016+0000 7f6ef3fff700 1 --2- 172.21.15.31:0/2706963154 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ef4078630 0x7f6ef41250b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f6eec00c000 tx=0x7f6eec00b040).stop 2020-06-27T04:42:28.019 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:28.016+0000 7f6ef9400700 1 -- 172.21.15.31:0/2706963154 reap_dead start 2020-06-27T04:42:28.019 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:28.016+0000 7f6ef3fff700 1 -- 172.21.15.31:0/2706963154 shutdown_connections 2020-06-27T04:42:28.020 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:28.016+0000 7f6ef3fff700 1 -- 172.21.15.31:0/2706963154 >> 172.21.15.31:0/2706963154 conn(0x7f6ef4025510 msgr2=0x7f6ef40626b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:42:28.020 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:28.016+0000 7f6ef3fff700 1 -- 172.21.15.31:0/2706963154 shutdown_connections 2020-06-27T04:42:28.020 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:28.016+0000 7f6ef3fff700 1 -- 172.21.15.31:0/2706963154 wait complete. 2020-06-27T04:42:28.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:28 smithi051 bash[18409]: audit 2020-06-27T04:42:28.008875+0000 mon.b (mon.2) 33 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256782\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256838\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:28.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:28 smithi051 bash[18409]: audit 2020-06-27T04:42:28.009261+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:42:28.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:28 smithi051 bash[18409]: audit 2020-06-27T04:42:28.009420+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256782\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256838\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:28.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:28 smithi051 bash[18409]: audit 2020-06-27T04:42:28.012014+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256782\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256838\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:28.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:28 smithi031 bash[18426]: audit 2020-06-27T04:42:28.008875+0000 mon.b (mon.2) 33 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256782\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256838\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:28.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:28 smithi031 bash[18426]: audit 2020-06-27T04:42:28.009261+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:42:28.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:28 smithi031 bash[18426]: audit 2020-06-27T04:42:28.009420+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256782\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256838\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:28.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:28 smithi031 bash[18426]: audit 2020-06-27T04:42:28.012014+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256782\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256838\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:28.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:28 smithi031 bash[22603]: audit 2020-06-27T04:42:28.008875+0000 mon.b (mon.2) 33 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256782\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256838\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:28.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:28 smithi031 bash[22603]: audit 2020-06-27T04:42:28.009261+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:42:28.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:28 smithi031 bash[22603]: audit 2020-06-27T04:42:28.009420+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256782\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256838\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:28.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:28 smithi031 bash[22603]: audit 2020-06-27T04:42:28.012014+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256782\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.256838\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_device_update\": \"2020-06-27T04:40:18.363325\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:28.753 INFO:teuthology.orchestra.run.smithi031:osd.0> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service 2020-06-27T04:42:28.756 INFO:tasks.cephadm:Deploying osd.1 on smithi031 with /dev/vg_nvme/lv_3... 2020-06-27T04:42:28.756 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2020-06-27T04:42:28.795 INFO:ceph.osd.0.smithi031.stdout:-- Logs begin at Sat 2020-06-27 04:33:08 UTC. -- 2020-06-27T04:42:29.380 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:29 smithi031 bash[25253]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-06-27T04:42:29.380 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:29 smithi031 bash[25253]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2020-06-27T04:42:29.380 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:29 smithi031 bash[25253]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2020-06-27T04:42:29.380 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:29 smithi031 bash[25253]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2020-06-27T04:42:29.381 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:29 smithi031 bash[25253]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2020-06-27T04:42:29.381 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:29 smithi031 bash[25253]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-06-27T04:42:29.381 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:29 smithi031 bash[25253]: --> ceph-volume lvm activate successful for osd ID: 0 2020-06-27T04:42:29.381 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:29 smithi031 podman[25255]: 2020-06-27 04:42:29.094429201 +0000 UTC m=+1.104293512 container died 72184c875a9086e68dc20fe9d54f131c360c1c2b31c199508bc1be767a2302ce (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:42:29.946 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:29 smithi031 podman[25255]: 2020-06-27 04:42:29.685595951 +0000 UTC m=+1.695460250 container remove 72184c875a9086e68dc20fe9d54f131c360c1c2b31c199508bc1be767a2302ce (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:42:29.947 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:29 smithi031 bash[25253]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0 found: no such container 2020-06-27T04:42:29.947 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:29 smithi031 bash[25253]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0 2020-06-27T04:42:29.947 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:29 smithi031 bash[25253]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0" found: no such container 2020-06-27T04:42:29.947 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:29 smithi031 bash[18426]: audit 2020-06-27T04:42:29.707191+0000 mon.b (mon.2) 35 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_daemon_update\": \"2020-06-27T04:42:29.706583\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:29.948 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:29 smithi031 bash[18426]: audit 2020-06-27T04:42:29.707897+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_daemon_update\": \"2020-06-27T04:42:29.706583\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:29.948 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:29 smithi031 bash[18426]: audit 2020-06-27T04:42:29.710968+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_daemon_update\": \"2020-06-27T04:42:29.706583\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:29.948 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:29 smithi031 bash[18426]: audit 2020-06-27T04:42:29.711805+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:29.949 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:29 smithi031 bash[22603]: audit 2020-06-27T04:42:29.707191+0000 mon.b (mon.2) 35 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_daemon_update\": \"2020-06-27T04:42:29.706583\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:29.949 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:29 smithi031 bash[22603]: audit 2020-06-27T04:42:29.707897+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_daemon_update\": \"2020-06-27T04:42:29.706583\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:29.949 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:29 smithi031 bash[22603]: audit 2020-06-27T04:42:29.710968+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_daemon_update\": \"2020-06-27T04:42:29.706583\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:29.949 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:29 smithi031 bash[22603]: audit 2020-06-27T04:42:29.711805+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:30.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:29 smithi051 bash[18409]: audit 2020-06-27T04:42:29.707191+0000 mon.b (mon.2) 35 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_daemon_update\": \"2020-06-27T04:42:29.706583\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:30.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:29 smithi051 bash[18409]: audit 2020-06-27T04:42:29.707897+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_daemon_update\": \"2020-06-27T04:42:29.706583\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:30.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:29 smithi051 bash[18409]: audit 2020-06-27T04:42:29.710968+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_daemon_update\": \"2020-06-27T04:42:29.706583\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:30.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:29 smithi051 bash[18409]: audit 2020-06-27T04:42:29.711805+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:30.973 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 podman[25580]: 2020-06-27 04:42:30.657344966 +0000 UTC m=+0.855698200 container create bf7312b7e1fcc1242bb382d2e29d4f1fe05d5d106a92f24fa770ff816962b70f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:42:30.973 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 podman[25580]: 2020-06-27 04:42:30.886213464 +0000 UTC m=+1.084566708 container init bf7312b7e1fcc1242bb382d2e29d4f1fe05d5d106a92f24fa770ff816962b70f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:42:31.262 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 podman[25580]: 2020-06-27 04:42:30.976958421 +0000 UTC m=+1.175311654 container start bf7312b7e1fcc1242bb382d2e29d4f1fe05d5d106a92f24fa770ff816962b70f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:42:31.262 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 podman[25580]: 2020-06-27 04:42:30.977043565 +0000 UTC m=+1.175396801 container attach bf7312b7e1fcc1242bb382d2e29d4f1fe05d5d106a92f24fa770ff816962b70f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:42:31.263 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f7098084700 20 EpollDriver.del_event del event fd=14 cur_mask=1 delmask=3 to 8 2020-06-27T04:42:31.263 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 10 -- 172.21.15.31:0/489294961 shutdown 172.21.15.31:0/489294961 2020-06-27T04:42:31.263 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 10 Processor -- stop 2020-06-27T04:42:31.263 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 20 Event(0x55ae2bd06e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:42:31.263 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 1 -- 172.21.15.31:0/489294961 shutdown_connections 2020-06-27T04:42:31.264 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 5 -- 172.21.15.31:0/489294961 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55ae2bd73400 2020-06-27T04:42:31.264 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 1 --2- 172.21.15.31:0/489294961 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55ae2bd73400 0x55ae2bce4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:42:31.264 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 5 -- 172.21.15.31:0/489294961 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55ae2bd72c00 2020-06-27T04:42:31.264 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 1 --2- 172.21.15.31:0/489294961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55ae2bd72c00 0x55ae2bce3400 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:42:31.264 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 5 -- 172.21.15.31:0/489294961 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55ae2bd73000 2020-06-27T04:42:31.265 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 1 --2- 172.21.15.31:0/489294961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ae2bd73000 0x55ae2bce3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:42:31.265 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 5 -- 172.21.15.31:0/489294961 shutdown_connections delete 0x55ae2bd72c00 2020-06-27T04:42:31.265 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 5 -- 172.21.15.31:0/489294961 shutdown_connections delete 0x55ae2bd73000 2020-06-27T04:42:31.265 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 5 -- 172.21.15.31:0/489294961 shutdown_connections delete 0x55ae2bd73400 2020-06-27T04:42:31.265 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 1 -- 172.21.15.31:0/489294961 >> 172.21.15.31:0/489294961 conn(0x55ae2bd72800 msgr2=0x55ae2bddb000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:42:31.266 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 20 --1- 172.21.15.31:0/489294961 >> 172.21.15.31:0/489294961 conn(0x55ae2bd72800 0x55ae2bddb000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:42:31.266 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 2 --1- 172.21.15.31:0/489294961 >> 172.21.15.31:0/489294961 conn(0x55ae2bd72800 0x55ae2bddb000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:42:31.266 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 5 --1- 172.21.15.31:0/489294961 >> 172.21.15.31:0/489294961 conn(0x55ae2bd72800 0x55ae2bddb000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:42:31.266 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 20 Event(0x55ae2bd06e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:42:31.266 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 10 --1- 172.21.15.31:0/489294961 >> 172.21.15.31:0/489294961 conn(0x55ae2bd72800 0x55ae2bddb000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:42:31.266 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 20 Event(0x55ae2bd07040 nevent=5000 time_id=3).wakeup 2020-06-27T04:42:31.267 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 20 Event(0x55ae2bd07280 nevent=5000 time_id=2).wakeup 2020-06-27T04:42:31.267 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f7098885700 5 --1- 172.21.15.31:0/489294961 >> 172.21.15.31:0/489294961 conn(0x55ae2bd72800 0x55ae2bddb000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:42:31.267 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f7098885700 5 --1- 172.21.15.31:0/489294961 >> 172.21.15.31:0/489294961 conn(0x55ae2bd72800 0x55ae2bddb000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:42:31.267 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 10 -- 172.21.15.31:0/489294961 wait: waiting for dispatch queue 2020-06-27T04:42:31.267 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 10 -- 172.21.15.31:0/489294961 wait: dispatch queue is stopped 2020-06-27T04:42:31.268 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 1 -- 172.21.15.31:0/489294961 shutdown_connections 2020-06-27T04:42:31.268 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 5 -- 172.21.15.31:0/489294961 shutdown_connections delete 0x55ae2bd72800 2020-06-27T04:42:31.268 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 20 Event(0x55ae2bd06e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:42:31.268 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 20 Event(0x55ae2bd07040 nevent=5000 time_id=3).wakeup 2020-06-27T04:42:31.268 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 20 Event(0x55ae2bd07280 nevent=5000 time_id=2).wakeup 2020-06-27T04:42:31.268 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 10 -- 172.21.15.31:0/489294961 wait: done. 2020-06-27T04:42:31.269 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:30 smithi031 bash[25253]: debug 2020-06-27T04:42:30.911+0000 7f709eb02f40 1 -- 172.21.15.31:0/489294961 wait complete. 2020-06-27T04:42:31.723 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:31 smithi031 bash[25253]: debug 2020-06-27T04:42:31.435+0000 7f709eb02f40 -1 Falling back to public interface 2020-06-27T04:42:31.730 INFO:teuthology.orchestra.run.smithi031.stderr:--> Zapping: /dev/vg_nvme/lv_3 2020-06-27T04:42:31.731 INFO:teuthology.orchestra.run.smithi031.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2020-06-27T04:42:31.731 INFO:teuthology.orchestra.run.smithi031.stderr: stderr: 10+0 records in 2020-06-27T04:42:31.731 INFO:teuthology.orchestra.run.smithi031.stderr:10+0 records out 2020-06-27T04:42:31.731 INFO:teuthology.orchestra.run.smithi031.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0136162 s, 770 MB/s 2020-06-27T04:42:31.731 INFO:teuthology.orchestra.run.smithi031.stderr:--> Zapping successful for: 2020-06-27T04:42:32.067 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:32 smithi031 bash[25253]: debug 2020-06-27T04:42:32.003+0000 7f709eb02f40 -1 osd.0 0 log_to_monitors {default=true} 2020-06-27T04:42:32.236 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph orch daemon add osd smithi031:vg_nvme/lv_3 2020-06-27T04:42:32.437 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:32 smithi031 bash[18426]: audit 2020-06-27T04:42:32.007240+0000 mon.a (mon.0) 261 : audit [INF] from='osd.0 v2:172.21.15.31:6800/4030364259' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:42:32.437 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:32 smithi031 bash[22603]: audit 2020-06-27T04:42:32.007240+0000 mon.a (mon.0) 261 : audit [INF] from='osd.0 v2:172.21.15.31:6800/4030364259' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:42:32.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:32 smithi051 bash[18409]: audit 2020-06-27T04:42:32.007240+0000 mon.a (mon.0) 261 : audit [INF] from='osd.0 v2:172.21.15.31:6800/4030364259' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:42:33.406 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:42:33 smithi031 bash[25253]: debug 2020-06-27T04:42:33.067+0000 7f709507e700 -1 osd.0 0 waiting for initial osdmap 2020-06-27T04:42:33.407 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:33 smithi031 bash[18426]: audit 2020-06-27T04:42:32.060611+0000 mon.a (mon.0) 262 : audit [INF] from='osd.0 v2:172.21.15.31:6800/4030364259' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2020-06-27T04:42:33.407 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:33 smithi031 bash[18426]: cluster 2020-06-27T04:42:32.060646+0000 mon.a (mon.0) 263 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2020-06-27T04:42:33.407 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:33 smithi031 bash[18426]: audit 2020-06-27T04:42:32.061229+0000 mon.a (mon.0) 264 : audit [INF] from='osd.0 v2:172.21.15.31:6800/4030364259' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:42:33.407 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:33 smithi031 bash[18426]: audit 2020-06-27T04:42:32.064385+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:42:33.408 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:33 smithi031 bash[18426]: audit 2020-06-27T04:42:33.064420+0000 mon.a (mon.0) 265 : audit [INF] from='osd.0 v2:172.21.15.31:6800/4030364259' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2020-06-27T04:42:33.408 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:33 smithi031 bash[22603]: audit 2020-06-27T04:42:32.060611+0000 mon.a (mon.0) 262 : audit [INF] from='osd.0 v2:172.21.15.31:6800/4030364259' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2020-06-27T04:42:33.408 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:33 smithi031 bash[22603]: cluster 2020-06-27T04:42:32.060646+0000 mon.a (mon.0) 263 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2020-06-27T04:42:33.408 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:33 smithi031 bash[22603]: audit 2020-06-27T04:42:32.061229+0000 mon.a (mon.0) 264 : audit [INF] from='osd.0 v2:172.21.15.31:6800/4030364259' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:42:33.408 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:33 smithi031 bash[22603]: audit 2020-06-27T04:42:32.064385+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:42:33.409 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:33 smithi031 bash[22603]: audit 2020-06-27T04:42:33.064420+0000 mon.a (mon.0) 265 : audit [INF] from='osd.0 v2:172.21.15.31:6800/4030364259' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2020-06-27T04:42:33.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:33 smithi051 bash[18409]: audit 2020-06-27T04:42:32.060611+0000 mon.a (mon.0) 262 : audit [INF] from='osd.0 v2:172.21.15.31:6800/4030364259' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2020-06-27T04:42:33.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:33 smithi051 bash[18409]: cluster 2020-06-27T04:42:32.060646+0000 mon.a (mon.0) 263 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2020-06-27T04:42:33.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:33 smithi051 bash[18409]: audit 2020-06-27T04:42:32.061229+0000 mon.a (mon.0) 264 : audit [INF] from='osd.0 v2:172.21.15.31:6800/4030364259' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:42:33.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:33 smithi051 bash[18409]: audit 2020-06-27T04:42:32.064385+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:42:33.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:33 smithi051 bash[18409]: audit 2020-06-27T04:42:33.064420+0000 mon.a (mon.0) 265 : audit [INF] from='osd.0 v2:172.21.15.31:6800/4030364259' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2020-06-27T04:42:34.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:34 smithi031 bash[18426]: cluster 2020-06-27T04:42:33.049482+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:42:34.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:34 smithi031 bash[18426]: cluster 2020-06-27T04:42:33.049574+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:42:34.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:34 smithi031 bash[18426]: cluster 2020-06-27T04:42:33.064482+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e10: 1 total, 0 up, 0 in 2020-06-27T04:42:34.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:34 smithi031 bash[18426]: audit 2020-06-27T04:42:33.067156+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:42:34.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:34 smithi031 bash[22603]: cluster 2020-06-27T04:42:33.049482+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:42:34.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:34 smithi031 bash[22603]: cluster 2020-06-27T04:42:33.049574+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:42:34.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:34 smithi031 bash[22603]: cluster 2020-06-27T04:42:33.064482+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e10: 1 total, 0 up, 0 in 2020-06-27T04:42:34.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:34 smithi031 bash[22603]: audit 2020-06-27T04:42:33.067156+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:42:34.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:34 smithi051 bash[18409]: cluster 2020-06-27T04:42:33.049482+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:42:34.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:34 smithi051 bash[18409]: cluster 2020-06-27T04:42:33.049574+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:42:34.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:34 smithi051 bash[18409]: cluster 2020-06-27T04:42:33.064482+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e10: 1 total, 0 up, 0 in 2020-06-27T04:42:34.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:34 smithi051 bash[18409]: audit 2020-06-27T04:42:33.067156+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:42:34.570 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.564+0000 7fb1befc1700 1 Processor -- start 2020-06-27T04:42:34.570 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.564+0000 7fb1befc1700 1 -- start start 2020-06-27T04:42:34.571 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.565+0000 7fb1befc1700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb1b8066360 0x7fb1b806cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:42:34.571 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.565+0000 7fb1befc1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1b806be30 0x7fb1b8078280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:42:34.571 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.565+0000 7fb1befc1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1b80788b0 0x7fb1b8122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:42:34.571 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.565+0000 7fb1befc1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8123280 con 0x7fb1b806be30 2020-06-27T04:42:34.571 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.565+0000 7fb1befc1700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b81233c0 con 0x7fb1b8066360 2020-06-27T04:42:34.572 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.565+0000 7fb1befc1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8123580 con 0x7fb1b80788b0 2020-06-27T04:42:34.572 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.565+0000 7fb1bcd5d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1b806be30 0x7fb1b8078280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:42:34.572 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.565+0000 7fb1bdd5f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1b80788b0 0x7fb1b8122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:42:34.572 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.565+0000 7fb1bcd5d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1b806be30 0x7fb1b8078280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38864/0 (socket says 172.21.15.31:38864) 2020-06-27T04:42:34.572 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.565+0000 7fb1bcd5d700 1 -- 172.21.15.31:0/2708807961 learned_addr learned my addr 172.21.15.31:0/2708807961 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:42:34.573 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.565+0000 7fb1bd55e700 1 --2- 172.21.15.31:0/2708807961 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb1b8066360 0x7fb1b806cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:42:34.573 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.565+0000 7fb1bdd5f700 1 -- 172.21.15.31:0/2708807961 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb1b8066360 msgr2=0x7fb1b806cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:42:34.573 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.565+0000 7fb1bdd5f700 1 --2- 172.21.15.31:0/2708807961 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb1b8066360 0x7fb1b806cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:42:34.573 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.565+0000 7fb1bdd5f700 1 -- 172.21.15.31:0/2708807961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1b806be30 msgr2=0x7fb1b8078280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:42:34.573 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.565+0000 7fb1bdd5f700 1 --2- 172.21.15.31:0/2708807961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1b806be30 0x7fb1b8078280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:42:34.574 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.565+0000 7fb1bdd5f700 1 -- 172.21.15.31:0/2708807961 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b8123740 con 0x7fb1b80788b0 2020-06-27T04:42:34.574 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.565+0000 7fb1bdd5f700 1 --2- 172.21.15.31:0/2708807961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1b80788b0 0x7fb1b8122cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fb1b000a000 tx=0x7fb1b0004d20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:42:34.574 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.565+0000 7fb1ad7fa700 1 -- 172.21.15.31:0/2708807961 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1b0004020 con 0x7fb1b80788b0 2020-06-27T04:42:34.574 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.566+0000 7fb1befc1700 1 -- 172.21.15.31:0/2708807961 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b81239f0 con 0x7fb1b80788b0 2020-06-27T04:42:34.574 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.566+0000 7fb1befc1700 1 -- 172.21.15.31:0/2708807961 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b8123f90 con 0x7fb1b80788b0 2020-06-27T04:42:34.575 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.566+0000 7fb1ad7fa700 1 -- 172.21.15.31:0/2708807961 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fb1b000f040 con 0x7fb1b80788b0 2020-06-27T04:42:34.575 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.566+0000 7fb1ad7fa700 1 -- 172.21.15.31:0/2708807961 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1b0003620 con 0x7fb1b80788b0 2020-06-27T04:42:34.575 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.566+0000 7fb1ad7fa700 1 -- 172.21.15.31:0/2708807961 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7fb1b0019020 con 0x7fb1b80788b0 2020-06-27T04:42:34.575 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.566+0000 7fb1ad7fa700 1 --2- 172.21.15.31:0/2708807961 >> v2:172.21.15.51:6800/950992045 conn(0x7fb19402ab50 0x7fb19402d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:42:34.575 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.566+0000 7fb1ad7fa700 1 -- 172.21.15.31:0/2708807961 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2142+0+0 (secure 0 0 0) 0x7fb1b0039200 con 0x7fb1b80788b0 2020-06-27T04:42:34.575 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.566+0000 7fb1befc1700 1 -- 172.21.15.31:0/2708807961 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b805e210 con 0x7fb1b80788b0 2020-06-27T04:42:34.576 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.567+0000 7fb1bd55e700 1 --2- 172.21.15.31:0/2708807961 >> v2:172.21.15.51:6800/950992045 conn(0x7fb19402ab50 0x7fb19402d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:42:34.576 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.567+0000 7fb1bd55e700 1 --2- 172.21.15.31:0/2708807961 >> v2:172.21.15.51:6800/950992045 conn(0x7fb19402ab50 0x7fb19402d010 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fb1b4016000 tx=0x7fb1b4009b30).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:42:34.577 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.570+0000 7fb1ad7fa700 1 -- 172.21.15.31:0/2708807961 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fb1b00118e0 con 0x7fb1b80788b0 2020-06-27T04:42:34.751 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:34.747+0000 7fb1befc1700 1 -- 172.21.15.31:0/2708807961 --> v2:172.21.15.51:6800/950992045 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1b805f390 con 0x7fb19402ab50 2020-06-27T04:42:35.330 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[18426]: audit 2020-06-27T04:42:34.067601+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:42:35.331 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[18426]: cluster 2020-06-27T04:42:34.071032+0000 mon.a (mon.0) 267 : cluster [INF] osd.0 v2:172.21.15.31:6800/4030364259 boot 2020-06-27T04:42:35.331 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[18426]: cluster 2020-06-27T04:42:34.071073+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2020-06-27T04:42:35.331 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[18426]: audit 2020-06-27T04:42:34.074174+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:42:35.331 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[18426]: audit 2020-06-27T04:42:34.113620+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:42:35.332 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[22603]: audit 2020-06-27T04:42:34.067601+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:42:35.332 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[22603]: cluster 2020-06-27T04:42:34.071032+0000 mon.a (mon.0) 267 : cluster [INF] osd.0 v2:172.21.15.31:6800/4030364259 boot 2020-06-27T04:42:35.332 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[22603]: cluster 2020-06-27T04:42:34.071073+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2020-06-27T04:42:35.332 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[22603]: audit 2020-06-27T04:42:34.074174+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:42:35.332 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[22603]: audit 2020-06-27T04:42:34.113620+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:42:35.334 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[22603]: audit 2020-06-27T04:42:34.360194+0000 mon.b (mon.2) 42 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_daemon_update\": \"2020-06-27T04:42:29.706583\", \"last_device_update\": \"2020-06-27T04:42:34.359426\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:35.334 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[22603]: audit 2020-06-27T04:42:34.360702+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_daemon_update\": \"2020-06-27T04:42:29.706583\", \"last_device_update\": \"2020-06-27T04:42:34.359426\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:35.335 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[22603]: audit 2020-06-27T04:42:34.363210+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_daemon_update\": \"2020-06-27T04:42:29.706583\", \"last_device_update\": \"2020-06-27T04:42:34.359426\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:35.335 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[22603]: audit 2020-06-27T04:42:34.749141+0000 mgr.x (mgr.34109) 6 : audit [DBG] from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:42:35.335 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[22603]: audit 2020-06-27T04:42:34.750055+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:42:35.335 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[22603]: cephadm 2020-06-27T04:42:34.750775+0000 mgr.x (mgr.34109) 7 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:42:35.335 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[22603]: cephadm 2020-06-27T04:42:34.750856+0000 mgr.x (mgr.34109) 8 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:42:35.336 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[22603]: cephadm 2020-06-27T04:42:34.751096+0000 mgr.x (mgr.34109) 9 : cephadm [INF] Applying None on host smithi031... 2020-06-27T04:42:35.336 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[22603]: audit 2020-06-27T04:42:34.751474+0000 mon.b (mon.2) 44 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:42:35.336 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[22603]: audit 2020-06-27T04:42:34.752233+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:42:35.336 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[22603]: audit 2020-06-27T04:42:34.753029+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:35.336 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[22603]: cluster 2020-06-27T04:42:35.072960+0000 mon.a (mon.0) 271 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2020-06-27T04:42:35.337 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[18426]: audit 2020-06-27T04:42:34.360194+0000 mon.b (mon.2) 42 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_daemon_update\": \"2020-06-27T04:42:29.706583\", \"last_device_update\": \"2020-06-27T04:42:34.359426\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:35.337 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[18426]: audit 2020-06-27T04:42:34.360702+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_daemon_update\": \"2020-06-27T04:42:29.706583\", \"last_device_update\": \"2020-06-27T04:42:34.359426\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:35.337 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[18426]: audit 2020-06-27T04:42:34.363210+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_daemon_update\": \"2020-06-27T04:42:29.706583\", \"last_device_update\": \"2020-06-27T04:42:34.359426\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:35.337 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[18426]: audit 2020-06-27T04:42:34.749141+0000 mgr.x (mgr.34109) 6 : audit [DBG] from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:42:35.338 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[18426]: audit 2020-06-27T04:42:34.750055+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:42:35.338 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[18426]: cephadm 2020-06-27T04:42:34.750775+0000 mgr.x (mgr.34109) 7 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:42:35.338 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[18426]: cephadm 2020-06-27T04:42:34.750856+0000 mgr.x (mgr.34109) 8 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:42:35.338 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[18426]: cephadm 2020-06-27T04:42:34.751096+0000 mgr.x (mgr.34109) 9 : cephadm [INF] Applying None on host smithi031... 2020-06-27T04:42:35.338 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[18426]: audit 2020-06-27T04:42:34.751474+0000 mon.b (mon.2) 44 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:42:35.339 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[18426]: audit 2020-06-27T04:42:34.752233+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:42:35.339 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[18426]: audit 2020-06-27T04:42:34.753029+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:35.339 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:35 smithi031 bash[18426]: cluster 2020-06-27T04:42:35.072960+0000 mon.a (mon.0) 271 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2020-06-27T04:42:35.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:35 smithi051 bash[18409]: audit 2020-06-27T04:42:34.067601+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:42:35.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:35 smithi051 bash[18409]: cluster 2020-06-27T04:42:34.071032+0000 mon.a (mon.0) 267 : cluster [INF] osd.0 v2:172.21.15.31:6800/4030364259 boot 2020-06-27T04:42:35.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:35 smithi051 bash[18409]: cluster 2020-06-27T04:42:34.071073+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2020-06-27T04:42:35.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:35 smithi051 bash[18409]: audit 2020-06-27T04:42:34.074174+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:42:35.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:35 smithi051 bash[18409]: audit 2020-06-27T04:42:34.113620+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:42:35.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:35 smithi051 bash[18409]: audit 2020-06-27T04:42:34.360194+0000 mon.b (mon.2) 42 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_daemon_update\": \"2020-06-27T04:42:29.706583\", \"last_device_update\": \"2020-06-27T04:42:34.359426\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:35.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:35 smithi051 bash[18409]: audit 2020-06-27T04:42:34.360702+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_daemon_update\": \"2020-06-27T04:42:29.706583\", \"last_device_update\": \"2020-06-27T04:42:34.359426\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:35.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:35 smithi051 bash[18409]: audit 2020-06-27T04:42:34.363210+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}}, \"last_daemon_update\": \"2020-06-27T04:42:29.706583\", \"last_device_update\": \"2020-06-27T04:42:34.359426\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:35.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:35 smithi051 bash[18409]: audit 2020-06-27T04:42:34.749141+0000 mgr.x (mgr.34109) 6 : audit [DBG] from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:42:35.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:35 smithi051 bash[18409]: audit 2020-06-27T04:42:34.750055+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:42:35.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:35 smithi051 bash[18409]: cephadm 2020-06-27T04:42:34.750775+0000 mgr.x (mgr.34109) 7 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:42:35.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:35 smithi051 bash[18409]: cephadm 2020-06-27T04:42:34.750856+0000 mgr.x (mgr.34109) 8 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:42:35.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:35 smithi051 bash[18409]: cephadm 2020-06-27T04:42:34.751096+0000 mgr.x (mgr.34109) 9 : cephadm [INF] Applying None on host smithi031... 2020-06-27T04:42:35.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:35 smithi051 bash[18409]: audit 2020-06-27T04:42:34.751474+0000 mon.b (mon.2) 44 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:42:35.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:35 smithi051 bash[18409]: audit 2020-06-27T04:42:34.752233+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:42:35.473 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:35 smithi051 bash[18409]: audit 2020-06-27T04:42:34.753029+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:35.473 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:35 smithi051 bash[18409]: cluster 2020-06-27T04:42:35.072960+0000 mon.a (mon.0) 271 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2020-06-27T04:42:36.375 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:36 smithi031 bash[18426]: cluster 2020-06-27T04:42:35.068232+0000 mgr.x (mgr.34109) 10 : cluster [DBG] pgmap v7: 1 pgs: 1 creating+peering; 0 B data, 104 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:36.376 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:36 smithi031 bash[18426]: cluster 2020-06-27T04:42:35.104154+0000 mgr.x (mgr.34109) 11 : cluster [DBG] pgmap v9: 1 pgs: 1 creating+peering; 0 B data, 104 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:36.376 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:36 smithi031 bash[18426]: cluster 2020-06-27T04:42:35.361743+0000 mon.a (mon.0) 272 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2020-06-27T04:42:36.376 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:36 smithi031 bash[18426]: cluster 2020-06-27T04:42:36.073319+0000 mon.a (mon.0) 273 : cluster [DBG] osdmap e13: 1 total, 1 up, 1 in 2020-06-27T04:42:36.377 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:36 smithi031 bash[22603]: cluster 2020-06-27T04:42:35.068232+0000 mgr.x (mgr.34109) 10 : cluster [DBG] pgmap v7: 1 pgs: 1 creating+peering; 0 B data, 104 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:36.377 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:36 smithi031 bash[22603]: cluster 2020-06-27T04:42:35.104154+0000 mgr.x (mgr.34109) 11 : cluster [DBG] pgmap v9: 1 pgs: 1 creating+peering; 0 B data, 104 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:36.378 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:36 smithi031 bash[22603]: cluster 2020-06-27T04:42:35.361743+0000 mon.a (mon.0) 272 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2020-06-27T04:42:36.378 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:36 smithi031 bash[22603]: cluster 2020-06-27T04:42:36.073319+0000 mon.a (mon.0) 273 : cluster [DBG] osdmap e13: 1 total, 1 up, 1 in 2020-06-27T04:42:36.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:36 smithi051 bash[18409]: cluster 2020-06-27T04:42:35.068232+0000 mgr.x (mgr.34109) 10 : cluster [DBG] pgmap v7: 1 pgs: 1 creating+peering; 0 B data, 104 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:36.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:36 smithi051 bash[18409]: cluster 2020-06-27T04:42:35.104154+0000 mgr.x (mgr.34109) 11 : cluster [DBG] pgmap v9: 1 pgs: 1 creating+peering; 0 B data, 104 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:36.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:36 smithi051 bash[18409]: cluster 2020-06-27T04:42:35.361743+0000 mon.a (mon.0) 272 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2020-06-27T04:42:36.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:36 smithi051 bash[18409]: cluster 2020-06-27T04:42:36.073319+0000 mon.a (mon.0) 273 : cluster [DBG] osdmap e13: 1 total, 1 up, 1 in 2020-06-27T04:42:37.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:37 smithi051 bash[18409]: audit 2020-06-27T04:42:37.061698+0000 mon.a (mon.0) 274 : audit [INF] from='client.? 172.21.15.31:0/1040884388' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e06700d6-7863-486c-a5bd-4ea867e8273c"}]: dispatch 2020-06-27T04:42:37.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:37 smithi051 bash[18409]: audit 2020-06-27T04:42:37.065234+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:42:37.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:37 smithi051 bash[18409]: audit 2020-06-27T04:42:37.066381+0000 mon.a (mon.0) 275 : audit [INF] from='client.? 172.21.15.31:0/1040884388' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e06700d6-7863-486c-a5bd-4ea867e8273c"}]': finished 2020-06-27T04:42:37.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:37 smithi051 bash[18409]: cluster 2020-06-27T04:42:37.066430+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2020-06-27T04:42:37.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:37 smithi031 bash[18426]: audit 2020-06-27T04:42:37.061698+0000 mon.a (mon.0) 274 : audit [INF] from='client.? 172.21.15.31:0/1040884388' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e06700d6-7863-486c-a5bd-4ea867e8273c"}]: dispatch 2020-06-27T04:42:37.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:37 smithi031 bash[18426]: audit 2020-06-27T04:42:37.065234+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:42:37.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:37 smithi031 bash[18426]: audit 2020-06-27T04:42:37.066381+0000 mon.a (mon.0) 275 : audit [INF] from='client.? 172.21.15.31:0/1040884388' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e06700d6-7863-486c-a5bd-4ea867e8273c"}]': finished 2020-06-27T04:42:37.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:37 smithi031 bash[18426]: cluster 2020-06-27T04:42:37.066430+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2020-06-27T04:42:37.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:37 smithi031 bash[22603]: audit 2020-06-27T04:42:37.061698+0000 mon.a (mon.0) 274 : audit [INF] from='client.? 172.21.15.31:0/1040884388' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e06700d6-7863-486c-a5bd-4ea867e8273c"}]: dispatch 2020-06-27T04:42:37.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:37 smithi031 bash[22603]: audit 2020-06-27T04:42:37.065234+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:42:37.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:37 smithi031 bash[22603]: audit 2020-06-27T04:42:37.066381+0000 mon.a (mon.0) 275 : audit [INF] from='client.? 172.21.15.31:0/1040884388' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e06700d6-7863-486c-a5bd-4ea867e8273c"}]': finished 2020-06-27T04:42:37.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:37 smithi031 bash[22603]: cluster 2020-06-27T04:42:37.066430+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2020-06-27T04:42:38.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:38 smithi051 bash[18409]: cluster 2020-06-27T04:42:37.104679+0000 mgr.x (mgr.34109) 12 : cluster [DBG] pgmap v12: 1 pgs: 1 creating+peering; 0 B data, 104 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:38.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:38 smithi051 bash[18409]: audit 2020-06-27T04:42:37.591615+0000 mon.c (mon.1) 4 : audit [DBG] from='client.? 172.21.15.31:0/845410367' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:42:38.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:38 smithi031 bash[18426]: cluster 2020-06-27T04:42:37.104679+0000 mgr.x (mgr.34109) 12 : cluster [DBG] pgmap v12: 1 pgs: 1 creating+peering; 0 B data, 104 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:38.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:38 smithi031 bash[18426]: audit 2020-06-27T04:42:37.591615+0000 mon.c (mon.1) 4 : audit [DBG] from='client.? 172.21.15.31:0/845410367' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:42:38.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:38 smithi031 bash[22603]: cluster 2020-06-27T04:42:37.104679+0000 mgr.x (mgr.34109) 12 : cluster [DBG] pgmap v12: 1 pgs: 1 creating+peering; 0 B data, 104 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:38.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:38 smithi031 bash[22603]: audit 2020-06-27T04:42:37.591615+0000 mon.c (mon.1) 4 : audit [DBG] from='client.? 172.21.15.31:0/845410367' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:42:40.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:40 smithi051 bash[18409]: cluster 2020-06-27T04:42:39.105236+0000 mgr.x (mgr.34109) 13 : cluster [DBG] pgmap v13: 1 pgs: 1 creating+peering; 0 B data, 104 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:40.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:40 smithi051 bash[18409]: audit 2020-06-27T04:42:40.027836+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:40.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:40 smithi031 bash[18426]: cluster 2020-06-27T04:42:39.105236+0000 mgr.x (mgr.34109) 13 : cluster [DBG] pgmap v13: 1 pgs: 1 creating+peering; 0 B data, 104 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:40.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:40 smithi031 bash[18426]: audit 2020-06-27T04:42:40.027836+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:40.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:40 smithi031 bash[22603]: cluster 2020-06-27T04:42:39.105236+0000 mgr.x (mgr.34109) 13 : cluster [DBG] pgmap v13: 1 pgs: 1 creating+peering; 0 B data, 104 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:40.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:40 smithi031 bash[22603]: audit 2020-06-27T04:42:40.027836+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:41.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:41 smithi051 bash[18409]: cluster 2020-06-27T04:42:41.161185+0000 mon.a (mon.0) 277 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2020-06-27T04:42:41.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:41 smithi031 bash[18426]: cluster 2020-06-27T04:42:41.161185+0000 mon.a (mon.0) 277 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2020-06-27T04:42:41.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:41 smithi031 bash[22603]: cluster 2020-06-27T04:42:41.161185+0000 mon.a (mon.0) 277 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2020-06-27T04:42:42.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:42 smithi031 bash[18426]: cluster 2020-06-27T04:42:41.105704+0000 mgr.x (mgr.34109) 14 : cluster [DBG] pgmap v14: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:42.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:42 smithi031 bash[22603]: cluster 2020-06-27T04:42:41.105704+0000 mgr.x (mgr.34109) 14 : cluster [DBG] pgmap v14: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:42.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:42 smithi051 bash[18409]: cluster 2020-06-27T04:42:41.105704+0000 mgr.x (mgr.34109) 14 : cluster [DBG] pgmap v14: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:43.443 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:43 smithi031 bash[18426]: audit 2020-06-27T04:42:42.577286+0000 mon.b (mon.2) 49 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2020-06-27T04:42:43.444 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:43 smithi031 bash[18426]: audit 2020-06-27T04:42:42.578130+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:42:43.444 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:43 smithi031 bash[18426]: cephadm 2020-06-27T04:42:42.578764+0000 mgr.x (mgr.34109) 15 : cephadm [INF] Deploying daemon osd.1 on smithi031 2020-06-27T04:42:43.444 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:43 smithi031 bash[18426]: audit 2020-06-27T04:42:42.579076+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2020-06-27T04:42:43.444 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:43 smithi031 bash[22603]: audit 2020-06-27T04:42:42.577286+0000 mon.b (mon.2) 49 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2020-06-27T04:42:43.445 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:43 smithi031 bash[22603]: audit 2020-06-27T04:42:42.578130+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:42:43.445 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:43 smithi031 bash[22603]: cephadm 2020-06-27T04:42:42.578764+0000 mgr.x (mgr.34109) 15 : cephadm [INF] Deploying daemon osd.1 on smithi031 2020-06-27T04:42:43.445 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:43 smithi031 bash[22603]: audit 2020-06-27T04:42:42.579076+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2020-06-27T04:42:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:43 smithi051 bash[18409]: audit 2020-06-27T04:42:42.577286+0000 mon.b (mon.2) 49 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2020-06-27T04:42:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:43 smithi051 bash[18409]: audit 2020-06-27T04:42:42.578130+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:42:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:43 smithi051 bash[18409]: cephadm 2020-06-27T04:42:42.578764+0000 mgr.x (mgr.34109) 15 : cephadm [INF] Deploying daemon osd.1 on smithi031 2020-06-27T04:42:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:43 smithi051 bash[18409]: audit 2020-06-27T04:42:42.579076+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2020-06-27T04:42:44.226 INFO:teuthology.orchestra.run.smithi031.stdout:Created osd(s) 1 on host 'smithi031' 2020-06-27T04:42:44.227 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:44.214+0000 7fb1ad7fa700 1 -- 172.21.15.31:0/2708807961 <== mgr.34109 v2:172.21.15.51:6800/950992045 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb1b4009390 con 0x7fb19402ab50 2020-06-27T04:42:44.227 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:44.216+0000 7fb1befc1700 1 -- 172.21.15.31:0/2708807961 >> v2:172.21.15.51:6800/950992045 conn(0x7fb19402ab50 msgr2=0x7fb19402d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:42:44.227 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:44.216+0000 7fb1befc1700 1 --2- 172.21.15.31:0/2708807961 >> v2:172.21.15.51:6800/950992045 conn(0x7fb19402ab50 0x7fb19402d010 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fb1b4016000 tx=0x7fb1b4009b30).stop 2020-06-27T04:42:44.228 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:44.216+0000 7fb1befc1700 1 -- 172.21.15.31:0/2708807961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1b80788b0 msgr2=0x7fb1b8122cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:42:44.228 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:44.216+0000 7fb1befc1700 1 --2- 172.21.15.31:0/2708807961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1b80788b0 0x7fb1b8122cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fb1b000a000 tx=0x7fb1b0004d20).stop 2020-06-27T04:42:44.228 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:44.217+0000 7fb1befc1700 1 -- 172.21.15.31:0/2708807961 shutdown_connections 2020-06-27T04:42:44.228 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:44.217+0000 7fb1befc1700 1 --2- 172.21.15.31:0/2708807961 >> v2:172.21.15.51:6800/950992045 conn(0x7fb19402ab50 0x7fb19402d010 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:42:44.228 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:44.217+0000 7fb1befc1700 1 --2- 172.21.15.31:0/2708807961 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb1b8066360 0x7fb1b806cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:42:44.229 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:44.217+0000 7fb1befc1700 1 --2- 172.21.15.31:0/2708807961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1b80788b0 0x7fb1b8122cb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:42:44.229 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:44.217+0000 7fb1befc1700 1 --2- 172.21.15.31:0/2708807961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1b806be30 0x7fb1b8078280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:42:44.229 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:44.217+0000 7fb1befc1700 1 -- 172.21.15.31:0/2708807961 >> 172.21.15.31:0/2708807961 conn(0x7fb1b8061830 msgr2=0x7fb1b806d350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:42:44.229 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:44.217+0000 7fb1befc1700 1 -- 172.21.15.31:0/2708807961 shutdown_connections 2020-06-27T04:42:44.229 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:44.217+0000 7fb1befc1700 1 -- 172.21.15.31:0/2708807961 wait complete. 2020-06-27T04:42:44.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:44 smithi031 bash[18426]: cluster 2020-06-27T04:42:43.106062+0000 mgr.x (mgr.34109) 16 : cluster [DBG] pgmap v15: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:44.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:44 smithi031 bash[18426]: audit 2020-06-27T04:42:44.208507+0000 mon.b (mon.2) 52 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_device_update\": \"2020-06-27T04:42:34.359426\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:44.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:44 smithi031 bash[18426]: audit 2020-06-27T04:42:44.208868+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:42:44.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:44 smithi031 bash[18426]: audit 2020-06-27T04:42:44.209010+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_device_update\": \"2020-06-27T04:42:34.359426\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:44.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:44 smithi031 bash[18426]: audit 2020-06-27T04:42:44.211706+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_device_update\": \"2020-06-27T04:42:34.359426\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:44.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:44 smithi031 bash[22603]: cluster 2020-06-27T04:42:43.106062+0000 mgr.x (mgr.34109) 16 : cluster [DBG] pgmap v15: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:44.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:44 smithi031 bash[22603]: audit 2020-06-27T04:42:44.208507+0000 mon.b (mon.2) 52 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_device_update\": \"2020-06-27T04:42:34.359426\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:44.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:44 smithi031 bash[22603]: audit 2020-06-27T04:42:44.208868+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:42:44.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:44 smithi031 bash[22603]: audit 2020-06-27T04:42:44.209010+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_device_update\": \"2020-06-27T04:42:34.359426\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:44.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:44 smithi031 bash[22603]: audit 2020-06-27T04:42:44.211706+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_device_update\": \"2020-06-27T04:42:34.359426\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:44.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:44 smithi051 bash[18409]: cluster 2020-06-27T04:42:43.106062+0000 mgr.x (mgr.34109) 16 : cluster [DBG] pgmap v15: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:44.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:44 smithi051 bash[18409]: audit 2020-06-27T04:42:44.208507+0000 mon.b (mon.2) 52 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_device_update\": \"2020-06-27T04:42:34.359426\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:44.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:44 smithi051 bash[18409]: audit 2020-06-27T04:42:44.208868+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:42:44.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:44 smithi051 bash[18409]: audit 2020-06-27T04:42:44.209010+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_device_update\": \"2020-06-27T04:42:34.359426\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:44.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:44 smithi051 bash[18409]: audit 2020-06-27T04:42:44.211706+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706337\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706444\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:29.706486\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_device_update\": \"2020-06-27T04:42:34.359426\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:45.022 INFO:teuthology.orchestra.run.smithi031:osd.1> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service 2020-06-27T04:42:45.025 INFO:tasks.cephadm:Deploying osd.2 on smithi031 with /dev/vg_nvme/lv_2... 2020-06-27T04:42:45.025 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2020-06-27T04:42:45.066 INFO:ceph.osd.1.smithi031.stdout:-- Logs begin at Sat 2020-06-27 04:33:08 UTC. -- 2020-06-27T04:42:45.473 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:45 smithi031 bash[27358]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-06-27T04:42:45.473 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:45 smithi031 bash[27358]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2020-06-27T04:42:45.473 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:45 smithi031 bash[27358]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2020-06-27T04:42:45.474 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:45 smithi031 bash[27358]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2020-06-27T04:42:45.474 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:45 smithi031 bash[27358]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2020-06-27T04:42:45.474 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:45 smithi031 bash[27358]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-06-27T04:42:45.474 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:45 smithi031 bash[27358]: --> ceph-volume lvm activate successful for osd ID: 1 2020-06-27T04:42:45.474 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:45 smithi031 podman[27360]: 2020-06-27 04:42:45.395390685 +0000 UTC m=+1.200797812 container died 91f2828c9069aead095896a0dfd01b7debce3474a3a8c8637ada6360dd6a979f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:42:46.195 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:45 smithi031 podman[27360]: 2020-06-27 04:42:45.938733984 +0000 UTC m=+1.744141112 container remove 91f2828c9069aead095896a0dfd01b7debce3474a3a8c8637ada6360dd6a979f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:42:46.196 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:46 smithi031 bash[27358]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1 found: no such container 2020-06-27T04:42:46.196 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:46 smithi031 bash[27358]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1 2020-06-27T04:42:46.196 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:46 smithi031 bash[27358]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1" found: no such container 2020-06-27T04:42:46.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:46 smithi031 bash[18426]: cluster 2020-06-27T04:42:45.106519+0000 mgr.x (mgr.34109) 17 : cluster [DBG] pgmap v16: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:46.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:46 smithi031 bash[18426]: audit 2020-06-27T04:42:46.081901+0000 mon.b (mon.2) 54 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_daemon_update\": \"2020-06-27T04:42:46.081245\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:46.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:46 smithi031 bash[18426]: audit 2020-06-27T04:42:46.082490+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_daemon_update\": \"2020-06-27T04:42:46.081245\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:46.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:46 smithi031 bash[18426]: audit 2020-06-27T04:42:46.085123+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_daemon_update\": \"2020-06-27T04:42:46.081245\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:46.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:46 smithi031 bash[18426]: audit 2020-06-27T04:42:46.085964+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:46.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:46 smithi031 bash[22603]: cluster 2020-06-27T04:42:45.106519+0000 mgr.x (mgr.34109) 17 : cluster [DBG] pgmap v16: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:46.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:46 smithi031 bash[22603]: audit 2020-06-27T04:42:46.081901+0000 mon.b (mon.2) 54 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_daemon_update\": \"2020-06-27T04:42:46.081245\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:46.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:46 smithi031 bash[22603]: audit 2020-06-27T04:42:46.082490+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_daemon_update\": \"2020-06-27T04:42:46.081245\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:46.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:46 smithi031 bash[22603]: audit 2020-06-27T04:42:46.085123+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_daemon_update\": \"2020-06-27T04:42:46.081245\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:46.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:46 smithi031 bash[22603]: audit 2020-06-27T04:42:46.085964+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:46.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:46 smithi051 bash[18409]: cluster 2020-06-27T04:42:45.106519+0000 mgr.x (mgr.34109) 17 : cluster [DBG] pgmap v16: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:46.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:46 smithi051 bash[18409]: audit 2020-06-27T04:42:46.081901+0000 mon.b (mon.2) 54 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_daemon_update\": \"2020-06-27T04:42:46.081245\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:46.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:46 smithi051 bash[18409]: audit 2020-06-27T04:42:46.082490+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_daemon_update\": \"2020-06-27T04:42:46.081245\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:46.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:46 smithi051 bash[18409]: audit 2020-06-27T04:42:46.085123+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_daemon_update\": \"2020-06-27T04:42:46.081245\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:46.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:46 smithi051 bash[18409]: audit 2020-06-27T04:42:46.085964+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:46.952 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:46 smithi031 podman[27717]: 2020-06-27 04:42:46.682389783 +0000 UTC m=+0.616389014 container create 3c82a83d4166698ffe1ce3ddbcfa4cf9e1952bd66f44df4382953557c8c58b77 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:42:46.952 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:46 smithi031 podman[27717]: 2020-06-27 04:42:46.949097147 +0000 UTC m=+0.883096392 container init 3c82a83d4166698ffe1ce3ddbcfa4cf9e1952bd66f44df4382953557c8c58b77 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:42:47.223 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 podman[27717]: 2020-06-27 04:42:47.033676579 +0000 UTC m=+0.967675810 container start 3c82a83d4166698ffe1ce3ddbcfa4cf9e1952bd66f44df4382953557c8c58b77 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:42:47.223 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 podman[27717]: 2020-06-27 04:42:47.033766071 +0000 UTC m=+0.967765219 container attach 3c82a83d4166698ffe1ce3ddbcfa4cf9e1952bd66f44df4382953557c8c58b77 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:42:47.224 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.971+0000 7fdff1de2f40 1 -- 172.21.15.31:0/2544630573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571e3a92c00 msgr2=0x5571e3a03400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:42:47.224 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.971+0000 7fdff1de2f40 1 --2- 172.21.15.31:0/2544630573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571e3a92c00 0x5571e3a03400 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x5571e3a15a70 tx=0x5571e39e2d80).stop 2020-06-27T04:42:47.224 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.971+0000 7fdff1de2f40 5 --2- 172.21.15.31:0/2544630573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571e3a92c00 0x5571e3a03400 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x5571e3a15a70 tx=0x5571e39e2d80).reset_recv_state 2020-06-27T04:42:47.224 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.971+0000 7fdff1de2f40 20 Event(0x5571e3a27040 nevent=5000 time_id=3).wakeup 2020-06-27T04:42:47.224 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.971+0000 7fdff1de2f40 10 --2- 172.21.15.31:0/2544630573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571e3a92c00 0x5571e3a03400 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x5571e3a15a70 tx=0x5571e39e2d80).discard_out_queue started 2020-06-27T04:42:47.225 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.971+0000 7fdff1de2f40 20 Event(0x5571e3a27040 nevent=5000 time_id=3).wakeup 2020-06-27T04:42:47.225 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.971+0000 7fdfeb364700 5 --2- 172.21.15.31:0/2544630573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571e3a92c00 0x5571e3a03400 secure :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0x5571e3a15a70 tx=0x5571e39e2d80).reset_recv_state (warped) reseting crypto handlers 2020-06-27T04:42:47.225 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.971+0000 7fdfeb364700 5 --2- 172.21.15.31:0/2544630573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571e3a92c00 0x5571e3a03400 secure :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0x5571e3a15a70 tx=0x5571e39e2d80).reset_security 2020-06-27T04:42:47.225 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.971+0000 7fdfeb364700 20 EpollDriver.del_event del event fd=16 cur_mask=1 delmask=3 to 8 2020-06-27T04:42:47.225 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.971+0000 7fdff1de2f40 10 -- 172.21.15.31:0/2544630573 shutdown 172.21.15.31:0/2544630573 2020-06-27T04:42:47.226 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.971+0000 7fdff1de2f40 10 Processor -- stop 2020-06-27T04:42:47.226 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.971+0000 7fdff1de2f40 20 Event(0x5571e3a26e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:42:47.226 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 1 -- 172.21.15.31:0/2544630573 shutdown_connections 2020-06-27T04:42:47.226 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 5 -- 172.21.15.31:0/2544630573 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x5571e3a93400 2020-06-27T04:42:47.226 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 1 --2- 172.21.15.31:0/2544630573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571e3a93400 0x5571e3a04300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:42:47.227 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 5 -- 172.21.15.31:0/2544630573 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x5571e3a92c00 2020-06-27T04:42:47.227 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 1 --2- 172.21.15.31:0/2544630573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571e3a92c00 0x5571e3a03400 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:42:47.227 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 5 -- 172.21.15.31:0/2544630573 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x5571e3a93000 2020-06-27T04:42:47.227 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 1 --2- 172.21.15.31:0/2544630573 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x5571e3a93000 0x5571e3a03e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:42:47.227 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 5 -- 172.21.15.31:0/2544630573 shutdown_connections delete 0x5571e3a92c00 2020-06-27T04:42:47.228 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 5 -- 172.21.15.31:0/2544630573 shutdown_connections delete 0x5571e3a93000 2020-06-27T04:42:47.228 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 5 -- 172.21.15.31:0/2544630573 shutdown_connections delete 0x5571e3a93400 2020-06-27T04:42:47.228 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 1 -- 172.21.15.31:0/2544630573 >> 172.21.15.31:0/2544630573 conn(0x5571e3a92800 msgr2=0x5571e3afb000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:42:47.228 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 20 --1- 172.21.15.31:0/2544630573 >> 172.21.15.31:0/2544630573 conn(0x5571e3a92800 0x5571e3afb000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:42:47.228 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 2 --1- 172.21.15.31:0/2544630573 >> 172.21.15.31:0/2544630573 conn(0x5571e3a92800 0x5571e3afb000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:42:47.228 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 5 --1- 172.21.15.31:0/2544630573 >> 172.21.15.31:0/2544630573 conn(0x5571e3a92800 0x5571e3afb000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:42:47.229 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 20 Event(0x5571e3a26e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:42:47.229 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 10 --1- 172.21.15.31:0/2544630573 >> 172.21.15.31:0/2544630573 conn(0x5571e3a92800 0x5571e3afb000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:42:47.229 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 20 Event(0x5571e3a26e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:42:47.229 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 20 Event(0x5571e3a27040 nevent=5000 time_id=3).wakeup 2020-06-27T04:42:47.229 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdfebb65700 5 --1- 172.21.15.31:0/2544630573 >> 172.21.15.31:0/2544630573 conn(0x5571e3a92800 0x5571e3afb000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:42:47.230 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 20 Event(0x5571e3a27280 nevent=5000 time_id=2).wakeup 2020-06-27T04:42:47.230 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdfebb65700 5 --1- 172.21.15.31:0/2544630573 >> 172.21.15.31:0/2544630573 conn(0x5571e3a92800 0x5571e3afb000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:42:47.230 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 10 -- 172.21.15.31:0/2544630573 wait: waiting for dispatch queue 2020-06-27T04:42:47.230 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 10 -- 172.21.15.31:0/2544630573 wait: dispatch queue is stopped 2020-06-27T04:42:47.230 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 1 -- 172.21.15.31:0/2544630573 shutdown_connections 2020-06-27T04:42:47.231 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 5 -- 172.21.15.31:0/2544630573 shutdown_connections delete 0x5571e3a92800 2020-06-27T04:42:47.231 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 20 Event(0x5571e3a26e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:42:47.231 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 20 Event(0x5571e3a27040 nevent=5000 time_id=3).wakeup 2020-06-27T04:42:47.231 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 20 Event(0x5571e3a27280 nevent=5000 time_id=2).wakeup 2020-06-27T04:42:47.231 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 10 -- 172.21.15.31:0/2544630573 wait: done. 2020-06-27T04:42:47.232 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:46.972+0000 7fdff1de2f40 1 -- 172.21.15.31:0/2544630573 wait complete. 2020-06-27T04:42:47.723 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:47 smithi031 bash[27358]: debug 2020-06-27T04:42:47.495+0000 7fdff1de2f40 -1 Falling back to public interface 2020-06-27T04:42:47.830 INFO:teuthology.orchestra.run.smithi031.stderr:--> Zapping: /dev/vg_nvme/lv_2 2020-06-27T04:42:47.831 INFO:teuthology.orchestra.run.smithi031.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2020-06-27T04:42:47.831 INFO:teuthology.orchestra.run.smithi031.stderr: stderr: 10+0 records in 2020-06-27T04:42:47.831 INFO:teuthology.orchestra.run.smithi031.stderr:10+0 records out 2020-06-27T04:42:47.831 INFO:teuthology.orchestra.run.smithi031.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124493 s, 842 MB/s 2020-06-27T04:42:47.831 INFO:teuthology.orchestra.run.smithi031.stderr:--> Zapping successful for: 2020-06-27T04:42:48.392 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:48 smithi031 bash[27358]: debug 2020-06-27T04:42:48.059+0000 7fdff1de2f40 -1 osd.1 0 log_to_monitors {default=true} 2020-06-27T04:42:48.392 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:48 smithi031 bash[18426]: cluster 2020-06-27T04:42:47.107019+0000 mgr.x (mgr.34109) 18 : cluster [DBG] pgmap v17: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:48.393 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:48 smithi031 bash[18426]: audit 2020-06-27T04:42:48.063300+0000 mon.c (mon.1) 5 : audit [INF] from='osd.1 v2:172.21.15.31:6804/3103897888' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:42:48.393 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:48 smithi031 bash[18426]: audit 2020-06-27T04:42:48.063581+0000 mon.a (mon.0) 282 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:42:48.393 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:48 smithi031 bash[22603]: cluster 2020-06-27T04:42:47.107019+0000 mgr.x (mgr.34109) 18 : cluster [DBG] pgmap v17: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:48.393 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:48 smithi031 bash[22603]: audit 2020-06-27T04:42:48.063300+0000 mon.c (mon.1) 5 : audit [INF] from='osd.1 v2:172.21.15.31:6804/3103897888' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:42:48.393 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:48 smithi031 bash[22603]: audit 2020-06-27T04:42:48.063581+0000 mon.a (mon.0) 282 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:42:48.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:48 smithi051 bash[18409]: cluster 2020-06-27T04:42:47.107019+0000 mgr.x (mgr.34109) 18 : cluster [DBG] pgmap v17: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:48.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:48 smithi051 bash[18409]: audit 2020-06-27T04:42:48.063300+0000 mon.c (mon.1) 5 : audit [INF] from='osd.1 v2:172.21.15.31:6804/3103897888' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:42:48.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:48 smithi051 bash[18409]: audit 2020-06-27T04:42:48.063581+0000 mon.a (mon.0) 282 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:42:48.685 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph orch daemon add osd smithi031:vg_nvme/lv_2 2020-06-27T04:42:49.201 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:49 smithi031 bash[18426]: audit 2020-06-27T04:42:48.109033+0000 mon.a (mon.0) 283 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2020-06-27T04:42:49.202 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:49 smithi031 bash[18426]: cluster 2020-06-27T04:42:48.109085+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2020-06-27T04:42:49.202 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:49 smithi031 bash[18426]: audit 2020-06-27T04:42:48.109636+0000 mon.c (mon.1) 6 : audit [INF] from='osd.1 v2:172.21.15.31:6804/3103897888' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:42:49.202 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:49 smithi031 bash[18426]: audit 2020-06-27T04:42:48.109887+0000 mon.a (mon.0) 285 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:42:49.202 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:49 smithi031 bash[18426]: audit 2020-06-27T04:42:48.110472+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:42:49.202 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:49 smithi031 bash[18426]: cluster 2020-06-27T04:42:49.055048+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:42:49.203 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:49 smithi031 bash[18426]: cluster 2020-06-27T04:42:49.055121+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:42:49.203 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:49 smithi031 bash[22603]: audit 2020-06-27T04:42:48.109033+0000 mon.a (mon.0) 283 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2020-06-27T04:42:49.203 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:49 smithi031 bash[22603]: cluster 2020-06-27T04:42:48.109085+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2020-06-27T04:42:49.203 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:49 smithi031 bash[22603]: audit 2020-06-27T04:42:48.109636+0000 mon.c (mon.1) 6 : audit [INF] from='osd.1 v2:172.21.15.31:6804/3103897888' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:42:49.203 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:49 smithi031 bash[22603]: audit 2020-06-27T04:42:48.109887+0000 mon.a (mon.0) 285 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:42:49.204 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:49 smithi031 bash[22603]: audit 2020-06-27T04:42:48.110472+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:42:49.204 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:49 smithi031 bash[22603]: cluster 2020-06-27T04:42:49.055048+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:42:49.204 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:49 smithi031 bash[22603]: cluster 2020-06-27T04:42:49.055121+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:42:49.204 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:42:49 smithi031 bash[27358]: debug 2020-06-27T04:42:49.116+0000 7fdfe835e700 -1 osd.1 0 waiting for initial osdmap 2020-06-27T04:42:49.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:49 smithi051 bash[18409]: audit 2020-06-27T04:42:48.109033+0000 mon.a (mon.0) 283 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2020-06-27T04:42:49.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:49 smithi051 bash[18409]: cluster 2020-06-27T04:42:48.109085+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2020-06-27T04:42:49.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:49 smithi051 bash[18409]: audit 2020-06-27T04:42:48.109636+0000 mon.c (mon.1) 6 : audit [INF] from='osd.1 v2:172.21.15.31:6804/3103897888' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:42:49.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:49 smithi051 bash[18409]: audit 2020-06-27T04:42:48.109887+0000 mon.a (mon.0) 285 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:42:49.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:49 smithi051 bash[18409]: audit 2020-06-27T04:42:48.110472+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:42:49.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:49 smithi051 bash[18409]: cluster 2020-06-27T04:42:49.055048+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:42:49.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:49 smithi051 bash[18409]: cluster 2020-06-27T04:42:49.055121+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:42:50.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:50 smithi031 bash[22603]: cluster 2020-06-27T04:42:49.107518+0000 mgr.x (mgr.34109) 19 : cluster [DBG] pgmap v19: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:50.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:50 smithi031 bash[22603]: audit 2020-06-27T04:42:49.110403+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:42:50.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:50 smithi031 bash[22603]: audit 2020-06-27T04:42:49.110579+0000 mon.a (mon.0) 286 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2020-06-27T04:42:50.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:50 smithi031 bash[22603]: cluster 2020-06-27T04:42:49.110643+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e16: 2 total, 1 up, 1 in 2020-06-27T04:42:50.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:50 smithi031 bash[22603]: audit 2020-06-27T04:42:49.117232+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:42:50.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:50 smithi031 bash[18426]: cluster 2020-06-27T04:42:49.107518+0000 mgr.x (mgr.34109) 19 : cluster [DBG] pgmap v19: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:50.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:50 smithi031 bash[18426]: audit 2020-06-27T04:42:49.110403+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:42:50.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:50 smithi031 bash[18426]: audit 2020-06-27T04:42:49.110579+0000 mon.a (mon.0) 286 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2020-06-27T04:42:50.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:50 smithi031 bash[18426]: cluster 2020-06-27T04:42:49.110643+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e16: 2 total, 1 up, 1 in 2020-06-27T04:42:50.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:50 smithi031 bash[18426]: audit 2020-06-27T04:42:49.117232+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:42:50.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:50 smithi051 bash[18409]: cluster 2020-06-27T04:42:49.107518+0000 mgr.x (mgr.34109) 19 : cluster [DBG] pgmap v19: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:50.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:50 smithi051 bash[18409]: audit 2020-06-27T04:42:49.110403+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:42:50.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:50 smithi051 bash[18409]: audit 2020-06-27T04:42:49.110579+0000 mon.a (mon.0) 286 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2020-06-27T04:42:50.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:50 smithi051 bash[18409]: cluster 2020-06-27T04:42:49.110643+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e16: 2 total, 1 up, 1 in 2020-06-27T04:42:50.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:50 smithi051 bash[18409]: audit 2020-06-27T04:42:49.117232+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:42:51.007 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.002+0000 7fa610922700 1 Processor -- start 2020-06-27T04:42:51.007 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.002+0000 7fa610922700 1 -- start start 2020-06-27T04:42:51.007 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.002+0000 7fa610922700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fa60c0676c0 0x7fa60c06d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:42:51.007 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.002+0000 7fa610922700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa60c06bc70 0x7fa60c0780d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:42:51.008 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.002+0000 7fa610922700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa60c078680 0x7fa60c122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:42:51.008 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.002+0000 7fa610922700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c078d60 con 0x7fa60c078680 2020-06-27T04:42:51.008 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.002+0000 7fa610922700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c1231d0 con 0x7fa60c0676c0 2020-06-27T04:42:51.008 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.002+0000 7fa610922700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c123390 con 0x7fa60c06bc70 2020-06-27T04:42:51.008 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.002+0000 7fa60b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa60c06bc70 0x7fa60c0780d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:42:51.009 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.002+0000 7fa60b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa60c06bc70 0x7fa60c0780d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35180/0 (socket says 172.21.15.31:35180) 2020-06-27T04:42:51.009 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.002+0000 7fa60b7fe700 1 -- 172.21.15.31:0/2711693928 learned_addr learned my addr 172.21.15.31:0/2711693928 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:42:51.009 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.002+0000 7fa611b84700 1 --2- 172.21.15.31:0/2711693928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa60c078680 0x7fa60c122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:42:51.009 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.002+0000 7fa60bfff700 1 --2- 172.21.15.31:0/2711693928 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fa60c0676c0 0x7fa60c06d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:42:51.009 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.002+0000 7fa60b7fe700 1 -- 172.21.15.31:0/2711693928 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fa60c0676c0 msgr2=0x7fa60c06d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:42:51.012 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.002+0000 7fa60b7fe700 1 --2- 172.21.15.31:0/2711693928 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fa60c0676c0 0x7fa60c06d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:42:51.012 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.002+0000 7fa60b7fe700 1 -- 172.21.15.31:0/2711693928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa60c078680 msgr2=0x7fa60c122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:42:51.013 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.002+0000 7fa60b7fe700 1 --2- 172.21.15.31:0/2711693928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa60c078680 0x7fa60c122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:42:51.013 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.003+0000 7fa60b7fe700 1 -- 172.21.15.31:0/2711693928 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c123550 con 0x7fa60c06bc70 2020-06-27T04:42:51.013 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.003+0000 7fa611b84700 1 --2- 172.21.15.31:0/2711693928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa60c078680 0x7fa60c122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:42:51.013 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.003+0000 7fa60b7fe700 1 --2- 172.21.15.31:0/2711693928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa60c06bc70 0x7fa60c0780d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fa600002f70 tx=0x7fa600009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:42:51.013 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.003+0000 7fa5f3fff700 1 -- 172.21.15.31:0/2711693928 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa60000e030 con 0x7fa60c06bc70 2020-06-27T04:42:51.014 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.003+0000 7fa610922700 1 -- 172.21.15.31:0/2711693928 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c073eb0 con 0x7fa60c06bc70 2020-06-27T04:42:51.014 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.003+0000 7fa5f3fff700 1 -- 172.21.15.31:0/2711693928 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fa600013cb0 con 0x7fa60c06bc70 2020-06-27T04:42:51.014 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.003+0000 7fa5f3fff700 1 -- 172.21.15.31:0/2711693928 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa600018070 con 0x7fa60c06bc70 2020-06-27T04:42:51.014 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.003+0000 7fa610922700 1 -- 172.21.15.31:0/2711693928 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60c0743f0 con 0x7fa60c06bc70 2020-06-27T04:42:51.014 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.003+0000 7fa5f3fff700 1 -- 172.21.15.31:0/2711693928 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7fa60001dac0 con 0x7fa60c06bc70 2020-06-27T04:42:51.015 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.004+0000 7fa5f3fff700 1 --2- 172.21.15.31:0/2711693928 >> v2:172.21.15.51:6800/950992045 conn(0x7fa5e802ab00 0x7fa5e802cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:42:51.015 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.004+0000 7fa5f3fff700 1 -- 172.21.15.31:0/2711693928 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 2434+0+0 (secure 0 0 0) 0x7fa60003bb90 con 0x7fa60c06bc70 2020-06-27T04:42:51.015 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.004+0000 7fa610922700 1 -- 172.21.15.31:0/2711693928 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60c05e210 con 0x7fa60c06bc70 2020-06-27T04:42:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.004+0000 7fa60bfff700 1 --2- 172.21.15.31:0/2711693928 >> v2:172.21.15.51:6800/950992045 conn(0x7fa5e802ab00 0x7fa5e802cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:42:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.004+0000 7fa60bfff700 1 --2- 172.21.15.31:0/2711693928 >> v2:172.21.15.51:6800/950992045 conn(0x7fa5e802ab00 0x7fa5e802cfc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fa5fc00c000 tx=0x7fa5fc009040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:42:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.008+0000 7fa5f3fff700 1 -- 172.21.15.31:0/2711693928 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fa600004610 con 0x7fa60c06bc70 2020-06-27T04:42:51.143 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:51 smithi031 bash[22603]: audit 2020-06-27T04:42:50.114957+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:42:51.143 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:51 smithi031 bash[22603]: cluster 2020-06-27T04:42:50.123332+0000 mon.a (mon.0) 288 : cluster [INF] osd.1 v2:172.21.15.31:6804/3103897888 boot 2020-06-27T04:42:51.145 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:51 smithi031 bash[22603]: cluster 2020-06-27T04:42:50.123382+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2020-06-27T04:42:51.145 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:51 smithi031 bash[22603]: audit 2020-06-27T04:42:50.565461+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:42:51.145 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:51 smithi031 bash[22603]: audit 2020-06-27T04:42:50.810600+0000 mon.b (mon.2) 61 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_daemon_update\": \"2020-06-27T04:42:46.081245\", \"last_device_update\": \"2020-06-27T04:42:50.809841\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:51.146 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:51 smithi031 bash[22603]: audit 2020-06-27T04:42:50.811135+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_daemon_update\": \"2020-06-27T04:42:46.081245\", \"last_device_update\": \"2020-06-27T04:42:50.809841\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:51.146 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:51 smithi031 bash[22603]: audit 2020-06-27T04:42:50.813524+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_daemon_update\": \"2020-06-27T04:42:46.081245\", \"last_device_update\": \"2020-06-27T04:42:50.809841\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:51.192 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:42:51.189+0000 7fa610922700 1 -- 172.21.15.31:0/2711693928 --> v2:172.21.15.51:6800/950992045 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa60c05f390 con 0x7fa5e802ab00 2020-06-27T04:42:51.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:51 smithi051 bash[18409]: audit 2020-06-27T04:42:50.114957+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:42:51.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:51 smithi051 bash[18409]: cluster 2020-06-27T04:42:50.123332+0000 mon.a (mon.0) 288 : cluster [INF] osd.1 v2:172.21.15.31:6804/3103897888 boot 2020-06-27T04:42:51.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:51 smithi051 bash[18409]: cluster 2020-06-27T04:42:50.123382+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2020-06-27T04:42:51.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:51 smithi051 bash[18409]: audit 2020-06-27T04:42:50.565461+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:42:51.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:51 smithi051 bash[18409]: audit 2020-06-27T04:42:50.810600+0000 mon.b (mon.2) 61 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_daemon_update\": \"2020-06-27T04:42:46.081245\", \"last_device_update\": \"2020-06-27T04:42:50.809841\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:51.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:51 smithi051 bash[18409]: audit 2020-06-27T04:42:50.811135+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_daemon_update\": \"2020-06-27T04:42:46.081245\", \"last_device_update\": \"2020-06-27T04:42:50.809841\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:51.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:51 smithi051 bash[18409]: audit 2020-06-27T04:42:50.813524+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_daemon_update\": \"2020-06-27T04:42:46.081245\", \"last_device_update\": \"2020-06-27T04:42:50.809841\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:51.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:51 smithi031 bash[18426]: audit 2020-06-27T04:42:50.114957+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:42:51.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:51 smithi031 bash[18426]: cluster 2020-06-27T04:42:50.123332+0000 mon.a (mon.0) 288 : cluster [INF] osd.1 v2:172.21.15.31:6804/3103897888 boot 2020-06-27T04:42:51.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:51 smithi031 bash[18426]: cluster 2020-06-27T04:42:50.123382+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2020-06-27T04:42:51.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:51 smithi031 bash[18426]: audit 2020-06-27T04:42:50.565461+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:42:51.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:51 smithi031 bash[18426]: audit 2020-06-27T04:42:50.810600+0000 mon.b (mon.2) 61 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_daemon_update\": \"2020-06-27T04:42:46.081245\", \"last_device_update\": \"2020-06-27T04:42:50.809841\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:51.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:51 smithi031 bash[18426]: audit 2020-06-27T04:42:50.811135+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_daemon_update\": \"2020-06-27T04:42:46.081245\", \"last_device_update\": \"2020-06-27T04:42:50.809841\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:42:51.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:51 smithi031 bash[18426]: audit 2020-06-27T04:42:50.813524+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}}, \"last_daemon_update\": \"2020-06-27T04:42:46.081245\", \"last_device_update\": \"2020-06-27T04:42:50.809841\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:42:53.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:52 smithi051 bash[18409]: cluster 2020-06-27T04:42:51.107872+0000 mgr.x (mgr.34109) 20 : cluster [DBG] pgmap v22: 1 pgs: 1 undersized+peered; 0 B data, 144 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:53.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:52 smithi051 bash[18409]: cluster 2020-06-27T04:42:51.132888+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e18: 2 total, 2 up, 2 in 2020-06-27T04:42:53.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:52 smithi051 bash[18409]: audit 2020-06-27T04:42:51.141696+0000 mon.c (mon.1) 7 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2020-06-27T04:42:53.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:52 smithi051 bash[18409]: audit 2020-06-27T04:42:51.191474+0000 mgr.x (mgr.34109) 21 : audit [DBG] from='client.24184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:42:53.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:52 smithi051 bash[18409]: audit 2020-06-27T04:42:51.192392+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:42:53.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:52 smithi051 bash[18409]: cephadm 2020-06-27T04:42:51.193122+0000 mgr.x (mgr.34109) 22 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:42:53.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:52 smithi051 bash[18409]: cephadm 2020-06-27T04:42:51.193202+0000 mgr.x (mgr.34109) 23 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:42:53.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:52 smithi051 bash[18409]: cephadm 2020-06-27T04:42:51.193454+0000 mgr.x (mgr.34109) 24 : cephadm [INF] Applying None on host smithi031... 2020-06-27T04:42:53.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:52 smithi051 bash[18409]: audit 2020-06-27T04:42:51.193822+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:42:53.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:52 smithi051 bash[18409]: audit 2020-06-27T04:42:51.194548+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:42:53.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:52 smithi051 bash[18409]: audit 2020-06-27T04:42:51.195316+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:53.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:52 smithi051 bash[18409]: audit 2020-06-27T04:42:52.036794+0000 mon.c (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2020-06-27T04:42:53.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[18426]: cluster 2020-06-27T04:42:51.107872+0000 mgr.x (mgr.34109) 20 : cluster [DBG] pgmap v22: 1 pgs: 1 undersized+peered; 0 B data, 144 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:53.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[18426]: cluster 2020-06-27T04:42:51.132888+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e18: 2 total, 2 up, 2 in 2020-06-27T04:42:53.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[18426]: audit 2020-06-27T04:42:51.141696+0000 mon.c (mon.1) 7 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2020-06-27T04:42:53.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[18426]: audit 2020-06-27T04:42:51.191474+0000 mgr.x (mgr.34109) 21 : audit [DBG] from='client.24184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:42:53.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[18426]: audit 2020-06-27T04:42:51.192392+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:42:53.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[18426]: cephadm 2020-06-27T04:42:51.193122+0000 mgr.x (mgr.34109) 22 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:42:53.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[18426]: cephadm 2020-06-27T04:42:51.193202+0000 mgr.x (mgr.34109) 23 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:42:53.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[18426]: cephadm 2020-06-27T04:42:51.193454+0000 mgr.x (mgr.34109) 24 : cephadm [INF] Applying None on host smithi031... 2020-06-27T04:42:53.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[18426]: audit 2020-06-27T04:42:51.193822+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:42:53.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[18426]: audit 2020-06-27T04:42:51.194548+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:42:53.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[18426]: audit 2020-06-27T04:42:51.195316+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:53.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[18426]: audit 2020-06-27T04:42:52.036794+0000 mon.c (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2020-06-27T04:42:53.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[22603]: cluster 2020-06-27T04:42:51.107872+0000 mgr.x (mgr.34109) 20 : cluster [DBG] pgmap v22: 1 pgs: 1 undersized+peered; 0 B data, 144 KiB used, 88 GiB / 89 GiB avail 2020-06-27T04:42:53.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[22603]: cluster 2020-06-27T04:42:51.132888+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e18: 2 total, 2 up, 2 in 2020-06-27T04:42:53.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[22603]: audit 2020-06-27T04:42:51.141696+0000 mon.c (mon.1) 7 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2020-06-27T04:42:53.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[22603]: audit 2020-06-27T04:42:51.191474+0000 mgr.x (mgr.34109) 21 : audit [DBG] from='client.24184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:42:53.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[22603]: audit 2020-06-27T04:42:51.192392+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:42:53.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[22603]: cephadm 2020-06-27T04:42:51.193122+0000 mgr.x (mgr.34109) 22 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:42:53.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[22603]: cephadm 2020-06-27T04:42:51.193202+0000 mgr.x (mgr.34109) 23 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:42:53.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[22603]: cephadm 2020-06-27T04:42:51.193454+0000 mgr.x (mgr.34109) 24 : cephadm [INF] Applying None on host smithi031... 2020-06-27T04:42:53.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[22603]: audit 2020-06-27T04:42:51.193822+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:42:53.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[22603]: audit 2020-06-27T04:42:51.194548+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:42:53.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[22603]: audit 2020-06-27T04:42:51.195316+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:53.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:52 smithi031 bash[22603]: audit 2020-06-27T04:42:52.036794+0000 mon.c (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2020-06-27T04:42:54.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:53 smithi051 bash[18409]: audit 2020-06-27T04:42:52.041407+0000 mon.b (mon.2) 66 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2020-06-27T04:42:54.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:53 smithi051 bash[18409]: audit 2020-06-27T04:42:52.920441+0000 mon.b (mon.2) 67 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2020-06-27T04:42:54.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:53 smithi051 bash[18409]: audit 2020-06-27T04:42:52.927291+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20200627-044217"}]: dispatch 2020-06-27T04:42:54.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:53 smithi051 bash[18409]: audit 2020-06-27T04:42:52.927621+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20200627-044217"}]: dispatch 2020-06-27T04:42:54.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:53 smithi051 bash[18409]: audit 2020-06-27T04:42:52.930717+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20200627-044217"}]': finished 2020-06-27T04:42:54.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:53 smithi051 bash[18409]: cluster 2020-06-27T04:42:53.108351+0000 mgr.x (mgr.34109) 25 : cluster [DBG] pgmap v24: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 177 GiB / 179 GiB avail 2020-06-27T04:42:54.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:53 smithi051 bash[18409]: audit 2020-06-27T04:42:53.556713+0000 mon.a (mon.0) 295 : audit [INF] from='client.? 172.21.15.31:0/4059321354' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82a9c5cf-2ae0-429e-82a6-03b9928e5c98"}]: dispatch 2020-06-27T04:42:54.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:53 smithi051 bash[18409]: audit 2020-06-27T04:42:53.560037+0000 mon.a (mon.0) 296 : audit [INF] from='client.? 172.21.15.31:0/4059321354' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82a9c5cf-2ae0-429e-82a6-03b9928e5c98"}]': finished 2020-06-27T04:42:54.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:53 smithi051 bash[18409]: cluster 2020-06-27T04:42:53.560082+0000 mon.a (mon.0) 297 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2020-06-27T04:42:54.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:53 smithi051 bash[18409]: audit 2020-06-27T04:42:53.560093+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:42:54.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[18426]: audit 2020-06-27T04:42:52.041407+0000 mon.b (mon.2) 66 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2020-06-27T04:42:54.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[18426]: audit 2020-06-27T04:42:52.920441+0000 mon.b (mon.2) 67 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2020-06-27T04:42:54.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[18426]: audit 2020-06-27T04:42:52.927291+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20200627-044217"}]: dispatch 2020-06-27T04:42:54.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[18426]: audit 2020-06-27T04:42:52.927621+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20200627-044217"}]: dispatch 2020-06-27T04:42:54.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[18426]: audit 2020-06-27T04:42:52.930717+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20200627-044217"}]': finished 2020-06-27T04:42:54.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[18426]: cluster 2020-06-27T04:42:53.108351+0000 mgr.x (mgr.34109) 25 : cluster [DBG] pgmap v24: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 177 GiB / 179 GiB avail 2020-06-27T04:42:54.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[18426]: audit 2020-06-27T04:42:53.556713+0000 mon.a (mon.0) 295 : audit [INF] from='client.? 172.21.15.31:0/4059321354' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82a9c5cf-2ae0-429e-82a6-03b9928e5c98"}]: dispatch 2020-06-27T04:42:54.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[18426]: audit 2020-06-27T04:42:53.560037+0000 mon.a (mon.0) 296 : audit [INF] from='client.? 172.21.15.31:0/4059321354' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82a9c5cf-2ae0-429e-82a6-03b9928e5c98"}]': finished 2020-06-27T04:42:54.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[18426]: cluster 2020-06-27T04:42:53.560082+0000 mon.a (mon.0) 297 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2020-06-27T04:42:54.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[18426]: audit 2020-06-27T04:42:53.560093+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:42:54.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[22603]: audit 2020-06-27T04:42:52.041407+0000 mon.b (mon.2) 66 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2020-06-27T04:42:54.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[22603]: audit 2020-06-27T04:42:52.920441+0000 mon.b (mon.2) 67 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2020-06-27T04:42:54.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[22603]: audit 2020-06-27T04:42:52.927291+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20200627-044217"}]: dispatch 2020-06-27T04:42:54.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[22603]: audit 2020-06-27T04:42:52.927621+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20200627-044217"}]: dispatch 2020-06-27T04:42:54.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[22603]: audit 2020-06-27T04:42:52.930717+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20200627-044217"}]': finished 2020-06-27T04:42:54.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[22603]: cluster 2020-06-27T04:42:53.108351+0000 mgr.x (mgr.34109) 25 : cluster [DBG] pgmap v24: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 177 GiB / 179 GiB avail 2020-06-27T04:42:54.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[22603]: audit 2020-06-27T04:42:53.556713+0000 mon.a (mon.0) 295 : audit [INF] from='client.? 172.21.15.31:0/4059321354' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82a9c5cf-2ae0-429e-82a6-03b9928e5c98"}]: dispatch 2020-06-27T04:42:54.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[22603]: audit 2020-06-27T04:42:53.560037+0000 mon.a (mon.0) 296 : audit [INF] from='client.? 172.21.15.31:0/4059321354' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82a9c5cf-2ae0-429e-82a6-03b9928e5c98"}]': finished 2020-06-27T04:42:54.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[22603]: cluster 2020-06-27T04:42:53.560082+0000 mon.a (mon.0) 297 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2020-06-27T04:42:54.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:53 smithi031 bash[22603]: audit 2020-06-27T04:42:53.560093+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:42:55.217 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:54 smithi051 bash[18409]: audit 2020-06-27T04:42:54.081199+0000 mon.a (mon.0) 298 : audit [DBG] from='client.? 172.21.15.31:0/3827628400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:42:55.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:54 smithi031 bash[18426]: audit 2020-06-27T04:42:54.081199+0000 mon.a (mon.0) 298 : audit [DBG] from='client.? 172.21.15.31:0/3827628400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:42:55.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:54 smithi031 bash[22603]: audit 2020-06-27T04:42:54.081199+0000 mon.a (mon.0) 298 : audit [DBG] from='client.? 172.21.15.31:0/3827628400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:42:56.217 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:55 smithi051 bash[18409]: cluster 2020-06-27T04:42:55.108923+0000 mgr.x (mgr.34109) 26 : cluster [DBG] pgmap v26: 1 pgs: 1 undersized+peered; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2020-06-27T04:42:56.222 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:55 smithi031 bash[18426]: cluster 2020-06-27T04:42:55.108923+0000 mgr.x (mgr.34109) 26 : cluster [DBG] pgmap v26: 1 pgs: 1 undersized+peered; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2020-06-27T04:42:56.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:55 smithi031 bash[22603]: cluster 2020-06-27T04:42:55.108923+0000 mgr.x (mgr.34109) 26 : cluster [DBG] pgmap v26: 1 pgs: 1 undersized+peered; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2020-06-27T04:42:57.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:56 smithi051 bash[18409]: audit 2020-06-27T04:42:56.564555+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:57.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:56 smithi031 bash[18426]: audit 2020-06-27T04:42:56.564555+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:57.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:56 smithi031 bash[22603]: audit 2020-06-27T04:42:56.564555+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:42:58.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:58 smithi051 bash[18409]: cluster 2020-06-27T04:42:57.109373+0000 mgr.x (mgr.34109) 27 : cluster [DBG] pgmap v27: 1 pgs: 1 active+undersized+degraded; 0 B data, 336 KiB used, 177 GiB / 179 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:42:58.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:58 smithi031 bash[18426]: cluster 2020-06-27T04:42:57.109373+0000 mgr.x (mgr.34109) 27 : cluster [DBG] pgmap v27: 1 pgs: 1 active+undersized+degraded; 0 B data, 336 KiB used, 177 GiB / 179 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:42:58.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:58 smithi031 bash[22603]: cluster 2020-06-27T04:42:57.109373+0000 mgr.x (mgr.34109) 27 : cluster [DBG] pgmap v27: 1 pgs: 1 active+undersized+degraded; 0 B data, 336 KiB used, 177 GiB / 179 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:42:59.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:59 smithi051 bash[18409]: cluster 2020-06-27T04:42:58.101142+0000 mon.a (mon.0) 299 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2020-06-27T04:42:59.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:59 smithi051 bash[18409]: cluster 2020-06-27T04:42:58.101183+0000 mon.a (mon.0) 300 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2020-06-27T04:42:59.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:59 smithi051 bash[18409]: audit 2020-06-27T04:42:59.003145+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2020-06-27T04:42:59.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:59 smithi051 bash[18409]: audit 2020-06-27T04:42:59.003998+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:42:59.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:42:59 smithi051 bash[18409]: audit 2020-06-27T04:42:59.004933+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2020-06-27T04:42:59.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:59 smithi031 bash[18426]: cluster 2020-06-27T04:42:58.101142+0000 mon.a (mon.0) 299 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2020-06-27T04:42:59.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:59 smithi031 bash[18426]: cluster 2020-06-27T04:42:58.101183+0000 mon.a (mon.0) 300 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2020-06-27T04:42:59.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:59 smithi031 bash[18426]: audit 2020-06-27T04:42:59.003145+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2020-06-27T04:42:59.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:59 smithi031 bash[18426]: audit 2020-06-27T04:42:59.003998+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:42:59.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:42:59 smithi031 bash[18426]: audit 2020-06-27T04:42:59.004933+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2020-06-27T04:42:59.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:59 smithi031 bash[22603]: cluster 2020-06-27T04:42:58.101142+0000 mon.a (mon.0) 299 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2020-06-27T04:42:59.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:59 smithi031 bash[22603]: cluster 2020-06-27T04:42:58.101183+0000 mon.a (mon.0) 300 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2020-06-27T04:42:59.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:59 smithi031 bash[22603]: audit 2020-06-27T04:42:59.003145+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2020-06-27T04:42:59.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:59 smithi031 bash[22603]: audit 2020-06-27T04:42:59.003998+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:42:59.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:42:59 smithi031 bash[22603]: audit 2020-06-27T04:42:59.004933+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2020-06-27T04:43:00.467 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:00 smithi031 bash[18426]: cephadm 2020-06-27T04:42:59.004595+0000 mgr.x (mgr.34109) 28 : cephadm [INF] Deploying daemon osd.2 on smithi031 2020-06-27T04:43:00.467 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:00 smithi031 bash[18426]: cluster 2020-06-27T04:42:59.109797+0000 mgr.x (mgr.34109) 29 : cluster [DBG] pgmap v28: 1 pgs: 1 active+undersized+degraded; 0 B data, 336 KiB used, 177 GiB / 179 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:00.468 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:00 smithi031 bash[22603]: cephadm 2020-06-27T04:42:59.004595+0000 mgr.x (mgr.34109) 28 : cephadm [INF] Deploying daemon osd.2 on smithi031 2020-06-27T04:43:00.468 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:00 smithi031 bash[22603]: cluster 2020-06-27T04:42:59.109797+0000 mgr.x (mgr.34109) 29 : cluster [DBG] pgmap v28: 1 pgs: 1 active+undersized+degraded; 0 B data, 336 KiB used, 177 GiB / 179 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:00.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:00 smithi051 bash[18409]: cephadm 2020-06-27T04:42:59.004595+0000 mgr.x (mgr.34109) 28 : cephadm [INF] Deploying daemon osd.2 on smithi031 2020-06-27T04:43:00.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:00 smithi051 bash[18409]: cluster 2020-06-27T04:42:59.109797+0000 mgr.x (mgr.34109) 29 : cluster [DBG] pgmap v28: 1 pgs: 1 active+undersized+degraded; 0 B data, 336 KiB used, 177 GiB / 179 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:00.643 INFO:teuthology.orchestra.run.smithi031.stdout:Created osd(s) 2 on host 'smithi031' 2020-06-27T04:43:00.644 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:00.639+0000 7fa5f3fff700 1 -- 172.21.15.31:0/2711693928 <== mgr.34109 v2:172.21.15.51:6800/950992045 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa5fc00f040 con 0x7fa5e802ab00 2020-06-27T04:43:00.645 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:00.641+0000 7fa610922700 1 -- 172.21.15.31:0/2711693928 >> v2:172.21.15.51:6800/950992045 conn(0x7fa5e802ab00 msgr2=0x7fa5e802cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:43:00.645 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:00.641+0000 7fa610922700 1 --2- 172.21.15.31:0/2711693928 >> v2:172.21.15.51:6800/950992045 conn(0x7fa5e802ab00 0x7fa5e802cfc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fa5fc00c000 tx=0x7fa5fc009040).stop 2020-06-27T04:43:00.645 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:00.641+0000 7fa610922700 1 -- 172.21.15.31:0/2711693928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa60c06bc70 msgr2=0x7fa60c0780d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:43:00.646 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:00.641+0000 7fa610922700 1 --2- 172.21.15.31:0/2711693928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa60c06bc70 0x7fa60c0780d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fa600002f70 tx=0x7fa600009b30).stop 2020-06-27T04:43:00.646 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:00.641+0000 7fa610922700 1 -- 172.21.15.31:0/2711693928 shutdown_connections 2020-06-27T04:43:00.646 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:00.641+0000 7fa610922700 1 --2- 172.21.15.31:0/2711693928 >> v2:172.21.15.51:6800/950992045 conn(0x7fa5e802ab00 0x7fa5e802cfc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:00.646 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:00.641+0000 7fa610922700 1 --2- 172.21.15.31:0/2711693928 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fa60c0676c0 0x7fa60c06d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:00.646 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:00.641+0000 7fa610922700 1 --2- 172.21.15.31:0/2711693928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa60c078680 0x7fa60c122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:00.647 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:00.641+0000 7fa610922700 1 --2- 172.21.15.31:0/2711693928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa60c06bc70 0x7fa60c0780d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:00.647 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:00.641+0000 7fa610922700 1 -- 172.21.15.31:0/2711693928 >> 172.21.15.31:0/2711693928 conn(0x7fa60c025510 msgr2=0x7fa60c06c140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:43:00.647 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:00.642+0000 7fa610922700 1 -- 172.21.15.31:0/2711693928 shutdown_connections 2020-06-27T04:43:00.647 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:00.642+0000 7fa610922700 1 -- 172.21.15.31:0/2711693928 wait complete. 2020-06-27T04:43:01.370 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:01 smithi031 bash[18426]: audit 2020-06-27T04:43:00.635761+0000 mon.b (mon.2) 74 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_device_update\": \"2020-06-27T04:42:50.809841\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:01.371 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:01 smithi031 bash[18426]: audit 2020-06-27T04:43:00.636130+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:01.371 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:01 smithi031 bash[18426]: audit 2020-06-27T04:43:00.636612+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_device_update\": \"2020-06-27T04:42:50.809841\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:01.371 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:01 smithi031 bash[18426]: audit 2020-06-27T04:43:00.639249+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_device_update\": \"2020-06-27T04:42:50.809841\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:43:01.372 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:01 smithi031 bash[22603]: audit 2020-06-27T04:43:00.635761+0000 mon.b (mon.2) 74 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_device_update\": \"2020-06-27T04:42:50.809841\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:01.372 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:01 smithi031 bash[22603]: audit 2020-06-27T04:43:00.636130+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:01.372 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:01 smithi031 bash[22603]: audit 2020-06-27T04:43:00.636612+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_device_update\": \"2020-06-27T04:42:50.809841\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:01.373 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:01 smithi031 bash[22603]: audit 2020-06-27T04:43:00.639249+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_device_update\": \"2020-06-27T04:42:50.809841\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:43:01.373 INFO:teuthology.orchestra.run.smithi031:osd.2> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service 2020-06-27T04:43:01.376 INFO:tasks.cephadm:Deploying osd.3 on smithi031 with /dev/vg_nvme/lv_1... 2020-06-27T04:43:01.377 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2020-06-27T04:43:01.417 INFO:ceph.osd.2.smithi031.stdout:-- Logs begin at Sat 2020-06-27 04:33:08 UTC. -- 2020-06-27T04:43:01.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:01 smithi051 bash[18409]: audit 2020-06-27T04:43:00.635761+0000 mon.b (mon.2) 74 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_device_update\": \"2020-06-27T04:42:50.809841\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:01.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:01 smithi051 bash[18409]: audit 2020-06-27T04:43:00.636130+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:01.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:01 smithi051 bash[18409]: audit 2020-06-27T04:43:00.636612+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_device_update\": \"2020-06-27T04:42:50.809841\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:01.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:01 smithi051 bash[18409]: audit 2020-06-27T04:43:00.639249+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.080933\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081030\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081069\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:46.081140\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_device_update\": \"2020-06-27T04:42:50.809841\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:43:01.643 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:01 smithi031 bash[29513]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-06-27T04:43:01.643 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:01 smithi031 bash[29513]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2020-06-27T04:43:01.644 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:01 smithi031 bash[29513]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2020-06-27T04:43:01.644 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:01 smithi031 bash[29513]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2020-06-27T04:43:01.644 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:01 smithi031 bash[29513]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2020-06-27T04:43:01.644 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:01 smithi031 bash[29513]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-06-27T04:43:01.644 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:01 smithi031 bash[29513]: --> ceph-volume lvm activate successful for osd ID: 2 2020-06-27T04:43:01.973 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:01 smithi031 podman[29515]: 2020-06-27 04:43:01.740421194 +0000 UTC m=+1.120700995 container died e737c2be5142bbd772f87dfd6215e8e4473800d9c48298e19dad51dd1267284a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:43:02.648 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:02 smithi031 podman[29515]: 2020-06-27 04:43:02.331466637 +0000 UTC m=+1.711746437 container remove e737c2be5142bbd772f87dfd6215e8e4473800d9c48298e19dad51dd1267284a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:43:02.648 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:02 smithi031 bash[29513]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2 found: no such container 2020-06-27T04:43:02.648 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:02 smithi031 bash[29513]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2 2020-06-27T04:43:02.648 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:02 smithi031 bash[29513]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2" found: no such container 2020-06-27T04:43:02.907 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:02 smithi031 bash[22603]: cluster 2020-06-27T04:43:01.110146+0000 mgr.x (mgr.34109) 30 : cluster [DBG] pgmap v29: 1 pgs: 1 active+undersized+degraded; 0 B data, 336 KiB used, 177 GiB / 179 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:02.907 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:02 smithi031 podman[29874]: 2020-06-27 04:43:02.863025666 +0000 UTC m=+0.378026066 container create c299b703ddeca1e5c11e37c5eadac42f3200285eb182feaf3222976dd3045b5c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:43:02.908 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:02 smithi031 bash[18426]: cluster 2020-06-27T04:43:01.110146+0000 mgr.x (mgr.34109) 30 : cluster [DBG] pgmap v29: 1 pgs: 1 active+undersized+degraded; 0 B data, 336 KiB used, 177 GiB / 179 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:02.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:02 smithi051 bash[18409]: cluster 2020-06-27T04:43:01.110146+0000 mgr.x (mgr.34109) 30 : cluster [DBG] pgmap v29: 1 pgs: 1 active+undersized+degraded; 0 B data, 336 KiB used, 177 GiB / 179 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:03.456 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 podman[29874]: 2020-06-27 04:43:03.184551149 +0000 UTC m=+0.699551675 container init c299b703ddeca1e5c11e37c5eadac42f3200285eb182feaf3222976dd3045b5c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:43:03.457 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 podman[29874]: 2020-06-27 04:43:03.353551447 +0000 UTC m=+0.868551970 container start c299b703ddeca1e5c11e37c5eadac42f3200285eb182feaf3222976dd3045b5c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:43:03.457 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 podman[29874]: 2020-06-27 04:43:03.353740174 +0000 UTC m=+0.868740777 container attach c299b703ddeca1e5c11e37c5eadac42f3200285eb182feaf3222976dd3045b5c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:43:03.457 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 10 -- 172.21.15.31:0/118178672 shutdown 172.21.15.31:0/118178672 2020-06-27T04:43:03.457 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 10 Processor -- stop 2020-06-27T04:43:03.458 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 20 Event(0x560f24a52e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:43:03.458 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 1 -- 172.21.15.31:0/118178672 shutdown_connections 2020-06-27T04:43:03.458 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 5 -- 172.21.15.31:0/118178672 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x560f24abf400 2020-06-27T04:43:03.458 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 1 --2- 172.21.15.31:0/118178672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f24abf400 0x560f24a30300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:03.458 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 5 -- 172.21.15.31:0/118178672 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x560f24abec00 2020-06-27T04:43:03.459 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 1 --2- 172.21.15.31:0/118178672 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x560f24abec00 0x560f24a2f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:03.459 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 5 -- 172.21.15.31:0/118178672 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x560f24abf000 2020-06-27T04:43:03.459 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 1 --2- 172.21.15.31:0/118178672 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x560f24abf000 0x560f24a2fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:03.459 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 5 -- 172.21.15.31:0/118178672 shutdown_connections delete 0x560f24abec00 2020-06-27T04:43:03.459 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 5 -- 172.21.15.31:0/118178672 shutdown_connections delete 0x560f24abf000 2020-06-27T04:43:03.460 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 5 -- 172.21.15.31:0/118178672 shutdown_connections delete 0x560f24abf400 2020-06-27T04:43:03.460 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 1 -- 172.21.15.31:0/118178672 >> 172.21.15.31:0/118178672 conn(0x560f24abe800 msgr2=0x560f24b27000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:43:03.460 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 20 --1- 172.21.15.31:0/118178672 >> 172.21.15.31:0/118178672 conn(0x560f24abe800 0x560f24b27000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:43:03.460 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 2 --1- 172.21.15.31:0/118178672 >> 172.21.15.31:0/118178672 conn(0x560f24abe800 0x560f24b27000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:43:03.460 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 5 --1- 172.21.15.31:0/118178672 >> 172.21.15.31:0/118178672 conn(0x560f24abe800 0x560f24b27000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:43:03.461 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 20 Event(0x560f24a52e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:43:03.461 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 10 --1- 172.21.15.31:0/118178672 >> 172.21.15.31:0/118178672 conn(0x560f24abe800 0x560f24b27000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:43:03.461 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f0458ba9700 5 --1- 172.21.15.31:0/118178672 >> 172.21.15.31:0/118178672 conn(0x560f24abe800 0x560f24b27000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:43:03.461 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 20 Event(0x560f24a52e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:43:03.461 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 20 Event(0x560f24a53040 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:03.462 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f0458ba9700 5 --1- 172.21.15.31:0/118178672 >> 172.21.15.31:0/118178672 conn(0x560f24abe800 0x560f24b27000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:43:03.462 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 20 Event(0x560f24a53280 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:03.462 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 10 -- 172.21.15.31:0/118178672 wait: waiting for dispatch queue 2020-06-27T04:43:03.462 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 10 -- 172.21.15.31:0/118178672 wait: dispatch queue is stopped 2020-06-27T04:43:03.462 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 1 -- 172.21.15.31:0/118178672 shutdown_connections 2020-06-27T04:43:03.463 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 5 -- 172.21.15.31:0/118178672 shutdown_connections delete 0x560f24abe800 2020-06-27T04:43:03.463 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 20 Event(0x560f24a52e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:43:03.463 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 20 Event(0x560f24a53040 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:03.463 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 20 Event(0x560f24a53280 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:03.463 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 10 -- 172.21.15.31:0/118178672 wait: done. 2020-06-27T04:43:03.464 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.211+0000 7f045ee26f40 1 -- 172.21.15.31:0/118178672 wait complete. 2020-06-27T04:43:03.707 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[18426]: audit 2020-06-27T04:43:02.731695+0000 mon.b (mon.2) 76 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_daemon_update\": \"2020-06-27T04:43:02.730979\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:03.708 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[18426]: audit 2020-06-27T04:43:02.732322+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_daemon_update\": \"2020-06-27T04:43:02.730979\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:03.708 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[18426]: audit 2020-06-27T04:43:02.735863+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_daemon_update\": \"2020-06-27T04:43:02.730979\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:43:03.708 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[18426]: audit 2020-06-27T04:43:02.738208+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:03.708 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[22603]: audit 2020-06-27T04:43:02.731695+0000 mon.b (mon.2) 76 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_daemon_update\": \"2020-06-27T04:43:02.730979\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:03.709 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[22603]: audit 2020-06-27T04:43:02.732322+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_daemon_update\": \"2020-06-27T04:43:02.730979\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:03.709 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[22603]: audit 2020-06-27T04:43:02.735863+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_daemon_update\": \"2020-06-27T04:43:02.730979\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:43:03.709 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[22603]: audit 2020-06-27T04:43:02.738208+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:03.958 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:03 smithi031 bash[29513]: debug 2020-06-27T04:43:03.730+0000 7f045ee26f40 -1 Falling back to public interface 2020-06-27T04:43:03.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:03 smithi051 bash[18409]: audit 2020-06-27T04:43:02.731695+0000 mon.b (mon.2) 76 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_daemon_update\": \"2020-06-27T04:43:02.730979\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:03.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:03 smithi051 bash[18409]: audit 2020-06-27T04:43:02.732322+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_daemon_update\": \"2020-06-27T04:43:02.730979\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:03.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:03 smithi051 bash[18409]: audit 2020-06-27T04:43:02.735863+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_daemon_update\": \"2020-06-27T04:43:02.730979\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:43:03.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:03 smithi051 bash[18409]: audit 2020-06-27T04:43:02.738208+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:04.514 INFO:teuthology.orchestra.run.smithi031.stderr:--> Zapping: /dev/vg_nvme/lv_1 2020-06-27T04:43:04.514 INFO:teuthology.orchestra.run.smithi031.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2020-06-27T04:43:04.515 INFO:teuthology.orchestra.run.smithi031.stderr: stderr: 10+0 records in 2020-06-27T04:43:04.515 INFO:teuthology.orchestra.run.smithi031.stderr:10+0 records out 2020-06-27T04:43:04.515 INFO:teuthology.orchestra.run.smithi031.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113642 s, 923 MB/s 2020-06-27T04:43:04.515 INFO:teuthology.orchestra.run.smithi031.stderr:--> Zapping successful for: 2020-06-27T04:43:04.614 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:04 smithi031 bash[29513]: debug 2020-06-27T04:43:04.302+0000 7f045ee26f40 -1 osd.2 0 log_to_monitors {default=true} 2020-06-27T04:43:04.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:04 smithi031 bash[18426]: cluster 2020-06-27T04:43:03.110695+0000 mgr.x (mgr.34109) 31 : cluster [DBG] pgmap v30: 1 pgs: 1 active+undersized+degraded; 0 B data, 336 KiB used, 177 GiB / 179 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:04.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:04 smithi031 bash[18426]: audit 2020-06-27T04:43:04.306278+0000 mon.a (mon.0) 305 : audit [INF] from='osd.2 v2:172.21.15.31:6808/3672781084' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:43:04.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:04 smithi031 bash[22603]: cluster 2020-06-27T04:43:03.110695+0000 mgr.x (mgr.34109) 31 : cluster [DBG] pgmap v30: 1 pgs: 1 active+undersized+degraded; 0 B data, 336 KiB used, 177 GiB / 179 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:04.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:04 smithi031 bash[22603]: audit 2020-06-27T04:43:04.306278+0000 mon.a (mon.0) 305 : audit [INF] from='osd.2 v2:172.21.15.31:6808/3672781084' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:43:05.089 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph orch daemon add osd smithi031:vg_nvme/lv_1 2020-06-27T04:43:05.217 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:04 smithi051 bash[18409]: cluster 2020-06-27T04:43:03.110695+0000 mgr.x (mgr.34109) 31 : cluster [DBG] pgmap v30: 1 pgs: 1 active+undersized+degraded; 0 B data, 336 KiB used, 177 GiB / 179 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:05.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:04 smithi051 bash[18409]: audit 2020-06-27T04:43:04.306278+0000 mon.a (mon.0) 305 : audit [INF] from='osd.2 v2:172.21.15.31:6808/3672781084' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:43:05.956 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[29513]: debug 2020-06-27T04:43:05.741+0000 7f0456ba5700 -1 osd.2 0 waiting for initial osdmap 2020-06-27T04:43:05.957 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[18426]: audit 2020-06-27T04:43:04.737923+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:43:05.957 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[18426]: audit 2020-06-27T04:43:04.742647+0000 mon.a (mon.0) 306 : audit [INF] from='osd.2 v2:172.21.15.31:6808/3672781084' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2020-06-27T04:43:05.957 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[18426]: cluster 2020-06-27T04:43:04.742720+0000 mon.a (mon.0) 307 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2020-06-27T04:43:05.958 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[18426]: audit 2020-06-27T04:43:04.743414+0000 mon.a (mon.0) 308 : audit [INF] from='osd.2 v2:172.21.15.31:6808/3672781084' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:43:05.958 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[18426]: cluster 2020-06-27T04:43:05.285113+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:43:05.958 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[18426]: cluster 2020-06-27T04:43:05.285288+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:43:05.958 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[18426]: audit 2020-06-27T04:43:05.739939+0000 mon.a (mon.0) 309 : audit [INF] from='osd.2 v2:172.21.15.31:6808/3672781084' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2020-06-27T04:43:05.958 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[18426]: cluster 2020-06-27T04:43:05.739994+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e21: 3 total, 2 up, 2 in 2020-06-27T04:43:05.959 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[18426]: audit 2020-06-27T04:43:05.741949+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:43:05.959 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[18426]: audit 2020-06-27T04:43:05.742618+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:43:05.959 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[22603]: audit 2020-06-27T04:43:04.737923+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:43:05.959 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[22603]: audit 2020-06-27T04:43:04.742647+0000 mon.a (mon.0) 306 : audit [INF] from='osd.2 v2:172.21.15.31:6808/3672781084' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2020-06-27T04:43:05.959 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[22603]: cluster 2020-06-27T04:43:04.742720+0000 mon.a (mon.0) 307 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2020-06-27T04:43:05.960 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[22603]: audit 2020-06-27T04:43:04.743414+0000 mon.a (mon.0) 308 : audit [INF] from='osd.2 v2:172.21.15.31:6808/3672781084' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:43:05.960 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[22603]: cluster 2020-06-27T04:43:05.285113+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:43:05.960 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[22603]: cluster 2020-06-27T04:43:05.285288+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:43:05.960 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[22603]: audit 2020-06-27T04:43:05.739939+0000 mon.a (mon.0) 309 : audit [INF] from='osd.2 v2:172.21.15.31:6808/3672781084' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2020-06-27T04:43:05.960 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[22603]: cluster 2020-06-27T04:43:05.739994+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e21: 3 total, 2 up, 2 in 2020-06-27T04:43:05.961 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[22603]: audit 2020-06-27T04:43:05.741949+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:43:05.961 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:05 smithi031 bash[22603]: audit 2020-06-27T04:43:05.742618+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:43:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:05 smithi051 bash[18409]: audit 2020-06-27T04:43:04.737923+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:43:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:05 smithi051 bash[18409]: audit 2020-06-27T04:43:04.742647+0000 mon.a (mon.0) 306 : audit [INF] from='osd.2 v2:172.21.15.31:6808/3672781084' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2020-06-27T04:43:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:05 smithi051 bash[18409]: cluster 2020-06-27T04:43:04.742720+0000 mon.a (mon.0) 307 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2020-06-27T04:43:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:05 smithi051 bash[18409]: audit 2020-06-27T04:43:04.743414+0000 mon.a (mon.0) 308 : audit [INF] from='osd.2 v2:172.21.15.31:6808/3672781084' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:43:06.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:05 smithi051 bash[18409]: cluster 2020-06-27T04:43:05.285113+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:43:06.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:05 smithi051 bash[18409]: cluster 2020-06-27T04:43:05.285288+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:43:06.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:05 smithi051 bash[18409]: audit 2020-06-27T04:43:05.739939+0000 mon.a (mon.0) 309 : audit [INF] from='osd.2 v2:172.21.15.31:6808/3672781084' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2020-06-27T04:43:06.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:05 smithi051 bash[18409]: cluster 2020-06-27T04:43:05.739994+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e21: 3 total, 2 up, 2 in 2020-06-27T04:43:06.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:05 smithi051 bash[18409]: audit 2020-06-27T04:43:05.741949+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:43:06.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:05 smithi051 bash[18409]: audit 2020-06-27T04:43:05.742618+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:43:06.913 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:06 smithi031 bash[18426]: cluster 2020-06-27T04:43:05.111119+0000 mgr.x (mgr.34109) 32 : cluster [DBG] pgmap v32: 1 pgs: 1 active+undersized+degraded; 0 B data, 344 KiB used, 177 GiB / 179 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:06.913 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:06 smithi031 bash[18426]: audit 2020-06-27T04:43:06.743304+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:43:06.914 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:06 smithi031 bash[22603]: cluster 2020-06-27T04:43:05.111119+0000 mgr.x (mgr.34109) 32 : cluster [DBG] pgmap v32: 1 pgs: 1 active+undersized+degraded; 0 B data, 344 KiB used, 177 GiB / 179 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:06.914 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:06 smithi031 bash[22603]: audit 2020-06-27T04:43:06.743304+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:43:07.217 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:06 smithi051 bash[18409]: cluster 2020-06-27T04:43:05.111119+0000 mgr.x (mgr.34109) 32 : cluster [DBG] pgmap v32: 1 pgs: 1 active+undersized+degraded; 0 B data, 344 KiB used, 177 GiB / 179 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:07.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:06 smithi051 bash[18409]: audit 2020-06-27T04:43:06.743304+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:43:07.321 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.317+0000 7fc94605b700 1 Processor -- start 2020-06-27T04:43:07.321 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.317+0000 7fc94605b700 1 -- start start 2020-06-27T04:43:07.321 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.317+0000 7fc94605b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc940066360 0x7fc940067e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:43:07.322 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.317+0000 7fc94605b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9400678b0 0x7fc940068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:43:07.322 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.317+0000 7fc94605b700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc9400786f0 0x7fc9401250b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:43:07.322 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.317+0000 7fc94605b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc940078d70 con 0x7fc940066360 2020-06-27T04:43:07.322 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.317+0000 7fc94605b700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9401255d0 con 0x7fc9400786f0 2020-06-27T04:43:07.322 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.317+0000 7fc94605b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc940125790 con 0x7fc9400678b0 2020-06-27T04:43:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.317+0000 7fc93f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9400678b0 0x7fc940068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:43:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.317+0000 7fc93f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9400678b0 0x7fc940068580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35260/0 (socket says 172.21.15.31:35260) 2020-06-27T04:43:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.317+0000 7fc93f7fe700 1 -- 172.21.15.31:0/3682142002 learned_addr learned my addr 172.21.15.31:0/3682142002 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:43:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.317+0000 7fc93ffff700 1 --2- 172.21.15.31:0/3682142002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc940066360 0x7fc940067e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:43:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.317+0000 7fc944df9700 1 --2- 172.21.15.31:0/3682142002 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc9400786f0 0x7fc9401250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:43:07.324 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.317+0000 7fc93f7fe700 1 -- 172.21.15.31:0/3682142002 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc9400786f0 msgr2=0x7fc9401250b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:43:07.324 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.317+0000 7fc93f7fe700 1 --2- 172.21.15.31:0/3682142002 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc9400786f0 0x7fc9401250b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:07.324 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.317+0000 7fc93f7fe700 1 -- 172.21.15.31:0/3682142002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc940066360 msgr2=0x7fc940067e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:43:07.324 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.317+0000 7fc93f7fe700 1 --2- 172.21.15.31:0/3682142002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc940066360 0x7fc940067e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:07.324 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.317+0000 7fc93f7fe700 1 -- 172.21.15.31:0/3682142002 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc940125950 con 0x7fc9400678b0 2020-06-27T04:43:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.318+0000 7fc93f7fe700 1 --2- 172.21.15.31:0/3682142002 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9400678b0 0x7fc940068580 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fc9340040c0 tx=0x7fc934009d20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:43:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.318+0000 7fc927fff700 1 -- 172.21.15.31:0/3682142002 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc934004e80 con 0x7fc9400678b0 2020-06-27T04:43:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.318+0000 7fc94605b700 1 -- 172.21.15.31:0/3682142002 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc940125c00 con 0x7fc9400678b0 2020-06-27T04:43:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.318+0000 7fc927fff700 1 -- 172.21.15.31:0/3682142002 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fc93400f040 con 0x7fc9400678b0 2020-06-27T04:43:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.318+0000 7fc927fff700 1 -- 172.21.15.31:0/3682142002 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9340138f0 con 0x7fc9400678b0 2020-06-27T04:43:07.326 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.318+0000 7fc94605b700 1 -- 172.21.15.31:0/3682142002 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc940126120 con 0x7fc9400678b0 2020-06-27T04:43:07.327 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.318+0000 7fc927fff700 1 -- 172.21.15.31:0/3682142002 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7fc934013b60 con 0x7fc9400678b0 2020-06-27T04:43:07.327 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.319+0000 7fc927fff700 1 --2- 172.21.15.31:0/3682142002 >> v2:172.21.15.51:6800/950992045 conn(0x7fc91c02ab00 0x7fc91c02cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:43:07.327 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.319+0000 7fc927fff700 1 -- 172.21.15.31:0/3682142002 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 2726+0+0 (secure 0 0 0) 0x7fc934039e80 con 0x7fc9400678b0 2020-06-27T04:43:07.327 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.319+0000 7fc94605b700 1 -- 172.21.15.31:0/3682142002 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94005e210 con 0x7fc9400678b0 2020-06-27T04:43:07.327 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.319+0000 7fc93ffff700 1 --2- 172.21.15.31:0/3682142002 >> v2:172.21.15.51:6800/950992045 conn(0x7fc91c02ab00 0x7fc91c02cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:43:07.328 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.319+0000 7fc93ffff700 1 --2- 172.21.15.31:0/3682142002 >> v2:172.21.15.51:6800/950992045 conn(0x7fc91c02ab00 0x7fc91c02cfc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fc93000b000 tx=0x7fc93000b040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:43:07.328 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.323+0000 7fc927fff700 1 -- 172.21.15.31:0/3682142002 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fc934022250 con 0x7fc9400678b0 2020-06-27T04:43:07.504 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:07.501+0000 7fc94605b700 1 -- 172.21.15.31:0/3682142002 --> v2:172.21.15.51:6800/950992045 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc94005f390 con 0x7fc91c02ab00 2020-06-27T04:43:08.014 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[18426]: cluster 2020-06-27T04:43:06.752443+0000 mon.a (mon.0) 311 : cluster [INF] osd.2 v2:172.21.15.31:6808/3672781084 boot 2020-06-27T04:43:08.015 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[18426]: audit 2020-06-27T04:43:06.752451+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:43:08.015 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[18426]: cluster 2020-06-27T04:43:06.752483+0000 mon.a (mon.0) 312 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2020-06-27T04:43:08.015 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[18426]: audit 2020-06-27T04:43:06.925531+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:08.015 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[18426]: audit 2020-06-27T04:43:07.174185+0000 mon.b (mon.2) 84 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_daemon_update\": \"2020-06-27T04:43:02.730979\", \"last_device_update\": \"2020-06-27T04:43:07.173345\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:08.016 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[18426]: audit 2020-06-27T04:43:07.174833+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_daemon_update\": \"2020-06-27T04:43:02.730979\", \"last_device_update\": \"2020-06-27T04:43:07.173345\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:08.016 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[18426]: audit 2020-06-27T04:43:07.177842+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_daemon_update\": \"2020-06-27T04:43:02.730979\", \"last_device_update\": \"2020-06-27T04:43:07.173345\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:43:08.016 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[18426]: audit 2020-06-27T04:43:07.504300+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:43:08.016 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[18426]: audit 2020-06-27T04:43:07.505649+0000 mon.b (mon.2) 86 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:43:08.017 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[18426]: audit 2020-06-27T04:43:07.506340+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:08.017 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[18426]: audit 2020-06-27T04:43:07.507077+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:08.017 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[22603]: cluster 2020-06-27T04:43:06.752443+0000 mon.a (mon.0) 311 : cluster [INF] osd.2 v2:172.21.15.31:6808/3672781084 boot 2020-06-27T04:43:08.017 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[22603]: audit 2020-06-27T04:43:06.752451+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:43:08.017 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[22603]: cluster 2020-06-27T04:43:06.752483+0000 mon.a (mon.0) 312 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2020-06-27T04:43:08.018 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[22603]: audit 2020-06-27T04:43:06.925531+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:08.018 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[22603]: audit 2020-06-27T04:43:07.174185+0000 mon.b (mon.2) 84 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_daemon_update\": \"2020-06-27T04:43:02.730979\", \"last_device_update\": \"2020-06-27T04:43:07.173345\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:08.018 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[22603]: audit 2020-06-27T04:43:07.174833+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_daemon_update\": \"2020-06-27T04:43:02.730979\", \"last_device_update\": \"2020-06-27T04:43:07.173345\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:08.018 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[22603]: audit 2020-06-27T04:43:07.177842+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_daemon_update\": \"2020-06-27T04:43:02.730979\", \"last_device_update\": \"2020-06-27T04:43:07.173345\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:43:08.019 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[22603]: audit 2020-06-27T04:43:07.504300+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:43:08.019 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[22603]: audit 2020-06-27T04:43:07.505649+0000 mon.b (mon.2) 86 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:43:08.019 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[22603]: audit 2020-06-27T04:43:07.506340+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:08.019 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:07 smithi031 bash[22603]: audit 2020-06-27T04:43:07.507077+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:08.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:07 smithi051 bash[18409]: cluster 2020-06-27T04:43:06.752443+0000 mon.a (mon.0) 311 : cluster [INF] osd.2 v2:172.21.15.31:6808/3672781084 boot 2020-06-27T04:43:08.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:07 smithi051 bash[18409]: audit 2020-06-27T04:43:06.752451+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:43:08.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:07 smithi051 bash[18409]: cluster 2020-06-27T04:43:06.752483+0000 mon.a (mon.0) 312 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2020-06-27T04:43:08.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:07 smithi051 bash[18409]: audit 2020-06-27T04:43:06.925531+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:08.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:07 smithi051 bash[18409]: audit 2020-06-27T04:43:07.174185+0000 mon.b (mon.2) 84 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_daemon_update\": \"2020-06-27T04:43:02.730979\", \"last_device_update\": \"2020-06-27T04:43:07.173345\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:08.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:07 smithi051 bash[18409]: audit 2020-06-27T04:43:07.174833+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_daemon_update\": \"2020-06-27T04:43:02.730979\", \"last_device_update\": \"2020-06-27T04:43:07.173345\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:08.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:07 smithi051 bash[18409]: audit 2020-06-27T04:43:07.177842+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}}, \"last_daemon_update\": \"2020-06-27T04:43:02.730979\", \"last_device_update\": \"2020-06-27T04:43:07.173345\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:43:08.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:07 smithi051 bash[18409]: audit 2020-06-27T04:43:07.504300+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:43:08.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:07 smithi051 bash[18409]: audit 2020-06-27T04:43:07.505649+0000 mon.b (mon.2) 86 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:43:08.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:07 smithi051 bash[18409]: audit 2020-06-27T04:43:07.506340+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:08.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:07 smithi051 bash[18409]: audit 2020-06-27T04:43:07.507077+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:09.064 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:08 smithi031 bash[22603]: cluster 2020-06-27T04:43:07.111574+0000 mgr.x (mgr.34109) 33 : cluster [DBG] pgmap v35: 1 pgs: 1 active+undersized+degraded; 0 B data, 360 KiB used, 177 GiB / 179 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:09.064 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:08 smithi031 bash[22603]: audit 2020-06-27T04:43:07.503409+0000 mgr.x (mgr.34109) 34 : audit [DBG] from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:43:09.065 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:08 smithi031 bash[22603]: cephadm 2020-06-27T04:43:07.504978+0000 mgr.x (mgr.34109) 35 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:43:09.065 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:08 smithi031 bash[22603]: cephadm 2020-06-27T04:43:07.505055+0000 mgr.x (mgr.34109) 36 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:43:09.065 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:08 smithi031 bash[22603]: cephadm 2020-06-27T04:43:07.505290+0000 mgr.x (mgr.34109) 37 : cephadm [INF] Applying None on host smithi031... 2020-06-27T04:43:09.065 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:08 smithi031 bash[22603]: cluster 2020-06-27T04:43:07.763028+0000 mon.a (mon.0) 315 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2020-06-27T04:43:09.065 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:08 smithi031 bash[18426]: cluster 2020-06-27T04:43:07.111574+0000 mgr.x (mgr.34109) 33 : cluster [DBG] pgmap v35: 1 pgs: 1 active+undersized+degraded; 0 B data, 360 KiB used, 177 GiB / 179 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:09.066 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:08 smithi031 bash[18426]: audit 2020-06-27T04:43:07.503409+0000 mgr.x (mgr.34109) 34 : audit [DBG] from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:43:09.066 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:08 smithi031 bash[18426]: cephadm 2020-06-27T04:43:07.504978+0000 mgr.x (mgr.34109) 35 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:43:09.066 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:08 smithi031 bash[18426]: cephadm 2020-06-27T04:43:07.505055+0000 mgr.x (mgr.34109) 36 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:43:09.066 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:08 smithi031 bash[18426]: cephadm 2020-06-27T04:43:07.505290+0000 mgr.x (mgr.34109) 37 : cephadm [INF] Applying None on host smithi031... 2020-06-27T04:43:09.066 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:08 smithi031 bash[18426]: cluster 2020-06-27T04:43:07.763028+0000 mon.a (mon.0) 315 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2020-06-27T04:43:09.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:08 smithi051 bash[18409]: cluster 2020-06-27T04:43:07.111574+0000 mgr.x (mgr.34109) 33 : cluster [DBG] pgmap v35: 1 pgs: 1 active+undersized+degraded; 0 B data, 360 KiB used, 177 GiB / 179 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:09.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:08 smithi051 bash[18409]: audit 2020-06-27T04:43:07.503409+0000 mgr.x (mgr.34109) 34 : audit [DBG] from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:43:09.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:08 smithi051 bash[18409]: cephadm 2020-06-27T04:43:07.504978+0000 mgr.x (mgr.34109) 35 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:43:09.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:08 smithi051 bash[18409]: cephadm 2020-06-27T04:43:07.505055+0000 mgr.x (mgr.34109) 36 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:43:09.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:08 smithi051 bash[18409]: cephadm 2020-06-27T04:43:07.505290+0000 mgr.x (mgr.34109) 37 : cephadm [INF] Applying None on host smithi031... 2020-06-27T04:43:09.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:08 smithi051 bash[18409]: cluster 2020-06-27T04:43:07.763028+0000 mon.a (mon.0) 315 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2020-06-27T04:43:11.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:10 smithi051 bash[18409]: cluster 2020-06-27T04:43:09.111926+0000 mgr.x (mgr.34109) 38 : cluster [DBG] pgmap v37: 1 pgs: 1 active+undersized+degraded; 0 B data, 552 KiB used, 265 GiB / 268 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:11.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:10 smithi051 bash[18409]: audit 2020-06-27T04:43:09.781382+0000 mon.a (mon.0) 316 : audit [INF] from='client.? 172.21.15.31:0/1724314780' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a3667cb-5c57-47fb-8c93-da3a3817c975"}]: dispatch 2020-06-27T04:43:11.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:10 smithi051 bash[18409]: audit 2020-06-27T04:43:09.786260+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:43:11.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:10 smithi051 bash[18409]: audit 2020-06-27T04:43:09.787329+0000 mon.a (mon.0) 317 : audit [INF] from='client.? 172.21.15.31:0/1724314780' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a3667cb-5c57-47fb-8c93-da3a3817c975"}]': finished 2020-06-27T04:43:11.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:10 smithi051 bash[18409]: cluster 2020-06-27T04:43:09.787357+0000 mon.a (mon.0) 318 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2020-06-27T04:43:11.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:10 smithi051 bash[18409]: audit 2020-06-27T04:43:10.304899+0000 mon.a (mon.0) 319 : audit [DBG] from='client.? 172.21.15.31:0/2169719648' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:43:11.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:10 smithi031 bash[18426]: cluster 2020-06-27T04:43:09.111926+0000 mgr.x (mgr.34109) 38 : cluster [DBG] pgmap v37: 1 pgs: 1 active+undersized+degraded; 0 B data, 552 KiB used, 265 GiB / 268 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:11.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:10 smithi031 bash[18426]: audit 2020-06-27T04:43:09.781382+0000 mon.a (mon.0) 316 : audit [INF] from='client.? 172.21.15.31:0/1724314780' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a3667cb-5c57-47fb-8c93-da3a3817c975"}]: dispatch 2020-06-27T04:43:11.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:10 smithi031 bash[18426]: audit 2020-06-27T04:43:09.786260+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:43:11.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:10 smithi031 bash[18426]: audit 2020-06-27T04:43:09.787329+0000 mon.a (mon.0) 317 : audit [INF] from='client.? 172.21.15.31:0/1724314780' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a3667cb-5c57-47fb-8c93-da3a3817c975"}]': finished 2020-06-27T04:43:11.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:10 smithi031 bash[18426]: cluster 2020-06-27T04:43:09.787357+0000 mon.a (mon.0) 318 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2020-06-27T04:43:11.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:10 smithi031 bash[18426]: audit 2020-06-27T04:43:10.304899+0000 mon.a (mon.0) 319 : audit [DBG] from='client.? 172.21.15.31:0/2169719648' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:43:11.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:10 smithi031 bash[22603]: cluster 2020-06-27T04:43:09.111926+0000 mgr.x (mgr.34109) 38 : cluster [DBG] pgmap v37: 1 pgs: 1 active+undersized+degraded; 0 B data, 552 KiB used, 265 GiB / 268 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:11.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:10 smithi031 bash[22603]: audit 2020-06-27T04:43:09.781382+0000 mon.a (mon.0) 316 : audit [INF] from='client.? 172.21.15.31:0/1724314780' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a3667cb-5c57-47fb-8c93-da3a3817c975"}]: dispatch 2020-06-27T04:43:11.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:10 smithi031 bash[22603]: audit 2020-06-27T04:43:09.786260+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:43:11.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:10 smithi031 bash[22603]: audit 2020-06-27T04:43:09.787329+0000 mon.a (mon.0) 317 : audit [INF] from='client.? 172.21.15.31:0/1724314780' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a3667cb-5c57-47fb-8c93-da3a3817c975"}]': finished 2020-06-27T04:43:11.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:10 smithi031 bash[22603]: cluster 2020-06-27T04:43:09.787357+0000 mon.a (mon.0) 318 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2020-06-27T04:43:11.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:10 smithi031 bash[22603]: audit 2020-06-27T04:43:10.304899+0000 mon.a (mon.0) 319 : audit [DBG] from='client.? 172.21.15.31:0/2169719648' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:43:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:12 smithi031 bash[18426]: cluster 2020-06-27T04:43:11.112251+0000 mgr.x (mgr.34109) 39 : cluster [DBG] pgmap v39: 1 pgs: 1 active+undersized+degraded; 0 B data, 576 KiB used, 265 GiB / 268 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:12 smithi031 bash[18426]: audit 2020-06-27T04:43:12.698376+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:12.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:12 smithi031 bash[22603]: cluster 2020-06-27T04:43:11.112251+0000 mgr.x (mgr.34109) 39 : cluster [DBG] pgmap v39: 1 pgs: 1 active+undersized+degraded; 0 B data, 576 KiB used, 265 GiB / 268 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:12.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:12 smithi031 bash[22603]: audit 2020-06-27T04:43:12.698376+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:13.217 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:12 smithi051 bash[18409]: cluster 2020-06-27T04:43:11.112251+0000 mgr.x (mgr.34109) 39 : cluster [DBG] pgmap v39: 1 pgs: 1 active+undersized+degraded; 0 B data, 576 KiB used, 265 GiB / 268 GiB avail; 2/6 objects degraded (33.333%) 2020-06-27T04:43:13.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:12 smithi051 bash[18409]: audit 2020-06-27T04:43:12.698376+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:14.217 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:13 smithi051 bash[18409]: cluster 2020-06-27T04:43:13.112620+0000 mgr.x (mgr.34109) 40 : cluster [DBG] pgmap v40: 1 pgs: 1 active+clean; 0 B data, 616 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:14.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:13 smithi051 bash[18409]: cluster 2020-06-27T04:43:13.776109+0000 mon.a (mon.0) 320 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2020-06-27T04:43:14.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:13 smithi051 bash[18409]: cluster 2020-06-27T04:43:13.776198+0000 mon.a (mon.0) 321 : cluster [INF] Cluster is now healthy 2020-06-27T04:43:14.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:13 smithi031 bash[18426]: cluster 2020-06-27T04:43:13.112620+0000 mgr.x (mgr.34109) 40 : cluster [DBG] pgmap v40: 1 pgs: 1 active+clean; 0 B data, 616 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:14.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:13 smithi031 bash[18426]: cluster 2020-06-27T04:43:13.776109+0000 mon.a (mon.0) 320 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2020-06-27T04:43:14.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:13 smithi031 bash[18426]: cluster 2020-06-27T04:43:13.776198+0000 mon.a (mon.0) 321 : cluster [INF] Cluster is now healthy 2020-06-27T04:43:14.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:13 smithi031 bash[22603]: cluster 2020-06-27T04:43:13.112620+0000 mgr.x (mgr.34109) 40 : cluster [DBG] pgmap v40: 1 pgs: 1 active+clean; 0 B data, 616 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:14.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:13 smithi031 bash[22603]: cluster 2020-06-27T04:43:13.776109+0000 mon.a (mon.0) 320 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2020-06-27T04:43:14.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:13 smithi031 bash[22603]: cluster 2020-06-27T04:43:13.776198+0000 mon.a (mon.0) 321 : cluster [INF] Cluster is now healthy 2020-06-27T04:43:16.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:16 smithi051 bash[18409]: cluster 2020-06-27T04:43:15.113067+0000 mgr.x (mgr.34109) 41 : cluster [DBG] pgmap v41: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:16.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:16 smithi051 bash[18409]: audit 2020-06-27T04:43:15.289033+0000 mon.b (mon.2) 91 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2020-06-27T04:43:16.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:16 smithi051 bash[18409]: audit 2020-06-27T04:43:15.289924+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:16.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:16 smithi051 bash[18409]: cephadm 2020-06-27T04:43:15.290563+0000 mgr.x (mgr.34109) 42 : cephadm [INF] Deploying daemon osd.3 on smithi031 2020-06-27T04:43:16.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:16 smithi051 bash[18409]: audit 2020-06-27T04:43:15.290914+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2020-06-27T04:43:16.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:16 smithi031 bash[18426]: cluster 2020-06-27T04:43:15.113067+0000 mgr.x (mgr.34109) 41 : cluster [DBG] pgmap v41: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:16.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:16 smithi031 bash[18426]: audit 2020-06-27T04:43:15.289033+0000 mon.b (mon.2) 91 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2020-06-27T04:43:16.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:16 smithi031 bash[18426]: audit 2020-06-27T04:43:15.289924+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:16.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:16 smithi031 bash[18426]: cephadm 2020-06-27T04:43:15.290563+0000 mgr.x (mgr.34109) 42 : cephadm [INF] Deploying daemon osd.3 on smithi031 2020-06-27T04:43:16.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:16 smithi031 bash[18426]: audit 2020-06-27T04:43:15.290914+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2020-06-27T04:43:16.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:16 smithi031 bash[22603]: cluster 2020-06-27T04:43:15.113067+0000 mgr.x (mgr.34109) 41 : cluster [DBG] pgmap v41: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:16.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:16 smithi031 bash[22603]: audit 2020-06-27T04:43:15.289033+0000 mon.b (mon.2) 91 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2020-06-27T04:43:16.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:16 smithi031 bash[22603]: audit 2020-06-27T04:43:15.289924+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:16.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:16 smithi031 bash[22603]: cephadm 2020-06-27T04:43:15.290563+0000 mgr.x (mgr.34109) 42 : cephadm [INF] Deploying daemon osd.3 on smithi031 2020-06-27T04:43:16.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:16 smithi031 bash[22603]: audit 2020-06-27T04:43:15.290914+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2020-06-27T04:43:16.957 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:16.953+0000 7fc927fff700 1 -- 172.21.15.31:0/3682142002 <== mgr.34109 v2:172.21.15.51:6800/950992045 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc93000f040 con 0x7fc91c02ab00 2020-06-27T04:43:16.957 INFO:teuthology.orchestra.run.smithi031.stdout:Created osd(s) 3 on host 'smithi031' 2020-06-27T04:43:16.958 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:16.955+0000 7fc94605b700 1 -- 172.21.15.31:0/3682142002 >> v2:172.21.15.51:6800/950992045 conn(0x7fc91c02ab00 msgr2=0x7fc91c02cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:43:16.959 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:16.955+0000 7fc94605b700 1 --2- 172.21.15.31:0/3682142002 >> v2:172.21.15.51:6800/950992045 conn(0x7fc91c02ab00 0x7fc91c02cfc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fc93000b000 tx=0x7fc93000b040).stop 2020-06-27T04:43:16.959 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:16.955+0000 7fc94605b700 1 -- 172.21.15.31:0/3682142002 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9400678b0 msgr2=0x7fc940068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:43:16.959 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:16.955+0000 7fc94605b700 1 --2- 172.21.15.31:0/3682142002 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9400678b0 0x7fc940068580 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fc9340040c0 tx=0x7fc934009d20).stop 2020-06-27T04:43:16.959 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:16.955+0000 7fc94605b700 1 -- 172.21.15.31:0/3682142002 shutdown_connections 2020-06-27T04:43:16.959 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:16.955+0000 7fc94605b700 1 --2- 172.21.15.31:0/3682142002 >> v2:172.21.15.51:6800/950992045 conn(0x7fc91c02ab00 0x7fc91c02cfc0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:16.960 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:16.955+0000 7fc94605b700 1 --2- 172.21.15.31:0/3682142002 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc9400786f0 0x7fc9401250b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:16.960 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:16.955+0000 7fc94605b700 1 --2- 172.21.15.31:0/3682142002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc940066360 0x7fc940067e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:16.960 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:16.955+0000 7fc94605b700 1 --2- 172.21.15.31:0/3682142002 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9400678b0 0x7fc940068580 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:16.960 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:16.955+0000 7fc94605b700 1 -- 172.21.15.31:0/3682142002 >> 172.21.15.31:0/3682142002 conn(0x7fc940061830 msgr2=0x7fc940062f40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:43:16.960 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:16.955+0000 7fc94605b700 1 -- 172.21.15.31:0/3682142002 shutdown_connections 2020-06-27T04:43:16.961 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:43:16.955+0000 7fc94605b700 1 -- 172.21.15.31:0/3682142002 wait complete. 2020-06-27T04:43:17.432 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:17 smithi031 bash[18426]: audit 2020-06-27T04:43:16.949711+0000 mon.b (mon.2) 94 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_device_update\": \"2020-06-27T04:43:07.173345\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:17.433 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:17 smithi031 bash[18426]: audit 2020-06-27T04:43:16.950086+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:17.433 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:17 smithi031 bash[18426]: audit 2020-06-27T04:43:16.950554+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_device_update\": \"2020-06-27T04:43:07.173345\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:17.434 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:17 smithi031 bash[18426]: audit 2020-06-27T04:43:16.953356+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_device_update\": \"2020-06-27T04:43:07.173345\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:43:17.434 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:17 smithi031 bash[22603]: audit 2020-06-27T04:43:16.949711+0000 mon.b (mon.2) 94 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_device_update\": \"2020-06-27T04:43:07.173345\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:17.434 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:17 smithi031 bash[22603]: audit 2020-06-27T04:43:16.950086+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:17.434 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:17 smithi031 bash[22603]: audit 2020-06-27T04:43:16.950554+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_device_update\": \"2020-06-27T04:43:07.173345\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:17.435 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:17 smithi031 bash[22603]: audit 2020-06-27T04:43:16.953356+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_device_update\": \"2020-06-27T04:43:07.173345\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:43:17.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:17 smithi051 bash[18409]: audit 2020-06-27T04:43:16.949711+0000 mon.b (mon.2) 94 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_device_update\": \"2020-06-27T04:43:07.173345\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:17.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:17 smithi051 bash[18409]: audit 2020-06-27T04:43:16.950086+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:17.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:17 smithi051 bash[18409]: audit 2020-06-27T04:43:16.950554+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_device_update\": \"2020-06-27T04:43:07.173345\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:17.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:17 smithi051 bash[18409]: audit 2020-06-27T04:43:16.953356+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730558\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730651\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730690\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730793\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:02.730863\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_device_update\": \"2020-06-27T04:43:07.173345\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:43:17.754 INFO:teuthology.orchestra.run.smithi031:osd.3> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service 2020-06-27T04:43:17.757 INFO:tasks.cephadm:Deploying osd.4 on smithi051 with /dev/vg_nvme/lv_4... 2020-06-27T04:43:17.757 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2020-06-27T04:43:17.792 INFO:ceph.osd.3.smithi031.stdout:-- Logs begin at Sat 2020-06-27 04:33:08 UTC. -- 2020-06-27T04:43:18.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:18 smithi031 bash[18426]: cluster 2020-06-27T04:43:17.113544+0000 mgr.x (mgr.34109) 43 : cluster [DBG] pgmap v42: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:18.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:18 smithi031 bash[22603]: cluster 2020-06-27T04:43:17.113544+0000 mgr.x (mgr.34109) 43 : cluster [DBG] pgmap v42: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:18.224 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:17 smithi031 bash[31715]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-06-27T04:43:18.224 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:17 smithi031 bash[31715]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2020-06-27T04:43:18.225 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:17 smithi031 bash[31715]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2020-06-27T04:43:18.225 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:17 smithi031 bash[31715]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2020-06-27T04:43:18.226 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:17 smithi031 bash[31715]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2020-06-27T04:43:18.226 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:17 smithi031 bash[31715]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-06-27T04:43:18.226 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:17 smithi031 bash[31715]: --> ceph-volume lvm activate successful for osd ID: 3 2020-06-27T04:43:18.227 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:18 smithi031 podman[31717]: 2020-06-27 04:43:18.008425008 +0000 UTC m=+1.076157298 container died 23d222f0363358372ada1fcadfa3a7ee391757633fbdf1121c62b68a5583fb59 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:43:18.406 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:18 smithi051 bash[18409]: cluster 2020-06-27T04:43:17.113544+0000 mgr.x (mgr.34109) 43 : cluster [DBG] pgmap v42: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:18.912 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:18 smithi031 podman[31717]: 2020-06-27 04:43:18.53243489 +0000 UTC m=+1.600167180 container remove 23d222f0363358372ada1fcadfa3a7ee391757633fbdf1121c62b68a5583fb59 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:43:18.913 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:18 smithi031 bash[31715]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3 found: no such container 2020-06-27T04:43:18.913 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:18 smithi031 bash[31715]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3 2020-06-27T04:43:18.913 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:18 smithi031 bash[31715]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3" found: no such container 2020-06-27T04:43:19.188 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:18 smithi031 podman[31986]: 2020-06-27 04:43:18.91042771 +0000 UTC m=+0.272432573 container create 97568baaffaca0ed49cbc603d48d13a4c5a1c85f21d2fc61fe1ca627ee825630 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:43:19.188 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 podman[31986]: 2020-06-27 04:43:19.043686718 +0000 UTC m=+0.405691589 container init 97568baaffaca0ed49cbc603d48d13a4c5a1c85f21d2fc61fe1ca627ee825630 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:43:19.188 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 podman[31986]: 2020-06-27 04:43:19.113515659 +0000 UTC m=+0.475520655 container start 97568baaffaca0ed49cbc603d48d13a4c5a1c85f21d2fc61fe1ca627ee825630 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:43:19.188 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 podman[31986]: 2020-06-27 04:43:19.113712286 +0000 UTC m=+0.475717328 container attach 97568baaffaca0ed49cbc603d48d13a4c5a1c85f21d2fc61fe1ca627ee825630 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:43:19.189 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c52cbb700 5 --2- 172.21.15.31:0/4021803581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55921b54b400 0x55921b4bc300 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0x55921b4cda70 tx=0x55921b49ac00).reset_recv_state (warped) reseting crypto handlers 2020-06-27T04:43:19.189 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c52cbb700 5 --2- 172.21.15.31:0/4021803581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55921b54b400 0x55921b4bc300 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0x55921b4cda70 tx=0x55921b49ac00).reset_security 2020-06-27T04:43:19.189 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c52cbb700 20 EpollDriver.del_event del event fd=16 cur_mask=1 delmask=3 to 5 2020-06-27T04:43:19.189 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 10 -- 172.21.15.31:0/4021803581 shutdown 172.21.15.31:0/4021803581 2020-06-27T04:43:19.189 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 10 Processor -- stop 2020-06-27T04:43:19.190 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 20 Event(0x55921b4dee00 nevent=5000 time_id=3).wakeup 2020-06-27T04:43:19.190 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 1 -- 172.21.15.31:0/4021803581 shutdown_connections 2020-06-27T04:43:19.190 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 5 -- 172.21.15.31:0/4021803581 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55921b54b400 2020-06-27T04:43:19.190 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 1 --2- 172.21.15.31:0/4021803581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55921b54b400 0x55921b4bc300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:19.190 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 5 -- 172.21.15.31:0/4021803581 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55921b54ac00 2020-06-27T04:43:19.191 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 1 --2- 172.21.15.31:0/4021803581 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55921b54ac00 0x55921b4bb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:19.191 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 5 -- 172.21.15.31:0/4021803581 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55921b54b000 2020-06-27T04:43:19.191 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 1 --2- 172.21.15.31:0/4021803581 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55921b54b000 0x55921b4bbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:19.191 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 5 -- 172.21.15.31:0/4021803581 shutdown_connections delete 0x55921b54ac00 2020-06-27T04:43:19.191 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 5 -- 172.21.15.31:0/4021803581 shutdown_connections delete 0x55921b54b000 2020-06-27T04:43:19.192 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 5 -- 172.21.15.31:0/4021803581 shutdown_connections delete 0x55921b54b400 2020-06-27T04:43:19.192 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 1 -- 172.21.15.31:0/4021803581 >> 172.21.15.31:0/4021803581 conn(0x55921b54a800 msgr2=0x55921b5b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:43:19.192 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 20 --1- 172.21.15.31:0/4021803581 >> 172.21.15.31:0/4021803581 conn(0x55921b54a800 0x55921b5b3000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:43:19.192 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 2 --1- 172.21.15.31:0/4021803581 >> 172.21.15.31:0/4021803581 conn(0x55921b54a800 0x55921b5b3000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:43:19.192 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 5 --1- 172.21.15.31:0/4021803581 >> 172.21.15.31:0/4021803581 conn(0x55921b54a800 0x55921b5b3000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:43:19.193 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 20 Event(0x55921b4dee00 nevent=5000 time_id=3).wakeup 2020-06-27T04:43:19.193 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 10 --1- 172.21.15.31:0/4021803581 >> 172.21.15.31:0/4021803581 conn(0x55921b54a800 0x55921b5b3000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:43:19.193 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 20 Event(0x55921b4df040 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:19.193 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 20 Event(0x55921b4df280 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:19.193 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c52cbb700 5 --1- 172.21.15.31:0/4021803581 >> 172.21.15.31:0/4021803581 conn(0x55921b54a800 0x55921b5b3000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:43:19.193 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c52cbb700 5 --1- 172.21.15.31:0/4021803581 >> 172.21.15.31:0/4021803581 conn(0x55921b54a800 0x55921b5b3000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:43:19.194 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 10 -- 172.21.15.31:0/4021803581 wait: waiting for dispatch queue 2020-06-27T04:43:19.194 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 10 -- 172.21.15.31:0/4021803581 wait: dispatch queue is stopped 2020-06-27T04:43:19.194 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 1 -- 172.21.15.31:0/4021803581 shutdown_connections 2020-06-27T04:43:19.194 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 5 -- 172.21.15.31:0/4021803581 shutdown_connections delete 0x55921b54a800 2020-06-27T04:43:19.194 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 20 Event(0x55921b4dee00 nevent=5000 time_id=3).wakeup 2020-06-27T04:43:19.195 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 20 Event(0x55921b4df040 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:19.195 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 20 Event(0x55921b4df280 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:19.195 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 10 -- 172.21.15.31:0/4021803581 wait: done. 2020-06-27T04:43:19.195 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.073+0000 7f8c58f38f40 1 -- 172.21.15.31:0/4021803581 wait complete. 2020-06-27T04:43:19.195 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[18426]: audit 2020-06-27T04:43:19.155677+0000 mon.b (mon.2) 96 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_daemon_update\": \"2020-06-27T04:43:19.154555\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:19.196 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[18426]: audit 2020-06-27T04:43:19.156468+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_daemon_update\": \"2020-06-27T04:43:19.154555\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:19.196 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[18426]: audit 2020-06-27T04:43:19.158985+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_daemon_update\": \"2020-06-27T04:43:19.154555\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:43:19.196 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[18426]: audit 2020-06-27T04:43:19.160735+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:19.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:19 smithi051 bash[18409]: audit 2020-06-27T04:43:19.155677+0000 mon.b (mon.2) 96 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_daemon_update\": \"2020-06-27T04:43:19.154555\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:19.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:19 smithi051 bash[18409]: audit 2020-06-27T04:43:19.156468+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_daemon_update\": \"2020-06-27T04:43:19.154555\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:19.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:19 smithi051 bash[18409]: audit 2020-06-27T04:43:19.158985+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_daemon_update\": \"2020-06-27T04:43:19.154555\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:43:19.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:19 smithi051 bash[18409]: audit 2020-06-27T04:43:19.160735+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:19.473 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.343+0000 7f8c58f38f40 -1 Falling back to public interface 2020-06-27T04:43:19.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[22603]: audit 2020-06-27T04:43:19.155677+0000 mon.b (mon.2) 96 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_daemon_update\": \"2020-06-27T04:43:19.154555\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:19.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[22603]: audit 2020-06-27T04:43:19.156468+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_daemon_update\": \"2020-06-27T04:43:19.154555\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:19.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[22603]: audit 2020-06-27T04:43:19.158985+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_daemon_update\": \"2020-06-27T04:43:19.154555\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:43:19.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[22603]: audit 2020-06-27T04:43:19.160735+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:19.485 INFO:teuthology.orchestra.run.smithi051.stderr:--> Zapping: /dev/vg_nvme/lv_4 2020-06-27T04:43:19.486 INFO:teuthology.orchestra.run.smithi051.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2020-06-27T04:43:19.486 INFO:teuthology.orchestra.run.smithi051.stderr: stderr: 10+0 records in 2020-06-27T04:43:19.486 INFO:teuthology.orchestra.run.smithi051.stderr:10+0 records out 2020-06-27T04:43:19.486 INFO:teuthology.orchestra.run.smithi051.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00820114 s, 1.3 GB/s 2020-06-27T04:43:19.486 INFO:teuthology.orchestra.run.smithi051.stderr:--> Zapping successful for: 2020-06-27T04:43:20.145 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph orch daemon add osd smithi051:vg_nvme/lv_4 2020-06-27T04:43:20.190 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:19 smithi031 bash[31715]: debug 2020-06-27T04:43:19.912+0000 7f8c58f38f40 -1 osd.3 0 log_to_monitors {default=true} 2020-06-27T04:43:20.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:20 smithi051 bash[18409]: cluster 2020-06-27T04:43:19.113823+0000 mgr.x (mgr.34109) 44 : cluster [DBG] pgmap v43: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:20.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:20 smithi051 bash[18409]: audit 2020-06-27T04:43:19.916938+0000 mon.c (mon.1) 9 : audit [INF] from='osd.3 v2:172.21.15.31:6812/772723559' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:43:20.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:20 smithi051 bash[18409]: audit 2020-06-27T04:43:19.917221+0000 mon.a (mon.0) 326 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:43:20.472 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:20 smithi031 bash[22603]: cluster 2020-06-27T04:43:19.113823+0000 mgr.x (mgr.34109) 44 : cluster [DBG] pgmap v43: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:20.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:20 smithi031 bash[22603]: audit 2020-06-27T04:43:19.916938+0000 mon.c (mon.1) 9 : audit [INF] from='osd.3 v2:172.21.15.31:6812/772723559' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:43:20.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:20 smithi031 bash[22603]: audit 2020-06-27T04:43:19.917221+0000 mon.a (mon.0) 326 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:43:20.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:20 smithi031 bash[18426]: cluster 2020-06-27T04:43:19.113823+0000 mgr.x (mgr.34109) 44 : cluster [DBG] pgmap v43: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:20.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:20 smithi031 bash[18426]: audit 2020-06-27T04:43:19.916938+0000 mon.c (mon.1) 9 : audit [INF] from='osd.3 v2:172.21.15.31:6812/772723559' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:43:20.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:20 smithi031 bash[18426]: audit 2020-06-27T04:43:19.917221+0000 mon.a (mon.0) 326 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:43:21.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:21 smithi051 bash[18409]: audit 2020-06-27T04:43:20.195805+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:43:21.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:21 smithi051 bash[18409]: audit 2020-06-27T04:43:20.197935+0000 mon.a (mon.0) 327 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2020-06-27T04:43:21.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:21 smithi051 bash[18409]: cluster 2020-06-27T04:43:20.197973+0000 mon.a (mon.0) 328 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2020-06-27T04:43:21.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:21 smithi051 bash[18409]: audit 2020-06-27T04:43:20.198495+0000 mon.c (mon.1) 10 : audit [INF] from='osd.3 v2:172.21.15.31:6812/772723559' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:43:21.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:21 smithi051 bash[18409]: audit 2020-06-27T04:43:20.198763+0000 mon.a (mon.0) 329 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:43:21.476 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:43:21 smithi031 bash[31715]: debug 2020-06-27T04:43:21.205+0000 7f8c4f4b4700 -1 osd.3 0 waiting for initial osdmap 2020-06-27T04:43:21.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:21 smithi031 bash[18426]: audit 2020-06-27T04:43:20.195805+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:43:21.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:21 smithi031 bash[18426]: audit 2020-06-27T04:43:20.197935+0000 mon.a (mon.0) 327 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2020-06-27T04:43:21.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:21 smithi031 bash[18426]: cluster 2020-06-27T04:43:20.197973+0000 mon.a (mon.0) 328 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2020-06-27T04:43:21.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:21 smithi031 bash[18426]: audit 2020-06-27T04:43:20.198495+0000 mon.c (mon.1) 10 : audit [INF] from='osd.3 v2:172.21.15.31:6812/772723559' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:43:21.478 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:21 smithi031 bash[18426]: audit 2020-06-27T04:43:20.198763+0000 mon.a (mon.0) 329 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:43:21.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:21 smithi031 bash[22603]: audit 2020-06-27T04:43:20.195805+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:43:21.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:21 smithi031 bash[22603]: audit 2020-06-27T04:43:20.197935+0000 mon.a (mon.0) 327 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2020-06-27T04:43:21.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:21 smithi031 bash[22603]: cluster 2020-06-27T04:43:20.197973+0000 mon.a (mon.0) 328 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2020-06-27T04:43:21.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:21 smithi031 bash[22603]: audit 2020-06-27T04:43:20.198495+0000 mon.c (mon.1) 10 : audit [INF] from='osd.3 v2:172.21.15.31:6812/772723559' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:43:21.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:21 smithi031 bash[22603]: audit 2020-06-27T04:43:20.198763+0000 mon.a (mon.0) 329 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:43:21.696 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.690+0000 7fb102061700 1 Processor -- start 2020-06-27T04:43:21.696 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.690+0000 7fb102061700 1 -- start start 2020-06-27T04:43:21.697 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb102061700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0fc0678b0 0x7fb0fc074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:43:21.697 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb102061700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0fc06be30 0x7fb0fc074980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:43:21.697 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb102061700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb0fc0778e0 0x7fb0fc077d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:43:21.697 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb102061700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0783b0 con 0x7fb0fc0678b0 2020-06-27T04:43:21.697 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb102061700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc078520 con 0x7fb0fc0778e0 2020-06-27T04:43:21.698 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb102061700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0786e0 con 0x7fb0fc06be30 2020-06-27T04:43:21.698 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb100dff700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb0fc0778e0 0x7fb0fc077d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:43:21.698 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb0f3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0fc06be30 0x7fb0fc074980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:43:21.698 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb0fbfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0fc0678b0 0x7fb0fc074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:43:21.698 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb0f3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0fc06be30 0x7fb0fc074980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.51:60012/0 (socket says 172.21.15.51:60012) 2020-06-27T04:43:21.699 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb0f3fff700 1 -- 172.21.15.51:0/3112469312 learned_addr learned my addr 172.21.15.51:0/3112469312 (peer_addr_for_me v2:172.21.15.51:0/0) 2020-06-27T04:43:21.699 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb0fbfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0fc0678b0 0x7fb0fc074290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.51:34348/0 (socket says 172.21.15.51:34348) 2020-06-27T04:43:21.699 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb100dff700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb0fc0778e0 0x7fb0fc077d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.51:3300/0 says I am v2:172.21.15.51:49884/0 (socket says 172.21.15.51:49884) 2020-06-27T04:43:21.699 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb100dff700 1 -- 172.21.15.51:0/3112469312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0fc06be30 msgr2=0x7fb0fc074980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:43:21.699 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb100dff700 1 --2- 172.21.15.51:0/3112469312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0fc06be30 0x7fb0fc074980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:21.700 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb100dff700 1 -- 172.21.15.51:0/3112469312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0fc0678b0 msgr2=0x7fb0fc074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:43:21.700 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb100dff700 1 --2- 172.21.15.51:0/3112469312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0fc0678b0 0x7fb0fc074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:21.700 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb100dff700 1 -- 172.21.15.51:0/3112469312 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc0788a0 con 0x7fb0fc0778e0 2020-06-27T04:43:21.700 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb0f3fff700 1 --2- 172.21.15.51:0/3112469312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0fc06be30 0x7fb0fc074980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:43:21.700 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb100dff700 1 --2- 172.21.15.51:0/3112469312 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb0fc0778e0 0x7fb0fc077d60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fb0f400c000 tx=0x7fb0f400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:43:21.701 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb0f8ff9700 1 -- 172.21.15.51:0/3112469312 <== mon.2 v2:172.21.15.51:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0f400e6d0 con 0x7fb0fc0778e0 2020-06-27T04:43:21.701 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb0f8ff9700 1 -- 172.21.15.51:0/3112469312 <== mon.2 v2:172.21.15.51:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fb0f400f040 con 0x7fb0fc0778e0 2020-06-27T04:43:21.701 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb102061700 1 -- 172.21.15.51:0/3112469312 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0fc078af0 con 0x7fb0fc0778e0 2020-06-27T04:43:21.701 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb0f8ff9700 1 -- 172.21.15.51:0/3112469312 <== mon.2 v2:172.21.15.51:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0f4007af0 con 0x7fb0fc0778e0 2020-06-27T04:43:21.701 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.691+0000 7fb102061700 1 -- 172.21.15.51:0/3112469312 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0fc122e70 con 0x7fb0fc0778e0 2020-06-27T04:43:21.702 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.692+0000 7fb0f8ff9700 1 -- 172.21.15.51:0/3112469312 <== mon.2 v2:172.21.15.51:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7fb0f4007c50 con 0x7fb0fc0778e0 2020-06-27T04:43:21.702 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.692+0000 7fb0f8ff9700 1 --2- 172.21.15.51:0/3112469312 >> v2:172.21.15.51:6800/950992045 conn(0x7fb0d402ab50 0x7fb0d402d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:43:21.702 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.692+0000 7fb0f8ff9700 1 -- 172.21.15.51:0/3112469312 <== mon.2 v2:172.21.15.51:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 2878+0+0 (secure 0 0 0) 0x7fb0f403a160 con 0x7fb0fc0778e0 2020-06-27T04:43:21.702 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.692+0000 7fb102061700 1 -- 172.21.15.51:0/3112469312 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0fc05e210 con 0x7fb0fc0778e0 2020-06-27T04:43:21.703 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.692+0000 7fb0fbfff700 1 --2- 172.21.15.51:0/3112469312 >> v2:172.21.15.51:6800/950992045 conn(0x7fb0d402ab50 0x7fb0d402d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:43:21.703 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.693+0000 7fb0fbfff700 1 --2- 172.21.15.51:0/3112469312 >> v2:172.21.15.51:6800/950992045 conn(0x7fb0d402ab50 0x7fb0d402d010 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fb0ec00b000 tx=0x7fb0ec00b040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:43:21.703 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.696+0000 7fb0f8ff9700 1 -- 172.21.15.51:0/3112469312 <== mon.2 v2:172.21.15.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fb0f4019020 con 0x7fb0fc0778e0 2020-06-27T04:43:21.877 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:21.873+0000 7fb102061700 1 -- 172.21.15.51:0/3112469312 --> v2:172.21.15.51:6800/950992045 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi051:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0fc05f390 con 0x7fb0d402ab50 2020-06-27T04:43:22.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:22 smithi051 bash[18409]: cluster 2020-06-27T04:43:20.955768+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:43:22.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:22 smithi051 bash[18409]: cluster 2020-06-27T04:43:20.955851+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:43:22.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:22 smithi051 bash[18409]: cluster 2020-06-27T04:43:21.114444+0000 mgr.x (mgr.34109) 45 : cluster [DBG] pgmap v45: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:22.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:22 smithi051 bash[18409]: audit 2020-06-27T04:43:21.196939+0000 mon.a (mon.0) 330 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2020-06-27T04:43:22.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:22 smithi051 bash[18409]: cluster 2020-06-27T04:43:21.196987+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2020-06-27T04:43:22.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:22 smithi051 bash[18409]: audit 2020-06-27T04:43:21.197401+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:43:22.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:22 smithi051 bash[18409]: audit 2020-06-27T04:43:21.199556+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:43:22.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:22 smithi051 bash[18409]: audit 2020-06-27T04:43:21.876303+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:43:22.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:22 smithi051 bash[18409]: audit 2020-06-27T04:43:21.877495+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:43:22.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:22 smithi051 bash[18409]: audit 2020-06-27T04:43:21.878034+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:22.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:22 smithi051 bash[18409]: audit 2020-06-27T04:43:21.878604+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:22.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:22 smithi051 bash[18409]: audit 2020-06-27T04:43:22.200046+0000 mon.b (mon.2) 105 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:43:22.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[18426]: cluster 2020-06-27T04:43:20.955768+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:43:22.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[18426]: cluster 2020-06-27T04:43:20.955851+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:43:22.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[18426]: cluster 2020-06-27T04:43:21.114444+0000 mgr.x (mgr.34109) 45 : cluster [DBG] pgmap v45: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:22.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[18426]: audit 2020-06-27T04:43:21.196939+0000 mon.a (mon.0) 330 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2020-06-27T04:43:22.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[18426]: cluster 2020-06-27T04:43:21.196987+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2020-06-27T04:43:22.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[18426]: audit 2020-06-27T04:43:21.197401+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:43:22.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[18426]: audit 2020-06-27T04:43:21.199556+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:43:22.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[18426]: audit 2020-06-27T04:43:21.876303+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:43:22.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[18426]: audit 2020-06-27T04:43:21.877495+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:43:22.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[18426]: audit 2020-06-27T04:43:21.878034+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:22.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[18426]: audit 2020-06-27T04:43:21.878604+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:22.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[18426]: audit 2020-06-27T04:43:22.200046+0000 mon.b (mon.2) 105 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:43:22.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[22603]: cluster 2020-06-27T04:43:20.955768+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:43:22.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[22603]: cluster 2020-06-27T04:43:20.955851+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:43:22.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[22603]: cluster 2020-06-27T04:43:21.114444+0000 mgr.x (mgr.34109) 45 : cluster [DBG] pgmap v45: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:22.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[22603]: audit 2020-06-27T04:43:21.196939+0000 mon.a (mon.0) 330 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2020-06-27T04:43:22.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[22603]: cluster 2020-06-27T04:43:21.196987+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2020-06-27T04:43:22.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[22603]: audit 2020-06-27T04:43:21.197401+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:43:22.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[22603]: audit 2020-06-27T04:43:21.199556+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:43:22.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[22603]: audit 2020-06-27T04:43:21.876303+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:43:22.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[22603]: audit 2020-06-27T04:43:21.877495+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:43:22.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[22603]: audit 2020-06-27T04:43:21.878034+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:22.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[22603]: audit 2020-06-27T04:43:21.878604+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:22.480 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:22 smithi031 bash[22603]: audit 2020-06-27T04:43:22.200046+0000 mon.b (mon.2) 105 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:43:23.346 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:23 smithi051 bash[18409]: audit 2020-06-27T04:43:21.875532+0000 mgr.x (mgr.34109) 46 : audit [DBG] from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi051:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:43:23.347 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:23 smithi051 bash[18409]: cephadm 2020-06-27T04:43:21.876851+0000 mgr.x (mgr.34109) 47 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:43:23.347 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:23 smithi051 bash[18409]: cephadm 2020-06-27T04:43:21.876906+0000 mgr.x (mgr.34109) 48 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:43:23.347 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:23 smithi051 bash[18409]: cephadm 2020-06-27T04:43:21.877227+0000 mgr.x (mgr.34109) 49 : cephadm [INF] Applying None on host smithi051... 2020-06-27T04:43:23.347 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:23 smithi051 bash[18409]: audit 2020-06-27T04:43:22.208566+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:43:23.347 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:23 smithi051 bash[18409]: cluster 2020-06-27T04:43:22.210364+0000 mon.a (mon.0) 332 : cluster [INF] osd.3 v2:172.21.15.31:6812/772723559 boot 2020-06-27T04:43:23.348 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:23 smithi051 bash[18409]: cluster 2020-06-27T04:43:22.210432+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2020-06-27T04:43:23.348 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:23 smithi051 bash[18409]: audit 2020-06-27T04:43:22.222520+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:23.348 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:23 smithi051 bash[18409]: audit 2020-06-27T04:43:22.467870+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_daemon_update\": \"2020-06-27T04:43:19.154555\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:23.348 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:23 smithi051 bash[18409]: audit 2020-06-27T04:43:22.468622+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_daemon_update\": \"2020-06-27T04:43:19.154555\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:23.349 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:23 smithi051 bash[18409]: audit 2020-06-27T04:43:22.471350+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_daemon_update\": \"2020-06-27T04:43:19.154555\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:43:23.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[18426]: audit 2020-06-27T04:43:21.875532+0000 mgr.x (mgr.34109) 46 : audit [DBG] from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi051:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:43:23.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[18426]: cephadm 2020-06-27T04:43:21.876851+0000 mgr.x (mgr.34109) 47 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:43:23.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[18426]: cephadm 2020-06-27T04:43:21.876906+0000 mgr.x (mgr.34109) 48 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:43:23.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[18426]: cephadm 2020-06-27T04:43:21.877227+0000 mgr.x (mgr.34109) 49 : cephadm [INF] Applying None on host smithi051... 2020-06-27T04:43:23.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[18426]: audit 2020-06-27T04:43:22.208566+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:43:23.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[18426]: cluster 2020-06-27T04:43:22.210364+0000 mon.a (mon.0) 332 : cluster [INF] osd.3 v2:172.21.15.31:6812/772723559 boot 2020-06-27T04:43:23.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[18426]: cluster 2020-06-27T04:43:22.210432+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2020-06-27T04:43:23.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[18426]: audit 2020-06-27T04:43:22.222520+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:23.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[18426]: audit 2020-06-27T04:43:22.467870+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_daemon_update\": \"2020-06-27T04:43:19.154555\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:23.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[18426]: audit 2020-06-27T04:43:22.468622+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_daemon_update\": \"2020-06-27T04:43:19.154555\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:23.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[18426]: audit 2020-06-27T04:43:22.471350+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_daemon_update\": \"2020-06-27T04:43:19.154555\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:43:23.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[22603]: audit 2020-06-27T04:43:21.875532+0000 mgr.x (mgr.34109) 46 : audit [DBG] from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi051:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:43:23.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[22603]: cephadm 2020-06-27T04:43:21.876851+0000 mgr.x (mgr.34109) 47 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:43:23.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[22603]: cephadm 2020-06-27T04:43:21.876906+0000 mgr.x (mgr.34109) 48 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:43:23.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[22603]: cephadm 2020-06-27T04:43:21.877227+0000 mgr.x (mgr.34109) 49 : cephadm [INF] Applying None on host smithi051... 2020-06-27T04:43:23.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[22603]: audit 2020-06-27T04:43:22.208566+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:43:23.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[22603]: cluster 2020-06-27T04:43:22.210364+0000 mon.a (mon.0) 332 : cluster [INF] osd.3 v2:172.21.15.31:6812/772723559 boot 2020-06-27T04:43:23.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[22603]: cluster 2020-06-27T04:43:22.210432+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2020-06-27T04:43:23.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[22603]: audit 2020-06-27T04:43:22.222520+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:23.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[22603]: audit 2020-06-27T04:43:22.467870+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_daemon_update\": \"2020-06-27T04:43:19.154555\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:23.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[22603]: audit 2020-06-27T04:43:22.468622+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_daemon_update\": \"2020-06-27T04:43:19.154555\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:43:23.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:23 smithi031 bash[22603]: audit 2020-06-27T04:43:22.471350+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}}, \"last_daemon_update\": \"2020-06-27T04:43:19.154555\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:43:24.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:24 smithi051 bash[18409]: cluster 2020-06-27T04:43:23.114998+0000 mgr.x (mgr.34109) 50 : cluster [DBG] pgmap v48: 1 pgs: 1 active+clean; 0 B data, 648 KiB used, 265 GiB / 268 GiB avail 2020-06-27T04:43:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:24 smithi051 bash[18409]: cluster 2020-06-27T04:43:23.477783+0000 mon.a (mon.0) 336 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2020-06-27T04:43:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:24 smithi051 bash[18409]: audit 2020-06-27T04:43:23.982758+0000 mon.b (mon.2) 109 : audit [INF] from='client.? 172.21.15.51:0/3782775336' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62c9b092-2f7d-4391-acae-dd78afcf7d5a"}]: dispatch 2020-06-27T04:43:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:24 smithi051 bash[18409]: audit 2020-06-27T04:43:23.983353+0000 mon.a (mon.0) 337 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62c9b092-2f7d-4391-acae-dd78afcf7d5a"}]: dispatch 2020-06-27T04:43:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:24 smithi051 bash[18409]: audit 2020-06-27T04:43:23.989954+0000 mon.a (mon.0) 338 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62c9b092-2f7d-4391-acae-dd78afcf7d5a"}]': finished 2020-06-27T04:43:24.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:24 smithi051 bash[18409]: cluster 2020-06-27T04:43:23.990056+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2020-06-27T04:43:24.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:24 smithi051 bash[18409]: audit 2020-06-27T04:43:23.992215+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:43:24.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:24 smithi051 bash[18409]: audit 2020-06-27T04:43:24.455372+0000 mon.b (mon.2) 111 : audit [DBG] from='client.? 172.21.15.51:0/1570869164' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:43:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:24 smithi031 bash[22603]: cluster 2020-06-27T04:43:23.114998+0000 mgr.x (mgr.34109) 50 : cluster [DBG] pgmap v48: 1 pgs: 1 active+clean; 0 B data, 648 KiB used, 265 GiB / 268 GiB avail 2020-06-27T04:43:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:24 smithi031 bash[22603]: cluster 2020-06-27T04:43:23.477783+0000 mon.a (mon.0) 336 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2020-06-27T04:43:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:24 smithi031 bash[22603]: audit 2020-06-27T04:43:23.982758+0000 mon.b (mon.2) 109 : audit [INF] from='client.? 172.21.15.51:0/3782775336' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62c9b092-2f7d-4391-acae-dd78afcf7d5a"}]: dispatch 2020-06-27T04:43:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:24 smithi031 bash[22603]: audit 2020-06-27T04:43:23.983353+0000 mon.a (mon.0) 337 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62c9b092-2f7d-4391-acae-dd78afcf7d5a"}]: dispatch 2020-06-27T04:43:24.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:24 smithi031 bash[22603]: audit 2020-06-27T04:43:23.989954+0000 mon.a (mon.0) 338 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62c9b092-2f7d-4391-acae-dd78afcf7d5a"}]': finished 2020-06-27T04:43:24.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:24 smithi031 bash[22603]: cluster 2020-06-27T04:43:23.990056+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2020-06-27T04:43:24.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:24 smithi031 bash[22603]: audit 2020-06-27T04:43:23.992215+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:43:24.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:24 smithi031 bash[22603]: audit 2020-06-27T04:43:24.455372+0000 mon.b (mon.2) 111 : audit [DBG] from='client.? 172.21.15.51:0/1570869164' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:43:24.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:24 smithi031 bash[18426]: cluster 2020-06-27T04:43:23.114998+0000 mgr.x (mgr.34109) 50 : cluster [DBG] pgmap v48: 1 pgs: 1 active+clean; 0 B data, 648 KiB used, 265 GiB / 268 GiB avail 2020-06-27T04:43:24.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:24 smithi031 bash[18426]: cluster 2020-06-27T04:43:23.477783+0000 mon.a (mon.0) 336 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2020-06-27T04:43:24.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:24 smithi031 bash[18426]: audit 2020-06-27T04:43:23.982758+0000 mon.b (mon.2) 109 : audit [INF] from='client.? 172.21.15.51:0/3782775336' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62c9b092-2f7d-4391-acae-dd78afcf7d5a"}]: dispatch 2020-06-27T04:43:24.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:24 smithi031 bash[18426]: audit 2020-06-27T04:43:23.983353+0000 mon.a (mon.0) 337 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62c9b092-2f7d-4391-acae-dd78afcf7d5a"}]: dispatch 2020-06-27T04:43:24.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:24 smithi031 bash[18426]: audit 2020-06-27T04:43:23.989954+0000 mon.a (mon.0) 338 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62c9b092-2f7d-4391-acae-dd78afcf7d5a"}]': finished 2020-06-27T04:43:24.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:24 smithi031 bash[18426]: cluster 2020-06-27T04:43:23.990056+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2020-06-27T04:43:24.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:24 smithi031 bash[18426]: audit 2020-06-27T04:43:23.992215+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:43:24.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:24 smithi031 bash[18426]: audit 2020-06-27T04:43:24.455372+0000 mon.b (mon.2) 111 : audit [DBG] from='client.? 172.21.15.51:0/1570869164' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:43:26.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:26 smithi051 bash[18409]: cluster 2020-06-27T04:43:25.115379+0000 mgr.x (mgr.34109) 51 : cluster [DBG] pgmap v51: 1 pgs: 1 active+clean; 0 B data, 920 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:26 smithi031 bash[18426]: cluster 2020-06-27T04:43:25.115379+0000 mgr.x (mgr.34109) 51 : cluster [DBG] pgmap v51: 1 pgs: 1 active+clean; 0 B data, 920 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:26.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:26 smithi031 bash[22603]: cluster 2020-06-27T04:43:25.115379+0000 mgr.x (mgr.34109) 51 : cluster [DBG] pgmap v51: 1 pgs: 1 active+clean; 0 B data, 920 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:27.637 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:27 smithi051 bash[18409]: audit 2020-06-27T04:43:26.892976+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:27.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:27 smithi031 bash[18426]: audit 2020-06-27T04:43:26.892976+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:27.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:27 smithi031 bash[22603]: audit 2020-06-27T04:43:26.892976+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:28.714 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:28 smithi051 bash[18409]: cluster 2020-06-27T04:43:27.115651+0000 mgr.x (mgr.34109) 52 : cluster [DBG] pgmap v52: 1 pgs: 1 active+clean; 0 B data, 952 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:28.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:28 smithi031 bash[18426]: cluster 2020-06-27T04:43:27.115651+0000 mgr.x (mgr.34109) 52 : cluster [DBG] pgmap v52: 1 pgs: 1 active+clean; 0 B data, 952 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:28.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:28 smithi031 bash[22603]: cluster 2020-06-27T04:43:27.115651+0000 mgr.x (mgr.34109) 52 : cluster [DBG] pgmap v52: 1 pgs: 1 active+clean; 0 B data, 952 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:29.945 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:29 smithi051 bash[18409]: audit 2020-06-27T04:43:29.175309+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2020-06-27T04:43:29.946 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:29 smithi051 bash[18409]: audit 2020-06-27T04:43:29.175938+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:29.946 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:29 smithi051 bash[18409]: audit 2020-06-27T04:43:29.176630+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2020-06-27T04:43:29.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:29 smithi031 bash[18426]: audit 2020-06-27T04:43:29.175309+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2020-06-27T04:43:29.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:29 smithi031 bash[18426]: audit 2020-06-27T04:43:29.175938+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:29.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:29 smithi031 bash[18426]: audit 2020-06-27T04:43:29.176630+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2020-06-27T04:43:29.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:29 smithi031 bash[22603]: audit 2020-06-27T04:43:29.175309+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2020-06-27T04:43:29.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:29 smithi031 bash[22603]: audit 2020-06-27T04:43:29.175938+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:29.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:29 smithi031 bash[22603]: audit 2020-06-27T04:43:29.176630+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2020-06-27T04:43:30.624 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:30 smithi051 bash[18409]: cluster 2020-06-27T04:43:29.116049+0000 mgr.x (mgr.34109) 53 : cluster [DBG] pgmap v53: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:30.624 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:30 smithi051 bash[18409]: cephadm 2020-06-27T04:43:29.176390+0000 mgr.x (mgr.34109) 54 : cephadm [INF] Deploying daemon osd.4 on smithi051 2020-06-27T04:43:30.664 INFO:teuthology.orchestra.run.smithi051.stdout:Created osd(s) 4 on host 'smithi051' 2020-06-27T04:43:30.664 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:30.660+0000 7fb0f8ff9700 1 -- 172.21.15.51:0/3112469312 <== mgr.34109 v2:172.21.15.51:6800/950992045 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb0ec00f040 con 0x7fb0d402ab50 2020-06-27T04:43:30.665 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:30.662+0000 7fb102061700 1 -- 172.21.15.51:0/3112469312 >> v2:172.21.15.51:6800/950992045 conn(0x7fb0d402ab50 msgr2=0x7fb0d402d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:43:30.665 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:30.662+0000 7fb102061700 1 --2- 172.21.15.51:0/3112469312 >> v2:172.21.15.51:6800/950992045 conn(0x7fb0d402ab50 0x7fb0d402d010 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fb0ec00b000 tx=0x7fb0ec00b040).stop 2020-06-27T04:43:30.665 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:30.663+0000 7fb102061700 1 -- 172.21.15.51:0/3112469312 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb0fc0778e0 msgr2=0x7fb0fc077d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:43:30.666 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:30.663+0000 7fb102061700 1 --2- 172.21.15.51:0/3112469312 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb0fc0778e0 0x7fb0fc077d60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fb0f400c000 tx=0x7fb0f400b040).stop 2020-06-27T04:43:30.668 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:30.663+0000 7fb102061700 1 -- 172.21.15.51:0/3112469312 shutdown_connections 2020-06-27T04:43:30.668 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:30.663+0000 7fb102061700 1 --2- 172.21.15.51:0/3112469312 >> v2:172.21.15.51:6800/950992045 conn(0x7fb0d402ab50 0x7fb0d402d010 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:30.668 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:30.663+0000 7fb102061700 1 --2- 172.21.15.51:0/3112469312 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb0fc0778e0 0x7fb0fc077d60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:30.668 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:30.663+0000 7fb102061700 1 --2- 172.21.15.51:0/3112469312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0fc0678b0 0x7fb0fc074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:30.669 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:30.663+0000 7fb102061700 1 --2- 172.21.15.51:0/3112469312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0fc06be30 0x7fb0fc074980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:30.669 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:30.663+0000 7fb102061700 1 -- 172.21.15.51:0/3112469312 >> 172.21.15.51:0/3112469312 conn(0x7fb0fc061830 msgr2=0x7fb0fc063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:43:30.669 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:30.663+0000 7fb102061700 1 -- 172.21.15.51:0/3112469312 shutdown_connections 2020-06-27T04:43:30.669 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:30.663+0000 7fb102061700 1 -- 172.21.15.51:0/3112469312 wait complete. 2020-06-27T04:43:30.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:30 smithi031 bash[18426]: cluster 2020-06-27T04:43:29.116049+0000 mgr.x (mgr.34109) 53 : cluster [DBG] pgmap v53: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:30.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:30 smithi031 bash[18426]: cephadm 2020-06-27T04:43:29.176390+0000 mgr.x (mgr.34109) 54 : cephadm [INF] Deploying daemon osd.4 on smithi051 2020-06-27T04:43:30.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:30 smithi031 bash[22603]: cluster 2020-06-27T04:43:29.116049+0000 mgr.x (mgr.34109) 53 : cluster [DBG] pgmap v53: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:30.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:30 smithi031 bash[22603]: cephadm 2020-06-27T04:43:29.176390+0000 mgr.x (mgr.34109) 54 : cephadm [INF] Deploying daemon osd.4 on smithi051 2020-06-27T04:43:31.378 INFO:teuthology.orchestra.run.smithi051:osd.4> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service 2020-06-27T04:43:31.380 INFO:tasks.cephadm:Deploying osd.5 on smithi051 with /dev/vg_nvme/lv_3... 2020-06-27T04:43:31.381 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2020-06-27T04:43:31.427 INFO:ceph.osd.4.smithi051.stdout:-- Logs begin at Sat 2020-06-27 04:33:02 UTC. -- 2020-06-27T04:43:31.639 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:31 smithi051 bash[18409]: audit 2020-06-27T04:43:30.656654+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234291\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234390\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:31.640 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:31 smithi051 bash[18409]: audit 2020-06-27T04:43:30.656941+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:31.640 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:31 smithi051 bash[18409]: audit 2020-06-27T04:43:30.657404+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234291\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234390\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:31.640 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:31 smithi051 bash[18409]: audit 2020-06-27T04:43:30.659869+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234291\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234390\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:43:31.967 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:31 smithi051 bash[21231]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-06-27T04:43:31.968 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:31 smithi051 bash[21231]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2020-06-27T04:43:31.968 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:31 smithi051 bash[21231]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2020-06-27T04:43:31.968 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:31 smithi051 bash[21231]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2020-06-27T04:43:31.968 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:31 smithi051 bash[21231]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2020-06-27T04:43:31.969 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:31 smithi051 bash[21231]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-06-27T04:43:31.969 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:31 smithi051 bash[21231]: --> ceph-volume lvm activate successful for osd ID: 4 2020-06-27T04:43:31.969 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:31 smithi051 podman[21233]: 2020-06-27 04:43:31.698605259 +0000 UTC m=+1.057319253 container died 1c23c0f63b259522d4ae7f13adf88c7f77dda1be3635c23e5ff4cefda69e84da (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:43:31.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:31 smithi031 bash[18426]: audit 2020-06-27T04:43:30.656654+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234291\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234390\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:31.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:31 smithi031 bash[18426]: audit 2020-06-27T04:43:30.656941+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:31.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:31 smithi031 bash[18426]: audit 2020-06-27T04:43:30.657404+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234291\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234390\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:31.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:31 smithi031 bash[18426]: audit 2020-06-27T04:43:30.659869+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234291\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234390\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:43:31.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:31 smithi031 bash[22603]: audit 2020-06-27T04:43:30.656654+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234291\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234390\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:31.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:31 smithi031 bash[22603]: audit 2020-06-27T04:43:30.656941+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:31.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:31 smithi031 bash[22603]: audit 2020-06-27T04:43:30.657404+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234291\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234390\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:31.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:31 smithi031 bash[22603]: audit 2020-06-27T04:43:30.659869+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234291\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:42:18.234390\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_device_update\": \"2020-06-27T04:41:13.787250\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:43:32.313 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:32 smithi051 podman[21233]: 2020-06-27 04:43:32.251719186 +0000 UTC m=+1.610433194 container remove 1c23c0f63b259522d4ae7f13adf88c7f77dda1be3635c23e5ff4cefda69e84da (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:43:32.596 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:32 smithi051 bash[21231]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4 found: no such container 2020-06-27T04:43:32.596 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:32 smithi051 bash[21231]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4 2020-06-27T04:43:32.596 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:32 smithi051 bash[21231]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4" found: no such container 2020-06-27T04:43:32.959 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:32 smithi051 bash[18409]: cluster 2020-06-27T04:43:31.116352+0000 mgr.x (mgr.34109) 55 : cluster [DBG] pgmap v54: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:32.959 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:32 smithi051 bash[18409]: audit 2020-06-27T04:43:32.277871+0000 mon.b (mon.2) 118 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_daemon_update\": \"2020-06-27T04:43:32.277090\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:32.959 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:32 smithi051 bash[18409]: audit 2020-06-27T04:43:32.278494+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_daemon_update\": \"2020-06-27T04:43:32.277090\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:32.960 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:32 smithi051 bash[18409]: audit 2020-06-27T04:43:32.283343+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_daemon_update\": \"2020-06-27T04:43:32.277090\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:43:32.960 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:32 smithi051 bash[18409]: audit 2020-06-27T04:43:32.285118+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:32.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:32 smithi031 bash[22603]: cluster 2020-06-27T04:43:31.116352+0000 mgr.x (mgr.34109) 55 : cluster [DBG] pgmap v54: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:32.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:32 smithi031 bash[22603]: audit 2020-06-27T04:43:32.277871+0000 mon.b (mon.2) 118 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_daemon_update\": \"2020-06-27T04:43:32.277090\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:32.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:32 smithi031 bash[22603]: audit 2020-06-27T04:43:32.278494+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_daemon_update\": \"2020-06-27T04:43:32.277090\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:32.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:32 smithi031 bash[22603]: audit 2020-06-27T04:43:32.283343+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_daemon_update\": \"2020-06-27T04:43:32.277090\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:43:32.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:32 smithi031 bash[22603]: audit 2020-06-27T04:43:32.285118+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:32.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:32 smithi031 bash[18426]: cluster 2020-06-27T04:43:31.116352+0000 mgr.x (mgr.34109) 55 : cluster [DBG] pgmap v54: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:32.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:32 smithi031 bash[18426]: audit 2020-06-27T04:43:32.277871+0000 mon.b (mon.2) 118 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_daemon_update\": \"2020-06-27T04:43:32.277090\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:32.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:32 smithi031 bash[18426]: audit 2020-06-27T04:43:32.278494+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_daemon_update\": \"2020-06-27T04:43:32.277090\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:32.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:32 smithi031 bash[18426]: audit 2020-06-27T04:43:32.283343+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_daemon_update\": \"2020-06-27T04:43:32.277090\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:43:32.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:32 smithi031 bash[18426]: audit 2020-06-27T04:43:32.285118+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:33.218 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:32 smithi051 podman[21567]: 2020-06-27 04:43:32.956423469 +0000 UTC m=+0.584725440 container create ada5651149315f085f4d10286adbb8fc64d0ca14a34890585b38a0c70cada94f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:43:33.554 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 podman[21567]: 2020-06-27 04:43:33.247951846 +0000 UTC m=+0.876253820 container init ada5651149315f085f4d10286adbb8fc64d0ca14a34890585b38a0c70cada94f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:43:33.554 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 podman[21567]: 2020-06-27 04:43:33.284648201 +0000 UTC m=+0.912950176 container start ada5651149315f085f4d10286adbb8fc64d0ca14a34890585b38a0c70cada94f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:43:33.554 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 podman[21567]: 2020-06-27 04:43:33.284788169 +0000 UTC m=+0.913090154 container attach ada5651149315f085f4d10286adbb8fc64d0ca14a34890585b38a0c70cada94f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:43:33.554 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 1 -- 172.21.15.51:0/3987043426 shutdown_connections 2020-06-27T04:43:33.555 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 5 -- 172.21.15.51:0/3987043426 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x558809cf5400 2020-06-27T04:43:33.555 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 1 --2- 172.21.15.51:0/3987043426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558809cf5400 0x558809c66300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-06-27T04:43:33.555 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 5 -- 172.21.15.51:0/3987043426 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x558809cf4c00 2020-06-27T04:43:33.555 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 1 --2- 172.21.15.51:0/3987043426 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x558809cf4c00 0x558809c65400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:33.556 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 5 -- 172.21.15.51:0/3987043426 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x558809cf5000 2020-06-27T04:43:33.556 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 1 --2- 172.21.15.51:0/3987043426 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x558809cf5000 0x558809c65e00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:33.556 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 5 -- 172.21.15.51:0/3987043426 shutdown_connections delete 0x558809cf4c00 2020-06-27T04:43:33.556 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 5 -- 172.21.15.51:0/3987043426 shutdown_connections delete 0x558809cf5000 2020-06-27T04:43:33.556 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 5 -- 172.21.15.51:0/3987043426 shutdown_connections delete 0x558809cf5400 2020-06-27T04:43:33.557 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 1 -- 172.21.15.51:0/3987043426 >> 172.21.15.51:0/3987043426 conn(0x558809cf4800 msgr2=0x558809d5d000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:43:33.557 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 20 --1- 172.21.15.51:0/3987043426 >> 172.21.15.51:0/3987043426 conn(0x558809cf4800 0x558809d5d000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:43:33.557 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 2 --1- 172.21.15.51:0/3987043426 >> 172.21.15.51:0/3987043426 conn(0x558809cf4800 0x558809d5d000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:43:33.557 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 5 --1- 172.21.15.51:0/3987043426 >> 172.21.15.51:0/3987043426 conn(0x558809cf4800 0x558809d5d000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:43:33.557 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 20 Event(0x558809c88e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:33.558 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 10 --1- 172.21.15.51:0/3987043426 >> 172.21.15.51:0/3987043426 conn(0x558809cf4800 0x558809d5d000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:43:33.558 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 20 Event(0x558809c88e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:33.558 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac6f550700 5 --1- 172.21.15.51:0/3987043426 >> 172.21.15.51:0/3987043426 conn(0x558809cf4800 0x558809d5d000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:43:33.558 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 20 Event(0x558809c89040 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:33.558 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac6f550700 5 --1- 172.21.15.51:0/3987043426 >> 172.21.15.51:0/3987043426 conn(0x558809cf4800 0x558809d5d000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:43:33.559 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 20 Event(0x558809c89280 nevent=5000 time_id=3).wakeup 2020-06-27T04:43:33.559 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 10 -- 172.21.15.51:0/3987043426 wait: waiting for dispatch queue 2020-06-27T04:43:33.559 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 10 -- 172.21.15.51:0/3987043426 wait: dispatch queue is stopped 2020-06-27T04:43:33.559 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 1 -- 172.21.15.51:0/3987043426 shutdown_connections 2020-06-27T04:43:33.560 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 5 -- 172.21.15.51:0/3987043426 shutdown_connections delete 0x558809cf4800 2020-06-27T04:43:33.560 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 20 Event(0x558809c88e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:33.560 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 20 Event(0x558809c89040 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:33.560 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 20 Event(0x558809c89280 nevent=5000 time_id=3).wakeup 2020-06-27T04:43:33.560 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 10 -- 172.21.15.51:0/3987043426 wait: done. 2020-06-27T04:43:33.560 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.271+0000 7fac757cdf40 1 -- 172.21.15.51:0/3987043426 wait complete. 2020-06-27T04:43:33.836 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:33 smithi051 bash[21231]: debug 2020-06-27T04:43:33.789+0000 7fac757cdf40 -1 Falling back to public interface 2020-06-27T04:43:34.155 INFO:teuthology.orchestra.run.smithi051.stderr:--> Zapping: /dev/vg_nvme/lv_3 2020-06-27T04:43:34.156 INFO:teuthology.orchestra.run.smithi051.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2020-06-27T04:43:34.156 INFO:teuthology.orchestra.run.smithi051.stderr: stderr: 10+0 records in 2020-06-27T04:43:34.156 INFO:teuthology.orchestra.run.smithi051.stderr:10+0 records out 2020-06-27T04:43:34.156 INFO:teuthology.orchestra.run.smithi051.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00947182 s, 1.1 GB/s 2020-06-27T04:43:34.156 INFO:teuthology.orchestra.run.smithi051.stderr:--> Zapping successful for: 2020-06-27T04:43:34.468 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:34 smithi051 bash[21231]: debug 2020-06-27T04:43:34.354+0000 7fac757cdf40 -1 osd.4 0 log_to_monitors {default=true} 2020-06-27T04:43:34.632 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph orch daemon add osd smithi051:vg_nvme/lv_3 2020-06-27T04:43:34.920 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:34 smithi051 bash[18409]: cluster 2020-06-27T04:43:33.116772+0000 mgr.x (mgr.34109) 56 : cluster [DBG] pgmap v55: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:34.920 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:34 smithi051 bash[18409]: audit 2020-06-27T04:43:34.357846+0000 mon.b (mon.2) 120 : audit [INF] from='osd.4 v2:172.21.15.51:6801/3547494673' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:43:34.921 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:34 smithi051 bash[18409]: audit 2020-06-27T04:43:34.358283+0000 mon.a (mon.0) 344 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:43:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:34 smithi031 bash[18426]: cluster 2020-06-27T04:43:33.116772+0000 mgr.x (mgr.34109) 56 : cluster [DBG] pgmap v55: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:34 smithi031 bash[18426]: audit 2020-06-27T04:43:34.357846+0000 mon.b (mon.2) 120 : audit [INF] from='osd.4 v2:172.21.15.51:6801/3547494673' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:43:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:34 smithi031 bash[18426]: audit 2020-06-27T04:43:34.358283+0000 mon.a (mon.0) 344 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:43:34.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:34 smithi031 bash[22603]: cluster 2020-06-27T04:43:33.116772+0000 mgr.x (mgr.34109) 56 : cluster [DBG] pgmap v55: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:34.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:34 smithi031 bash[22603]: audit 2020-06-27T04:43:34.357846+0000 mon.b (mon.2) 120 : audit [INF] from='osd.4 v2:172.21.15.51:6801/3547494673' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:43:34.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:34 smithi031 bash[22603]: audit 2020-06-27T04:43:34.358283+0000 mon.a (mon.0) 344 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:43:35.967 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:43:35 smithi051 bash[21231]: debug 2020-06-27T04:43:35.681+0000 7fac6bd49700 -1 osd.4 0 waiting for initial osdmap 2020-06-27T04:43:35.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:35 smithi051 bash[18409]: audit 2020-06-27T04:43:34.670671+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:43:35.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:35 smithi051 bash[18409]: audit 2020-06-27T04:43:34.671890+0000 mon.a (mon.0) 345 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2020-06-27T04:43:35.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:35 smithi051 bash[18409]: cluster 2020-06-27T04:43:34.671957+0000 mon.a (mon.0) 346 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2020-06-27T04:43:35.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:35 smithi051 bash[18409]: audit 2020-06-27T04:43:34.672564+0000 mon.b (mon.2) 122 : audit [INF] from='osd.4 v2:172.21.15.51:6801/3547494673' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:43:35.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:35 smithi051 bash[18409]: audit 2020-06-27T04:43:34.673398+0000 mon.a (mon.0) 347 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:43:35.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:35 smithi031 bash[18426]: audit 2020-06-27T04:43:34.670671+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:43:35.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:35 smithi031 bash[18426]: audit 2020-06-27T04:43:34.671890+0000 mon.a (mon.0) 345 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2020-06-27T04:43:35.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:35 smithi031 bash[18426]: cluster 2020-06-27T04:43:34.671957+0000 mon.a (mon.0) 346 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2020-06-27T04:43:35.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:35 smithi031 bash[18426]: audit 2020-06-27T04:43:34.672564+0000 mon.b (mon.2) 122 : audit [INF] from='osd.4 v2:172.21.15.51:6801/3547494673' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:43:35.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:35 smithi031 bash[18426]: audit 2020-06-27T04:43:34.673398+0000 mon.a (mon.0) 347 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:43:35.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:35 smithi031 bash[22603]: audit 2020-06-27T04:43:34.670671+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:43:35.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:35 smithi031 bash[22603]: audit 2020-06-27T04:43:34.671890+0000 mon.a (mon.0) 345 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2020-06-27T04:43:35.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:35 smithi031 bash[22603]: cluster 2020-06-27T04:43:34.671957+0000 mon.a (mon.0) 346 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2020-06-27T04:43:35.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:35 smithi031 bash[22603]: audit 2020-06-27T04:43:34.672564+0000 mon.b (mon.2) 122 : audit [INF] from='osd.4 v2:172.21.15.51:6801/3547494673' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:43:35.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:35 smithi031 bash[22603]: audit 2020-06-27T04:43:34.673398+0000 mon.a (mon.0) 347 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:43:36.552 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.547+0000 7f77c840b700 1 Processor -- start 2020-06-27T04:43:36.552 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.547+0000 7f77c840b700 1 -- start start 2020-06-27T04:43:36.553 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.547+0000 7f77c840b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77c00678b0 0x7f77c006c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:43:36.553 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.547+0000 7f77c840b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77c006be30 0x7f77c0078800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:43:36.553 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.547+0000 7f77c840b700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f77c006cc20 0x7f77c01250b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:43:36.553 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.547+0000 7f77c840b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c01255a0 con 0x7f77c006be30 2020-06-27T04:43:36.554 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.547+0000 7f77c840b700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c01256e0 con 0x7f77c006cc20 2020-06-27T04:43:36.554 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.547+0000 7f77c840b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c0125820 con 0x7f77c00678b0 2020-06-27T04:43:36.554 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.547+0000 7f77c71a9700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f77c006cc20 0x7f77c01250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:43:36.555 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.548+0000 7f77c61a7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77c006be30 0x7f77c0078800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:43:36.555 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.548+0000 7f77c71a9700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f77c006cc20 0x7f77c01250b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.51:3300/0 says I am v2:172.21.15.51:49944/0 (socket says 172.21.15.51:49944) 2020-06-27T04:43:36.555 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.548+0000 7f77c71a9700 1 -- 172.21.15.51:0/3141628296 learned_addr learned my addr 172.21.15.51:0/3141628296 (peer_addr_for_me v2:172.21.15.51:0/0) 2020-06-27T04:43:36.556 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.548+0000 7f77c69a8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77c00678b0 0x7f77c006c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:43:36.556 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.548+0000 7f77c71a9700 1 -- 172.21.15.51:0/3141628296 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77c00678b0 msgr2=0x7f77c006c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:43:36.556 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.548+0000 7f77c71a9700 1 --2- 172.21.15.51:0/3141628296 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77c00678b0 0x7f77c006c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:36.556 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.548+0000 7f77c71a9700 1 -- 172.21.15.51:0/3141628296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77c006be30 msgr2=0x7f77c0078800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:43:36.556 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.548+0000 7f77c71a9700 1 --2- 172.21.15.51:0/3141628296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77c006be30 0x7f77c0078800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:36.557 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.548+0000 7f77c71a9700 1 -- 172.21.15.51:0/3141628296 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c01259b0 con 0x7f77c006cc20 2020-06-27T04:43:36.557 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.548+0000 7f77c71a9700 1 --2- 172.21.15.51:0/3141628296 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f77c006cc20 0x7f77c01250b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f77b000a000 tx=0x7f77b0009d00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:43:36.557 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.548+0000 7f77beffd700 1 -- 172.21.15.51:0/3141628296 <== mon.2 v2:172.21.15.51:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77b0004e80 con 0x7f77c006cc20 2020-06-27T04:43:36.557 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.548+0000 7f77beffd700 1 -- 172.21.15.51:0/3141628296 <== mon.2 v2:172.21.15.51:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f77b000f040 con 0x7f77c006cc20 2020-06-27T04:43:36.558 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.548+0000 7f77beffd700 1 -- 172.21.15.51:0/3141628296 <== mon.2 v2:172.21.15.51:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77b0013930 con 0x7f77c006cc20 2020-06-27T04:43:36.558 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.548+0000 7f77c840b700 1 -- 172.21.15.51:0/3141628296 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c0125c60 con 0x7f77c006cc20 2020-06-27T04:43:36.558 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.548+0000 7f77c840b700 1 -- 172.21.15.51:0/3141628296 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c0126180 con 0x7f77c006cc20 2020-06-27T04:43:36.558 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.549+0000 7f77beffd700 1 -- 172.21.15.51:0/3141628296 <== mon.2 v2:172.21.15.51:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f77b0019020 con 0x7f77c006cc20 2020-06-27T04:43:36.558 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.549+0000 7f77beffd700 1 --2- 172.21.15.51:0/3141628296 >> v2:172.21.15.51:6800/950992045 conn(0x7f77a402ab50 0x7f77a402d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:43:36.559 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.549+0000 7f77beffd700 1 -- 172.21.15.51:0/3141628296 <== mon.2 v2:172.21.15.51:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3280+0+0 (secure 0 0 0) 0x7f77b0039320 con 0x7f77c006cc20 2020-06-27T04:43:36.559 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.549+0000 7f77c840b700 1 -- 172.21.15.51:0/3141628296 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c005e210 con 0x7f77c006cc20 2020-06-27T04:43:36.560 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.549+0000 7f77c69a8700 1 --2- 172.21.15.51:0/3141628296 >> v2:172.21.15.51:6800/950992045 conn(0x7f77a402ab50 0x7f77a402d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:43:36.560 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.549+0000 7f77c69a8700 1 --2- 172.21.15.51:0/3141628296 >> v2:172.21.15.51:6800/950992045 conn(0x7f77a402ab50 0x7f77a402d010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f77b800d000 tx=0x7f77b8004be0).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:43:36.561 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.553+0000 7f77beffd700 1 -- 172.21.15.51:0/3141628296 <== mon.2 v2:172.21.15.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f77b00114d0 con 0x7f77c006cc20 2020-06-27T04:43:36.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:36 smithi051 bash[18409]: cluster 2020-06-27T04:43:35.117085+0000 mgr.x (mgr.34109) 57 : cluster [DBG] pgmap v57: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:36.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:36 smithi051 bash[18409]: cluster 2020-06-27T04:43:35.378109+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:43:36.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:36 smithi051 bash[18409]: cluster 2020-06-27T04:43:35.378366+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:43:36.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:36 smithi051 bash[18409]: audit 2020-06-27T04:43:35.671722+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:43:36.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:36 smithi051 bash[18409]: audit 2020-06-27T04:43:35.675780+0000 mon.a (mon.0) 348 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]': finished 2020-06-27T04:43:36.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:36 smithi051 bash[18409]: cluster 2020-06-27T04:43:35.675842+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2020-06-27T04:43:36.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:36 smithi051 bash[18409]: audit 2020-06-27T04:43:35.678547+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:43:36.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:36 smithi051 bash[18409]: audit 2020-06-27T04:43:36.196287+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:36.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:36 smithi051 bash[18409]: audit 2020-06-27T04:43:36.447435+0000 mon.b (mon.2) 126 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_daemon_update\": \"2020-06-27T04:43:32.277090\", \"last_device_update\": \"2020-06-27T04:43:36.446756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:36.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:36 smithi051 bash[18409]: audit 2020-06-27T04:43:36.447970+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_daemon_update\": \"2020-06-27T04:43:32.277090\", \"last_device_update\": \"2020-06-27T04:43:36.446756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:36.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:36 smithi051 bash[18409]: audit 2020-06-27T04:43:36.450791+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_daemon_update\": \"2020-06-27T04:43:32.277090\", \"last_device_update\": \"2020-06-27T04:43:36.446756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:43:36.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:36 smithi051 bash[18409]: audit 2020-06-27T04:43:36.678624+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:43:36.739 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:36.736+0000 7f77c840b700 1 -- 172.21.15.51:0/3141628296 --> v2:172.21.15.51:6800/950992045 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi051:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f77c005f390 con 0x7f77a402ab50 2020-06-27T04:43:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[18426]: cluster 2020-06-27T04:43:35.117085+0000 mgr.x (mgr.34109) 57 : cluster [DBG] pgmap v57: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:36.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[18426]: cluster 2020-06-27T04:43:35.378109+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:43:36.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[18426]: cluster 2020-06-27T04:43:35.378366+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:43:36.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[18426]: audit 2020-06-27T04:43:35.671722+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:43:36.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[18426]: audit 2020-06-27T04:43:35.675780+0000 mon.a (mon.0) 348 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]': finished 2020-06-27T04:43:36.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[18426]: cluster 2020-06-27T04:43:35.675842+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2020-06-27T04:43:36.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[18426]: audit 2020-06-27T04:43:35.678547+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:43:36.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[18426]: audit 2020-06-27T04:43:36.196287+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:36.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[18426]: audit 2020-06-27T04:43:36.447435+0000 mon.b (mon.2) 126 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_daemon_update\": \"2020-06-27T04:43:32.277090\", \"last_device_update\": \"2020-06-27T04:43:36.446756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:36.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[18426]: audit 2020-06-27T04:43:36.447970+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_daemon_update\": \"2020-06-27T04:43:32.277090\", \"last_device_update\": \"2020-06-27T04:43:36.446756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:36.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[18426]: audit 2020-06-27T04:43:36.450791+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_daemon_update\": \"2020-06-27T04:43:32.277090\", \"last_device_update\": \"2020-06-27T04:43:36.446756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:43:36.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[18426]: audit 2020-06-27T04:43:36.678624+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:43:36.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[22603]: cluster 2020-06-27T04:43:35.117085+0000 mgr.x (mgr.34109) 57 : cluster [DBG] pgmap v57: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:36.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[22603]: cluster 2020-06-27T04:43:35.378109+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:43:36.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[22603]: cluster 2020-06-27T04:43:35.378366+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:43:36.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[22603]: audit 2020-06-27T04:43:35.671722+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:43:36.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[22603]: audit 2020-06-27T04:43:35.675780+0000 mon.a (mon.0) 348 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]': finished 2020-06-27T04:43:36.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[22603]: cluster 2020-06-27T04:43:35.675842+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2020-06-27T04:43:36.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[22603]: audit 2020-06-27T04:43:35.678547+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:43:36.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[22603]: audit 2020-06-27T04:43:36.196287+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:36.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[22603]: audit 2020-06-27T04:43:36.447435+0000 mon.b (mon.2) 126 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_daemon_update\": \"2020-06-27T04:43:32.277090\", \"last_device_update\": \"2020-06-27T04:43:36.446756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:36.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[22603]: audit 2020-06-27T04:43:36.447970+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_daemon_update\": \"2020-06-27T04:43:32.277090\", \"last_device_update\": \"2020-06-27T04:43:36.446756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:36.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[22603]: audit 2020-06-27T04:43:36.450791+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}}, \"last_daemon_update\": \"2020-06-27T04:43:32.277090\", \"last_device_update\": \"2020-06-27T04:43:36.446756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:43:36.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:36 smithi031 bash[22603]: audit 2020-06-27T04:43:36.678624+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:43:37.965 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:37 smithi051 bash[18409]: cluster 2020-06-27T04:43:36.684497+0000 mon.a (mon.0) 352 : cluster [INF] osd.4 v2:172.21.15.51:6801/3547494673 boot 2020-06-27T04:43:37.965 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:37 smithi051 bash[18409]: cluster 2020-06-27T04:43:36.684559+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2020-06-27T04:43:37.966 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:37 smithi051 bash[18409]: audit 2020-06-27T04:43:36.684656+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:43:37.966 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:37 smithi051 bash[18409]: audit 2020-06-27T04:43:36.737544+0000 mgr.x (mgr.34109) 58 : audit [DBG] from='client.34253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi051:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:43:37.966 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:37 smithi051 bash[18409]: audit 2020-06-27T04:43:36.738261+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:43:37.966 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:37 smithi051 bash[18409]: cephadm 2020-06-27T04:43:36.738773+0000 mgr.x (mgr.34109) 59 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:43:37.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:37 smithi051 bash[18409]: cephadm 2020-06-27T04:43:36.738828+0000 mgr.x (mgr.34109) 60 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:43:37.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:37 smithi051 bash[18409]: cephadm 2020-06-27T04:43:36.739002+0000 mgr.x (mgr.34109) 61 : cephadm [INF] Applying None on host smithi051... 2020-06-27T04:43:37.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:37 smithi051 bash[18409]: audit 2020-06-27T04:43:36.739254+0000 mon.b (mon.2) 130 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:43:37.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:37 smithi051 bash[18409]: audit 2020-06-27T04:43:36.739729+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:37.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:37 smithi051 bash[18409]: audit 2020-06-27T04:43:36.740275+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:37.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[18426]: cluster 2020-06-27T04:43:36.684497+0000 mon.a (mon.0) 352 : cluster [INF] osd.4 v2:172.21.15.51:6801/3547494673 boot 2020-06-27T04:43:37.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[18426]: cluster 2020-06-27T04:43:36.684559+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2020-06-27T04:43:37.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[18426]: audit 2020-06-27T04:43:36.684656+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:43:37.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[18426]: audit 2020-06-27T04:43:36.737544+0000 mgr.x (mgr.34109) 58 : audit [DBG] from='client.34253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi051:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:43:37.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[18426]: audit 2020-06-27T04:43:36.738261+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:43:37.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[18426]: cephadm 2020-06-27T04:43:36.738773+0000 mgr.x (mgr.34109) 59 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:43:37.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[18426]: cephadm 2020-06-27T04:43:36.738828+0000 mgr.x (mgr.34109) 60 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:43:37.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[18426]: cephadm 2020-06-27T04:43:36.739002+0000 mgr.x (mgr.34109) 61 : cephadm [INF] Applying None on host smithi051... 2020-06-27T04:43:37.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[18426]: audit 2020-06-27T04:43:36.739254+0000 mon.b (mon.2) 130 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:43:37.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[18426]: audit 2020-06-27T04:43:36.739729+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:37.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[18426]: audit 2020-06-27T04:43:36.740275+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:37.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[22603]: cluster 2020-06-27T04:43:36.684497+0000 mon.a (mon.0) 352 : cluster [INF] osd.4 v2:172.21.15.51:6801/3547494673 boot 2020-06-27T04:43:37.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[22603]: cluster 2020-06-27T04:43:36.684559+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2020-06-27T04:43:37.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[22603]: audit 2020-06-27T04:43:36.684656+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:43:37.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[22603]: audit 2020-06-27T04:43:36.737544+0000 mgr.x (mgr.34109) 58 : audit [DBG] from='client.34253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi051:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:43:37.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[22603]: audit 2020-06-27T04:43:36.738261+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:43:37.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[22603]: cephadm 2020-06-27T04:43:36.738773+0000 mgr.x (mgr.34109) 59 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:43:37.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[22603]: cephadm 2020-06-27T04:43:36.738828+0000 mgr.x (mgr.34109) 60 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:43:37.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[22603]: cephadm 2020-06-27T04:43:36.739002+0000 mgr.x (mgr.34109) 61 : cephadm [INF] Applying None on host smithi051... 2020-06-27T04:43:37.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[22603]: audit 2020-06-27T04:43:36.739254+0000 mon.b (mon.2) 130 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:43:37.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[22603]: audit 2020-06-27T04:43:36.739729+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:37.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:37 smithi031 bash[22603]: audit 2020-06-27T04:43:36.740275+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:38.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:38 smithi051 bash[18409]: cluster 2020-06-27T04:43:37.117556+0000 mgr.x (mgr.34109) 62 : cluster [DBG] pgmap v60: 1 pgs: 1 peering; 0 B data, 1008 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:38.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:38 smithi051 bash[18409]: cluster 2020-06-27T04:43:37.698257+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2020-06-27T04:43:38.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:38 smithi031 bash[18426]: cluster 2020-06-27T04:43:37.117556+0000 mgr.x (mgr.34109) 62 : cluster [DBG] pgmap v60: 1 pgs: 1 peering; 0 B data, 1008 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:38 smithi031 bash[18426]: cluster 2020-06-27T04:43:37.698257+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2020-06-27T04:43:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:38 smithi031 bash[22603]: cluster 2020-06-27T04:43:37.117556+0000 mgr.x (mgr.34109) 62 : cluster [DBG] pgmap v60: 1 pgs: 1 peering; 0 B data, 1008 KiB used, 354 GiB / 358 GiB avail 2020-06-27T04:43:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:38 smithi031 bash[22603]: cluster 2020-06-27T04:43:37.698257+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2020-06-27T04:43:39.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:39 smithi051 bash[18409]: audit 2020-06-27T04:43:38.853328+0000 mon.b (mon.2) 133 : audit [INF] from='client.? 172.21.15.51:0/322784472' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1dca5a6a-245c-4161-9042-713f7c0bbfe4"}]: dispatch 2020-06-27T04:43:39.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:39 smithi051 bash[18409]: audit 2020-06-27T04:43:38.853852+0000 mon.a (mon.0) 355 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1dca5a6a-245c-4161-9042-713f7c0bbfe4"}]: dispatch 2020-06-27T04:43:39.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:39 smithi051 bash[18409]: audit 2020-06-27T04:43:38.857843+0000 mon.a (mon.0) 356 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1dca5a6a-245c-4161-9042-713f7c0bbfe4"}]': finished 2020-06-27T04:43:39.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:39 smithi051 bash[18409]: cluster 2020-06-27T04:43:38.857911+0000 mon.a (mon.0) 357 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2020-06-27T04:43:39.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:39 smithi051 bash[18409]: audit 2020-06-27T04:43:38.863146+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:43:39.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:39 smithi051 bash[18409]: audit 2020-06-27T04:43:39.341871+0000 mon.b (mon.2) 135 : audit [DBG] from='client.? 172.21.15.51:0/3988481407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:43:39.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:39 smithi031 bash[18426]: audit 2020-06-27T04:43:38.853328+0000 mon.b (mon.2) 133 : audit [INF] from='client.? 172.21.15.51:0/322784472' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1dca5a6a-245c-4161-9042-713f7c0bbfe4"}]: dispatch 2020-06-27T04:43:39.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:39 smithi031 bash[18426]: audit 2020-06-27T04:43:38.853852+0000 mon.a (mon.0) 355 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1dca5a6a-245c-4161-9042-713f7c0bbfe4"}]: dispatch 2020-06-27T04:43:39.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:39 smithi031 bash[18426]: audit 2020-06-27T04:43:38.857843+0000 mon.a (mon.0) 356 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1dca5a6a-245c-4161-9042-713f7c0bbfe4"}]': finished 2020-06-27T04:43:39.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:39 smithi031 bash[18426]: cluster 2020-06-27T04:43:38.857911+0000 mon.a (mon.0) 357 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2020-06-27T04:43:39.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:39 smithi031 bash[18426]: audit 2020-06-27T04:43:38.863146+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:43:39.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:39 smithi031 bash[18426]: audit 2020-06-27T04:43:39.341871+0000 mon.b (mon.2) 135 : audit [DBG] from='client.? 172.21.15.51:0/3988481407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:43:39.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:39 smithi031 bash[22603]: audit 2020-06-27T04:43:38.853328+0000 mon.b (mon.2) 133 : audit [INF] from='client.? 172.21.15.51:0/322784472' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1dca5a6a-245c-4161-9042-713f7c0bbfe4"}]: dispatch 2020-06-27T04:43:39.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:39 smithi031 bash[22603]: audit 2020-06-27T04:43:38.853852+0000 mon.a (mon.0) 355 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1dca5a6a-245c-4161-9042-713f7c0bbfe4"}]: dispatch 2020-06-27T04:43:39.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:39 smithi031 bash[22603]: audit 2020-06-27T04:43:38.857843+0000 mon.a (mon.0) 356 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1dca5a6a-245c-4161-9042-713f7c0bbfe4"}]': finished 2020-06-27T04:43:39.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:39 smithi031 bash[22603]: cluster 2020-06-27T04:43:38.857911+0000 mon.a (mon.0) 357 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2020-06-27T04:43:39.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:39 smithi031 bash[22603]: audit 2020-06-27T04:43:38.863146+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:43:39.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:39 smithi031 bash[22603]: audit 2020-06-27T04:43:39.341871+0000 mon.b (mon.2) 135 : audit [DBG] from='client.? 172.21.15.51:0/3988481407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:43:40.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:40 smithi051 bash[18409]: cluster 2020-06-27T04:43:39.117865+0000 mgr.x (mgr.34109) 63 : cluster [DBG] pgmap v63: 1 pgs: 1 peering; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail 2020-06-27T04:43:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:40 smithi031 bash[18426]: cluster 2020-06-27T04:43:39.117865+0000 mgr.x (mgr.34109) 63 : cluster [DBG] pgmap v63: 1 pgs: 1 peering; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail 2020-06-27T04:43:40.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:40 smithi031 bash[22603]: cluster 2020-06-27T04:43:39.117865+0000 mgr.x (mgr.34109) 63 : cluster [DBG] pgmap v63: 1 pgs: 1 peering; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail 2020-06-27T04:43:42.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:42 smithi051 bash[18409]: cluster 2020-06-27T04:43:41.118378+0000 mgr.x (mgr.34109) 64 : cluster [DBG] pgmap v64: 1 pgs: 1 peering; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail 2020-06-27T04:43:42.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:42 smithi051 bash[18409]: audit 2020-06-27T04:43:41.788468+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:42.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:42 smithi031 bash[18426]: cluster 2020-06-27T04:43:41.118378+0000 mgr.x (mgr.34109) 64 : cluster [DBG] pgmap v64: 1 pgs: 1 peering; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail 2020-06-27T04:43:42.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:42 smithi031 bash[18426]: audit 2020-06-27T04:43:41.788468+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:42.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:42 smithi031 bash[22603]: cluster 2020-06-27T04:43:41.118378+0000 mgr.x (mgr.34109) 64 : cluster [DBG] pgmap v64: 1 pgs: 1 peering; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail 2020-06-27T04:43:42.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:42 smithi031 bash[22603]: audit 2020-06-27T04:43:41.788468+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:44.935 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:44 smithi051 bash[18409]: cluster 2020-06-27T04:43:43.118834+0000 mgr.x (mgr.34109) 65 : cluster [DBG] pgmap v65: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:44.935 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:44 smithi051 bash[18409]: audit 2020-06-27T04:43:44.178489+0000 mon.b (mon.2) 137 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2020-06-27T04:43:44.936 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:44 smithi051 bash[18409]: audit 2020-06-27T04:43:44.179084+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:44.936 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:44 smithi051 bash[18409]: audit 2020-06-27T04:43:44.179755+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2020-06-27T04:43:44.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:44 smithi031 bash[18426]: cluster 2020-06-27T04:43:43.118834+0000 mgr.x (mgr.34109) 65 : cluster [DBG] pgmap v65: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:44 smithi031 bash[18426]: audit 2020-06-27T04:43:44.178489+0000 mon.b (mon.2) 137 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2020-06-27T04:43:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:44 smithi031 bash[18426]: audit 2020-06-27T04:43:44.179084+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:44 smithi031 bash[18426]: audit 2020-06-27T04:43:44.179755+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2020-06-27T04:43:44.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:44 smithi031 bash[22603]: cluster 2020-06-27T04:43:43.118834+0000 mgr.x (mgr.34109) 65 : cluster [DBG] pgmap v65: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:44.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:44 smithi031 bash[22603]: audit 2020-06-27T04:43:44.178489+0000 mon.b (mon.2) 137 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2020-06-27T04:43:44.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:44 smithi031 bash[22603]: audit 2020-06-27T04:43:44.179084+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:44.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:44 smithi031 bash[22603]: audit 2020-06-27T04:43:44.179755+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2020-06-27T04:43:45.709 INFO:teuthology.orchestra.run.smithi051.stdout:Created osd(s) 5 on host 'smithi051' 2020-06-27T04:43:45.710 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:45.706+0000 7f77beffd700 1 -- 172.21.15.51:0/3141628296 <== mgr.34109 v2:172.21.15.51:6800/950992045 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f77b8011470 con 0x7f77a402ab50 2020-06-27T04:43:45.711 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:45.708+0000 7f77c840b700 1 -- 172.21.15.51:0/3141628296 >> v2:172.21.15.51:6800/950992045 conn(0x7f77a402ab50 msgr2=0x7f77a402d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:43:45.711 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:45.708+0000 7f77c840b700 1 --2- 172.21.15.51:0/3141628296 >> v2:172.21.15.51:6800/950992045 conn(0x7f77a402ab50 0x7f77a402d010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f77b800d000 tx=0x7f77b8004be0).stop 2020-06-27T04:43:45.711 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:45.709+0000 7f77c840b700 1 -- 172.21.15.51:0/3141628296 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f77c006cc20 msgr2=0x7f77c01250b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:43:45.711 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:45.709+0000 7f77c840b700 1 --2- 172.21.15.51:0/3141628296 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f77c006cc20 0x7f77c01250b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f77b000a000 tx=0x7f77b0009d00).stop 2020-06-27T04:43:45.712 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:45.710+0000 7f77c840b700 1 -- 172.21.15.51:0/3141628296 shutdown_connections 2020-06-27T04:43:45.712 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:45.710+0000 7f77c840b700 1 --2- 172.21.15.51:0/3141628296 >> v2:172.21.15.51:6800/950992045 conn(0x7f77a402ab50 0x7f77a402d010 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:45.712 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:45.710+0000 7f77c840b700 1 --2- 172.21.15.51:0/3141628296 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f77c006cc20 0x7f77c01250b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:45.713 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:45.710+0000 7f77c840b700 1 --2- 172.21.15.51:0/3141628296 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77c00678b0 0x7f77c006c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:45.713 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:45.710+0000 7f77c840b700 1 --2- 172.21.15.51:0/3141628296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77c006be30 0x7f77c0078800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:45.713 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:45.710+0000 7f77c840b700 1 -- 172.21.15.51:0/3141628296 >> 172.21.15.51:0/3141628296 conn(0x7f77c0061830 msgr2=0x7f77c0063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:43:45.713 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:45.710+0000 7f77c840b700 1 -- 172.21.15.51:0/3141628296 shutdown_connections 2020-06-27T04:43:45.713 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:45.710+0000 7f77c840b700 1 -- 172.21.15.51:0/3141628296 wait complete. 2020-06-27T04:43:45.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:45 smithi051 bash[18409]: cephadm 2020-06-27T04:43:44.179542+0000 mgr.x (mgr.34109) 66 : cephadm [INF] Deploying daemon osd.5 on smithi051 2020-06-27T04:43:45.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:45 smithi051 bash[18409]: audit 2020-06-27T04:43:45.701917+0000 mon.b (mon.2) 140 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_device_update\": \"2020-06-27T04:43:36.446756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:45.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:45 smithi051 bash[18409]: audit 2020-06-27T04:43:45.702239+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:45.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:45 smithi051 bash[18409]: audit 2020-06-27T04:43:45.702494+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_device_update\": \"2020-06-27T04:43:36.446756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:45.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:45 smithi051 bash[18409]: audit 2020-06-27T04:43:45.705387+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_device_update\": \"2020-06-27T04:43:36.446756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:43:45.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:45 smithi031 bash[18426]: cephadm 2020-06-27T04:43:44.179542+0000 mgr.x (mgr.34109) 66 : cephadm [INF] Deploying daemon osd.5 on smithi051 2020-06-27T04:43:45.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:45 smithi031 bash[18426]: audit 2020-06-27T04:43:45.701917+0000 mon.b (mon.2) 140 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_device_update\": \"2020-06-27T04:43:36.446756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:45.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:45 smithi031 bash[18426]: audit 2020-06-27T04:43:45.702239+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:45.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:45 smithi031 bash[18426]: audit 2020-06-27T04:43:45.702494+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_device_update\": \"2020-06-27T04:43:36.446756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:45.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:45 smithi031 bash[18426]: audit 2020-06-27T04:43:45.705387+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_device_update\": \"2020-06-27T04:43:36.446756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:43:45.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:45 smithi031 bash[22603]: cephadm 2020-06-27T04:43:44.179542+0000 mgr.x (mgr.34109) 66 : cephadm [INF] Deploying daemon osd.5 on smithi051 2020-06-27T04:43:45.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:45 smithi031 bash[22603]: audit 2020-06-27T04:43:45.701917+0000 mon.b (mon.2) 140 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_device_update\": \"2020-06-27T04:43:36.446756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:45.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:45 smithi031 bash[22603]: audit 2020-06-27T04:43:45.702239+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:45.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:45 smithi031 bash[22603]: audit 2020-06-27T04:43:45.702494+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_device_update\": \"2020-06-27T04:43:36.446756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:45.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:45 smithi031 bash[22603]: audit 2020-06-27T04:43:45.705387+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276628\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276757\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:32.276832\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_device_update\": \"2020-06-27T04:43:36.446756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:43:46.336 INFO:teuthology.orchestra.run.smithi051:osd.5> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service 2020-06-27T04:43:46.339 INFO:tasks.cephadm:Deploying osd.6 on smithi051 with /dev/vg_nvme/lv_2... 2020-06-27T04:43:46.339 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2020-06-27T04:43:46.373 INFO:ceph.osd.5.smithi051.stdout:-- Logs begin at Sat 2020-06-27 04:33:02 UTC. -- 2020-06-27T04:43:46.673 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:46 smithi051 bash[23354]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-06-27T04:43:46.674 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:46 smithi051 bash[23354]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2020-06-27T04:43:46.674 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:46 smithi051 bash[23354]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2020-06-27T04:43:46.674 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:46 smithi051 bash[23354]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2020-06-27T04:43:46.674 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:46 smithi051 bash[23354]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2020-06-27T04:43:46.674 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:46 smithi051 bash[23354]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-06-27T04:43:46.675 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:46 smithi051 bash[23354]: --> ceph-volume lvm activate successful for osd ID: 5 2020-06-27T04:43:46.675 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:46 smithi051 podman[23356]: 2020-06-27 04:43:46.670609938 +0000 UTC m=+0.985773026 container died 8616f65fb3fb6b3a3d742f8942a7650fbb13bd8b1050a4542eef776e891cdef3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:43:46.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:46 smithi051 bash[18409]: cluster 2020-06-27T04:43:45.119287+0000 mgr.x (mgr.34109) 67 : cluster [DBG] pgmap v66: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:46 smithi031 bash[18426]: cluster 2020-06-27T04:43:45.119287+0000 mgr.x (mgr.34109) 67 : cluster [DBG] pgmap v66: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:46.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:46 smithi031 bash[22603]: cluster 2020-06-27T04:43:45.119287+0000 mgr.x (mgr.34109) 67 : cluster [DBG] pgmap v66: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:47.399 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:47 smithi051 podman[23356]: 2020-06-27 04:43:47.252127125 +0000 UTC m=+1.567290218 container remove 8616f65fb3fb6b3a3d742f8942a7650fbb13bd8b1050a4542eef776e891cdef3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:43:47.399 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:47 smithi051 bash[23354]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5 found: no such container 2020-06-27T04:43:47.399 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:47 smithi051 bash[23354]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5 2020-06-27T04:43:47.399 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:47 smithi051 bash[23354]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5" found: no such container 2020-06-27T04:43:47.968 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:47 smithi051 podman[23699]: 2020-06-27 04:43:47.666625924 +0000 UTC m=+0.255406132 container create da4eb380a0b707d99955a8258c8cb527303ef48eae5cf3c5f771aa06c67c7230 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:43:47.968 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:47 smithi051 podman[23699]: 2020-06-27 04:43:47.965665485 +0000 UTC m=+0.554445869 container init da4eb380a0b707d99955a8258c8cb527303ef48eae5cf3c5f771aa06c67c7230 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:43:48.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[18409]: cluster 2020-06-27T04:43:47.119639+0000 mgr.x (mgr.34109) 68 : cluster [DBG] pgmap v67: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:48.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[18409]: audit 2020-06-27T04:43:47.262953+0000 mon.b (mon.2) 142 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:43:48.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[18409]: audit 2020-06-27T04:43:47.263579+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:43:48.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[18409]: audit 2020-06-27T04:43:47.274549+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-06-27T04:43:48.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[18409]: audit 2020-06-27T04:43:47.424832+0000 mon.b (mon.2) 143 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_daemon_update\": \"2020-06-27T04:43:47.424267\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:48.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[18409]: audit 2020-06-27T04:43:47.425622+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_daemon_update\": \"2020-06-27T04:43:47.424267\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:48.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[18409]: audit 2020-06-27T04:43:47.428051+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_daemon_update\": \"2020-06-27T04:43:47.424267\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:43:48.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[18409]: audit 2020-06-27T04:43:47.429410+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:48.221 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 podman[23699]: 2020-06-27 04:43:48.165495406 +0000 UTC m=+0.754275611 container start da4eb380a0b707d99955a8258c8cb527303ef48eae5cf3c5f771aa06c67c7230 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:43:48.221 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 podman[23699]: 2020-06-27 04:43:48.165560462 +0000 UTC m=+0.754340670 container attach da4eb380a0b707d99955a8258c8cb527303ef48eae5cf3c5f771aa06c67c7230 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:43:48.221 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 10 -- 172.21.15.51:0/2407903671 shutdown 172.21.15.51:0/2407903671 2020-06-27T04:43:48.221 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 10 Processor -- stop 2020-06-27T04:43:48.221 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 20 Event(0x5611c34d6e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:48.222 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 1 -- 172.21.15.51:0/2407903671 shutdown_connections 2020-06-27T04:43:48.222 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 5 -- 172.21.15.51:0/2407903671 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x5611c3543400 2020-06-27T04:43:48.222 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 1 --2- 172.21.15.51:0/2407903671 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5611c3543400 0x5611c34b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:48.222 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 5 -- 172.21.15.51:0/2407903671 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x5611c3542c00 2020-06-27T04:43:48.222 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 1 --2- 172.21.15.51:0/2407903671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611c3542c00 0x5611c34b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:48.223 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 5 -- 172.21.15.51:0/2407903671 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x5611c3543000 2020-06-27T04:43:48.223 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 1 --2- 172.21.15.51:0/2407903671 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x5611c3543000 0x5611c34b3e00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:48.223 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 5 -- 172.21.15.51:0/2407903671 shutdown_connections delete 0x5611c3542c00 2020-06-27T04:43:48.223 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 5 -- 172.21.15.51:0/2407903671 shutdown_connections delete 0x5611c3543000 2020-06-27T04:43:48.223 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 5 -- 172.21.15.51:0/2407903671 shutdown_connections delete 0x5611c3543400 2020-06-27T04:43:48.224 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 1 -- 172.21.15.51:0/2407903671 >> 172.21.15.51:0/2407903671 conn(0x5611c3542800 msgr2=0x5611c35ab000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:43:48.224 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 20 --1- 172.21.15.51:0/2407903671 >> 172.21.15.51:0/2407903671 conn(0x5611c3542800 0x5611c35ab000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:43:48.224 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 2 --1- 172.21.15.51:0/2407903671 >> 172.21.15.51:0/2407903671 conn(0x5611c3542800 0x5611c35ab000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:43:48.224 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 5 --1- 172.21.15.51:0/2407903671 >> 172.21.15.51:0/2407903671 conn(0x5611c3542800 0x5611c35ab000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:43:48.224 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 20 Event(0x5611c34d6e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:48.224 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 10 --1- 172.21.15.51:0/2407903671 >> 172.21.15.51:0/2407903671 conn(0x5611c3542800 0x5611c35ab000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:43:48.226 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 20 Event(0x5611c34d6e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:48.226 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f539ffa2700 5 --1- 172.21.15.51:0/2407903671 >> 172.21.15.51:0/2407903671 conn(0x5611c3542800 0x5611c35ab000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:43:48.226 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 20 Event(0x5611c34d7040 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:48.227 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f539ffa2700 5 --1- 172.21.15.51:0/2407903671 >> 172.21.15.51:0/2407903671 conn(0x5611c3542800 0x5611c35ab000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:43:48.227 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 20 Event(0x5611c34d7280 nevent=5000 time_id=3).wakeup 2020-06-27T04:43:48.227 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 10 -- 172.21.15.51:0/2407903671 wait: waiting for dispatch queue 2020-06-27T04:43:48.227 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 10 -- 172.21.15.51:0/2407903671 wait: dispatch queue is stopped 2020-06-27T04:43:48.227 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 1 -- 172.21.15.51:0/2407903671 shutdown_connections 2020-06-27T04:43:48.228 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 5 -- 172.21.15.51:0/2407903671 shutdown_connections delete 0x5611c3542800 2020-06-27T04:43:48.228 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 20 Event(0x5611c34d6e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:48.228 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 20 Event(0x5611c34d7040 nevent=5000 time_id=2).wakeup 2020-06-27T04:43:48.228 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 20 Event(0x5611c34d7280 nevent=5000 time_id=3).wakeup 2020-06-27T04:43:48.228 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 10 -- 172.21.15.51:0/2407903671 wait: done. 2020-06-27T04:43:48.229 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:47.991+0000 7f53a621ff40 1 -- 172.21.15.51:0/2407903671 wait complete. 2020-06-27T04:43:48.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:48 smithi031 bash[22603]: cluster 2020-06-27T04:43:47.119639+0000 mgr.x (mgr.34109) 68 : cluster [DBG] pgmap v67: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:48.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:48 smithi031 bash[22603]: audit 2020-06-27T04:43:47.262953+0000 mon.b (mon.2) 142 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:43:48.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:48 smithi031 bash[22603]: audit 2020-06-27T04:43:47.263579+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:43:48.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:48 smithi031 bash[22603]: audit 2020-06-27T04:43:47.274549+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-06-27T04:43:48.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:48 smithi031 bash[22603]: audit 2020-06-27T04:43:47.424832+0000 mon.b (mon.2) 143 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_daemon_update\": \"2020-06-27T04:43:47.424267\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:48.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:48 smithi031 bash[22603]: audit 2020-06-27T04:43:47.425622+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_daemon_update\": \"2020-06-27T04:43:47.424267\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:48.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:48 smithi031 bash[22603]: audit 2020-06-27T04:43:47.428051+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_daemon_update\": \"2020-06-27T04:43:47.424267\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:43:48.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:48 smithi031 bash[22603]: audit 2020-06-27T04:43:47.429410+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:48.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:48 smithi031 bash[18426]: cluster 2020-06-27T04:43:47.119639+0000 mgr.x (mgr.34109) 68 : cluster [DBG] pgmap v67: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:48.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:48 smithi031 bash[18426]: audit 2020-06-27T04:43:47.262953+0000 mon.b (mon.2) 142 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:43:48.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:48 smithi031 bash[18426]: audit 2020-06-27T04:43:47.263579+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:43:48.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:48 smithi031 bash[18426]: audit 2020-06-27T04:43:47.274549+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-06-27T04:43:48.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:48 smithi031 bash[18426]: audit 2020-06-27T04:43:47.424832+0000 mon.b (mon.2) 143 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_daemon_update\": \"2020-06-27T04:43:47.424267\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:48.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:48 smithi031 bash[18426]: audit 2020-06-27T04:43:47.425622+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_daemon_update\": \"2020-06-27T04:43:47.424267\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:48.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:48 smithi031 bash[18426]: audit 2020-06-27T04:43:47.428051+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_daemon_update\": \"2020-06-27T04:43:47.424267\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:43:48.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:48 smithi031 bash[18426]: audit 2020-06-27T04:43:47.429410+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:48.533 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:48.258+0000 7f53a621ff40 -1 Falling back to public interface 2020-06-27T04:43:48.968 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:48 smithi051 bash[23354]: debug 2020-06-27T04:43:48.822+0000 7f53a621ff40 -1 osd.5 0 log_to_monitors {default=true} 2020-06-27T04:43:49.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:49 smithi051 bash[18409]: audit 2020-06-27T04:43:48.827019+0000 mon.b (mon.2) 145 : audit [INF] from='osd.5 v2:172.21.15.51:6805/1207065717' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:43:49.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:49 smithi051 bash[18409]: audit 2020-06-27T04:43:48.827598+0000 mon.a (mon.0) 364 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:43:49.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:49 smithi031 bash[22603]: audit 2020-06-27T04:43:48.827019+0000 mon.b (mon.2) 145 : audit [INF] from='osd.5 v2:172.21.15.51:6805/1207065717' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:43:49.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:49 smithi031 bash[22603]: audit 2020-06-27T04:43:48.827598+0000 mon.a (mon.0) 364 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:43:49.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:49 smithi031 bash[18426]: audit 2020-06-27T04:43:48.827019+0000 mon.b (mon.2) 145 : audit [INF] from='osd.5 v2:172.21.15.51:6805/1207065717' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:43:49.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:49 smithi031 bash[18426]: audit 2020-06-27T04:43:48.827598+0000 mon.a (mon.0) 364 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:43:49.558 INFO:teuthology.orchestra.run.smithi051.stderr:--> Zapping: /dev/vg_nvme/lv_2 2020-06-27T04:43:49.558 INFO:teuthology.orchestra.run.smithi051.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2020-06-27T04:43:49.558 INFO:teuthology.orchestra.run.smithi051.stderr: stderr: 10+0 records in 2020-06-27T04:43:49.558 INFO:teuthology.orchestra.run.smithi051.stderr:10+0 records out 2020-06-27T04:43:49.559 INFO:teuthology.orchestra.run.smithi051.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00822174 s, 1.3 GB/s 2020-06-27T04:43:49.559 INFO:teuthology.orchestra.run.smithi051.stderr:--> Zapping successful for: 2020-06-27T04:43:50.178 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph orch daemon add osd smithi051:vg_nvme/lv_2 2020-06-27T04:43:50.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:43:50 smithi051 bash[23354]: debug 2020-06-27T04:43:50.132+0000 7f539c79b700 -1 osd.5 0 waiting for initial osdmap 2020-06-27T04:43:50.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:50 smithi051 bash[18409]: cluster 2020-06-27T04:43:49.119978+0000 mgr.x (mgr.34109) 69 : cluster [DBG] pgmap v68: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:50.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:50 smithi051 bash[18409]: audit 2020-06-27T04:43:49.121909+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:43:50.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:50 smithi051 bash[18409]: audit 2020-06-27T04:43:49.122331+0000 mon.a (mon.0) 365 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2020-06-27T04:43:50.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:50 smithi051 bash[18409]: cluster 2020-06-27T04:43:49.122410+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2020-06-27T04:43:50.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:50 smithi051 bash[18409]: audit 2020-06-27T04:43:49.122971+0000 mon.b (mon.2) 147 : audit [INF] from='osd.5 v2:172.21.15.51:6805/1207065717' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:43:50.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:50 smithi051 bash[18409]: audit 2020-06-27T04:43:49.123331+0000 mon.a (mon.0) 367 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:43:50.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:50 smithi031 bash[22603]: cluster 2020-06-27T04:43:49.119978+0000 mgr.x (mgr.34109) 69 : cluster [DBG] pgmap v68: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:50.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:50 smithi031 bash[22603]: audit 2020-06-27T04:43:49.121909+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:43:50.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:50 smithi031 bash[22603]: audit 2020-06-27T04:43:49.122331+0000 mon.a (mon.0) 365 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2020-06-27T04:43:50.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:50 smithi031 bash[22603]: cluster 2020-06-27T04:43:49.122410+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2020-06-27T04:43:50.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:50 smithi031 bash[22603]: audit 2020-06-27T04:43:49.122971+0000 mon.b (mon.2) 147 : audit [INF] from='osd.5 v2:172.21.15.51:6805/1207065717' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:43:50.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:50 smithi031 bash[22603]: audit 2020-06-27T04:43:49.123331+0000 mon.a (mon.0) 367 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:43:50.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:50 smithi031 bash[18426]: cluster 2020-06-27T04:43:49.119978+0000 mgr.x (mgr.34109) 69 : cluster [DBG] pgmap v68: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:43:50.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:50 smithi031 bash[18426]: audit 2020-06-27T04:43:49.121909+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:43:50.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:50 smithi031 bash[18426]: audit 2020-06-27T04:43:49.122331+0000 mon.a (mon.0) 365 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2020-06-27T04:43:50.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:50 smithi031 bash[18426]: cluster 2020-06-27T04:43:49.122410+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2020-06-27T04:43:50.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:50 smithi031 bash[18426]: audit 2020-06-27T04:43:49.122971+0000 mon.b (mon.2) 147 : audit [INF] from='osd.5 v2:172.21.15.51:6805/1207065717' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:43:50.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:50 smithi031 bash[18426]: audit 2020-06-27T04:43:49.123331+0000 mon.a (mon.0) 367 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:43:51.137 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:51 smithi051 bash[18409]: cluster 2020-06-27T04:43:49.867327+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:43:51.137 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:51 smithi051 bash[18409]: cluster 2020-06-27T04:43:49.867405+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:43:51.137 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:51 smithi051 bash[18409]: audit 2020-06-27T04:43:50.123741+0000 mon.a (mon.0) 368 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]': finished 2020-06-27T04:43:51.138 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:51 smithi051 bash[18409]: cluster 2020-06-27T04:43:50.123810+0000 mon.a (mon.0) 369 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2020-06-27T04:43:51.138 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:51 smithi051 bash[18409]: audit 2020-06-27T04:43:50.126527+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:43:51.138 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:51 smithi051 bash[18409]: audit 2020-06-27T04:43:51.124266+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:43:51.138 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:51 smithi051 bash[18409]: cluster 2020-06-27T04:43:51.124651+0000 mon.a (mon.0) 370 : cluster [INF] osd.5 v2:172.21.15.51:6805/1207065717 boot 2020-06-27T04:43:51.138 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:51 smithi051 bash[18409]: cluster 2020-06-27T04:43:51.124720+0000 mon.a (mon.0) 371 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2020-06-27T04:43:51.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:51 smithi031 bash[22603]: cluster 2020-06-27T04:43:49.867327+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:43:51.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:51 smithi031 bash[22603]: cluster 2020-06-27T04:43:49.867405+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:43:51.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:51 smithi031 bash[22603]: audit 2020-06-27T04:43:50.123741+0000 mon.a (mon.0) 368 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]': finished 2020-06-27T04:43:51.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:51 smithi031 bash[22603]: cluster 2020-06-27T04:43:50.123810+0000 mon.a (mon.0) 369 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2020-06-27T04:43:51.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:51 smithi031 bash[22603]: audit 2020-06-27T04:43:50.126527+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:43:51.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:51 smithi031 bash[22603]: audit 2020-06-27T04:43:51.124266+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:43:51.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:51 smithi031 bash[22603]: cluster 2020-06-27T04:43:51.124651+0000 mon.a (mon.0) 370 : cluster [INF] osd.5 v2:172.21.15.51:6805/1207065717 boot 2020-06-27T04:43:51.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:51 smithi031 bash[22603]: cluster 2020-06-27T04:43:51.124720+0000 mon.a (mon.0) 371 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2020-06-27T04:43:51.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:51 smithi031 bash[18426]: cluster 2020-06-27T04:43:49.867327+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:43:51.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:51 smithi031 bash[18426]: cluster 2020-06-27T04:43:49.867405+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:43:51.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:51 smithi031 bash[18426]: audit 2020-06-27T04:43:50.123741+0000 mon.a (mon.0) 368 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]': finished 2020-06-27T04:43:51.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:51 smithi031 bash[18426]: cluster 2020-06-27T04:43:50.123810+0000 mon.a (mon.0) 369 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2020-06-27T04:43:51.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:51 smithi031 bash[18426]: audit 2020-06-27T04:43:50.126527+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:43:51.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:51 smithi031 bash[18426]: audit 2020-06-27T04:43:51.124266+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:43:51.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:51 smithi031 bash[18426]: cluster 2020-06-27T04:43:51.124651+0000 mon.a (mon.0) 370 : cluster [INF] osd.5 v2:172.21.15.51:6805/1207065717 boot 2020-06-27T04:43:51.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:51 smithi031 bash[18426]: cluster 2020-06-27T04:43:51.124720+0000 mon.a (mon.0) 371 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2020-06-27T04:43:52.160 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.156+0000 7ffb72516700 1 Processor -- start 2020-06-27T04:43:52.161 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.156+0000 7ffb72516700 1 -- start start 2020-06-27T04:43:52.161 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.156+0000 7ffb72516700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7ffb6c0678b0 0x7ffb6c06cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:43:52.161 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.156+0000 7ffb72516700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb6c06be30 0x7ffb6c0782a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:43:52.161 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.156+0000 7ffb72516700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb6c0788d0 0x7ffb6c122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:43:52.161 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.156+0000 7ffb72516700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c123280 con 0x7ffb6c0788d0 2020-06-27T04:43:52.162 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.156+0000 7ffb72516700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c1233f0 con 0x7ffb6c0678b0 2020-06-27T04:43:52.162 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.156+0000 7ffb72516700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c1235b0 con 0x7ffb6c06be30 2020-06-27T04:43:52.162 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.156+0000 7ffb70ab3700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7ffb6c0678b0 0x7ffb6c06cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:43:52.162 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.156+0000 7ffb70ab3700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7ffb6c0678b0 0x7ffb6c06cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.51:3300/0 says I am v2:172.21.15.51:50058/0 (socket says 172.21.15.51:50058) 2020-06-27T04:43:52.162 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.156+0000 7ffb70ab3700 1 -- 172.21.15.51:0/3583217672 learned_addr learned my addr 172.21.15.51:0/3583217672 (peer_addr_for_me v2:172.21.15.51:0/0) 2020-06-27T04:43:52.163 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.156+0000 7ffb6bfff700 1 --2- 172.21.15.51:0/3583217672 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb6c06be30 0x7ffb6c0782a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:43:52.163 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.156+0000 7ffb712b4700 1 --2- 172.21.15.51:0/3583217672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb6c0788d0 0x7ffb6c122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:43:52.163 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.156+0000 7ffb70ab3700 1 -- 172.21.15.51:0/3583217672 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb6c06be30 msgr2=0x7ffb6c0782a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:43:52.163 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.156+0000 7ffb70ab3700 1 --2- 172.21.15.51:0/3583217672 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb6c06be30 0x7ffb6c0782a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:52.163 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.156+0000 7ffb70ab3700 1 -- 172.21.15.51:0/3583217672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb6c0788d0 msgr2=0x7ffb6c122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:43:52.164 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.156+0000 7ffb70ab3700 1 --2- 172.21.15.51:0/3583217672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb6c0788d0 0x7ffb6c122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:43:52.164 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.156+0000 7ffb70ab3700 1 -- 172.21.15.51:0/3583217672 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6c123770 con 0x7ffb6c0678b0 2020-06-27T04:43:52.164 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.157+0000 7ffb70ab3700 1 --2- 172.21.15.51:0/3583217672 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7ffb6c0678b0 0x7ffb6c06cdb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ffb5c005000 tx=0x7ffb5c007d80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:43:52.164 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.157+0000 7ffb68ff9700 1 -- 172.21.15.51:0/3583217672 <== mon.2 v2:172.21.15.51:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb5c00a560 con 0x7ffb6c0678b0 2020-06-27T04:43:52.164 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.157+0000 7ffb68ff9700 1 -- 172.21.15.51:0/3583217672 <== mon.2 v2:172.21.15.51:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7ffb5c00ab00 con 0x7ffb6c0678b0 2020-06-27T04:43:52.164 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.157+0000 7ffb68ff9700 1 -- 172.21.15.51:0/3583217672 <== mon.2 v2:172.21.15.51:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb5c013a50 con 0x7ffb6c0678b0 2020-06-27T04:43:52.165 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.157+0000 7ffb72516700 1 -- 172.21.15.51:0/3583217672 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6c123a20 con 0x7ffb6c0678b0 2020-06-27T04:43:52.165 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.157+0000 7ffb72516700 1 -- 172.21.15.51:0/3583217672 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6c123fc0 con 0x7ffb6c0678b0 2020-06-27T04:43:52.166 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.158+0000 7ffb72516700 1 -- 172.21.15.51:0/3583217672 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb6c05e210 con 0x7ffb6c0678b0 2020-06-27T04:43:52.166 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.158+0000 7ffb68ff9700 1 -- 172.21.15.51:0/3583217672 <== mon.2 v2:172.21.15.51:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7ffb5c010030 con 0x7ffb6c0678b0 2020-06-27T04:43:52.166 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.158+0000 7ffb68ff9700 1 --2- 172.21.15.51:0/3583217672 >> v2:172.21.15.51:6800/950992045 conn(0x7ffb4802ab00 0x7ffb4802cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:43:52.166 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.158+0000 7ffb68ff9700 1 -- 172.21.15.51:0/3583217672 <== mon.2 v2:172.21.15.51:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 3712+0+0 (secure 0 0 0) 0x7ffb5c03a9f0 con 0x7ffb6c0678b0 2020-06-27T04:43:52.167 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.158+0000 7ffb6bfff700 1 --2- 172.21.15.51:0/3583217672 >> v2:172.21.15.51:6800/950992045 conn(0x7ffb4802ab00 0x7ffb4802cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:43:52.167 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.159+0000 7ffb6bfff700 1 --2- 172.21.15.51:0/3583217672 >> v2:172.21.15.51:6800/950992045 conn(0x7ffb4802ab00 0x7ffb4802cfc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ffb60016000 tx=0x7ffb60009b30).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:43:52.167 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.162+0000 7ffb68ff9700 1 -- 172.21.15.51:0/3583217672 <== mon.2 v2:172.21.15.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7ffb5c01a4e0 con 0x7ffb6c0678b0 2020-06-27T04:43:52.344 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:43:52.341+0000 7ffb72516700 1 -- 172.21.15.51:0/3583217672 --> v2:172.21.15.51:6800/950992045 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi051:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb6c05f390 con 0x7ffb4802ab00 2020-06-27T04:43:52.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:52 smithi051 bash[18409]: cluster 2020-06-27T04:43:51.120435+0000 mgr.x (mgr.34109) 70 : cluster [DBG] pgmap v71: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2020-06-27T04:43:52.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:52 smithi051 bash[18409]: audit 2020-06-27T04:43:51.768224+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:52.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:52 smithi051 bash[18409]: audit 2020-06-27T04:43:52.021052+0000 mon.b (mon.2) 151 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_daemon_update\": \"2020-06-27T04:43:47.424267\", \"last_device_update\": \"2020-06-27T04:43:52.020309\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:52.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:52 smithi051 bash[18409]: audit 2020-06-27T04:43:52.021576+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_daemon_update\": \"2020-06-27T04:43:47.424267\", \"last_device_update\": \"2020-06-27T04:43:52.020309\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:52.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:52 smithi051 bash[18409]: audit 2020-06-27T04:43:52.024637+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_daemon_update\": \"2020-06-27T04:43:47.424267\", \"last_device_update\": \"2020-06-27T04:43:52.020309\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:43:52.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:52 smithi031 bash[22603]: cluster 2020-06-27T04:43:51.120435+0000 mgr.x (mgr.34109) 70 : cluster [DBG] pgmap v71: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2020-06-27T04:43:52.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:52 smithi031 bash[22603]: audit 2020-06-27T04:43:51.768224+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:52.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:52 smithi031 bash[22603]: audit 2020-06-27T04:43:52.021052+0000 mon.b (mon.2) 151 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_daemon_update\": \"2020-06-27T04:43:47.424267\", \"last_device_update\": \"2020-06-27T04:43:52.020309\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:52.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:52 smithi031 bash[22603]: audit 2020-06-27T04:43:52.021576+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_daemon_update\": \"2020-06-27T04:43:47.424267\", \"last_device_update\": \"2020-06-27T04:43:52.020309\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:52.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:52 smithi031 bash[22603]: audit 2020-06-27T04:43:52.024637+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_daemon_update\": \"2020-06-27T04:43:47.424267\", \"last_device_update\": \"2020-06-27T04:43:52.020309\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:43:52.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:52 smithi031 bash[18426]: cluster 2020-06-27T04:43:51.120435+0000 mgr.x (mgr.34109) 70 : cluster [DBG] pgmap v71: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2020-06-27T04:43:52.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:52 smithi031 bash[18426]: audit 2020-06-27T04:43:51.768224+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:43:52.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:52 smithi031 bash[18426]: audit 2020-06-27T04:43:52.021052+0000 mon.b (mon.2) 151 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_daemon_update\": \"2020-06-27T04:43:47.424267\", \"last_device_update\": \"2020-06-27T04:43:52.020309\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:52.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:52 smithi031 bash[18426]: audit 2020-06-27T04:43:52.021576+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_daemon_update\": \"2020-06-27T04:43:47.424267\", \"last_device_update\": \"2020-06-27T04:43:52.020309\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:43:52.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:52 smithi031 bash[18426]: audit 2020-06-27T04:43:52.024637+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}}, \"last_daemon_update\": \"2020-06-27T04:43:47.424267\", \"last_device_update\": \"2020-06-27T04:43:52.020309\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:43:53.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:53 smithi051 bash[18409]: cluster 2020-06-27T04:43:52.137072+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2020-06-27T04:43:53.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:53 smithi051 bash[18409]: audit 2020-06-27T04:43:52.343524+0000 mgr.x (mgr.34109) 71 : audit [DBG] from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi051:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:43:53.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:53 smithi051 bash[18409]: audit 2020-06-27T04:43:52.344279+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:43:53.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:53 smithi051 bash[18409]: cephadm 2020-06-27T04:43:52.344791+0000 mgr.x (mgr.34109) 72 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:43:53.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:53 smithi051 bash[18409]: cephadm 2020-06-27T04:43:52.344847+0000 mgr.x (mgr.34109) 73 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:43:53.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:53 smithi051 bash[18409]: cephadm 2020-06-27T04:43:52.345022+0000 mgr.x (mgr.34109) 74 : cephadm [INF] Applying None on host smithi051... 2020-06-27T04:43:53.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:53 smithi051 bash[18409]: audit 2020-06-27T04:43:52.345277+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:43:53.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:53 smithi051 bash[18409]: audit 2020-06-27T04:43:52.345767+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:53.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:53 smithi051 bash[18409]: audit 2020-06-27T04:43:52.346276+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:53.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:53 smithi031 bash[18426]: cluster 2020-06-27T04:43:52.137072+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2020-06-27T04:43:53.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:53 smithi031 bash[18426]: audit 2020-06-27T04:43:52.343524+0000 mgr.x (mgr.34109) 71 : audit [DBG] from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi051:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:43:53.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:53 smithi031 bash[18426]: audit 2020-06-27T04:43:52.344279+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:43:53.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:53 smithi031 bash[18426]: cephadm 2020-06-27T04:43:52.344791+0000 mgr.x (mgr.34109) 72 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:43:53.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:53 smithi031 bash[18426]: cephadm 2020-06-27T04:43:52.344847+0000 mgr.x (mgr.34109) 73 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:43:53.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:53 smithi031 bash[18426]: cephadm 2020-06-27T04:43:52.345022+0000 mgr.x (mgr.34109) 74 : cephadm [INF] Applying None on host smithi051... 2020-06-27T04:43:53.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:53 smithi031 bash[18426]: audit 2020-06-27T04:43:52.345277+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:43:53.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:53 smithi031 bash[18426]: audit 2020-06-27T04:43:52.345767+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:53.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:53 smithi031 bash[18426]: audit 2020-06-27T04:43:52.346276+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:53.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:53 smithi031 bash[22603]: cluster 2020-06-27T04:43:52.137072+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2020-06-27T04:43:53.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:53 smithi031 bash[22603]: audit 2020-06-27T04:43:52.343524+0000 mgr.x (mgr.34109) 71 : audit [DBG] from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi051:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:43:53.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:53 smithi031 bash[22603]: audit 2020-06-27T04:43:52.344279+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:43:53.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:53 smithi031 bash[22603]: cephadm 2020-06-27T04:43:52.344791+0000 mgr.x (mgr.34109) 72 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:43:53.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:53 smithi031 bash[22603]: cephadm 2020-06-27T04:43:52.344847+0000 mgr.x (mgr.34109) 73 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:43:53.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:53 smithi031 bash[22603]: cephadm 2020-06-27T04:43:52.345022+0000 mgr.x (mgr.34109) 74 : cephadm [INF] Applying None on host smithi051... 2020-06-27T04:43:53.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:53 smithi031 bash[22603]: audit 2020-06-27T04:43:52.345277+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:43:53.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:53 smithi031 bash[22603]: audit 2020-06-27T04:43:52.345767+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:43:53.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:53 smithi031 bash[22603]: audit 2020-06-27T04:43:52.346276+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:54.217 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:54 smithi051 bash[18409]: cluster 2020-06-27T04:43:53.120710+0000 mgr.x (mgr.34109) 75 : cluster [DBG] pgmap v74: 1 pgs: 1 active+clean; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:43:54.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:54 smithi031 bash[18426]: cluster 2020-06-27T04:43:53.120710+0000 mgr.x (mgr.34109) 75 : cluster [DBG] pgmap v74: 1 pgs: 1 active+clean; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:43:54.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:54 smithi031 bash[22603]: cluster 2020-06-27T04:43:53.120710+0000 mgr.x (mgr.34109) 75 : cluster [DBG] pgmap v74: 1 pgs: 1 active+clean; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:43:55.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:55 smithi051 bash[18409]: audit 2020-06-27T04:43:54.630552+0000 mon.b (mon.2) 156 : audit [INF] from='client.? 172.21.15.51:0/2497686405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6125844a-2c24-409d-9f33-ba0cbb1bb822"}]: dispatch 2020-06-27T04:43:55.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:55 smithi051 bash[18409]: audit 2020-06-27T04:43:54.630986+0000 mon.a (mon.0) 375 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6125844a-2c24-409d-9f33-ba0cbb1bb822"}]: dispatch 2020-06-27T04:43:55.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:55 smithi051 bash[18409]: audit 2020-06-27T04:43:54.635559+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:43:55.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:55 smithi051 bash[18409]: audit 2020-06-27T04:43:54.637116+0000 mon.a (mon.0) 376 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6125844a-2c24-409d-9f33-ba0cbb1bb822"}]': finished 2020-06-27T04:43:55.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:55 smithi051 bash[18409]: cluster 2020-06-27T04:43:54.637196+0000 mon.a (mon.0) 377 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2020-06-27T04:43:55.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:55 smithi051 bash[18409]: audit 2020-06-27T04:43:55.116380+0000 mon.b (mon.2) 158 : audit [DBG] from='client.? 172.21.15.51:0/422492960' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:43:55.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:55 smithi031 bash[18426]: audit 2020-06-27T04:43:54.630552+0000 mon.b (mon.2) 156 : audit [INF] from='client.? 172.21.15.51:0/2497686405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6125844a-2c24-409d-9f33-ba0cbb1bb822"}]: dispatch 2020-06-27T04:43:55.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:55 smithi031 bash[18426]: audit 2020-06-27T04:43:54.630986+0000 mon.a (mon.0) 375 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6125844a-2c24-409d-9f33-ba0cbb1bb822"}]: dispatch 2020-06-27T04:43:55.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:55 smithi031 bash[18426]: audit 2020-06-27T04:43:54.635559+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:43:55.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:55 smithi031 bash[18426]: audit 2020-06-27T04:43:54.637116+0000 mon.a (mon.0) 376 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6125844a-2c24-409d-9f33-ba0cbb1bb822"}]': finished 2020-06-27T04:43:55.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:55 smithi031 bash[18426]: cluster 2020-06-27T04:43:54.637196+0000 mon.a (mon.0) 377 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2020-06-27T04:43:55.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:55 smithi031 bash[18426]: audit 2020-06-27T04:43:55.116380+0000 mon.b (mon.2) 158 : audit [DBG] from='client.? 172.21.15.51:0/422492960' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:43:55.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:55 smithi031 bash[22603]: audit 2020-06-27T04:43:54.630552+0000 mon.b (mon.2) 156 : audit [INF] from='client.? 172.21.15.51:0/2497686405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6125844a-2c24-409d-9f33-ba0cbb1bb822"}]: dispatch 2020-06-27T04:43:55.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:55 smithi031 bash[22603]: audit 2020-06-27T04:43:54.630986+0000 mon.a (mon.0) 375 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6125844a-2c24-409d-9f33-ba0cbb1bb822"}]: dispatch 2020-06-27T04:43:55.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:55 smithi031 bash[22603]: audit 2020-06-27T04:43:54.635559+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:43:55.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:55 smithi031 bash[22603]: audit 2020-06-27T04:43:54.637116+0000 mon.a (mon.0) 376 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6125844a-2c24-409d-9f33-ba0cbb1bb822"}]': finished 2020-06-27T04:43:55.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:55 smithi031 bash[22603]: cluster 2020-06-27T04:43:54.637196+0000 mon.a (mon.0) 377 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2020-06-27T04:43:55.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:55 smithi031 bash[22603]: audit 2020-06-27T04:43:55.116380+0000 mon.b (mon.2) 158 : audit [DBG] from='client.? 172.21.15.51:0/422492960' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:43:56.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:56 smithi051 bash[18409]: cluster 2020-06-27T04:43:55.120966+0000 mgr.x (mgr.34109) 76 : cluster [DBG] pgmap v76: 1 pgs: 1 active+clean; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:43:56.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:56 smithi031 bash[18426]: cluster 2020-06-27T04:43:55.120966+0000 mgr.x (mgr.34109) 76 : cluster [DBG] pgmap v76: 1 pgs: 1 active+clean; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:43:56.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:56 smithi031 bash[22603]: cluster 2020-06-27T04:43:55.120966+0000 mgr.x (mgr.34109) 76 : cluster [DBG] pgmap v76: 1 pgs: 1 active+clean; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:43:58.332 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:58 smithi051 bash[18409]: cluster 2020-06-27T04:43:57.121433+0000 mgr.x (mgr.34109) 77 : cluster [DBG] pgmap v77: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:43:58.333 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:43:58 smithi051 bash[18409]: audit 2020-06-27T04:43:57.605526+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:58.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:58 smithi031 bash[18426]: cluster 2020-06-27T04:43:57.121433+0000 mgr.x (mgr.34109) 77 : cluster [DBG] pgmap v77: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:43:58.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:43:58 smithi031 bash[18426]: audit 2020-06-27T04:43:57.605526+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:43:58.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:58 smithi031 bash[22603]: cluster 2020-06-27T04:43:57.121433+0000 mgr.x (mgr.34109) 77 : cluster [DBG] pgmap v77: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:43:58.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:43:58 smithi031 bash[22603]: audit 2020-06-27T04:43:57.605526+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:44:00.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:00 smithi051 bash[18409]: cluster 2020-06-27T04:43:59.121798+0000 mgr.x (mgr.34109) 78 : cluster [DBG] pgmap v78: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:44:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:00 smithi051 bash[18409]: audit 2020-06-27T04:44:00.061734+0000 mon.b (mon.2) 160 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2020-06-27T04:44:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:00 smithi051 bash[18409]: audit 2020-06-27T04:44:00.062335+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:44:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:00 smithi051 bash[18409]: audit 2020-06-27T04:44:00.063043+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2020-06-27T04:44:00.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:00 smithi031 bash[18426]: cluster 2020-06-27T04:43:59.121798+0000 mgr.x (mgr.34109) 78 : cluster [DBG] pgmap v78: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:44:00.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:00 smithi031 bash[18426]: audit 2020-06-27T04:44:00.061734+0000 mon.b (mon.2) 160 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2020-06-27T04:44:00.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:00 smithi031 bash[18426]: audit 2020-06-27T04:44:00.062335+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:44:00.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:00 smithi031 bash[18426]: audit 2020-06-27T04:44:00.063043+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2020-06-27T04:44:00.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:00 smithi031 bash[22603]: cluster 2020-06-27T04:43:59.121798+0000 mgr.x (mgr.34109) 78 : cluster [DBG] pgmap v78: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:44:00.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:00 smithi031 bash[22603]: audit 2020-06-27T04:44:00.061734+0000 mon.b (mon.2) 160 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2020-06-27T04:44:00.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:00 smithi031 bash[22603]: audit 2020-06-27T04:44:00.062335+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:44:00.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:00 smithi031 bash[22603]: audit 2020-06-27T04:44:00.063043+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2020-06-27T04:44:01.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:01 smithi051 bash[18409]: cephadm 2020-06-27T04:44:00.062803+0000 mgr.x (mgr.34109) 79 : cephadm [INF] Deploying daemon osd.6 on smithi051 2020-06-27T04:44:01.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:01 smithi031 bash[18426]: cephadm 2020-06-27T04:44:00.062803+0000 mgr.x (mgr.34109) 79 : cephadm [INF] Deploying daemon osd.6 on smithi051 2020-06-27T04:44:01.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:01 smithi031 bash[22603]: cephadm 2020-06-27T04:44:00.062803+0000 mgr.x (mgr.34109) 79 : cephadm [INF] Deploying daemon osd.6 on smithi051 2020-06-27T04:44:01.663 INFO:teuthology.orchestra.run.smithi051.stdout:Created osd(s) 6 on host 'smithi051' 2020-06-27T04:44:01.664 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:01.658+0000 7ffb68ff9700 1 -- 172.21.15.51:0/3583217672 <== mgr.34109 v2:172.21.15.51:6800/950992045 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ffb600077b0 con 0x7ffb4802ab00 2020-06-27T04:44:01.664 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:01.660+0000 7ffb72516700 1 -- 172.21.15.51:0/3583217672 >> v2:172.21.15.51:6800/950992045 conn(0x7ffb4802ab00 msgr2=0x7ffb4802cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:01.665 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:01.660+0000 7ffb72516700 1 --2- 172.21.15.51:0/3583217672 >> v2:172.21.15.51:6800/950992045 conn(0x7ffb4802ab00 0x7ffb4802cfc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ffb60016000 tx=0x7ffb60009b30).stop 2020-06-27T04:44:01.665 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:01.660+0000 7ffb72516700 1 -- 172.21.15.51:0/3583217672 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7ffb6c0678b0 msgr2=0x7ffb6c06cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:01.665 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:01.660+0000 7ffb72516700 1 --2- 172.21.15.51:0/3583217672 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7ffb6c0678b0 0x7ffb6c06cdb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ffb5c005000 tx=0x7ffb5c007d80).stop 2020-06-27T04:44:01.665 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:01.661+0000 7ffb72516700 1 -- 172.21.15.51:0/3583217672 shutdown_connections 2020-06-27T04:44:01.665 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:01.661+0000 7ffb72516700 1 --2- 172.21.15.51:0/3583217672 >> v2:172.21.15.51:6800/950992045 conn(0x7ffb4802ab00 0x7ffb4802cfc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:01.666 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:01.661+0000 7ffb72516700 1 --2- 172.21.15.51:0/3583217672 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7ffb6c0678b0 0x7ffb6c06cdb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:01.666 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:01.661+0000 7ffb72516700 1 --2- 172.21.15.51:0/3583217672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb6c0788d0 0x7ffb6c122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:01.666 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:01.661+0000 7ffb72516700 1 --2- 172.21.15.51:0/3583217672 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb6c06be30 0x7ffb6c0782a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:01.666 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:01.661+0000 7ffb72516700 1 -- 172.21.15.51:0/3583217672 >> 172.21.15.51:0/3583217672 conn(0x7ffb6c061830 msgr2=0x7ffb6c063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:44:01.666 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:01.661+0000 7ffb72516700 1 -- 172.21.15.51:0/3583217672 shutdown_connections 2020-06-27T04:44:01.667 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:01.661+0000 7ffb72516700 1 -- 172.21.15.51:0/3583217672 wait complete. 2020-06-27T04:44:02.334 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:02 smithi051 bash[18409]: cluster 2020-06-27T04:44:01.122252+0000 mgr.x (mgr.34109) 80 : cluster [DBG] pgmap v79: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:44:02.334 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:02 smithi051 bash[18409]: audit 2020-06-27T04:44:01.654383+0000 mon.b (mon.2) 163 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_device_update\": \"2020-06-27T04:43:52.020309\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:02.335 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:02 smithi051 bash[18409]: audit 2020-06-27T04:44:01.654668+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:44:02.335 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:02 smithi051 bash[18409]: audit 2020-06-27T04:44:01.655039+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_device_update\": \"2020-06-27T04:43:52.020309\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:02.335 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:02 smithi051 bash[18409]: audit 2020-06-27T04:44:01.658270+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_device_update\": \"2020-06-27T04:43:52.020309\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:02.350 INFO:teuthology.orchestra.run.smithi051:osd.6> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service 2020-06-27T04:44:02.353 INFO:tasks.cephadm:Deploying osd.7 on smithi051 with /dev/vg_nvme/lv_1... 2020-06-27T04:44:02.353 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2020-06-27T04:44:02.387 INFO:ceph.osd.6.smithi051.stdout:-- Logs begin at Sat 2020-06-27 04:33:02 UTC. -- 2020-06-27T04:44:02.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:02 smithi031 bash[18426]: cluster 2020-06-27T04:44:01.122252+0000 mgr.x (mgr.34109) 80 : cluster [DBG] pgmap v79: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:44:02.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:02 smithi031 bash[18426]: audit 2020-06-27T04:44:01.654383+0000 mon.b (mon.2) 163 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_device_update\": \"2020-06-27T04:43:52.020309\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:02.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:02 smithi031 bash[18426]: audit 2020-06-27T04:44:01.654668+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:44:02.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:02 smithi031 bash[18426]: audit 2020-06-27T04:44:01.655039+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_device_update\": \"2020-06-27T04:43:52.020309\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:02.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:02 smithi031 bash[18426]: audit 2020-06-27T04:44:01.658270+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_device_update\": \"2020-06-27T04:43:52.020309\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:02.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:02 smithi031 bash[22603]: cluster 2020-06-27T04:44:01.122252+0000 mgr.x (mgr.34109) 80 : cluster [DBG] pgmap v79: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:44:02.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:02 smithi031 bash[22603]: audit 2020-06-27T04:44:01.654383+0000 mon.b (mon.2) 163 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_device_update\": \"2020-06-27T04:43:52.020309\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:02.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:02 smithi031 bash[22603]: audit 2020-06-27T04:44:01.654668+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:44:02.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:02 smithi031 bash[22603]: audit 2020-06-27T04:44:01.655039+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_device_update\": \"2020-06-27T04:43:52.020309\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:02.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:02 smithi031 bash[22603]: audit 2020-06-27T04:44:01.658270+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423887\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423963\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.423996\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:47.424137\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_device_update\": \"2020-06-27T04:43:52.020309\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:02.591 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:02 smithi051 podman[25497]: 2020-06-27 04:44:02.398625382 +0000 UTC m=+0.757842107 container start a163c456a0c22b2abbf45e7754f2079ac17c5c7ec5b4ba56730d65159faea5c4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:44:02.591 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:02 smithi051 podman[25497]: 2020-06-27 04:44:02.399042523 +0000 UTC m=+0.758259248 container attach a163c456a0c22b2abbf45e7754f2079ac17c5c7ec5b4ba56730d65159faea5c4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:44:02.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:02 smithi051 bash[25495]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-06-27T04:44:02.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:02 smithi051 bash[25495]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2020-06-27T04:44:02.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:02 smithi051 bash[25495]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2020-06-27T04:44:02.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:02 smithi051 bash[25495]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2020-06-27T04:44:02.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:02 smithi051 bash[25495]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2020-06-27T04:44:02.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:02 smithi051 bash[25495]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-06-27T04:44:02.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:02 smithi051 bash[25495]: --> ceph-volume lvm activate successful for osd ID: 6 2020-06-27T04:44:02.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:02 smithi051 podman[25497]: 2020-06-27 04:44:02.733703167 +0000 UTC m=+1.092919922 container died a163c456a0c22b2abbf45e7754f2079ac17c5c7ec5b4ba56730d65159faea5c4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:44:03.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:03 smithi051 bash[18409]: audit 2020-06-27T04:44:02.276264+0000 mon.b (mon.2) 165 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:44:03.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:03 smithi051 bash[18409]: audit 2020-06-27T04:44:02.276963+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:44:03.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:03 smithi051 bash[18409]: audit 2020-06-27T04:44:02.279331+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-06-27T04:44:03.469 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:03 smithi051 podman[25497]: 2020-06-27 04:44:03.328683828 +0000 UTC m=+1.687900562 container remove a163c456a0c22b2abbf45e7754f2079ac17c5c7ec5b4ba56730d65159faea5c4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:44:03.469 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:03 smithi051 bash[25495]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6 found: no such container 2020-06-27T04:44:03.469 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:03 smithi051 bash[25495]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6 2020-06-27T04:44:03.469 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:03 smithi051 bash[25495]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6" found: no such container 2020-06-27T04:44:03.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:03 smithi031 bash[18426]: audit 2020-06-27T04:44:02.276264+0000 mon.b (mon.2) 165 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:44:03.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:03 smithi031 bash[18426]: audit 2020-06-27T04:44:02.276963+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:44:03.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:03 smithi031 bash[18426]: audit 2020-06-27T04:44:02.279331+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-06-27T04:44:03.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:03 smithi031 bash[22603]: audit 2020-06-27T04:44:02.276264+0000 mon.b (mon.2) 165 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:44:03.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:03 smithi031 bash[22603]: audit 2020-06-27T04:44:02.276963+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:44:03.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:03 smithi031 bash[22603]: audit 2020-06-27T04:44:02.279331+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-06-27T04:44:04.391 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 podman[25841]: 2020-06-27 04:44:04.072412029 +0000 UTC m=+0.631192896 container create 55271d6c0fdecb4a81bfffc01cd174f4f2a17770b308324d604a2a340c9dba5d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:44:04.392 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 podman[25841]: 2020-06-27 04:44:04.320019797 +0000 UTC m=+0.878800557 container init 55271d6c0fdecb4a81bfffc01cd174f4f2a17770b308324d604a2a340c9dba5d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:44:04.392 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[18409]: cluster 2020-06-27T04:44:03.122636+0000 mgr.x (mgr.34109) 81 : cluster [DBG] pgmap v80: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:44:04.392 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[18409]: audit 2020-06-27T04:44:03.740117+0000 mon.b (mon.2) 166 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_daemon_update\": \"2020-06-27T04:44:03.739496\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:04.392 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[18409]: audit 2020-06-27T04:44:03.740728+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_daemon_update\": \"2020-06-27T04:44:03.739496\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:04.393 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[18409]: audit 2020-06-27T04:44:03.743275+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_daemon_update\": \"2020-06-27T04:44:03.739496\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:04.393 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[18409]: audit 2020-06-27T04:44:03.744252+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:44:04.677 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 podman[25841]: 2020-06-27 04:44:04.389005495 +0000 UTC m=+0.947786376 container start 55271d6c0fdecb4a81bfffc01cd174f4f2a17770b308324d604a2a340c9dba5d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:44:04.677 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 10 -- 172.21.15.51:0/1426084207 shutdown 172.21.15.51:0/1426084207 2020-06-27T04:44:04.677 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 10 Processor -- stop 2020-06-27T04:44:04.677 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 20 Event(0x562e36f22e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:44:04.678 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 1 -- 172.21.15.51:0/1426084207 shutdown_connections 2020-06-27T04:44:04.678 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 5 -- 172.21.15.51:0/1426084207 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x562e36f8f400 2020-06-27T04:44:04.678 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 1 --2- 172.21.15.51:0/1426084207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x562e36f8f400 0x562e36f00300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-06-27T04:44:04.678 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 5 -- 172.21.15.51:0/1426084207 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x562e36f8ec00 2020-06-27T04:44:04.678 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 1 --2- 172.21.15.51:0/1426084207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562e36f8ec00 0x562e36eff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-06-27T04:44:04.679 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 5 -- 172.21.15.51:0/1426084207 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x562e36f8f000 2020-06-27T04:44:04.679 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 1 --2- 172.21.15.51:0/1426084207 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x562e36f8f000 0x562e36effe00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:04.679 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 5 -- 172.21.15.51:0/1426084207 shutdown_connections delete 0x562e36f8ec00 2020-06-27T04:44:04.679 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 5 -- 172.21.15.51:0/1426084207 shutdown_connections delete 0x562e36f8f000 2020-06-27T04:44:04.679 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 5 -- 172.21.15.51:0/1426084207 shutdown_connections delete 0x562e36f8f400 2020-06-27T04:44:04.680 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 podman[25841]: 2020-06-27 04:44:04.389178569 +0000 UTC m=+0.947959360 container attach 55271d6c0fdecb4a81bfffc01cd174f4f2a17770b308324d604a2a340c9dba5d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:44:04.680 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 1 -- 172.21.15.51:0/1426084207 >> 172.21.15.51:0/1426084207 conn(0x562e36f8e800 msgr2=0x562e36ff7000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:44:04.680 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 20 --1- 172.21.15.51:0/1426084207 >> 172.21.15.51:0/1426084207 conn(0x562e36f8e800 0x562e36ff7000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:44:04.680 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 2 --1- 172.21.15.51:0/1426084207 >> 172.21.15.51:0/1426084207 conn(0x562e36f8e800 0x562e36ff7000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:44:04.680 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 5 --1- 172.21.15.51:0/1426084207 >> 172.21.15.51:0/1426084207 conn(0x562e36f8e800 0x562e36ff7000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:44:04.681 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 20 Event(0x562e36f22e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:44:04.681 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 10 --1- 172.21.15.51:0/1426084207 >> 172.21.15.51:0/1426084207 conn(0x562e36f8e800 0x562e36ff7000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:44:04.681 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 20 Event(0x562e36f23040 nevent=5000 time_id=2).wakeup 2020-06-27T04:44:04.681 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 20 Event(0x562e36f23280 nevent=5000 time_id=3).wakeup 2020-06-27T04:44:04.681 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa29b897700 5 --1- 172.21.15.51:0/1426084207 >> 172.21.15.51:0/1426084207 conn(0x562e36f8e800 0x562e36ff7000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:44:04.682 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa29b897700 5 --1- 172.21.15.51:0/1426084207 >> 172.21.15.51:0/1426084207 conn(0x562e36f8e800 0x562e36ff7000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:44:04.682 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 10 -- 172.21.15.51:0/1426084207 wait: waiting for dispatch queue 2020-06-27T04:44:04.682 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 10 -- 172.21.15.51:0/1426084207 wait: dispatch queue is stopped 2020-06-27T04:44:04.682 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 1 -- 172.21.15.51:0/1426084207 shutdown_connections 2020-06-27T04:44:04.682 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 5 -- 172.21.15.51:0/1426084207 shutdown_connections delete 0x562e36f8e800 2020-06-27T04:44:04.683 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 20 Event(0x562e36f22e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:44:04.683 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 20 Event(0x562e36f23040 nevent=5000 time_id=2).wakeup 2020-06-27T04:44:04.683 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 20 Event(0x562e36f23280 nevent=5000 time_id=3).wakeup 2020-06-27T04:44:04.683 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 10 -- 172.21.15.51:0/1426084207 wait: done. 2020-06-27T04:44:04.683 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.342+0000 7fa2a1b14f40 1 -- 172.21.15.51:0/1426084207 wait complete. 2020-06-27T04:44:04.684 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:04 smithi051 bash[25495]: debug 2020-06-27T04:44:04.611+0000 7fa2a1b14f40 -1 Falling back to public interface 2020-06-27T04:44:04.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:04 smithi031 bash[18426]: cluster 2020-06-27T04:44:03.122636+0000 mgr.x (mgr.34109) 81 : cluster [DBG] pgmap v80: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:44:04.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:04 smithi031 bash[18426]: audit 2020-06-27T04:44:03.740117+0000 mon.b (mon.2) 166 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_daemon_update\": \"2020-06-27T04:44:03.739496\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:04.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:04 smithi031 bash[18426]: audit 2020-06-27T04:44:03.740728+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_daemon_update\": \"2020-06-27T04:44:03.739496\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:04.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:04 smithi031 bash[18426]: audit 2020-06-27T04:44:03.743275+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_daemon_update\": \"2020-06-27T04:44:03.739496\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:04.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:04 smithi031 bash[18426]: audit 2020-06-27T04:44:03.744252+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:44:04.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:04 smithi031 bash[22603]: cluster 2020-06-27T04:44:03.122636+0000 mgr.x (mgr.34109) 81 : cluster [DBG] pgmap v80: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:44:04.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:04 smithi031 bash[22603]: audit 2020-06-27T04:44:03.740117+0000 mon.b (mon.2) 166 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_daemon_update\": \"2020-06-27T04:44:03.739496\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:04.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:04 smithi031 bash[22603]: audit 2020-06-27T04:44:03.740728+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_daemon_update\": \"2020-06-27T04:44:03.739496\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:04.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:04 smithi031 bash[22603]: audit 2020-06-27T04:44:03.743275+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_daemon_update\": \"2020-06-27T04:44:03.739496\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:04.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:04 smithi031 bash[22603]: audit 2020-06-27T04:44:03.744252+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:44:05.131 INFO:teuthology.orchestra.run.smithi051.stderr:--> Zapping: /dev/vg_nvme/lv_1 2020-06-27T04:44:05.131 INFO:teuthology.orchestra.run.smithi051.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2020-06-27T04:44:05.131 INFO:teuthology.orchestra.run.smithi051.stderr: stderr: 10+0 records in 2020-06-27T04:44:05.132 INFO:teuthology.orchestra.run.smithi051.stderr:10+0 records out 2020-06-27T04:44:05.132 INFO:teuthology.orchestra.run.smithi051.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00995211 s, 1.1 GB/s 2020-06-27T04:44:05.132 INFO:teuthology.orchestra.run.smithi051.stderr:--> Zapping successful for: 2020-06-27T04:44:05.294 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:05 smithi051 bash[25495]: debug 2020-06-27T04:44:05.181+0000 7fa2a1b14f40 -1 osd.6 0 log_to_monitors {default=true} 2020-06-27T04:44:05.671 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:05 smithi051 bash[18409]: audit 2020-06-27T04:44:05.186199+0000 mon.b (mon.2) 168 : audit [INF] from='osd.6 v2:172.21.15.51:6809/2568976317' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:44:05.671 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:05 smithi051 bash[18409]: audit 2020-06-27T04:44:05.186540+0000 mon.a (mon.0) 384 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:44:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:05 smithi031 bash[18426]: audit 2020-06-27T04:44:05.186199+0000 mon.b (mon.2) 168 : audit [INF] from='osd.6 v2:172.21.15.51:6809/2568976317' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:44:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:05 smithi031 bash[18426]: audit 2020-06-27T04:44:05.186540+0000 mon.a (mon.0) 384 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:44:05.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:05 smithi031 bash[22603]: audit 2020-06-27T04:44:05.186199+0000 mon.b (mon.2) 168 : audit [INF] from='osd.6 v2:172.21.15.51:6809/2568976317' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:44:05.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:05 smithi031 bash[22603]: audit 2020-06-27T04:44:05.186540+0000 mon.a (mon.0) 384 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:44:05.956 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph orch daemon add osd smithi051:vg_nvme/lv_1 2020-06-27T04:44:06.449 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:44:06 smithi051 bash[25495]: debug 2020-06-27T04:44:06.295+0000 7fa298090700 -1 osd.6 0 waiting for initial osdmap 2020-06-27T04:44:06.450 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:06 smithi051 bash[18409]: cluster 2020-06-27T04:44:05.122998+0000 mgr.x (mgr.34109) 82 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:44:06.450 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:06 smithi051 bash[18409]: audit 2020-06-27T04:44:05.290990+0000 mon.a (mon.0) 385 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2020-06-27T04:44:06.450 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:06 smithi051 bash[18409]: cluster 2020-06-27T04:44:05.291047+0000 mon.a (mon.0) 386 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2020-06-27T04:44:06.450 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:06 smithi051 bash[18409]: audit 2020-06-27T04:44:05.294264+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:44:06.451 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:06 smithi051 bash[18409]: audit 2020-06-27T04:44:05.294678+0000 mon.b (mon.2) 170 : audit [INF] from='osd.6 v2:172.21.15.51:6809/2568976317' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:44:06.451 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:06 smithi051 bash[18409]: audit 2020-06-27T04:44:05.295250+0000 mon.a (mon.0) 387 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:44:06.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:06 smithi031 bash[18426]: cluster 2020-06-27T04:44:05.122998+0000 mgr.x (mgr.34109) 82 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:44:06.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:06 smithi031 bash[18426]: audit 2020-06-27T04:44:05.290990+0000 mon.a (mon.0) 385 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2020-06-27T04:44:06.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:06 smithi031 bash[18426]: cluster 2020-06-27T04:44:05.291047+0000 mon.a (mon.0) 386 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2020-06-27T04:44:06.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:06 smithi031 bash[18426]: audit 2020-06-27T04:44:05.294264+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:44:06.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:06 smithi031 bash[18426]: audit 2020-06-27T04:44:05.294678+0000 mon.b (mon.2) 170 : audit [INF] from='osd.6 v2:172.21.15.51:6809/2568976317' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:44:06.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:06 smithi031 bash[18426]: audit 2020-06-27T04:44:05.295250+0000 mon.a (mon.0) 387 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:44:06.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:06 smithi031 bash[22603]: cluster 2020-06-27T04:44:05.122998+0000 mgr.x (mgr.34109) 82 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:44:06.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:06 smithi031 bash[22603]: audit 2020-06-27T04:44:05.290990+0000 mon.a (mon.0) 385 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2020-06-27T04:44:06.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:06 smithi031 bash[22603]: cluster 2020-06-27T04:44:05.291047+0000 mon.a (mon.0) 386 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2020-06-27T04:44:06.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:06 smithi031 bash[22603]: audit 2020-06-27T04:44:05.294264+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:44:06.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:06 smithi031 bash[22603]: audit 2020-06-27T04:44:05.294678+0000 mon.b (mon.2) 170 : audit [INF] from='osd.6 v2:172.21.15.51:6809/2568976317' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:44:06.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:06 smithi031 bash[22603]: audit 2020-06-27T04:44:05.295250+0000 mon.a (mon.0) 387 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:44:07.657 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:07 smithi051 bash[18409]: cluster 2020-06-27T04:44:06.203570+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:44:07.657 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:07 smithi051 bash[18409]: cluster 2020-06-27T04:44:06.203667+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:44:07.658 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:07 smithi051 bash[18409]: audit 2020-06-27T04:44:06.293833+0000 mon.a (mon.0) 388 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]': finished 2020-06-27T04:44:07.658 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:07 smithi051 bash[18409]: cluster 2020-06-27T04:44:06.293893+0000 mon.a (mon.0) 389 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2020-06-27T04:44:07.658 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:07 smithi051 bash[18409]: audit 2020-06-27T04:44:06.294323+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:44:07.658 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:07 smithi051 bash[18409]: audit 2020-06-27T04:44:06.296827+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:44:07.658 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:07 smithi051 bash[18409]: cluster 2020-06-27T04:44:07.298498+0000 mon.a (mon.0) 390 : cluster [INF] osd.6 v2:172.21.15.51:6809/2568976317 boot 2020-06-27T04:44:07.659 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:07 smithi051 bash[18409]: cluster 2020-06-27T04:44:07.298562+0000 mon.a (mon.0) 391 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2020-06-27T04:44:07.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:07 smithi031 bash[18426]: cluster 2020-06-27T04:44:06.203570+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:44:07.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:07 smithi031 bash[18426]: cluster 2020-06-27T04:44:06.203667+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:44:07.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:07 smithi031 bash[18426]: audit 2020-06-27T04:44:06.293833+0000 mon.a (mon.0) 388 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]': finished 2020-06-27T04:44:07.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:07 smithi031 bash[18426]: cluster 2020-06-27T04:44:06.293893+0000 mon.a (mon.0) 389 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2020-06-27T04:44:07.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:07 smithi031 bash[18426]: audit 2020-06-27T04:44:06.294323+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:44:07.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:07 smithi031 bash[18426]: audit 2020-06-27T04:44:06.296827+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:44:07.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:07 smithi031 bash[18426]: cluster 2020-06-27T04:44:07.298498+0000 mon.a (mon.0) 390 : cluster [INF] osd.6 v2:172.21.15.51:6809/2568976317 boot 2020-06-27T04:44:07.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:07 smithi031 bash[18426]: cluster 2020-06-27T04:44:07.298562+0000 mon.a (mon.0) 391 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2020-06-27T04:44:07.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:07 smithi031 bash[22603]: cluster 2020-06-27T04:44:06.203570+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:44:07.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:07 smithi031 bash[22603]: cluster 2020-06-27T04:44:06.203667+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:44:07.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:07 smithi031 bash[22603]: audit 2020-06-27T04:44:06.293833+0000 mon.a (mon.0) 388 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]': finished 2020-06-27T04:44:07.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:07 smithi031 bash[22603]: cluster 2020-06-27T04:44:06.293893+0000 mon.a (mon.0) 389 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2020-06-27T04:44:07.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:07 smithi031 bash[22603]: audit 2020-06-27T04:44:06.294323+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:44:07.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:07 smithi031 bash[22603]: audit 2020-06-27T04:44:06.296827+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:44:07.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:07 smithi031 bash[22603]: cluster 2020-06-27T04:44:07.298498+0000 mon.a (mon.0) 390 : cluster [INF] osd.6 v2:172.21.15.51:6809/2568976317 boot 2020-06-27T04:44:07.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:07 smithi031 bash[22603]: cluster 2020-06-27T04:44:07.298562+0000 mon.a (mon.0) 391 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2020-06-27T04:44:08.062 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.057+0000 7f9903965700 1 Processor -- start 2020-06-27T04:44:08.145 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f9903965700 1 -- start start 2020-06-27T04:44:08.145 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f9903965700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98fc066360 0x7f98fc06cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:08.146 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f9903965700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f98fc06be30 0x7f98fc078360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:08.146 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f9903965700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98fc078990 0x7f98fc122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:08.146 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f9903965700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc1232c0 con 0x7f98fc066360 2020-06-27T04:44:08.146 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f9903965700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc123430 con 0x7f98fc06be30 2020-06-27T04:44:08.146 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f9903965700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc1235f0 con 0x7f98fc078990 2020-06-27T04:44:08.147 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f9901701700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f98fc06be30 0x7f98fc078360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:08.147 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f9901701700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f98fc06be30 0x7f98fc078360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.51:3300/0 says I am v2:172.21.15.51:50156/0 (socket says 172.21.15.51:50156) 2020-06-27T04:44:08.147 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f9901701700 1 -- 172.21.15.51:0/1860797542 learned_addr learned my addr 172.21.15.51:0/1860797542 (peer_addr_for_me v2:172.21.15.51:0/0) 2020-06-27T04:44:08.147 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f9901f02700 1 --2- 172.21.15.51:0/1860797542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98fc066360 0x7f98fc06cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:08.147 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f9902703700 1 --2- 172.21.15.51:0/1860797542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98fc078990 0x7f98fc122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:08.148 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f9901701700 1 -- 172.21.15.51:0/1860797542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98fc078990 msgr2=0x7f98fc122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:08.148 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f9901701700 1 --2- 172.21.15.51:0/1860797542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98fc078990 0x7f98fc122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:08.148 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f9901701700 1 -- 172.21.15.51:0/1860797542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98fc066360 msgr2=0x7f98fc06cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:08.148 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f9901701700 1 --2- 172.21.15.51:0/1860797542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98fc066360 0x7f98fc06cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:08.148 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f9901701700 1 -- 172.21.15.51:0/1860797542 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc1237b0 con 0x7f98fc06be30 2020-06-27T04:44:08.149 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f9901701700 1 --2- 172.21.15.51:0/1860797542 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f98fc06be30 0x7f98fc078360 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f98ec0040c0 tx=0x7f98ec009d20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:44:08.149 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.058+0000 7f98f1ffb700 1 -- 172.21.15.51:0/1860797542 <== mon.2 v2:172.21.15.51:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98ec004e80 con 0x7f98fc06be30 2020-06-27T04:44:08.149 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.059+0000 7f98f1ffb700 1 -- 172.21.15.51:0/1860797542 <== mon.2 v2:172.21.15.51:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f98ec00f040 con 0x7f98fc06be30 2020-06-27T04:44:08.149 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.059+0000 7f9903965700 1 -- 172.21.15.51:0/1860797542 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98fc123a60 con 0x7f98fc06be30 2020-06-27T04:44:08.149 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.059+0000 7f98f1ffb700 1 -- 172.21.15.51:0/1860797542 <== mon.2 v2:172.21.15.51:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98ec0138f0 con 0x7f98fc06be30 2020-06-27T04:44:08.150 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.059+0000 7f9903965700 1 -- 172.21.15.51:0/1860797542 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc123f80 con 0x7f98fc06be30 2020-06-27T04:44:08.150 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.059+0000 7f98f1ffb700 1 -- 172.21.15.51:0/1860797542 <== mon.2 v2:172.21.15.51:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f98ec013b60 con 0x7f98fc06be30 2020-06-27T04:44:08.150 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.059+0000 7f98f1ffb700 1 --2- 172.21.15.51:0/1860797542 >> v2:172.21.15.51:6800/950992045 conn(0x7f98d802ab00 0x7f98d802cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:08.150 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.059+0000 7f98f1ffb700 1 -- 172.21.15.51:0/1860797542 <== mon.2 v2:172.21.15.51:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4004+0+0 (secure 0 0 0) 0x7f98ec03bd00 con 0x7f98fc06be30 2020-06-27T04:44:08.151 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.059+0000 7f9901f02700 1 --2- 172.21.15.51:0/1860797542 >> v2:172.21.15.51:6800/950992045 conn(0x7f98d802ab00 0x7f98d802cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:08.151 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.060+0000 7f9901f02700 1 --2- 172.21.15.51:0/1860797542 >> v2:172.21.15.51:6800/950992045 conn(0x7f98d802ab00 0x7f98d802cfc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f98f8016000 tx=0x7f98f8009b30).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:44:08.152 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.060+0000 7f9903965700 1 -- 172.21.15.51:0/1860797542 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98fc05e210 con 0x7f98fc06be30 2020-06-27T04:44:08.152 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.064+0000 7f98f1ffb700 1 -- 172.21.15.51:0/1860797542 <== mon.2 v2:172.21.15.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f98ec03f060 con 0x7f98fc06be30 2020-06-27T04:44:08.244 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:08.241+0000 7f9903965700 1 -- 172.21.15.51:0/1860797542 --> v2:172.21.15.51:6800/950992045 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi051:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f98fc05f390 con 0x7f98d802ab00 2020-06-27T04:44:08.707 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:08 smithi051 bash[18409]: cluster 2020-06-27T04:44:07.123319+0000 mgr.x (mgr.34109) 83 : cluster [DBG] pgmap v84: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:44:08.707 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:08 smithi051 bash[18409]: audit 2020-06-27T04:44:07.300864+0000 mon.b (mon.2) 173 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:44:08.707 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:08 smithi051 bash[18409]: audit 2020-06-27T04:44:07.670508+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:44:08.707 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:08 smithi051 bash[18409]: audit 2020-06-27T04:44:07.921681+0000 mon.b (mon.2) 175 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_daemon_update\": \"2020-06-27T04:44:03.739496\", \"last_device_update\": \"2020-06-27T04:44:07.920918\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:08.708 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:08 smithi051 bash[18409]: audit 2020-06-27T04:44:07.922284+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_daemon_update\": \"2020-06-27T04:44:03.739496\", \"last_device_update\": \"2020-06-27T04:44:07.920918\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:08.708 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:08 smithi051 bash[18409]: audit 2020-06-27T04:44:07.925188+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_daemon_update\": \"2020-06-27T04:44:03.739496\", \"last_device_update\": \"2020-06-27T04:44:07.920918\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:08.708 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:08 smithi051 bash[18409]: audit 2020-06-27T04:44:08.243861+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:44:08.708 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:08 smithi051 bash[18409]: audit 2020-06-27T04:44:08.244847+0000 mon.b (mon.2) 177 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:44:08.709 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:08 smithi051 bash[18409]: audit 2020-06-27T04:44:08.245323+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:44:08.709 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:08 smithi051 bash[18409]: audit 2020-06-27T04:44:08.245849+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:44:08.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[18426]: cluster 2020-06-27T04:44:07.123319+0000 mgr.x (mgr.34109) 83 : cluster [DBG] pgmap v84: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:44:08.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[18426]: audit 2020-06-27T04:44:07.300864+0000 mon.b (mon.2) 173 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:44:08.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[18426]: audit 2020-06-27T04:44:07.670508+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:44:08.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[18426]: audit 2020-06-27T04:44:07.921681+0000 mon.b (mon.2) 175 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_daemon_update\": \"2020-06-27T04:44:03.739496\", \"last_device_update\": \"2020-06-27T04:44:07.920918\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:08.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[18426]: audit 2020-06-27T04:44:07.922284+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_daemon_update\": \"2020-06-27T04:44:03.739496\", \"last_device_update\": \"2020-06-27T04:44:07.920918\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:08.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[18426]: audit 2020-06-27T04:44:07.925188+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_daemon_update\": \"2020-06-27T04:44:03.739496\", \"last_device_update\": \"2020-06-27T04:44:07.920918\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:08.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[18426]: audit 2020-06-27T04:44:08.243861+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:44:08.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[18426]: audit 2020-06-27T04:44:08.244847+0000 mon.b (mon.2) 177 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:44:08.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[18426]: audit 2020-06-27T04:44:08.245323+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:44:08.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[18426]: audit 2020-06-27T04:44:08.245849+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:44:08.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[22603]: cluster 2020-06-27T04:44:07.123319+0000 mgr.x (mgr.34109) 83 : cluster [DBG] pgmap v84: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2020-06-27T04:44:08.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[22603]: audit 2020-06-27T04:44:07.300864+0000 mon.b (mon.2) 173 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:44:08.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[22603]: audit 2020-06-27T04:44:07.670508+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:44:08.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[22603]: audit 2020-06-27T04:44:07.921681+0000 mon.b (mon.2) 175 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_daemon_update\": \"2020-06-27T04:44:03.739496\", \"last_device_update\": \"2020-06-27T04:44:07.920918\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:08.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[22603]: audit 2020-06-27T04:44:07.922284+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_daemon_update\": \"2020-06-27T04:44:03.739496\", \"last_device_update\": \"2020-06-27T04:44:07.920918\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:08.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[22603]: audit 2020-06-27T04:44:07.925188+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}}, \"last_daemon_update\": \"2020-06-27T04:44:03.739496\", \"last_device_update\": \"2020-06-27T04:44:07.920918\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:08.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[22603]: audit 2020-06-27T04:44:08.243861+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-06-27T04:44:08.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[22603]: audit 2020-06-27T04:44:08.244847+0000 mon.b (mon.2) 177 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-06-27T04:44:08.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[22603]: audit 2020-06-27T04:44:08.245323+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:44:08.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:08 smithi031 bash[22603]: audit 2020-06-27T04:44:08.245849+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:44:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:09 smithi051 bash[18409]: audit 2020-06-27T04:44:08.243135+0000 mgr.x (mgr.34109) 84 : audit [DBG] from='client.34307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi051:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:44:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:09 smithi051 bash[18409]: cephadm 2020-06-27T04:44:08.244373+0000 mgr.x (mgr.34109) 85 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:44:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:09 smithi051 bash[18409]: cephadm 2020-06-27T04:44:08.244438+0000 mgr.x (mgr.34109) 86 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:44:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:09 smithi051 bash[18409]: cephadm 2020-06-27T04:44:08.244617+0000 mgr.x (mgr.34109) 87 : cephadm [INF] Applying None on host smithi051... 2020-06-27T04:44:09.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:09 smithi051 bash[18409]: cluster 2020-06-27T04:44:08.318228+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2020-06-27T04:44:09.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:09 smithi031 bash[18426]: audit 2020-06-27T04:44:08.243135+0000 mgr.x (mgr.34109) 84 : audit [DBG] from='client.34307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi051:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:44:09.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:09 smithi031 bash[18426]: cephadm 2020-06-27T04:44:08.244373+0000 mgr.x (mgr.34109) 85 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:44:09.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:09 smithi031 bash[18426]: cephadm 2020-06-27T04:44:08.244438+0000 mgr.x (mgr.34109) 86 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:44:09.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:09 smithi031 bash[18426]: cephadm 2020-06-27T04:44:08.244617+0000 mgr.x (mgr.34109) 87 : cephadm [INF] Applying None on host smithi051... 2020-06-27T04:44:09.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:09 smithi031 bash[18426]: cluster 2020-06-27T04:44:08.318228+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2020-06-27T04:44:09.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:09 smithi031 bash[22603]: audit 2020-06-27T04:44:08.243135+0000 mgr.x (mgr.34109) 84 : audit [DBG] from='client.34307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi051:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:44:09.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:09 smithi031 bash[22603]: cephadm 2020-06-27T04:44:08.244373+0000 mgr.x (mgr.34109) 85 : cephadm [INF] Found osd claims -> {} 2020-06-27T04:44:09.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:09 smithi031 bash[22603]: cephadm 2020-06-27T04:44:08.244438+0000 mgr.x (mgr.34109) 86 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-06-27T04:44:09.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:09 smithi031 bash[22603]: cephadm 2020-06-27T04:44:08.244617+0000 mgr.x (mgr.34109) 87 : cephadm [INF] Applying None on host smithi051... 2020-06-27T04:44:09.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:09 smithi031 bash[22603]: cluster 2020-06-27T04:44:08.318228+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2020-06-27T04:44:10.717 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:10 smithi051 bash[18409]: cluster 2020-06-27T04:44:09.123750+0000 mgr.x (mgr.34109) 88 : cluster [DBG] pgmap v87: 1 pgs: 1 peering; 0 B data, 2.3 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:10.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:10 smithi051 bash[18409]: cluster 2020-06-27T04:44:09.316674+0000 mon.a (mon.0) 395 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2020-06-27T04:44:10.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:10 smithi031 bash[18426]: cluster 2020-06-27T04:44:09.123750+0000 mgr.x (mgr.34109) 88 : cluster [DBG] pgmap v87: 1 pgs: 1 peering; 0 B data, 2.3 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:10.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:10 smithi031 bash[18426]: cluster 2020-06-27T04:44:09.316674+0000 mon.a (mon.0) 395 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2020-06-27T04:44:10.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:10 smithi031 bash[22603]: cluster 2020-06-27T04:44:09.123750+0000 mgr.x (mgr.34109) 88 : cluster [DBG] pgmap v87: 1 pgs: 1 peering; 0 B data, 2.3 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:10.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:10 smithi031 bash[22603]: cluster 2020-06-27T04:44:09.316674+0000 mon.a (mon.0) 395 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2020-06-27T04:44:11.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:11 smithi051 bash[18409]: audit 2020-06-27T04:44:10.502598+0000 mon.b (mon.2) 180 : audit [INF] from='client.? 172.21.15.51:0/799090211' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41502006-951e-4786-872a-1fd840460fa7"}]: dispatch 2020-06-27T04:44:11.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:11 smithi051 bash[18409]: audit 2020-06-27T04:44:10.503248+0000 mon.a (mon.0) 396 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41502006-951e-4786-872a-1fd840460fa7"}]: dispatch 2020-06-27T04:44:11.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:11 smithi051 bash[18409]: audit 2020-06-27T04:44:10.507087+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:44:11.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:11 smithi051 bash[18409]: audit 2020-06-27T04:44:10.507131+0000 mon.a (mon.0) 397 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41502006-951e-4786-872a-1fd840460fa7"}]': finished 2020-06-27T04:44:11.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:11 smithi051 bash[18409]: cluster 2020-06-27T04:44:10.507204+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2020-06-27T04:44:11.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:11 smithi051 bash[18409]: audit 2020-06-27T04:44:10.997282+0000 mon.b (mon.2) 182 : audit [DBG] from='client.? 172.21.15.51:0/3381652176' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:44:11.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:11 smithi031 bash[18426]: audit 2020-06-27T04:44:10.502598+0000 mon.b (mon.2) 180 : audit [INF] from='client.? 172.21.15.51:0/799090211' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41502006-951e-4786-872a-1fd840460fa7"}]: dispatch 2020-06-27T04:44:11.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:11 smithi031 bash[18426]: audit 2020-06-27T04:44:10.503248+0000 mon.a (mon.0) 396 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41502006-951e-4786-872a-1fd840460fa7"}]: dispatch 2020-06-27T04:44:11.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:11 smithi031 bash[18426]: audit 2020-06-27T04:44:10.507087+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:44:11.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:11 smithi031 bash[18426]: audit 2020-06-27T04:44:10.507131+0000 mon.a (mon.0) 397 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41502006-951e-4786-872a-1fd840460fa7"}]': finished 2020-06-27T04:44:11.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:11 smithi031 bash[18426]: cluster 2020-06-27T04:44:10.507204+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2020-06-27T04:44:11.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:11 smithi031 bash[18426]: audit 2020-06-27T04:44:10.997282+0000 mon.b (mon.2) 182 : audit [DBG] from='client.? 172.21.15.51:0/3381652176' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:44:11.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:11 smithi031 bash[22603]: audit 2020-06-27T04:44:10.502598+0000 mon.b (mon.2) 180 : audit [INF] from='client.? 172.21.15.51:0/799090211' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41502006-951e-4786-872a-1fd840460fa7"}]: dispatch 2020-06-27T04:44:11.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:11 smithi031 bash[22603]: audit 2020-06-27T04:44:10.503248+0000 mon.a (mon.0) 396 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41502006-951e-4786-872a-1fd840460fa7"}]: dispatch 2020-06-27T04:44:11.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:11 smithi031 bash[22603]: audit 2020-06-27T04:44:10.507087+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:44:11.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:11 smithi031 bash[22603]: audit 2020-06-27T04:44:10.507131+0000 mon.a (mon.0) 397 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41502006-951e-4786-872a-1fd840460fa7"}]': finished 2020-06-27T04:44:11.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:11 smithi031 bash[22603]: cluster 2020-06-27T04:44:10.507204+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2020-06-27T04:44:11.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:11 smithi031 bash[22603]: audit 2020-06-27T04:44:10.997282+0000 mon.b (mon.2) 182 : audit [DBG] from='client.? 172.21.15.51:0/3381652176' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-06-27T04:44:12.911 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:12 smithi051 bash[18409]: cluster 2020-06-27T04:44:11.124139+0000 mgr.x (mgr.34109) 89 : cluster [DBG] pgmap v89: 1 pgs: 1 peering; 0 B data, 2.4 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:12 smithi031 bash[18426]: cluster 2020-06-27T04:44:11.124139+0000 mgr.x (mgr.34109) 89 : cluster [DBG] pgmap v89: 1 pgs: 1 peering; 0 B data, 2.4 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:12.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:12 smithi031 bash[22603]: cluster 2020-06-27T04:44:11.124139+0000 mgr.x (mgr.34109) 89 : cluster [DBG] pgmap v89: 1 pgs: 1 peering; 0 B data, 2.4 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:13.717 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:13 smithi051 bash[18409]: audit 2020-06-27T04:44:13.403491+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:44:13.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:13 smithi031 bash[18426]: audit 2020-06-27T04:44:13.403491+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:44:13.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:13 smithi031 bash[22603]: audit 2020-06-27T04:44:13.403491+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:44:14.913 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:14 smithi051 bash[18409]: cluster 2020-06-27T04:44:13.124526+0000 mgr.x (mgr.34109) 90 : cluster [DBG] pgmap v90: 1 pgs: 1 peering; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:14 smithi031 bash[18426]: cluster 2020-06-27T04:44:13.124526+0000 mgr.x (mgr.34109) 90 : cluster [DBG] pgmap v90: 1 pgs: 1 peering; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:14 smithi031 bash[22603]: cluster 2020-06-27T04:44:13.124526+0000 mgr.x (mgr.34109) 90 : cluster [DBG] pgmap v90: 1 pgs: 1 peering; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:15.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:15 smithi051 bash[18409]: cluster 2020-06-27T04:44:15.516832+0000 mon.a (mon.0) 399 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2020-06-27T04:44:15.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:15 smithi051 bash[18409]: cluster 2020-06-27T04:44:15.516887+0000 mon.a (mon.0) 400 : cluster [INF] Cluster is now healthy 2020-06-27T04:44:15.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:15 smithi031 bash[18426]: cluster 2020-06-27T04:44:15.516832+0000 mon.a (mon.0) 399 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2020-06-27T04:44:15.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:15 smithi031 bash[18426]: cluster 2020-06-27T04:44:15.516887+0000 mon.a (mon.0) 400 : cluster [INF] Cluster is now healthy 2020-06-27T04:44:15.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:15 smithi031 bash[22603]: cluster 2020-06-27T04:44:15.516832+0000 mon.a (mon.0) 399 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2020-06-27T04:44:15.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:15 smithi031 bash[22603]: cluster 2020-06-27T04:44:15.516887+0000 mon.a (mon.0) 400 : cluster [INF] Cluster is now healthy 2020-06-27T04:44:16.630 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:16 smithi051 bash[18409]: cluster 2020-06-27T04:44:15.124983+0000 mgr.x (mgr.34109) 91 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:16.630 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:16 smithi051 bash[18409]: audit 2020-06-27T04:44:15.850112+0000 mon.b (mon.2) 184 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2020-06-27T04:44:16.630 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:16 smithi051 bash[18409]: audit 2020-06-27T04:44:15.850799+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:44:16.631 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:16 smithi051 bash[18409]: audit 2020-06-27T04:44:15.851495+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2020-06-27T04:44:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:16 smithi031 bash[22603]: cluster 2020-06-27T04:44:15.124983+0000 mgr.x (mgr.34109) 91 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:16 smithi031 bash[22603]: audit 2020-06-27T04:44:15.850112+0000 mon.b (mon.2) 184 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2020-06-27T04:44:16.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:16 smithi031 bash[22603]: audit 2020-06-27T04:44:15.850799+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:44:16.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:16 smithi031 bash[22603]: audit 2020-06-27T04:44:15.851495+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2020-06-27T04:44:16.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:16 smithi031 bash[18426]: cluster 2020-06-27T04:44:15.124983+0000 mgr.x (mgr.34109) 91 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:16.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:16 smithi031 bash[18426]: audit 2020-06-27T04:44:15.850112+0000 mon.b (mon.2) 184 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2020-06-27T04:44:16.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:16 smithi031 bash[18426]: audit 2020-06-27T04:44:15.850799+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:44:16.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:16 smithi031 bash[18426]: audit 2020-06-27T04:44:15.851495+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2020-06-27T04:44:17.379 INFO:teuthology.orchestra.run.smithi051.stdout:Created osd(s) 7 on host 'smithi051' 2020-06-27T04:44:17.379 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:17.374+0000 7f98f1ffb700 1 -- 172.21.15.51:0/1860797542 <== mgr.34109 v2:172.21.15.51:6800/950992045 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f98f80077b0 con 0x7f98d802ab00 2020-06-27T04:44:17.380 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:17.377+0000 7f9903965700 1 -- 172.21.15.51:0/1860797542 >> v2:172.21.15.51:6800/950992045 conn(0x7f98d802ab00 msgr2=0x7f98d802cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:17.380 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:17.377+0000 7f9903965700 1 --2- 172.21.15.51:0/1860797542 >> v2:172.21.15.51:6800/950992045 conn(0x7f98d802ab00 0x7f98d802cfc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f98f8016000 tx=0x7f98f8009b30).stop 2020-06-27T04:44:17.380 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:17.377+0000 7f9903965700 1 -- 172.21.15.51:0/1860797542 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f98fc06be30 msgr2=0x7f98fc078360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:17.381 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:17.377+0000 7f9903965700 1 --2- 172.21.15.51:0/1860797542 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f98fc06be30 0x7f98fc078360 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f98ec0040c0 tx=0x7f98ec009d20).stop 2020-06-27T04:44:17.383 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:17.380+0000 7f9903965700 1 -- 172.21.15.51:0/1860797542 shutdown_connections 2020-06-27T04:44:17.383 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:17.380+0000 7f9903965700 1 --2- 172.21.15.51:0/1860797542 >> v2:172.21.15.51:6800/950992045 conn(0x7f98d802ab00 0x7f98d802cfc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:17.383 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:17.380+0000 7f9903965700 1 --2- 172.21.15.51:0/1860797542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98fc078990 0x7f98fc122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:17.383 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:17.380+0000 7f9903965700 1 --2- 172.21.15.51:0/1860797542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98fc066360 0x7f98fc06cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:17.384 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:17.380+0000 7f9903965700 1 --2- 172.21.15.51:0/1860797542 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f98fc06be30 0x7f98fc078360 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:17.384 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:17.380+0000 7f9903965700 1 -- 172.21.15.51:0/1860797542 >> 172.21.15.51:0/1860797542 conn(0x7f98fc061830 msgr2=0x7f98fc06d350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:44:17.384 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:17.381+0000 7f9903965700 1 -- 172.21.15.51:0/1860797542 shutdown_connections 2020-06-27T04:44:17.385 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:17.382+0000 7f9903965700 1 -- 172.21.15.51:0/1860797542 wait complete. 2020-06-27T04:44:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:17 smithi051 bash[18409]: cephadm 2020-06-27T04:44:15.851251+0000 mgr.x (mgr.34109) 92 : cephadm [INF] Deploying daemon osd.7 on smithi051 2020-06-27T04:44:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:17 smithi051 bash[18409]: audit 2020-06-27T04:44:17.371294+0000 mon.b (mon.2) 187 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_device_update\": \"2020-06-27T04:44:07.920918\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:17.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:17 smithi051 bash[18409]: audit 2020-06-27T04:44:17.371581+0000 mon.b (mon.2) 188 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:44:17.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:17 smithi051 bash[18409]: audit 2020-06-27T04:44:17.371900+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_device_update\": \"2020-06-27T04:44:07.920918\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:17.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:17 smithi051 bash[18409]: audit 2020-06-27T04:44:17.374461+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_device_update\": \"2020-06-27T04:44:07.920918\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:17.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:17 smithi031 bash[22603]: cephadm 2020-06-27T04:44:15.851251+0000 mgr.x (mgr.34109) 92 : cephadm [INF] Deploying daemon osd.7 on smithi051 2020-06-27T04:44:17.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:17 smithi031 bash[22603]: audit 2020-06-27T04:44:17.371294+0000 mon.b (mon.2) 187 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_device_update\": \"2020-06-27T04:44:07.920918\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:17.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:17 smithi031 bash[22603]: audit 2020-06-27T04:44:17.371581+0000 mon.b (mon.2) 188 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:44:17.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:17 smithi031 bash[22603]: audit 2020-06-27T04:44:17.371900+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_device_update\": \"2020-06-27T04:44:07.920918\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:17.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:17 smithi031 bash[22603]: audit 2020-06-27T04:44:17.374461+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_device_update\": \"2020-06-27T04:44:07.920918\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:17.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:17 smithi031 bash[18426]: cephadm 2020-06-27T04:44:15.851251+0000 mgr.x (mgr.34109) 92 : cephadm [INF] Deploying daemon osd.7 on smithi051 2020-06-27T04:44:17.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:17 smithi031 bash[18426]: audit 2020-06-27T04:44:17.371294+0000 mon.b (mon.2) 187 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_device_update\": \"2020-06-27T04:44:07.920918\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:17.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:17 smithi031 bash[18426]: audit 2020-06-27T04:44:17.371581+0000 mon.b (mon.2) 188 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:44:17.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:17 smithi031 bash[18426]: audit 2020-06-27T04:44:17.371900+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_device_update\": \"2020-06-27T04:44:07.920918\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:17.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:17 smithi031 bash[18426]: audit 2020-06-27T04:44:17.374461+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.738995\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739072\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739105\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739260\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:03.739356\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_device_update\": \"2020-06-27T04:44:07.920918\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:18.034 INFO:teuthology.orchestra.run.smithi051:osd.7> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service 2020-06-27T04:44:18.037 INFO:tasks.cephadm:Adding ceph.rgw.realm.zone.a on smithi031 2020-06-27T04:44:18.037 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- radosgw-admin realm create --rgw-realm realm --default 2020-06-27T04:44:18.072 INFO:ceph.osd.7.smithi051.stdout:-- Logs begin at Sat 2020-06-27 04:33:02 UTC. -- 2020-06-27T04:44:18.336 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:18 smithi051 podman[27667]: 2020-06-27 04:44:18.085866711 +0000 UTC m=+0.729218112 container start 9c454c13a078e0f3786fe598e80ecf62dd3e4a5756737b2272426b62daaba019 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:44:18.336 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:18 smithi051 podman[27667]: 2020-06-27 04:44:18.085941383 +0000 UTC m=+0.729292796 container attach 9c454c13a078e0f3786fe598e80ecf62dd3e4a5756737b2272426b62daaba019 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:44:18.587 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:18 smithi051 bash[27665]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-06-27T04:44:18.587 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:18 smithi051 bash[27665]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2020-06-27T04:44:18.587 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:18 smithi051 bash[27665]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2020-06-27T04:44:18.587 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:18 smithi051 bash[27665]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2020-06-27T04:44:18.588 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:18 smithi051 bash[27665]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2020-06-27T04:44:18.588 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:18 smithi051 bash[27665]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-06-27T04:44:18.588 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:18 smithi051 bash[27665]: --> ceph-volume lvm activate successful for osd ID: 7 2020-06-27T04:44:18.588 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:18 smithi051 podman[27667]: 2020-06-27 04:44:18.430805959 +0000 UTC m=+1.074157370 container died 9c454c13a078e0f3786fe598e80ecf62dd3e4a5756737b2272426b62daaba019 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:44:18.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:18 smithi051 bash[18409]: cluster 2020-06-27T04:44:17.125272+0000 mgr.x (mgr.34109) 93 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:18 smithi031 bash[22603]: cluster 2020-06-27T04:44:17.125272+0000 mgr.x (mgr.34109) 93 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:18 smithi031 bash[18426]: cluster 2020-06-27T04:44:17.125272+0000 mgr.x (mgr.34109) 93 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:19.347 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:19 smithi051 podman[27667]: 2020-06-27 04:44:19.063539119 +0000 UTC m=+1.706890547 container remove 9c454c13a078e0f3786fe598e80ecf62dd3e4a5756737b2272426b62daaba019 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:44:19.348 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:19 smithi051 bash[27665]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7 found: no such container 2020-06-27T04:44:19.348 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:19 smithi051 bash[27665]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7 2020-06-27T04:44:19.348 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:19 smithi051 bash[27665]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7" found: no such container 2020-06-27T04:44:20.046 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:19 smithi051 podman[27994]: 2020-06-27 04:44:19.785879975 +0000 UTC m=+0.613140948 container create 6ff3e9a565265712a1d93d02308d35a5a39802881a49facbdd764e07206681e6 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:44:20.046 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 podman[27994]: 2020-06-27 04:44:20.011185707 +0000 UTC m=+0.838446800 container init 6ff3e9a565265712a1d93d02308d35a5a39802881a49facbdd764e07206681e6 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:44:20.297 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 podman[27994]: 2020-06-27 04:44:20.043896836 +0000 UTC m=+0.871157825 container start 6ff3e9a565265712a1d93d02308d35a5a39802881a49facbdd764e07206681e6 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:44:20.297 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 podman[27994]: 2020-06-27 04:44:20.043989193 +0000 UTC m=+0.871250184 container attach 6ff3e9a565265712a1d93d02308d35a5a39802881a49facbdd764e07206681e6 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:44:20.297 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f100da06700 5 --2- 172.21.15.51:0/411207750 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55a79743cc00 0x55a7973ad400 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0x55a7973bfa70 tx=0x55a79738cf00).reset_recv_state (warped) reseting crypto handlers 2020-06-27T04:44:20.298 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f100da06700 5 --2- 172.21.15.51:0/411207750 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55a79743cc00 0x55a7973ad400 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0x55a7973bfa70 tx=0x55a79738cf00).reset_security 2020-06-27T04:44:20.298 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 10 -- 172.21.15.51:0/411207750 shutdown 172.21.15.51:0/411207750 2020-06-27T04:44:20.298 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 10 Processor -- stop 2020-06-27T04:44:20.298 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 20 Event(0x55a7973d0e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:44:20.298 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f100da06700 20 EpollDriver.del_event del event fd=14 cur_mask=1 delmask=3 to 8 2020-06-27T04:44:20.299 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f100ca04700 10 -- 172.21.15.51:0/411207750 dispatch_throttle_release 383 to dispatch throttler 383/104857600 2020-06-27T04:44:20.299 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f100ca04700 20 -- 172.21.15.51:0/411207750 done calling dispatch on 0x55a7973b8c60 2020-06-27T04:44:20.299 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 1 -- 172.21.15.51:0/411207750 shutdown_connections 2020-06-27T04:44:20.299 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 5 -- 172.21.15.51:0/411207750 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55a79743cc00 2020-06-27T04:44:20.299 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 1 --2- 172.21.15.51:0/411207750 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55a79743cc00 0x55a7973ad400 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:20.300 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 5 -- 172.21.15.51:0/411207750 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55a79743d400 2020-06-27T04:44:20.300 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 1 --2- 172.21.15.51:0/411207750 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a79743d400 0x55a7973ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:20.300 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 5 -- 172.21.15.51:0/411207750 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55a79743d000 2020-06-27T04:44:20.300 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 1 --2- 172.21.15.51:0/411207750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a79743d000 0x55a7973ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:20.300 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 5 -- 172.21.15.51:0/411207750 shutdown_connections delete 0x55a79743cc00 2020-06-27T04:44:20.301 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 5 -- 172.21.15.51:0/411207750 shutdown_connections delete 0x55a79743d000 2020-06-27T04:44:20.301 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 5 -- 172.21.15.51:0/411207750 shutdown_connections delete 0x55a79743d400 2020-06-27T04:44:20.301 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 1 -- 172.21.15.51:0/411207750 >> 172.21.15.51:0/411207750 conn(0x55a79743c800 msgr2=0x55a7974a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:44:20.301 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 20 --1- 172.21.15.51:0/411207750 >> 172.21.15.51:0/411207750 conn(0x55a79743c800 0x55a7974a5000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:44:20.301 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 2 --1- 172.21.15.51:0/411207750 >> 172.21.15.51:0/411207750 conn(0x55a79743c800 0x55a7974a5000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:44:20.301 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 5 --1- 172.21.15.51:0/411207750 >> 172.21.15.51:0/411207750 conn(0x55a79743c800 0x55a7974a5000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:44:20.302 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 20 Event(0x55a7973d0e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:44:20.302 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 10 --1- 172.21.15.51:0/411207750 >> 172.21.15.51:0/411207750 conn(0x55a79743c800 0x55a7974a5000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:44:20.302 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 20 Event(0x55a7973d0e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:44:20.302 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 20 Event(0x55a7973d1040 nevent=5000 time_id=3).wakeup 2020-06-27T04:44:20.302 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f100e207700 5 --1- 172.21.15.51:0/411207750 >> 172.21.15.51:0/411207750 conn(0x55a79743c800 0x55a7974a5000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:44:20.303 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 20 Event(0x55a7973d1280 nevent=5000 time_id=2).wakeup 2020-06-27T04:44:20.303 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f100e207700 5 --1- 172.21.15.51:0/411207750 >> 172.21.15.51:0/411207750 conn(0x55a79743c800 0x55a7974a5000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:44:20.303 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 10 -- 172.21.15.51:0/411207750 wait: waiting for dispatch queue 2020-06-27T04:44:20.303 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 10 -- 172.21.15.51:0/411207750 wait: dispatch queue is stopped 2020-06-27T04:44:20.303 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 1 -- 172.21.15.51:0/411207750 shutdown_connections 2020-06-27T04:44:20.304 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 5 -- 172.21.15.51:0/411207750 shutdown_connections delete 0x55a79743c800 2020-06-27T04:44:20.304 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 20 Event(0x55a7973d0e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:44:20.304 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 20 Event(0x55a7973d1040 nevent=5000 time_id=3).wakeup 2020-06-27T04:44:20.304 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 20 Event(0x55a7973d1280 nevent=5000 time_id=2).wakeup 2020-06-27T04:44:20.304 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 10 -- 172.21.15.51:0/411207750 wait: done. 2020-06-27T04:44:20.304 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.036+0000 7f1014484f40 1 -- 172.21.15.51:0/411207750 wait complete. 2020-06-27T04:44:20.866 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[27665]: debug 2020-06-27T04:44:20.556+0000 7f1014484f40 -1 Falling back to public interface 2020-06-27T04:44:21.125 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[18409]: cluster 2020-06-27T04:44:19.125563+0000 mgr.x (mgr.34109) 94 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:21.126 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[18409]: audit 2020-06-27T04:44:20.248650+0000 mon.b (mon.2) 189 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_daemon_update\": \"2020-06-27T04:44:20.247939\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:21.126 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[18409]: audit 2020-06-27T04:44:20.249313+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_daemon_update\": \"2020-06-27T04:44:20.247939\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:21.126 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[18409]: audit 2020-06-27T04:44:20.252065+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_daemon_update\": \"2020-06-27T04:44:20.247939\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:21.127 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:20 smithi051 bash[18409]: audit 2020-06-27T04:44:20.252812+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:44:21.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:20 smithi031 bash[18426]: cluster 2020-06-27T04:44:19.125563+0000 mgr.x (mgr.34109) 94 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:21.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:20 smithi031 bash[18426]: audit 2020-06-27T04:44:20.248650+0000 mon.b (mon.2) 189 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_daemon_update\": \"2020-06-27T04:44:20.247939\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:21.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:20 smithi031 bash[18426]: audit 2020-06-27T04:44:20.249313+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_daemon_update\": \"2020-06-27T04:44:20.247939\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:21.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:20 smithi031 bash[18426]: audit 2020-06-27T04:44:20.252065+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_daemon_update\": \"2020-06-27T04:44:20.247939\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:21.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:20 smithi031 bash[18426]: audit 2020-06-27T04:44:20.252812+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:44:21.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:20 smithi031 bash[22603]: cluster 2020-06-27T04:44:19.125563+0000 mgr.x (mgr.34109) 94 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:21.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:20 smithi031 bash[22603]: audit 2020-06-27T04:44:20.248650+0000 mon.b (mon.2) 189 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_daemon_update\": \"2020-06-27T04:44:20.247939\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:21.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:20 smithi031 bash[22603]: audit 2020-06-27T04:44:20.249313+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_daemon_update\": \"2020-06-27T04:44:20.247939\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:21.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:20 smithi031 bash[22603]: audit 2020-06-27T04:44:20.252065+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_daemon_update\": \"2020-06-27T04:44:20.247939\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:21.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:20 smithi031 bash[22603]: audit 2020-06-27T04:44:20.252812+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T04:44:21.467 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:21 smithi051 bash[27665]: debug 2020-06-27T04:44:21.121+0000 7f1014484f40 -1 osd.7 0 log_to_monitors {default=true} 2020-06-27T04:44:21.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:21 smithi051 bash[18409]: audit 2020-06-27T04:44:21.125793+0000 mon.b (mon.2) 191 : audit [INF] from='osd.7 v2:172.21.15.51:6813/1443623027' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:44:21.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:21 smithi051 bash[18409]: cluster 2020-06-27T04:44:21.125888+0000 mgr.x (mgr.34109) 95 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:21.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:21 smithi051 bash[18409]: audit 2020-06-27T04:44:21.126132+0000 mon.a (mon.0) 405 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:44:21.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:21 smithi051 bash[18409]: audit 2020-06-27T04:44:21.258029+0000 mon.b (mon.2) 192 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:44:21.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:21 smithi051 bash[18409]: audit 2020-06-27T04:44:21.259891+0000 mon.a (mon.0) 406 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2020-06-27T04:44:21.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:21 smithi051 bash[18409]: cluster 2020-06-27T04:44:21.260063+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2020-06-27T04:44:21.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:21 smithi051 bash[18409]: audit 2020-06-27T04:44:21.261415+0000 mon.b (mon.2) 193 : audit [INF] from='client.? 172.21.15.51:0/1374490498' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2020-06-27T04:44:21.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:21 smithi051 bash[18409]: audit 2020-06-27T04:44:21.262039+0000 mon.a (mon.0) 408 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2020-06-27T04:44:21.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:21 smithi051 bash[18409]: audit 2020-06-27T04:44:21.264264+0000 mon.b (mon.2) 194 : audit [INF] from='osd.7 v2:172.21.15.51:6813/1443623027' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:44:21.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:21 smithi051 bash[18409]: audit 2020-06-27T04:44:21.264734+0000 mon.a (mon.0) 409 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:44:22.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[22603]: audit 2020-06-27T04:44:21.125793+0000 mon.b (mon.2) 191 : audit [INF] from='osd.7 v2:172.21.15.51:6813/1443623027' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:44:22.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[22603]: cluster 2020-06-27T04:44:21.125888+0000 mgr.x (mgr.34109) 95 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:22.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[22603]: audit 2020-06-27T04:44:21.126132+0000 mon.a (mon.0) 405 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:44:22.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[22603]: audit 2020-06-27T04:44:21.258029+0000 mon.b (mon.2) 192 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:44:22.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[22603]: audit 2020-06-27T04:44:21.259891+0000 mon.a (mon.0) 406 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2020-06-27T04:44:22.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[22603]: cluster 2020-06-27T04:44:21.260063+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2020-06-27T04:44:22.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[22603]: audit 2020-06-27T04:44:21.261415+0000 mon.b (mon.2) 193 : audit [INF] from='client.? 172.21.15.51:0/1374490498' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2020-06-27T04:44:22.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[22603]: audit 2020-06-27T04:44:21.262039+0000 mon.a (mon.0) 408 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2020-06-27T04:44:22.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[22603]: audit 2020-06-27T04:44:21.264264+0000 mon.b (mon.2) 194 : audit [INF] from='osd.7 v2:172.21.15.51:6813/1443623027' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:44:22.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[22603]: audit 2020-06-27T04:44:21.264734+0000 mon.a (mon.0) 409 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:44:22.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[18426]: audit 2020-06-27T04:44:21.125793+0000 mon.b (mon.2) 191 : audit [INF] from='osd.7 v2:172.21.15.51:6813/1443623027' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:44:22.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[18426]: cluster 2020-06-27T04:44:21.125888+0000 mgr.x (mgr.34109) 95 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:22.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[18426]: audit 2020-06-27T04:44:21.126132+0000 mon.a (mon.0) 405 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:44:22.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[18426]: audit 2020-06-27T04:44:21.258029+0000 mon.b (mon.2) 192 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:44:22.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[18426]: audit 2020-06-27T04:44:21.259891+0000 mon.a (mon.0) 406 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2020-06-27T04:44:22.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[18426]: cluster 2020-06-27T04:44:21.260063+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2020-06-27T04:44:22.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[18426]: audit 2020-06-27T04:44:21.261415+0000 mon.b (mon.2) 193 : audit [INF] from='client.? 172.21.15.51:0/1374490498' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2020-06-27T04:44:22.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[18426]: audit 2020-06-27T04:44:21.262039+0000 mon.a (mon.0) 408 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2020-06-27T04:44:22.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[18426]: audit 2020-06-27T04:44:21.264264+0000 mon.b (mon.2) 194 : audit [INF] from='osd.7 v2:172.21.15.51:6813/1443623027' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:44:22.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:21 smithi031 bash[18426]: audit 2020-06-27T04:44:21.264734+0000 mon.a (mon.0) 409 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:44:22.718 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:44:22 smithi051 bash[27665]: debug 2020-06-27T04:44:22.262+0000 7f100aa00700 -1 osd.7 0 waiting for initial osdmap 2020-06-27T04:44:23.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:23 smithi051 bash[18409]: cluster 2020-06-27T04:44:22.115172+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:44:23.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:23 smithi051 bash[18409]: cluster 2020-06-27T04:44:22.115289+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:44:23.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:23 smithi051 bash[18409]: audit 2020-06-27T04:44:22.256361+0000 mon.a (mon.0) 410 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2020-06-27T04:44:23.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:23 smithi051 bash[18409]: audit 2020-06-27T04:44:22.256433+0000 mon.b (mon.2) 195 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:44:23.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:23 smithi051 bash[18409]: audit 2020-06-27T04:44:22.256478+0000 mon.a (mon.0) 411 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]': finished 2020-06-27T04:44:23.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:23 smithi051 bash[18409]: cluster 2020-06-27T04:44:22.256613+0000 mon.a (mon.0) 412 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2020-06-27T04:44:23.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:23 smithi051 bash[18409]: audit 2020-06-27T04:44:22.265792+0000 mon.b (mon.2) 196 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:44:23.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:23 smithi051 bash[18409]: audit 2020-06-27T04:44:22.280737+0000 mon.b (mon.2) 197 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}, {\"id\": \"69c55725-a555-4ffc-843e-010b80b5a68d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1593233047.300462, \"finished_at\": 1593233057.3832364}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:44:23.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:23 smithi051 bash[18409]: audit 2020-06-27T04:44:22.281064+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}, {\"id\": \"69c55725-a555-4ffc-843e-010b80b5a68d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1593233047.300462, \"finished_at\": 1593233057.3832364}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:44:23.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:23 smithi051 bash[18409]: audit 2020-06-27T04:44:22.283754+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}, {\"id\": \"69c55725-a555-4ffc-843e-010b80b5a68d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1593233047.300462, \"finished_at\": 1593233057.3832364}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-06-27T04:44:23.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[22603]: cluster 2020-06-27T04:44:22.115172+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:44:23.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[22603]: cluster 2020-06-27T04:44:22.115289+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:44:23.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[22603]: audit 2020-06-27T04:44:22.256361+0000 mon.a (mon.0) 410 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2020-06-27T04:44:23.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[22603]: audit 2020-06-27T04:44:22.256433+0000 mon.b (mon.2) 195 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:44:23.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[22603]: audit 2020-06-27T04:44:22.256478+0000 mon.a (mon.0) 411 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]': finished 2020-06-27T04:44:23.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[22603]: cluster 2020-06-27T04:44:22.256613+0000 mon.a (mon.0) 412 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2020-06-27T04:44:23.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[22603]: audit 2020-06-27T04:44:22.265792+0000 mon.b (mon.2) 196 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:44:23.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[22603]: audit 2020-06-27T04:44:22.280737+0000 mon.b (mon.2) 197 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}, {\"id\": \"69c55725-a555-4ffc-843e-010b80b5a68d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1593233047.300462, \"finished_at\": 1593233057.3832364}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:44:23.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[22603]: audit 2020-06-27T04:44:22.281064+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}, {\"id\": \"69c55725-a555-4ffc-843e-010b80b5a68d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1593233047.300462, \"finished_at\": 1593233057.3832364}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:44:23.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[22603]: audit 2020-06-27T04:44:22.283754+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}, {\"id\": \"69c55725-a555-4ffc-843e-010b80b5a68d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1593233047.300462, \"finished_at\": 1593233057.3832364}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-06-27T04:44:23.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[18426]: cluster 2020-06-27T04:44:22.115172+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2020-06-27T04:44:23.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[18426]: cluster 2020-06-27T04:44:22.115289+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2020-06-27T04:44:23.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[18426]: audit 2020-06-27T04:44:22.256361+0000 mon.a (mon.0) 410 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2020-06-27T04:44:23.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[18426]: audit 2020-06-27T04:44:22.256433+0000 mon.b (mon.2) 195 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:44:23.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[18426]: audit 2020-06-27T04:44:22.256478+0000 mon.a (mon.0) 411 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]': finished 2020-06-27T04:44:23.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[18426]: cluster 2020-06-27T04:44:22.256613+0000 mon.a (mon.0) 412 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2020-06-27T04:44:23.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[18426]: audit 2020-06-27T04:44:22.265792+0000 mon.b (mon.2) 196 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:44:23.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[18426]: audit 2020-06-27T04:44:22.280737+0000 mon.b (mon.2) 197 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}, {\"id\": \"69c55725-a555-4ffc-843e-010b80b5a68d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1593233047.300462, \"finished_at\": 1593233057.3832364}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:44:23.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[18426]: audit 2020-06-27T04:44:22.281064+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}, {\"id\": \"69c55725-a555-4ffc-843e-010b80b5a68d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1593233047.300462, \"finished_at\": 1593233057.3832364}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:44:23.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:23 smithi031 bash[18426]: audit 2020-06-27T04:44:22.283754+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}, {\"id\": \"69c55725-a555-4ffc-843e-010b80b5a68d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1593233047.300462, \"finished_at\": 1593233057.3832364}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-06-27T04:44:24.306 INFO:teuthology.orchestra.run.smithi051.stdout:{ 2020-06-27T04:44:24.306 INFO:teuthology.orchestra.run.smithi051.stdout: "id": "a321c108-5eb9-4ed2-92be-e49f8859a1ec", 2020-06-27T04:44:24.306 INFO:teuthology.orchestra.run.smithi051.stdout: "name": "realm", 2020-06-27T04:44:24.307 INFO:teuthology.orchestra.run.smithi051.stdout: "current_period": "a1d305cc-2402-4413-b762-168b3308a6b1", 2020-06-27T04:44:24.307 INFO:teuthology.orchestra.run.smithi051.stdout: "epoch": 1 2020-06-27T04:44:24.307 INFO:teuthology.orchestra.run.smithi051.stdout:} 2020-06-27T04:44:24.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:24 smithi051 bash[18409]: cluster 2020-06-27T04:44:23.126492+0000 mgr.x (mgr.34109) 96 : cluster [DBG] pgmap v97: 33 pgs: 1 creating+peering, 6 active+clean, 26 unknown; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:24.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:24 smithi051 bash[18409]: cluster 2020-06-27T04:44:23.259723+0000 mon.a (mon.0) 415 : cluster [INF] osd.7 v2:172.21.15.51:6813/1443623027 boot 2020-06-27T04:44:24.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:24 smithi051 bash[18409]: cluster 2020-06-27T04:44:23.259773+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2020-06-27T04:44:24.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:24 smithi051 bash[18409]: audit 2020-06-27T04:44:23.260822+0000 mon.b (mon.2) 198 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:44:24.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:24 smithi051 bash[18409]: audit 2020-06-27T04:44:23.303756+0000 mon.b (mon.2) 199 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:44:24.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:24 smithi051 bash[18409]: audit 2020-06-27T04:44:23.544229+0000 mon.b (mon.2) 200 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_daemon_update\": \"2020-06-27T04:44:20.247939\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:24.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:24 smithi051 bash[18409]: audit 2020-06-27T04:44:23.544906+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_daemon_update\": \"2020-06-27T04:44:20.247939\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:24.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:24 smithi051 bash[18409]: audit 2020-06-27T04:44:23.547947+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_daemon_update\": \"2020-06-27T04:44:20.247939\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:24.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:24 smithi031 bash[22603]: cluster 2020-06-27T04:44:23.126492+0000 mgr.x (mgr.34109) 96 : cluster [DBG] pgmap v97: 33 pgs: 1 creating+peering, 6 active+clean, 26 unknown; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:24.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:24 smithi031 bash[22603]: cluster 2020-06-27T04:44:23.259723+0000 mon.a (mon.0) 415 : cluster [INF] osd.7 v2:172.21.15.51:6813/1443623027 boot 2020-06-27T04:44:24.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:24 smithi031 bash[22603]: cluster 2020-06-27T04:44:23.259773+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2020-06-27T04:44:24.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:24 smithi031 bash[22603]: audit 2020-06-27T04:44:23.260822+0000 mon.b (mon.2) 198 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:44:24.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:24 smithi031 bash[22603]: audit 2020-06-27T04:44:23.303756+0000 mon.b (mon.2) 199 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:44:24.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:24 smithi031 bash[22603]: audit 2020-06-27T04:44:23.544229+0000 mon.b (mon.2) 200 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_daemon_update\": \"2020-06-27T04:44:20.247939\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:24.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:24 smithi031 bash[22603]: audit 2020-06-27T04:44:23.544906+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_daemon_update\": \"2020-06-27T04:44:20.247939\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:24.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:24 smithi031 bash[22603]: audit 2020-06-27T04:44:23.547947+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_daemon_update\": \"2020-06-27T04:44:20.247939\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:24.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:24 smithi031 bash[18426]: cluster 2020-06-27T04:44:23.126492+0000 mgr.x (mgr.34109) 96 : cluster [DBG] pgmap v97: 33 pgs: 1 creating+peering, 6 active+clean, 26 unknown; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2020-06-27T04:44:24.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:24 smithi031 bash[18426]: cluster 2020-06-27T04:44:23.259723+0000 mon.a (mon.0) 415 : cluster [INF] osd.7 v2:172.21.15.51:6813/1443623027 boot 2020-06-27T04:44:24.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:24 smithi031 bash[18426]: cluster 2020-06-27T04:44:23.259773+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2020-06-27T04:44:24.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:24 smithi031 bash[18426]: audit 2020-06-27T04:44:23.260822+0000 mon.b (mon.2) 198 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:44:24.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:24 smithi031 bash[18426]: audit 2020-06-27T04:44:23.303756+0000 mon.b (mon.2) 199 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:44:24.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:24 smithi031 bash[18426]: audit 2020-06-27T04:44:23.544229+0000 mon.b (mon.2) 200 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_daemon_update\": \"2020-06-27T04:44:20.247939\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:24.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:24 smithi031 bash[18426]: audit 2020-06-27T04:44:23.544906+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_daemon_update\": \"2020-06-27T04:44:20.247939\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:24.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:24 smithi031 bash[18426]: audit 2020-06-27T04:44:23.547947+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}}, \"last_daemon_update\": \"2020-06-27T04:44:20.247939\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:24.922 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- radosgw-admin zonegroup create --rgw-zonegroup=default --master --default 2020-06-27T04:44:25.595 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:25 smithi051 bash[18409]: cluster 2020-06-27T04:44:24.262432+0000 mon.a (mon.0) 419 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2020-06-27T04:44:25.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:25 smithi031 bash[22603]: cluster 2020-06-27T04:44:24.262432+0000 mon.a (mon.0) 419 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2020-06-27T04:44:25.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:25 smithi031 bash[18426]: cluster 2020-06-27T04:44:24.262432+0000 mon.a (mon.0) 419 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2020-06-27T04:44:26.386 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:26 smithi051 bash[18409]: cluster 2020-06-27T04:44:25.126932+0000 mgr.x (mgr.34109) 97 : cluster [DBG] pgmap v100: 33 pgs: 1 peering, 7 creating+peering, 14 active+clean, 11 unknown; 247 B data, 3.0 MiB used, 707 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2020-06-27T04:44:26.387 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:26 smithi051 bash[18409]: cluster 2020-06-27T04:44:25.276294+0000 mon.a (mon.0) 420 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2020-06-27T04:44:26.514 INFO:teuthology.orchestra.run.smithi051.stdout:{ 2020-06-27T04:44:26.514 INFO:teuthology.orchestra.run.smithi051.stdout: "id": "056f2207-b25d-4454-ba77-b8f232cd23bd", 2020-06-27T04:44:26.514 INFO:teuthology.orchestra.run.smithi051.stdout: "name": "default", 2020-06-27T04:44:26.515 INFO:teuthology.orchestra.run.smithi051.stdout: "api_name": "default", 2020-06-27T04:44:26.515 INFO:teuthology.orchestra.run.smithi051.stdout: "is_master": "true", 2020-06-27T04:44:26.515 INFO:teuthology.orchestra.run.smithi051.stdout: "endpoints": [], 2020-06-27T04:44:26.515 INFO:teuthology.orchestra.run.smithi051.stdout: "hostnames": [], 2020-06-27T04:44:26.515 INFO:teuthology.orchestra.run.smithi051.stdout: "hostnames_s3website": [], 2020-06-27T04:44:26.516 INFO:teuthology.orchestra.run.smithi051.stdout: "master_zone": "", 2020-06-27T04:44:26.516 INFO:teuthology.orchestra.run.smithi051.stdout: "zones": [], 2020-06-27T04:44:26.516 INFO:teuthology.orchestra.run.smithi051.stdout: "placement_targets": [], 2020-06-27T04:44:26.516 INFO:teuthology.orchestra.run.smithi051.stdout: "default_placement": "", 2020-06-27T04:44:26.516 INFO:teuthology.orchestra.run.smithi051.stdout: "realm_id": "a321c108-5eb9-4ed2-92be-e49f8859a1ec", 2020-06-27T04:44:26.516 INFO:teuthology.orchestra.run.smithi051.stdout: "sync_policy": { 2020-06-27T04:44:26.517 INFO:teuthology.orchestra.run.smithi051.stdout: "groups": [] 2020-06-27T04:44:26.517 INFO:teuthology.orchestra.run.smithi051.stdout: } 2020-06-27T04:44:26.517 INFO:teuthology.orchestra.run.smithi051.stdout:} 2020-06-27T04:44:26.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:26 smithi031 bash[18426]: cluster 2020-06-27T04:44:25.126932+0000 mgr.x (mgr.34109) 97 : cluster [DBG] pgmap v100: 33 pgs: 1 peering, 7 creating+peering, 14 active+clean, 11 unknown; 247 B data, 3.0 MiB used, 707 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2020-06-27T04:44:26.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:26 smithi031 bash[18426]: cluster 2020-06-27T04:44:25.276294+0000 mon.a (mon.0) 420 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2020-06-27T04:44:26.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:26 smithi031 bash[22603]: cluster 2020-06-27T04:44:25.126932+0000 mgr.x (mgr.34109) 97 : cluster [DBG] pgmap v100: 33 pgs: 1 peering, 7 creating+peering, 14 active+clean, 11 unknown; 247 B data, 3.0 MiB used, 707 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2020-06-27T04:44:26.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:26 smithi031 bash[22603]: cluster 2020-06-27T04:44:25.276294+0000 mon.a (mon.0) 420 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2020-06-27T04:44:27.028 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- radosgw-admin zone create --rgw-zonegroup=default --rgw-zone zone --master --default 2020-06-27T04:44:28.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:28 smithi051 bash[18409]: cluster 2020-06-27T04:44:27.127289+0000 mgr.x (mgr.34109) 98 : cluster [DBG] pgmap v102: 33 pgs: 1 peering, 7 creating+peering, 25 active+clean; 408 B data, 3.2 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s wr, 1 op/s 2020-06-27T04:44:28.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:28 smithi031 bash[18426]: cluster 2020-06-27T04:44:27.127289+0000 mgr.x (mgr.34109) 98 : cluster [DBG] pgmap v102: 33 pgs: 1 peering, 7 creating+peering, 25 active+clean; 408 B data, 3.2 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s wr, 1 op/s 2020-06-27T04:44:28.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:28 smithi031 bash[22603]: cluster 2020-06-27T04:44:27.127289+0000 mgr.x (mgr.34109) 98 : cluster [DBG] pgmap v102: 33 pgs: 1 peering, 7 creating+peering, 25 active+clean; 408 B data, 3.2 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s wr, 1 op/s 2020-06-27T04:44:28.689 INFO:teuthology.orchestra.run.smithi051.stdout:{ 2020-06-27T04:44:28.690 INFO:teuthology.orchestra.run.smithi051.stdout: "id": "2170d6b9-4c2b-4044-aea7-e8f368afbe30", 2020-06-27T04:44:28.690 INFO:teuthology.orchestra.run.smithi051.stdout: "name": "zone", 2020-06-27T04:44:28.690 INFO:teuthology.orchestra.run.smithi051.stdout: "domain_root": "zone.rgw.meta:root", 2020-06-27T04:44:28.690 INFO:teuthology.orchestra.run.smithi051.stdout: "control_pool": "zone.rgw.control", 2020-06-27T04:44:28.690 INFO:teuthology.orchestra.run.smithi051.stdout: "gc_pool": "zone.rgw.log:gc", 2020-06-27T04:44:28.691 INFO:teuthology.orchestra.run.smithi051.stdout: "lc_pool": "zone.rgw.log:lc", 2020-06-27T04:44:28.691 INFO:teuthology.orchestra.run.smithi051.stdout: "log_pool": "zone.rgw.log", 2020-06-27T04:44:28.691 INFO:teuthology.orchestra.run.smithi051.stdout: "intent_log_pool": "zone.rgw.log:intent", 2020-06-27T04:44:28.691 INFO:teuthology.orchestra.run.smithi051.stdout: "usage_log_pool": "zone.rgw.log:usage", 2020-06-27T04:44:28.691 INFO:teuthology.orchestra.run.smithi051.stdout: "roles_pool": "zone.rgw.meta:roles", 2020-06-27T04:44:28.691 INFO:teuthology.orchestra.run.smithi051.stdout: "reshard_pool": "zone.rgw.log:reshard", 2020-06-27T04:44:28.692 INFO:teuthology.orchestra.run.smithi051.stdout: "user_keys_pool": "zone.rgw.meta:users.keys", 2020-06-27T04:44:28.692 INFO:teuthology.orchestra.run.smithi051.stdout: "user_email_pool": "zone.rgw.meta:users.email", 2020-06-27T04:44:28.692 INFO:teuthology.orchestra.run.smithi051.stdout: "user_swift_pool": "zone.rgw.meta:users.swift", 2020-06-27T04:44:28.692 INFO:teuthology.orchestra.run.smithi051.stdout: "user_uid_pool": "zone.rgw.meta:users.uid", 2020-06-27T04:44:28.692 INFO:teuthology.orchestra.run.smithi051.stdout: "otp_pool": "zone.rgw.otp", 2020-06-27T04:44:28.693 INFO:teuthology.orchestra.run.smithi051.stdout: "system_key": { 2020-06-27T04:44:28.693 INFO:teuthology.orchestra.run.smithi051.stdout: "access_key": "", 2020-06-27T04:44:28.693 INFO:teuthology.orchestra.run.smithi051.stdout: "secret_key": "" 2020-06-27T04:44:28.693 INFO:teuthology.orchestra.run.smithi051.stdout: }, 2020-06-27T04:44:28.693 INFO:teuthology.orchestra.run.smithi051.stdout: "placement_pools": [ 2020-06-27T04:44:28.693 INFO:teuthology.orchestra.run.smithi051.stdout: { 2020-06-27T04:44:28.694 INFO:teuthology.orchestra.run.smithi051.stdout: "key": "default-placement", 2020-06-27T04:44:28.694 INFO:teuthology.orchestra.run.smithi051.stdout: "val": { 2020-06-27T04:44:28.694 INFO:teuthology.orchestra.run.smithi051.stdout: "index_pool": "zone.rgw.buckets.index", 2020-06-27T04:44:28.694 INFO:teuthology.orchestra.run.smithi051.stdout: "storage_classes": { 2020-06-27T04:44:28.694 INFO:teuthology.orchestra.run.smithi051.stdout: "STANDARD": { 2020-06-27T04:44:28.695 INFO:teuthology.orchestra.run.smithi051.stdout: "data_pool": "zone.rgw.buckets.data" 2020-06-27T04:44:28.695 INFO:teuthology.orchestra.run.smithi051.stdout: } 2020-06-27T04:44:28.695 INFO:teuthology.orchestra.run.smithi051.stdout: }, 2020-06-27T04:44:28.695 INFO:teuthology.orchestra.run.smithi051.stdout: "data_extra_pool": "zone.rgw.buckets.non-ec", 2020-06-27T04:44:28.695 INFO:teuthology.orchestra.run.smithi051.stdout: "index_type": 0 2020-06-27T04:44:28.695 INFO:teuthology.orchestra.run.smithi051.stdout: } 2020-06-27T04:44:28.696 INFO:teuthology.orchestra.run.smithi051.stdout: } 2020-06-27T04:44:28.696 INFO:teuthology.orchestra.run.smithi051.stdout: ], 2020-06-27T04:44:28.696 INFO:teuthology.orchestra.run.smithi051.stdout: "realm_id": "a321c108-5eb9-4ed2-92be-e49f8859a1ec" 2020-06-27T04:44:28.696 INFO:teuthology.orchestra.run.smithi051.stdout:} 2020-06-27T04:44:29.191 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph orch apply rgw realm zone --placement '1;smithi031=realm.zone.a' 2020-06-27T04:44:30.462 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:30 smithi051 bash[18409]: cluster 2020-06-27T04:44:29.127933+0000 mgr.x (mgr.34109) 99 : cluster [DBG] pgmap v103: 33 pgs: 33 active+clean; 616 B data, 3.4 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s wr, 2 op/s 2020-06-27T04:44:30.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:30 smithi031 bash[18426]: cluster 2020-06-27T04:44:29.127933+0000 mgr.x (mgr.34109) 99 : cluster [DBG] pgmap v103: 33 pgs: 33 active+clean; 616 B data, 3.4 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s wr, 2 op/s 2020-06-27T04:44:30.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:30 smithi031 bash[22603]: cluster 2020-06-27T04:44:29.127933+0000 mgr.x (mgr.34109) 99 : cluster [DBG] pgmap v103: 33 pgs: 33 active+clean; 616 B data, 3.4 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s wr, 2 op/s 2020-06-27T04:44:30.911 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.906+0000 7f76c2982700 1 Processor -- start 2020-06-27T04:44:30.911 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.906+0000 7f76c2982700 1 -- start start 2020-06-27T04:44:30.911 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c2982700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76bc066370 0x7f76bc0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:30.911 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c2982700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76bc0678c0 0x7f76bc078900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:30.912 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c2982700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f76bc073a20 0x7f76bc120ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:30.912 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c2982700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc121220 con 0x7f76bc0678c0 2020-06-27T04:44:30.912 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c2982700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc121360 con 0x7f76bc073a20 2020-06-27T04:44:30.912 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c2982700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc121520 con 0x7f76bc066370 2020-06-27T04:44:30.912 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c1720700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f76bc073a20 0x7f76bc120ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:30.913 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c1720700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f76bc073a20 0x7f76bc120ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.51:3300/0 says I am v2:172.21.15.51:50418/0 (socket says 172.21.15.51:50418) 2020-06-27T04:44:30.913 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c1720700 1 -- 172.21.15.51:0/979440452 learned_addr learned my addr 172.21.15.51:0/979440452 (peer_addr_for_me v2:172.21.15.51:0/0) 2020-06-27T04:44:30.913 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76bbfff700 1 --2- 172.21.15.51:0/979440452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76bc0678c0 0x7f76bc078900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:30.913 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c0f1f700 1 --2- 172.21.15.51:0/979440452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76bc066370 0x7f76bc0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:30.914 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c1720700 1 -- 172.21.15.51:0/979440452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76bc066370 msgr2=0x7f76bc0732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:30.914 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c1720700 1 --2- 172.21.15.51:0/979440452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76bc066370 0x7f76bc0732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:30.914 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c1720700 1 -- 172.21.15.51:0/979440452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76bc0678c0 msgr2=0x7f76bc078900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:30.914 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c1720700 1 --2- 172.21.15.51:0/979440452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76bc0678c0 0x7f76bc078900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:30.914 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c1720700 1 -- 172.21.15.51:0/979440452 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc1216e0 con 0x7f76bc073a20 2020-06-27T04:44:30.915 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c0f1f700 1 --2- 172.21.15.51:0/979440452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76bc066370 0x7f76bc0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-06-27T04:44:30.915 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76bbfff700 1 --2- 172.21.15.51:0/979440452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76bc0678c0 0x7f76bc078900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-06-27T04:44:30.915 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c1720700 1 --2- 172.21.15.51:0/979440452 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f76bc073a20 0x7f76bc120ca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f76b40032f0 tx=0x7f76b4004cf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:44:30.915 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76b8ff9700 1 -- 172.21.15.51:0/979440452 <== mon.2 v2:172.21.15.51:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76b400e030 con 0x7f76bc073a20 2020-06-27T04:44:30.915 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76b8ff9700 1 -- 172.21.15.51:0/979440452 <== mon.2 v2:172.21.15.51:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f76b4013e00 con 0x7f76bc073a20 2020-06-27T04:44:30.916 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c2982700 1 -- 172.21.15.51:0/979440452 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76bc121930 con 0x7f76bc073a20 2020-06-27T04:44:30.916 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76b8ff9700 1 -- 172.21.15.51:0/979440452 <== mon.2 v2:172.21.15.51:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76b4018070 con 0x7f76bc073a20 2020-06-27T04:44:30.916 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.907+0000 7f76c2982700 1 -- 172.21.15.51:0/979440452 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76bc121d70 con 0x7f76bc073a20 2020-06-27T04:44:30.916 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.908+0000 7f76b8ff9700 1 -- 172.21.15.51:0/979440452 <== mon.2 v2:172.21.15.51:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f76b401dd50 con 0x7f76bc073a20 2020-06-27T04:44:30.916 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.908+0000 7f76b8ff9700 1 --2- 172.21.15.51:0/979440452 >> v2:172.21.15.51:6800/950992045 conn(0x7f769802ab00 0x7f769802cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:30.917 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.908+0000 7f76b8ff9700 1 -- 172.21.15.51:0/979440452 <== mon.2 v2:172.21.15.51:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4655+0+0 (secure 0 0 0) 0x7f76b403c7f0 con 0x7f76bc073a20 2020-06-27T04:44:30.917 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.908+0000 7f76c0f1f700 1 --2- 172.21.15.51:0/979440452 >> v2:172.21.15.51:6800/950992045 conn(0x7f769802ab00 0x7f769802cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:30.917 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.908+0000 7f76c2982700 1 -- 172.21.15.51:0/979440452 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76bc05e210 con 0x7f76bc073a20 2020-06-27T04:44:30.918 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.909+0000 7f76c0f1f700 1 --2- 172.21.15.51:0/979440452 >> v2:172.21.15.51:6800/950992045 conn(0x7f769802ab00 0x7f769802cfc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f76ac007000 tx=0x7f76ac008040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:44:30.918 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:30.912+0000 7f76b8ff9700 1 -- 172.21.15.51:0/979440452 <== mon.2 v2:172.21.15.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f76b4011550 con 0x7f76bc073a20 2020-06-27T04:44:31.097 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:31.095+0000 7f76c2982700 1 -- 172.21.15.51:0/979440452 --> v2:172.21.15.51:6800/950992045 -- mgr_command(tid 0: {"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi031=realm.zone.a", "target": ["mon-mgr", ""]}) v1 -- 0x7f76bc05f390 con 0x7f769802ab00 2020-06-27T04:44:31.103 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:31.101+0000 7f76b8ff9700 1 -- 172.21.15.51:0/979440452 <== mgr.34109 v2:172.21.15.51:6800/950992045 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+35 (secure 0 0 0) 0x7f76ac00c040 con 0x7f769802ab00 2020-06-27T04:44:31.104 INFO:teuthology.orchestra.run.smithi051.stdout:Scheduled rgw.realm.zone update... 2020-06-27T04:44:31.105 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:31.103+0000 7f76c2982700 1 -- 172.21.15.51:0/979440452 >> v2:172.21.15.51:6800/950992045 conn(0x7f769802ab00 msgr2=0x7f769802cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:31.105 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:31.103+0000 7f76c2982700 1 --2- 172.21.15.51:0/979440452 >> v2:172.21.15.51:6800/950992045 conn(0x7f769802ab00 0x7f769802cfc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f76ac007000 tx=0x7f76ac008040).stop 2020-06-27T04:44:31.106 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:31.103+0000 7f76c2982700 1 -- 172.21.15.51:0/979440452 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f76bc073a20 msgr2=0x7f76bc120ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:31.106 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:31.103+0000 7f76c2982700 1 --2- 172.21.15.51:0/979440452 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f76bc073a20 0x7f76bc120ca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f76b40032f0 tx=0x7f76b4004cf0).stop 2020-06-27T04:44:31.106 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:31.103+0000 7f76c2982700 1 -- 172.21.15.51:0/979440452 shutdown_connections 2020-06-27T04:44:31.106 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:31.103+0000 7f76c2982700 1 --2- 172.21.15.51:0/979440452 >> v2:172.21.15.51:6800/950992045 conn(0x7f769802ab00 0x7f769802cfc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:31.106 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:31.103+0000 7f76c2982700 1 --2- 172.21.15.51:0/979440452 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f76bc073a20 0x7f76bc120ca0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:31.107 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:31.103+0000 7f76c2982700 1 --2- 172.21.15.51:0/979440452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76bc066370 0x7f76bc0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:31.107 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:31.103+0000 7f76c2982700 1 --2- 172.21.15.51:0/979440452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76bc0678c0 0x7f76bc078900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:31.107 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:31.103+0000 7f76c2982700 1 -- 172.21.15.51:0/979440452 >> 172.21.15.51:0/979440452 conn(0x7f76bc061840 msgr2=0x7f76bc062ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:44:31.107 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:31.103+0000 7f76c2982700 1 -- 172.21.15.51:0/979440452 shutdown_connections 2020-06-27T04:44:31.107 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:31.103+0000 7f76c2982700 1 -- 172.21.15.51:0/979440452 wait complete. 2020-06-27T04:44:31.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.097815+0000 mon.b (mon.2) 201 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.realm.zone","val":"{\"created\": \"2020-06-27T04:44:31.097468\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"realm.zone.a\", \"network\": \"\"}]}, \"service_id\": \"realm.zone\", \"service_name\": \"rgw.realm.zone\", \"service_type\": \"rgw\", \"spec\": {\"rgw_realm\": \"realm\", \"rgw_zone\": \"zone\"}}}"}]: dispatch 2020-06-27T04:44:31.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.098402+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.realm.zone","val":"{\"created\": \"2020-06-27T04:44:31.097468\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"realm.zone.a\", \"network\": \"\"}]}, \"service_id\": \"realm.zone\", \"service_name\": \"rgw.realm.zone\", \"service_type\": \"rgw\", \"spec\": {\"rgw_realm\": \"realm\", \"rgw_zone\": \"zone\"}}}"}]: dispatch 2020-06-27T04:44:31.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.101210+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.realm.zone","val":"{\"created\": \"2020-06-27T04:44:31.097468\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"realm.zone.a\", \"network\": \"\"}]}, \"service_id\": \"realm.zone\", \"service_name\": \"rgw.realm.zone\", \"service_type\": \"rgw\", \"spec\": {\"rgw_realm\": \"realm\", \"rgw_zone\": \"zone\"}}}"}]': finished 2020-06-27T04:44:31.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.103103+0000 mon.b (mon.2) 202 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config set", "who": "client.rgw.realm.zone", "name": "rgw_zone", "value": "zone"}]: dispatch 2020-06-27T04:44:31.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.103450+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "config set", "who": "client.rgw.realm.zone", "name": "rgw_zone", "value": "zone"}]: dispatch 2020-06-27T04:44:31.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.106584+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "config set", "who": "client.rgw.realm.zone", "name": "rgw_zone", "value": "zone"}]': finished 2020-06-27T04:44:31.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.109905+0000 mon.b (mon.2) 203 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config set", "who": "client.rgw.realm", "name": "rgw_realm", "value": "realm"}]: dispatch 2020-06-27T04:44:31.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.110495+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "config set", "who": "client.rgw.realm", "name": "rgw_realm", "value": "realm"}]: dispatch 2020-06-27T04:44:31.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.113577+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "config set", "who": "client.rgw.realm", "name": "rgw_realm", "value": "realm"}]': finished 2020-06-27T04:44:31.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.116985+0000 mon.b (mon.2) 204 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config set", "who": "client.rgw.realm.zone", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2020-06-27T04:44:31.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.117357+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "config set", "who": "client.rgw.realm.zone", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2020-06-27T04:44:31.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.120344+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "config set", "who": "client.rgw.realm.zone", "name": "rgw_frontends", "value": "beast port=80"}]': finished 2020-06-27T04:44:31.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.123806+0000 mon.b (mon.2) 205 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.realm.zone","val":"{\"created\": \"2020-06-27T04:44:31.123491\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"realm.zone.a\", \"network\": \"\"}]}, \"service_id\": \"realm.zone\", \"service_name\": \"rgw.realm.zone\", \"service_type\": \"rgw\", \"spec\": {\"rgw_realm\": \"realm\", \"rgw_zone\": \"zone\"}}}"}]: dispatch 2020-06-27T04:44:31.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.124113+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.realm.zone","val":"{\"created\": \"2020-06-27T04:44:31.123491\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"realm.zone.a\", \"network\": \"\"}]}, \"service_id\": \"realm.zone\", \"service_name\": \"rgw.realm.zone\", \"service_type\": \"rgw\", \"spec\": {\"rgw_realm\": \"realm\", \"rgw_zone\": \"zone\"}}}"}]: dispatch 2020-06-27T04:44:31.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.128726+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.realm.zone","val":"{\"created\": \"2020-06-27T04:44:31.123491\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"realm.zone.a\", \"network\": \"\"}]}, \"service_id\": \"realm.zone\", \"service_name\": \"rgw.realm.zone\", \"service_type\": \"rgw\", \"spec\": {\"rgw_realm\": \"realm\", \"rgw_zone\": \"zone\"}}}"}]': finished 2020-06-27T04:44:31.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.129381+0000 mon.b (mon.2) 206 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2020-06-27T04:44:31.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.129658+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2020-06-27T04:44:31.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.132796+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2020-06-27T04:44:31.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.136073+0000 mon.b (mon.2) 207 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:44:31.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:31 smithi051 bash[18409]: audit 2020-06-27T04:44:31.136770+0000 mon.b (mon.2) 208 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "client.rgw.realm.zone.a", "key": "container_image"}]: dispatch 2020-06-27T04:44:31.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.097815+0000 mon.b (mon.2) 201 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.realm.zone","val":"{\"created\": \"2020-06-27T04:44:31.097468\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"realm.zone.a\", \"network\": \"\"}]}, \"service_id\": \"realm.zone\", \"service_name\": \"rgw.realm.zone\", \"service_type\": \"rgw\", \"spec\": {\"rgw_realm\": \"realm\", \"rgw_zone\": \"zone\"}}}"}]: dispatch 2020-06-27T04:44:31.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.098402+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.realm.zone","val":"{\"created\": \"2020-06-27T04:44:31.097468\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"realm.zone.a\", \"network\": \"\"}]}, \"service_id\": \"realm.zone\", \"service_name\": \"rgw.realm.zone\", \"service_type\": \"rgw\", \"spec\": {\"rgw_realm\": \"realm\", \"rgw_zone\": \"zone\"}}}"}]: dispatch 2020-06-27T04:44:31.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.101210+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.realm.zone","val":"{\"created\": \"2020-06-27T04:44:31.097468\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"realm.zone.a\", \"network\": \"\"}]}, \"service_id\": \"realm.zone\", \"service_name\": \"rgw.realm.zone\", \"service_type\": \"rgw\", \"spec\": {\"rgw_realm\": \"realm\", \"rgw_zone\": \"zone\"}}}"}]': finished 2020-06-27T04:44:31.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.103103+0000 mon.b (mon.2) 202 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config set", "who": "client.rgw.realm.zone", "name": "rgw_zone", "value": "zone"}]: dispatch 2020-06-27T04:44:31.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.103450+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "config set", "who": "client.rgw.realm.zone", "name": "rgw_zone", "value": "zone"}]: dispatch 2020-06-27T04:44:31.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.106584+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "config set", "who": "client.rgw.realm.zone", "name": "rgw_zone", "value": "zone"}]': finished 2020-06-27T04:44:31.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.109905+0000 mon.b (mon.2) 203 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config set", "who": "client.rgw.realm", "name": "rgw_realm", "value": "realm"}]: dispatch 2020-06-27T04:44:31.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.110495+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "config set", "who": "client.rgw.realm", "name": "rgw_realm", "value": "realm"}]: dispatch 2020-06-27T04:44:31.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.113577+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "config set", "who": "client.rgw.realm", "name": "rgw_realm", "value": "realm"}]': finished 2020-06-27T04:44:31.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.116985+0000 mon.b (mon.2) 204 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config set", "who": "client.rgw.realm.zone", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2020-06-27T04:44:31.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.117357+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "config set", "who": "client.rgw.realm.zone", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2020-06-27T04:44:31.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.120344+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "config set", "who": "client.rgw.realm.zone", "name": "rgw_frontends", "value": "beast port=80"}]': finished 2020-06-27T04:44:31.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.123806+0000 mon.b (mon.2) 205 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.realm.zone","val":"{\"created\": \"2020-06-27T04:44:31.123491\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"realm.zone.a\", \"network\": \"\"}]}, \"service_id\": \"realm.zone\", \"service_name\": \"rgw.realm.zone\", \"service_type\": \"rgw\", \"spec\": {\"rgw_realm\": \"realm\", \"rgw_zone\": \"zone\"}}}"}]: dispatch 2020-06-27T04:44:31.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.124113+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.realm.zone","val":"{\"created\": \"2020-06-27T04:44:31.123491\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"realm.zone.a\", \"network\": \"\"}]}, \"service_id\": \"realm.zone\", \"service_name\": \"rgw.realm.zone\", \"service_type\": \"rgw\", \"spec\": {\"rgw_realm\": \"realm\", \"rgw_zone\": \"zone\"}}}"}]: dispatch 2020-06-27T04:44:31.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.128726+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.realm.zone","val":"{\"created\": \"2020-06-27T04:44:31.123491\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"realm.zone.a\", \"network\": \"\"}]}, \"service_id\": \"realm.zone\", \"service_name\": \"rgw.realm.zone\", \"service_type\": \"rgw\", \"spec\": {\"rgw_realm\": \"realm\", \"rgw_zone\": \"zone\"}}}"}]': finished 2020-06-27T04:44:31.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.129381+0000 mon.b (mon.2) 206 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2020-06-27T04:44:31.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.129658+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2020-06-27T04:44:31.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.132796+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2020-06-27T04:44:31.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.136073+0000 mon.b (mon.2) 207 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:44:31.478 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[18426]: audit 2020-06-27T04:44:31.136770+0000 mon.b (mon.2) 208 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "client.rgw.realm.zone.a", "key": "container_image"}]: dispatch 2020-06-27T04:44:31.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.097815+0000 mon.b (mon.2) 201 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.realm.zone","val":"{\"created\": \"2020-06-27T04:44:31.097468\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"realm.zone.a\", \"network\": \"\"}]}, \"service_id\": \"realm.zone\", \"service_name\": \"rgw.realm.zone\", \"service_type\": \"rgw\", \"spec\": {\"rgw_realm\": \"realm\", \"rgw_zone\": \"zone\"}}}"}]: dispatch 2020-06-27T04:44:31.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.098402+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.realm.zone","val":"{\"created\": \"2020-06-27T04:44:31.097468\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"realm.zone.a\", \"network\": \"\"}]}, \"service_id\": \"realm.zone\", \"service_name\": \"rgw.realm.zone\", \"service_type\": \"rgw\", \"spec\": {\"rgw_realm\": \"realm\", \"rgw_zone\": \"zone\"}}}"}]: dispatch 2020-06-27T04:44:31.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.101210+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.realm.zone","val":"{\"created\": \"2020-06-27T04:44:31.097468\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"realm.zone.a\", \"network\": \"\"}]}, \"service_id\": \"realm.zone\", \"service_name\": \"rgw.realm.zone\", \"service_type\": \"rgw\", \"spec\": {\"rgw_realm\": \"realm\", \"rgw_zone\": \"zone\"}}}"}]': finished 2020-06-27T04:44:31.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.103103+0000 mon.b (mon.2) 202 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config set", "who": "client.rgw.realm.zone", "name": "rgw_zone", "value": "zone"}]: dispatch 2020-06-27T04:44:31.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.103450+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "config set", "who": "client.rgw.realm.zone", "name": "rgw_zone", "value": "zone"}]: dispatch 2020-06-27T04:44:31.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.106584+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "config set", "who": "client.rgw.realm.zone", "name": "rgw_zone", "value": "zone"}]': finished 2020-06-27T04:44:31.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.109905+0000 mon.b (mon.2) 203 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config set", "who": "client.rgw.realm", "name": "rgw_realm", "value": "realm"}]: dispatch 2020-06-27T04:44:31.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.110495+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "config set", "who": "client.rgw.realm", "name": "rgw_realm", "value": "realm"}]: dispatch 2020-06-27T04:44:31.480 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.113577+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "config set", "who": "client.rgw.realm", "name": "rgw_realm", "value": "realm"}]': finished 2020-06-27T04:44:31.480 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.116985+0000 mon.b (mon.2) 204 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config set", "who": "client.rgw.realm.zone", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2020-06-27T04:44:31.480 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.117357+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "config set", "who": "client.rgw.realm.zone", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2020-06-27T04:44:31.480 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.120344+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "config set", "who": "client.rgw.realm.zone", "name": "rgw_frontends", "value": "beast port=80"}]': finished 2020-06-27T04:44:31.480 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.123806+0000 mon.b (mon.2) 205 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.realm.zone","val":"{\"created\": \"2020-06-27T04:44:31.123491\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"realm.zone.a\", \"network\": \"\"}]}, \"service_id\": \"realm.zone\", \"service_name\": \"rgw.realm.zone\", \"service_type\": \"rgw\", \"spec\": {\"rgw_realm\": \"realm\", \"rgw_zone\": \"zone\"}}}"}]: dispatch 2020-06-27T04:44:31.480 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.124113+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.realm.zone","val":"{\"created\": \"2020-06-27T04:44:31.123491\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"realm.zone.a\", \"network\": \"\"}]}, \"service_id\": \"realm.zone\", \"service_name\": \"rgw.realm.zone\", \"service_type\": \"rgw\", \"spec\": {\"rgw_realm\": \"realm\", \"rgw_zone\": \"zone\"}}}"}]: dispatch 2020-06-27T04:44:31.481 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.128726+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.realm.zone","val":"{\"created\": \"2020-06-27T04:44:31.123491\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"realm.zone.a\", \"network\": \"\"}]}, \"service_id\": \"realm.zone\", \"service_name\": \"rgw.realm.zone\", \"service_type\": \"rgw\", \"spec\": {\"rgw_realm\": \"realm\", \"rgw_zone\": \"zone\"}}}"}]': finished 2020-06-27T04:44:31.481 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.129381+0000 mon.b (mon.2) 206 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2020-06-27T04:44:31.481 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.129658+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2020-06-27T04:44:31.481 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.132796+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2020-06-27T04:44:31.481 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.136073+0000 mon.b (mon.2) 207 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-06-27T04:44:31.482 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:31 smithi031 bash[22603]: audit 2020-06-27T04:44:31.136770+0000 mon.b (mon.2) 208 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "client.rgw.realm.zone.a", "key": "container_image"}]: dispatch 2020-06-27T04:44:31.557 INFO:teuthology.orchestra.run.smithi031:rgw.realm.zone.a> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@rgw.realm.zone.a.service 2020-06-27T04:44:31.563 INFO:tasks.cephadm:Adding prometheus.a on smithi051 2020-06-27T04:44:31.564 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph orch apply prometheus '1;smithi051=a' 2020-06-27T04:44:31.594 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:-- Logs begin at Sat 2020-06-27 04:33:08 UTC. -- 2020-06-27T04:44:32.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:32 smithi031 bash[22603]: audit 2020-06-27T04:44:31.096357+0000 mgr.x (mgr.34109) 100 : audit [DBG] from='client.34379 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi031=realm.zone.a", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:44:32.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:32 smithi031 bash[22603]: cephadm 2020-06-27T04:44:31.097453+0000 mgr.x (mgr.34109) 101 : cephadm [INF] Saving service rgw.realm.zone spec with placement count:1 smithi031=realm.zone.a 2020-06-27T04:44:32.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:32 smithi031 bash[22603]: cephadm 2020-06-27T04:44:31.123383+0000 mgr.x (mgr.34109) 102 : cephadm [INF] Saving service rgw.realm.zone spec with placement count:1 smithi031=realm.zone.a 2020-06-27T04:44:32.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:32 smithi031 bash[22603]: cluster 2020-06-27T04:44:31.128272+0000 mgr.x (mgr.34109) 103 : cluster [DBG] pgmap v104: 33 pgs: 33 active+clean; 1007 B data, 3.4 MiB used, 707 GiB / 715 GiB avail; 260 B/s rd, 1.5 KiB/s wr, 2 op/s 2020-06-27T04:44:32.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:32 smithi031 bash[22603]: cephadm 2020-06-27T04:44:31.136521+0000 mgr.x (mgr.34109) 104 : cephadm [INF] Deploying daemon rgw.realm.zone.a on smithi031 2020-06-27T04:44:32.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:32 smithi031 bash[18426]: audit 2020-06-27T04:44:31.096357+0000 mgr.x (mgr.34109) 100 : audit [DBG] from='client.34379 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi031=realm.zone.a", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:44:32.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:32 smithi031 bash[18426]: cephadm 2020-06-27T04:44:31.097453+0000 mgr.x (mgr.34109) 101 : cephadm [INF] Saving service rgw.realm.zone spec with placement count:1 smithi031=realm.zone.a 2020-06-27T04:44:32.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:32 smithi031 bash[18426]: cephadm 2020-06-27T04:44:31.123383+0000 mgr.x (mgr.34109) 102 : cephadm [INF] Saving service rgw.realm.zone spec with placement count:1 smithi031=realm.zone.a 2020-06-27T04:44:32.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:32 smithi031 bash[18426]: cluster 2020-06-27T04:44:31.128272+0000 mgr.x (mgr.34109) 103 : cluster [DBG] pgmap v104: 33 pgs: 33 active+clean; 1007 B data, 3.4 MiB used, 707 GiB / 715 GiB avail; 260 B/s rd, 1.5 KiB/s wr, 2 op/s 2020-06-27T04:44:32.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:32 smithi031 bash[18426]: cephadm 2020-06-27T04:44:31.136521+0000 mgr.x (mgr.34109) 104 : cephadm [INF] Deploying daemon rgw.realm.zone.a on smithi031 2020-06-27T04:44:32.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:32 smithi051 bash[18409]: audit 2020-06-27T04:44:31.096357+0000 mgr.x (mgr.34109) 100 : audit [DBG] from='client.34379 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi031=realm.zone.a", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:44:32.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:32 smithi051 bash[18409]: cephadm 2020-06-27T04:44:31.097453+0000 mgr.x (mgr.34109) 101 : cephadm [INF] Saving service rgw.realm.zone spec with placement count:1 smithi031=realm.zone.a 2020-06-27T04:44:32.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:32 smithi051 bash[18409]: cephadm 2020-06-27T04:44:31.123383+0000 mgr.x (mgr.34109) 102 : cephadm [INF] Saving service rgw.realm.zone spec with placement count:1 smithi031=realm.zone.a 2020-06-27T04:44:32.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:32 smithi051 bash[18409]: cluster 2020-06-27T04:44:31.128272+0000 mgr.x (mgr.34109) 103 : cluster [DBG] pgmap v104: 33 pgs: 33 active+clean; 1007 B data, 3.4 MiB used, 707 GiB / 715 GiB avail; 260 B/s rd, 1.5 KiB/s wr, 2 op/s 2020-06-27T04:44:32.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:32 smithi051 bash[18409]: cephadm 2020-06-27T04:44:31.136521+0000 mgr.x (mgr.34109) 104 : cephadm [INF] Deploying daemon rgw.realm.zone.a on smithi031 2020-06-27T04:44:32.816 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:Jun 27 04:44:32 smithi031 systemd[1]: Starting Ceph rgw.realm.zone.a for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:44:32.817 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:Jun 27 04:44:32 smithi031 podman[32797]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-rgw.realm.zone.a found: no such container 2020-06-27T04:44:33.172 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:Jun 27 04:44:32 smithi031 systemd[1]: Started Ceph rgw.realm.zone.a for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:44:33.172 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:Jun 27 04:44:32 smithi031 bash[32813]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-rgw.realm.zone.a" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-rgw.realm.zone.a found: no such container 2020-06-27T04:44:33.172 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:Jun 27 04:44:32 smithi031 bash[32813]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-rgw.realm.zone.a 2020-06-27T04:44:33.173 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:Jun 27 04:44:32 smithi031 bash[32813]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-rgw.realm.zone.a" found: no such container 2020-06-27T04:44:33.175 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.169+0000 7f2fdf67b700 1 Processor -- start 2020-06-27T04:44:33.175 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.169+0000 7f2fdf67b700 1 -- start start 2020-06-27T04:44:33.176 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fdf67b700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f2fd8066360 0x7f2fd8067e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:33.176 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fdf67b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fd80678b0 0x7f2fd8068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:33.176 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fdf67b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2fd8078760 0x7f2fd81250b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:33.176 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fdf67b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd8078d40 con 0x7f2fd80678b0 2020-06-27T04:44:33.176 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fdf67b700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd81255a0 con 0x7f2fd8066360 2020-06-27T04:44:33.177 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fdf67b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd8125760 con 0x7f2fd8078760 2020-06-27T04:44:33.177 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fddc18700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f2fd8066360 0x7f2fd8067e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:33.177 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fddc18700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f2fd8066360 0x7f2fd8067e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.51:3300/0 says I am v2:172.21.15.51:50428/0 (socket says 172.21.15.51:50428) 2020-06-27T04:44:33.177 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fddc18700 1 -- 172.21.15.51:0/1737010907 learned_addr learned my addr 172.21.15.51:0/1737010907 (peer_addr_for_me v2:172.21.15.51:0/0) 2020-06-27T04:44:33.177 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fde419700 1 --2- 172.21.15.51:0/1737010907 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2fd8078760 0x7f2fd81250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:33.178 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fdd417700 1 --2- 172.21.15.51:0/1737010907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fd80678b0 0x7f2fd8068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:33.178 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fddc18700 1 -- 172.21.15.51:0/1737010907 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2fd8078760 msgr2=0x7f2fd81250b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:33.178 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fddc18700 1 --2- 172.21.15.51:0/1737010907 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2fd8078760 0x7f2fd81250b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:33.178 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fddc18700 1 -- 172.21.15.51:0/1737010907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fd80678b0 msgr2=0x7f2fd8068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:33.179 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fddc18700 1 --2- 172.21.15.51:0/1737010907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fd80678b0 0x7f2fd8068580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:33.179 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fddc18700 1 -- 172.21.15.51:0/1737010907 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd8125920 con 0x7f2fd8066360 2020-06-27T04:44:33.179 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fdd417700 1 --2- 172.21.15.51:0/1737010907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fd80678b0 0x7f2fd8068580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-27T04:44:33.179 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fddc18700 1 --2- 172.21.15.51:0/1737010907 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f2fd8066360 0x7f2fd8067e90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f2fd8078e80 tx=0x7f2fd400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:44:33.179 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fc9ffb700 1 -- 172.21.15.51:0/1737010907 <== mon.2 v2:172.21.15.51:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd40094d0 con 0x7f2fd8066360 2020-06-27T04:44:33.180 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fc9ffb700 1 -- 172.21.15.51:0/1737010907 <== mon.2 v2:172.21.15.51:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f2fd400f040 con 0x7f2fd8066360 2020-06-27T04:44:33.180 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fc9ffb700 1 -- 172.21.15.51:0/1737010907 <== mon.2 v2:172.21.15.51:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd400cab0 con 0x7f2fd8066360 2020-06-27T04:44:33.180 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.170+0000 7f2fdf67b700 1 -- 172.21.15.51:0/1737010907 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd8125b70 con 0x7f2fd8066360 2020-06-27T04:44:33.180 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.171+0000 7f2fdf67b700 1 -- 172.21.15.51:0/1737010907 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd8126060 con 0x7f2fd8066360 2020-06-27T04:44:33.180 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.171+0000 7f2fc9ffb700 1 -- 172.21.15.51:0/1737010907 <== mon.2 v2:172.21.15.51:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f2fd401b060 con 0x7f2fd8066360 2020-06-27T04:44:33.181 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.171+0000 7f2fc9ffb700 1 --2- 172.21.15.51:0/1737010907 >> v2:172.21.15.51:6800/950992045 conn(0x7f2fb402ab50 0x7f2fb402d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:33.181 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.171+0000 7f2fc9ffb700 1 -- 172.21.15.51:0/1737010907 <== mon.2 v2:172.21.15.51:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4655+0+0 (secure 0 0 0) 0x7f2fd403d500 con 0x7f2fd8066360 2020-06-27T04:44:33.181 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.171+0000 7f2fdd417700 1 --2- 172.21.15.51:0/1737010907 >> v2:172.21.15.51:6800/950992045 conn(0x7f2fb402ab50 0x7f2fb402d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:33.181 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.172+0000 7f2fdd417700 1 --2- 172.21.15.51:0/1737010907 >> v2:172.21.15.51:6800/950992045 conn(0x7f2fb402ab50 0x7f2fb402d010 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f2fcc00c000 tx=0x7f2fcc009040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:44:33.181 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.172+0000 7f2fdf67b700 1 -- 172.21.15.51:0/1737010907 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd805e210 con 0x7f2fd8066360 2020-06-27T04:44:33.182 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.175+0000 7f2fc9ffb700 1 -- 172.21.15.51:0/1737010907 <== mon.2 v2:172.21.15.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f2fd4019070 con 0x7f2fd8066360 2020-06-27T04:44:33.362 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.359+0000 7f2fdf67b700 1 -- 172.21.15.51:0/1737010907 --> v2:172.21.15.51:6800/950992045 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi051=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fd805f390 con 0x7f2fb402ab50 2020-06-27T04:44:33.369 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.366+0000 7f2fc9ffb700 1 -- 172.21.15.51:0/1737010907 <== mgr.34109 v2:172.21.15.51:6800/950992045 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f2fcc000e90 con 0x7f2fb402ab50 2020-06-27T04:44:33.369 INFO:teuthology.orchestra.run.smithi051.stdout:Scheduled prometheus update... 2020-06-27T04:44:33.377 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.368+0000 7f2fdf67b700 1 -- 172.21.15.51:0/1737010907 >> v2:172.21.15.51:6800/950992045 conn(0x7f2fb402ab50 msgr2=0x7f2fb402d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:33.378 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.368+0000 7f2fdf67b700 1 --2- 172.21.15.51:0/1737010907 >> v2:172.21.15.51:6800/950992045 conn(0x7f2fb402ab50 0x7f2fb402d010 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f2fcc00c000 tx=0x7f2fcc009040).stop 2020-06-27T04:44:33.378 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.368+0000 7f2fdf67b700 1 -- 172.21.15.51:0/1737010907 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f2fd8066360 msgr2=0x7f2fd8067e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:33.378 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.368+0000 7f2fdf67b700 1 --2- 172.21.15.51:0/1737010907 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f2fd8066360 0x7f2fd8067e90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f2fd8078e80 tx=0x7f2fd400b040).stop 2020-06-27T04:44:33.378 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.368+0000 7f2fdf67b700 1 -- 172.21.15.51:0/1737010907 shutdown_connections 2020-06-27T04:44:33.378 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.368+0000 7f2fdf67b700 1 --2- 172.21.15.51:0/1737010907 >> v2:172.21.15.51:6800/950992045 conn(0x7f2fb402ab50 0x7f2fb402d010 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:33.379 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.368+0000 7f2fdf67b700 1 --2- 172.21.15.51:0/1737010907 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f2fd8066360 0x7f2fd8067e90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:33.379 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.368+0000 7f2fdf67b700 1 --2- 172.21.15.51:0/1737010907 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2fd8078760 0x7f2fd81250b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:33.379 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.368+0000 7f2fdf67b700 1 --2- 172.21.15.51:0/1737010907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fd80678b0 0x7f2fd8068580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:33.379 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.368+0000 7f2fdf67b700 1 -- 172.21.15.51:0/1737010907 >> 172.21.15.51:0/1737010907 conn(0x7f2fd8061830 msgr2=0x7f2fd8062f40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:44:33.380 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.368+0000 7f2fdf67b700 1 -- 172.21.15.51:0/1737010907 shutdown_connections 2020-06-27T04:44:33.380 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:33.368+0000 7f2fdf67b700 1 -- 172.21.15.51:0/1737010907 wait complete. 2020-06-27T04:44:33.391 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:33 smithi051 bash[18409]: audit 2020-06-27T04:44:32.284678+0000 mon.b (mon.2) 209 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}, {\"id\": \"69c55725-a555-4ffc-843e-010b80b5a68d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1593233047.300462, \"finished_at\": 1593233057.3832364}, {\"id\": \"a56bb95f-43ac-4fca-b98a-2c613d41b88c\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1593233063.2678702, \"finished_at\": 1593233070.5232582}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:44:33.391 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:33 smithi051 bash[18409]: audit 2020-06-27T04:44:32.285341+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}, {\"id\": \"69c55725-a555-4ffc-843e-010b80b5a68d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1593233047.300462, \"finished_at\": 1593233057.3832364}, {\"id\": \"a56bb95f-43ac-4fca-b98a-2c613d41b88c\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1593233063.2678702, \"finished_at\": 1593233070.5232582}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:44:33.392 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:33 smithi051 bash[18409]: audit 2020-06-27T04:44:32.288300+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}, {\"id\": \"69c55725-a555-4ffc-843e-010b80b5a68d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1593233047.300462, \"finished_at\": 1593233057.3832364}, {\"id\": \"a56bb95f-43ac-4fca-b98a-2c613d41b88c\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1593233063.2678702, \"finished_at\": 1593233070.5232582}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-06-27T04:44:33.392 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:33 smithi051 bash[18409]: audit 2020-06-27T04:44:32.848769+0000 mon.b (mon.2) 210 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:44:33.392 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:33 smithi051 bash[18409]: audit 2020-06-27T04:44:32.849437+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:44:33.392 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:33 smithi051 bash[18409]: audit 2020-06-27T04:44:32.852210+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:44:33.393 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:33 smithi051 bash[18409]: audit 2020-06-27T04:44:32.853320+0000 mon.b (mon.2) 211 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:44:33.468 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:Jun 27 04:44:33 smithi031 podman[32849]: 2020-06-27 04:44:33.164686447 +0000 UTC m=+0.250091334 container create e94f871d50c8a91d08ad043f50a1a2807ee9fcf59985efc6056c24db64136f95 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-rgw.realm.zone.a) 2020-06-27T04:44:33.468 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[18426]: audit 2020-06-27T04:44:32.284678+0000 mon.b (mon.2) 209 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}, {\"id\": \"69c55725-a555-4ffc-843e-010b80b5a68d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1593233047.300462, \"finished_at\": 1593233057.3832364}, {\"id\": \"a56bb95f-43ac-4fca-b98a-2c613d41b88c\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1593233063.2678702, \"finished_at\": 1593233070.5232582}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:44:33.468 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[18426]: audit 2020-06-27T04:44:32.285341+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}, {\"id\": \"69c55725-a555-4ffc-843e-010b80b5a68d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1593233047.300462, \"finished_at\": 1593233057.3832364}, {\"id\": \"a56bb95f-43ac-4fca-b98a-2c613d41b88c\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1593233063.2678702, \"finished_at\": 1593233070.5232582}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:44:33.468 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[18426]: audit 2020-06-27T04:44:32.288300+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}, {\"id\": \"69c55725-a555-4ffc-843e-010b80b5a68d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1593233047.300462, \"finished_at\": 1593233057.3832364}, {\"id\": \"a56bb95f-43ac-4fca-b98a-2c613d41b88c\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1593233063.2678702, \"finished_at\": 1593233070.5232582}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-06-27T04:44:33.469 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[18426]: audit 2020-06-27T04:44:32.848769+0000 mon.b (mon.2) 210 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:44:33.469 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[18426]: audit 2020-06-27T04:44:32.849437+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:44:33.469 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[18426]: audit 2020-06-27T04:44:32.852210+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:44:33.470 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[18426]: audit 2020-06-27T04:44:32.853320+0000 mon.b (mon.2) 211 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:44:33.470 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[22603]: audit 2020-06-27T04:44:32.284678+0000 mon.b (mon.2) 209 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}, {\"id\": \"69c55725-a555-4ffc-843e-010b80b5a68d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1593233047.300462, \"finished_at\": 1593233057.3832364}, {\"id\": \"a56bb95f-43ac-4fca-b98a-2c613d41b88c\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1593233063.2678702, \"finished_at\": 1593233070.5232582}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:44:33.470 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[22603]: audit 2020-06-27T04:44:32.285341+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}, {\"id\": \"69c55725-a555-4ffc-843e-010b80b5a68d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1593233047.300462, \"finished_at\": 1593233057.3832364}, {\"id\": \"a56bb95f-43ac-4fca-b98a-2c613d41b88c\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1593233063.2678702, \"finished_at\": 1593233070.5232582}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-06-27T04:44:33.471 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[22603]: audit 2020-06-27T04:44:32.288300+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"f4eba15b-d724-415c-9d46-5b714a36361e\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1593233016.6838293, \"finished_at\": 1593233025.713558}, {\"id\": \"e8c0406b-7ae7-47a6-802f-93bd37663f3b\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1593233031.1239617, \"finished_at\": 1593233041.6626847}, {\"id\": \"69c55725-a555-4ffc-843e-010b80b5a68d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1593233047.300462, \"finished_at\": 1593233057.3832364}, {\"id\": \"a56bb95f-43ac-4fca-b98a-2c613d41b88c\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1593233063.2678702, \"finished_at\": 1593233070.5232582}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-06-27T04:44:33.471 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[22603]: audit 2020-06-27T04:44:32.848769+0000 mon.b (mon.2) 210 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:44:33.471 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[22603]: audit 2020-06-27T04:44:32.849437+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:44:33.471 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[22603]: audit 2020-06-27T04:44:32.852210+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153798\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153878\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.153913\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154061\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154201\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:43:19.154334\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:44:33.472 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[22603]: audit 2020-06-27T04:44:32.853320+0000 mon.b (mon.2) 211 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:44:33.723 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:Jun 27 04:44:33 smithi031 podman[32849]: 2020-06-27 04:44:33.668677077 +0000 UTC m=+0.754082067 container init e94f871d50c8a91d08ad043f50a1a2807ee9fcf59985efc6056c24db64136f95 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-rgw.realm.zone.a) 2020-06-27T04:44:33.723 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:Jun 27 04:44:33 smithi031 podman[32849]: 2020-06-27 04:44:33.714578465 +0000 UTC m=+0.799983346 container start e94f871d50c8a91d08ad043f50a1a2807ee9fcf59985efc6056c24db64136f95 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-rgw.realm.zone.a) 2020-06-27T04:44:33.723 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:Jun 27 04:44:33 smithi031 podman[32849]: 2020-06-27 04:44:33.714653033 +0000 UTC m=+0.800057919 container attach e94f871d50c8a91d08ad043f50a1a2807ee9fcf59985efc6056c24db64136f95 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-rgw.realm.zone.a) 2020-06-27T04:44:33.723 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[32813]: debug 2020-06-27T04:44:33.701+0000 7fb365ef92c0 1 -- 172.21.15.31:0/2967696960 shutdown_connections 2020-06-27T04:44:33.724 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[32813]: debug 2020-06-27T04:44:33.701+0000 7fb365ef92c0 1 --2- 172.21.15.31:0/2967696960 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5645f3b7f400 0x5645f3bc4d00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:33.724 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[32813]: debug 2020-06-27T04:44:33.701+0000 7fb365ef92c0 1 --2- 172.21.15.31:0/2967696960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5645f3b7ec00 0x5645f3bc4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:33.724 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[32813]: debug 2020-06-27T04:44:33.701+0000 7fb365ef92c0 1 --2- 172.21.15.31:0/2967696960 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x5645f3b7f000 0x5645f3bc4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:33.724 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[32813]: debug 2020-06-27T04:44:33.701+0000 7fb365ef92c0 1 -- 172.21.15.31:0/2967696960 >> 172.21.15.31:0/2967696960 conn(0x5645f3b7e800 msgr2=0x5645f3c4c800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:44:33.725 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[32813]: debug 2020-06-27T04:44:33.701+0000 7fb365ef92c0 1 -- 172.21.15.31:0/2967696960 shutdown_connections 2020-06-27T04:44:33.725 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:Jun 27 04:44:33 smithi031 bash[32813]: debug 2020-06-27T04:44:33.701+0000 7fb365ef92c0 1 -- 172.21.15.31:0/2967696960 wait complete. 2020-06-27T04:44:33.860 INFO:teuthology.orchestra.run.smithi051:prometheus.a> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@prometheus.a.service 2020-06-27T04:44:33.864 INFO:tasks.cephadm:Adding node-exporter.a on smithi031 2020-06-27T04:44:33.864 INFO:tasks.cephadm:Adding node-exporter.b on smithi051 2020-06-27T04:44:33.865 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph orch apply node-exporter '2;smithi031=a;smithi051=b' 2020-06-27T04:44:33.897 INFO:ceph.prometheus.a.smithi051.stdout:-- Logs begin at Sat 2020-06-27 04:33:02 UTC. -- 2020-06-27T04:44:34.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:34 smithi051 bash[18409]: cluster 2020-06-27T04:44:33.128642+0000 mgr.x (mgr.34109) 105 : cluster [DBG] pgmap v105: 33 pgs: 33 active+clean; 1007 B data, 3.5 MiB used, 707 GiB / 715 GiB avail; 461 B/s rd, 1.4 KiB/s wr, 2 op/s 2020-06-27T04:44:34.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:34 smithi051 bash[18409]: audit 2020-06-27T04:44:33.360317+0000 mgr.x (mgr.34109) 106 : audit [DBG] from='client.34385 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi051=a", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:44:34.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:34 smithi051 bash[18409]: cephadm 2020-06-27T04:44:33.360923+0000 mgr.x (mgr.34109) 107 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi051=a 2020-06-27T04:44:34.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:34 smithi051 bash[18409]: audit 2020-06-27T04:44:33.361191+0000 mon.b (mon.2) 212 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2020-06-27T04:44:33.360933\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"prometheus\", \"service_type\": \"prometheus\"}}"}]: dispatch 2020-06-27T04:44:34.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:34 smithi051 bash[18409]: audit 2020-06-27T04:44:33.361597+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2020-06-27T04:44:33.360933\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"prometheus\", \"service_type\": \"prometheus\"}}"}]: dispatch 2020-06-27T04:44:34.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:34 smithi051 bash[18409]: audit 2020-06-27T04:44:33.364106+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2020-06-27T04:44:33.360933\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"prometheus\", \"service_type\": \"prometheus\"}}"}]': finished 2020-06-27T04:44:34.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:34 smithi031 bash[18426]: cluster 2020-06-27T04:44:33.128642+0000 mgr.x (mgr.34109) 105 : cluster [DBG] pgmap v105: 33 pgs: 33 active+clean; 1007 B data, 3.5 MiB used, 707 GiB / 715 GiB avail; 461 B/s rd, 1.4 KiB/s wr, 2 op/s 2020-06-27T04:44:34.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:34 smithi031 bash[18426]: audit 2020-06-27T04:44:33.360317+0000 mgr.x (mgr.34109) 106 : audit [DBG] from='client.34385 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi051=a", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:44:34.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:34 smithi031 bash[18426]: cephadm 2020-06-27T04:44:33.360923+0000 mgr.x (mgr.34109) 107 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi051=a 2020-06-27T04:44:34.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:34 smithi031 bash[18426]: audit 2020-06-27T04:44:33.361191+0000 mon.b (mon.2) 212 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2020-06-27T04:44:33.360933\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"prometheus\", \"service_type\": \"prometheus\"}}"}]: dispatch 2020-06-27T04:44:34.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:34 smithi031 bash[18426]: audit 2020-06-27T04:44:33.361597+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2020-06-27T04:44:33.360933\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"prometheus\", \"service_type\": \"prometheus\"}}"}]: dispatch 2020-06-27T04:44:34.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:34 smithi031 bash[18426]: audit 2020-06-27T04:44:33.364106+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2020-06-27T04:44:33.360933\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"prometheus\", \"service_type\": \"prometheus\"}}"}]': finished 2020-06-27T04:44:34.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:34 smithi031 bash[22603]: cluster 2020-06-27T04:44:33.128642+0000 mgr.x (mgr.34109) 105 : cluster [DBG] pgmap v105: 33 pgs: 33 active+clean; 1007 B data, 3.5 MiB used, 707 GiB / 715 GiB avail; 461 B/s rd, 1.4 KiB/s wr, 2 op/s 2020-06-27T04:44:34.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:34 smithi031 bash[22603]: audit 2020-06-27T04:44:33.360317+0000 mgr.x (mgr.34109) 106 : audit [DBG] from='client.34385 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi051=a", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:44:34.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:34 smithi031 bash[22603]: cephadm 2020-06-27T04:44:33.360923+0000 mgr.x (mgr.34109) 107 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi051=a 2020-06-27T04:44:34.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:34 smithi031 bash[22603]: audit 2020-06-27T04:44:33.361191+0000 mon.b (mon.2) 212 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2020-06-27T04:44:33.360933\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"prometheus\", \"service_type\": \"prometheus\"}}"}]: dispatch 2020-06-27T04:44:34.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:34 smithi031 bash[22603]: audit 2020-06-27T04:44:33.361597+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2020-06-27T04:44:33.360933\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"prometheus\", \"service_type\": \"prometheus\"}}"}]: dispatch 2020-06-27T04:44:34.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:34 smithi031 bash[22603]: audit 2020-06-27T04:44:33.364106+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2020-06-27T04:44:33.360933\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"prometheus\", \"service_type\": \"prometheus\"}}"}]': finished 2020-06-27T04:44:35.393 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:35 smithi051 bash[18409]: audit 2020-06-27T04:44:34.337992+0000 mon.b (mon.2) 213 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}}, \"last_daemon_update\": \"2020-06-27T04:44:34.337216\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:44:35.394 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:35 smithi051 bash[18409]: audit 2020-06-27T04:44:34.338589+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}}, \"last_daemon_update\": \"2020-06-27T04:44:34.337216\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:44:35.394 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:35 smithi051 bash[18409]: audit 2020-06-27T04:44:34.343982+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}}, \"last_daemon_update\": \"2020-06-27T04:44:34.337216\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:44:35.395 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:35 smithi051 bash[18409]: cephadm 2020-06-27T04:44:34.353219+0000 mgr.x (mgr.34109) 108 : cephadm [INF] Deploying daemon prometheus.a on smithi051 2020-06-27T04:44:35.395 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:35 smithi051 bash[18409]: cluster 2020-06-27T04:44:34.370994+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2020-06-27T04:44:35.395 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:35 smithi051 bash[18409]: audit 2020-06-27T04:44:34.372850+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.31:0/2254075557' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2020-06-27T04:44:35.395 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:35 smithi051 bash[18409]: audit 2020-06-27T04:44:34.373115+0000 mon.a (mon.0) 442 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2020-06-27T04:44:35.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:35 smithi031 bash[18426]: audit 2020-06-27T04:44:34.337992+0000 mon.b (mon.2) 213 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}}, \"last_daemon_update\": \"2020-06-27T04:44:34.337216\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:44:35.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:35 smithi031 bash[18426]: audit 2020-06-27T04:44:34.338589+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}}, \"last_daemon_update\": \"2020-06-27T04:44:34.337216\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:44:35.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:35 smithi031 bash[18426]: audit 2020-06-27T04:44:34.343982+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}}, \"last_daemon_update\": \"2020-06-27T04:44:34.337216\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:44:35.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:35 smithi031 bash[18426]: cephadm 2020-06-27T04:44:34.353219+0000 mgr.x (mgr.34109) 108 : cephadm [INF] Deploying daemon prometheus.a on smithi051 2020-06-27T04:44:35.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:35 smithi031 bash[18426]: cluster 2020-06-27T04:44:34.370994+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2020-06-27T04:44:35.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:35 smithi031 bash[18426]: audit 2020-06-27T04:44:34.372850+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.31:0/2254075557' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2020-06-27T04:44:35.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:35 smithi031 bash[18426]: audit 2020-06-27T04:44:34.373115+0000 mon.a (mon.0) 442 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2020-06-27T04:44:35.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:35 smithi031 bash[22603]: audit 2020-06-27T04:44:34.337992+0000 mon.b (mon.2) 213 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}}, \"last_daemon_update\": \"2020-06-27T04:44:34.337216\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:44:35.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:35 smithi031 bash[22603]: audit 2020-06-27T04:44:34.338589+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}}, \"last_daemon_update\": \"2020-06-27T04:44:34.337216\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:44:35.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:35 smithi031 bash[22603]: audit 2020-06-27T04:44:34.343982+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}}, \"last_daemon_update\": \"2020-06-27T04:44:34.337216\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:44:35.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:35 smithi031 bash[22603]: cephadm 2020-06-27T04:44:34.353219+0000 mgr.x (mgr.34109) 108 : cephadm [INF] Deploying daemon prometheus.a on smithi051 2020-06-27T04:44:35.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:35 smithi031 bash[22603]: cluster 2020-06-27T04:44:34.370994+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2020-06-27T04:44:35.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:35 smithi031 bash[22603]: audit 2020-06-27T04:44:34.372850+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.31:0/2254075557' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2020-06-27T04:44:35.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:35 smithi031 bash[22603]: audit 2020-06-27T04:44:34.373115+0000 mon.a (mon.0) 442 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2020-06-27T04:44:35.582 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9ab59e700 1 Processor -- start 2020-06-27T04:44:35.582 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9ab59e700 1 -- start start 2020-06-27T04:44:35.583 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9ab59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9ac066220 0x7fd9ac074080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:35.583 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9ab59e700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd9ac0676c0 0x7fd9ac074770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:35.583 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9ab59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9ac077680 0x7fd9ac077b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:35.583 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9ab59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac078150 con 0x7fd9ac077680 2020-06-27T04:44:35.583 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9ab59e700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac0782c0 con 0x7fd9ac0676c0 2020-06-27T04:44:35.584 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9ab59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac078480 con 0x7fd9ac066220 2020-06-27T04:44:35.584 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9aa59c700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd9ac0676c0 0x7fd9ac074770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:35.584 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9aa59c700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd9ac0676c0 0x7fd9ac074770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.51:3300/0 says I am v2:172.21.15.51:50472/0 (socket says 172.21.15.51:50472) 2020-06-27T04:44:35.584 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9aa59c700 1 -- 172.21.15.51:0/4120401453 learned_addr learned my addr 172.21.15.51:0/4120401453 (peer_addr_for_me v2:172.21.15.51:0/0) 2020-06-27T04:44:35.584 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9aad9d700 1 --2- 172.21.15.51:0/4120401453 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9ac066220 0x7fd9ac074080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:35.585 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9b0e35700 1 --2- 172.21.15.51:0/4120401453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9ac077680 0x7fd9ac077b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:35.585 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9aa59c700 1 -- 172.21.15.51:0/4120401453 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9ac066220 msgr2=0x7fd9ac074080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:35.585 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9aa59c700 1 --2- 172.21.15.51:0/4120401453 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9ac066220 0x7fd9ac074080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:35.585 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9aa59c700 1 -- 172.21.15.51:0/4120401453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9ac077680 msgr2=0x7fd9ac077b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:35.585 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9aa59c700 1 --2- 172.21.15.51:0/4120401453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9ac077680 0x7fd9ac077b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:35.586 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9aa59c700 1 -- 172.21.15.51:0/4120401453 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac078640 con 0x7fd9ac0676c0 2020-06-27T04:44:35.586 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.579+0000 7fd9aa59c700 1 --2- 172.21.15.51:0/4120401453 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd9ac0676c0 0x7fd9ac074770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd9a0004370 tx=0x7fd9a000b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:44:35.586 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.580+0000 7fd99affd700 1 -- 172.21.15.51:0/4120401453 <== mon.2 v2:172.21.15.51:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9a00094d0 con 0x7fd9ac0676c0 2020-06-27T04:44:35.586 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.580+0000 7fd9ab59e700 1 -- 172.21.15.51:0/4120401453 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ac078890 con 0x7fd9ac0676c0 2020-06-27T04:44:35.586 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.580+0000 7fd99affd700 1 -- 172.21.15.51:0/4120401453 <== mon.2 v2:172.21.15.51:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fd9a000f040 con 0x7fd9ac0676c0 2020-06-27T04:44:35.586 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.580+0000 7fd9ab59e700 1 -- 172.21.15.51:0/4120401453 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ac0645c0 con 0x7fd9ac0676c0 2020-06-27T04:44:35.587 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.580+0000 7fd99affd700 1 -- 172.21.15.51:0/4120401453 <== mon.2 v2:172.21.15.51:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9a000c9d0 con 0x7fd9ac0676c0 2020-06-27T04:44:35.588 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.580+0000 7fd99affd700 1 -- 172.21.15.51:0/4120401453 <== mon.2 v2:172.21.15.51:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7fd9a000cb30 con 0x7fd9ac0676c0 2020-06-27T04:44:35.588 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.581+0000 7fd99affd700 1 --2- 172.21.15.51:0/4120401453 >> v2:172.21.15.51:6800/950992045 conn(0x7fd98c02ab50 0x7fd98c02d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:35.588 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.581+0000 7fd9ab59e700 1 -- 172.21.15.51:0/4120401453 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ac05e210 con 0x7fd9ac0676c0 2020-06-27T04:44:35.588 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.581+0000 7fd99affd700 1 -- 172.21.15.51:0/4120401453 <== mon.2 v2:172.21.15.51:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5017+0+0 (secure 0 0 0) 0x7fd9a003a770 con 0x7fd9ac0676c0 2020-06-27T04:44:35.588 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.581+0000 7fd9aad9d700 1 --2- 172.21.15.51:0/4120401453 >> v2:172.21.15.51:6800/950992045 conn(0x7fd98c02ab50 0x7fd98c02d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:35.589 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.581+0000 7fd9aad9d700 1 --2- 172.21.15.51:0/4120401453 >> v2:172.21.15.51:6800/950992045 conn(0x7fd98c02ab50 0x7fd98c02d010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd99c00c000 tx=0x7fd99c009040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:44:35.589 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.584+0000 7fd99affd700 1 -- 172.21.15.51:0/4120401453 <== mon.2 v2:172.21.15.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fd9a0019070 con 0x7fd9ac0676c0 2020-06-27T04:44:35.767 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.765+0000 7fd9ab59e700 1 -- 172.21.15.51:0/4120401453 --> v2:172.21.15.51:6800/950992045 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi031=a;smithi051=b", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9ac05f390 con 0x7fd98c02ab50 2020-06-27T04:44:35.843 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.841+0000 7fd99affd700 1 -- 172.21.15.51:0/4120401453 <== mgr.34109 v2:172.21.15.51:6800/950992045 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fd99c00f040 con 0x7fd98c02ab50 2020-06-27T04:44:35.844 INFO:teuthology.orchestra.run.smithi051.stdout:Scheduled node-exporter update... 2020-06-27T04:44:35.846 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.843+0000 7fd9ab59e700 1 -- 172.21.15.51:0/4120401453 >> v2:172.21.15.51:6800/950992045 conn(0x7fd98c02ab50 msgr2=0x7fd98c02d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:35.846 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.843+0000 7fd9ab59e700 1 --2- 172.21.15.51:0/4120401453 >> v2:172.21.15.51:6800/950992045 conn(0x7fd98c02ab50 0x7fd98c02d010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd99c00c000 tx=0x7fd99c009040).stop 2020-06-27T04:44:35.846 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.843+0000 7fd9ab59e700 1 -- 172.21.15.51:0/4120401453 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd9ac0676c0 msgr2=0x7fd9ac074770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:35.846 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.843+0000 7fd9ab59e700 1 --2- 172.21.15.51:0/4120401453 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd9ac0676c0 0x7fd9ac074770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd9a0004370 tx=0x7fd9a000b040).stop 2020-06-27T04:44:35.847 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.843+0000 7fd9ab59e700 1 -- 172.21.15.51:0/4120401453 shutdown_connections 2020-06-27T04:44:35.847 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.843+0000 7fd9ab59e700 1 --2- 172.21.15.51:0/4120401453 >> v2:172.21.15.51:6800/950992045 conn(0x7fd98c02ab50 0x7fd98c02d010 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:35.847 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.843+0000 7fd9ab59e700 1 --2- 172.21.15.51:0/4120401453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9ac077680 0x7fd9ac077b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:35.847 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.843+0000 7fd9ab59e700 1 --2- 172.21.15.51:0/4120401453 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9ac066220 0x7fd9ac074080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:35.847 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.843+0000 7fd9ab59e700 1 --2- 172.21.15.51:0/4120401453 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd9ac0676c0 0x7fd9ac074770 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:35.848 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.843+0000 7fd9ab59e700 1 -- 172.21.15.51:0/4120401453 >> 172.21.15.51:0/4120401453 conn(0x7fd9ac025510 msgr2=0x7fd9ac06c910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:44:35.848 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.844+0000 7fd9ab59e700 1 -- 172.21.15.51:0/4120401453 shutdown_connections 2020-06-27T04:44:35.849 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:35.844+0000 7fd9ab59e700 1 -- 172.21.15.51:0/4120401453 wait complete. 2020-06-27T04:44:36.522 INFO:teuthology.orchestra.run.smithi031:node-exporter.a> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@node-exporter.a.service 2020-06-27T04:44:36.526 INFO:teuthology.orchestra.run.smithi051:node-exporter.b> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@node-exporter.b.service 2020-06-27T04:44:36.529 INFO:tasks.cephadm:Adding alertmanager.a on smithi031 2020-06-27T04:44:36.529 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph orch apply alertmanager '1;smithi031=a' 2020-06-27T04:44:36.564 INFO:ceph.node-exporter.a.smithi031.stdout:-- Logs begin at Sat 2020-06-27 04:33:08 UTC. -- 2020-06-27T04:44:36.575 INFO:ceph.node-exporter.b.smithi051.stdout:-- Logs begin at Sat 2020-06-27 04:33:02 UTC. -- 2020-06-27T04:44:36.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:36 smithi051 bash[18409]: cluster 2020-06-27T04:44:35.128988+0000 mgr.x (mgr.34109) 109 : cluster [DBG] pgmap v107: 65 pgs: 6 creating+peering, 26 unknown, 33 active+clean; 1.9 KiB data, 3.5 MiB used, 707 GiB / 715 GiB avail; 623 B/s rd, 1.5 KiB/s wr, 2 op/s 2020-06-27T04:44:36.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:36 smithi051 bash[18409]: audit 2020-06-27T04:44:35.378440+0000 mon.a (mon.0) 443 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]': finished 2020-06-27T04:44:36.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:36 smithi051 bash[18409]: cluster 2020-06-27T04:44:35.378635+0000 mon.a (mon.0) 444 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2020-06-27T04:44:36.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:36 smithi051 bash[18409]: audit 2020-06-27T04:44:35.766321+0000 mgr.x (mgr.34109) 110 : audit [DBG] from='client.34397 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi031=a;smithi051=b", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:44:36.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:36 smithi051 bash[18409]: cephadm 2020-06-27T04:44:35.766961+0000 mgr.x (mgr.34109) 111 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi031=a,smithi051=b 2020-06-27T04:44:36.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:36 smithi051 bash[18409]: audit 2020-06-27T04:44:35.767277+0000 mon.b (mon.2) 214 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2020-06-27T04:44:35.766971\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi051\", \"name\": \"b\", \"network\": \"\"}]}, \"service_name\": \"node-exporter\", \"service_type\": \"node-exporter\"}}"}]: dispatch 2020-06-27T04:44:36.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:36 smithi051 bash[18409]: audit 2020-06-27T04:44:35.836073+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2020-06-27T04:44:35.766971\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi051\", \"name\": \"b\", \"network\": \"\"}]}, \"service_name\": \"node-exporter\", \"service_type\": \"node-exporter\"}}"}]: dispatch 2020-06-27T04:44:36.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:36 smithi051 bash[18409]: audit 2020-06-27T04:44:35.839340+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2020-06-27T04:44:35.766971\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi051\", \"name\": \"b\", \"network\": \"\"}]}, \"service_name\": \"node-exporter\", \"service_type\": \"node-exporter\"}}"}]': finished 2020-06-27T04:44:36.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:36 smithi031 bash[18426]: cluster 2020-06-27T04:44:35.128988+0000 mgr.x (mgr.34109) 109 : cluster [DBG] pgmap v107: 65 pgs: 6 creating+peering, 26 unknown, 33 active+clean; 1.9 KiB data, 3.5 MiB used, 707 GiB / 715 GiB avail; 623 B/s rd, 1.5 KiB/s wr, 2 op/s 2020-06-27T04:44:36.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:36 smithi031 bash[18426]: audit 2020-06-27T04:44:35.378440+0000 mon.a (mon.0) 443 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]': finished 2020-06-27T04:44:36.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:36 smithi031 bash[18426]: cluster 2020-06-27T04:44:35.378635+0000 mon.a (mon.0) 444 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2020-06-27T04:44:36.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:36 smithi031 bash[18426]: audit 2020-06-27T04:44:35.766321+0000 mgr.x (mgr.34109) 110 : audit [DBG] from='client.34397 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi031=a;smithi051=b", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:44:36.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:36 smithi031 bash[18426]: cephadm 2020-06-27T04:44:35.766961+0000 mgr.x (mgr.34109) 111 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi031=a,smithi051=b 2020-06-27T04:44:36.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:36 smithi031 bash[18426]: audit 2020-06-27T04:44:35.767277+0000 mon.b (mon.2) 214 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2020-06-27T04:44:35.766971\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi051\", \"name\": \"b\", \"network\": \"\"}]}, \"service_name\": \"node-exporter\", \"service_type\": \"node-exporter\"}}"}]: dispatch 2020-06-27T04:44:36.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:36 smithi031 bash[18426]: audit 2020-06-27T04:44:35.836073+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2020-06-27T04:44:35.766971\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi051\", \"name\": \"b\", \"network\": \"\"}]}, \"service_name\": \"node-exporter\", \"service_type\": \"node-exporter\"}}"}]: dispatch 2020-06-27T04:44:36.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:36 smithi031 bash[18426]: audit 2020-06-27T04:44:35.839340+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2020-06-27T04:44:35.766971\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi051\", \"name\": \"b\", \"network\": \"\"}]}, \"service_name\": \"node-exporter\", \"service_type\": \"node-exporter\"}}"}]': finished 2020-06-27T04:44:36.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:36 smithi031 bash[22603]: cluster 2020-06-27T04:44:35.128988+0000 mgr.x (mgr.34109) 109 : cluster [DBG] pgmap v107: 65 pgs: 6 creating+peering, 26 unknown, 33 active+clean; 1.9 KiB data, 3.5 MiB used, 707 GiB / 715 GiB avail; 623 B/s rd, 1.5 KiB/s wr, 2 op/s 2020-06-27T04:44:36.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:36 smithi031 bash[22603]: audit 2020-06-27T04:44:35.378440+0000 mon.a (mon.0) 443 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]': finished 2020-06-27T04:44:36.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:36 smithi031 bash[22603]: cluster 2020-06-27T04:44:35.378635+0000 mon.a (mon.0) 444 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2020-06-27T04:44:36.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:36 smithi031 bash[22603]: audit 2020-06-27T04:44:35.766321+0000 mgr.x (mgr.34109) 110 : audit [DBG] from='client.34397 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi031=a;smithi051=b", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:44:36.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:36 smithi031 bash[22603]: cephadm 2020-06-27T04:44:35.766961+0000 mgr.x (mgr.34109) 111 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi031=a,smithi051=b 2020-06-27T04:44:36.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:36 smithi031 bash[22603]: audit 2020-06-27T04:44:35.767277+0000 mon.b (mon.2) 214 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2020-06-27T04:44:35.766971\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi051\", \"name\": \"b\", \"network\": \"\"}]}, \"service_name\": \"node-exporter\", \"service_type\": \"node-exporter\"}}"}]: dispatch 2020-06-27T04:44:36.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:36 smithi031 bash[22603]: audit 2020-06-27T04:44:35.836073+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2020-06-27T04:44:35.766971\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi051\", \"name\": \"b\", \"network\": \"\"}]}, \"service_name\": \"node-exporter\", \"service_type\": \"node-exporter\"}}"}]: dispatch 2020-06-27T04:44:36.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:36 smithi031 bash[22603]: audit 2020-06-27T04:44:35.839340+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2020-06-27T04:44:35.766971\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi051\", \"name\": \"b\", \"network\": \"\"}]}, \"service_name\": \"node-exporter\", \"service_type\": \"node-exporter\"}}"}]': finished 2020-06-27T04:44:37.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:37 smithi051 bash[18409]: cluster 2020-06-27T04:44:36.379848+0000 mon.a (mon.0) 447 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2020-06-27T04:44:37.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:37 smithi051 bash[18409]: audit 2020-06-27T04:44:36.383151+0000 mon.c (mon.1) 12 : audit [INF] from='client.? 172.21.15.31:0/2254075557' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2020-06-27T04:44:37.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:37 smithi051 bash[18409]: audit 2020-06-27T04:44:36.391072+0000 mon.a (mon.0) 448 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2020-06-27T04:44:37.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:37 smithi051 bash[18409]: audit 2020-06-27T04:44:37.384614+0000 mon.a (mon.0) 449 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]': finished 2020-06-27T04:44:37.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:37 smithi051 bash[18409]: cluster 2020-06-27T04:44:37.384721+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2020-06-27T04:44:37.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:37 smithi031 bash[18426]: cluster 2020-06-27T04:44:36.379848+0000 mon.a (mon.0) 447 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2020-06-27T04:44:37.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:37 smithi031 bash[18426]: audit 2020-06-27T04:44:36.383151+0000 mon.c (mon.1) 12 : audit [INF] from='client.? 172.21.15.31:0/2254075557' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2020-06-27T04:44:37.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:37 smithi031 bash[18426]: audit 2020-06-27T04:44:36.391072+0000 mon.a (mon.0) 448 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2020-06-27T04:44:37.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:37 smithi031 bash[18426]: audit 2020-06-27T04:44:37.384614+0000 mon.a (mon.0) 449 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]': finished 2020-06-27T04:44:37.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:37 smithi031 bash[18426]: cluster 2020-06-27T04:44:37.384721+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2020-06-27T04:44:37.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:37 smithi031 bash[22603]: cluster 2020-06-27T04:44:36.379848+0000 mon.a (mon.0) 447 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2020-06-27T04:44:37.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:37 smithi031 bash[22603]: audit 2020-06-27T04:44:36.383151+0000 mon.c (mon.1) 12 : audit [INF] from='client.? 172.21.15.31:0/2254075557' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2020-06-27T04:44:37.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:37 smithi031 bash[22603]: audit 2020-06-27T04:44:36.391072+0000 mon.a (mon.0) 448 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2020-06-27T04:44:37.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:37 smithi031 bash[22603]: audit 2020-06-27T04:44:37.384614+0000 mon.a (mon.0) 449 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]': finished 2020-06-27T04:44:37.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:37 smithi031 bash[22603]: cluster 2020-06-27T04:44:37.384721+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2020-06-27T04:44:38.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:38 smithi051 bash[18409]: cluster 2020-06-27T04:44:37.129471+0000 mgr.x (mgr.34109) 112 : cluster [DBG] pgmap v110: 97 pgs: 6 creating+peering, 50 unknown, 41 active+clean; 1.9 KiB data, 3.5 MiB used, 707 GiB / 715 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 2 op/s 2020-06-27T04:44:38.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:38 smithi031 bash[18426]: cluster 2020-06-27T04:44:37.129471+0000 mgr.x (mgr.34109) 112 : cluster [DBG] pgmap v110: 97 pgs: 6 creating+peering, 50 unknown, 41 active+clean; 1.9 KiB data, 3.5 MiB used, 707 GiB / 715 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 2 op/s 2020-06-27T04:44:38.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:38 smithi031 bash[22603]: cluster 2020-06-27T04:44:37.129471+0000 mgr.x (mgr.34109) 112 : cluster [DBG] pgmap v110: 97 pgs: 6 creating+peering, 50 unknown, 41 active+clean; 1.9 KiB data, 3.5 MiB used, 707 GiB / 715 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 2 op/s 2020-06-27T04:44:39.717 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:39 smithi051 bash[18409]: cluster 2020-06-27T04:44:38.400110+0000 mon.a (mon.0) 451 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2020-06-27T04:44:39.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:39 smithi051 bash[18409]: audit 2020-06-27T04:44:38.401933+0000 mon.c (mon.1) 13 : audit [INF] from='client.? 172.21.15.31:0/3636044534' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2020-06-27T04:44:39.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:39 smithi051 bash[18409]: audit 2020-06-27T04:44:38.402346+0000 mon.a (mon.0) 452 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2020-06-27T04:44:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:39 smithi031 bash[18426]: cluster 2020-06-27T04:44:38.400110+0000 mon.a (mon.0) 451 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2020-06-27T04:44:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:39 smithi031 bash[18426]: audit 2020-06-27T04:44:38.401933+0000 mon.c (mon.1) 13 : audit [INF] from='client.? 172.21.15.31:0/3636044534' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2020-06-27T04:44:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:39 smithi031 bash[18426]: audit 2020-06-27T04:44:38.402346+0000 mon.a (mon.0) 452 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2020-06-27T04:44:39.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:39 smithi031 bash[22603]: cluster 2020-06-27T04:44:38.400110+0000 mon.a (mon.0) 451 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2020-06-27T04:44:39.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:39 smithi031 bash[22603]: audit 2020-06-27T04:44:38.401933+0000 mon.c (mon.1) 13 : audit [INF] from='client.? 172.21.15.31:0/3636044534' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2020-06-27T04:44:39.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:39 smithi031 bash[22603]: audit 2020-06-27T04:44:38.402346+0000 mon.a (mon.0) 452 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2020-06-27T04:44:40.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:40 smithi051 bash[18409]: cluster 2020-06-27T04:44:39.129840+0000 mgr.x (mgr.34109) 113 : cluster [DBG] pgmap v113: 129 pgs: 6 creating+peering, 44 unknown, 79 active+clean; 1.9 KiB data, 3.8 MiB used, 707 GiB / 715 GiB avail; 3.5 KiB/s rd, 3 op/s 2020-06-27T04:44:40.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:40 smithi051 bash[18409]: audit 2020-06-27T04:44:39.402414+0000 mon.a (mon.0) 453 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]': finished 2020-06-27T04:44:40.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:40 smithi051 bash[18409]: cluster 2020-06-27T04:44:39.402655+0000 mon.a (mon.0) 454 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2020-06-27T04:44:40.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:40 smithi051 bash[18409]: audit 2020-06-27T04:44:39.406393+0000 mon.c (mon.1) 14 : audit [INF] from='client.? 172.21.15.31:0/3636044534' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2020-06-27T04:44:40.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:40 smithi051 bash[18409]: audit 2020-06-27T04:44:39.412636+0000 mon.a (mon.0) 455 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2020-06-27T04:44:40.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:40 smithi031 bash[22603]: cluster 2020-06-27T04:44:39.129840+0000 mgr.x (mgr.34109) 113 : cluster [DBG] pgmap v113: 129 pgs: 6 creating+peering, 44 unknown, 79 active+clean; 1.9 KiB data, 3.8 MiB used, 707 GiB / 715 GiB avail; 3.5 KiB/s rd, 3 op/s 2020-06-27T04:44:40.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:40 smithi031 bash[22603]: audit 2020-06-27T04:44:39.402414+0000 mon.a (mon.0) 453 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]': finished 2020-06-27T04:44:40.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:40 smithi031 bash[22603]: cluster 2020-06-27T04:44:39.402655+0000 mon.a (mon.0) 454 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2020-06-27T04:44:40.729 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:40 smithi031 bash[22603]: audit 2020-06-27T04:44:39.406393+0000 mon.c (mon.1) 14 : audit [INF] from='client.? 172.21.15.31:0/3636044534' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2020-06-27T04:44:40.729 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:40 smithi031 bash[22603]: audit 2020-06-27T04:44:39.412636+0000 mon.a (mon.0) 455 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2020-06-27T04:44:40.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:40 smithi031 bash[18426]: cluster 2020-06-27T04:44:39.129840+0000 mgr.x (mgr.34109) 113 : cluster [DBG] pgmap v113: 129 pgs: 6 creating+peering, 44 unknown, 79 active+clean; 1.9 KiB data, 3.8 MiB used, 707 GiB / 715 GiB avail; 3.5 KiB/s rd, 3 op/s 2020-06-27T04:44:40.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:40 smithi031 bash[18426]: audit 2020-06-27T04:44:39.402414+0000 mon.a (mon.0) 453 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]': finished 2020-06-27T04:44:40.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:40 smithi031 bash[18426]: cluster 2020-06-27T04:44:39.402655+0000 mon.a (mon.0) 454 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2020-06-27T04:44:40.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:40 smithi031 bash[18426]: audit 2020-06-27T04:44:39.406393+0000 mon.c (mon.1) 14 : audit [INF] from='client.? 172.21.15.31:0/3636044534' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2020-06-27T04:44:40.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:40 smithi031 bash[18426]: audit 2020-06-27T04:44:39.412636+0000 mon.a (mon.0) 455 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2020-06-27T04:44:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:41 smithi051 bash[18409]: audit 2020-06-27T04:44:40.415621+0000 mon.a (mon.0) 456 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2020-06-27T04:44:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:41 smithi051 bash[18409]: cluster 2020-06-27T04:44:40.415692+0000 mon.a (mon.0) 457 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2020-06-27T04:44:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:41 smithi051 bash[18409]: audit 2020-06-27T04:44:40.416504+0000 mon.c (mon.1) 15 : audit [INF] from='client.? 172.21.15.31:0/3636044534' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2020-06-27T04:44:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:41 smithi051 bash[18409]: audit 2020-06-27T04:44:40.416923+0000 mon.a (mon.0) 458 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2020-06-27T04:44:41.722 INFO:ceph.rgw.realm.zone.a.smithi031.stdout:Jun 27 04:44:41 smithi031 bash[32813]: debug 2020-06-27T04:44:41.523+0000 7fb365ef92c0 -1 rgw period pusher: The new period does not contain my zonegroup! 2020-06-27T04:44:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:41 smithi031 bash[18426]: audit 2020-06-27T04:44:40.415621+0000 mon.a (mon.0) 456 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2020-06-27T04:44:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:41 smithi031 bash[18426]: cluster 2020-06-27T04:44:40.415692+0000 mon.a (mon.0) 457 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2020-06-27T04:44:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:41 smithi031 bash[18426]: audit 2020-06-27T04:44:40.416504+0000 mon.c (mon.1) 15 : audit [INF] from='client.? 172.21.15.31:0/3636044534' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2020-06-27T04:44:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:41 smithi031 bash[18426]: audit 2020-06-27T04:44:40.416923+0000 mon.a (mon.0) 458 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2020-06-27T04:44:41.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:41 smithi031 bash[22603]: audit 2020-06-27T04:44:40.415621+0000 mon.a (mon.0) 456 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2020-06-27T04:44:41.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:41 smithi031 bash[22603]: cluster 2020-06-27T04:44:40.415692+0000 mon.a (mon.0) 457 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2020-06-27T04:44:41.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:41 smithi031 bash[22603]: audit 2020-06-27T04:44:40.416504+0000 mon.c (mon.1) 15 : audit [INF] from='client.? 172.21.15.31:0/3636044534' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2020-06-27T04:44:41.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:41 smithi031 bash[22603]: audit 2020-06-27T04:44:40.416923+0000 mon.a (mon.0) 458 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2020-06-27T04:44:42.565 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.557+0000 7f910de94700 1 Processor -- start 2020-06-27T04:44:42.565 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.557+0000 7f910de94700 1 -- start start 2020-06-27T04:44:42.565 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.557+0000 7f910de94700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91080678b0 0x7f910806c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:42.566 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.557+0000 7f910de94700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f910806be30 0x7f910806cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:42.566 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.557+0000 7f910de94700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9108078770 0x7f91081250b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:42.566 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.557+0000 7f910de94700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91081255a0 con 0x7f91080678b0 2020-06-27T04:44:42.566 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.557+0000 7f910de94700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91081256e0 con 0x7f910806be30 2020-06-27T04:44:42.566 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.557+0000 7f910de94700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9108125820 con 0x7f9108078770 2020-06-27T04:44:42.567 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.557+0000 7f90fffff700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f910806be30 0x7f910806cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:42.567 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.557+0000 7f90fffff700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f910806be30 0x7f910806cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.51:3300/0 says I am v2:172.21.15.51:50536/0 (socket says 172.21.15.51:50536) 2020-06-27T04:44:42.567 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.557+0000 7f90fffff700 1 -- 172.21.15.51:0/2852834840 learned_addr learned my addr 172.21.15.51:0/2852834840 (peer_addr_for_me v2:172.21.15.51:0/0) 2020-06-27T04:44:42.567 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.557+0000 7f90fffff700 1 -- 172.21.15.51:0/2852834840 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9108078770 msgr2=0x7f91081250b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:42.567 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.557+0000 7f90fffff700 1 --2- 172.21.15.51:0/2852834840 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9108078770 0x7f91081250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-06-27T04:44:42.568 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.557+0000 7f9107fff700 1 --2- 172.21.15.51:0/2852834840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91080678b0 0x7f910806c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:42.568 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.557+0000 7f90fffff700 1 -- 172.21.15.51:0/2852834840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91080678b0 msgr2=0x7f910806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:42.568 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.557+0000 7f90fffff700 1 --2- 172.21.15.51:0/2852834840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91080678b0 0x7f910806c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:42.568 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.557+0000 7f90fffff700 1 -- 172.21.15.51:0/2852834840 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91081259e0 con 0x7f910806be30 2020-06-27T04:44:42.568 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.557+0000 7f9107fff700 1 --2- 172.21.15.51:0/2852834840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91080678b0 0x7f910806c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-06-27T04:44:42.569 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.558+0000 7f90fffff700 1 --2- 172.21.15.51:0/2852834840 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f910806be30 0x7f910806cb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f90f0002f70 tx=0x7f90f0009b30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:44:42.569 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.558+0000 7f9104ff9700 1 -- 172.21.15.51:0/2852834840 <== mon.2 v2:172.21.15.51:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90f000e030 con 0x7f910806be30 2020-06-27T04:44:42.569 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.558+0000 7f9104ff9700 1 -- 172.21.15.51:0/2852834840 <== mon.2 v2:172.21.15.51:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f90f0013db0 con 0x7f910806be30 2020-06-27T04:44:42.569 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.558+0000 7f910de94700 1 -- 172.21.15.51:0/2852834840 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9108125c30 con 0x7f910806be30 2020-06-27T04:44:42.569 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.558+0000 7f9104ff9700 1 -- 172.21.15.51:0/2852834840 <== mon.2 v2:172.21.15.51:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90f0018070 con 0x7f910806be30 2020-06-27T04:44:42.570 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.558+0000 7f910de94700 1 -- 172.21.15.51:0/2852834840 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9108126170 con 0x7f910806be30 2020-06-27T04:44:42.570 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.559+0000 7f9104ff9700 1 -- 172.21.15.51:0/2852834840 <== mon.2 v2:172.21.15.51:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f90f001db90 con 0x7f910806be30 2020-06-27T04:44:42.570 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.559+0000 7f9104ff9700 1 --2- 172.21.15.51:0/2852834840 >> v2:172.21.15.51:6800/950992045 conn(0x7f90e002ab00 0x7f90e002cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:42.570 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.559+0000 7f9104ff9700 1 -- 172.21.15.51:0/2852834840 <== mon.2 v2:172.21.15.51:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5778+0+0 (secure 0 0 0) 0x7f90f003cc10 con 0x7f910806be30 2020-06-27T04:44:42.570 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.559+0000 7f910de94700 1 -- 172.21.15.51:0/2852834840 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f910805e210 con 0x7f910806be30 2020-06-27T04:44:42.570 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.559+0000 7f9107fff700 1 --2- 172.21.15.51:0/2852834840 >> v2:172.21.15.51:6800/950992045 conn(0x7f90e002ab00 0x7f90e002cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:42.571 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.559+0000 7f9107fff700 1 --2- 172.21.15.51:0/2852834840 >> v2:172.21.15.51:6800/950992045 conn(0x7f90e002ab00 0x7f90e002cfc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f90f8008000 tx=0x7f90f8009040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:44:42.571 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.562+0000 7f9104ff9700 1 -- 172.21.15.51:0/2852834840 <== mon.2 v2:172.21.15.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f90f0011780 con 0x7f910806be30 2020-06-27T04:44:42.717 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:42 smithi051 bash[18409]: cluster 2020-06-27T04:44:41.130233+0000 mgr.x (mgr.34109) 114 : cluster [DBG] pgmap v116: 129 pgs: 27 unknown, 102 active+clean; 1.9 KiB data, 3.9 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2020-06-27T04:44:42.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:42 smithi051 bash[18409]: audit 2020-06-27T04:44:41.420728+0000 mon.a (mon.0) 459 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2020-06-27T04:44:42.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:42 smithi051 bash[18409]: cluster 2020-06-27T04:44:41.420823+0000 mon.a (mon.0) 460 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2020-06-27T04:44:42.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:42 smithi031 bash[22603]: cluster 2020-06-27T04:44:41.130233+0000 mgr.x (mgr.34109) 114 : cluster [DBG] pgmap v116: 129 pgs: 27 unknown, 102 active+clean; 1.9 KiB data, 3.9 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2020-06-27T04:44:42.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:42 smithi031 bash[22603]: audit 2020-06-27T04:44:41.420728+0000 mon.a (mon.0) 459 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2020-06-27T04:44:42.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:42 smithi031 bash[22603]: cluster 2020-06-27T04:44:41.420823+0000 mon.a (mon.0) 460 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2020-06-27T04:44:42.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:42 smithi031 bash[18426]: cluster 2020-06-27T04:44:41.130233+0000 mgr.x (mgr.34109) 114 : cluster [DBG] pgmap v116: 129 pgs: 27 unknown, 102 active+clean; 1.9 KiB data, 3.9 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2020-06-27T04:44:42.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:42 smithi031 bash[18426]: audit 2020-06-27T04:44:41.420728+0000 mon.a (mon.0) 459 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2020-06-27T04:44:42.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:42 smithi031 bash[18426]: cluster 2020-06-27T04:44:41.420823+0000 mon.a (mon.0) 460 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2020-06-27T04:44:42.744 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.741+0000 7f910de94700 1 -- 172.21.15.51:0/2852834840 --> v2:172.21.15.51:6800/950992045 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi031=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f910805f390 con 0x7f90e002ab00 2020-06-27T04:44:42.749 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.747+0000 7f9104ff9700 1 -- 172.21.15.51:0/2852834840 <== mgr.34109 v2:172.21.15.51:6800/950992045 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f90f800d040 con 0x7f90e002ab00 2020-06-27T04:44:42.750 INFO:teuthology.orchestra.run.smithi051.stdout:Scheduled alertmanager update... 2020-06-27T04:44:42.751 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.749+0000 7f910de94700 1 -- 172.21.15.51:0/2852834840 >> v2:172.21.15.51:6800/950992045 conn(0x7f90e002ab00 msgr2=0x7f90e002cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:42.751 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.749+0000 7f910de94700 1 --2- 172.21.15.51:0/2852834840 >> v2:172.21.15.51:6800/950992045 conn(0x7f90e002ab00 0x7f90e002cfc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f90f8008000 tx=0x7f90f8009040).stop 2020-06-27T04:44:42.752 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.749+0000 7f910de94700 1 -- 172.21.15.51:0/2852834840 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f910806be30 msgr2=0x7f910806cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:42.752 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.749+0000 7f910de94700 1 --2- 172.21.15.51:0/2852834840 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f910806be30 0x7f910806cb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f90f0002f70 tx=0x7f90f0009b30).stop 2020-06-27T04:44:42.752 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.749+0000 7f910de94700 1 -- 172.21.15.51:0/2852834840 shutdown_connections 2020-06-27T04:44:42.752 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.749+0000 7f910de94700 1 --2- 172.21.15.51:0/2852834840 >> v2:172.21.15.51:6800/950992045 conn(0x7f90e002ab00 0x7f90e002cfc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:42.752 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.749+0000 7f910de94700 1 --2- 172.21.15.51:0/2852834840 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9108078770 0x7f91081250b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-06-27T04:44:42.753 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.749+0000 7f910de94700 1 --2- 172.21.15.51:0/2852834840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91080678b0 0x7f910806c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:42.753 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.749+0000 7f910de94700 1 --2- 172.21.15.51:0/2852834840 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f910806be30 0x7f910806cb30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:42.753 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.749+0000 7f910de94700 1 -- 172.21.15.51:0/2852834840 >> 172.21.15.51:0/2852834840 conn(0x7f9108061830 msgr2=0x7f9108063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:44:42.753 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.749+0000 7f910de94700 1 -- 172.21.15.51:0/2852834840 shutdown_connections 2020-06-27T04:44:42.753 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:42.749+0000 7f910de94700 1 -- 172.21.15.51:0/2852834840 wait complete. 2020-06-27T04:44:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:43 smithi051 bash[18409]: audit 2020-06-27T04:44:42.742938+0000 mgr.x (mgr.34109) 115 : audit [DBG] from='client.34415 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi031=a", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:44:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:43 smithi051 bash[18409]: cephadm 2020-06-27T04:44:42.743526+0000 mgr.x (mgr.34109) 116 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi031=a 2020-06-27T04:44:43.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:43 smithi051 bash[18409]: audit 2020-06-27T04:44:42.743853+0000 mon.b (mon.2) 215 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2020-06-27T04:44:42.743535\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"alertmanager\", \"service_type\": \"alertmanager\"}}"}]: dispatch 2020-06-27T04:44:43.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:43 smithi051 bash[18409]: audit 2020-06-27T04:44:42.744478+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2020-06-27T04:44:42.743535\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"alertmanager\", \"service_type\": \"alertmanager\"}}"}]: dispatch 2020-06-27T04:44:43.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:43 smithi051 bash[18409]: audit 2020-06-27T04:44:42.747306+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2020-06-27T04:44:42.743535\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"alertmanager\", \"service_type\": \"alertmanager\"}}"}]': finished 2020-06-27T04:44:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:43 smithi031 bash[22603]: audit 2020-06-27T04:44:42.742938+0000 mgr.x (mgr.34109) 115 : audit [DBG] from='client.34415 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi031=a", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:44:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:43 smithi031 bash[22603]: cephadm 2020-06-27T04:44:42.743526+0000 mgr.x (mgr.34109) 116 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi031=a 2020-06-27T04:44:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:43 smithi031 bash[22603]: audit 2020-06-27T04:44:42.743853+0000 mon.b (mon.2) 215 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2020-06-27T04:44:42.743535\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"alertmanager\", \"service_type\": \"alertmanager\"}}"}]: dispatch 2020-06-27T04:44:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:43 smithi031 bash[22603]: audit 2020-06-27T04:44:42.744478+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2020-06-27T04:44:42.743535\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"alertmanager\", \"service_type\": \"alertmanager\"}}"}]: dispatch 2020-06-27T04:44:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:43 smithi031 bash[22603]: audit 2020-06-27T04:44:42.747306+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2020-06-27T04:44:42.743535\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"alertmanager\", \"service_type\": \"alertmanager\"}}"}]': finished 2020-06-27T04:44:43.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:43 smithi031 bash[18426]: audit 2020-06-27T04:44:42.742938+0000 mgr.x (mgr.34109) 115 : audit [DBG] from='client.34415 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi031=a", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:44:43.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:43 smithi031 bash[18426]: cephadm 2020-06-27T04:44:42.743526+0000 mgr.x (mgr.34109) 116 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi031=a 2020-06-27T04:44:43.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:43 smithi031 bash[18426]: audit 2020-06-27T04:44:42.743853+0000 mon.b (mon.2) 215 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2020-06-27T04:44:42.743535\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"alertmanager\", \"service_type\": \"alertmanager\"}}"}]: dispatch 2020-06-27T04:44:43.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:43 smithi031 bash[18426]: audit 2020-06-27T04:44:42.744478+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2020-06-27T04:44:42.743535\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"alertmanager\", \"service_type\": \"alertmanager\"}}"}]: dispatch 2020-06-27T04:44:43.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:43 smithi031 bash[18426]: audit 2020-06-27T04:44:42.747306+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2020-06-27T04:44:42.743535\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi031\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"alertmanager\", \"service_type\": \"alertmanager\"}}"}]': finished 2020-06-27T04:44:45.034 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:44 smithi051 bash[18409]: cluster 2020-06-27T04:44:43.130859+0000 mgr.x (mgr.34109) 117 : cluster [DBG] pgmap v118: 129 pgs: 11 unknown, 118 active+clean; 2.5 KiB data, 4.1 MiB used, 707 GiB / 715 GiB avail; 26 KiB/s rd, 1.3 KiB/s wr, 53 op/s 2020-06-27T04:44:45.054 INFO:teuthology.orchestra.run.smithi031:alertmanager.a> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@alertmanager.a.service 2020-06-27T04:44:45.058 INFO:tasks.cephadm:Adding grafana.a on smithi051 2020-06-27T04:44:45.058 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph orch apply grafana '1;smithi051=a' 2020-06-27T04:44:45.090 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:44 smithi031 bash[18426]: cluster 2020-06-27T04:44:43.130859+0000 mgr.x (mgr.34109) 117 : cluster [DBG] pgmap v118: 129 pgs: 11 unknown, 118 active+clean; 2.5 KiB data, 4.1 MiB used, 707 GiB / 715 GiB avail; 26 KiB/s rd, 1.3 KiB/s wr, 53 op/s 2020-06-27T04:44:45.090 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:44 smithi031 bash[22603]: cluster 2020-06-27T04:44:43.130859+0000 mgr.x (mgr.34109) 117 : cluster [DBG] pgmap v118: 129 pgs: 11 unknown, 118 active+clean; 2.5 KiB data, 4.1 MiB used, 707 GiB / 715 GiB avail; 26 KiB/s rd, 1.3 KiB/s wr, 53 op/s 2020-06-27T04:44:45.096 INFO:ceph.alertmanager.a.smithi031.stdout:-- Logs begin at Sat 2020-06-27 04:33:08 UTC. -- 2020-06-27T04:44:46.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:46 smithi051 bash[18409]: cluster 2020-06-27T04:44:45.131473+0000 mgr.x (mgr.34109) 118 : cluster [DBG] pgmap v119: 129 pgs: 129 active+clean; 4.2 KiB data, 4.5 MiB used, 707 GiB / 715 GiB avail; 85 KiB/s rd, 3.7 KiB/s wr, 184 op/s 2020-06-27T04:44:47.196 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.193+0000 7fb0f9814700 1 Processor -- start 2020-06-27T04:44:47.197 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.193+0000 7fb0f9814700 1 -- start start 2020-06-27T04:44:47.197 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.193+0000 7fb0f9814700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0f40678b0 0x7fb0f406cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:47.197 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.193+0000 7fb0f9814700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb0f406be30 0x7fb0f40780a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:47.198 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.193+0000 7fb0f9814700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0f40786d0 0x7fb0f41250b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:47.198 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.193+0000 7fb0f9814700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f41255a0 con 0x7fb0f40678b0 2020-06-27T04:44:47.198 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.193+0000 7fb0f9814700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f41256e0 con 0x7fb0f406be30 2020-06-27T04:44:47.198 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.193+0000 7fb0f9814700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4125820 con 0x7fb0f40786d0 2020-06-27T04:44:47.198 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.193+0000 7fb0f2ffd700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb0f406be30 0x7fb0f40780a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:47.199 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.193+0000 7fb0f2ffd700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb0f406be30 0x7fb0f40780a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.51:3300/0 says I am v2:172.21.15.51:50550/0 (socket says 172.21.15.51:50550) 2020-06-27T04:44:47.199 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.193+0000 7fb0f2ffd700 1 -- 172.21.15.51:0/121923693 learned_addr learned my addr 172.21.15.51:0/121923693 (peer_addr_for_me v2:172.21.15.51:0/0) 2020-06-27T04:44:47.199 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.193+0000 7fb0f37fe700 1 --2- 172.21.15.51:0/121923693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0f40678b0 0x7fb0f406cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:47.199 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.193+0000 7fb0f3fff700 1 --2- 172.21.15.51:0/121923693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0f40786d0 0x7fb0f41250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:47.199 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.193+0000 7fb0f2ffd700 1 -- 172.21.15.51:0/121923693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0f40786d0 msgr2=0x7fb0f41250b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:47.200 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.193+0000 7fb0f2ffd700 1 --2- 172.21.15.51:0/121923693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0f40786d0 0x7fb0f41250b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:47.200 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.193+0000 7fb0f2ffd700 1 -- 172.21.15.51:0/121923693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0f40678b0 msgr2=0x7fb0f406cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:47.200 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.193+0000 7fb0f2ffd700 1 --2- 172.21.15.51:0/121923693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0f40678b0 0x7fb0f406cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:47.200 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.193+0000 7fb0f2ffd700 1 -- 172.21.15.51:0/121923693 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f4125960 con 0x7fb0f406be30 2020-06-27T04:44:47.200 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.194+0000 7fb0f2ffd700 1 --2- 172.21.15.51:0/121923693 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb0f406be30 0x7fb0f40780a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fb0e4002f70 tx=0x7fb0e4009b30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:44:47.201 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.194+0000 7fb0eb7fe700 1 -- 172.21.15.51:0/121923693 <== mon.2 v2:172.21.15.51:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0e400e030 con 0x7fb0f406be30 2020-06-27T04:44:47.201 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.194+0000 7fb0eb7fe700 1 -- 172.21.15.51:0/121923693 <== mon.2 v2:172.21.15.51:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fb0e4013cb0 con 0x7fb0f406be30 2020-06-27T04:44:47.201 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.194+0000 7fb0f9814700 1 -- 172.21.15.51:0/121923693 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f4125bb0 con 0x7fb0f406be30 2020-06-27T04:44:47.201 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.194+0000 7fb0eb7fe700 1 -- 172.21.15.51:0/121923693 <== mon.2 v2:172.21.15.51:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0e4018070 con 0x7fb0f406be30 2020-06-27T04:44:47.202 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.194+0000 7fb0f9814700 1 -- 172.21.15.51:0/121923693 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f4125ff0 con 0x7fb0f406be30 2020-06-27T04:44:47.202 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.195+0000 7fb0eb7fe700 1 -- 172.21.15.51:0/121923693 <== mon.2 v2:172.21.15.51:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7fb0e401da40 con 0x7fb0f406be30 2020-06-27T04:44:47.203 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.195+0000 7fb0eb7fe700 1 --2- 172.21.15.51:0/121923693 >> v2:172.21.15.51:6800/950992045 conn(0x7fb0cc02ab50 0x7fb0cc02d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:47.203 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.195+0000 7fb0eb7fe700 1 -- 172.21.15.51:0/121923693 <== mon.2 v2:172.21.15.51:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5778+0+0 (secure 0 0 0) 0x7fb0e403ca50 con 0x7fb0f406be30 2020-06-27T04:44:47.203 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.195+0000 7fb0f9814700 1 -- 172.21.15.51:0/121923693 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f405e210 con 0x7fb0f406be30 2020-06-27T04:44:47.203 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.195+0000 7fb0f37fe700 1 --2- 172.21.15.51:0/121923693 >> v2:172.21.15.51:6800/950992045 conn(0x7fb0cc02ab50 0x7fb0cc02d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:47.204 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.195+0000 7fb0f37fe700 1 --2- 172.21.15.51:0/121923693 >> v2:172.21.15.51:6800/950992045 conn(0x7fb0cc02ab50 0x7fb0cc02d010 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fb0dc00d000 tx=0x7fb0dc007cf0).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:44:47.204 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.199+0000 7fb0eb7fe700 1 -- 172.21.15.51:0/121923693 <== mon.2 v2:172.21.15.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fb0e4012e00 con 0x7fb0f406be30 2020-06-27T04:44:47.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:46 smithi031 bash[22603]: cluster 2020-06-27T04:44:45.131473+0000 mgr.x (mgr.34109) 118 : cluster [DBG] pgmap v119: 129 pgs: 129 active+clean; 4.2 KiB data, 4.5 MiB used, 707 GiB / 715 GiB avail; 85 KiB/s rd, 3.7 KiB/s wr, 184 op/s 2020-06-27T04:44:47.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:46 smithi031 bash[18426]: cluster 2020-06-27T04:44:45.131473+0000 mgr.x (mgr.34109) 118 : cluster [DBG] pgmap v119: 129 pgs: 129 active+clean; 4.2 KiB data, 4.5 MiB used, 707 GiB / 715 GiB avail; 85 KiB/s rd, 3.7 KiB/s wr, 184 op/s 2020-06-27T04:44:47.388 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.385+0000 7fb0f9814700 1 -- 172.21.15.51:0/121923693 --> v2:172.21.15.51:6800/950992045 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi051=a", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0f405f390 con 0x7fb0cc02ab50 2020-06-27T04:44:47.400 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.397+0000 7fb0eb7fe700 1 -- 172.21.15.51:0/121923693 <== mgr.34109 v2:172.21.15.51:6800/950992045 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fb0dc000e90 con 0x7fb0cc02ab50 2020-06-27T04:44:47.400 INFO:teuthology.orchestra.run.smithi051.stdout:Scheduled grafana update... 2020-06-27T04:44:47.401 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.399+0000 7fb0f9814700 1 -- 172.21.15.51:0/121923693 >> v2:172.21.15.51:6800/950992045 conn(0x7fb0cc02ab50 msgr2=0x7fb0cc02d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:47.402 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.399+0000 7fb0f9814700 1 --2- 172.21.15.51:0/121923693 >> v2:172.21.15.51:6800/950992045 conn(0x7fb0cc02ab50 0x7fb0cc02d010 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fb0dc00d000 tx=0x7fb0dc007cf0).stop 2020-06-27T04:44:47.402 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.399+0000 7fb0f9814700 1 -- 172.21.15.51:0/121923693 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb0f406be30 msgr2=0x7fb0f40780a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:47.402 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.399+0000 7fb0f9814700 1 --2- 172.21.15.51:0/121923693 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb0f406be30 0x7fb0f40780a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fb0e4002f70 tx=0x7fb0e4009b30).stop 2020-06-27T04:44:47.402 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.399+0000 7fb0f9814700 1 -- 172.21.15.51:0/121923693 shutdown_connections 2020-06-27T04:44:47.402 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.399+0000 7fb0f9814700 1 --2- 172.21.15.51:0/121923693 >> v2:172.21.15.51:6800/950992045 conn(0x7fb0cc02ab50 0x7fb0cc02d010 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:47.403 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.399+0000 7fb0f9814700 1 --2- 172.21.15.51:0/121923693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0f40786d0 0x7fb0f41250b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:47.403 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.399+0000 7fb0f9814700 1 --2- 172.21.15.51:0/121923693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0f40678b0 0x7fb0f406cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:47.403 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.399+0000 7fb0f9814700 1 --2- 172.21.15.51:0/121923693 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb0f406be30 0x7fb0f40780a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:47.403 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.399+0000 7fb0f9814700 1 -- 172.21.15.51:0/121923693 >> 172.21.15.51:0/121923693 conn(0x7fb0f4061830 msgr2=0x7fb0f4063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:44:47.403 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.399+0000 7fb0f9814700 1 -- 172.21.15.51:0/121923693 shutdown_connections 2020-06-27T04:44:47.404 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:47.399+0000 7fb0f9814700 1 -- 172.21.15.51:0/121923693 wait complete. 2020-06-27T04:44:48.176 INFO:teuthology.orchestra.run.smithi051:grafana.a> sudo journalctl -f -n 0 -u ceph-12892ae2-b830-11ea-a06d-001a4aab830c@grafana.a.service 2020-06-27T04:44:48.179 INFO:tasks.cephadm:Setting up client nodes... 2020-06-27T04:44:48.179 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2020-06-27T04:44:48.208 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:48 smithi051 bash[18409]: cluster 2020-06-27T04:44:47.131937+0000 mgr.x (mgr.34109) 119 : cluster [DBG] pgmap v120: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 95 KiB/s rd, 4.1 KiB/s wr, 203 op/s 2020-06-27T04:44:48.209 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:48 smithi051 bash[18409]: audit 2020-06-27T04:44:47.386784+0000 mgr.x (mgr.34109) 120 : audit [DBG] from='client.34421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi051=a", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:44:48.209 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:48 smithi051 bash[18409]: cephadm 2020-06-27T04:44:47.387409+0000 mgr.x (mgr.34109) 121 : cephadm [INF] Saving service grafana spec with placement count:1 smithi051=a 2020-06-27T04:44:48.209 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:48 smithi051 bash[18409]: audit 2020-06-27T04:44:47.387740+0000 mon.b (mon.2) 216 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2020-06-27T04:44:47.387428\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"grafana\", \"service_type\": \"grafana\"}}"}]: dispatch 2020-06-27T04:44:48.209 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:48 smithi051 bash[18409]: audit 2020-06-27T04:44:47.388244+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2020-06-27T04:44:47.387428\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"grafana\", \"service_type\": \"grafana\"}}"}]: dispatch 2020-06-27T04:44:48.210 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:48 smithi051 bash[18409]: audit 2020-06-27T04:44:47.395271+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2020-06-27T04:44:47.387428\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"grafana\", \"service_type\": \"grafana\"}}"}]': finished 2020-06-27T04:44:48.214 INFO:ceph.grafana.a.smithi051.stdout:-- Logs begin at Sat 2020-06-27 04:33:02 UTC. -- 2020-06-27T04:44:48.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:48 smithi031 bash[18426]: cluster 2020-06-27T04:44:47.131937+0000 mgr.x (mgr.34109) 119 : cluster [DBG] pgmap v120: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 95 KiB/s rd, 4.1 KiB/s wr, 203 op/s 2020-06-27T04:44:48.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:48 smithi031 bash[18426]: audit 2020-06-27T04:44:47.386784+0000 mgr.x (mgr.34109) 120 : audit [DBG] from='client.34421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi051=a", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:44:48.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:48 smithi031 bash[18426]: cephadm 2020-06-27T04:44:47.387409+0000 mgr.x (mgr.34109) 121 : cephadm [INF] Saving service grafana spec with placement count:1 smithi051=a 2020-06-27T04:44:48.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:48 smithi031 bash[18426]: audit 2020-06-27T04:44:47.387740+0000 mon.b (mon.2) 216 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2020-06-27T04:44:47.387428\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"grafana\", \"service_type\": \"grafana\"}}"}]: dispatch 2020-06-27T04:44:48.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:48 smithi031 bash[18426]: audit 2020-06-27T04:44:47.388244+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2020-06-27T04:44:47.387428\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"grafana\", \"service_type\": \"grafana\"}}"}]: dispatch 2020-06-27T04:44:48.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:48 smithi031 bash[18426]: audit 2020-06-27T04:44:47.395271+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2020-06-27T04:44:47.387428\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"grafana\", \"service_type\": \"grafana\"}}"}]': finished 2020-06-27T04:44:48.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:48 smithi031 bash[22603]: cluster 2020-06-27T04:44:47.131937+0000 mgr.x (mgr.34109) 119 : cluster [DBG] pgmap v120: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 95 KiB/s rd, 4.1 KiB/s wr, 203 op/s 2020-06-27T04:44:48.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:48 smithi031 bash[22603]: audit 2020-06-27T04:44:47.386784+0000 mgr.x (mgr.34109) 120 : audit [DBG] from='client.34421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi051=a", "target": ["mon-mgr", ""]}]: dispatch 2020-06-27T04:44:48.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:48 smithi031 bash[22603]: cephadm 2020-06-27T04:44:47.387409+0000 mgr.x (mgr.34109) 121 : cephadm [INF] Saving service grafana spec with placement count:1 smithi051=a 2020-06-27T04:44:48.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:48 smithi031 bash[22603]: audit 2020-06-27T04:44:47.387740+0000 mon.b (mon.2) 216 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2020-06-27T04:44:47.387428\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"grafana\", \"service_type\": \"grafana\"}}"}]: dispatch 2020-06-27T04:44:48.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:48 smithi031 bash[22603]: audit 2020-06-27T04:44:47.388244+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2020-06-27T04:44:47.387428\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"grafana\", \"service_type\": \"grafana\"}}"}]: dispatch 2020-06-27T04:44:48.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:48 smithi031 bash[22603]: audit 2020-06-27T04:44:47.395271+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2020-06-27T04:44:47.387428\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi051\", \"name\": \"a\", \"network\": \"\"}]}, \"service_name\": \"grafana\", \"service_type\": \"grafana\"}}"}]': finished 2020-06-27T04:44:48.865 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:48 smithi051 systemd[1]: Starting Ceph prometheus.a for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:44:49.131 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:48 smithi051 podman[30518]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a found: no such container 2020-06-27T04:44:49.131 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:48 smithi051 systemd[1]: Started Ceph prometheus.a for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:44:49.132 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:48 smithi051 bash[30532]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a found: no such container 2020-06-27T04:44:49.132 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:48 smithi051 bash[30532]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a 2020-06-27T04:44:49.132 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:48 smithi051 bash[30532]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a" found: no such container 2020-06-27T04:44:49.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:49 smithi031 bash[22603]: audit 2020-06-27T04:44:48.895031+0000 mon.b (mon.2) 217 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:49.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:49 smithi031 bash[22603]: audit 2020-06-27T04:44:48.895632+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:49.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:49 smithi031 bash[22603]: audit 2020-06-27T04:44:48.898029+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:49.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:49 smithi031 bash[22603]: audit 2020-06-27T04:44:48.900075+0000 mon.b (mon.2) 218 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:44:49.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:49 smithi031 bash[18426]: audit 2020-06-27T04:44:48.895031+0000 mon.b (mon.2) 217 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:49.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:49 smithi031 bash[18426]: audit 2020-06-27T04:44:48.895632+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:49.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:49 smithi031 bash[18426]: audit 2020-06-27T04:44:48.898029+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:49.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:49 smithi031 bash[18426]: audit 2020-06-27T04:44:48.900075+0000 mon.b (mon.2) 218 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:44:49.468 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 podman[30565]: 2020-06-27 04:44:49.164315866 +0000 UTC m=+0.202880268 container create 87a0fe4361d1d3732cd08c465d59ed7162650f63f9a135381671018191d4d8d6 (image=docker.io/prom/prometheus:v2.18.1, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a) 2020-06-27T04:44:49.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[18409]: audit 2020-06-27T04:44:48.895031+0000 mon.b (mon.2) 217 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:49.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[18409]: audit 2020-06-27T04:44:48.895632+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:49.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[18409]: audit 2020-06-27T04:44:48.898029+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247294\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247370\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247404\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247590\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247694\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:20.247794\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:49.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[18409]: audit 2020-06-27T04:44:48.900075+0000 mon.b (mon.2) 218 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:44:49.968 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 podman[30565]: 2020-06-27 04:44:49.480890086 +0000 UTC m=+0.519454479 container init 87a0fe4361d1d3732cd08c465d59ed7162650f63f9a135381671018191d4d8d6 (image=docker.io/prom/prometheus:v2.18.1, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a) 2020-06-27T04:44:49.968 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 podman[30565]: 2020-06-27 04:44:49.522535118 +0000 UTC m=+0.561099504 container start 87a0fe4361d1d3732cd08c465d59ed7162650f63f9a135381671018191d4d8d6 (image=docker.io/prom/prometheus:v2.18.1, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a) 2020-06-27T04:44:49.968 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 podman[30565]: 2020-06-27 04:44:49.522611435 +0000 UTC m=+0.561175861 container attach 87a0fe4361d1d3732cd08c465d59ed7162650f63f9a135381671018191d4d8d6 (image=docker.io/prom/prometheus:v2.18.1, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a) 2020-06-27T04:44:49.969 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[30532]: level=info ts=2020-06-27T04:44:49.521Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2020-06-27T04:44:49.969 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[30532]: level=info ts=2020-06-27T04:44:49.521Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2020-06-27T04:44:49.969 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[30532]: level=info ts=2020-06-27T04:44:49.521Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2020-06-27T04:44:49.969 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[30532]: level=info ts=2020-06-27T04:44:49.521Z caller=main.go:339 host_details="(Linux 4.18.0-193.6.3.el8_2.x86_64 #1 SMP Wed Jun 10 11:09:32 UTC 2020 x86_64 smithi051 (none))" 2020-06-27T04:44:49.969 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[30532]: level=info ts=2020-06-27T04:44:49.521Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2020-06-27T04:44:49.970 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[30532]: level=info ts=2020-06-27T04:44:49.521Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2020-06-27T04:44:49.970 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[30532]: level=info ts=2020-06-27T04:44:49.522Z caller=main.go:678 msg="Starting TSDB ..." 2020-06-27T04:44:49.970 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[30532]: level=info ts=2020-06-27T04:44:49.522Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2020-06-27T04:44:49.970 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[30532]: level=info ts=2020-06-27T04:44:49.525Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2020-06-27T04:44:49.970 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[30532]: level=info ts=2020-06-27T04:44:49.525Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2020-06-27T04:44:49.971 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[30532]: level=info ts=2020-06-27T04:44:49.525Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=170.611µs 2020-06-27T04:44:49.971 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[30532]: level=info ts=2020-06-27T04:44:49.526Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2020-06-27T04:44:49.971 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[30532]: level=info ts=2020-06-27T04:44:49.526Z caller=main.go:695 msg="TSDB started" 2020-06-27T04:44:49.971 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[30532]: level=info ts=2020-06-27T04:44:49.526Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2020-06-27T04:44:49.971 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[30532]: level=info ts=2020-06-27T04:44:49.527Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2020-06-27T04:44:49.972 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:44:49 smithi051 bash[30532]: level=info ts=2020-06-27T04:44:49.527Z caller=main.go:646 msg="Server is ready to receive web requests." 2020-06-27T04:44:50.431 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:50 smithi031 bash[18426]: cluster 2020-06-27T04:44:49.132426+0000 mgr.x (mgr.34109) 122 : cluster [DBG] pgmap v121: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 88 KiB/s rd, 3.7 KiB/s wr, 186 op/s 2020-06-27T04:44:50.431 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:50 smithi031 bash[22603]: cluster 2020-06-27T04:44:49.132426+0000 mgr.x (mgr.34109) 122 : cluster [DBG] pgmap v121: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 88 KiB/s rd, 3.7 KiB/s wr, 186 op/s 2020-06-27T04:44:50.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:50 smithi051 bash[18409]: cluster 2020-06-27T04:44:49.132426+0000 mgr.x (mgr.34109) 122 : cluster [DBG] pgmap v121: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 88 KiB/s rd, 3.7 KiB/s wr, 186 op/s 2020-06-27T04:44:50.823 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.819+0000 7f0e2d900700 1 Processor -- start 2020-06-27T04:44:50.824 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.819+0000 7f0e2d900700 1 -- start start 2020-06-27T04:44:50.824 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.819+0000 7f0e2d900700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e280678c0 0x7f0e28073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:50.824 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.819+0000 7f0e2d900700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e2806be40 0x7f0e28073870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:50.824 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.819+0000 7f0e2d900700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0e28078790 0x7f0e28120ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:50.825 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.819+0000 7f0e2d900700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e28078d70 con 0x7f0e280678c0 2020-06-27T04:44:50.825 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.819+0000 7f0e2d900700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e281211c0 con 0x7f0e28078790 2020-06-27T04:44:50.825 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.819+0000 7f0e2d900700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e28121380 con 0x7f0e2806be40 2020-06-27T04:44:50.825 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.819+0000 7f0e26ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e2806be40 0x7f0e28073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:50.825 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.819+0000 7f0e26ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e2806be40 0x7f0e28073870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35534/0 (socket says 172.21.15.31:35534) 2020-06-27T04:44:50.826 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.819+0000 7f0e26ffd700 1 -- 172.21.15.31:0/3536892316 learned_addr learned my addr 172.21.15.31:0/3536892316 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:44:50.826 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.819+0000 7f0e277fe700 1 --2- 172.21.15.31:0/3536892316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e280678c0 0x7f0e28073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:50.826 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.819+0000 7f0e27fff700 1 --2- 172.21.15.31:0/3536892316 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0e28078790 0x7f0e28120ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:50.826 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.820+0000 7f0e26ffd700 1 -- 172.21.15.31:0/3536892316 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0e28078790 msgr2=0x7f0e28120ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:50.827 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.820+0000 7f0e26ffd700 1 --2- 172.21.15.31:0/3536892316 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0e28078790 0x7f0e28120ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:50.827 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.820+0000 7f0e26ffd700 1 -- 172.21.15.31:0/3536892316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e280678c0 msgr2=0x7f0e28073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:50.827 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.820+0000 7f0e26ffd700 1 --2- 172.21.15.31:0/3536892316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e280678c0 0x7f0e28073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:50.827 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.820+0000 7f0e26ffd700 1 -- 172.21.15.31:0/3536892316 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e28121540 con 0x7f0e2806be40 2020-06-27T04:44:50.827 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.820+0000 7f0e27fff700 1 --2- 172.21.15.31:0/3536892316 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0e28078790 0x7f0e28120ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-27T04:44:50.827 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.820+0000 7f0e26ffd700 1 --2- 172.21.15.31:0/3536892316 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e2806be40 0x7f0e28073870 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0e1c002f70 tx=0x7f0e1c009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:44:50.828 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.820+0000 7f0e0f7fe700 1 -- 172.21.15.31:0/3536892316 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e1c00e030 con 0x7f0e2806be40 2020-06-27T04:44:50.828 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.820+0000 7f0e2d900700 1 -- 172.21.15.31:0/3536892316 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e28121790 con 0x7f0e2806be40 2020-06-27T04:44:50.828 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.820+0000 7f0e0f7fe700 1 -- 172.21.15.31:0/3536892316 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f0e1c013cb0 con 0x7f0e2806be40 2020-06-27T04:44:50.828 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.820+0000 7f0e0f7fe700 1 -- 172.21.15.31:0/3536892316 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e1c018070 con 0x7f0e2806be40 2020-06-27T04:44:50.828 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.820+0000 7f0e2d900700 1 -- 172.21.15.31:0/3536892316 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e28121c50 con 0x7f0e2806be40 2020-06-27T04:44:50.829 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.821+0000 7f0e0f7fe700 1 -- 172.21.15.31:0/3536892316 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f0e1c01db40 con 0x7f0e2806be40 2020-06-27T04:44:50.830 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.821+0000 7f0e0f7fe700 1 --2- 172.21.15.31:0/3536892316 >> v2:172.21.15.51:6800/950992045 conn(0x7f0e0002ab00 0x7f0e0002cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:50.830 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.821+0000 7f0e0f7fe700 1 -- 172.21.15.31:0/3536892316 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5778+0+0 (secure 0 0 0) 0x7f0e1c03c8e0 con 0x7f0e2806be40 2020-06-27T04:44:50.830 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.821+0000 7f0e277fe700 1 --2- 172.21.15.31:0/3536892316 >> v2:172.21.15.51:6800/950992045 conn(0x7f0e0002ab00 0x7f0e0002cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:50.830 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.821+0000 7f0e2d900700 1 -- 172.21.15.31:0/3536892316 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e2805e210 con 0x7f0e2806be40 2020-06-27T04:44:50.830 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.821+0000 7f0e277fe700 1 --2- 172.21.15.31:0/3536892316 >> v2:172.21.15.51:6800/950992045 conn(0x7f0e0002ab00 0x7f0e0002cfc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f0e1800b000 tx=0x7f0e1800b040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:44:50.831 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:50.825+0000 7f0e0f7fe700 1 -- 172.21.15.31:0/3536892316 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f0e1c012750 con 0x7f0e2806be40 2020-06-27T04:44:50.851 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:50 smithi051 systemd[1]: Starting Ceph node-exporter.b for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:44:51.037 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:51.034+0000 7f0e2d900700 1 -- 172.21.15.31:0/3536892316 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f0e28121ec0 con 0x7f0e2806be40 2020-06-27T04:44:51.042 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:51.039+0000 7f0e0f7fe700 1 -- 172.21.15.31:0/3536892316 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7f0e1c013e20 con 0x7f0e2806be40 2020-06-27T04:44:51.042 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2020-06-27T04:44:51.042 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDDzvZeDxYpAhAAfUx0tZNoGasuUgRFjJVEgw== 2020-06-27T04:44:51.043 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:51.040+0000 7f0e2d900700 1 -- 172.21.15.31:0/3536892316 >> v2:172.21.15.51:6800/950992045 conn(0x7f0e0002ab00 msgr2=0x7f0e0002cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:51.044 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:51.040+0000 7f0e2d900700 1 --2- 172.21.15.31:0/3536892316 >> v2:172.21.15.51:6800/950992045 conn(0x7f0e0002ab00 0x7f0e0002cfc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f0e1800b000 tx=0x7f0e1800b040).stop 2020-06-27T04:44:51.044 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:51.040+0000 7f0e2d900700 1 -- 172.21.15.31:0/3536892316 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e2806be40 msgr2=0x7f0e28073870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:51.044 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:51.040+0000 7f0e2d900700 1 --2- 172.21.15.31:0/3536892316 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e2806be40 0x7f0e28073870 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0e1c002f70 tx=0x7f0e1c009b30).stop 2020-06-27T04:44:51.044 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:51.040+0000 7f0e2d900700 1 -- 172.21.15.31:0/3536892316 shutdown_connections 2020-06-27T04:44:51.045 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:51.040+0000 7f0e2d900700 1 --2- 172.21.15.31:0/3536892316 >> v2:172.21.15.51:6800/950992045 conn(0x7f0e0002ab00 0x7f0e0002cfc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:51.045 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:51.040+0000 7f0e2d900700 1 --2- 172.21.15.31:0/3536892316 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0e28078790 0x7f0e28120ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:51.045 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:51.040+0000 7f0e2d900700 1 --2- 172.21.15.31:0/3536892316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e280678c0 0x7f0e28073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:51.045 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:51.040+0000 7f0e2d900700 1 --2- 172.21.15.31:0/3536892316 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e2806be40 0x7f0e28073870 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:51.045 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:51.040+0000 7f0e2d900700 1 -- 172.21.15.31:0/3536892316 >> 172.21.15.31:0/3536892316 conn(0x7f0e28061840 msgr2=0x7f0e28063c30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:44:51.046 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:51.040+0000 7f0e2d900700 1 -- 172.21.15.31:0/3536892316 shutdown_connections 2020-06-27T04:44:51.046 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:44:51.040+0000 7f0e2d900700 1 -- 172.21.15.31:0/3536892316 wait complete. 2020-06-27T04:44:51.138 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:50 smithi051 podman[30943]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-node-exporter.b found: no such container 2020-06-27T04:44:51.138 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:50 smithi051 systemd[1]: Started Ceph node-exporter.b for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:44:51.139 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:50 smithi051 bash[30958]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-node-exporter.b" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-node-exporter.b found: no such container 2020-06-27T04:44:51.139 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:50 smithi051 bash[30958]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-node-exporter.b 2020-06-27T04:44:51.139 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:50 smithi051 bash[30958]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-node-exporter.b" found: no such container 2020-06-27T04:44:51.139 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:50 smithi051 bash[30958]: Trying to pull registry.access.redhat.com/prom/node-exporter:v0.18.1... 2020-06-27T04:44:51.377 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:51 smithi031 systemd[1]: Starting Ceph node-exporter.a for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:44:51.377 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[18426]: audit 2020-06-27T04:44:50.330939+0000 mon.b (mon.2) 219 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}}, \"last_daemon_update\": \"2020-06-27T04:44:50.330197\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:51.378 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[18426]: audit 2020-06-27T04:44:50.331831+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}}, \"last_daemon_update\": \"2020-06-27T04:44:50.330197\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:51.378 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[18426]: audit 2020-06-27T04:44:50.334729+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}}, \"last_daemon_update\": \"2020-06-27T04:44:50.330197\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:51.378 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[18426]: cephadm 2020-06-27T04:44:50.336430+0000 mgr.x (mgr.34109) 123 : cephadm [INF] Deploying daemon node-exporter.b on smithi051 2020-06-27T04:44:51.378 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[18426]: audit 2020-06-27T04:44:50.881831+0000 mon.b (mon.2) 220 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:51.379 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[18426]: audit 2020-06-27T04:44:50.882414+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:51.379 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[18426]: audit 2020-06-27T04:44:50.884843+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:51.379 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[18426]: audit 2020-06-27T04:44:51.035773+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.31:0/3536892316' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-06-27T04:44:51.380 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[18426]: audit 2020-06-27T04:44:51.036086+0000 mon.a (mon.0) 471 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-06-27T04:44:51.380 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[18426]: audit 2020-06-27T04:44:51.040016+0000 mon.a (mon.0) 472 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-06-27T04:44:51.380 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[22603]: audit 2020-06-27T04:44:50.330939+0000 mon.b (mon.2) 219 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}}, \"last_daemon_update\": \"2020-06-27T04:44:50.330197\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:51.380 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[22603]: audit 2020-06-27T04:44:50.331831+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}}, \"last_daemon_update\": \"2020-06-27T04:44:50.330197\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:51.381 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[22603]: audit 2020-06-27T04:44:50.334729+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}}, \"last_daemon_update\": \"2020-06-27T04:44:50.330197\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:51.381 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[22603]: cephadm 2020-06-27T04:44:50.336430+0000 mgr.x (mgr.34109) 123 : cephadm [INF] Deploying daemon node-exporter.b on smithi051 2020-06-27T04:44:51.381 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[22603]: audit 2020-06-27T04:44:50.881831+0000 mon.b (mon.2) 220 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:51.382 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[22603]: audit 2020-06-27T04:44:50.882414+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:51.382 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[22603]: audit 2020-06-27T04:44:50.884843+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:51.382 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[22603]: audit 2020-06-27T04:44:51.035773+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.31:0/3536892316' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-06-27T04:44:51.382 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[22603]: audit 2020-06-27T04:44:51.036086+0000 mon.a (mon.0) 471 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-06-27T04:44:51.383 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[22603]: audit 2020-06-27T04:44:51.040016+0000 mon.a (mon.0) 472 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-06-27T04:44:51.469 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[30958]: name unknown: Repo not found 2020-06-27T04:44:51.470 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[30958]: Trying to pull registry.fedoraproject.org/prom/node-exporter:v0.18.1... 2020-06-27T04:44:51.470 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[30958]: manifest unknown: manifest unknown 2020-06-27T04:44:51.470 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[30958]: Trying to pull registry.centos.org/prom/node-exporter:v0.18.1... 2020-06-27T04:44:51.471 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[30958]: manifest unknown: manifest unknown 2020-06-27T04:44:51.471 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[30958]: Trying to pull docker.io/prom/node-exporter:v0.18.1... 2020-06-27T04:44:51.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[18409]: audit 2020-06-27T04:44:50.330939+0000 mon.b (mon.2) 219 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}}, \"last_daemon_update\": \"2020-06-27T04:44:50.330197\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:51.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[18409]: audit 2020-06-27T04:44:50.331831+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}}, \"last_daemon_update\": \"2020-06-27T04:44:50.330197\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:51.473 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[18409]: audit 2020-06-27T04:44:50.334729+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}}, \"last_daemon_update\": \"2020-06-27T04:44:50.330197\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:51.473 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[18409]: cephadm 2020-06-27T04:44:50.336430+0000 mgr.x (mgr.34109) 123 : cephadm [INF] Deploying daemon node-exporter.b on smithi051 2020-06-27T04:44:51.474 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[18409]: audit 2020-06-27T04:44:50.881831+0000 mon.b (mon.2) 220 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:51.474 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[18409]: audit 2020-06-27T04:44:50.882414+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:44:51.475 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[18409]: audit 2020-06-27T04:44:50.884843+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:44:51.475 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[18409]: audit 2020-06-27T04:44:51.035773+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.31:0/3536892316' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-06-27T04:44:51.475 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[18409]: audit 2020-06-27T04:44:51.036086+0000 mon.a (mon.0) 471 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-06-27T04:44:51.476 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[18409]: audit 2020-06-27T04:44:51.040016+0000 mon.a (mon.0) 472 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-06-27T04:44:51.623 INFO:teuthology.orchestra.run.smithi031:> sudo sh -c 'cat > /etc/ceph/ceph.client.0.keyring' && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-06-27T04:44:51.647 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:51 smithi031 podman[33993]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-node-exporter.a found: no such container 2020-06-27T04:44:51.647 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:51 smithi031 systemd[1]: Started Ceph node-exporter.a for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:44:51.647 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[34015]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-node-exporter.a" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-node-exporter.a found: no such container 2020-06-27T04:44:51.689 INFO:teuthology.orchestra.run.smithi051:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2020-06-27T04:44:51.901 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[34015]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-node-exporter.a 2020-06-27T04:44:51.901 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[34015]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-node-exporter.a" found: no such container 2020-06-27T04:44:51.901 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[34015]: Trying to pull registry.access.redhat.com/prom/node-exporter:v0.18.1... 2020-06-27T04:44:51.967 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[30958]: Getting image source signatures 2020-06-27T04:44:51.968 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[30958]: Copying blob sha256:49a2d53aa1af115e87f7e23a7fe4b7a3e12304d37982fb6528b035d0f68a3b56 2020-06-27T04:44:51.968 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[30958]: Copying blob sha256:3589a6efd9ce96b2f2218a80bacb84f60d5e584d024023617b0f56b87fe798c3 2020-06-27T04:44:51.968 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:51 smithi051 bash[30958]: Copying blob sha256:190160031744b0810999dd6f293478be0b41524654c70782cf09437095430f2f 2020-06-27T04:44:52.223 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[34015]: name unknown: Repo not found 2020-06-27T04:44:52.224 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:51 smithi031 bash[34015]: Trying to pull registry.fedoraproject.org/prom/node-exporter:v0.18.1... 2020-06-27T04:44:52.224 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[34015]: manifest unknown: manifest unknown 2020-06-27T04:44:52.224 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[34015]: Trying to pull registry.centos.org/prom/node-exporter:v0.18.1... 2020-06-27T04:44:52.224 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[34015]: manifest unknown: manifest unknown 2020-06-27T04:44:52.225 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[34015]: Trying to pull docker.io/prom/node-exporter:v0.18.1... 2020-06-27T04:44:52.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[18426]: cephadm 2020-06-27T04:44:50.885507+0000 mgr.x (mgr.34109) 124 : cephadm [INF] Deploying daemon node-exporter.a on smithi031 2020-06-27T04:44:52.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[18426]: cluster 2020-06-27T04:44:51.132838+0000 mgr.x (mgr.34109) 125 : cluster [DBG] pgmap v122: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 79 KiB/s rd, 3.2 KiB/s wr, 165 op/s 2020-06-27T04:44:52.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[18426]: audit 2020-06-27T04:44:51.463601+0000 mon.b (mon.2) 221 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:44:52.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[18426]: audit 2020-06-27T04:44:51.464450+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:44:52.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[18426]: audit 2020-06-27T04:44:51.467152+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:44:52.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[18426]: cephadm 2020-06-27T04:44:51.470486+0000 mgr.x (mgr.34109) 126 : cephadm [INF] Deploying daemon alertmanager.a on smithi031 2020-06-27T04:44:52.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[22603]: cephadm 2020-06-27T04:44:50.885507+0000 mgr.x (mgr.34109) 124 : cephadm [INF] Deploying daemon node-exporter.a on smithi031 2020-06-27T04:44:52.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[22603]: cluster 2020-06-27T04:44:51.132838+0000 mgr.x (mgr.34109) 125 : cluster [DBG] pgmap v122: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 79 KiB/s rd, 3.2 KiB/s wr, 165 op/s 2020-06-27T04:44:52.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[22603]: audit 2020-06-27T04:44:51.463601+0000 mon.b (mon.2) 221 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:44:52.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[22603]: audit 2020-06-27T04:44:51.464450+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:44:52.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[22603]: audit 2020-06-27T04:44:51.467152+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:44:52.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[22603]: cephadm 2020-06-27T04:44:51.470486+0000 mgr.x (mgr.34109) 126 : cephadm [INF] Deploying daemon alertmanager.a on smithi031 2020-06-27T04:44:52.468 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:52 smithi051 bash[30958]: Copying config sha256:e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87 2020-06-27T04:44:52.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:52 smithi051 bash[18409]: cephadm 2020-06-27T04:44:50.885507+0000 mgr.x (mgr.34109) 124 : cephadm [INF] Deploying daemon node-exporter.a on smithi031 2020-06-27T04:44:52.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:52 smithi051 bash[18409]: cluster 2020-06-27T04:44:51.132838+0000 mgr.x (mgr.34109) 125 : cluster [DBG] pgmap v122: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 79 KiB/s rd, 3.2 KiB/s wr, 165 op/s 2020-06-27T04:44:52.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:52 smithi051 bash[18409]: audit 2020-06-27T04:44:51.463601+0000 mon.b (mon.2) 221 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:44:52.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:52 smithi051 bash[18409]: audit 2020-06-27T04:44:51.464450+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:44:52.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:52 smithi051 bash[18409]: audit 2020-06-27T04:44:51.467152+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:44:52.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:52 smithi051 bash[18409]: cephadm 2020-06-27T04:44:51.470486+0000 mgr.x (mgr.34109) 126 : cephadm [INF] Deploying daemon alertmanager.a on smithi031 2020-06-27T04:44:52.722 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[34015]: Getting image source signatures 2020-06-27T04:44:52.723 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[34015]: Copying blob sha256:190160031744b0810999dd6f293478be0b41524654c70782cf09437095430f2f 2020-06-27T04:44:52.970 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:52 smithi051 bash[30958]: Writing manifest to image destination 2020-06-27T04:44:52.971 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:52 smithi051 bash[30958]: Storing signatures 2020-06-27T04:44:53.223 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[34015]: Copying blob sha256:3589a6efd9ce96b2f2218a80bacb84f60d5e584d024023617b0f56b87fe798c3 2020-06-27T04:44:53.223 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:52 smithi031 bash[34015]: Copying blob sha256:49a2d53aa1af115e87f7e23a7fe4b7a3e12304d37982fb6528b035d0f68a3b56 2020-06-27T04:44:53.583 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:53 smithi031 bash[34015]: Copying config sha256:e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87 2020-06-27T04:44:53.972 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:53 smithi031 bash[34015]: Writing manifest to image destination 2020-06-27T04:44:53.973 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:53 smithi031 bash[34015]: Storing signatures 2020-06-27T04:44:54.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:54 smithi051 bash[18409]: cluster 2020-06-27T04:44:53.133553+0000 mgr.x (mgr.34109) 127 : cluster [DBG] pgmap v123: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 67 KiB/s rd, 2.7 KiB/s wr, 141 op/s 2020-06-27T04:44:54.472 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:54 smithi031 bash[22603]: cluster 2020-06-27T04:44:53.133553+0000 mgr.x (mgr.34109) 127 : cluster [DBG] pgmap v123: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 67 KiB/s rd, 2.7 KiB/s wr, 141 op/s 2020-06-27T04:44:54.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:54 smithi031 bash[18426]: cluster 2020-06-27T04:44:53.133553+0000 mgr.x (mgr.34109) 127 : cluster [DBG] pgmap v123: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 67 KiB/s rd, 2.7 KiB/s wr, 141 op/s 2020-06-27T04:44:54.968 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:54 smithi051 podman[30991]: 2020-06-27 04:44:54.703605358 +0000 UTC m=+3.759452172 image pull 2020-06-27T04:44:55.335 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.330+0000 7fd5fdffb700 1 Processor -- start 2020-06-27T04:44:55.335 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.330+0000 7fd5fdffb700 1 -- start start 2020-06-27T04:44:55.335 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.330+0000 7fd5fdffb700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd5f8066370 0x7fd5f8074280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:55.336 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.330+0000 7fd5fdffb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5f80678c0 0x7fd5f8074970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:55.336 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.330+0000 7fd5fdffb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5f8077880 0x7fd5f8077d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:55.336 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.330+0000 7fd5fdffb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f8078350 con 0x7fd5f8077880 2020-06-27T04:44:55.336 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.330+0000 7fd5fdffb700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f80784c0 con 0x7fd5f8066370 2020-06-27T04:44:55.336 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.330+0000 7fd5fdffb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f8078680 con 0x7fd5f80678c0 2020-06-27T04:44:55.337 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.331+0000 7fd5f7fff700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd5f8066370 0x7fd5f8074280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:55.337 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.331+0000 7fd5f7fff700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd5f8066370 0x7fd5f8074280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.51:3300/0 says I am v2:172.21.15.51:50608/0 (socket says 172.21.15.51:50608) 2020-06-27T04:44:55.337 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.331+0000 7fd5ef7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5f80678c0 0x7fd5f8074970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:55.337 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.331+0000 7fd5f7fff700 1 -- 172.21.15.51:0/2003059440 learned_addr learned my addr 172.21.15.51:0/2003059440 (peer_addr_for_me v2:172.21.15.51:0/0) 2020-06-27T04:44:55.337 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.331+0000 7fd5fcd99700 1 --2- 172.21.15.51:0/2003059440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5f8077880 0x7fd5f8077d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:55.338 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.331+0000 7fd5f7fff700 1 -- 172.21.15.51:0/2003059440 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5f80678c0 msgr2=0x7fd5f8074970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:55.338 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.331+0000 7fd5f7fff700 1 --2- 172.21.15.51:0/2003059440 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5f80678c0 0x7fd5f8074970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:55.338 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.331+0000 7fd5f7fff700 1 -- 172.21.15.51:0/2003059440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5f8077880 msgr2=0x7fd5f8077d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:55.338 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.331+0000 7fd5f7fff700 1 --2- 172.21.15.51:0/2003059440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5f8077880 0x7fd5f8077d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:55.338 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.331+0000 7fd5f7fff700 1 -- 172.21.15.51:0/2003059440 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f8078840 con 0x7fd5f8066370 2020-06-27T04:44:55.339 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.331+0000 7fd5f7fff700 1 --2- 172.21.15.51:0/2003059440 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd5f8066370 0x7fd5f8074280 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fd5e800c000 tx=0x7fd5e800b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:44:55.339 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.331+0000 7fd5f4ff9700 1 -- 172.21.15.51:0/2003059440 <== mon.2 v2:172.21.15.51:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5e80094d0 con 0x7fd5f8066370 2020-06-27T04:44:55.339 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.331+0000 7fd5f4ff9700 1 -- 172.21.15.51:0/2003059440 <== mon.2 v2:172.21.15.51:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fd5e800f040 con 0x7fd5f8066370 2020-06-27T04:44:55.339 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.331+0000 7fd5f4ff9700 1 -- 172.21.15.51:0/2003059440 <== mon.2 v2:172.21.15.51:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5e800cad0 con 0x7fd5f8066370 2020-06-27T04:44:55.339 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.331+0000 7fd5fdffb700 1 -- 172.21.15.51:0/2003059440 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f8078a90 con 0x7fd5f8066370 2020-06-27T04:44:55.340 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.331+0000 7fd5fdffb700 1 -- 172.21.15.51:0/2003059440 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f8067ee0 con 0x7fd5f8066370 2020-06-27T04:44:55.341 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.332+0000 7fd5f4ff9700 1 -- 172.21.15.51:0/2003059440 <== mon.2 v2:172.21.15.51:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7fd5e801b060 con 0x7fd5f8066370 2020-06-27T04:44:55.341 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.332+0000 7fd5f4ff9700 1 --2- 172.21.15.51:0/2003059440 >> v2:172.21.15.51:6800/950992045 conn(0x7fd5d002ab00 0x7fd5d002cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:44:55.341 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.332+0000 7fd5f4ff9700 1 -- 172.21.15.51:0/2003059440 <== mon.2 v2:172.21.15.51:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5778+0+0 (secure 0 0 0) 0x7fd5e803a760 con 0x7fd5f8066370 2020-06-27T04:44:55.341 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.332+0000 7fd5ef7fe700 1 --2- 172.21.15.51:0/2003059440 >> v2:172.21.15.51:6800/950992045 conn(0x7fd5d002ab00 0x7fd5d002cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:44:55.342 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.332+0000 7fd5fdffb700 1 -- 172.21.15.51:0/2003059440 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f805e210 con 0x7fd5f8066370 2020-06-27T04:44:55.342 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.333+0000 7fd5ef7fe700 1 --2- 172.21.15.51:0/2003059440 >> v2:172.21.15.51:6800/950992045 conn(0x7fd5d002ab00 0x7fd5d002cfc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fd5e000b000 tx=0x7fd5e000b040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:44:55.342 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.339+0000 7fd5f4ff9700 1 -- 172.21.15.51:0/2003059440 <== mon.2 v2:172.21.15.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fd5e8007e40 con 0x7fd5f8066370 2020-06-27T04:44:55.468 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 podman[30991]: 2020-06-27 04:44:55.128781443 +0000 UTC m=+4.184628241 container create aa5208eb7cd4c62a4d14d924dd0cb29cf43fd70cf4df80a8718b92c71483b551 (image=docker.io/prom/node-exporter:v0.18.1, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-node-exporter.b) 2020-06-27T04:44:55.559 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.555+0000 7fd5fdffb700 1 -- 172.21.15.51:0/2003059440 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fd5f8068940 con 0x7fd5f8066370 2020-06-27T04:44:55.565 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.562+0000 7fd5f4ff9700 1 -- 172.21.15.51:0/2003059440 <== mon.2 v2:172.21.15.51:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v18) v1 ==== 170+0+59 (secure 0 0 0) 0x7fd5e8012360 con 0x7fd5f8066370 2020-06-27T04:44:55.566 INFO:teuthology.orchestra.run.smithi051.stdout:[client.1] 2020-06-27T04:44:55.566 INFO:teuthology.orchestra.run.smithi051.stdout: key = AQDHzvZeF9hDIRAA/E1C/vA9aFr3nWl8qbj4qQ== 2020-06-27T04:44:55.567 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.563+0000 7fd5fdffb700 1 -- 172.21.15.51:0/2003059440 >> v2:172.21.15.51:6800/950992045 conn(0x7fd5d002ab00 msgr2=0x7fd5d002cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:55.567 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.563+0000 7fd5fdffb700 1 --2- 172.21.15.51:0/2003059440 >> v2:172.21.15.51:6800/950992045 conn(0x7fd5d002ab00 0x7fd5d002cfc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fd5e000b000 tx=0x7fd5e000b040).stop 2020-06-27T04:44:55.567 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.563+0000 7fd5fdffb700 1 -- 172.21.15.51:0/2003059440 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd5f8066370 msgr2=0x7fd5f8074280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:44:55.567 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.563+0000 7fd5fdffb700 1 --2- 172.21.15.51:0/2003059440 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd5f8066370 0x7fd5f8074280 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fd5e800c000 tx=0x7fd5e800b040).stop 2020-06-27T04:44:55.568 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.563+0000 7fd5fdffb700 1 -- 172.21.15.51:0/2003059440 shutdown_connections 2020-06-27T04:44:55.568 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.563+0000 7fd5fdffb700 1 --2- 172.21.15.51:0/2003059440 >> v2:172.21.15.51:6800/950992045 conn(0x7fd5d002ab00 0x7fd5d002cfc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:55.568 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.563+0000 7fd5fdffb700 1 --2- 172.21.15.51:0/2003059440 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd5f8066370 0x7fd5f8074280 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:55.568 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.563+0000 7fd5fdffb700 1 --2- 172.21.15.51:0/2003059440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5f8077880 0x7fd5f8077d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:55.568 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.563+0000 7fd5fdffb700 1 --2- 172.21.15.51:0/2003059440 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5f80678c0 0x7fd5f8074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:44:55.569 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.563+0000 7fd5fdffb700 1 -- 172.21.15.51:0/2003059440 >> 172.21.15.51:0/2003059440 conn(0x7fd5f8061840 msgr2=0x7fd5f8062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:44:55.569 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.564+0000 7fd5fdffb700 1 -- 172.21.15.51:0/2003059440 shutdown_connections 2020-06-27T04:44:55.569 INFO:teuthology.orchestra.run.smithi051.stderr:2020-06-27T04:44:55.564+0000 7fd5fdffb700 1 -- 172.21.15.51:0/2003059440 wait complete. 2020-06-27T04:44:55.704 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:55 smithi031 podman[34063]: 2020-06-27 04:44:55.428923048 +0000 UTC m=+3.771059815 image pull 2020-06-27T04:44:55.705 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:55 smithi031 podman[34063]: 2020-06-27 04:44:55.66100922 +0000 UTC m=+4.003145995 container create 8233d564daece4854a9fa79e968f54b39020f551360401cdb0fbec4662dddb6b (image=docker.io/prom/node-exporter:v0.18.1, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-node-exporter.a) 2020-06-27T04:44:55.968 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 podman[30991]: 2020-06-27 04:44:55.513213898 +0000 UTC m=+4.569060696 container init aa5208eb7cd4c62a4d14d924dd0cb29cf43fd70cf4df80a8718b92c71483b551 (image=docker.io/prom/node-exporter:v0.18.1, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-node-exporter.b) 2020-06-27T04:44:55.968 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 podman[30991]: 2020-06-27 04:44:55.554905027 +0000 UTC m=+4.610751830 container start aa5208eb7cd4c62a4d14d924dd0cb29cf43fd70cf4df80a8718b92c71483b551 (image=docker.io/prom/node-exporter:v0.18.1, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-node-exporter.b) 2020-06-27T04:44:55.969 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 podman[30991]: 2020-06-27 04:44:55.554983309 +0000 UTC m=+4.610830131 container attach aa5208eb7cd4c62a4d14d924dd0cb29cf43fd70cf4df80a8718b92c71483b551 (image=docker.io/prom/node-exporter:v0.18.1, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-node-exporter.b) 2020-06-27T04:44:55.969 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2020-06-27T04:44:55.969 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2020-06-27T04:44:55.969 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2020-06-27T04:44:55.969 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - arp" source="node_exporter.go:104" 2020-06-27T04:44:55.970 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - bcache" source="node_exporter.go:104" 2020-06-27T04:44:55.970 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - bonding" source="node_exporter.go:104" 2020-06-27T04:44:55.970 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2020-06-27T04:44:55.970 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - cpu" source="node_exporter.go:104" 2020-06-27T04:44:55.970 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2020-06-27T04:44:55.971 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2020-06-27T04:44:55.971 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - edac" source="node_exporter.go:104" 2020-06-27T04:44:55.971 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - entropy" source="node_exporter.go:104" 2020-06-27T04:44:55.971 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - filefd" source="node_exporter.go:104" 2020-06-27T04:44:55.971 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2020-06-27T04:44:55.972 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2020-06-27T04:44:55.972 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2020-06-27T04:44:55.972 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2020-06-27T04:44:55.972 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2020-06-27T04:44:55.972 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2020-06-27T04:44:55.972 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2020-06-27T04:44:55.973 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - netclass" source="node_exporter.go:104" 2020-06-27T04:44:55.973 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - netdev" source="node_exporter.go:104" 2020-06-27T04:44:55.973 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - netstat" source="node_exporter.go:104" 2020-06-27T04:44:55.973 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - nfs" source="node_exporter.go:104" 2020-06-27T04:44:55.973 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2020-06-27T04:44:55.974 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - pressure" source="node_exporter.go:104" 2020-06-27T04:44:55.974 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2020-06-27T04:44:55.974 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - stat" source="node_exporter.go:104" 2020-06-27T04:44:55.974 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - textfile" source="node_exporter.go:104" 2020-06-27T04:44:55.974 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - time" source="node_exporter.go:104" 2020-06-27T04:44:55.975 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - uname" source="node_exporter.go:104" 2020-06-27T04:44:55.975 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2020-06-27T04:44:55.975 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - xfs" source="node_exporter.go:104" 2020-06-27T04:44:55.975 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg=" - zfs" source="node_exporter.go:104" 2020-06-27T04:44:55.976 INFO:ceph.node-exporter.b.smithi051.stdout:Jun 27 04:44:55 smithi051 bash[30958]: time="2020-06-27T04:44:55Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2020-06-27T04:44:56.406 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:56 smithi051 bash[18409]: cluster 2020-06-27T04:44:55.134082+0000 mgr.x (mgr.34109) 128 : cluster [DBG] pgmap v124: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 56 KiB/s rd, 2.2 KiB/s wr, 117 op/s 2020-06-27T04:44:56.406 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:56 smithi051 bash[18409]: audit 2020-06-27T04:44:55.557569+0000 mon.b (mon.2) 222 : audit [INF] from='client.? 172.21.15.51:0/2003059440' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-06-27T04:44:56.406 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:56 smithi051 bash[18409]: audit 2020-06-27T04:44:55.557966+0000 mon.a (mon.0) 475 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-06-27T04:44:56.407 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:56 smithi051 bash[18409]: audit 2020-06-27T04:44:55.563213+0000 mon.a (mon.0) 476 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-06-27T04:44:56.427 INFO:teuthology.orchestra.run.smithi051:> sudo sh -c 'cat > /etc/ceph/ceph.client.1.keyring' && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-06-27T04:44:56.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[18426]: cluster 2020-06-27T04:44:55.134082+0000 mgr.x (mgr.34109) 128 : cluster [DBG] pgmap v124: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 56 KiB/s rd, 2.2 KiB/s wr, 117 op/s 2020-06-27T04:44:56.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[18426]: audit 2020-06-27T04:44:55.557569+0000 mon.b (mon.2) 222 : audit [INF] from='client.? 172.21.15.51:0/2003059440' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-06-27T04:44:56.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[18426]: audit 2020-06-27T04:44:55.557966+0000 mon.a (mon.0) 475 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-06-27T04:44:56.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[18426]: audit 2020-06-27T04:44:55.563213+0000 mon.a (mon.0) 476 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-06-27T04:44:56.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[22603]: cluster 2020-06-27T04:44:55.134082+0000 mgr.x (mgr.34109) 128 : cluster [DBG] pgmap v124: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 56 KiB/s rd, 2.2 KiB/s wr, 117 op/s 2020-06-27T04:44:56.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[22603]: audit 2020-06-27T04:44:55.557569+0000 mon.b (mon.2) 222 : audit [INF] from='client.? 172.21.15.51:0/2003059440' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-06-27T04:44:56.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[22603]: audit 2020-06-27T04:44:55.557966+0000 mon.a (mon.0) 475 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-06-27T04:44:56.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[22603]: audit 2020-06-27T04:44:55.563213+0000 mon.a (mon.0) 476 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-06-27T04:44:56.476 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 podman[34063]: 2020-06-27 04:44:56.020314949 +0000 UTC m=+4.362451725 container init 8233d564daece4854a9fa79e968f54b39020f551360401cdb0fbec4662dddb6b (image=docker.io/prom/node-exporter:v0.18.1, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-node-exporter.a) 2020-06-27T04:44:56.476 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 podman[34063]: 2020-06-27 04:44:56.077618643 +0000 UTC m=+4.419755535 container start 8233d564daece4854a9fa79e968f54b39020f551360401cdb0fbec4662dddb6b (image=docker.io/prom/node-exporter:v0.18.1, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-node-exporter.a) 2020-06-27T04:44:56.476 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 podman[34063]: 2020-06-27 04:44:56.077743042 +0000 UTC m=+4.419879960 container attach 8233d564daece4854a9fa79e968f54b39020f551360401cdb0fbec4662dddb6b (image=docker.io/prom/node-exporter:v0.18.1, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-node-exporter.a) 2020-06-27T04:44:56.476 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2020-06-27T04:44:56.477 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2020-06-27T04:44:56.477 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2020-06-27T04:44:56.477 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - arp" source="node_exporter.go:104" 2020-06-27T04:44:56.477 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - bcache" source="node_exporter.go:104" 2020-06-27T04:44:56.477 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - bonding" source="node_exporter.go:104" 2020-06-27T04:44:56.478 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2020-06-27T04:44:56.478 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - cpu" source="node_exporter.go:104" 2020-06-27T04:44:56.478 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2020-06-27T04:44:56.478 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2020-06-27T04:44:56.479 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - edac" source="node_exporter.go:104" 2020-06-27T04:44:56.481 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - entropy" source="node_exporter.go:104" 2020-06-27T04:44:56.481 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - filefd" source="node_exporter.go:104" 2020-06-27T04:44:56.481 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2020-06-27T04:44:56.482 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2020-06-27T04:44:56.482 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2020-06-27T04:44:56.482 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2020-06-27T04:44:56.482 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2020-06-27T04:44:56.482 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2020-06-27T04:44:56.482 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2020-06-27T04:44:56.483 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - netclass" source="node_exporter.go:104" 2020-06-27T04:44:56.483 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - netdev" source="node_exporter.go:104" 2020-06-27T04:44:56.483 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - netstat" source="node_exporter.go:104" 2020-06-27T04:44:56.483 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - nfs" source="node_exporter.go:104" 2020-06-27T04:44:56.483 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2020-06-27T04:44:56.484 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - pressure" source="node_exporter.go:104" 2020-06-27T04:44:56.486 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2020-06-27T04:44:56.487 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - stat" source="node_exporter.go:104" 2020-06-27T04:44:56.487 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - textfile" source="node_exporter.go:104" 2020-06-27T04:44:56.487 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - time" source="node_exporter.go:104" 2020-06-27T04:44:56.487 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - uname" source="node_exporter.go:104" 2020-06-27T04:44:56.487 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2020-06-27T04:44:56.488 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - xfs" source="node_exporter.go:104" 2020-06-27T04:44:56.488 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg=" - zfs" source="node_exporter.go:104" 2020-06-27T04:44:56.488 INFO:ceph.node-exporter.a.smithi031.stdout:Jun 27 04:44:56 smithi031 bash[34015]: time="2020-06-27T04:44:56Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2020-06-27T04:44:56.493 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph osd dump --format=json 2020-06-27T04:44:56.647 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:44:58.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:44:58 smithi051 bash[18409]: cluster 2020-06-27T04:44:57.134844+0000 mgr.x (mgr.34109) 129 : cluster [DBG] pgmap v125: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 23 KiB/s rd, 853 B/s wr, 46 op/s 2020-06-27T04:44:58.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:44:58 smithi031 bash[18426]: cluster 2020-06-27T04:44:57.134844+0000 mgr.x (mgr.34109) 129 : cluster [DBG] pgmap v125: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 23 KiB/s rd, 853 B/s wr, 46 op/s 2020-06-27T04:44:58.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:44:58 smithi031 bash[22603]: cluster 2020-06-27T04:44:57.134844+0000 mgr.x (mgr.34109) 129 : cluster [DBG] pgmap v125: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 23 KiB/s rd, 853 B/s wr, 46 op/s 2020-06-27T04:45:00.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:00 smithi051 bash[18409]: cluster 2020-06-27T04:44:59.135531+0000 mgr.x (mgr.34109) 130 : cluster [DBG] pgmap v126: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 6 op/s 2020-06-27T04:45:00.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:00 smithi031 bash[18426]: cluster 2020-06-27T04:44:59.135531+0000 mgr.x (mgr.34109) 130 : cluster [DBG] pgmap v126: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 6 op/s 2020-06-27T04:45:00.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:00 smithi031 bash[22603]: cluster 2020-06-27T04:44:59.135531+0000 mgr.x (mgr.34109) 130 : cluster [DBG] pgmap v126: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 6 op/s 2020-06-27T04:45:01.885 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.881+0000 7fb494287700 1 Processor -- start 2020-06-27T04:45:01.885 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.881+0000 7fb494287700 1 -- start start 2020-06-27T04:45:01.886 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.881+0000 7fb494287700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb48c066360 0x7fb48c06ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:01.902 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.881+0000 7fb494287700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c06be30 0x7fb48c078270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:01.902 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.881+0000 7fb494287700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb48c0788f0 0x7fb48c122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:01.902 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.881+0000 7fb494287700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c123300 con 0x7fb48c06be30 2020-06-27T04:45:01.902 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.881+0000 7fb494287700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c123470 con 0x7fb48c066360 2020-06-27T04:45:01.903 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.881+0000 7fb494287700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c123630 con 0x7fb48c0788f0 2020-06-27T04:45:01.903 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.881+0000 7fb492023700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c06be30 0x7fb48c078270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:01.903 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.881+0000 7fb493025700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb48c0788f0 0x7fb48c122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:01.903 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.881+0000 7fb492023700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c06be30 0x7fb48c078270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39400/0 (socket says 172.21.15.31:39400) 2020-06-27T04:45:01.903 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.881+0000 7fb493025700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb48c0788f0 0x7fb48c122cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35650/0 (socket says 172.21.15.31:35650) 2020-06-27T04:45:01.904 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.881+0000 7fb492023700 1 -- 172.21.15.31:0/3864797548 learned_addr learned my addr 172.21.15.31:0/3864797548 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:01.904 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.881+0000 7fb492824700 1 --2- 172.21.15.31:0/3864797548 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb48c066360 0x7fb48c06ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:01.904 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.882+0000 7fb492023700 1 -- 172.21.15.31:0/3864797548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb48c0788f0 msgr2=0x7fb48c122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:01.904 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.882+0000 7fb492023700 1 --2- 172.21.15.31:0/3864797548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb48c0788f0 0x7fb48c122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:01.904 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.882+0000 7fb492023700 1 -- 172.21.15.31:0/3864797548 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb48c066360 msgr2=0x7fb48c06ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:01.905 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.882+0000 7fb492023700 1 --2- 172.21.15.31:0/3864797548 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb48c066360 0x7fb48c06ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:01.905 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.882+0000 7fb492023700 1 -- 172.21.15.31:0/3864797548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c1237f0 con 0x7fb48c06be30 2020-06-27T04:45:01.905 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.882+0000 7fb492023700 1 --2- 172.21.15.31:0/3864797548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c06be30 0x7fb48c078270 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fb48000c000 tx=0x7fb48000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:01.905 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.882+0000 7fb48affd700 1 -- 172.21.15.31:0/3864797548 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4800094d0 con 0x7fb48c06be30 2020-06-27T04:45:01.905 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.882+0000 7fb494287700 1 -- 172.21.15.31:0/3864797548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48c123aa0 con 0x7fb48c06be30 2020-06-27T04:45:01.906 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.882+0000 7fb48affd700 1 -- 172.21.15.31:0/3864797548 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fb48000f040 con 0x7fb48c06be30 2020-06-27T04:45:01.906 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.882+0000 7fb48affd700 1 -- 172.21.15.31:0/3864797548 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb480007cb0 con 0x7fb48c06be30 2020-06-27T04:45:01.906 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.882+0000 7fb494287700 1 -- 172.21.15.31:0/3864797548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48c123fc0 con 0x7fb48c06be30 2020-06-27T04:45:01.907 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.883+0000 7fb48affd700 1 -- 172.21.15.31:0/3864797548 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7fb48000c860 con 0x7fb48c06be30 2020-06-27T04:45:01.907 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.883+0000 7fb494287700 1 -- 172.21.15.31:0/3864797548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48c05e210 con 0x7fb48c06be30 2020-06-27T04:45:01.907 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.883+0000 7fb48affd700 1 --2- 172.21.15.31:0/3864797548 >> v2:172.21.15.51:6800/950992045 conn(0x7fb47002ab00 0x7fb47002cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:01.908 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.883+0000 7fb48affd700 1 -- 172.21.15.31:0/3864797548 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5778+0+0 (secure 0 0 0) 0x7fb48003ad60 con 0x7fb48c06be30 2020-06-27T04:45:01.908 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.883+0000 7fb492824700 1 --2- 172.21.15.31:0/3864797548 >> v2:172.21.15.51:6800/950992045 conn(0x7fb47002ab00 0x7fb47002cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:01.908 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.883+0000 7fb492824700 1 --2- 172.21.15.31:0/3864797548 >> v2:172.21.15.51:6800/950992045 conn(0x7fb47002ab00 0x7fb47002cfc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fb484016000 tx=0x7fb484004cf0).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:01.908 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:01.887+0000 7fb48affd700 1 -- 172.21.15.31:0/3864797548 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fb480007e10 con 0x7fb48c06be30 2020-06-27T04:45:02.049 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:02.045+0000 7fb494287700 1 -- 172.21.15.31:0/3864797548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb48c1241b0 con 0x7fb48c06be30 2020-06-27T04:45:02.050 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:02.046+0000 7fb48affd700 1 -- 172.21.15.31:0/3864797548 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16685 (secure 0 0 0) 0x7fb480019020 con 0x7fb48c06be30 2020-06-27T04:45:02.050 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:45:02.050 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":57,"fsid":"12892ae2-b830-11ea-a06d-001a4aab830c","created":"2020-06-27T04:39:37.261039+0000","modified":"2020-06-27T04:44:41.412797+0000","last_up_change":"2020-06-27T04:44:23.253829+0000","last_in_change":"2020-06-27T04:44:23.253829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-27T04:39:48.364049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2020-06-27T04:44:20.858261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"zone.rgw.log","create_time":"2020-06-27T04:44:34.179693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"zone.rgw.control","create_time":"2020-06-27T04:44:35.835421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"zone.rgw.meta","create_time":"2020-06-27T04:44:37.902913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":4030364259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":4030364259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":4030364259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":4030364259}]},"public_addr":"172.21.15.31:6800/4030364259","cluster_addr":"172.21.15.31:6801/4030364259","heartbeat_back_addr":"172.21.15.31:6803/4030364259","heartbeat_front_addr":"172.21.15.31:6802/4030364259","state":["exists","up"]},{"osd":1,"uuid":"e06700d6-7863-486c-a5bd-4ea867e8273c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":3103897888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":3103897888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":3103897888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":3103897888}]},"public_addr":"172.21.15.31:6804/3103897888","cluster_addr":"172.21.15.31:6805/3103897888","heartbeat_back_addr":"172.21.15.31:6807/3103897888","heartbeat_front_addr":"172.21.15.31:6806/3103897888","state":["exists","up"]},{"osd":2,"uuid":"82a9c5cf-2ae0-429e-82a6-03b9928e5c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":3672781084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":3672781084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":3672781084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":3672781084}]},"public_addr":"172.21.15.31:6808/3672781084","cluster_addr":"172.21.15.31:6809/3672781084","heartbeat_back_addr":"172.21.15.31:6811/3672781084","heartbeat_front_addr":"172.21.15.31:6810/3672781084","state":["exists","up"]},{"osd":3,"uuid":"5a3667cb-5c57-47fb-8c93-da3a3817c975","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":772723559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":772723559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6815","nonce":772723559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":772723559}]},"public_addr":"172.21.15.31:6812/772723559","cluster_addr":"172.21.15.31:6813/772723559","heartbeat_back_addr":"172.21.15.31:6815/772723559","heartbeat_front_addr":"172.21.15.31:6814/772723559","state":["exists","up"]},{"osd":4,"uuid":"62c9b092-2f7d-4391-acae-dd78afcf7d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6801","nonce":3547494673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6802","nonce":3547494673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6804","nonce":3547494673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6803","nonce":3547494673}]},"public_addr":"172.21.15.51:6801/3547494673","cluster_addr":"172.21.15.51:6802/3547494673","heartbeat_back_addr":"172.21.15.51:6804/3547494673","heartbeat_front_addr":"172.21.15.51:6803/3547494673","state":["exists","up"]},{"osd":5,"uuid":"1dca5a6a-245c-4161-9042-713f7c0bbfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6805","nonce":1207065717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6806","nonce":1207065717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6808","nonce":1207065717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6807","nonce":1207065717}]},"public_addr":"172.21.15.51:6805/1207065717","cluster_addr":"172.21.15.51:6806/1207065717","heartbeat_back_addr":"172.21.15.51:6808/1207065717","heartbeat_front_addr":"172.21.15.51:6807/1207065717","state":["exists","up"]},{"osd":6,"uuid":"6125844a-2c24-409d-9f33-ba0cbb1bb822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6809","nonce":2568976317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6810","nonce":2568976317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6812","nonce":2568976317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6811","nonce":2568976317}]},"public_addr":"172.21.15.51:6809/2568976317","cluster_addr":"172.21.15.51:6810/2568976317","heartbeat_back_addr":"172.21.15.51:6812/2568976317","heartbeat_front_addr":"172.21.15.51:6811/2568976317","state":["exists","up"]},{"osd":7,"uuid":"41502006-951e-4786-872a-1fd840460fa7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6813","nonce":1443623027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6814","nonce":1443623027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6816","nonce":1443623027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6815","nonce":1443623027}]},"public_addr":"172.21.15.51:6813/1443623027","cluster_addr":"172.21.15.51:6814/1443623027","heartbeat_back_addr":"172.21.15.51:6816/1443623027","heartbeat_front_addr":"172.21.15.51:6815/1443623027","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:42:33.049576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:42:49.055123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:43:05.285290+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:43:20.955853+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:43:35.378369+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:43:49.867408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:44:06.203670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:44:22.115293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.31:0/163335024":"2020-06-28T04:40:10.090940+0000","172.21.15.31:0/980973700":"2020-06-28T04:42:17.090997+0000","172.21.15.31:0/1723866722":"2020-06-28T04:40:10.090940+0000","172.21.15.31:6800/4294292023":"2020-06-28T04:40:10.090940+0000","172.21.15.31:0/3362836624":"2020-06-28T04:42:17.090997+0000","172.21.15.31:0/620485409":"2020-06-28T04:40:10.090940+0000","172.21.15.31:0/121410604":"2020-06-28T04:39:57.049167+0000","172.21.15.31:0/4226471217":"2020-06-28T04:39:57.049167+0000","172.21.15.31:0/3753882637":"2020-06-28T04:42:17.090997+0000","172.21.15.31:6800/769686724":"2020-06-28T04:39:57.049167+0000","172.21.15.31:6800/1241213118":"2020-06-28T04:42:17.090997+0000","172.21.15.31:0/1159003614":"2020-06-28T04:39:57.049167+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-27T04:45:02.051 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:02.048+0000 7fb494287700 1 -- 172.21.15.31:0/3864797548 >> v2:172.21.15.51:6800/950992045 conn(0x7fb47002ab00 msgr2=0x7fb47002cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:02.052 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:02.048+0000 7fb494287700 1 --2- 172.21.15.31:0/3864797548 >> v2:172.21.15.51:6800/950992045 conn(0x7fb47002ab00 0x7fb47002cfc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fb484016000 tx=0x7fb484004cf0).stop 2020-06-27T04:45:02.052 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:02.048+0000 7fb494287700 1 -- 172.21.15.31:0/3864797548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c06be30 msgr2=0x7fb48c078270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:02.052 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:02.048+0000 7fb494287700 1 --2- 172.21.15.31:0/3864797548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c06be30 0x7fb48c078270 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fb48000c000 tx=0x7fb48000b040).stop 2020-06-27T04:45:02.052 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:02.048+0000 7fb494287700 1 -- 172.21.15.31:0/3864797548 shutdown_connections 2020-06-27T04:45:02.052 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:02.048+0000 7fb494287700 1 --2- 172.21.15.31:0/3864797548 >> v2:172.21.15.51:6800/950992045 conn(0x7fb47002ab00 0x7fb47002cfc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:02.053 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:02.048+0000 7fb494287700 1 --2- 172.21.15.31:0/3864797548 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fb48c066360 0x7fb48c06ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:02.053 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:02.048+0000 7fb494287700 1 --2- 172.21.15.31:0/3864797548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb48c0788f0 0x7fb48c122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:02.053 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:02.048+0000 7fb494287700 1 --2- 172.21.15.31:0/3864797548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c06be30 0x7fb48c078270 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:02.053 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:02.048+0000 7fb494287700 1 -- 172.21.15.31:0/3864797548 >> 172.21.15.31:0/3864797548 conn(0x7fb48c061830 msgr2=0x7fb48c06d350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:02.053 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:02.048+0000 7fb494287700 1 -- 172.21.15.31:0/3864797548 shutdown_connections 2020-06-27T04:45:02.054 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:02.048+0000 7fb494287700 1 -- 172.21.15.31:0/3864797548 wait complete. 2020-06-27T04:45:02.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:02 smithi051 bash[18409]: cluster 2020-06-27T04:45:01.136056+0000 mgr.x (mgr.34109) 131 : cluster [DBG] pgmap v127: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2020-06-27T04:45:02.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:02 smithi051 bash[18409]: audit 2020-06-27T04:45:02.047090+0000 mon.a (mon.0) 477 : audit [DBG] from='client.? 172.21.15.31:0/3864797548' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-06-27T04:45:02.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:02 smithi031 bash[18426]: cluster 2020-06-27T04:45:01.136056+0000 mgr.x (mgr.34109) 131 : cluster [DBG] pgmap v127: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2020-06-27T04:45:02.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:02 smithi031 bash[18426]: audit 2020-06-27T04:45:02.047090+0000 mon.a (mon.0) 477 : audit [DBG] from='client.? 172.21.15.31:0/3864797548' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-06-27T04:45:02.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:02 smithi031 bash[22603]: cluster 2020-06-27T04:45:01.136056+0000 mgr.x (mgr.34109) 131 : cluster [DBG] pgmap v127: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2020-06-27T04:45:02.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:02 smithi031 bash[22603]: audit 2020-06-27T04:45:02.047090+0000 mon.a (mon.0) 477 : audit [DBG] from='client.? 172.21.15.31:0/3864797548' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-06-27T04:45:02.779 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-06-27T04:39:48.364049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2020-06-27T04:44:20.858261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'zone.rgw.log', 'create_time': '2020-06-27T04:44:34.179693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 4, 'pool_name': 'zone.rgw.control', 'create_time': '2020-06-27T04:44:35.835421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'zone.rgw.meta', 'create_time': '2020-06-27T04:44:37.902913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}] 2020-06-27T04:45:02.780 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2020-06-27T04:45:02.925 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:03.834 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:03 smithi031 systemd[1]: Started Ceph alertmanager.a for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:45:03.835 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:03 smithi031 bash[34672]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a found: no such container 2020-06-27T04:45:03.835 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:03 smithi031 bash[34672]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a 2020-06-27T04:45:03.835 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:03 smithi031 bash[34672]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a" found: no such container 2020-06-27T04:45:04.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:04 smithi051 bash[18409]: cluster 2020-06-27T04:45:03.136643+0000 mgr.x (mgr.34109) 132 : cluster [DBG] pgmap v128: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 341 B/s rd, 0 B/s wr, 0 op/s 2020-06-27T04:45:04.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:04 smithi051 bash[18409]: audit 2020-06-27T04:45:03.601764+0000 mon.b (mon.2) 223 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:51.468124\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:04.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:04 smithi051 bash[18409]: audit 2020-06-27T04:45:03.602484+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:51.468124\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:04.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:04 smithi051 bash[18409]: audit 2020-06-27T04:45:03.605249+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:51.468124\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:45:04.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:04 smithi051 bash[18409]: audit 2020-06-27T04:45:03.698099+0000 mon.b (mon.2) 224 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEBdlhx74v0I1lF5HxVItdNEwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMDA2MjcwNDQ1MDNaFw0z\nMDA2MjUwNDQ1MDNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCXtf8/Nt0B5WX6ygttdLBP\nPmDByVdCpWAxH2Kz3T9hek7NkNrWBsl4+OyHC3DltkF7QMin+Iw5XZBQtIY/Q6cj\njV/eCrAUejsnSYStNWZzoW63UT+aFiCN1PTbK6iLwBVmIeHPGsn+li4pnNKXtctG\nGOnUn/3INqfxl+JgDEQzY0MPc1uoGmYtro/zzO0BQ6NbRZv51iqBydQR5/CVUGbX\nUx805qwhGHkxmLcRNM09NZSTX5HczNFedOVRroyNm8e4Wog3EloG54rS5NwKKg7t\nlbVndxhqE0mjhs7Wung0TI5Kl19gWBuhueqr6bJbTjWlQDf3BKQHR5UT+Q5TI+pH\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAFlO6ivaxMWEOAigN6HiYUKIKf5ntvew\nuXXaGrRcFWqJc+R8MArdQCsTztE5bRoVaderK4Kb291o/z+f6FfXnMoZOLuVxe1j\nkMJublyf3+DBlSVdmZmK5Iddb+AeI7ywJLVgTLAnoyjWlbBbQ3gwFBfmSMcrk+V/\nj7VVRkI5MRctOXjR98jT9q1uCaNuUxoWqqV9NZtq/RWJTCgDpRpdnUdslTn6I3pK\nxyjgJotDa8EB3Pv+61l+lp7TaQslC7nGq5H2kOwrsnidnFWXBqbOF488/1g4FKRP\nUTiVxQpX1PmzinAPRkXLo7hu5qJyXqL4iLN8Zzpz8q3YM+k+Is4lUIg=\n-----END CERTIFICATE-----\n"}]: dispatch 2020-06-27T04:45:04.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:04 smithi051 bash[18409]: audit 2020-06-27T04:45:03.699117+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEBdlhx74v0I1lF5HxVItdNEwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMDA2MjcwNDQ1MDNaFw0z\nMDA2MjUwNDQ1MDNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCXtf8/Nt0B5WX6ygttdLBP\nPmDByVdCpWAxH2Kz3T9hek7NkNrWBsl4+OyHC3DltkF7QMin+Iw5XZBQtIY/Q6cj\njV/eCrAUejsnSYStNWZzoW63UT+aFiCN1PTbK6iLwBVmIeHPGsn+li4pnNKXtctG\nGOnUn/3INqfxl+JgDEQzY0MPc1uoGmYtro/zzO0BQ6NbRZv51iqBydQR5/CVUGbX\nUx805qwhGHkxmLcRNM09NZSTX5HczNFedOVRroyNm8e4Wog3EloG54rS5NwKKg7t\nlbVndxhqE0mjhs7Wung0TI5Kl19gWBuhueqr6bJbTjWlQDf3BKQHR5UT+Q5TI+pH\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAFlO6ivaxMWEOAigN6HiYUKIKf5ntvew\nuXXaGrRcFWqJc+R8MArdQCsTztE5bRoVaderK4Kb291o/z+f6FfXnMoZOLuVxe1j\nkMJublyf3+DBlSVdmZmK5Iddb+AeI7ywJLVgTLAnoyjWlbBbQ3gwFBfmSMcrk+V/\nj7VVRkI5MRctOXjR98jT9q1uCaNuUxoWqqV9NZtq/RWJTCgDpRpdnUdslTn6I3pK\nxyjgJotDa8EB3Pv+61l+lp7TaQslC7nGq5H2kOwrsnidnFWXBqbOF488/1g4FKRP\nUTiVxQpX1PmzinAPRkXLo7hu5qJyXqL4iLN8Zzpz8q3YM+k+Is4lUIg=\n-----END CERTIFICATE-----\n"}]: dispatch 2020-06-27T04:45:04.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:04 smithi051 bash[18409]: audit 2020-06-27T04:45:03.704002+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEBdlhx74v0I1lF5HxVItdNEwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMDA2MjcwNDQ1MDNaFw0z\nMDA2MjUwNDQ1MDNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCXtf8/Nt0B5WX6ygttdLBP\nPmDByVdCpWAxH2Kz3T9hek7NkNrWBsl4+OyHC3DltkF7QMin+Iw5XZBQtIY/Q6cj\njV/eCrAUejsnSYStNWZzoW63UT+aFiCN1PTbK6iLwBVmIeHPGsn+li4pnNKXtctG\nGOnUn/3INqfxl+JgDEQzY0MPc1uoGmYtro/zzO0BQ6NbRZv51iqBydQR5/CVUGbX\nUx805qwhGHkxmLcRNM09NZSTX5HczNFedOVRroyNm8e4Wog3EloG54rS5NwKKg7t\nlbVndxhqE0mjhs7Wung0TI5Kl19gWBuhueqr6bJbTjWlQDf3BKQHR5UT+Q5TI+pH\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAFlO6ivaxMWEOAigN6HiYUKIKf5ntvew\nuXXaGrRcFWqJc+R8MArdQCsTztE5bRoVaderK4Kb291o/z+f6FfXnMoZOLuVxe1j\nkMJublyf3+DBlSVdmZmK5Iddb+AeI7ywJLVgTLAnoyjWlbBbQ3gwFBfmSMcrk+V/\nj7VVRkI5MRctOXjR98jT9q1uCaNuUxoWqqV9NZtq/RWJTCgDpRpdnUdslTn6I3pK\nxyjgJotDa8EB3Pv+61l+lp7TaQslC7nGq5H2kOwrsnidnFWXBqbOF488/1g4FKRP\nUTiVxQpX1PmzinAPRkXLo7hu5qJyXqL4iLN8Zzpz8q3YM+k+Is4lUIg=\n-----END CERTIFICATE-----\n"}]': finished 2020-06-27T04:45:04.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:04 smithi051 bash[18409]: audit 2020-06-27T04:45:03.705390+0000 mon.b (mon.2) 225 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQCXtf8/Nt0B5WX6\nygttdLBPPmDByVdCpWAxH2Kz3T9hek7NkNrWBsl4+OyHC3DltkF7QMin+Iw5XZBQ\ntIY/Q6cjjV/eCrAUejsnSYStNWZzoW63UT+aFiCN1PTbK6iLwBVmIeHPGsn+li4p\nnNKXtctGGOnUn/3INqfxl+JgDEQzY0MPc1uoGmYtro/zzO0BQ6NbRZv51iqBydQR\n5/CVUGbXUx805qwhGHkxmLcRNM09NZSTX5HczNFedOVRroyNm8e4Wog3EloG54rS\n5NwKKg7tlbVndxhqE0mjhs7Wung0TI5Kl19gWBuhueqr6bJbTjWlQDf3BKQHR5UT\n+Q5TI+pHAgMBAAECggEADNj+yq2svbJdloVxvk05eRyBOSgB2cUDhmVwCGdeLLUc\n40+3GJTuju4VqcIQR4PNu9Barc7goSMJS6xeChGCoAIi8jzZeIJ5a/RP5hM1n+k1\n5RReXIAvNZOpQL5Lwbn8le+cndtY69RwCFodg3eDxWXqt3TtGv1174G7TAL965QF\nAtA9/+JnC72jk7jMhIRO42XOhHl119SmRrsvj8i65WyM+FI7m/X3vLm/t5n0uJpy\nLdvfS5tBqVMZi5yoaGwnBxRD6GK+EhRBDV1tfiDsfEvSM9BjpjtB/7Gd5olRX0/5\nNIEw6wNmbWhj0iMtFvJ8J5cgyK1LMw2pzg3m+5ED4QKBgQDFkhiawiqDp7avQzUo\ndAbQOKiWcq4wTOTXr/7N+toTuafLOv5qC+BtXTBzR8s+rkwiWvsrZ7ZWmfxAO5Ip\nYqaSbjy4kjt0mig0rMbjeO+NokEqxvkqlnk29aIfDELL1BjItwyG7v+v/KTQsvqx\nFq8UgKarrFu12CWbHyMW3fM+OQKBgQDEk+YEVCjyMxga7jMzp60H6sTJRjYraObr\nEU6ZYSj8ZESKdQIvKYiwSJOaWW7kgvUgSUWgghHmlWMzxIzvKCoYFLwppu5mQ2dG\nk2nyf8YN7DQ68BQMVVviYy/MeWnulXZDBHDbYqmg1k6z0ygNcI2kmVT8wZHH4ieQ\nbs6J4vhsfwKBgDb+PX8GQNM4oa8TI/7InQTkYHjQHxAutxwaTvCCvKT07nGxUBOw\njp2ibNQJzdb6qRJ/BJ7GVYixf/dZHYwLe5YSvTAa9BW2uy4+UXYLuZJQ8Za4n65t\nB/x2TtQZk5YsyWFFImWErQMNbcrxproYOE+ap8ntRfHN4lnVRu0chpJxAoGAQJdQ\nNw/oPFzpiL/H9ysbQcS0UGZPmkfnyElxiBhSvUu88bmstA5zqWjPhyHnvBIDtU4e\nILVcaGWhqPrmTBbobe0yPoVpRBTVtGzvnQy66Qw5xTvpenv5qxNoO0mRsyFNMIwf\nARcUIZMJXTD+shvPjswLDtoTqpf25BBksQ3xDsUCgYA+j9qMzFTMmdhmgX+wb9DK\nUUZbTCq2QDr3tNJJQRq0PXq+cKUGTjxSDUWTZXT6PIyzJHi0kGzxWpXhF8lhUU5/\nbDVmil+hRL2I37VvE6tJZ+XeKQ5KkKhE0LfySyWFf/EAUNIMu5cpdJO/hT7YOyFz\nr8ZULRYnY9iMHSYOlgN1lQ==\n-----END PRIVATE KEY-----\n"}]: dispatch 2020-06-27T04:45:04.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:04 smithi051 bash[18409]: audit 2020-06-27T04:45:03.705725+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQCXtf8/Nt0B5WX6\nygttdLBPPmDByVdCpWAxH2Kz3T9hek7NkNrWBsl4+OyHC3DltkF7QMin+Iw5XZBQ\ntIY/Q6cjjV/eCrAUejsnSYStNWZzoW63UT+aFiCN1PTbK6iLwBVmIeHPGsn+li4p\nnNKXtctGGOnUn/3INqfxl+JgDEQzY0MPc1uoGmYtro/zzO0BQ6NbRZv51iqBydQR\n5/CVUGbXUx805qwhGHkxmLcRNM09NZSTX5HczNFedOVRroyNm8e4Wog3EloG54rS\n5NwKKg7tlbVndxhqE0mjhs7Wung0TI5Kl19gWBuhueqr6bJbTjWlQDf3BKQHR5UT\n+Q5TI+pHAgMBAAECggEADNj+yq2svbJdloVxvk05eRyBOSgB2cUDhmVwCGdeLLUc\n40+3GJTuju4VqcIQR4PNu9Barc7goSMJS6xeChGCoAIi8jzZeIJ5a/RP5hM1n+k1\n5RReXIAvNZOpQL5Lwbn8le+cndtY69RwCFodg3eDxWXqt3TtGv1174G7TAL965QF\nAtA9/+JnC72jk7jMhIRO42XOhHl119SmRrsvj8i65WyM+FI7m/X3vLm/t5n0uJpy\nLdvfS5tBqVMZi5yoaGwnBxRD6GK+EhRBDV1tfiDsfEvSM9BjpjtB/7Gd5olRX0/5\nNIEw6wNmbWhj0iMtFvJ8J5cgyK1LMw2pzg3m+5ED4QKBgQDFkhiawiqDp7avQzUo\ndAbQOKiWcq4wTOTXr/7N+toTuafLOv5qC+BtXTBzR8s+rkwiWvsrZ7ZWmfxAO5Ip\nYqaSbjy4kjt0mig0rMbjeO+NokEqxvkqlnk29aIfDELL1BjItwyG7v+v/KTQsvqx\nFq8UgKarrFu12CWbHyMW3fM+OQKBgQDEk+YEVCjyMxga7jMzp60H6sTJRjYraObr\nEU6ZYSj8ZESKdQIvKYiwSJOaWW7kgvUgSUWgghHmlWMzxIzvKCoYFLwppu5mQ2dG\nk2nyf8YN7DQ68BQMVVviYy/MeWnulXZDBHDbYqmg1k6z0ygNcI2kmVT8wZHH4ieQ\nbs6J4vhsfwKBgDb+PX8GQNM4oa8TI/7InQTkYHjQHxAutxwaTvCCvKT07nGxUBOw\njp2ibNQJzdb6qRJ/BJ7GVYixf/dZHYwLe5YSvTAa9BW2uy4+UXYLuZJQ8Za4n65t\nB/x2TtQZk5YsyWFFImWErQMNbcrxproYOE+ap8ntRfHN4lnVRu0chpJxAoGAQJdQ\nNw/oPFzpiL/H9ysbQcS0UGZPmkfnyElxiBhSvUu88bmstA5zqWjPhyHnvBIDtU4e\nILVcaGWhqPrmTBbobe0yPoVpRBTVtGzvnQy66Qw5xTvpenv5qxNoO0mRsyFNMIwf\nARcUIZMJXTD+shvPjswLDtoTqpf25BBksQ3xDsUCgYA+j9qMzFTMmdhmgX+wb9DK\nUUZbTCq2QDr3tNJJQRq0PXq+cKUGTjxSDUWTZXT6PIyzJHi0kGzxWpXhF8lhUU5/\nbDVmil+hRL2I37VvE6tJZ+XeKQ5KkKhE0LfySyWFf/EAUNIMu5cpdJO/hT7YOyFz\nr8ZULRYnY9iMHSYOlgN1lQ==\n-----END PRIVATE KEY-----\n"}]: dispatch 2020-06-27T04:45:04.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:04 smithi051 bash[18409]: audit 2020-06-27T04:45:03.708588+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQCXtf8/Nt0B5WX6\nygttdLBPPmDByVdCpWAxH2Kz3T9hek7NkNrWBsl4+OyHC3DltkF7QMin+Iw5XZBQ\ntIY/Q6cjjV/eCrAUejsnSYStNWZzoW63UT+aFiCN1PTbK6iLwBVmIeHPGsn+li4p\nnNKXtctGGOnUn/3INqfxl+JgDEQzY0MPc1uoGmYtro/zzO0BQ6NbRZv51iqBydQR\n5/CVUGbXUx805qwhGHkxmLcRNM09NZSTX5HczNFedOVRroyNm8e4Wog3EloG54rS\n5NwKKg7tlbVndxhqE0mjhs7Wung0TI5Kl19gWBuhueqr6bJbTjWlQDf3BKQHR5UT\n+Q5TI+pHAgMBAAECggEADNj+yq2svbJdloVxvk05eRyBOSgB2cUDhmVwCGdeLLUc\n40+3GJTuju4VqcIQR4PNu9Barc7goSMJS6xeChGCoAIi8jzZeIJ5a/RP5hM1n+k1\n5RReXIAvNZOpQL5Lwbn8le+cndtY69RwCFodg3eDxWXqt3TtGv1174G7TAL965QF\nAtA9/+JnC72jk7jMhIRO42XOhHl119SmRrsvj8i65WyM+FI7m/X3vLm/t5n0uJpy\nLdvfS5tBqVMZi5yoaGwnBxRD6GK+EhRBDV1tfiDsfEvSM9BjpjtB/7Gd5olRX0/5\nNIEw6wNmbWhj0iMtFvJ8J5cgyK1LMw2pzg3m+5ED4QKBgQDFkhiawiqDp7avQzUo\ndAbQOKiWcq4wTOTXr/7N+toTuafLOv5qC+BtXTBzR8s+rkwiWvsrZ7ZWmfxAO5Ip\nYqaSbjy4kjt0mig0rMbjeO+NokEqxvkqlnk29aIfDELL1BjItwyG7v+v/KTQsvqx\nFq8UgKarrFu12CWbHyMW3fM+OQKBgQDEk+YEVCjyMxga7jMzp60H6sTJRjYraObr\nEU6ZYSj8ZESKdQIvKYiwSJOaWW7kgvUgSUWgghHmlWMzxIzvKCoYFLwppu5mQ2dG\nk2nyf8YN7DQ68BQMVVviYy/MeWnulXZDBHDbYqmg1k6z0ygNcI2kmVT8wZHH4ieQ\nbs6J4vhsfwKBgDb+PX8GQNM4oa8TI/7InQTkYHjQHxAutxwaTvCCvKT07nGxUBOw\njp2ibNQJzdb6qRJ/BJ7GVYixf/dZHYwLe5YSvTAa9BW2uy4+UXYLuZJQ8Za4n65t\nB/x2TtQZk5YsyWFFImWErQMNbcrxproYOE+ap8ntRfHN4lnVRu0chpJxAoGAQJdQ\nNw/oPFzpiL/H9ysbQcS0UGZPmkfnyElxiBhSvUu88bmstA5zqWjPhyHnvBIDtU4e\nILVcaGWhqPrmTBbobe0yPoVpRBTVtGzvnQy66Qw5xTvpenv5qxNoO0mRsyFNMIwf\nARcUIZMJXTD+shvPjswLDtoTqpf25BBksQ3xDsUCgYA+j9qMzFTMmdhmgX+wb9DK\nUUZbTCq2QDr3tNJJQRq0PXq+cKUGTjxSDUWTZXT6PIyzJHi0kGzxWpXhF8lhUU5/\nbDVmil+hRL2I37VvE6tJZ+XeKQ5KkKhE0LfySyWFf/EAUNIMu5cpdJO/hT7YOyFz\nr8ZULRYnY9iMHSYOlgN1lQ==\n-----END PRIVATE KEY-----\n"}]': finished 2020-06-27T04:45:04.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:04 smithi051 bash[18409]: audit 2020-06-27T04:45:03.710546+0000 mon.b (mon.2) 226 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2020-06-27T04:45:04.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:04 smithi051 bash[18409]: audit 2020-06-27T04:45:03.711038+0000 mgr.x (mgr.34109) 133 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2020-06-27T04:45:04.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:04 smithi051 bash[18409]: audit 2020-06-27T04:45:03.711388+0000 mon.b (mon.2) 227 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]: dispatch 2020-06-27T04:45:04.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:04 smithi051 bash[18409]: audit 2020-06-27T04:45:03.711659+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]: dispatch 2020-06-27T04:45:04.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:04 smithi051 bash[18409]: audit 2020-06-27T04:45:03.715071+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]': finished 2020-06-27T04:45:04.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:04 smithi051 bash[18409]: cephadm 2020-06-27T04:45:03.719296+0000 mgr.x (mgr.34109) 134 : cephadm [INF] Deploying daemon grafana.a on smithi051 2020-06-27T04:45:04.474 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:04 smithi031 podman[34702]: 2020-06-27 04:45:04.439196072 +0000 UTC m=+0.774913327 container create e89f4ff5dfc2520cb117902af1f94d41e2df846c6bd40601350865308d233cdf (image=docker.io/prom/alertmanager:v0.20.0, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a) 2020-06-27T04:45:04.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[18426]: cluster 2020-06-27T04:45:03.136643+0000 mgr.x (mgr.34109) 132 : cluster [DBG] pgmap v128: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 341 B/s rd, 0 B/s wr, 0 op/s 2020-06-27T04:45:04.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[18426]: audit 2020-06-27T04:45:03.601764+0000 mon.b (mon.2) 223 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:51.468124\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:04.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[18426]: audit 2020-06-27T04:45:03.602484+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:51.468124\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:04.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[18426]: audit 2020-06-27T04:45:03.605249+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:51.468124\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:45:04.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[18426]: audit 2020-06-27T04:45:03.698099+0000 mon.b (mon.2) 224 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEBdlhx74v0I1lF5HxVItdNEwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMDA2MjcwNDQ1MDNaFw0z\nMDA2MjUwNDQ1MDNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCXtf8/Nt0B5WX6ygttdLBP\nPmDByVdCpWAxH2Kz3T9hek7NkNrWBsl4+OyHC3DltkF7QMin+Iw5XZBQtIY/Q6cj\njV/eCrAUejsnSYStNWZzoW63UT+aFiCN1PTbK6iLwBVmIeHPGsn+li4pnNKXtctG\nGOnUn/3INqfxl+JgDEQzY0MPc1uoGmYtro/zzO0BQ6NbRZv51iqBydQR5/CVUGbX\nUx805qwhGHkxmLcRNM09NZSTX5HczNFedOVRroyNm8e4Wog3EloG54rS5NwKKg7t\nlbVndxhqE0mjhs7Wung0TI5Kl19gWBuhueqr6bJbTjWlQDf3BKQHR5UT+Q5TI+pH\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAFlO6ivaxMWEOAigN6HiYUKIKf5ntvew\nuXXaGrRcFWqJc+R8MArdQCsTztE5bRoVaderK4Kb291o/z+f6FfXnMoZOLuVxe1j\nkMJublyf3+DBlSVdmZmK5Iddb+AeI7ywJLVgTLAnoyjWlbBbQ3gwFBfmSMcrk+V/\nj7VVRkI5MRctOXjR98jT9q1uCaNuUxoWqqV9NZtq/RWJTCgDpRpdnUdslTn6I3pK\nxyjgJotDa8EB3Pv+61l+lp7TaQslC7nGq5H2kOwrsnidnFWXBqbOF488/1g4FKRP\nUTiVxQpX1PmzinAPRkXLo7hu5qJyXqL4iLN8Zzpz8q3YM+k+Is4lUIg=\n-----END CERTIFICATE-----\n"}]: dispatch 2020-06-27T04:45:04.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[18426]: audit 2020-06-27T04:45:03.699117+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEBdlhx74v0I1lF5HxVItdNEwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMDA2MjcwNDQ1MDNaFw0z\nMDA2MjUwNDQ1MDNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCXtf8/Nt0B5WX6ygttdLBP\nPmDByVdCpWAxH2Kz3T9hek7NkNrWBsl4+OyHC3DltkF7QMin+Iw5XZBQtIY/Q6cj\njV/eCrAUejsnSYStNWZzoW63UT+aFiCN1PTbK6iLwBVmIeHPGsn+li4pnNKXtctG\nGOnUn/3INqfxl+JgDEQzY0MPc1uoGmYtro/zzO0BQ6NbRZv51iqBydQR5/CVUGbX\nUx805qwhGHkxmLcRNM09NZSTX5HczNFedOVRroyNm8e4Wog3EloG54rS5NwKKg7t\nlbVndxhqE0mjhs7Wung0TI5Kl19gWBuhueqr6bJbTjWlQDf3BKQHR5UT+Q5TI+pH\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAFlO6ivaxMWEOAigN6HiYUKIKf5ntvew\nuXXaGrRcFWqJc+R8MArdQCsTztE5bRoVaderK4Kb291o/z+f6FfXnMoZOLuVxe1j\nkMJublyf3+DBlSVdmZmK5Iddb+AeI7ywJLVgTLAnoyjWlbBbQ3gwFBfmSMcrk+V/\nj7VVRkI5MRctOXjR98jT9q1uCaNuUxoWqqV9NZtq/RWJTCgDpRpdnUdslTn6I3pK\nxyjgJotDa8EB3Pv+61l+lp7TaQslC7nGq5H2kOwrsnidnFWXBqbOF488/1g4FKRP\nUTiVxQpX1PmzinAPRkXLo7hu5qJyXqL4iLN8Zzpz8q3YM+k+Is4lUIg=\n-----END CERTIFICATE-----\n"}]: dispatch 2020-06-27T04:45:04.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[18426]: audit 2020-06-27T04:45:03.704002+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEBdlhx74v0I1lF5HxVItdNEwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMDA2MjcwNDQ1MDNaFw0z\nMDA2MjUwNDQ1MDNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCXtf8/Nt0B5WX6ygttdLBP\nPmDByVdCpWAxH2Kz3T9hek7NkNrWBsl4+OyHC3DltkF7QMin+Iw5XZBQtIY/Q6cj\njV/eCrAUejsnSYStNWZzoW63UT+aFiCN1PTbK6iLwBVmIeHPGsn+li4pnNKXtctG\nGOnUn/3INqfxl+JgDEQzY0MPc1uoGmYtro/zzO0BQ6NbRZv51iqBydQR5/CVUGbX\nUx805qwhGHkxmLcRNM09NZSTX5HczNFedOVRroyNm8e4Wog3EloG54rS5NwKKg7t\nlbVndxhqE0mjhs7Wung0TI5Kl19gWBuhueqr6bJbTjWlQDf3BKQHR5UT+Q5TI+pH\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAFlO6ivaxMWEOAigN6HiYUKIKf5ntvew\nuXXaGrRcFWqJc+R8MArdQCsTztE5bRoVaderK4Kb291o/z+f6FfXnMoZOLuVxe1j\nkMJublyf3+DBlSVdmZmK5Iddb+AeI7ywJLVgTLAnoyjWlbBbQ3gwFBfmSMcrk+V/\nj7VVRkI5MRctOXjR98jT9q1uCaNuUxoWqqV9NZtq/RWJTCgDpRpdnUdslTn6I3pK\nxyjgJotDa8EB3Pv+61l+lp7TaQslC7nGq5H2kOwrsnidnFWXBqbOF488/1g4FKRP\nUTiVxQpX1PmzinAPRkXLo7hu5qJyXqL4iLN8Zzpz8q3YM+k+Is4lUIg=\n-----END CERTIFICATE-----\n"}]': finished 2020-06-27T04:45:04.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[18426]: audit 2020-06-27T04:45:03.705390+0000 mon.b (mon.2) 225 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQCXtf8/Nt0B5WX6\nygttdLBPPmDByVdCpWAxH2Kz3T9hek7NkNrWBsl4+OyHC3DltkF7QMin+Iw5XZBQ\ntIY/Q6cjjV/eCrAUejsnSYStNWZzoW63UT+aFiCN1PTbK6iLwBVmIeHPGsn+li4p\nnNKXtctGGOnUn/3INqfxl+JgDEQzY0MPc1uoGmYtro/zzO0BQ6NbRZv51iqBydQR\n5/CVUGbXUx805qwhGHkxmLcRNM09NZSTX5HczNFedOVRroyNm8e4Wog3EloG54rS\n5NwKKg7tlbVndxhqE0mjhs7Wung0TI5Kl19gWBuhueqr6bJbTjWlQDf3BKQHR5UT\n+Q5TI+pHAgMBAAECggEADNj+yq2svbJdloVxvk05eRyBOSgB2cUDhmVwCGdeLLUc\n40+3GJTuju4VqcIQR4PNu9Barc7goSMJS6xeChGCoAIi8jzZeIJ5a/RP5hM1n+k1\n5RReXIAvNZOpQL5Lwbn8le+cndtY69RwCFodg3eDxWXqt3TtGv1174G7TAL965QF\nAtA9/+JnC72jk7jMhIRO42XOhHl119SmRrsvj8i65WyM+FI7m/X3vLm/t5n0uJpy\nLdvfS5tBqVMZi5yoaGwnBxRD6GK+EhRBDV1tfiDsfEvSM9BjpjtB/7Gd5olRX0/5\nNIEw6wNmbWhj0iMtFvJ8J5cgyK1LMw2pzg3m+5ED4QKBgQDFkhiawiqDp7avQzUo\ndAbQOKiWcq4wTOTXr/7N+toTuafLOv5qC+BtXTBzR8s+rkwiWvsrZ7ZWmfxAO5Ip\nYqaSbjy4kjt0mig0rMbjeO+NokEqxvkqlnk29aIfDELL1BjItwyG7v+v/KTQsvqx\nFq8UgKarrFu12CWbHyMW3fM+OQKBgQDEk+YEVCjyMxga7jMzp60H6sTJRjYraObr\nEU6ZYSj8ZESKdQIvKYiwSJOaWW7kgvUgSUWgghHmlWMzxIzvKCoYFLwppu5mQ2dG\nk2nyf8YN7DQ68BQMVVviYy/MeWnulXZDBHDbYqmg1k6z0ygNcI2kmVT8wZHH4ieQ\nbs6J4vhsfwKBgDb+PX8GQNM4oa8TI/7InQTkYHjQHxAutxwaTvCCvKT07nGxUBOw\njp2ibNQJzdb6qRJ/BJ7GVYixf/dZHYwLe5YSvTAa9BW2uy4+UXYLuZJQ8Za4n65t\nB/x2TtQZk5YsyWFFImWErQMNbcrxproYOE+ap8ntRfHN4lnVRu0chpJxAoGAQJdQ\nNw/oPFzpiL/H9ysbQcS0UGZPmkfnyElxiBhSvUu88bmstA5zqWjPhyHnvBIDtU4e\nILVcaGWhqPrmTBbobe0yPoVpRBTVtGzvnQy66Qw5xTvpenv5qxNoO0mRsyFNMIwf\nARcUIZMJXTD+shvPjswLDtoTqpf25BBksQ3xDsUCgYA+j9qMzFTMmdhmgX+wb9DK\nUUZbTCq2QDr3tNJJQRq0PXq+cKUGTjxSDUWTZXT6PIyzJHi0kGzxWpXhF8lhUU5/\nbDVmil+hRL2I37VvE6tJZ+XeKQ5KkKhE0LfySyWFf/EAUNIMu5cpdJO/hT7YOyFz\nr8ZULRYnY9iMHSYOlgN1lQ==\n-----END PRIVATE KEY-----\n"}]: dispatch 2020-06-27T04:45:04.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[18426]: audit 2020-06-27T04:45:03.705725+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQCXtf8/Nt0B5WX6\nygttdLBPPmDByVdCpWAxH2Kz3T9hek7NkNrWBsl4+OyHC3DltkF7QMin+Iw5XZBQ\ntIY/Q6cjjV/eCrAUejsnSYStNWZzoW63UT+aFiCN1PTbK6iLwBVmIeHPGsn+li4p\nnNKXtctGGOnUn/3INqfxl+JgDEQzY0MPc1uoGmYtro/zzO0BQ6NbRZv51iqBydQR\n5/CVUGbXUx805qwhGHkxmLcRNM09NZSTX5HczNFedOVRroyNm8e4Wog3EloG54rS\n5NwKKg7tlbVndxhqE0mjhs7Wung0TI5Kl19gWBuhueqr6bJbTjWlQDf3BKQHR5UT\n+Q5TI+pHAgMBAAECggEADNj+yq2svbJdloVxvk05eRyBOSgB2cUDhmVwCGdeLLUc\n40+3GJTuju4VqcIQR4PNu9Barc7goSMJS6xeChGCoAIi8jzZeIJ5a/RP5hM1n+k1\n5RReXIAvNZOpQL5Lwbn8le+cndtY69RwCFodg3eDxWXqt3TtGv1174G7TAL965QF\nAtA9/+JnC72jk7jMhIRO42XOhHl119SmRrsvj8i65WyM+FI7m/X3vLm/t5n0uJpy\nLdvfS5tBqVMZi5yoaGwnBxRD6GK+EhRBDV1tfiDsfEvSM9BjpjtB/7Gd5olRX0/5\nNIEw6wNmbWhj0iMtFvJ8J5cgyK1LMw2pzg3m+5ED4QKBgQDFkhiawiqDp7avQzUo\ndAbQOKiWcq4wTOTXr/7N+toTuafLOv5qC+BtXTBzR8s+rkwiWvsrZ7ZWmfxAO5Ip\nYqaSbjy4kjt0mig0rMbjeO+NokEqxvkqlnk29aIfDELL1BjItwyG7v+v/KTQsvqx\nFq8UgKarrFu12CWbHyMW3fM+OQKBgQDEk+YEVCjyMxga7jMzp60H6sTJRjYraObr\nEU6ZYSj8ZESKdQIvKYiwSJOaWW7kgvUgSUWgghHmlWMzxIzvKCoYFLwppu5mQ2dG\nk2nyf8YN7DQ68BQMVVviYy/MeWnulXZDBHDbYqmg1k6z0ygNcI2kmVT8wZHH4ieQ\nbs6J4vhsfwKBgDb+PX8GQNM4oa8TI/7InQTkYHjQHxAutxwaTvCCvKT07nGxUBOw\njp2ibNQJzdb6qRJ/BJ7GVYixf/dZHYwLe5YSvTAa9BW2uy4+UXYLuZJQ8Za4n65t\nB/x2TtQZk5YsyWFFImWErQMNbcrxproYOE+ap8ntRfHN4lnVRu0chpJxAoGAQJdQ\nNw/oPFzpiL/H9ysbQcS0UGZPmkfnyElxiBhSvUu88bmstA5zqWjPhyHnvBIDtU4e\nILVcaGWhqPrmTBbobe0yPoVpRBTVtGzvnQy66Qw5xTvpenv5qxNoO0mRsyFNMIwf\nARcUIZMJXTD+shvPjswLDtoTqpf25BBksQ3xDsUCgYA+j9qMzFTMmdhmgX+wb9DK\nUUZbTCq2QDr3tNJJQRq0PXq+cKUGTjxSDUWTZXT6PIyzJHi0kGzxWpXhF8lhUU5/\nbDVmil+hRL2I37VvE6tJZ+XeKQ5KkKhE0LfySyWFf/EAUNIMu5cpdJO/hT7YOyFz\nr8ZULRYnY9iMHSYOlgN1lQ==\n-----END PRIVATE KEY-----\n"}]: dispatch 2020-06-27T04:45:04.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[18426]: audit 2020-06-27T04:45:03.708588+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQCXtf8/Nt0B5WX6\nygttdLBPPmDByVdCpWAxH2Kz3T9hek7NkNrWBsl4+OyHC3DltkF7QMin+Iw5XZBQ\ntIY/Q6cjjV/eCrAUejsnSYStNWZzoW63UT+aFiCN1PTbK6iLwBVmIeHPGsn+li4p\nnNKXtctGGOnUn/3INqfxl+JgDEQzY0MPc1uoGmYtro/zzO0BQ6NbRZv51iqBydQR\n5/CVUGbXUx805qwhGHkxmLcRNM09NZSTX5HczNFedOVRroyNm8e4Wog3EloG54rS\n5NwKKg7tlbVndxhqE0mjhs7Wung0TI5Kl19gWBuhueqr6bJbTjWlQDf3BKQHR5UT\n+Q5TI+pHAgMBAAECggEADNj+yq2svbJdloVxvk05eRyBOSgB2cUDhmVwCGdeLLUc\n40+3GJTuju4VqcIQR4PNu9Barc7goSMJS6xeChGCoAIi8jzZeIJ5a/RP5hM1n+k1\n5RReXIAvNZOpQL5Lwbn8le+cndtY69RwCFodg3eDxWXqt3TtGv1174G7TAL965QF\nAtA9/+JnC72jk7jMhIRO42XOhHl119SmRrsvj8i65WyM+FI7m/X3vLm/t5n0uJpy\nLdvfS5tBqVMZi5yoaGwnBxRD6GK+EhRBDV1tfiDsfEvSM9BjpjtB/7Gd5olRX0/5\nNIEw6wNmbWhj0iMtFvJ8J5cgyK1LMw2pzg3m+5ED4QKBgQDFkhiawiqDp7avQzUo\ndAbQOKiWcq4wTOTXr/7N+toTuafLOv5qC+BtXTBzR8s+rkwiWvsrZ7ZWmfxAO5Ip\nYqaSbjy4kjt0mig0rMbjeO+NokEqxvkqlnk29aIfDELL1BjItwyG7v+v/KTQsvqx\nFq8UgKarrFu12CWbHyMW3fM+OQKBgQDEk+YEVCjyMxga7jMzp60H6sTJRjYraObr\nEU6ZYSj8ZESKdQIvKYiwSJOaWW7kgvUgSUWgghHmlWMzxIzvKCoYFLwppu5mQ2dG\nk2nyf8YN7DQ68BQMVVviYy/MeWnulXZDBHDbYqmg1k6z0ygNcI2kmVT8wZHH4ieQ\nbs6J4vhsfwKBgDb+PX8GQNM4oa8TI/7InQTkYHjQHxAutxwaTvCCvKT07nGxUBOw\njp2ibNQJzdb6qRJ/BJ7GVYixf/dZHYwLe5YSvTAa9BW2uy4+UXYLuZJQ8Za4n65t\nB/x2TtQZk5YsyWFFImWErQMNbcrxproYOE+ap8ntRfHN4lnVRu0chpJxAoGAQJdQ\nNw/oPFzpiL/H9ysbQcS0UGZPmkfnyElxiBhSvUu88bmstA5zqWjPhyHnvBIDtU4e\nILVcaGWhqPrmTBbobe0yPoVpRBTVtGzvnQy66Qw5xTvpenv5qxNoO0mRsyFNMIwf\nARcUIZMJXTD+shvPjswLDtoTqpf25BBksQ3xDsUCgYA+j9qMzFTMmdhmgX+wb9DK\nUUZbTCq2QDr3tNJJQRq0PXq+cKUGTjxSDUWTZXT6PIyzJHi0kGzxWpXhF8lhUU5/\nbDVmil+hRL2I37VvE6tJZ+XeKQ5KkKhE0LfySyWFf/EAUNIMu5cpdJO/hT7YOyFz\nr8ZULRYnY9iMHSYOlgN1lQ==\n-----END PRIVATE KEY-----\n"}]': finished 2020-06-27T04:45:04.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[18426]: audit 2020-06-27T04:45:03.710546+0000 mon.b (mon.2) 226 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2020-06-27T04:45:04.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[18426]: audit 2020-06-27T04:45:03.711038+0000 mgr.x (mgr.34109) 133 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2020-06-27T04:45:04.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[18426]: audit 2020-06-27T04:45:03.711388+0000 mon.b (mon.2) 227 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]: dispatch 2020-06-27T04:45:04.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[18426]: audit 2020-06-27T04:45:03.711659+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]: dispatch 2020-06-27T04:45:04.478 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[18426]: audit 2020-06-27T04:45:03.715071+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]': finished 2020-06-27T04:45:04.478 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[18426]: cephadm 2020-06-27T04:45:03.719296+0000 mgr.x (mgr.34109) 134 : cephadm [INF] Deploying daemon grafana.a on smithi051 2020-06-27T04:45:04.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[22603]: cluster 2020-06-27T04:45:03.136643+0000 mgr.x (mgr.34109) 132 : cluster [DBG] pgmap v128: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 341 B/s rd, 0 B/s wr, 0 op/s 2020-06-27T04:45:04.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[22603]: audit 2020-06-27T04:45:03.601764+0000 mon.b (mon.2) 223 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:51.468124\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:04.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[22603]: audit 2020-06-27T04:45:03.602484+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:51.468124\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:04.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[22603]: audit 2020-06-27T04:45:03.605249+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336329\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336456\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336523\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336790\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.336911\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337021\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:34.337129\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:51.468124\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:45:04.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[22603]: audit 2020-06-27T04:45:03.698099+0000 mon.b (mon.2) 224 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEBdlhx74v0I1lF5HxVItdNEwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMDA2MjcwNDQ1MDNaFw0z\nMDA2MjUwNDQ1MDNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCXtf8/Nt0B5WX6ygttdLBP\nPmDByVdCpWAxH2Kz3T9hek7NkNrWBsl4+OyHC3DltkF7QMin+Iw5XZBQtIY/Q6cj\njV/eCrAUejsnSYStNWZzoW63UT+aFiCN1PTbK6iLwBVmIeHPGsn+li4pnNKXtctG\nGOnUn/3INqfxl+JgDEQzY0MPc1uoGmYtro/zzO0BQ6NbRZv51iqBydQR5/CVUGbX\nUx805qwhGHkxmLcRNM09NZSTX5HczNFedOVRroyNm8e4Wog3EloG54rS5NwKKg7t\nlbVndxhqE0mjhs7Wung0TI5Kl19gWBuhueqr6bJbTjWlQDf3BKQHR5UT+Q5TI+pH\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAFlO6ivaxMWEOAigN6HiYUKIKf5ntvew\nuXXaGrRcFWqJc+R8MArdQCsTztE5bRoVaderK4Kb291o/z+f6FfXnMoZOLuVxe1j\nkMJublyf3+DBlSVdmZmK5Iddb+AeI7ywJLVgTLAnoyjWlbBbQ3gwFBfmSMcrk+V/\nj7VVRkI5MRctOXjR98jT9q1uCaNuUxoWqqV9NZtq/RWJTCgDpRpdnUdslTn6I3pK\nxyjgJotDa8EB3Pv+61l+lp7TaQslC7nGq5H2kOwrsnidnFWXBqbOF488/1g4FKRP\nUTiVxQpX1PmzinAPRkXLo7hu5qJyXqL4iLN8Zzpz8q3YM+k+Is4lUIg=\n-----END CERTIFICATE-----\n"}]: dispatch 2020-06-27T04:45:04.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[22603]: audit 2020-06-27T04:45:03.699117+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEBdlhx74v0I1lF5HxVItdNEwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMDA2MjcwNDQ1MDNaFw0z\nMDA2MjUwNDQ1MDNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCXtf8/Nt0B5WX6ygttdLBP\nPmDByVdCpWAxH2Kz3T9hek7NkNrWBsl4+OyHC3DltkF7QMin+Iw5XZBQtIY/Q6cj\njV/eCrAUejsnSYStNWZzoW63UT+aFiCN1PTbK6iLwBVmIeHPGsn+li4pnNKXtctG\nGOnUn/3INqfxl+JgDEQzY0MPc1uoGmYtro/zzO0BQ6NbRZv51iqBydQR5/CVUGbX\nUx805qwhGHkxmLcRNM09NZSTX5HczNFedOVRroyNm8e4Wog3EloG54rS5NwKKg7t\nlbVndxhqE0mjhs7Wung0TI5Kl19gWBuhueqr6bJbTjWlQDf3BKQHR5UT+Q5TI+pH\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAFlO6ivaxMWEOAigN6HiYUKIKf5ntvew\nuXXaGrRcFWqJc+R8MArdQCsTztE5bRoVaderK4Kb291o/z+f6FfXnMoZOLuVxe1j\nkMJublyf3+DBlSVdmZmK5Iddb+AeI7ywJLVgTLAnoyjWlbBbQ3gwFBfmSMcrk+V/\nj7VVRkI5MRctOXjR98jT9q1uCaNuUxoWqqV9NZtq/RWJTCgDpRpdnUdslTn6I3pK\nxyjgJotDa8EB3Pv+61l+lp7TaQslC7nGq5H2kOwrsnidnFWXBqbOF488/1g4FKRP\nUTiVxQpX1PmzinAPRkXLo7hu5qJyXqL4iLN8Zzpz8q3YM+k+Is4lUIg=\n-----END CERTIFICATE-----\n"}]: dispatch 2020-06-27T04:45:04.480 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[22603]: audit 2020-06-27T04:45:03.704002+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEBdlhx74v0I1lF5HxVItdNEwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMDA2MjcwNDQ1MDNaFw0z\nMDA2MjUwNDQ1MDNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCXtf8/Nt0B5WX6ygttdLBP\nPmDByVdCpWAxH2Kz3T9hek7NkNrWBsl4+OyHC3DltkF7QMin+Iw5XZBQtIY/Q6cj\njV/eCrAUejsnSYStNWZzoW63UT+aFiCN1PTbK6iLwBVmIeHPGsn+li4pnNKXtctG\nGOnUn/3INqfxl+JgDEQzY0MPc1uoGmYtro/zzO0BQ6NbRZv51iqBydQR5/CVUGbX\nUx805qwhGHkxmLcRNM09NZSTX5HczNFedOVRroyNm8e4Wog3EloG54rS5NwKKg7t\nlbVndxhqE0mjhs7Wung0TI5Kl19gWBuhueqr6bJbTjWlQDf3BKQHR5UT+Q5TI+pH\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAFlO6ivaxMWEOAigN6HiYUKIKf5ntvew\nuXXaGrRcFWqJc+R8MArdQCsTztE5bRoVaderK4Kb291o/z+f6FfXnMoZOLuVxe1j\nkMJublyf3+DBlSVdmZmK5Iddb+AeI7ywJLVgTLAnoyjWlbBbQ3gwFBfmSMcrk+V/\nj7VVRkI5MRctOXjR98jT9q1uCaNuUxoWqqV9NZtq/RWJTCgDpRpdnUdslTn6I3pK\nxyjgJotDa8EB3Pv+61l+lp7TaQslC7nGq5H2kOwrsnidnFWXBqbOF488/1g4FKRP\nUTiVxQpX1PmzinAPRkXLo7hu5qJyXqL4iLN8Zzpz8q3YM+k+Is4lUIg=\n-----END CERTIFICATE-----\n"}]': finished 2020-06-27T04:45:04.480 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[22603]: audit 2020-06-27T04:45:03.705390+0000 mon.b (mon.2) 225 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQCXtf8/Nt0B5WX6\nygttdLBPPmDByVdCpWAxH2Kz3T9hek7NkNrWBsl4+OyHC3DltkF7QMin+Iw5XZBQ\ntIY/Q6cjjV/eCrAUejsnSYStNWZzoW63UT+aFiCN1PTbK6iLwBVmIeHPGsn+li4p\nnNKXtctGGOnUn/3INqfxl+JgDEQzY0MPc1uoGmYtro/zzO0BQ6NbRZv51iqBydQR\n5/CVUGbXUx805qwhGHkxmLcRNM09NZSTX5HczNFedOVRroyNm8e4Wog3EloG54rS\n5NwKKg7tlbVndxhqE0mjhs7Wung0TI5Kl19gWBuhueqr6bJbTjWlQDf3BKQHR5UT\n+Q5TI+pHAgMBAAECggEADNj+yq2svbJdloVxvk05eRyBOSgB2cUDhmVwCGdeLLUc\n40+3GJTuju4VqcIQR4PNu9Barc7goSMJS6xeChGCoAIi8jzZeIJ5a/RP5hM1n+k1\n5RReXIAvNZOpQL5Lwbn8le+cndtY69RwCFodg3eDxWXqt3TtGv1174G7TAL965QF\nAtA9/+JnC72jk7jMhIRO42XOhHl119SmRrsvj8i65WyM+FI7m/X3vLm/t5n0uJpy\nLdvfS5tBqVMZi5yoaGwnBxRD6GK+EhRBDV1tfiDsfEvSM9BjpjtB/7Gd5olRX0/5\nNIEw6wNmbWhj0iMtFvJ8J5cgyK1LMw2pzg3m+5ED4QKBgQDFkhiawiqDp7avQzUo\ndAbQOKiWcq4wTOTXr/7N+toTuafLOv5qC+BtXTBzR8s+rkwiWvsrZ7ZWmfxAO5Ip\nYqaSbjy4kjt0mig0rMbjeO+NokEqxvkqlnk29aIfDELL1BjItwyG7v+v/KTQsvqx\nFq8UgKarrFu12CWbHyMW3fM+OQKBgQDEk+YEVCjyMxga7jMzp60H6sTJRjYraObr\nEU6ZYSj8ZESKdQIvKYiwSJOaWW7kgvUgSUWgghHmlWMzxIzvKCoYFLwppu5mQ2dG\nk2nyf8YN7DQ68BQMVVviYy/MeWnulXZDBHDbYqmg1k6z0ygNcI2kmVT8wZHH4ieQ\nbs6J4vhsfwKBgDb+PX8GQNM4oa8TI/7InQTkYHjQHxAutxwaTvCCvKT07nGxUBOw\njp2ibNQJzdb6qRJ/BJ7GVYixf/dZHYwLe5YSvTAa9BW2uy4+UXYLuZJQ8Za4n65t\nB/x2TtQZk5YsyWFFImWErQMNbcrxproYOE+ap8ntRfHN4lnVRu0chpJxAoGAQJdQ\nNw/oPFzpiL/H9ysbQcS0UGZPmkfnyElxiBhSvUu88bmstA5zqWjPhyHnvBIDtU4e\nILVcaGWhqPrmTBbobe0yPoVpRBTVtGzvnQy66Qw5xTvpenv5qxNoO0mRsyFNMIwf\nARcUIZMJXTD+shvPjswLDtoTqpf25BBksQ3xDsUCgYA+j9qMzFTMmdhmgX+wb9DK\nUUZbTCq2QDr3tNJJQRq0PXq+cKUGTjxSDUWTZXT6PIyzJHi0kGzxWpXhF8lhUU5/\nbDVmil+hRL2I37VvE6tJZ+XeKQ5KkKhE0LfySyWFf/EAUNIMu5cpdJO/hT7YOyFz\nr8ZULRYnY9iMHSYOlgN1lQ==\n-----END PRIVATE KEY-----\n"}]: dispatch 2020-06-27T04:45:04.480 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[22603]: audit 2020-06-27T04:45:03.705725+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQCXtf8/Nt0B5WX6\nygttdLBPPmDByVdCpWAxH2Kz3T9hek7NkNrWBsl4+OyHC3DltkF7QMin+Iw5XZBQ\ntIY/Q6cjjV/eCrAUejsnSYStNWZzoW63UT+aFiCN1PTbK6iLwBVmIeHPGsn+li4p\nnNKXtctGGOnUn/3INqfxl+JgDEQzY0MPc1uoGmYtro/zzO0BQ6NbRZv51iqBydQR\n5/CVUGbXUx805qwhGHkxmLcRNM09NZSTX5HczNFedOVRroyNm8e4Wog3EloG54rS\n5NwKKg7tlbVndxhqE0mjhs7Wung0TI5Kl19gWBuhueqr6bJbTjWlQDf3BKQHR5UT\n+Q5TI+pHAgMBAAECggEADNj+yq2svbJdloVxvk05eRyBOSgB2cUDhmVwCGdeLLUc\n40+3GJTuju4VqcIQR4PNu9Barc7goSMJS6xeChGCoAIi8jzZeIJ5a/RP5hM1n+k1\n5RReXIAvNZOpQL5Lwbn8le+cndtY69RwCFodg3eDxWXqt3TtGv1174G7TAL965QF\nAtA9/+JnC72jk7jMhIRO42XOhHl119SmRrsvj8i65WyM+FI7m/X3vLm/t5n0uJpy\nLdvfS5tBqVMZi5yoaGwnBxRD6GK+EhRBDV1tfiDsfEvSM9BjpjtB/7Gd5olRX0/5\nNIEw6wNmbWhj0iMtFvJ8J5cgyK1LMw2pzg3m+5ED4QKBgQDFkhiawiqDp7avQzUo\ndAbQOKiWcq4wTOTXr/7N+toTuafLOv5qC+BtXTBzR8s+rkwiWvsrZ7ZWmfxAO5Ip\nYqaSbjy4kjt0mig0rMbjeO+NokEqxvkqlnk29aIfDELL1BjItwyG7v+v/KTQsvqx\nFq8UgKarrFu12CWbHyMW3fM+OQKBgQDEk+YEVCjyMxga7jMzp60H6sTJRjYraObr\nEU6ZYSj8ZESKdQIvKYiwSJOaWW7kgvUgSUWgghHmlWMzxIzvKCoYFLwppu5mQ2dG\nk2nyf8YN7DQ68BQMVVviYy/MeWnulXZDBHDbYqmg1k6z0ygNcI2kmVT8wZHH4ieQ\nbs6J4vhsfwKBgDb+PX8GQNM4oa8TI/7InQTkYHjQHxAutxwaTvCCvKT07nGxUBOw\njp2ibNQJzdb6qRJ/BJ7GVYixf/dZHYwLe5YSvTAa9BW2uy4+UXYLuZJQ8Za4n65t\nB/x2TtQZk5YsyWFFImWErQMNbcrxproYOE+ap8ntRfHN4lnVRu0chpJxAoGAQJdQ\nNw/oPFzpiL/H9ysbQcS0UGZPmkfnyElxiBhSvUu88bmstA5zqWjPhyHnvBIDtU4e\nILVcaGWhqPrmTBbobe0yPoVpRBTVtGzvnQy66Qw5xTvpenv5qxNoO0mRsyFNMIwf\nARcUIZMJXTD+shvPjswLDtoTqpf25BBksQ3xDsUCgYA+j9qMzFTMmdhmgX+wb9DK\nUUZbTCq2QDr3tNJJQRq0PXq+cKUGTjxSDUWTZXT6PIyzJHi0kGzxWpXhF8lhUU5/\nbDVmil+hRL2I37VvE6tJZ+XeKQ5KkKhE0LfySyWFf/EAUNIMu5cpdJO/hT7YOyFz\nr8ZULRYnY9iMHSYOlgN1lQ==\n-----END PRIVATE KEY-----\n"}]: dispatch 2020-06-27T04:45:04.480 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[22603]: audit 2020-06-27T04:45:03.708588+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQCXtf8/Nt0B5WX6\nygttdLBPPmDByVdCpWAxH2Kz3T9hek7NkNrWBsl4+OyHC3DltkF7QMin+Iw5XZBQ\ntIY/Q6cjjV/eCrAUejsnSYStNWZzoW63UT+aFiCN1PTbK6iLwBVmIeHPGsn+li4p\nnNKXtctGGOnUn/3INqfxl+JgDEQzY0MPc1uoGmYtro/zzO0BQ6NbRZv51iqBydQR\n5/CVUGbXUx805qwhGHkxmLcRNM09NZSTX5HczNFedOVRroyNm8e4Wog3EloG54rS\n5NwKKg7tlbVndxhqE0mjhs7Wung0TI5Kl19gWBuhueqr6bJbTjWlQDf3BKQHR5UT\n+Q5TI+pHAgMBAAECggEADNj+yq2svbJdloVxvk05eRyBOSgB2cUDhmVwCGdeLLUc\n40+3GJTuju4VqcIQR4PNu9Barc7goSMJS6xeChGCoAIi8jzZeIJ5a/RP5hM1n+k1\n5RReXIAvNZOpQL5Lwbn8le+cndtY69RwCFodg3eDxWXqt3TtGv1174G7TAL965QF\nAtA9/+JnC72jk7jMhIRO42XOhHl119SmRrsvj8i65WyM+FI7m/X3vLm/t5n0uJpy\nLdvfS5tBqVMZi5yoaGwnBxRD6GK+EhRBDV1tfiDsfEvSM9BjpjtB/7Gd5olRX0/5\nNIEw6wNmbWhj0iMtFvJ8J5cgyK1LMw2pzg3m+5ED4QKBgQDFkhiawiqDp7avQzUo\ndAbQOKiWcq4wTOTXr/7N+toTuafLOv5qC+BtXTBzR8s+rkwiWvsrZ7ZWmfxAO5Ip\nYqaSbjy4kjt0mig0rMbjeO+NokEqxvkqlnk29aIfDELL1BjItwyG7v+v/KTQsvqx\nFq8UgKarrFu12CWbHyMW3fM+OQKBgQDEk+YEVCjyMxga7jMzp60H6sTJRjYraObr\nEU6ZYSj8ZESKdQIvKYiwSJOaWW7kgvUgSUWgghHmlWMzxIzvKCoYFLwppu5mQ2dG\nk2nyf8YN7DQ68BQMVVviYy/MeWnulXZDBHDbYqmg1k6z0ygNcI2kmVT8wZHH4ieQ\nbs6J4vhsfwKBgDb+PX8GQNM4oa8TI/7InQTkYHjQHxAutxwaTvCCvKT07nGxUBOw\njp2ibNQJzdb6qRJ/BJ7GVYixf/dZHYwLe5YSvTAa9BW2uy4+UXYLuZJQ8Za4n65t\nB/x2TtQZk5YsyWFFImWErQMNbcrxproYOE+ap8ntRfHN4lnVRu0chpJxAoGAQJdQ\nNw/oPFzpiL/H9ysbQcS0UGZPmkfnyElxiBhSvUu88bmstA5zqWjPhyHnvBIDtU4e\nILVcaGWhqPrmTBbobe0yPoVpRBTVtGzvnQy66Qw5xTvpenv5qxNoO0mRsyFNMIwf\nARcUIZMJXTD+shvPjswLDtoTqpf25BBksQ3xDsUCgYA+j9qMzFTMmdhmgX+wb9DK\nUUZbTCq2QDr3tNJJQRq0PXq+cKUGTjxSDUWTZXT6PIyzJHi0kGzxWpXhF8lhUU5/\nbDVmil+hRL2I37VvE6tJZ+XeKQ5KkKhE0LfySyWFf/EAUNIMu5cpdJO/hT7YOyFz\nr8ZULRYnY9iMHSYOlgN1lQ==\n-----END PRIVATE KEY-----\n"}]': finished 2020-06-27T04:45:04.481 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[22603]: audit 2020-06-27T04:45:03.710546+0000 mon.b (mon.2) 226 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2020-06-27T04:45:04.481 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[22603]: audit 2020-06-27T04:45:03.711038+0000 mgr.x (mgr.34109) 133 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2020-06-27T04:45:04.481 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[22603]: audit 2020-06-27T04:45:03.711388+0000 mon.b (mon.2) 227 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]: dispatch 2020-06-27T04:45:04.481 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[22603]: audit 2020-06-27T04:45:03.711659+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]: dispatch 2020-06-27T04:45:04.481 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[22603]: audit 2020-06-27T04:45:03.715071+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]': finished 2020-06-27T04:45:04.482 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[22603]: cephadm 2020-06-27T04:45:03.719296+0000 mgr.x (mgr.34109) 134 : cephadm [INF] Deploying daemon grafana.a on smithi051 2020-06-27T04:45:05.118 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.114+0000 7fd804c22700 1 Processor -- start 2020-06-27T04:45:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.114+0000 7fd804c22700 1 -- start start 2020-06-27T04:45:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.114+0000 7fd804c22700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd800066360 0x7fd80006cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.114+0000 7fd804c22700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd80006be30 0x7fd800078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:05.120 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.114+0000 7fd804c22700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8000786b0 0x7fd8001250b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:05.120 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.114+0000 7fd804c22700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd800078d70 con 0x7fd8000786b0 2020-06-27T04:45:05.120 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.114+0000 7fd804c22700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8001255d0 con 0x7fd80006be30 2020-06-27T04:45:05.120 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.114+0000 7fd804c22700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd800125790 con 0x7fd800066360 2020-06-27T04:45:05.120 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.114+0000 7fd7ff59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8000786b0 0x7fd8001250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:05.120 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.114+0000 7fd7fed9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd800066360 0x7fd80006cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:05.121 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.114+0000 7fd7fe59c700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd80006be30 0x7fd800078080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:05.121 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.114+0000 7fd7ff59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8000786b0 0x7fd8001250b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39416/0 (socket says 172.21.15.31:39416) 2020-06-27T04:45:05.121 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.114+0000 7fd7ff59e700 1 -- 172.21.15.31:0/169652930 learned_addr learned my addr 172.21.15.31:0/169652930 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:05.121 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.115+0000 7fd7fed9d700 1 -- 172.21.15.31:0/169652930 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd80006be30 msgr2=0x7fd800078080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:05.121 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.115+0000 7fd7fed9d700 1 --2- 172.21.15.31:0/169652930 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd80006be30 0x7fd800078080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:05.122 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.115+0000 7fd7fed9d700 1 -- 172.21.15.31:0/169652930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8000786b0 msgr2=0x7fd8001250b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:05.122 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.115+0000 7fd7fed9d700 1 --2- 172.21.15.31:0/169652930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8000786b0 0x7fd8001250b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:05.122 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.115+0000 7fd7fed9d700 1 -- 172.21.15.31:0/169652930 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd800125950 con 0x7fd800066360 2020-06-27T04:45:05.122 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.115+0000 7fd7ff59e700 1 --2- 172.21.15.31:0/169652930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8000786b0 0x7fd8001250b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:45:05.122 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.115+0000 7fd7fed9d700 1 --2- 172.21.15.31:0/169652930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd800066360 0x7fd80006cdb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd7e8002f70 tx=0x7fd7e8009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:05.123 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.115+0000 7fd7f6ffd700 1 -- 172.21.15.31:0/169652930 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7e800e030 con 0x7fd800066360 2020-06-27T04:45:05.123 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.115+0000 7fd7f6ffd700 1 -- 172.21.15.31:0/169652930 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fd7e800be60 con 0x7fd800066360 2020-06-27T04:45:05.123 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.115+0000 7fd804c22700 1 -- 172.21.15.31:0/169652930 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd800125ba0 con 0x7fd800066360 2020-06-27T04:45:05.123 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.115+0000 7fd7f6ffd700 1 -- 172.21.15.31:0/169652930 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7e8018070 con 0x7fd800066360 2020-06-27T04:45:05.123 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.115+0000 7fd804c22700 1 -- 172.21.15.31:0/169652930 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd800125fe0 con 0x7fd800066360 2020-06-27T04:45:05.124 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.116+0000 7fd7f6ffd700 1 -- 172.21.15.31:0/169652930 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7fd7e801d610 con 0x7fd800066360 2020-06-27T04:45:05.125 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.116+0000 7fd7f6ffd700 1 --2- 172.21.15.31:0/169652930 >> v2:172.21.15.51:6800/950992045 conn(0x7fd7d802ab50 0x7fd7d802d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:05.125 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.116+0000 7fd7f6ffd700 1 -- 172.21.15.31:0/169652930 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5778+0+0 (secure 0 0 0) 0x7fd7e803c6a0 con 0x7fd800066360 2020-06-27T04:45:05.125 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.116+0000 7fd804c22700 1 -- 172.21.15.31:0/169652930 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80005e210 con 0x7fd800066360 2020-06-27T04:45:05.125 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.116+0000 7fd7fe59c700 1 --2- 172.21.15.31:0/169652930 >> v2:172.21.15.51:6800/950992045 conn(0x7fd7d802ab50 0x7fd7d802d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:05.125 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.116+0000 7fd7fe59c700 1 --2- 172.21.15.31:0/169652930 >> v2:172.21.15.51:6800/950992045 conn(0x7fd7d802ab50 0x7fd7d802d010 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd7f000c000 tx=0x7fd7f0004d20).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:05.126 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.120+0000 7fd7f6ffd700 1 -- 172.21.15.31:0/169652930 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fd7e801de10 con 0x7fd800066360 2020-06-27T04:45:05.223 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:04 smithi031 podman[34702]: 2020-06-27 04:45:04.926039225 +0000 UTC m=+1.261756462 container init e89f4ff5dfc2520cb117902af1f94d41e2df846c6bd40601350865308d233cdf (image=docker.io/prom/alertmanager:v0.20.0, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a) 2020-06-27T04:45:05.223 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:04 smithi031 podman[34702]: 2020-06-27 04:45:04.959371622 +0000 UTC m=+1.295088853 container start e89f4ff5dfc2520cb117902af1f94d41e2df846c6bd40601350865308d233cdf (image=docker.io/prom/alertmanager:v0.20.0, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a) 2020-06-27T04:45:05.223 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:04 smithi031 podman[34702]: 2020-06-27 04:45:04.959448146 +0000 UTC m=+1.295165380 container attach e89f4ff5dfc2520cb117902af1f94d41e2df846c6bd40601350865308d233cdf (image=docker.io/prom/alertmanager:v0.20.0, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a) 2020-06-27T04:45:05.224 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[34672]: level=info ts=2020-06-27T04:45:04.953Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2020-06-27T04:45:05.224 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[34672]: level=info ts=2020-06-27T04:45:04.953Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2020-06-27T04:45:05.224 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[34672]: level=info ts=2020-06-27T04:45:04.954Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.31 port=9094 2020-06-27T04:45:05.224 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[34672]: level=info ts=2020-06-27T04:45:04.955Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2020-06-27T04:45:05.224 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[34672]: level=info ts=2020-06-27T04:45:04.974Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2020-06-27T04:45:05.225 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[34672]: level=info ts=2020-06-27T04:45:04.975Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2020-06-27T04:45:05.225 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:04 smithi031 bash[34672]: level=info ts=2020-06-27T04:45:04.978Z caller=main.go:497 msg=Listening address=:9093 2020-06-27T04:45:05.276 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.273+0000 7fd804c22700 1 -- 172.21.15.31:0/169652930 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd8001262c0 con 0x7fd800066360 2020-06-27T04:45:05.277 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.273+0000 7fd7f6ffd700 1 -- 172.21.15.31:0/169652930 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v57) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd7e8012bc0 con 0x7fd800066360 2020-06-27T04:45:05.277 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2020-06-27T04:45:05.278 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.275+0000 7fd804c22700 1 -- 172.21.15.31:0/169652930 >> v2:172.21.15.51:6800/950992045 conn(0x7fd7d802ab50 msgr2=0x7fd7d802d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:05.279 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.275+0000 7fd804c22700 1 --2- 172.21.15.31:0/169652930 >> v2:172.21.15.51:6800/950992045 conn(0x7fd7d802ab50 0x7fd7d802d010 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd7f000c000 tx=0x7fd7f0004d20).stop 2020-06-27T04:45:05.279 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.275+0000 7fd804c22700 1 -- 172.21.15.31:0/169652930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd800066360 msgr2=0x7fd80006cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:05.279 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.275+0000 7fd804c22700 1 --2- 172.21.15.31:0/169652930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd800066360 0x7fd80006cdb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd7e8002f70 tx=0x7fd7e8009b30).stop 2020-06-27T04:45:05.279 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.275+0000 7fd804c22700 1 -- 172.21.15.31:0/169652930 shutdown_connections 2020-06-27T04:45:05.279 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.275+0000 7fd804c22700 1 --2- 172.21.15.31:0/169652930 >> v2:172.21.15.51:6800/950992045 conn(0x7fd7d802ab50 0x7fd7d802d010 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:05.280 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.275+0000 7fd804c22700 1 --2- 172.21.15.31:0/169652930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8000786b0 0x7fd8001250b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:05.280 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.275+0000 7fd804c22700 1 --2- 172.21.15.31:0/169652930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd800066360 0x7fd80006cdb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:05.280 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.275+0000 7fd804c22700 1 --2- 172.21.15.31:0/169652930 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd80006be30 0x7fd800078080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:05.280 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.275+0000 7fd804c22700 1 -- 172.21.15.31:0/169652930 >> 172.21.15.31:0/169652930 conn(0x7fd800061830 msgr2=0x7fd80006d350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:05.280 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.275+0000 7fd804c22700 1 -- 172.21.15.31:0/169652930 shutdown_connections 2020-06-27T04:45:05.280 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:05.275+0000 7fd804c22700 1 -- 172.21.15.31:0/169652930 wait complete. 2020-06-27T04:45:05.927 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph osd pool get .rgw.root pg_num 2020-06-27T04:45:06.077 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:06.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:06 smithi051 bash[18409]: cluster 2020-06-27T04:45:05.137207+0000 mgr.x (mgr.34109) 135 : cluster [DBG] pgmap v129: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:06.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:06 smithi051 bash[18409]: audit 2020-06-27T04:45:05.274986+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.31:0/169652930' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2020-06-27T04:45:06.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:06 smithi031 bash[18426]: cluster 2020-06-27T04:45:05.137207+0000 mgr.x (mgr.34109) 135 : cluster [DBG] pgmap v129: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:06.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:06 smithi031 bash[18426]: audit 2020-06-27T04:45:05.274986+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.31:0/169652930' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2020-06-27T04:45:06.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:06 smithi031 bash[22603]: cluster 2020-06-27T04:45:05.137207+0000 mgr.x (mgr.34109) 135 : cluster [DBG] pgmap v129: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:06.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:06 smithi031 bash[22603]: audit 2020-06-27T04:45:05.274986+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.31:0/169652930' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2020-06-27T04:45:07.223 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:06 smithi031 bash[34672]: level=info ts=2020-06-27T04:45:06.955Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000066604s 2020-06-27T04:45:07.863 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.859+0000 7f6db94ad700 1 Processor -- start 2020-06-27T04:45:07.864 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.859+0000 7f6db94ad700 1 -- start start 2020-06-27T04:45:07.864 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.859+0000 7f6db94ad700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db40678b0 0x7f6db4073190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:07.864 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.859+0000 7f6db94ad700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f6db406be30 0x7f6db40787f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:07.864 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.859+0000 7f6db94ad700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db4073880 0x7f6db4120ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:07.865 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.859+0000 7f6db94ad700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db4121190 con 0x7f6db4073880 2020-06-27T04:45:07.865 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.859+0000 7f6db94ad700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db41212d0 con 0x7f6db406be30 2020-06-27T04:45:07.865 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.859+0000 7f6db94ad700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db4121410 con 0x7f6db40678b0 2020-06-27T04:45:07.865 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.859+0000 7f6db37fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db40678b0 0x7f6db4073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:07.865 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.859+0000 7f6db3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db4073880 0x7f6db4120ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:07.866 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.859+0000 7f6db37fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db40678b0 0x7f6db4073190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35674/0 (socket says 172.21.15.31:35674) 2020-06-27T04:45:07.866 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.859+0000 7f6db37fe700 1 -- 172.21.15.31:0/4151011053 learned_addr learned my addr 172.21.15.31:0/4151011053 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:07.866 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.859+0000 7f6db2ffd700 1 --2- 172.21.15.31:0/4151011053 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f6db406be30 0x7f6db40787f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:07.866 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.860+0000 7f6db3fff700 1 -- 172.21.15.31:0/4151011053 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db40678b0 msgr2=0x7f6db4073190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:07.867 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.860+0000 7f6db3fff700 1 --2- 172.21.15.31:0/4151011053 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db40678b0 0x7f6db4073190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:07.867 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.860+0000 7f6db3fff700 1 -- 172.21.15.31:0/4151011053 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f6db406be30 msgr2=0x7f6db40787f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:07.867 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.860+0000 7f6db3fff700 1 --2- 172.21.15.31:0/4151011053 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f6db406be30 0x7f6db40787f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:07.867 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.860+0000 7f6db3fff700 1 -- 172.21.15.31:0/4151011053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db41215d0 con 0x7f6db4073880 2020-06-27T04:45:07.867 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.860+0000 7f6db37fe700 1 --2- 172.21.15.31:0/4151011053 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db40678b0 0x7f6db4073190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:45:07.867 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.860+0000 7f6db2ffd700 1 --2- 172.21.15.31:0/4151011053 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f6db406be30 0x7f6db40787f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:45:07.868 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.860+0000 7f6db3fff700 1 --2- 172.21.15.31:0/4151011053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db4073880 0x7f6db4120ca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f6dac00c000 tx=0x7f6dac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:07.868 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.860+0000 7f6dab7fe700 1 -- 172.21.15.31:0/4151011053 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6dac0092e0 con 0x7f6db4073880 2020-06-27T04:45:07.868 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.860+0000 7f6db94ad700 1 -- 172.21.15.31:0/4151011053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db4121820 con 0x7f6db4073880 2020-06-27T04:45:07.868 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.860+0000 7f6dab7fe700 1 -- 172.21.15.31:0/4151011053 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f6dac00f040 con 0x7f6db4073880 2020-06-27T04:45:07.868 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.860+0000 7f6dab7fe700 1 -- 172.21.15.31:0/4151011053 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6dac007b20 con 0x7f6db4073880 2020-06-27T04:45:07.869 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.860+0000 7f6db94ad700 1 -- 172.21.15.31:0/4151011053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db4121d90 con 0x7f6db4073880 2020-06-27T04:45:07.870 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.861+0000 7f6dab7fe700 1 -- 172.21.15.31:0/4151011053 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f6dac007c80 con 0x7f6db4073880 2020-06-27T04:45:07.870 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.861+0000 7f6dab7fe700 1 --2- 172.21.15.31:0/4151011053 >> v2:172.21.15.51:6800/950992045 conn(0x7f6d8c02ab00 0x7f6d8c02cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:07.870 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.861+0000 7f6dab7fe700 1 -- 172.21.15.31:0/4151011053 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5778+0+0 (secure 0 0 0) 0x7f6dac03ac70 con 0x7f6db4073880 2020-06-27T04:45:07.871 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.861+0000 7f6db94ad700 1 -- 172.21.15.31:0/4151011053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db405e210 con 0x7f6db4073880 2020-06-27T04:45:07.871 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.861+0000 7f6db37fe700 1 --2- 172.21.15.31:0/4151011053 >> v2:172.21.15.51:6800/950992045 conn(0x7f6d8c02ab00 0x7f6d8c02cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:07.871 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.862+0000 7f6db37fe700 1 --2- 172.21.15.31:0/4151011053 >> v2:172.21.15.51:6800/950992045 conn(0x7f6d8c02ab00 0x7f6d8c02cfc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6d9c00b000 tx=0x7f6d9c00b040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:07.871 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:07.865+0000 7f6dab7fe700 1 -- 172.21.15.31:0/4151011053 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f6dac012540 con 0x7f6db4073880 2020-06-27T04:45:08.022 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:08.018+0000 7f6db94ad700 1 -- 172.21.15.31:0/4151011053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"} v 0) v1 -- 0x7f6db4121fa0 con 0x7f6db4073880 2020-06-27T04:45:08.022 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:08.018+0000 7f6dab7fe700 1 -- 172.21.15.31:0/4151011053 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]=0 v57) v1 ==== 98+0+11 (secure 0 0 0) 0x7f6dac012360 con 0x7f6db4073880 2020-06-27T04:45:08.022 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2020-06-27T04:45:08.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:08.020+0000 7f6db94ad700 1 -- 172.21.15.31:0/4151011053 >> v2:172.21.15.51:6800/950992045 conn(0x7f6d8c02ab00 msgr2=0x7f6d8c02cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:08.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:08.020+0000 7f6db94ad700 1 --2- 172.21.15.31:0/4151011053 >> v2:172.21.15.51:6800/950992045 conn(0x7f6d8c02ab00 0x7f6d8c02cfc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6d9c00b000 tx=0x7f6d9c00b040).stop 2020-06-27T04:45:08.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:08.020+0000 7f6db94ad700 1 -- 172.21.15.31:0/4151011053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db4073880 msgr2=0x7f6db4120ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:08.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:08.020+0000 7f6db94ad700 1 --2- 172.21.15.31:0/4151011053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db4073880 0x7f6db4120ca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f6dac00c000 tx=0x7f6dac00b040).stop 2020-06-27T04:45:08.025 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:08.020+0000 7f6db94ad700 1 -- 172.21.15.31:0/4151011053 shutdown_connections 2020-06-27T04:45:08.025 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:08.020+0000 7f6db94ad700 1 --2- 172.21.15.31:0/4151011053 >> v2:172.21.15.51:6800/950992045 conn(0x7f6d8c02ab00 0x7f6d8c02cfc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:08.025 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:08.020+0000 7f6db94ad700 1 --2- 172.21.15.31:0/4151011053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db4073880 0x7f6db4120ca0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:08.026 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:08.020+0000 7f6db94ad700 1 --2- 172.21.15.31:0/4151011053 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db40678b0 0x7f6db4073190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:08.026 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:08.020+0000 7f6db94ad700 1 --2- 172.21.15.31:0/4151011053 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f6db406be30 0x7f6db40787f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:08.026 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:08.020+0000 7f6db94ad700 1 -- 172.21.15.31:0/4151011053 >> 172.21.15.31:0/4151011053 conn(0x7f6db4061830 msgr2=0x7f6db4063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:08.027 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:08.020+0000 7f6db94ad700 1 -- 172.21.15.31:0/4151011053 shutdown_connections 2020-06-27T04:45:08.027 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:08.020+0000 7f6db94ad700 1 -- 172.21.15.31:0/4151011053 wait complete. 2020-06-27T04:45:08.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:08 smithi051 bash[18409]: cluster 2020-06-27T04:45:07.137708+0000 mgr.x (mgr.34109) 136 : cluster [DBG] pgmap v130: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:08.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:08 smithi051 bash[18409]: audit 2020-06-27T04:45:08.019994+0000 mon.a (mon.0) 486 : audit [DBG] from='client.? 172.21.15.31:0/4151011053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2020-06-27T04:45:08.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:08 smithi031 bash[18426]: cluster 2020-06-27T04:45:07.137708+0000 mgr.x (mgr.34109) 136 : cluster [DBG] pgmap v130: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:08.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:08 smithi031 bash[18426]: audit 2020-06-27T04:45:08.019994+0000 mon.a (mon.0) 486 : audit [DBG] from='client.? 172.21.15.31:0/4151011053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2020-06-27T04:45:08.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:08 smithi031 bash[22603]: cluster 2020-06-27T04:45:07.137708+0000 mgr.x (mgr.34109) 136 : cluster [DBG] pgmap v130: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:08.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:08 smithi031 bash[22603]: audit 2020-06-27T04:45:08.019994+0000 mon.a (mon.0) 486 : audit [DBG] from='client.? 172.21.15.31:0/4151011053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2020-06-27T04:45:08.659 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph osd pool get zone.rgw.log pg_num 2020-06-27T04:45:08.806 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:10.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:10 smithi051 bash[18409]: cluster 2020-06-27T04:45:09.138325+0000 mgr.x (mgr.34109) 137 : cluster [DBG] pgmap v131: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:10.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:10 smithi031 bash[18426]: cluster 2020-06-27T04:45:09.138325+0000 mgr.x (mgr.34109) 137 : cluster [DBG] pgmap v131: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:10.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:10 smithi031 bash[22603]: cluster 2020-06-27T04:45:09.138325+0000 mgr.x (mgr.34109) 137 : cluster [DBG] pgmap v131: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.539+0000 7ff21389e700 1 Processor -- start 2020-06-27T04:45:10.546 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.539+0000 7ff21389e700 1 -- start start 2020-06-27T04:45:10.546 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff21389e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c0678b0 0x7ff20c0742f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:10.546 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff21389e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c06be30 0x7ff20c0749e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:10.547 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff21389e700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7ff20c0778f0 0x7ff20c077d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:10.547 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff21389e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0783c0 con 0x7ff20c06be30 2020-06-27T04:45:10.547 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff21389e700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c078530 con 0x7ff20c0778f0 2020-06-27T04:45:10.548 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff21389e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0786f0 con 0x7ff20c0678b0 2020-06-27T04:45:10.548 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff21163a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c06be30 0x7ff20c0749e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:10.548 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff211e3b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c0678b0 0x7ff20c0742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:10.549 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff21163a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c06be30 0x7ff20c0749e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39440/0 (socket says 172.21.15.31:39440) 2020-06-27T04:45:10.549 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff21163a700 1 -- 172.21.15.31:0/1834050125 learned_addr learned my addr 172.21.15.31:0/1834050125 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:10.549 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff211e3b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c0678b0 0x7ff20c0742f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35686/0 (socket says 172.21.15.31:35686) 2020-06-27T04:45:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff21263c700 1 --2- 172.21.15.31:0/1834050125 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7ff20c0778f0 0x7ff20c077d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff21163a700 1 -- 172.21.15.31:0/1834050125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c0678b0 msgr2=0x7ff20c0742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff21163a700 1 --2- 172.21.15.31:0/1834050125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c0678b0 0x7ff20c0742f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:10.551 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff21163a700 1 -- 172.21.15.31:0/1834050125 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7ff20c0778f0 msgr2=0x7ff20c077d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:10.551 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff21163a700 1 --2- 172.21.15.31:0/1834050125 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7ff20c0778f0 0x7ff20c077d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:10.551 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff21163a700 1 -- 172.21.15.31:0/1834050125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c0788b0 con 0x7ff20c06be30 2020-06-27T04:45:10.552 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff21163a700 1 --2- 172.21.15.31:0/1834050125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c06be30 0x7ff20c0749e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7ff1fc002f70 tx=0x7ff1fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:10.552 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff201ffb700 1 -- 172.21.15.31:0/1834050125 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1fc00e030 con 0x7ff20c06be30 2020-06-27T04:45:10.552 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff201ffb700 1 -- 172.21.15.31:0/1834050125 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7ff1fc013cb0 con 0x7ff20c06be30 2020-06-27T04:45:10.552 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff21389e700 1 -- 172.21.15.31:0/1834050125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20c078b00 con 0x7ff20c06be30 2020-06-27T04:45:10.553 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.540+0000 7ff201ffb700 1 -- 172.21.15.31:0/1834050125 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1fc018070 con 0x7ff20c06be30 2020-06-27T04:45:10.553 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.541+0000 7ff21389e700 1 -- 172.21.15.31:0/1834050125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20c06c480 con 0x7ff20c06be30 2020-06-27T04:45:10.554 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.541+0000 7ff201ffb700 1 -- 172.21.15.31:0/1834050125 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7ff1fc01db30 con 0x7ff20c06be30 2020-06-27T04:45:10.555 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.541+0000 7ff201ffb700 1 --2- 172.21.15.31:0/1834050125 >> v2:172.21.15.51:6800/950992045 conn(0x7ff1e802ab00 0x7ff1e802cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:10.555 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.541+0000 7ff201ffb700 1 -- 172.21.15.31:0/1834050125 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5778+0+0 (secure 0 0 0) 0x7ff1fc03c970 con 0x7ff20c06be30 2020-06-27T04:45:10.555 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.542+0000 7ff21389e700 1 -- 172.21.15.31:0/1834050125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20c05e210 con 0x7ff20c06be30 2020-06-27T04:45:10.556 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.542+0000 7ff211e3b700 1 --2- 172.21.15.31:0/1834050125 >> v2:172.21.15.51:6800/950992045 conn(0x7ff1e802ab00 0x7ff1e802cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:10.556 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.542+0000 7ff211e3b700 1 --2- 172.21.15.31:0/1834050125 >> v2:172.21.15.51:6800/950992045 conn(0x7ff1e802ab00 0x7ff1e802cfc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7ff20800f000 tx=0x7ff208007d40).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:10.557 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.545+0000 7ff201ffb700 1 -- 172.21.15.31:0/1834050125 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7ff1fc011370 con 0x7ff20c06be30 2020-06-27T04:45:10.703 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.700+0000 7ff21389e700 1 -- 172.21.15.31:0/1834050125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"} v 0) v1 -- 0x7ff20c06c6f0 con 0x7ff20c06be30 2020-06-27T04:45:10.703 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.700+0000 7ff201ffb700 1 -- 172.21.15.31:0/1834050125 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]=0 v57) v1 ==== 101+0+11 (secure 0 0 0) 0x7ff1fc025390 con 0x7ff20c06be30 2020-06-27T04:45:10.704 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2020-06-27T04:45:10.705 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.701+0000 7ff21389e700 1 -- 172.21.15.31:0/1834050125 >> v2:172.21.15.51:6800/950992045 conn(0x7ff1e802ab00 msgr2=0x7ff1e802cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:10.705 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.701+0000 7ff21389e700 1 --2- 172.21.15.31:0/1834050125 >> v2:172.21.15.51:6800/950992045 conn(0x7ff1e802ab00 0x7ff1e802cfc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7ff20800f000 tx=0x7ff208007d40).stop 2020-06-27T04:45:10.705 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.701+0000 7ff21389e700 1 -- 172.21.15.31:0/1834050125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c06be30 msgr2=0x7ff20c0749e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:10.705 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.701+0000 7ff21389e700 1 --2- 172.21.15.31:0/1834050125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c06be30 0x7ff20c0749e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7ff1fc002f70 tx=0x7ff1fc009b30).stop 2020-06-27T04:45:10.705 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.701+0000 7ff21389e700 1 -- 172.21.15.31:0/1834050125 shutdown_connections 2020-06-27T04:45:10.706 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.701+0000 7ff21389e700 1 --2- 172.21.15.31:0/1834050125 >> v2:172.21.15.51:6800/950992045 conn(0x7ff1e802ab00 0x7ff1e802cfc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:10.706 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.701+0000 7ff21389e700 1 --2- 172.21.15.31:0/1834050125 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7ff20c0778f0 0x7ff20c077d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:10.706 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.701+0000 7ff21389e700 1 --2- 172.21.15.31:0/1834050125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c0678b0 0x7ff20c0742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:10.706 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.701+0000 7ff21389e700 1 --2- 172.21.15.31:0/1834050125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c06be30 0x7ff20c0749e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:10.706 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.701+0000 7ff21389e700 1 -- 172.21.15.31:0/1834050125 >> 172.21.15.31:0/1834050125 conn(0x7ff20c061830 msgr2=0x7ff20c063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:10.707 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.701+0000 7ff21389e700 1 -- 172.21.15.31:0/1834050125 shutdown_connections 2020-06-27T04:45:10.707 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:10.701+0000 7ff21389e700 1 -- 172.21.15.31:0/1834050125 wait complete. 2020-06-27T04:45:11.276 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph osd pool get zone.rgw.control pg_num 2020-06-27T04:45:11.426 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:11.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:11 smithi051 bash[18409]: audit 2020-06-27T04:45:10.701467+0000 mon.a (mon.0) 487 : audit [DBG] from='client.? 172.21.15.31:0/1834050125' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]: dispatch 2020-06-27T04:45:11.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:11 smithi031 bash[18426]: audit 2020-06-27T04:45:10.701467+0000 mon.a (mon.0) 487 : audit [DBG] from='client.? 172.21.15.31:0/1834050125' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]: dispatch 2020-06-27T04:45:11.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:11 smithi031 bash[22603]: audit 2020-06-27T04:45:10.701467+0000 mon.a (mon.0) 487 : audit [DBG] from='client.? 172.21.15.31:0/1834050125' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]: dispatch 2020-06-27T04:45:12.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:12 smithi051 bash[18409]: cluster 2020-06-27T04:45:11.138806+0000 mgr.x (mgr.34109) 138 : cluster [DBG] pgmap v132: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:12.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:12 smithi031 bash[18426]: cluster 2020-06-27T04:45:11.138806+0000 mgr.x (mgr.34109) 138 : cluster [DBG] pgmap v132: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:12.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:12 smithi031 bash[22603]: cluster 2020-06-27T04:45:11.138806+0000 mgr.x (mgr.34109) 138 : cluster [DBG] pgmap v132: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:13.218 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.213+0000 7f4c2cdc0700 1 Processor -- start 2020-06-27T04:45:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.213+0000 7f4c2cdc0700 1 -- start start 2020-06-27T04:45:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.213+0000 7f4c2cdc0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c28066360 0x7f4c28073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.213+0000 7f4c2cdc0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c280678b0 0x7f4c28073850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.213+0000 7f4c2cdc0700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f4c28078770 0x7f4c280fec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:13.220 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.213+0000 7f4c2cdc0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c28078d50 con 0x7f4c280678b0 2020-06-27T04:45:13.220 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.213+0000 7f4c2cdc0700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280ff180 con 0x7f4c28078770 2020-06-27T04:45:13.220 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.213+0000 7f4c2cdc0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280ff340 con 0x7f4c28066360 2020-06-27T04:45:13.220 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.213+0000 7f4c2659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c280678b0 0x7f4c28073850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:13.220 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.213+0000 7f4c26d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c28066360 0x7f4c28073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:13.221 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.213+0000 7f4c26d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c28066360 0x7f4c28073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35698/0 (socket says 172.21.15.31:35698) 2020-06-27T04:45:13.221 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.213+0000 7f4c2659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c280678b0 0x7f4c28073850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39452/0 (socket says 172.21.15.31:39452) 2020-06-27T04:45:13.221 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.213+0000 7f4c26d9d700 1 -- 172.21.15.31:0/3701002933 learned_addr learned my addr 172.21.15.31:0/3701002933 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:13.221 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.213+0000 7f4c2759e700 1 --2- 172.21.15.31:0/3701002933 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f4c28078770 0x7f4c280fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:13.221 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.214+0000 7f4c2659c700 1 -- 172.21.15.31:0/3701002933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c28066360 msgr2=0x7f4c28073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:13.222 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.214+0000 7f4c2659c700 1 --2- 172.21.15.31:0/3701002933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c28066360 0x7f4c28073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:13.222 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.214+0000 7f4c2659c700 1 -- 172.21.15.31:0/3701002933 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f4c28078770 msgr2=0x7f4c280fec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:13.222 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.214+0000 7f4c2659c700 1 --2- 172.21.15.31:0/3701002933 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f4c28078770 0x7f4c280fec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:13.222 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.214+0000 7f4c2659c700 1 -- 172.21.15.31:0/3701002933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c280ff500 con 0x7f4c280678b0 2020-06-27T04:45:13.223 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.214+0000 7f4c26d9d700 1 --2- 172.21.15.31:0/3701002933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c28066360 0x7f4c28073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:45:13.223 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.214+0000 7f4c2659c700 1 --2- 172.21.15.31:0/3701002933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c280678b0 0x7f4c28073850 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f4c1c00c000 tx=0x7f4c1c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:13.223 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.214+0000 7f4c16ffd700 1 -- 172.21.15.31:0/3701002933 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c1c0094d0 con 0x7f4c280678b0 2020-06-27T04:45:13.223 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.214+0000 7f4c2cdc0700 1 -- 172.21.15.31:0/3701002933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c280ff750 con 0x7f4c280678b0 2020-06-27T04:45:13.223 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.214+0000 7f4c16ffd700 1 -- 172.21.15.31:0/3701002933 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f4c1c00f040 con 0x7f4c280678b0 2020-06-27T04:45:13.224 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.214+0000 7f4c16ffd700 1 -- 172.21.15.31:0/3701002933 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c1c00cb90 con 0x7f4c280678b0 2020-06-27T04:45:13.224 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.214+0000 7f4c2cdc0700 1 -- 172.21.15.31:0/3701002933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c280ffcc0 con 0x7f4c280678b0 2020-06-27T04:45:13.224 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.215+0000 7f4c16ffd700 1 -- 172.21.15.31:0/3701002933 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f4c1c014460 con 0x7f4c280678b0 2020-06-27T04:45:13.224 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.215+0000 7f4c16ffd700 1 --2- 172.21.15.31:0/3701002933 >> v2:172.21.15.51:6800/950992045 conn(0x7f4c0802ab00 0x7f4c0802cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:13.224 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.215+0000 7f4c16ffd700 1 -- 172.21.15.31:0/3701002933 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5778+0+0 (secure 0 0 0) 0x7f4c1c03acd0 con 0x7f4c280678b0 2020-06-27T04:45:13.225 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.215+0000 7f4c2cdc0700 1 -- 172.21.15.31:0/3701002933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2805e210 con 0x7f4c280678b0 2020-06-27T04:45:13.225 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.215+0000 7f4c26d9d700 1 --2- 172.21.15.31:0/3701002933 >> v2:172.21.15.51:6800/950992045 conn(0x7f4c0802ab00 0x7f4c0802cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:13.225 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.215+0000 7f4c26d9d700 1 --2- 172.21.15.31:0/3701002933 >> v2:172.21.15.51:6800/950992045 conn(0x7f4c0802ab00 0x7f4c0802cfc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f4c1800b000 tx=0x7f4c1800b040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:13.226 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.219+0000 7f4c16ffd700 1 -- 172.21.15.31:0/3701002933 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f4c1c01e440 con 0x7f4c280678b0 2020-06-27T04:45:13.383 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.370+0000 7f4c2cdc0700 1 -- 172.21.15.31:0/3701002933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"} v 0) v1 -- 0x7f4c280262b0 con 0x7f4c280678b0 2020-06-27T04:45:13.383 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.370+0000 7f4c16ffd700 1 -- 172.21.15.31:0/3701002933 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]=0 v57) v1 ==== 105+0+11 (secure 0 0 0) 0x7f4c1c019020 con 0x7f4c280678b0 2020-06-27T04:45:13.383 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.371+0000 7f4c2cdc0700 1 -- 172.21.15.31:0/3701002933 >> v2:172.21.15.51:6800/950992045 conn(0x7f4c0802ab00 msgr2=0x7f4c0802cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:13.383 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.371+0000 7f4c2cdc0700 1 --2- 172.21.15.31:0/3701002933 >> v2:172.21.15.51:6800/950992045 conn(0x7f4c0802ab00 0x7f4c0802cfc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f4c1800b000 tx=0x7f4c1800b040).stop 2020-06-27T04:45:13.384 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.371+0000 7f4c2cdc0700 1 -- 172.21.15.31:0/3701002933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c280678b0 msgr2=0x7f4c28073850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:13.384 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.371+0000 7f4c2cdc0700 1 --2- 172.21.15.31:0/3701002933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c280678b0 0x7f4c28073850 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f4c1c00c000 tx=0x7f4c1c00b040).stop 2020-06-27T04:45:13.384 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.371+0000 7f4c2cdc0700 1 -- 172.21.15.31:0/3701002933 shutdown_connections 2020-06-27T04:45:13.384 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.372+0000 7f4c2cdc0700 1 --2- 172.21.15.31:0/3701002933 >> v2:172.21.15.51:6800/950992045 conn(0x7f4c0802ab00 0x7f4c0802cfc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:13.385 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.372+0000 7f4c2cdc0700 1 --2- 172.21.15.31:0/3701002933 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f4c28078770 0x7f4c280fec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:13.385 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.372+0000 7f4c2cdc0700 1 --2- 172.21.15.31:0/3701002933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c28066360 0x7f4c28073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:13.385 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.372+0000 7f4c2cdc0700 1 --2- 172.21.15.31:0/3701002933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c280678b0 0x7f4c28073850 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:13.385 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.372+0000 7f4c2cdc0700 1 -- 172.21.15.31:0/3701002933 >> 172.21.15.31:0/3701002933 conn(0x7f4c28061830 msgr2=0x7f4c28062fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:13.385 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.372+0000 7f4c2cdc0700 1 -- 172.21.15.31:0/3701002933 shutdown_connections 2020-06-27T04:45:13.386 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:13.372+0000 7f4c2cdc0700 1 -- 172.21.15.31:0/3701002933 wait complete. 2020-06-27T04:45:13.390 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2020-06-27T04:45:13.943 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph osd pool get zone.rgw.meta pg_num 2020-06-27T04:45:14.090 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:14.461 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:14 smithi031 bash[18426]: cluster 2020-06-27T04:45:13.139253+0000 mgr.x (mgr.34109) 139 : cluster [DBG] pgmap v133: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:14.462 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:14 smithi031 bash[18426]: audit 2020-06-27T04:45:13.371742+0000 mon.a (mon.0) 488 : audit [DBG] from='client.? 172.21.15.31:0/3701002933' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]: dispatch 2020-06-27T04:45:14.462 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:14 smithi031 bash[22603]: cluster 2020-06-27T04:45:13.139253+0000 mgr.x (mgr.34109) 139 : cluster [DBG] pgmap v133: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:14.462 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:14 smithi031 bash[22603]: audit 2020-06-27T04:45:13.371742+0000 mon.a (mon.0) 488 : audit [DBG] from='client.? 172.21.15.31:0/3701002933' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]: dispatch 2020-06-27T04:45:14.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:14 smithi051 bash[18409]: cluster 2020-06-27T04:45:13.139253+0000 mgr.x (mgr.34109) 139 : cluster [DBG] pgmap v133: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:14.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:14 smithi051 bash[18409]: audit 2020-06-27T04:45:13.371742+0000 mon.a (mon.0) 488 : audit [DBG] from='client.? 172.21.15.31:0/3701002933' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]: dispatch 2020-06-27T04:45:15.223 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:14 smithi031 bash[34672]: level=info ts=2020-06-27T04:45:14.956Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000906767s 2020-06-27T04:45:15.740 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe7802de700 1 Processor -- start 2020-06-27T04:45:15.740 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe7802de700 1 -- start start 2020-06-27T04:45:15.741 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe7802de700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fe778066360 0x7fe77806cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:15.741 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe7802de700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe77806be30 0x7fe778078330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:15.741 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe7802de700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe778078960 0x7fe778122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:15.741 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe7802de700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7781232b0 con 0x7fe77806be30 2020-06-27T04:45:15.741 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe7802de700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe778123420 con 0x7fe778066360 2020-06-27T04:45:15.742 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe7802de700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7781235e0 con 0x7fe778078960 2020-06-27T04:45:15.742 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe77e07a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe77806be30 0x7fe778078330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:15.742 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe77f07c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe778078960 0x7fe778122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:15.742 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe77e07a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe77806be30 0x7fe778078330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39464/0 (socket says 172.21.15.31:39464) 2020-06-27T04:45:15.742 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe77e07a700 1 -- 172.21.15.31:0/1726578600 learned_addr learned my addr 172.21.15.31:0/1726578600 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:15.743 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe77e87b700 1 --2- 172.21.15.31:0/1726578600 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fe778066360 0x7fe77806cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:15.743 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe77e07a700 1 -- 172.21.15.31:0/1726578600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe778078960 msgr2=0x7fe778122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:15.743 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe77e07a700 1 --2- 172.21.15.31:0/1726578600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe778078960 0x7fe778122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:15.743 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe77e07a700 1 -- 172.21.15.31:0/1726578600 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fe778066360 msgr2=0x7fe77806cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:15.744 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe77e07a700 1 --2- 172.21.15.31:0/1726578600 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fe778066360 0x7fe77806cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:15.744 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe77e07a700 1 -- 172.21.15.31:0/1726578600 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7781237a0 con 0x7fe77806be30 2020-06-27T04:45:15.744 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe77f07c700 1 --2- 172.21.15.31:0/1726578600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe778078960 0x7fe778122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:45:15.744 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.736+0000 7fe77e07a700 1 --2- 172.21.15.31:0/1726578600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe77806be30 0x7fe778078330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fe76800c000 tx=0x7fe76800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:15.744 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.737+0000 7fe776ffd700 1 -- 172.21.15.31:0/1726578600 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7680094d0 con 0x7fe77806be30 2020-06-27T04:45:15.745 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.737+0000 7fe7802de700 1 -- 172.21.15.31:0/1726578600 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe778073f10 con 0x7fe77806be30 2020-06-27T04:45:15.745 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.737+0000 7fe776ffd700 1 -- 172.21.15.31:0/1726578600 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fe76800f040 con 0x7fe77806be30 2020-06-27T04:45:15.745 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.737+0000 7fe776ffd700 1 -- 172.21.15.31:0/1726578600 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe768007e80 con 0x7fe77806be30 2020-06-27T04:45:15.745 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.737+0000 7fe7802de700 1 -- 172.21.15.31:0/1726578600 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe778074480 con 0x7fe77806be30 2020-06-27T04:45:15.746 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.737+0000 7fe776ffd700 1 -- 172.21.15.31:0/1726578600 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7fe768013650 con 0x7fe77806be30 2020-06-27T04:45:15.747 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.737+0000 7fe776ffd700 1 --2- 172.21.15.31:0/1726578600 >> v2:172.21.15.51:6800/950992045 conn(0x7fe75002aab0 0x7fe75002cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:15.747 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.738+0000 7fe776ffd700 1 -- 172.21.15.31:0/1726578600 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5778+0+0 (secure 0 0 0) 0x7fe76803f060 con 0x7fe77806be30 2020-06-27T04:45:15.747 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.738+0000 7fe7802de700 1 -- 172.21.15.31:0/1726578600 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77805e210 con 0x7fe77806be30 2020-06-27T04:45:15.747 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.738+0000 7fe77e87b700 1 --2- 172.21.15.31:0/1726578600 >> v2:172.21.15.51:6800/950992045 conn(0x7fe75002aab0 0x7fe75002cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:15.747 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.738+0000 7fe77e87b700 1 --2- 172.21.15.31:0/1726578600 >> v2:172.21.15.51:6800/950992045 conn(0x7fe75002aab0 0x7fe75002cf70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fe760016000 tx=0x7fe760009b30).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:15.748 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.741+0000 7fe776ffd700 1 -- 172.21.15.31:0/1726578600 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fe76801c420 con 0x7fe77806be30 2020-06-27T04:45:15.897 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.894+0000 7fe7802de700 1 -- 172.21.15.31:0/1726578600 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"} v 0) v1 -- 0x7fe7780746f0 con 0x7fe77806be30 2020-06-27T04:45:15.898 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.894+0000 7fe776ffd700 1 -- 172.21.15.31:0/1726578600 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]=0 v57) v1 ==== 102+0+11 (secure 0 0 0) 0x7fe76801bcb0 con 0x7fe77806be30 2020-06-27T04:45:15.898 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2020-06-27T04:45:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.895+0000 7fe7802de700 1 -- 172.21.15.31:0/1726578600 >> v2:172.21.15.51:6800/950992045 conn(0x7fe75002aab0 msgr2=0x7fe75002cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.895+0000 7fe7802de700 1 --2- 172.21.15.31:0/1726578600 >> v2:172.21.15.51:6800/950992045 conn(0x7fe75002aab0 0x7fe75002cf70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fe760016000 tx=0x7fe760009b30).stop 2020-06-27T04:45:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.895+0000 7fe7802de700 1 -- 172.21.15.31:0/1726578600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe77806be30 msgr2=0x7fe778078330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.895+0000 7fe7802de700 1 --2- 172.21.15.31:0/1726578600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe77806be30 0x7fe778078330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fe76800c000 tx=0x7fe76800b040).stop 2020-06-27T04:45:15.900 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.895+0000 7fe7802de700 1 -- 172.21.15.31:0/1726578600 shutdown_connections 2020-06-27T04:45:15.900 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.895+0000 7fe7802de700 1 --2- 172.21.15.31:0/1726578600 >> v2:172.21.15.51:6800/950992045 conn(0x7fe75002aab0 0x7fe75002cf70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:15.900 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.895+0000 7fe7802de700 1 --2- 172.21.15.31:0/1726578600 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fe778066360 0x7fe77806cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:15.900 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.895+0000 7fe7802de700 1 --2- 172.21.15.31:0/1726578600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe778078960 0x7fe778122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:15.900 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.895+0000 7fe7802de700 1 --2- 172.21.15.31:0/1726578600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe77806be30 0x7fe778078330 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:15.901 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.896+0000 7fe7802de700 1 -- 172.21.15.31:0/1726578600 >> 172.21.15.31:0/1726578600 conn(0x7fe778061830 msgr2=0x7fe77806d350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:15.901 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.896+0000 7fe7802de700 1 -- 172.21.15.31:0/1726578600 shutdown_connections 2020-06-27T04:45:15.901 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:15.896+0000 7fe7802de700 1 -- 172.21.15.31:0/1726578600 wait complete. 2020-06-27T04:45:16.387 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:16 smithi051 bash[18409]: cluster 2020-06-27T04:45:15.139721+0000 mgr.x (mgr.34109) 140 : cluster [DBG] pgmap v134: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:16.388 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:16 smithi051 bash[18409]: audit 2020-06-27T04:45:15.895624+0000 mon.a (mon.0) 489 : audit [DBG] from='client.? 172.21.15.31:0/1726578600' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]: dispatch 2020-06-27T04:45:16.470 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:16 smithi031 bash[18426]: cluster 2020-06-27T04:45:15.139721+0000 mgr.x (mgr.34109) 140 : cluster [DBG] pgmap v134: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:16.470 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:16 smithi031 bash[18426]: audit 2020-06-27T04:45:15.895624+0000 mon.a (mon.0) 489 : audit [DBG] from='client.? 172.21.15.31:0/1726578600' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]: dispatch 2020-06-27T04:45:16.470 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:16 smithi031 bash[22603]: cluster 2020-06-27T04:45:15.139721+0000 mgr.x (mgr.34109) 140 : cluster [DBG] pgmap v134: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:16.471 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:16 smithi031 bash[22603]: audit 2020-06-27T04:45:15.895624+0000 mon.a (mon.0) 489 : audit [DBG] from='client.? 172.21.15.31:0/1726578600' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]: dispatch 2020-06-27T04:45:16.485 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-06-27T04:45:16.487 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2020-06-27T04:45:16.487 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph mgr dump --format=json 2020-06-27T04:45:16.631 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:18.246 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.241+0000 7fa7659b2700 1 Processor -- start 2020-06-27T04:45:18.246 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.241+0000 7fa7659b2700 1 -- start start 2020-06-27T04:45:18.247 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa7659b2700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fa760066370 0x7fa76006d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:18.247 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa7659b2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa76006be40 0x7fa7600783a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:18.247 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa7659b2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7600789d0 0x7fa760122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:18.247 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa7659b2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa760123380 con 0x7fa76006be40 2020-06-27T04:45:18.247 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa7659b2700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7601234f0 con 0x7fa760066370 2020-06-27T04:45:18.248 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa7659b2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7601236b0 con 0x7fa7600789d0 2020-06-27T04:45:18.248 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa75ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7600789d0 0x7fa760122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:18.248 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa757fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa76006be40 0x7fa7600783a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:18.248 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa75ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7600789d0 0x7fa760122cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35726/0 (socket says 172.21.15.31:35726) 2020-06-27T04:45:18.248 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa75ffff700 1 -- 172.21.15.31:0/583674152 learned_addr learned my addr 172.21.15.31:0/583674152 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:18.249 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa75f7fe700 1 --2- 172.21.15.31:0/583674152 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fa760066370 0x7fa76006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:18.249 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa75ffff700 1 -- 172.21.15.31:0/583674152 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fa760066370 msgr2=0x7fa76006d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:18.249 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa75ffff700 1 --2- 172.21.15.31:0/583674152 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fa760066370 0x7fa76006d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:18.249 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa75ffff700 1 -- 172.21.15.31:0/583674152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa76006be40 msgr2=0x7fa7600783a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:18.249 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa75ffff700 1 --2- 172.21.15.31:0/583674152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa76006be40 0x7fa7600783a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:18.250 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa75ffff700 1 -- 172.21.15.31:0/583674152 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa760123870 con 0x7fa7600789d0 2020-06-27T04:45:18.250 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa757fff700 1 --2- 172.21.15.31:0/583674152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa76006be40 0x7fa7600783a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:45:18.250 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa75ffff700 1 --2- 172.21.15.31:0/583674152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7600789d0 0x7fa760122cb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa75800c000 tx=0x7fa75800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:18.250 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa7577fe700 1 -- 172.21.15.31:0/583674152 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7580094d0 con 0x7fa7600789d0 2020-06-27T04:45:18.250 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa7659b2700 1 -- 172.21.15.31:0/583674152 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa760123b20 con 0x7fa7600789d0 2020-06-27T04:45:18.250 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa7577fe700 1 -- 172.21.15.31:0/583674152 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fa75800f040 con 0x7fa7600789d0 2020-06-27T04:45:18.251 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa7577fe700 1 -- 172.21.15.31:0/583674152 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa758007d70 con 0x7fa7600789d0 2020-06-27T04:45:18.251 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.242+0000 7fa7659b2700 1 -- 172.21.15.31:0/583674152 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa760124040 con 0x7fa7600789d0 2020-06-27T04:45:18.251 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.243+0000 7fa7577fe700 1 -- 172.21.15.31:0/583674152 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7fa758014460 con 0x7fa7600789d0 2020-06-27T04:45:18.252 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.243+0000 7fa7577fe700 1 --2- 172.21.15.31:0/583674152 >> v2:172.21.15.51:6800/950992045 conn(0x7fa73802ab00 0x7fa73802cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:18.252 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.243+0000 7fa7577fe700 1 -- 172.21.15.31:0/583674152 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5894+0+0 (secure 0 0 0) 0x7fa75803b1a0 con 0x7fa7600789d0 2020-06-27T04:45:18.252 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.243+0000 7fa7659b2700 1 -- 172.21.15.31:0/583674152 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76005e210 con 0x7fa7600789d0 2020-06-27T04:45:18.253 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.243+0000 7fa75f7fe700 1 --2- 172.21.15.31:0/583674152 >> v2:172.21.15.51:6800/950992045 conn(0x7fa73802ab00 0x7fa73802cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:18.253 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.244+0000 7fa75f7fe700 1 --2- 172.21.15.31:0/583674152 >> v2:172.21.15.51:6800/950992045 conn(0x7fa73802ab00 0x7fa73802cfc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fa750014000 tx=0x7fa750009b30).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:18.253 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.247+0000 7fa7577fe700 1 -- 172.21.15.31:0/583674152 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fa758019080 con 0x7fa7600789d0 2020-06-27T04:45:18.444 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.440+0000 7fa7659b2700 1 -- 172.21.15.31:0/583674152 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa760124230 con 0x7fa7600789d0 2020-06-27T04:45:18.445 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.442+0000 7fa7577fe700 1 -- 172.21.15.31:0/583674152 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+63914 (secure 0 0 0) 0x7fa758012be0 con 0x7fa7600789d0 2020-06-27T04:45:18.447 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:45:18.447 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.443+0000 7fa7659b2700 1 -- 172.21.15.31:0/583674152 >> v2:172.21.15.51:6800/950992045 conn(0x7fa73802ab00 msgr2=0x7fa73802cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:18.447 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.443+0000 7fa7659b2700 1 --2- 172.21.15.31:0/583674152 >> v2:172.21.15.51:6800/950992045 conn(0x7fa73802ab00 0x7fa73802cfc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fa750014000 tx=0x7fa750009b30).stop 2020-06-27T04:45:18.448 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.443+0000 7fa7659b2700 1 -- 172.21.15.31:0/583674152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7600789d0 msgr2=0x7fa760122cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:18.448 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.443+0000 7fa7659b2700 1 --2- 172.21.15.31:0/583674152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7600789d0 0x7fa760122cb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa75800c000 tx=0x7fa75800b040).stop 2020-06-27T04:45:18.448 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.443+0000 7fa7659b2700 1 -- 172.21.15.31:0/583674152 shutdown_connections 2020-06-27T04:45:18.448 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.443+0000 7fa7659b2700 1 --2- 172.21.15.31:0/583674152 >> v2:172.21.15.51:6800/950992045 conn(0x7fa73802ab00 0x7fa73802cfc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:18.448 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.443+0000 7fa7659b2700 1 --2- 172.21.15.31:0/583674152 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fa760066370 0x7fa76006d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:18.449 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.443+0000 7fa7659b2700 1 --2- 172.21.15.31:0/583674152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7600789d0 0x7fa760122cb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:18.449 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.443+0000 7fa7659b2700 1 --2- 172.21.15.31:0/583674152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa76006be40 0x7fa7600783a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:18.449 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.443+0000 7fa7659b2700 1 -- 172.21.15.31:0/583674152 >> 172.21.15.31:0/583674152 conn(0x7fa760061840 msgr2=0x7fa76006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:18.449 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.443+0000 7fa7659b2700 1 -- 172.21.15.31:0/583674152 shutdown_connections 2020-06-27T04:45:18.449 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:18.443+0000 7fa7659b2700 1 -- 172.21.15.31:0/583674152 wait complete. 2020-06-27T04:45:18.466 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:18 smithi031 bash[22603]: audit 2020-06-27T04:45:17.130485+0000 mon.b (mon.2) 228 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2020-06-27T04:45:18.466 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:18 smithi031 bash[22603]: audit 2020-06-27T04:45:17.130750+0000 mon.b (mon.2) 229 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2020-06-27T04:45:18.467 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:18 smithi031 bash[22603]: audit 2020-06-27T04:45:17.130876+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2020-06-27T04:45:18.467 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:18 smithi031 bash[22603]: audit 2020-06-27T04:45:17.130932+0000 mon.b (mon.2) 230 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2020-06-27T04:45:18.467 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:18 smithi031 bash[22603]: audit 2020-06-27T04:45:17.131139+0000 mon.b (mon.2) 231 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2020-06-27T04:45:18.467 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:18 smithi031 bash[22603]: audit 2020-06-27T04:45:17.131147+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2020-06-27T04:45:18.467 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:18 smithi031 bash[22603]: audit 2020-06-27T04:45:17.131337+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2020-06-27T04:45:18.468 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:18 smithi031 bash[22603]: audit 2020-06-27T04:45:17.131509+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2020-06-27T04:45:18.468 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:18 smithi031 bash[22603]: cluster 2020-06-27T04:45:17.140223+0000 mgr.x (mgr.34109) 141 : cluster [DBG] pgmap v135: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:18.468 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:18 smithi031 bash[18426]: audit 2020-06-27T04:45:17.130485+0000 mon.b (mon.2) 228 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2020-06-27T04:45:18.468 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:18 smithi031 bash[18426]: audit 2020-06-27T04:45:17.130750+0000 mon.b (mon.2) 229 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2020-06-27T04:45:18.469 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:18 smithi031 bash[18426]: audit 2020-06-27T04:45:17.130876+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2020-06-27T04:45:18.469 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:18 smithi031 bash[18426]: audit 2020-06-27T04:45:17.130932+0000 mon.b (mon.2) 230 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2020-06-27T04:45:18.469 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:18 smithi031 bash[18426]: audit 2020-06-27T04:45:17.131139+0000 mon.b (mon.2) 231 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2020-06-27T04:45:18.469 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:18 smithi031 bash[18426]: audit 2020-06-27T04:45:17.131147+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2020-06-27T04:45:18.469 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:18 smithi031 bash[18426]: audit 2020-06-27T04:45:17.131337+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2020-06-27T04:45:18.469 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:18 smithi031 bash[18426]: audit 2020-06-27T04:45:17.131509+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2020-06-27T04:45:18.470 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:18 smithi031 bash[18426]: cluster 2020-06-27T04:45:17.140223+0000 mgr.x (mgr.34109) 141 : cluster [DBG] pgmap v135: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:18.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:18 smithi051 bash[18409]: audit 2020-06-27T04:45:17.130485+0000 mon.b (mon.2) 228 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2020-06-27T04:45:18.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:18 smithi051 bash[18409]: audit 2020-06-27T04:45:17.130750+0000 mon.b (mon.2) 229 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2020-06-27T04:45:18.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:18 smithi051 bash[18409]: audit 2020-06-27T04:45:17.130876+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2020-06-27T04:45:18.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:18 smithi051 bash[18409]: audit 2020-06-27T04:45:17.130932+0000 mon.b (mon.2) 230 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2020-06-27T04:45:18.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:18 smithi051 bash[18409]: audit 2020-06-27T04:45:17.131139+0000 mon.b (mon.2) 231 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2020-06-27T04:45:18.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:18 smithi051 bash[18409]: audit 2020-06-27T04:45:17.131147+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2020-06-27T04:45:18.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:18 smithi051 bash[18409]: audit 2020-06-27T04:45:17.131337+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2020-06-27T04:45:18.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:18 smithi051 bash[18409]: audit 2020-06-27T04:45:17.131509+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2020-06-27T04:45:18.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:18 smithi051 bash[18409]: cluster 2020-06-27T04:45:17.140223+0000 mgr.x (mgr.34109) 141 : cluster [DBG] pgmap v135: 129 pgs: 129 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:19.035 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"active_gid":34109,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6800","nonce":950992045}]},"active_addr":"172.21.15.51:6800/950992045","active_change":"2020-06-27T04:42:17.091366+0000","active_mgr_features":4540138292837744639,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi051:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":7,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.51:0","nonce":3833867882}]},{"addrvec":[{"type":"v2","addr":"172.21.15.51:0","nonce":3288264026}]},{"addrvec":[{"type":"v2","addr":"172.21.15.51:0","nonce":272670632}]}]}} 2020-06-27T04:45:19.038 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2020-06-27T04:45:19.039 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2020-06-27T04:45:19.039 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph osd dump --format=json 2020-06-27T04:45:19.192 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:19.451 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:19 smithi031 bash[18426]: audit 2020-06-27T04:45:18.134166+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]': finished 2020-06-27T04:45:19.451 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:19 smithi031 bash[18426]: audit 2020-06-27T04:45:18.134222+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]': finished 2020-06-27T04:45:19.451 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:19 smithi031 bash[18426]: audit 2020-06-27T04:45:18.134268+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]': finished 2020-06-27T04:45:19.451 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:19 smithi031 bash[18426]: audit 2020-06-27T04:45:18.134308+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]': finished 2020-06-27T04:45:19.452 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:19 smithi031 bash[18426]: cluster 2020-06-27T04:45:18.134339+0000 mon.a (mon.0) 498 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2020-06-27T04:45:19.452 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:19 smithi031 bash[18426]: audit 2020-06-27T04:45:18.442349+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.31:0/583674152' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2020-06-27T04:45:19.452 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:19 smithi031 bash[22603]: audit 2020-06-27T04:45:18.134166+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]': finished 2020-06-27T04:45:19.453 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:19 smithi031 bash[22603]: audit 2020-06-27T04:45:18.134222+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]': finished 2020-06-27T04:45:19.453 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:19 smithi031 bash[22603]: audit 2020-06-27T04:45:18.134268+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]': finished 2020-06-27T04:45:19.453 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:19 smithi031 bash[22603]: audit 2020-06-27T04:45:18.134308+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]': finished 2020-06-27T04:45:19.453 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:19 smithi031 bash[22603]: cluster 2020-06-27T04:45:18.134339+0000 mon.a (mon.0) 498 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2020-06-27T04:45:19.453 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:19 smithi031 bash[22603]: audit 2020-06-27T04:45:18.442349+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.31:0/583674152' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2020-06-27T04:45:19.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:19 smithi051 bash[18409]: audit 2020-06-27T04:45:18.134166+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]': finished 2020-06-27T04:45:19.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:19 smithi051 bash[18409]: audit 2020-06-27T04:45:18.134222+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]': finished 2020-06-27T04:45:19.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:19 smithi051 bash[18409]: audit 2020-06-27T04:45:18.134268+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]': finished 2020-06-27T04:45:19.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:19 smithi051 bash[18409]: audit 2020-06-27T04:45:18.134308+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]': finished 2020-06-27T04:45:19.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:19 smithi051 bash[18409]: cluster 2020-06-27T04:45:18.134339+0000 mon.a (mon.0) 498 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2020-06-27T04:45:19.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:19 smithi051 bash[18409]: audit 2020-06-27T04:45:18.442349+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.31:0/583674152' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2020-06-27T04:45:20.149 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:20 smithi031 bash[18426]: cluster 2020-06-27T04:45:19.132479+0000 mon.a (mon.0) 499 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2020-06-27T04:45:20.149 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:20 smithi031 bash[18426]: cluster 2020-06-27T04:45:19.140867+0000 mgr.x (mgr.34109) 142 : cluster [DBG] pgmap v138: 129 pgs: 1 peering, 128 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:20.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:20 smithi051 bash[18409]: cluster 2020-06-27T04:45:19.132479+0000 mon.a (mon.0) 499 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2020-06-27T04:45:20.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:20 smithi051 bash[18409]: cluster 2020-06-27T04:45:19.140867+0000 mgr.x (mgr.34109) 142 : cluster [DBG] pgmap v138: 129 pgs: 1 peering, 128 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:20.472 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:20 smithi031 bash[22603]: cluster 2020-06-27T04:45:19.132479+0000 mon.a (mon.0) 499 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2020-06-27T04:45:20.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:20 smithi031 bash[22603]: cluster 2020-06-27T04:45:19.140867+0000 mgr.x (mgr.34109) 142 : cluster [DBG] pgmap v138: 129 pgs: 1 peering, 128 active+clean; 5.3 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:20.872 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.867+0000 7f0226fb3700 1 Processor -- start 2020-06-27T04:45:20.872 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.867+0000 7f0226fb3700 1 -- start start 2020-06-27T04:45:20.872 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0226fb3700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0220066370 0x7f022006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:20.873 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0226fb3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f022006be40 0x7f0220078370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:20.873 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0226fb3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02200789a0 0x7f0220122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:20.873 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0226fb3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02201232f0 con 0x7f02200789a0 2020-06-27T04:45:20.873 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0226fb3700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0220123460 con 0x7f0220066370 2020-06-27T04:45:20.873 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0226fb3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0220123620 con 0x7f022006be40 2020-06-27T04:45:20.874 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0224d4f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f022006be40 0x7f0220078370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:20.874 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0225d51700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02200789a0 0x7f0220122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:20.874 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0224d4f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f022006be40 0x7f0220078370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35738/0 (socket says 172.21.15.31:35738) 2020-06-27T04:45:20.874 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0224d4f700 1 -- 172.21.15.31:0/13300890 learned_addr learned my addr 172.21.15.31:0/13300890 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:20.874 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0225550700 1 --2- 172.21.15.31:0/13300890 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0220066370 0x7f022006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:20.875 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0225d51700 1 -- 172.21.15.31:0/13300890 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f022006be40 msgr2=0x7f0220078370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:20.875 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0225d51700 1 --2- 172.21.15.31:0/13300890 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f022006be40 0x7f0220078370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:20.875 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0225d51700 1 -- 172.21.15.31:0/13300890 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0220066370 msgr2=0x7f022006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:20.875 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0225d51700 1 --2- 172.21.15.31:0/13300890 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0220066370 0x7f022006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:20.875 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0225d51700 1 -- 172.21.15.31:0/13300890 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02201237e0 con 0x7f02200789a0 2020-06-27T04:45:20.875 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0225d51700 1 --2- 172.21.15.31:0/13300890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02200789a0 0x7f0220122cb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f021800c000 tx=0x7f021800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:20.876 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f021d7fa700 1 -- 172.21.15.31:0/13300890 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02180095a0 con 0x7f02200789a0 2020-06-27T04:45:20.876 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0226fb3700 1 -- 172.21.15.31:0/13300890 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0220123a90 con 0x7f02200789a0 2020-06-27T04:45:20.876 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f021d7fa700 1 -- 172.21.15.31:0/13300890 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f021800f040 con 0x7f02200789a0 2020-06-27T04:45:20.876 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f021d7fa700 1 -- 172.21.15.31:0/13300890 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f021800c860 con 0x7f02200789a0 2020-06-27T04:45:20.876 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.868+0000 7f0226fb3700 1 -- 172.21.15.31:0/13300890 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0220123fb0 con 0x7f02200789a0 2020-06-27T04:45:20.878 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.869+0000 7f021d7fa700 1 -- 172.21.15.31:0/13300890 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f021800c9c0 con 0x7f02200789a0 2020-06-27T04:45:20.878 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.869+0000 7f021d7fa700 1 --2- 172.21.15.31:0/13300890 >> v2:172.21.15.51:6800/950992045 conn(0x7f01fc02ab50 0x7f01fc02d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:20.878 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.869+0000 7f021d7fa700 1 -- 172.21.15.31:0/13300890 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7f021803b890 con 0x7f02200789a0 2020-06-27T04:45:20.878 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.869+0000 7f0225550700 1 --2- 172.21.15.31:0/13300890 >> v2:172.21.15.51:6800/950992045 conn(0x7f01fc02ab50 0x7f01fc02d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:20.878 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.870+0000 7f0226fb3700 1 -- 172.21.15.31:0/13300890 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022005e210 con 0x7f02200789a0 2020-06-27T04:45:20.879 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.870+0000 7f0225550700 1 --2- 172.21.15.31:0/13300890 >> v2:172.21.15.51:6800/950992045 conn(0x7f01fc02ab50 0x7f01fc02d010 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f0214016000 tx=0x7f0214009b30).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:20.879 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:20.873+0000 7f021d7fa700 1 -- 172.21.15.31:0/13300890 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f0218019070 con 0x7f02200789a0 2020-06-27T04:45:21.029 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:21.026+0000 7f0226fb3700 1 -- 172.21.15.31:0/13300890 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0220124200 con 0x7f02200789a0 2020-06-27T04:45:21.030 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:21.027+0000 7f021d7fa700 1 -- 172.21.15.31:0/13300890 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16874 (secure 0 0 0) 0x7f0218012360 con 0x7f02200789a0 2020-06-27T04:45:21.031 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:45:21.031 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":59,"fsid":"12892ae2-b830-11ea-a06d-001a4aab830c","created":"2020-06-27T04:39:37.261039+0000","modified":"2020-06-27T04:45:19.129385+0000","last_up_change":"2020-06-27T04:44:23.253829+0000","last_in_change":"2020-06-27T04:44:23.253829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-27T04:39:48.364049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2020-06-27T04:44:20.858261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"zone.rgw.log","create_time":"2020-06-27T04:44:34.179693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"zone.rgw.control","create_time":"2020-06-27T04:44:35.835421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"zone.rgw.meta","create_time":"2020-06-27T04:44:37.902913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":4030364259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":4030364259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":4030364259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":4030364259}]},"public_addr":"172.21.15.31:6800/4030364259","cluster_addr":"172.21.15.31:6801/4030364259","heartbeat_back_addr":"172.21.15.31:6803/4030364259","heartbeat_front_addr":"172.21.15.31:6802/4030364259","state":["exists","up"]},{"osd":1,"uuid":"e06700d6-7863-486c-a5bd-4ea867e8273c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":3103897888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":3103897888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":3103897888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":3103897888}]},"public_addr":"172.21.15.31:6804/3103897888","cluster_addr":"172.21.15.31:6805/3103897888","heartbeat_back_addr":"172.21.15.31:6807/3103897888","heartbeat_front_addr":"172.21.15.31:6806/3103897888","state":["exists","up"]},{"osd":2,"uuid":"82a9c5cf-2ae0-429e-82a6-03b9928e5c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":3672781084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":3672781084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":3672781084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":3672781084}]},"public_addr":"172.21.15.31:6808/3672781084","cluster_addr":"172.21.15.31:6809/3672781084","heartbeat_back_addr":"172.21.15.31:6811/3672781084","heartbeat_front_addr":"172.21.15.31:6810/3672781084","state":["exists","up"]},{"osd":3,"uuid":"5a3667cb-5c57-47fb-8c93-da3a3817c975","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":772723559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":772723559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6815","nonce":772723559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":772723559}]},"public_addr":"172.21.15.31:6812/772723559","cluster_addr":"172.21.15.31:6813/772723559","heartbeat_back_addr":"172.21.15.31:6815/772723559","heartbeat_front_addr":"172.21.15.31:6814/772723559","state":["exists","up"]},{"osd":4,"uuid":"62c9b092-2f7d-4391-acae-dd78afcf7d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6801","nonce":3547494673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6802","nonce":3547494673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6804","nonce":3547494673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6803","nonce":3547494673}]},"public_addr":"172.21.15.51:6801/3547494673","cluster_addr":"172.21.15.51:6802/3547494673","heartbeat_back_addr":"172.21.15.51:6804/3547494673","heartbeat_front_addr":"172.21.15.51:6803/3547494673","state":["exists","up"]},{"osd":5,"uuid":"1dca5a6a-245c-4161-9042-713f7c0bbfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6805","nonce":1207065717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6806","nonce":1207065717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6808","nonce":1207065717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6807","nonce":1207065717}]},"public_addr":"172.21.15.51:6805/1207065717","cluster_addr":"172.21.15.51:6806/1207065717","heartbeat_back_addr":"172.21.15.51:6808/1207065717","heartbeat_front_addr":"172.21.15.51:6807/1207065717","state":["exists","up"]},{"osd":6,"uuid":"6125844a-2c24-409d-9f33-ba0cbb1bb822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6809","nonce":2568976317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6810","nonce":2568976317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6812","nonce":2568976317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6811","nonce":2568976317}]},"public_addr":"172.21.15.51:6809/2568976317","cluster_addr":"172.21.15.51:6810/2568976317","heartbeat_back_addr":"172.21.15.51:6812/2568976317","heartbeat_front_addr":"172.21.15.51:6811/2568976317","state":["exists","up"]},{"osd":7,"uuid":"41502006-951e-4786-872a-1fd840460fa7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6813","nonce":1443623027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6814","nonce":1443623027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6816","nonce":1443623027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6815","nonce":1443623027}]},"public_addr":"172.21.15.51:6813/1443623027","cluster_addr":"172.21.15.51:6814/1443623027","heartbeat_back_addr":"172.21.15.51:6816/1443623027","heartbeat_front_addr":"172.21.15.51:6815/1443623027","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:42:33.049576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:42:49.055123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:43:05.285290+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:43:20.955853+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:43:35.378369+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:43:49.867408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:44:06.203670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:44:22.115293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.12","mappings":[{"from":7,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.31:0/163335024":"2020-06-28T04:40:10.090940+0000","172.21.15.31:0/980973700":"2020-06-28T04:42:17.090997+0000","172.21.15.31:0/1723866722":"2020-06-28T04:40:10.090940+0000","172.21.15.31:6800/4294292023":"2020-06-28T04:40:10.090940+0000","172.21.15.31:0/3362836624":"2020-06-28T04:42:17.090997+0000","172.21.15.31:0/620485409":"2020-06-28T04:40:10.090940+0000","172.21.15.31:0/121410604":"2020-06-28T04:39:57.049167+0000","172.21.15.31:0/4226471217":"2020-06-28T04:39:57.049167+0000","172.21.15.31:0/3753882637":"2020-06-28T04:42:17.090997+0000","172.21.15.31:6800/769686724":"2020-06-28T04:39:57.049167+0000","172.21.15.31:6800/1241213118":"2020-06-28T04:42:17.090997+0000","172.21.15.31:0/1159003614":"2020-06-28T04:39:57.049167+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-27T04:45:21.033 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:21.029+0000 7f0226fb3700 1 -- 172.21.15.31:0/13300890 >> v2:172.21.15.51:6800/950992045 conn(0x7f01fc02ab50 msgr2=0x7f01fc02d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:21.033 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:21.029+0000 7f0226fb3700 1 --2- 172.21.15.31:0/13300890 >> v2:172.21.15.51:6800/950992045 conn(0x7f01fc02ab50 0x7f01fc02d010 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f0214016000 tx=0x7f0214009b30).stop 2020-06-27T04:45:21.033 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:21.029+0000 7f0226fb3700 1 -- 172.21.15.31:0/13300890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02200789a0 msgr2=0x7f0220122cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:21.034 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:21.029+0000 7f0226fb3700 1 --2- 172.21.15.31:0/13300890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02200789a0 0x7f0220122cb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f021800c000 tx=0x7f021800b040).stop 2020-06-27T04:45:21.034 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:21.029+0000 7f0226fb3700 1 -- 172.21.15.31:0/13300890 shutdown_connections 2020-06-27T04:45:21.034 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:21.029+0000 7f0226fb3700 1 --2- 172.21.15.31:0/13300890 >> v2:172.21.15.51:6800/950992045 conn(0x7f01fc02ab50 0x7f01fc02d010 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:21.035 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:21.029+0000 7f0226fb3700 1 --2- 172.21.15.31:0/13300890 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0220066370 0x7f022006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:21.035 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:21.029+0000 7f0226fb3700 1 --2- 172.21.15.31:0/13300890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02200789a0 0x7f0220122cb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:21.035 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:21.029+0000 7f0226fb3700 1 --2- 172.21.15.31:0/13300890 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f022006be40 0x7f0220078370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:21.036 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:21.029+0000 7f0226fb3700 1 -- 172.21.15.31:0/13300890 >> 172.21.15.31:0/13300890 conn(0x7f0220061840 msgr2=0x7f022006d360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:21.036 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:21.029+0000 7f0226fb3700 1 -- 172.21.15.31:0/13300890 shutdown_connections 2020-06-27T04:45:21.036 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:21.029+0000 7f0226fb3700 1 -- 172.21.15.31:0/13300890 wait complete. 2020-06-27T04:45:21.429 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:21 smithi051 bash[18409]: audit 2020-06-27T04:45:21.027937+0000 mon.a (mon.0) 500 : audit [DBG] from='client.? 172.21.15.31:0/13300890' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-06-27T04:45:21.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:21 smithi031 bash[18426]: audit 2020-06-27T04:45:21.027937+0000 mon.a (mon.0) 500 : audit [DBG] from='client.? 172.21.15.31:0/13300890' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-06-27T04:45:21.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:21 smithi031 bash[22603]: audit 2020-06-27T04:45:21.027937+0000 mon.a (mon.0) 500 : audit [DBG] from='client.? 172.21.15.31:0/13300890' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-06-27T04:45:21.562 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2020-06-27T04:45:21.562 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph osd dump --format=json 2020-06-27T04:45:21.710 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:22.334 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:22 smithi031 bash[18426]: cluster 2020-06-27T04:45:21.141497+0000 mgr.x (mgr.34109) 143 : cluster [DBG] pgmap v139: 129 pgs: 1 peering, 128 active+clean; 5.3 KiB data, 4.7 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:22.334 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:22 smithi031 bash[22603]: cluster 2020-06-27T04:45:21.141497+0000 mgr.x (mgr.34109) 143 : cluster [DBG] pgmap v139: 129 pgs: 1 peering, 128 active+clean; 5.3 KiB data, 4.7 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:22.435 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:22 smithi051 bash[18409]: cluster 2020-06-27T04:45:21.141497+0000 mgr.x (mgr.34109) 143 : cluster [DBG] pgmap v139: 129 pgs: 1 peering, 128 active+clean; 5.3 KiB data, 4.7 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:22.716 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:22 smithi051 systemd[1]: Starting Ceph grafana.a for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:45:22.716 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:22 smithi051 podman[31490]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-grafana.a found: no such container 2020-06-27T04:45:22.967 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:22 smithi051 systemd[1]: Started Ceph grafana.a for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:45:22.968 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:22 smithi051 bash[31505]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-grafana.a" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-grafana.a found: no such container 2020-06-27T04:45:22.968 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:22 smithi051 bash[31505]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-grafana.a 2020-06-27T04:45:22.968 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:22 smithi051 bash[31505]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-grafana.a" found: no such container 2020-06-27T04:45:23.412 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 podman[31538]: 2020-06-27 04:45:23.042241024 +0000 UTC m=+0.228657067 container create 992ff21e4e7fa9513755d591f2ddd151fdb09a91ce4b4f4b666f0c7eeb275762 (image=docker.io/ceph/ceph-grafana:6.6.2, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-grafana.a) 2020-06-27T04:45:23.412 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[18409]: audit 2020-06-27T04:45:22.746642+0000 mon.b (mon.2) 232 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:23.413 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[18409]: audit 2020-06-27T04:45:22.747405+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:23.413 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[18409]: audit 2020-06-27T04:45:22.749858+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:45:23.413 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[18409]: audit 2020-06-27T04:45:22.750981+0000 mon.b (mon.2) 233 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:45:23.414 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[18409]: audit 2020-06-27T04:45:22.751195+0000 mon.b (mon.2) 234 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:45:23.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:23 smithi031 bash[18426]: audit 2020-06-27T04:45:22.746642+0000 mon.b (mon.2) 232 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:23.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:23 smithi031 bash[18426]: audit 2020-06-27T04:45:22.747405+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:23.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:23 smithi031 bash[18426]: audit 2020-06-27T04:45:22.749858+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:45:23.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:23 smithi031 bash[18426]: audit 2020-06-27T04:45:22.750981+0000 mon.b (mon.2) 233 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:45:23.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:23 smithi031 bash[18426]: audit 2020-06-27T04:45:22.751195+0000 mon.b (mon.2) 234 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:45:23.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:23 smithi031 bash[22603]: audit 2020-06-27T04:45:22.746642+0000 mon.b (mon.2) 232 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:23.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:23 smithi031 bash[22603]: audit 2020-06-27T04:45:22.747405+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:23.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:23 smithi031 bash[22603]: audit 2020-06-27T04:45:22.749858+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329474\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329552\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329585\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329787\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.329900\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330007\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:44:50.330113\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:45:23.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:23 smithi031 bash[22603]: audit 2020-06-27T04:45:22.750981+0000 mon.b (mon.2) 233 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:45:23.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:23 smithi031 bash[22603]: audit 2020-06-27T04:45:22.751195+0000 mon.b (mon.2) 234 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:45:23.573 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.570+0000 7f1d47205700 1 Processor -- start 2020-06-27T04:45:23.573 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.570+0000 7f1d47205700 1 -- start start 2020-06-27T04:45:23.575 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.570+0000 7f1d47205700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d400678b0 0x7f1d400789d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:23.575 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.570+0000 7f1d47205700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d4006be30 0x7f1d40075580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:23.575 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.570+0000 7f1d47205700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f1d40075bb0 0x7f1d40122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:23.575 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.570+0000 7f1d47205700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d40123280 con 0x7f1d4006be30 2020-06-27T04:45:23.576 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.570+0000 7f1d47205700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d401233f0 con 0x7f1d40075bb0 2020-06-27T04:45:23.576 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.570+0000 7f1d47205700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d40061c90 con 0x7f1d400678b0 2020-06-27T04:45:23.576 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.570+0000 7f1d44fa1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d4006be30 0x7f1d40075580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:23.576 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.570+0000 7f1d45fa3700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f1d40075bb0 0x7f1d40122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:23.576 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.570+0000 7f1d44fa1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d4006be30 0x7f1d40075580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39500/0 (socket says 172.21.15.31:39500) 2020-06-27T04:45:23.577 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.570+0000 7f1d44fa1700 1 -- 172.21.15.31:0/4029619808 learned_addr learned my addr 172.21.15.31:0/4029619808 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:23.577 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.570+0000 7f1d457a2700 1 --2- 172.21.15.31:0/4029619808 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d400678b0 0x7f1d400789d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:23.577 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.571+0000 7f1d45fa3700 1 -- 172.21.15.31:0/4029619808 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d400678b0 msgr2=0x7f1d400789d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:23.577 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.571+0000 7f1d45fa3700 1 --2- 172.21.15.31:0/4029619808 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d400678b0 0x7f1d400789d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:23.577 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.571+0000 7f1d45fa3700 1 -- 172.21.15.31:0/4029619808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d4006be30 msgr2=0x7f1d40075580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:23.578 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.571+0000 7f1d45fa3700 1 --2- 172.21.15.31:0/4029619808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d4006be30 0x7f1d40075580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:23.578 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.571+0000 7f1d45fa3700 1 -- 172.21.15.31:0/4029619808 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d40061e50 con 0x7f1d40075bb0 2020-06-27T04:45:23.578 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.571+0000 7f1d45fa3700 1 --2- 172.21.15.31:0/4029619808 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f1d40075bb0 0x7f1d40122cb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f1d3800c000 tx=0x7f1d3800b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:23.578 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.571+0000 7f1d357fa700 1 -- 172.21.15.31:0/4029619808 <== mon.2 v2:172.21.15.51:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d3800c860 con 0x7f1d40075bb0 2020-06-27T04:45:23.578 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.571+0000 7f1d47205700 1 -- 172.21.15.31:0/4029619808 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d400620a0 con 0x7f1d40075bb0 2020-06-27T04:45:23.578 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.571+0000 7f1d357fa700 1 -- 172.21.15.31:0/4029619808 <== mon.2 v2:172.21.15.51:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f1d3800f040 con 0x7f1d40075bb0 2020-06-27T04:45:23.579 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.571+0000 7f1d357fa700 1 -- 172.21.15.31:0/4029619808 <== mon.2 v2:172.21.15.51:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d38007c90 con 0x7f1d40075bb0 2020-06-27T04:45:23.579 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.571+0000 7f1d47205700 1 -- 172.21.15.31:0/4029619808 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d40062610 con 0x7f1d40075bb0 2020-06-27T04:45:23.579 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.572+0000 7f1d357fa700 1 -- 172.21.15.31:0/4029619808 <== mon.2 v2:172.21.15.51:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f1d38014460 con 0x7f1d40075bb0 2020-06-27T04:45:23.579 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.572+0000 7f1d357fa700 1 --2- 172.21.15.31:0/4029619808 >> v2:172.21.15.51:6800/950992045 conn(0x7f1d1c02ab00 0x7f1d1c02cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:23.579 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.572+0000 7f1d357fa700 1 -- 172.21.15.31:0/4029619808 <== mon.2 v2:172.21.15.51:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7f1d3803bec0 con 0x7f1d40075bb0 2020-06-27T04:45:23.580 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.572+0000 7f1d457a2700 1 --2- 172.21.15.31:0/4029619808 >> v2:172.21.15.51:6800/950992045 conn(0x7f1d1c02ab00 0x7f1d1c02cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:23.580 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.572+0000 7f1d457a2700 1 --2- 172.21.15.31:0/4029619808 >> v2:172.21.15.51:6800/950992045 conn(0x7f1d1c02ab00 0x7f1d1c02cfc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f1d3c00b000 tx=0x7f1d3c00b040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:23.581 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.572+0000 7f1d47205700 1 -- 172.21.15.31:0/4029619808 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4005e210 con 0x7f1d40075bb0 2020-06-27T04:45:23.582 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.578+0000 7f1d357fa700 1 -- 172.21.15.31:0/4029619808 <== mon.2 v2:172.21.15.51:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f1d38019080 con 0x7f1d40075bb0 2020-06-27T04:45:23.704 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 podman[31538]: 2020-06-27 04:45:23.408869123 +0000 UTC m=+0.595285164 container init 992ff21e4e7fa9513755d591f2ddd151fdb09a91ce4b4f4b666f0c7eeb275762 (image=docker.io/ceph/ceph-grafana:6.6.2, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-grafana.a) 2020-06-27T04:45:23.704 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 podman[31538]: 2020-06-27 04:45:23.442141234 +0000 UTC m=+0.628557262 container start 992ff21e4e7fa9513755d591f2ddd151fdb09a91ce4b4f4b666f0c7eeb275762 (image=docker.io/ceph/ceph-grafana:6.6.2, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-grafana.a) 2020-06-27T04:45:23.705 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 podman[31538]: 2020-06-27 04:45:23.442206813 +0000 UTC m=+0.628622859 container attach 992ff21e4e7fa9513755d591f2ddd151fdb09a91ce4b4f4b666f0c7eeb275762 (image=docker.io/ceph/ceph-grafana:6.6.2, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-grafana.a) 2020-06-27T04:45:23.705 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Starting Grafana" logger=server version=6.6.2 commit=3fa63cfc34 branch=HEAD compiled=2020-02-20T12:03:49+0000 2020-06-27T04:45:23.705 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2020-06-27T04:45:23.705 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2020-06-27T04:45:23.706 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2020-06-27T04:45:23.706 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2020-06-27T04:45:23.706 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2020-06-27T04:45:23.706 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2020-06-27T04:45:23.706 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2020-06-27T04:45:23.707 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2020-06-27T04:45:23.707 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2020-06-27T04:45:23.707 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2020-06-27T04:45:23.707 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2020-06-27T04:45:23.707 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="App mode production" logger=settings 2020-06-27T04:45:23.708 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Initializing SqlStore" logger=server 2020-06-27T04:45:23.708 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2020-06-27T04:45:23.708 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Starting DB migration" logger=migrator 2020-06-27T04:45:23.708 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2020-06-27T04:45:23.708 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2020-06-27T04:45:23.708 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2020-06-27T04:45:23.709 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2020-06-27T04:45:23.709 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2020-06-27T04:45:23.757 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.754+0000 7f1d47205700 1 -- 172.21.15.31:0/4029619808 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d40062880 con 0x7f1d40075bb0 2020-06-27T04:45:23.758 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.755+0000 7f1d357fa700 1 -- 172.21.15.31:0/4029619808 <== mon.2 v2:172.21.15.51:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16874 (secure 0 0 0) 0x7f1d38012930 con 0x7f1d40075bb0 2020-06-27T04:45:23.759 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:45:23.759 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":59,"fsid":"12892ae2-b830-11ea-a06d-001a4aab830c","created":"2020-06-27T04:39:37.261039+0000","modified":"2020-06-27T04:45:19.129385+0000","last_up_change":"2020-06-27T04:44:23.253829+0000","last_in_change":"2020-06-27T04:44:23.253829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-27T04:39:48.364049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2020-06-27T04:44:20.858261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"zone.rgw.log","create_time":"2020-06-27T04:44:34.179693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"zone.rgw.control","create_time":"2020-06-27T04:44:35.835421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"zone.rgw.meta","create_time":"2020-06-27T04:44:37.902913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":4030364259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":4030364259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":4030364259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":4030364259}]},"public_addr":"172.21.15.31:6800/4030364259","cluster_addr":"172.21.15.31:6801/4030364259","heartbeat_back_addr":"172.21.15.31:6803/4030364259","heartbeat_front_addr":"172.21.15.31:6802/4030364259","state":["exists","up"]},{"osd":1,"uuid":"e06700d6-7863-486c-a5bd-4ea867e8273c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":3103897888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":3103897888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":3103897888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":3103897888}]},"public_addr":"172.21.15.31:6804/3103897888","cluster_addr":"172.21.15.31:6805/3103897888","heartbeat_back_addr":"172.21.15.31:6807/3103897888","heartbeat_front_addr":"172.21.15.31:6806/3103897888","state":["exists","up"]},{"osd":2,"uuid":"82a9c5cf-2ae0-429e-82a6-03b9928e5c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":3672781084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":3672781084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":3672781084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":3672781084}]},"public_addr":"172.21.15.31:6808/3672781084","cluster_addr":"172.21.15.31:6809/3672781084","heartbeat_back_addr":"172.21.15.31:6811/3672781084","heartbeat_front_addr":"172.21.15.31:6810/3672781084","state":["exists","up"]},{"osd":3,"uuid":"5a3667cb-5c57-47fb-8c93-da3a3817c975","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":772723559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":772723559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6815","nonce":772723559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":772723559}]},"public_addr":"172.21.15.31:6812/772723559","cluster_addr":"172.21.15.31:6813/772723559","heartbeat_back_addr":"172.21.15.31:6815/772723559","heartbeat_front_addr":"172.21.15.31:6814/772723559","state":["exists","up"]},{"osd":4,"uuid":"62c9b092-2f7d-4391-acae-dd78afcf7d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6801","nonce":3547494673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6802","nonce":3547494673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6804","nonce":3547494673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6803","nonce":3547494673}]},"public_addr":"172.21.15.51:6801/3547494673","cluster_addr":"172.21.15.51:6802/3547494673","heartbeat_back_addr":"172.21.15.51:6804/3547494673","heartbeat_front_addr":"172.21.15.51:6803/3547494673","state":["exists","up"]},{"osd":5,"uuid":"1dca5a6a-245c-4161-9042-713f7c0bbfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6805","nonce":1207065717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6806","nonce":1207065717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6808","nonce":1207065717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6807","nonce":1207065717}]},"public_addr":"172.21.15.51:6805/1207065717","cluster_addr":"172.21.15.51:6806/1207065717","heartbeat_back_addr":"172.21.15.51:6808/1207065717","heartbeat_front_addr":"172.21.15.51:6807/1207065717","state":["exists","up"]},{"osd":6,"uuid":"6125844a-2c24-409d-9f33-ba0cbb1bb822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6809","nonce":2568976317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6810","nonce":2568976317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6812","nonce":2568976317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6811","nonce":2568976317}]},"public_addr":"172.21.15.51:6809/2568976317","cluster_addr":"172.21.15.51:6810/2568976317","heartbeat_back_addr":"172.21.15.51:6812/2568976317","heartbeat_front_addr":"172.21.15.51:6811/2568976317","state":["exists","up"]},{"osd":7,"uuid":"41502006-951e-4786-872a-1fd840460fa7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6813","nonce":1443623027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6814","nonce":1443623027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6816","nonce":1443623027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.51:6815","nonce":1443623027}]},"public_addr":"172.21.15.51:6813/1443623027","cluster_addr":"172.21.15.51:6814/1443623027","heartbeat_back_addr":"172.21.15.51:6816/1443623027","heartbeat_front_addr":"172.21.15.51:6815/1443623027","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:42:33.049576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:42:49.055123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:43:05.285290+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:43:20.955853+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:43:35.378369+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:43:49.867408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:44:06.203670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:44:22.115293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.12","mappings":[{"from":7,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.31:0/163335024":"2020-06-28T04:40:10.090940+0000","172.21.15.31:0/980973700":"2020-06-28T04:42:17.090997+0000","172.21.15.31:0/1723866722":"2020-06-28T04:40:10.090940+0000","172.21.15.31:6800/4294292023":"2020-06-28T04:40:10.090940+0000","172.21.15.31:0/3362836624":"2020-06-28T04:42:17.090997+0000","172.21.15.31:0/620485409":"2020-06-28T04:40:10.090940+0000","172.21.15.31:0/121410604":"2020-06-28T04:39:57.049167+0000","172.21.15.31:0/4226471217":"2020-06-28T04:39:57.049167+0000","172.21.15.31:0/3753882637":"2020-06-28T04:42:17.090997+0000","172.21.15.31:6800/769686724":"2020-06-28T04:39:57.049167+0000","172.21.15.31:6800/1241213118":"2020-06-28T04:42:17.090997+0000","172.21.15.31:0/1159003614":"2020-06-28T04:39:57.049167+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-27T04:45:23.760 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.757+0000 7f1d47205700 1 -- 172.21.15.31:0/4029619808 >> v2:172.21.15.51:6800/950992045 conn(0x7f1d1c02ab00 msgr2=0x7f1d1c02cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:23.761 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.757+0000 7f1d47205700 1 --2- 172.21.15.31:0/4029619808 >> v2:172.21.15.51:6800/950992045 conn(0x7f1d1c02ab00 0x7f1d1c02cfc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f1d3c00b000 tx=0x7f1d3c00b040).stop 2020-06-27T04:45:23.761 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.757+0000 7f1d47205700 1 -- 172.21.15.31:0/4029619808 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f1d40075bb0 msgr2=0x7f1d40122cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:23.761 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.757+0000 7f1d47205700 1 --2- 172.21.15.31:0/4029619808 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f1d40075bb0 0x7f1d40122cb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f1d3800c000 tx=0x7f1d3800b040).stop 2020-06-27T04:45:23.761 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.757+0000 7f1d47205700 1 -- 172.21.15.31:0/4029619808 shutdown_connections 2020-06-27T04:45:23.761 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.757+0000 7f1d47205700 1 --2- 172.21.15.31:0/4029619808 >> v2:172.21.15.51:6800/950992045 conn(0x7f1d1c02ab00 0x7f1d1c02cfc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:23.763 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.757+0000 7f1d47205700 1 --2- 172.21.15.31:0/4029619808 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f1d40075bb0 0x7f1d40122cb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:23.764 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.757+0000 7f1d47205700 1 --2- 172.21.15.31:0/4029619808 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d400678b0 0x7f1d400789d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:23.764 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.757+0000 7f1d47205700 1 --2- 172.21.15.31:0/4029619808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d4006be30 0x7f1d40075580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:23.764 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.757+0000 7f1d47205700 1 -- 172.21.15.31:0/4029619808 >> 172.21.15.31:0/4029619808 conn(0x7f1d40061830 msgr2=0x7f1d4006b000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:23.764 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.757+0000 7f1d47205700 1 -- 172.21.15.31:0/4029619808 shutdown_connections 2020-06-27T04:45:23.764 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:23.757+0000 7f1d47205700 1 -- 172.21.15.31:0/4029619808 wait complete. 2020-06-27T04:45:23.955 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2020-06-27T04:45:23.956 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2020-06-27T04:45:24.218 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:23 smithi051 bash[31505]: t=2020-06-27T04:45:23+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2020-06-27T04:45:24.219 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:24 smithi051 bash[31505]: t=2020-06-27T04:45:24+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2020-06-27T04:45:24.219 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:24 smithi051 bash[31505]: t=2020-06-27T04:45:24+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2020-06-27T04:45:24.291 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2020-06-27T04:45:24.453 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:24.500 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:24 smithi051 bash[31505]: t=2020-06-27T04:45:24+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2020-06-27T04:45:24.501 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:24 smithi051 bash[31505]: t=2020-06-27T04:45:24+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2020-06-27T04:45:24.501 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:24 smithi051 bash[31505]: t=2020-06-27T04:45:24+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2020-06-27T04:45:24.501 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:24 smithi051 bash[31505]: t=2020-06-27T04:45:24+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2020-06-27T04:45:24.752 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:24 smithi051 bash[31505]: t=2020-06-27T04:45:24+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2020-06-27T04:45:24.753 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:24 smithi051 bash[31505]: t=2020-06-27T04:45:24+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2020-06-27T04:45:24.753 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:24 smithi051 bash[31505]: t=2020-06-27T04:45:24+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2020-06-27T04:45:25.038 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:24 smithi051 bash[31505]: t=2020-06-27T04:45:24+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2020-06-27T04:45:25.038 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:24 smithi051 bash[31505]: t=2020-06-27T04:45:24+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2020-06-27T04:45:25.038 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:24 smithi051 bash[31505]: t=2020-06-27T04:45:24+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2020-06-27T04:45:25.038 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:24 smithi051 bash[18409]: cluster 2020-06-27T04:45:23.141960+0000 mgr.x (mgr.34109) 144 : cluster [DBG] pgmap v140: 129 pgs: 1 peering, 128 active+clean; 5.3 KiB data, 4.7 MiB used, 707 GiB / 715 GiB avail; 5 B/s, 0 objects/s recovering 2020-06-27T04:45:25.039 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:24 smithi051 bash[18409]: audit 2020-06-27T04:45:23.755855+0000 mon.b (mon.2) 235 : audit [DBG] from='client.? 172.21.15.31:0/4029619808' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-06-27T04:45:25.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:24 smithi031 bash[18426]: cluster 2020-06-27T04:45:23.141960+0000 mgr.x (mgr.34109) 144 : cluster [DBG] pgmap v140: 129 pgs: 1 peering, 128 active+clean; 5.3 KiB data, 4.7 MiB used, 707 GiB / 715 GiB avail; 5 B/s, 0 objects/s recovering 2020-06-27T04:45:25.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:24 smithi031 bash[18426]: audit 2020-06-27T04:45:23.755855+0000 mon.b (mon.2) 235 : audit [DBG] from='client.? 172.21.15.31:0/4029619808' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-06-27T04:45:25.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:24 smithi031 bash[22603]: cluster 2020-06-27T04:45:23.141960+0000 mgr.x (mgr.34109) 144 : cluster [DBG] pgmap v140: 129 pgs: 1 peering, 128 active+clean; 5.3 KiB data, 4.7 MiB used, 707 GiB / 715 GiB avail; 5 B/s, 0 objects/s recovering 2020-06-27T04:45:25.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:24 smithi031 bash[22603]: audit 2020-06-27T04:45:23.755855+0000 mon.b (mon.2) 235 : audit [DBG] from='client.? 172.21.15.31:0/4029619808' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-06-27T04:45:25.290 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:25 smithi051 bash[31505]: t=2020-06-27T04:45:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2020-06-27T04:45:25.290 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:25 smithi051 bash[31505]: t=2020-06-27T04:45:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2020-06-27T04:45:25.291 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:25 smithi051 bash[31505]: t=2020-06-27T04:45:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2020-06-27T04:45:25.558 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:25 smithi051 bash[31505]: t=2020-06-27T04:45:25+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2020-06-27T04:45:25.558 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:25 smithi051 bash[31505]: t=2020-06-27T04:45:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2020-06-27T04:45:25.558 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:25 smithi051 bash[31505]: t=2020-06-27T04:45:25+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2020-06-27T04:45:25.819 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:25 smithi051 bash[31505]: t=2020-06-27T04:45:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2020-06-27T04:45:25.819 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:25 smithi051 bash[31505]: t=2020-06-27T04:45:25+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2020-06-27T04:45:25.819 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:25 smithi051 bash[31505]: t=2020-06-27T04:45:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2020-06-27T04:45:25.819 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:25 smithi051 bash[31505]: t=2020-06-27T04:45:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2020-06-27T04:45:25.820 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:25 smithi051 bash[18409]: audit 2020-06-27T04:45:25.356387+0000 mon.b (mon.2) 236 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354760\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354899\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355097\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355213\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355323\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355439\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355477\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355506\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:25.355593\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:25.820 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:25 smithi051 bash[18409]: audit 2020-06-27T04:45:25.356986+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354760\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354899\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355097\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355213\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355323\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355439\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355477\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355506\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:25.355593\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:25.820 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:25 smithi051 bash[18409]: audit 2020-06-27T04:45:25.359475+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354760\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354899\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355097\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355213\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355323\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355439\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355477\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355506\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:25.355593\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:45:25.821 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:25 smithi051 bash[18409]: audit 2020-06-27T04:45:25.481245+0000 mon.b (mon.2) 237 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479685\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479757\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479791\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479971\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480085\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480194\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480302\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480338\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"e89f4ff5dfc2\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480368\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:03.709233\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:51.468124\"}}, \"last_daemon_update\": \"2020-06-27T04:45:25.480461\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:25.821 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:25 smithi051 bash[18409]: audit 2020-06-27T04:45:25.481771+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479685\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479757\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479791\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479971\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480085\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480194\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480302\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480338\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"e89f4ff5dfc2\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480368\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:03.709233\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:51.468124\"}}, \"last_daemon_update\": \"2020-06-27T04:45:25.480461\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:25.821 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:25 smithi051 bash[18409]: audit 2020-06-27T04:45:25.486722+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479685\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479757\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479791\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479971\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480085\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480194\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480302\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480338\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"e89f4ff5dfc2\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480368\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:03.709233\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:51.468124\"}}, \"last_daemon_update\": \"2020-06-27T04:45:25.480461\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:45:26.119 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:25 smithi051 bash[31505]: t=2020-06-27T04:45:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2020-06-27T04:45:26.119 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:25 smithi051 bash[31505]: t=2020-06-27T04:45:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2020-06-27T04:45:26.119 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:26 smithi051 bash[31505]: t=2020-06-27T04:45:26+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2020-06-27T04:45:26.120 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:26 smithi051 bash[31505]: t=2020-06-27T04:45:26+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2020-06-27T04:45:26.193 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:25 smithi031 bash[22603]: audit 2020-06-27T04:45:25.356387+0000 mon.b (mon.2) 236 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354760\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354899\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355097\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355213\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355323\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355439\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355477\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355506\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:25.355593\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:26.194 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:25 smithi031 bash[22603]: audit 2020-06-27T04:45:25.356986+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354760\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354899\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355097\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355213\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355323\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355439\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355477\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355506\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:25.355593\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:26.194 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:25 smithi031 bash[22603]: audit 2020-06-27T04:45:25.359475+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354760\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354899\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355097\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355213\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355323\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355439\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355477\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355506\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:25.355593\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:45:26.194 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:25 smithi031 bash[22603]: audit 2020-06-27T04:45:25.481245+0000 mon.b (mon.2) 237 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479685\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479757\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479791\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479971\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480085\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480194\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480302\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480338\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"e89f4ff5dfc2\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480368\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:03.709233\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:51.468124\"}}, \"last_daemon_update\": \"2020-06-27T04:45:25.480461\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:26.195 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:25 smithi031 bash[22603]: audit 2020-06-27T04:45:25.481771+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479685\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479757\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479791\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479971\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480085\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480194\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480302\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480338\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"e89f4ff5dfc2\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480368\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:03.709233\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:51.468124\"}}, \"last_daemon_update\": \"2020-06-27T04:45:25.480461\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:26.195 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:25 smithi031 bash[22603]: audit 2020-06-27T04:45:25.486722+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479685\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479757\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479791\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479971\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480085\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480194\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480302\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480338\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"e89f4ff5dfc2\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480368\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:03.709233\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:51.468124\"}}, \"last_daemon_update\": \"2020-06-27T04:45:25.480461\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:45:26.195 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:25 smithi031 bash[18426]: audit 2020-06-27T04:45:25.356387+0000 mon.b (mon.2) 236 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354760\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354899\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355097\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355213\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355323\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355439\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355477\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355506\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:25.355593\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:26.196 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:25 smithi031 bash[18426]: audit 2020-06-27T04:45:25.356986+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354760\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354899\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355097\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355213\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355323\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355439\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355477\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355506\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:25.355593\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:26.196 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:25 smithi031 bash[18426]: audit 2020-06-27T04:45:25.359475+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354760\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354899\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355097\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355213\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355323\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"87a0fe4361d1\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355439\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:44:48.999759\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355477\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355506\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:34.345678\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:25.355593\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:45:26.196 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:25 smithi031 bash[18426]: audit 2020-06-27T04:45:25.481245+0000 mon.b (mon.2) 237 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479685\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479757\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479791\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479971\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480085\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480194\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480302\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480338\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"e89f4ff5dfc2\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480368\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:03.709233\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:51.468124\"}}, \"last_daemon_update\": \"2020-06-27T04:45:25.480461\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:26.197 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:25 smithi031 bash[18426]: audit 2020-06-27T04:45:25.481771+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479685\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479757\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479791\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479971\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480085\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480194\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480302\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480338\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"e89f4ff5dfc2\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480368\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:03.709233\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:51.468124\"}}, \"last_daemon_update\": \"2020-06-27T04:45:25.480461\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:26.197 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:25 smithi031 bash[18426]: audit 2020-06-27T04:45:25.486722+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479685\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479757\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479791\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479971\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480085\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480194\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480302\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480338\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"e89f4ff5dfc2\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480368\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:03.709233\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\"], \"last_config\": \"2020-06-27T04:44:51.468124\"}}, \"last_daemon_update\": \"2020-06-27T04:45:25.480461\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:45:26.468 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:26 smithi051 bash[31505]: t=2020-06-27T04:45:26+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2020-06-27T04:45:26.468 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:26 smithi051 bash[31505]: t=2020-06-27T04:45:26+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2020-06-27T04:45:26.468 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:26 smithi051 bash[31505]: t=2020-06-27T04:45:26+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2020-06-27T04:45:26.468 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:26 smithi051 bash[31505]: t=2020-06-27T04:45:26+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2020-06-27T04:45:26.739 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:26 smithi051 bash[31505]: t=2020-06-27T04:45:26+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2020-06-27T04:45:26.740 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:26 smithi051 bash[31505]: t=2020-06-27T04:45:26+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2020-06-27T04:45:26.740 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:26 smithi051 bash[31505]: t=2020-06-27T04:45:26+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2020-06-27T04:45:26.740 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:26 smithi051 bash[31505]: t=2020-06-27T04:45:26+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2020-06-27T04:45:26.740 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:26 smithi051 bash[31505]: t=2020-06-27T04:45:26+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2020-06-27T04:45:27.022 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.876+0000 7f29a195f700 1 Processor -- start 2020-06-27T04:45:27.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.876+0000 7f29a195f700 1 -- start start 2020-06-27T04:45:27.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.876+0000 7f29a195f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f299c066370 0x7f299c06cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:27.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.876+0000 7f29a195f700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f299c06be40 0x7f299c078300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:27.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.876+0000 7f29a195f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f299c078930 0x7f299c122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:27.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.876+0000 7f29a195f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c1232d0 con 0x7f299c078930 2020-06-27T04:45:27.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.876+0000 7f29a195f700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c123440 con 0x7f299c06be40 2020-06-27T04:45:27.037 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.876+0000 7f29a195f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c123600 con 0x7f299c066370 2020-06-27T04:45:27.037 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.876+0000 7f299b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f299c066370 0x7f299c06cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:27.037 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.876+0000 7f299bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f299c078930 0x7f299c122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:27.037 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.876+0000 7f299bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f299c078930 0x7f299c122cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39514/0 (socket says 172.21.15.31:39514) 2020-06-27T04:45:27.037 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.876+0000 7f299b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f299c066370 0x7f299c06cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35760/0 (socket says 172.21.15.31:35760) 2020-06-27T04:45:27.038 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.876+0000 7f299bfff700 1 -- 172.21.15.31:0/3840259878 learned_addr learned my addr 172.21.15.31:0/3840259878 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:27.038 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.876+0000 7f299affd700 1 --2- 172.21.15.31:0/3840259878 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f299c06be40 0x7f299c078300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:27.038 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.877+0000 7f299bfff700 1 -- 172.21.15.31:0/3840259878 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f299c066370 msgr2=0x7f299c06cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:27.039 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.877+0000 7f299bfff700 1 --2- 172.21.15.31:0/3840259878 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f299c066370 0x7f299c06cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:27.039 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.877+0000 7f299bfff700 1 -- 172.21.15.31:0/3840259878 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f299c06be40 msgr2=0x7f299c078300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:27.039 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.877+0000 7f299bfff700 1 --2- 172.21.15.31:0/3840259878 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f299c06be40 0x7f299c078300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:27.039 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.877+0000 7f299bfff700 1 -- 172.21.15.31:0/3840259878 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c1237c0 con 0x7f299c078930 2020-06-27T04:45:27.040 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.877+0000 7f299affd700 1 --2- 172.21.15.31:0/3840259878 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f299c06be40 0x7f299c078300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-27T04:45:27.040 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.877+0000 7f299b7fe700 1 --2- 172.21.15.31:0/3840259878 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f299c066370 0x7f299c06cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:45:27.040 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.877+0000 7f299bfff700 1 --2- 172.21.15.31:0/3840259878 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f299c078930 0x7f299c122cb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f2994004830 tx=0x7f299400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:27.040 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.877+0000 7f297bfff700 1 -- 172.21.15.31:0/3840259878 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29940095a0 con 0x7f299c078930 2020-06-27T04:45:27.040 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.877+0000 7f297bfff700 1 -- 172.21.15.31:0/3840259878 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f299400f040 con 0x7f299c078930 2020-06-27T04:45:27.040 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.877+0000 7f29a195f700 1 -- 172.21.15.31:0/3840259878 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c123a70 con 0x7f299c078930 2020-06-27T04:45:27.041 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.877+0000 7f297bfff700 1 -- 172.21.15.31:0/3840259878 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2994007ae0 con 0x7f299c078930 2020-06-27T04:45:27.041 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.877+0000 7f29a195f700 1 -- 172.21.15.31:0/3840259878 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c123f90 con 0x7f299c078930 2020-06-27T04:45:27.041 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.878+0000 7f297bfff700 1 -- 172.21.15.31:0/3840259878 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f2994007c40 con 0x7f299c078930 2020-06-27T04:45:27.041 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.878+0000 7f297bfff700 1 --2- 172.21.15.31:0/3840259878 >> v2:172.21.15.51:6800/950992045 conn(0x7f297402ab00 0x7f297402cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:27.041 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.878+0000 7f297bfff700 1 -- 172.21.15.31:0/3840259878 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7f299403a9c0 con 0x7f299c078930 2020-06-27T04:45:27.042 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.878+0000 7f29a195f700 1 --2- 172.21.15.31:0/3840259878 >> v2:172.21.15.31:6800/4030364259 conn(0x7f299c06de50 0x7f299c0565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:27.042 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.878+0000 7f299b7fe700 1 --2- 172.21.15.31:0/3840259878 >> v2:172.21.15.51:6800/950992045 conn(0x7f297402ab00 0x7f297402cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:27.042 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.878+0000 7f29a195f700 1 -- 172.21.15.31:0/3840259878 --> v2:172.21.15.31:6800/4030364259 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f299c05f390 con 0x7f299c06de50 2020-06-27T04:45:27.042 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.878+0000 7f299affd700 1 --2- 172.21.15.31:0/3840259878 >> v2:172.21.15.31:6800/4030364259 conn(0x7f299c06de50 0x7f299c0565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:27.042 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.878+0000 7f299b7fe700 1 --2- 172.21.15.31:0/3840259878 >> v2:172.21.15.51:6800/950992045 conn(0x7f297402ab00 0x7f297402cfc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f298c016000 tx=0x7f298c009b30).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:27.043 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.878+0000 7f299affd700 1 --2- 172.21.15.31:0/3840259878 >> v2:172.21.15.31:6800/4030364259 conn(0x7f299c06de50 0x7f299c0565d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:27.043 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.879+0000 7f297bfff700 1 -- 172.21.15.31:0/3840259878 <== osd.0 v2:172.21.15.31:6800/4030364259 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f29900045f0 con 0x7f299c06de50 2020-06-27T04:45:27.043 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.897+0000 7f29a195f700 1 -- 172.21.15.31:0/3840259878 --> v2:172.21.15.31:6800/4030364259 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f299c056cf0 con 0x7f299c06de50 2020-06-27T04:45:27.043 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.897+0000 7f297bfff700 1 -- 172.21.15.31:0/3840259878 <== osd.0 v2:172.21.15.31:6800/4030364259 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f299c056cf0 con 0x7f299c06de50 2020-06-27T04:45:27.043 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.898+0000 7f29a195f700 1 -- 172.21.15.31:0/3840259878 >> v2:172.21.15.31:6800/4030364259 conn(0x7f299c06de50 msgr2=0x7f299c0565d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:27.044 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.898+0000 7f29a195f700 1 --2- 172.21.15.31:0/3840259878 >> v2:172.21.15.31:6800/4030364259 conn(0x7f299c06de50 0x7f299c0565d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:27.044 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.898+0000 7f29a195f700 1 -- 172.21.15.31:0/3840259878 >> v2:172.21.15.51:6800/950992045 conn(0x7f297402ab00 msgr2=0x7f297402cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:27.044 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.898+0000 7f29a195f700 1 --2- 172.21.15.31:0/3840259878 >> v2:172.21.15.51:6800/950992045 conn(0x7f297402ab00 0x7f297402cfc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f298c016000 tx=0x7f298c009b30).stop 2020-06-27T04:45:27.044 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.898+0000 7f29a195f700 1 -- 172.21.15.31:0/3840259878 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f299c078930 msgr2=0x7f299c122cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:27.044 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.898+0000 7f29a195f700 1 --2- 172.21.15.31:0/3840259878 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f299c078930 0x7f299c122cb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f2994004830 tx=0x7f299400b040).stop 2020-06-27T04:45:27.045 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.898+0000 7f299bfff700 1 -- 172.21.15.31:0/3840259878 reap_dead start 2020-06-27T04:45:27.045 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.898+0000 7f29a195f700 1 -- 172.21.15.31:0/3840259878 shutdown_connections 2020-06-27T04:45:27.045 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.898+0000 7f29a195f700 1 -- 172.21.15.31:0/3840259878 >> 172.21.15.31:0/3840259878 conn(0x7f299c061840 msgr2=0x7f299c06d360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:27.045 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.898+0000 7f29a195f700 1 -- 172.21.15.31:0/3840259878 shutdown_connections 2020-06-27T04:45:27.045 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:26.898+0000 7f29a195f700 1 -- 172.21.15.31:0/3840259878 wait complete. 2020-06-27T04:45:27.046 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:26 smithi031 bash[18426]: cluster 2020-06-27T04:45:25.142450+0000 mgr.x (mgr.34109) 145 : cluster [DBG] pgmap v141: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 5 B/s, 0 objects/s recovering 2020-06-27T04:45:27.046 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:26 smithi031 bash[18426]: cephadm 2020-06-27T04:45:25.489371+0000 mgr.x (mgr.34109) 146 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2020-06-27T04:45:27.046 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:26 smithi031 bash[18426]: cephadm 2020-06-27T04:45:25.490385+0000 mgr.x (mgr.34109) 147 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi031 2020-06-27T04:45:27.046 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:26 smithi031 bash[22603]: cluster 2020-06-27T04:45:25.142450+0000 mgr.x (mgr.34109) 145 : cluster [DBG] pgmap v141: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 5 B/s, 0 objects/s recovering 2020-06-27T04:45:27.046 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:26 smithi031 bash[22603]: cephadm 2020-06-27T04:45:25.489371+0000 mgr.x (mgr.34109) 146 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2020-06-27T04:45:27.047 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:26 smithi031 bash[22603]: cephadm 2020-06-27T04:45:25.490385+0000 mgr.x (mgr.34109) 147 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi031 2020-06-27T04:45:27.049 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:26 smithi051 bash[18409]: cluster 2020-06-27T04:45:25.142450+0000 mgr.x (mgr.34109) 145 : cluster [DBG] pgmap v141: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 5 B/s, 0 objects/s recovering 2020-06-27T04:45:27.049 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:26 smithi051 bash[18409]: cephadm 2020-06-27T04:45:25.489371+0000 mgr.x (mgr.34109) 146 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2020-06-27T04:45:27.050 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:26 smithi051 bash[18409]: cephadm 2020-06-27T04:45:25.490385+0000 mgr.x (mgr.34109) 147 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi031 2020-06-27T04:45:27.050 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:26 smithi051 bash[31505]: t=2020-06-27T04:45:26+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2020-06-27T04:45:27.050 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:26 smithi051 bash[31505]: t=2020-06-27T04:45:26+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2020-06-27T04:45:27.367 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:27 smithi051 bash[31505]: t=2020-06-27T04:45:27+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2020-06-27T04:45:27.367 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:27 smithi051 bash[31505]: t=2020-06-27T04:45:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2020-06-27T04:45:27.368 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:27 smithi051 bash[31505]: t=2020-06-27T04:45:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2020-06-27T04:45:27.368 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:27 smithi051 bash[31505]: t=2020-06-27T04:45:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2020-06-27T04:45:27.368 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:27 smithi051 bash[31505]: t=2020-06-27T04:45:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2020-06-27T04:45:27.661 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:27 smithi051 bash[31505]: t=2020-06-27T04:45:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2020-06-27T04:45:27.661 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:27 smithi051 bash[31505]: t=2020-06-27T04:45:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2020-06-27T04:45:27.661 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:27 smithi051 bash[31505]: t=2020-06-27T04:45:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2020-06-27T04:45:27.661 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:27 smithi051 bash[31505]: t=2020-06-27T04:45:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2020-06-27T04:45:27.735 INFO:teuthology.orchestra.run.smithi031.stdout:47244640293 2020-06-27T04:45:27.736 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2020-06-27T04:45:27.881 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:27.928 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:27 smithi051 bash[31505]: t=2020-06-27T04:45:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2020-06-27T04:45:27.929 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:27 smithi051 bash[31505]: t=2020-06-27T04:45:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2020-06-27T04:45:27.929 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:27 smithi051 bash[31505]: t=2020-06-27T04:45:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2020-06-27T04:45:27.929 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:27 smithi051 bash[31505]: t=2020-06-27T04:45:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2020-06-27T04:45:28.180 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:28 smithi051 bash[18409]: cluster 2020-06-27T04:45:27.142957+0000 mgr.x (mgr.34109) 148 : cluster [DBG] pgmap v142: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 5 B/s, 0 objects/s recovering 2020-06-27T04:45:28.180 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:28 smithi051 bash[31505]: t=2020-06-27T04:45:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2020-06-27T04:45:28.181 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:28 smithi051 bash[31505]: t=2020-06-27T04:45:28+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2020-06-27T04:45:28.181 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:28 smithi051 bash[31505]: t=2020-06-27T04:45:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2020-06-27T04:45:28.181 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:28 smithi051 bash[31505]: t=2020-06-27T04:45:28+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2020-06-27T04:45:28.290 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:28 smithi031 bash[18426]: cluster 2020-06-27T04:45:27.142957+0000 mgr.x (mgr.34109) 148 : cluster [DBG] pgmap v142: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 5 B/s, 0 objects/s recovering 2020-06-27T04:45:28.291 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:28 smithi031 bash[22603]: cluster 2020-06-27T04:45:27.142957+0000 mgr.x (mgr.34109) 148 : cluster [DBG] pgmap v142: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 5 B/s, 0 objects/s recovering 2020-06-27T04:45:28.448 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:28 smithi051 bash[31505]: t=2020-06-27T04:45:28+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2020-06-27T04:45:28.448 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:28 smithi051 bash[31505]: t=2020-06-27T04:45:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2020-06-27T04:45:28.717 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:28 smithi051 bash[31505]: t=2020-06-27T04:45:28+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2020-06-27T04:45:28.718 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:28 smithi051 bash[31505]: t=2020-06-27T04:45:28+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2020-06-27T04:45:28.718 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:28 smithi051 bash[31505]: t=2020-06-27T04:45:28+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2020-06-27T04:45:28.718 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:28 smithi051 bash[31505]: t=2020-06-27T04:45:28+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2020-06-27T04:45:29.042 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:28 smithi051 bash[31505]: t=2020-06-27T04:45:28+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2020-06-27T04:45:29.043 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:28 smithi051 bash[31505]: t=2020-06-27T04:45:28+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2020-06-27T04:45:29.043 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:28 smithi051 bash[31505]: t=2020-06-27T04:45:28+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2020-06-27T04:45:29.043 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:28 smithi051 bash[31505]: t=2020-06-27T04:45:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2020-06-27T04:45:29.336 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:29 smithi051 bash[31505]: t=2020-06-27T04:45:29+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2020-06-27T04:45:29.336 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:29 smithi051 bash[31505]: t=2020-06-27T04:45:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2020-06-27T04:45:29.336 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:29 smithi051 bash[31505]: t=2020-06-27T04:45:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2020-06-27T04:45:29.336 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:29 smithi051 bash[31505]: t=2020-06-27T04:45:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2020-06-27T04:45:29.337 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:29 smithi051 bash[31505]: t=2020-06-27T04:45:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2020-06-27T04:45:29.511 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:29 smithi031 systemd[1]: Stopping Ceph alertmanager.a for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:45:29.644 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:29 smithi051 bash[31505]: t=2020-06-27T04:45:29+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2020-06-27T04:45:29.645 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:29 smithi051 bash[31505]: t=2020-06-27T04:45:29+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2020-06-27T04:45:29.645 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:29 smithi051 bash[31505]: t=2020-06-27T04:45:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2020-06-27T04:45:29.645 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:29 smithi051 bash[31505]: t=2020-06-27T04:45:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2020-06-27T04:45:29.824 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:29 smithi031 bash[34672]: level=info ts=2020-06-27T04:45:29.508Z caller=main.go:536 msg="Received SIGTERM, exiting gracefully..." 2020-06-27T04:45:29.825 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:29 smithi031 podman[36943]: 2020-06-27 04:45:29.715267122 +0000 UTC m=+0.321362948 container died e89f4ff5dfc2520cb117902af1f94d41e2df846c6bd40601350865308d233cdf (image=docker.io/prom/alertmanager:v0.20.0, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a) 2020-06-27T04:45:29.825 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:29 smithi031 podman[36943]: 2020-06-27 04:45:29.821937671 +0000 UTC m=+0.428033500 container stop e89f4ff5dfc2520cb117902af1f94d41e2df846c6bd40601350865308d233cdf (image=docker.io/prom/alertmanager:v0.20.0, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a) 2020-06-27T04:45:29.930 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:29 smithi051 bash[31505]: t=2020-06-27T04:45:29+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2020-06-27T04:45:29.930 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:29 smithi051 bash[31505]: t=2020-06-27T04:45:29+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2020-06-27T04:45:29.930 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:29 smithi051 bash[31505]: t=2020-06-27T04:45:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2020-06-27T04:45:30.124 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.824+0000 7fe9c359e700 1 Processor -- start 2020-06-27T04:45:30.124 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c359e700 1 -- start start 2020-06-27T04:45:30.124 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c359e700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fe9c40676c0 0x7fe9c406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:30.125 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c406bc70 0x7fe9c406d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:30.125 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c40785d0 0x7fe9c41250b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:30.125 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c4078c50 con 0x7fe9c40785d0 2020-06-27T04:45:30.125 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c359e700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c41255a0 con 0x7fe9c40676c0 2020-06-27T04:45:30.125 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c41256e0 con 0x7fe9c406bc70 2020-06-27T04:45:30.126 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c259c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c406bc70 0x7fe9c406d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:30.126 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c886d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c40785d0 0x7fe9c41250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:30.126 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c259c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c406bc70 0x7fe9c406d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35776/0 (socket says 172.21.15.31:35776) 2020-06-27T04:45:30.126 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c259c700 1 -- 172.21.15.31:0/761313152 learned_addr learned my addr 172.21.15.31:0/761313152 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:30.126 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c2d9d700 1 --2- 172.21.15.31:0/761313152 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fe9c40676c0 0x7fe9c406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:30.127 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c886d700 1 -- 172.21.15.31:0/761313152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c406bc70 msgr2=0x7fe9c406d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:30.127 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c886d700 1 --2- 172.21.15.31:0/761313152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c406bc70 0x7fe9c406d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:30.127 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c886d700 1 -- 172.21.15.31:0/761313152 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fe9c40676c0 msgr2=0x7fe9c406cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:30.127 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c886d700 1 --2- 172.21.15.31:0/761313152 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fe9c40676c0 0x7fe9c406cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:30.127 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c886d700 1 -- 172.21.15.31:0/761313152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c4125820 con 0x7fe9c40785d0 2020-06-27T04:45:30.127 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c259c700 1 --2- 172.21.15.31:0/761313152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c406bc70 0x7fe9c406d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:45:30.128 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.825+0000 7fe9c886d700 1 --2- 172.21.15.31:0/761313152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c40785d0 0x7fe9c41250b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fe9bc00c000 tx=0x7fe9bc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:30.128 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.826+0000 7fe9baffd700 1 -- 172.21.15.31:0/761313152 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9bc00c8d0 con 0x7fe9c40785d0 2020-06-27T04:45:30.128 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.826+0000 7fe9c359e700 1 -- 172.21.15.31:0/761313152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c4125a70 con 0x7fe9c40785d0 2020-06-27T04:45:30.128 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.826+0000 7fe9baffd700 1 -- 172.21.15.31:0/761313152 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fe9bc00f040 con 0x7fe9c40785d0 2020-06-27T04:45:30.128 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.826+0000 7fe9baffd700 1 -- 172.21.15.31:0/761313152 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9bc007d30 con 0x7fe9c40785d0 2020-06-27T04:45:30.129 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.826+0000 7fe9c359e700 1 -- 172.21.15.31:0/761313152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c4125fe0 con 0x7fe9c40785d0 2020-06-27T04:45:30.129 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.827+0000 7fe9baffd700 1 -- 172.21.15.31:0/761313152 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7fe9bc014460 con 0x7fe9c40785d0 2020-06-27T04:45:30.129 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.827+0000 7fe9c359e700 1 -- 172.21.15.31:0/761313152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe9c4056330 con 0x7fe9c40785d0 2020-06-27T04:45:30.129 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.827+0000 7fe9baffd700 1 --2- 172.21.15.31:0/761313152 >> v2:172.21.15.51:6800/950992045 conn(0x7fe99c02ab50 0x7fe99c02d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:30.129 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.827+0000 7fe9baffd700 1 -- 172.21.15.31:0/761313152 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7fe9bc03b180 con 0x7fe9c40785d0 2020-06-27T04:45:30.130 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.827+0000 7fe9baffd700 1 --2- 172.21.15.31:0/761313152 >> v2:172.21.15.31:6804/3103897888 conn(0x7fe99c033ad0 0x7fe99c035f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:30.130 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.827+0000 7fe9baffd700 1 -- 172.21.15.31:0/761313152 --> v2:172.21.15.31:6804/3103897888 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe99c0365a0 con 0x7fe99c033ad0 2020-06-27T04:45:30.130 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.827+0000 7fe9baffd700 1 -- 172.21.15.31:0/761313152 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9bc03d770 con 0x7fe9c40785d0 2020-06-27T04:45:30.130 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.827+0000 7fe9c2d9d700 1 --2- 172.21.15.31:0/761313152 >> v2:172.21.15.51:6800/950992045 conn(0x7fe99c02ab50 0x7fe99c02d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:30.130 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.827+0000 7fe9c259c700 1 --2- 172.21.15.31:0/761313152 >> v2:172.21.15.31:6804/3103897888 conn(0x7fe99c033ad0 0x7fe99c035f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:30.131 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.827+0000 7fe9c2d9d700 1 --2- 172.21.15.31:0/761313152 >> v2:172.21.15.51:6800/950992045 conn(0x7fe99c02ab50 0x7fe99c02d010 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fe9b400b000 tx=0x7fe9b400b040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:30.131 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.827+0000 7fe9c259c700 1 --2- 172.21.15.31:0/761313152 >> v2:172.21.15.31:6804/3103897888 conn(0x7fe99c033ad0 0x7fe99c035f70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:30.131 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.828+0000 7fe9baffd700 1 -- 172.21.15.31:0/761313152 <== osd.1 v2:172.21.15.31:6804/3103897888 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7fe99c0365a0 con 0x7fe99c033ad0 2020-06-27T04:45:30.131 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.846+0000 7fe9c359e700 1 -- 172.21.15.31:0/761313152 --> v2:172.21.15.31:6804/3103897888 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe9c40566d0 con 0x7fe99c033ad0 2020-06-27T04:45:30.131 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.846+0000 7fe9baffd700 1 -- 172.21.15.31:0/761313152 <== osd.1 v2:172.21.15.31:6804/3103897888 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe9c40566d0 con 0x7fe99c033ad0 2020-06-27T04:45:30.132 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.847+0000 7fe9c359e700 1 -- 172.21.15.31:0/761313152 >> v2:172.21.15.31:6804/3103897888 conn(0x7fe99c033ad0 msgr2=0x7fe99c035f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:30.132 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.847+0000 7fe9c359e700 1 --2- 172.21.15.31:0/761313152 >> v2:172.21.15.31:6804/3103897888 conn(0x7fe99c033ad0 0x7fe99c035f70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:30.132 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.847+0000 7fe9c359e700 1 -- 172.21.15.31:0/761313152 >> v2:172.21.15.51:6800/950992045 conn(0x7fe99c02ab50 msgr2=0x7fe99c02d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:30.132 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.847+0000 7fe9c359e700 1 --2- 172.21.15.31:0/761313152 >> v2:172.21.15.51:6800/950992045 conn(0x7fe99c02ab50 0x7fe99c02d010 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fe9b400b000 tx=0x7fe9b400b040).stop 2020-06-27T04:45:30.133 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.847+0000 7fe9c359e700 1 -- 172.21.15.31:0/761313152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c40785d0 msgr2=0x7fe9c41250b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:30.133 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.847+0000 7fe9c359e700 1 --2- 172.21.15.31:0/761313152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c40785d0 0x7fe9c41250b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fe9bc00c000 tx=0x7fe9bc00b040).stop 2020-06-27T04:45:30.133 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.847+0000 7fe9c886d700 1 -- 172.21.15.31:0/761313152 reap_dead start 2020-06-27T04:45:30.133 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.847+0000 7fe9c359e700 1 -- 172.21.15.31:0/761313152 shutdown_connections 2020-06-27T04:45:30.134 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.847+0000 7fe9c359e700 1 -- 172.21.15.31:0/761313152 >> 172.21.15.31:0/761313152 conn(0x7fe9c4025510 msgr2=0x7fe9c406da20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:30.134 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.847+0000 7fe9c359e700 1 -- 172.21.15.31:0/761313152 shutdown_connections 2020-06-27T04:45:30.134 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:29.847+0000 7fe9c359e700 1 -- 172.21.15.31:0/761313152 wait complete. 2020-06-27T04:45:30.134 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:29 smithi031 podman[36943]: e89f4ff5dfc2520cb117902af1f94d41e2df846c6bd40601350865308d233cdf 2020-06-27T04:45:30.190 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:29 smithi051 bash[31505]: t=2020-06-27T04:45:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2020-06-27T04:45:30.190 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:30 smithi051 bash[31505]: t=2020-06-27T04:45:30+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2020-06-27T04:45:30.190 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:30 smithi051 bash[31505]: t=2020-06-27T04:45:30+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2020-06-27T04:45:30.190 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:30 smithi051 bash[31505]: t=2020-06-27T04:45:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2020-06-27T04:45:30.191 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:30 smithi051 bash[31505]: t=2020-06-27T04:45:30+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2020-06-27T04:45:30.410 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:30 smithi031 bash[18426]: cluster 2020-06-27T04:45:29.143706+0000 mgr.x (mgr.34109) 149 : cluster [DBG] pgmap v143: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 4 B/s, 0 objects/s recovering 2020-06-27T04:45:30.410 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:30 smithi031 bash[22603]: cluster 2020-06-27T04:45:29.143706+0000 mgr.x (mgr.34109) 149 : cluster [DBG] pgmap v143: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 4 B/s, 0 objects/s recovering 2020-06-27T04:45:30.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:30 smithi051 bash[18409]: cluster 2020-06-27T04:45:29.143706+0000 mgr.x (mgr.34109) 149 : cluster [DBG] pgmap v143: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 4 B/s, 0 objects/s recovering 2020-06-27T04:45:30.468 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:30 smithi051 bash[31505]: t=2020-06-27T04:45:30+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2020-06-27T04:45:30.468 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:30 smithi051 bash[31505]: t=2020-06-27T04:45:30+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2020-06-27T04:45:30.468 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:30 smithi051 bash[31505]: t=2020-06-27T04:45:30+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2020-06-27T04:45:30.620 INFO:teuthology.orchestra.run.smithi031.stdout:73014444067 2020-06-27T04:45:30.621 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2020-06-27T04:45:30.687 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:30 smithi031 systemd[1]: Stopped Ceph alertmanager.a for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:45:30.688 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:30 smithi031 systemd[1]: Starting Ceph alertmanager.a for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:45:30.688 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:30 smithi031 podman[37066]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a found: no such container 2020-06-27T04:45:30.688 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:30 smithi031 systemd[1]: Started Ceph alertmanager.a for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:45:30.688 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:30 smithi031 bash[37082]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a found: no such container 2020-06-27T04:45:30.780 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:30.799 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:30 smithi051 bash[31505]: t=2020-06-27T04:45:30+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2020-06-27T04:45:30.799 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:30 smithi051 bash[31505]: t=2020-06-27T04:45:30+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2020-06-27T04:45:30.799 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:30 smithi051 bash[31505]: t=2020-06-27T04:45:30+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2020-06-27T04:45:30.799 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:30 smithi051 bash[31505]: t=2020-06-27T04:45:30+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2020-06-27T04:45:30.940 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:30 smithi031 bash[37082]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a 2020-06-27T04:45:30.940 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:30 smithi031 bash[37082]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a" found: no such container 2020-06-27T04:45:31.101 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:30 smithi051 bash[31505]: t=2020-06-27T04:45:30+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2020-06-27T04:45:31.101 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:30 smithi051 bash[31505]: t=2020-06-27T04:45:30+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2020-06-27T04:45:31.102 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:30 smithi051 bash[31505]: t=2020-06-27T04:45:30+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2020-06-27T04:45:31.190 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:30 smithi031 podman[37128]: 2020-06-27 04:45:30.937737976 +0000 UTC m=+0.238455071 container create f9fb95342d60592cf5f3f4f5b0feb538ef34fdb1cd5888ec8f630a5e95583426 (image=docker.io/prom/alertmanager:v0.20.0, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a) 2020-06-27T04:45:31.423 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:31 smithi051 bash[31505]: t=2020-06-27T04:45:31+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2020-06-27T04:45:31.423 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:31 smithi051 bash[31505]: t=2020-06-27T04:45:31+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2020-06-27T04:45:31.423 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:31 smithi051 bash[31505]: t=2020-06-27T04:45:31+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2020-06-27T04:45:31.424 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:31 smithi051 bash[18409]: audit 2020-06-27T04:45:30.619202+0000 mon.b (mon.2) 238 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479685\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479757\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479791\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479971\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480085\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480194\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480302\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480338\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:31.424 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:31 smithi051 bash[18409]: audit 2020-06-27T04:45:30.619853+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479685\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479757\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479791\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479971\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480085\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480194\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480302\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480338\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:31.424 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:31 smithi051 bash[18409]: audit 2020-06-27T04:45:30.623296+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479685\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479757\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479791\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479971\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480085\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480194\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480302\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480338\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:45:31.425 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:31 smithi051 bash[18409]: cephadm 2020-06-27T04:45:30.624556+0000 mgr.x (mgr.34109) 150 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2020-06-27T04:45:31.425 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:31 smithi051 bash[18409]: cephadm 2020-06-27T04:45:30.625946+0000 mgr.x (mgr.34109) 151 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi051 2020-06-27T04:45:31.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:31 smithi031 bash[22603]: audit 2020-06-27T04:45:30.619202+0000 mon.b (mon.2) 238 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479685\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479757\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479791\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479971\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480085\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480194\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480302\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480338\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:31.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:31 smithi031 bash[22603]: audit 2020-06-27T04:45:30.619853+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479685\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479757\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479791\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479971\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480085\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480194\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480302\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480338\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:31.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:31 smithi031 bash[22603]: audit 2020-06-27T04:45:30.623296+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479685\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479757\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479791\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479971\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480085\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480194\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480302\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480338\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:45:31.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:31 smithi031 bash[22603]: cephadm 2020-06-27T04:45:30.624556+0000 mgr.x (mgr.34109) 150 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2020-06-27T04:45:31.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:31 smithi031 bash[22603]: cephadm 2020-06-27T04:45:30.625946+0000 mgr.x (mgr.34109) 151 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi051 2020-06-27T04:45:31.476 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:31 smithi031 podman[37128]: 2020-06-27 04:45:31.255030234 +0000 UTC m=+0.555747241 container init f9fb95342d60592cf5f3f4f5b0feb538ef34fdb1cd5888ec8f630a5e95583426 (image=docker.io/prom/alertmanager:v0.20.0, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a) 2020-06-27T04:45:31.476 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:31 smithi031 podman[37128]: 2020-06-27 04:45:31.288336677 +0000 UTC m=+0.589053691 container start f9fb95342d60592cf5f3f4f5b0feb538ef34fdb1cd5888ec8f630a5e95583426 (image=docker.io/prom/alertmanager:v0.20.0, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a) 2020-06-27T04:45:31.477 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:31 smithi031 bash[37082]: level=info ts=2020-06-27T04:45:31.282Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2020-06-27T04:45:31.477 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:31 smithi031 bash[37082]: level=info ts=2020-06-27T04:45:31.282Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2020-06-27T04:45:31.477 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:31 smithi031 bash[37082]: level=info ts=2020-06-27T04:45:31.283Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.31 port=9094 2020-06-27T04:45:31.477 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:31 smithi031 bash[37082]: level=info ts=2020-06-27T04:45:31.284Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2020-06-27T04:45:31.477 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:31 smithi031 podman[37128]: 2020-06-27 04:45:31.288591636 +0000 UTC m=+0.589308689 container attach f9fb95342d60592cf5f3f4f5b0feb538ef34fdb1cd5888ec8f630a5e95583426 (image=docker.io/prom/alertmanager:v0.20.0, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-alertmanager.a) 2020-06-27T04:45:31.478 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:31 smithi031 bash[37082]: level=info ts=2020-06-27T04:45:31.303Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2020-06-27T04:45:31.478 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:31 smithi031 bash[37082]: level=info ts=2020-06-27T04:45:31.304Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2020-06-27T04:45:31.478 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:31 smithi031 bash[37082]: level=info ts=2020-06-27T04:45:31.307Z caller=main.go:497 msg=Listening address=:9093 2020-06-27T04:45:31.478 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:31 smithi031 bash[18426]: audit 2020-06-27T04:45:30.619202+0000 mon.b (mon.2) 238 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479685\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479757\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479791\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479971\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480085\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480194\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480302\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480338\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:31.479 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:31 smithi031 bash[18426]: audit 2020-06-27T04:45:30.619853+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479685\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479757\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479791\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479971\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480085\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480194\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480302\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480338\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:31.479 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:31 smithi031 bash[18426]: audit 2020-06-27T04:45:30.623296+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479685\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479757\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479791\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.479971\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480085\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480194\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480302\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.480338\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:45:31.479 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:31 smithi031 bash[18426]: cephadm 2020-06-27T04:45:30.624556+0000 mgr.x (mgr.34109) 150 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2020-06-27T04:45:31.479 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:31 smithi031 bash[18426]: cephadm 2020-06-27T04:45:30.625946+0000 mgr.x (mgr.34109) 151 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi051 2020-06-27T04:45:31.718 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:31 smithi051 bash[31505]: t=2020-06-27T04:45:31+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2020-06-27T04:45:31.718 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:31 smithi051 bash[31505]: t=2020-06-27T04:45:31+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2020-06-27T04:45:31.718 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:31 smithi051 bash[31505]: t=2020-06-27T04:45:31+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2020-06-27T04:45:31.718 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:31 smithi051 bash[31505]: t=2020-06-27T04:45:31+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2020-06-27T04:45:32.002 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:31 smithi051 bash[31505]: t=2020-06-27T04:45:31+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2020-06-27T04:45:32.003 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:31 smithi051 bash[31505]: t=2020-06-27T04:45:31+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2020-06-27T04:45:32.003 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:32 smithi051 bash[31505]: t=2020-06-27T04:45:32+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2020-06-27T04:45:32.623 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.620+0000 7f4bd0b6d700 1 Processor -- start 2020-06-27T04:45:32.624 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.620+0000 7f4bd0b6d700 1 -- start start 2020-06-27T04:45:32.624 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.621+0000 7f4bd0b6d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bcc0678c0 0x7f4bcc06ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:32.624 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.621+0000 7f4bd0b6d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bcc06be40 0x7f4bcc078300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:32.625 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.621+0000 7f4bd0b6d700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f4bcc078930 0x7f4bcc122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:32.625 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.621+0000 7f4bd0b6d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc123280 con 0x7f4bcc0678c0 2020-06-27T04:45:32.625 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.621+0000 7f4bd0b6d700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc1233f0 con 0x7f4bcc078930 2020-06-27T04:45:32.625 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.621+0000 7f4bd0b6d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc1235b0 con 0x7f4bcc06be40 2020-06-27T04:45:32.625 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.621+0000 7f4bcad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bcc0678c0 0x7f4bcc06ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:32.626 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.621+0000 7f4bca59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bcc06be40 0x7f4bcc078300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:32.626 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.621+0000 7f4bcad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bcc0678c0 0x7f4bcc06ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39542/0 (socket says 172.21.15.31:39542) 2020-06-27T04:45:32.626 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.621+0000 7f4bcad9d700 1 -- 172.21.15.31:0/3826503672 learned_addr learned my addr 172.21.15.31:0/3826503672 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:32.626 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.621+0000 7f4bcb59e700 1 --2- 172.21.15.31:0/3826503672 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f4bcc078930 0x7f4bcc122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:32.626 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.621+0000 7f4bca59c700 1 -- 172.21.15.31:0/3826503672 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f4bcc078930 msgr2=0x7f4bcc122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:32.627 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.621+0000 7f4bca59c700 1 --2- 172.21.15.31:0/3826503672 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f4bcc078930 0x7f4bcc122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:32.627 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.621+0000 7f4bca59c700 1 -- 172.21.15.31:0/3826503672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bcc0678c0 msgr2=0x7f4bcc06ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:32.627 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.621+0000 7f4bca59c700 1 --2- 172.21.15.31:0/3826503672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bcc0678c0 0x7f4bcc06ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:32.627 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.621+0000 7f4bca59c700 1 -- 172.21.15.31:0/3826503672 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc123770 con 0x7f4bcc06be40 2020-06-27T04:45:32.627 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.621+0000 7f4bca59c700 1 --2- 172.21.15.31:0/3826503672 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bcc06be40 0x7f4bcc078300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4bbc002f70 tx=0x7f4bbc009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:32.629 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:32 smithi051 bash[31505]: t=2020-06-27T04:45:32+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2020-06-27T04:45:32.629 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.622+0000 7f4bc2ffd700 1 -- 172.21.15.31:0/3826503672 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bbc00e030 con 0x7f4bcc06be40 2020-06-27T04:45:32.630 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.622+0000 7f4bc2ffd700 1 -- 172.21.15.31:0/3826503672 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f4bbc00bd10 con 0x7f4bcc06be40 2020-06-27T04:45:32.630 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.622+0000 7f4bd0b6d700 1 -- 172.21.15.31:0/3826503672 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bcc073ee0 con 0x7f4bcc06be40 2020-06-27T04:45:32.630 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.623+0000 7f4bc2ffd700 1 -- 172.21.15.31:0/3826503672 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bbc01c070 con 0x7f4bcc06be40 2020-06-27T04:45:32.630 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.623+0000 7f4bd0b6d700 1 -- 172.21.15.31:0/3826503672 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bcc074420 con 0x7f4bcc06be40 2020-06-27T04:45:32.630 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.623+0000 7f4bc2ffd700 1 -- 172.21.15.31:0/3826503672 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f4bbc021af0 con 0x7f4bcc06be40 2020-06-27T04:45:32.631 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.623+0000 7f4bc2ffd700 1 --2- 172.21.15.31:0/3826503672 >> v2:172.21.15.51:6800/950992045 conn(0x7f4ba402a990 0x7f4ba402ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:32.631 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.623+0000 7f4bc2ffd700 1 -- 172.21.15.31:0/3826503672 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7f4bbc040020 con 0x7f4bcc06be40 2020-06-27T04:45:32.631 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.623+0000 7f4bcad9d700 1 --2- 172.21.15.31:0/3826503672 >> v2:172.21.15.51:6800/950992045 conn(0x7f4ba402a990 0x7f4ba402ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:32.631 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.623+0000 7f4bd0b6d700 1 --2- 172.21.15.31:0/3826503672 >> v2:172.21.15.31:6808/3672781084 conn(0x7f4bcc06df30 0x7f4bcc0565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:32.631 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.623+0000 7f4bd0b6d700 1 -- 172.21.15.31:0/3826503672 --> v2:172.21.15.31:6808/3672781084 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4bcc05f390 con 0x7f4bcc06df30 2020-06-27T04:45:32.632 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.624+0000 7f4bcad9d700 1 --2- 172.21.15.31:0/3826503672 >> v2:172.21.15.51:6800/950992045 conn(0x7f4ba402a990 0x7f4ba402ce50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f4bb4004540 tx=0x7f4bb400b040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:32.632 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.624+0000 7f4bcb59e700 1 --2- 172.21.15.31:0/3826503672 >> v2:172.21.15.31:6808/3672781084 conn(0x7f4bcc06df30 0x7f4bcc0565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:32.632 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.624+0000 7f4bcb59e700 1 --2- 172.21.15.31:0/3826503672 >> v2:172.21.15.31:6808/3672781084 conn(0x7f4bcc06df30 0x7f4bcc0565d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:32.632 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.625+0000 7f4bc2ffd700 1 -- 172.21.15.31:0/3826503672 <== osd.2 v2:172.21.15.31:6808/3672781084 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f4bc400f040 con 0x7f4bcc06df30 2020-06-27T04:45:32.649 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.643+0000 7f4bd0b6d700 1 -- 172.21.15.31:0/3826503672 --> v2:172.21.15.31:6808/3672781084 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4bcc056ac0 con 0x7f4bcc06df30 2020-06-27T04:45:32.650 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.643+0000 7f4bc2ffd700 1 -- 172.21.15.31:0/3826503672 <== osd.2 v2:172.21.15.31:6808/3672781084 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4bcc056ac0 con 0x7f4bcc06df30 2020-06-27T04:45:32.650 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.643+0000 7f4bd0b6d700 1 -- 172.21.15.31:0/3826503672 >> v2:172.21.15.31:6808/3672781084 conn(0x7f4bcc06df30 msgr2=0x7f4bcc0565d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.643+0000 7f4bd0b6d700 1 --2- 172.21.15.31:0/3826503672 >> v2:172.21.15.31:6808/3672781084 conn(0x7f4bcc06df30 0x7f4bcc0565d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.643+0000 7f4bd0b6d700 1 -- 172.21.15.31:0/3826503672 >> v2:172.21.15.51:6800/950992045 conn(0x7f4ba402a990 msgr2=0x7f4ba402ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.643+0000 7f4bd0b6d700 1 --2- 172.21.15.31:0/3826503672 >> v2:172.21.15.51:6800/950992045 conn(0x7f4ba402a990 0x7f4ba402ce50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f4bb4004540 tx=0x7f4bb400b040).stop 2020-06-27T04:45:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.643+0000 7f4bd0b6d700 1 -- 172.21.15.31:0/3826503672 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bcc06be40 msgr2=0x7f4bcc078300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.643+0000 7f4bd0b6d700 1 --2- 172.21.15.31:0/3826503672 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bcc06be40 0x7f4bcc078300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4bbc002f70 tx=0x7f4bbc009b30).stop 2020-06-27T04:45:32.652 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.643+0000 7f4bcb59e700 1 -- 172.21.15.31:0/3826503672 reap_dead start 2020-06-27T04:45:32.652 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.643+0000 7f4bd0b6d700 1 -- 172.21.15.31:0/3826503672 shutdown_connections 2020-06-27T04:45:32.652 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.643+0000 7f4bd0b6d700 1 -- 172.21.15.31:0/3826503672 >> 172.21.15.31:0/3826503672 conn(0x7f4bcc061840 msgr2=0x7f4bcc063c30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:32.652 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.644+0000 7f4bd0b6d700 1 -- 172.21.15.31:0/3826503672 shutdown_connections 2020-06-27T04:45:32.652 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:32.644+0000 7f4bd0b6d700 1 -- 172.21.15.31:0/3826503672 wait complete. 2020-06-27T04:45:32.674 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:32 smithi031 bash[22603]: cluster 2020-06-27T04:45:31.144345+0000 mgr.x (mgr.34109) 152 : cluster [DBG] pgmap v144: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 3 B/s, 0 objects/s recovering 2020-06-27T04:45:32.675 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:32 smithi031 bash[18426]: cluster 2020-06-27T04:45:31.144345+0000 mgr.x (mgr.34109) 152 : cluster [DBG] pgmap v144: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 3 B/s, 0 objects/s recovering 2020-06-27T04:45:32.880 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:32 smithi051 bash[18409]: cluster 2020-06-27T04:45:31.144345+0000 mgr.x (mgr.34109) 152 : cluster [DBG] pgmap v144: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 3 B/s, 0 objects/s recovering 2020-06-27T04:45:32.880 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:32 smithi051 bash[31505]: t=2020-06-27T04:45:32+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2020-06-27T04:45:32.881 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:32 smithi051 bash[31505]: t=2020-06-27T04:45:32+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2020-06-27T04:45:33.153 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:32 smithi051 bash[31505]: t=2020-06-27T04:45:32+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2020-06-27T04:45:33.154 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:33 smithi051 bash[31505]: t=2020-06-27T04:45:33+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2020-06-27T04:45:33.154 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:33 smithi051 bash[31505]: t=2020-06-27T04:45:33+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2020-06-27T04:45:33.222 INFO:teuthology.orchestra.run.smithi031.stdout:94489280543 2020-06-27T04:45:33.223 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2020-06-27T04:45:33.373 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:33.456 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:33 smithi051 bash[31505]: t=2020-06-27T04:45:33+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2020-06-27T04:45:33.472 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:33 smithi031 bash[37082]: level=info ts=2020-06-27T04:45:33.284Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000054915s 2020-06-27T04:45:33.717 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:33 smithi051 bash[31505]: t=2020-06-27T04:45:33+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2020-06-27T04:45:33.718 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:33 smithi051 bash[31505]: t=2020-06-27T04:45:33+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2020-06-27T04:45:33.718 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:33 smithi051 bash[31505]: t=2020-06-27T04:45:33+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2020-06-27T04:45:33.718 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:33 smithi051 bash[31505]: t=2020-06-27T04:45:33+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2020-06-27T04:45:34.218 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:33 smithi051 bash[31505]: t=2020-06-27T04:45:33+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2020-06-27T04:45:34.218 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:33 smithi051 bash[31505]: t=2020-06-27T04:45:33+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2020-06-27T04:45:34.219 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[31505]: t=2020-06-27T04:45:34+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2020-06-27T04:45:34.709 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[18409]: cluster 2020-06-27T04:45:33.144909+0000 mgr.x (mgr.34109) 153 : cluster [DBG] pgmap v145: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 3 B/s, 0 objects/s recovering 2020-06-27T04:45:34.709 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[31505]: t=2020-06-27T04:45:34+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2020-06-27T04:45:34.710 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[31505]: t=2020-06-27T04:45:34+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2020-06-27T04:45:34.710 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[31505]: t=2020-06-27T04:45:34+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2020-06-27T04:45:34.748 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:34 smithi031 bash[18426]: cluster 2020-06-27T04:45:33.144909+0000 mgr.x (mgr.34109) 153 : cluster [DBG] pgmap v145: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 3 B/s, 0 objects/s recovering 2020-06-27T04:45:34.748 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:34 smithi031 bash[22603]: cluster 2020-06-27T04:45:33.144909+0000 mgr.x (mgr.34109) 153 : cluster [DBG] pgmap v145: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 3 B/s, 0 objects/s recovering 2020-06-27T04:45:34.960 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.957+0000 7feb49412700 1 Processor -- start 2020-06-27T04:45:34.961 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.957+0000 7feb49412700 1 -- start start 2020-06-27T04:45:34.961 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.957+0000 7feb49412700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb44066370 0x7feb4406cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:34.961 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.957+0000 7feb49412700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7feb4406be40 0x7feb44078380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:34.961 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.957+0000 7feb49412700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb440789b0 0x7feb44122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:34.962 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.957+0000 7feb49412700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb44123320 con 0x7feb44066370 2020-06-27T04:45:34.962 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.957+0000 7feb49412700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb44123490 con 0x7feb4406be40 2020-06-27T04:45:34.962 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.957+0000 7feb49412700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb44123650 con 0x7feb440789b0 2020-06-27T04:45:34.962 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.957+0000 7feb437fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb44066370 0x7feb4406cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:34.962 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.957+0000 7feb43fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb440789b0 0x7feb44122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:34.963 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.957+0000 7feb437fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb44066370 0x7feb4406cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39558/0 (socket says 172.21.15.31:39558) 2020-06-27T04:45:34.963 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.957+0000 7feb43fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb440789b0 0x7feb44122cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35808/0 (socket says 172.21.15.31:35808) 2020-06-27T04:45:34.963 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.957+0000 7feb437fe700 1 -- 172.21.15.31:0/1097427620 learned_addr learned my addr 172.21.15.31:0/1097427620 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:34.963 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.957+0000 7feb42ffd700 1 --2- 172.21.15.31:0/1097427620 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7feb4406be40 0x7feb44078380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:34.963 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.958+0000 7feb437fe700 1 -- 172.21.15.31:0/1097427620 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb440789b0 msgr2=0x7feb44122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:34.964 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.958+0000 7feb437fe700 1 --2- 172.21.15.31:0/1097427620 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb440789b0 0x7feb44122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:34.964 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.958+0000 7feb437fe700 1 -- 172.21.15.31:0/1097427620 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7feb4406be40 msgr2=0x7feb44078380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:34.964 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.958+0000 7feb437fe700 1 --2- 172.21.15.31:0/1097427620 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7feb4406be40 0x7feb44078380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:34.964 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.958+0000 7feb437fe700 1 -- 172.21.15.31:0/1097427620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb44123810 con 0x7feb44066370 2020-06-27T04:45:34.964 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.958+0000 7feb43fff700 1 --2- 172.21.15.31:0/1097427620 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb440789b0 0x7feb44122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:45:34.965 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.958+0000 7feb437fe700 1 --2- 172.21.15.31:0/1097427620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb44066370 0x7feb4406cd50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7feb34002f70 tx=0x7feb34009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:34.965 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.958+0000 7feb2b7fe700 1 -- 172.21.15.31:0/1097427620 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb3400e030 con 0x7feb44066370 2020-06-27T04:45:34.965 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.958+0000 7feb2b7fe700 1 -- 172.21.15.31:0/1097427620 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7feb34013cb0 con 0x7feb44066370 2020-06-27T04:45:34.965 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.958+0000 7feb49412700 1 -- 172.21.15.31:0/1097427620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb44123a60 con 0x7feb44066370 2020-06-27T04:45:34.965 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.958+0000 7feb2b7fe700 1 -- 172.21.15.31:0/1097427620 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb34018070 con 0x7feb44066370 2020-06-27T04:45:34.966 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.958+0000 7feb49412700 1 -- 172.21.15.31:0/1097427620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb44123f20 con 0x7feb44066370 2020-06-27T04:45:34.967 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.959+0000 7feb2b7fe700 1 -- 172.21.15.31:0/1097427620 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7feb3401db60 con 0x7feb44066370 2020-06-27T04:45:34.967 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.959+0000 7feb2b7fe700 1 --2- 172.21.15.31:0/1097427620 >> v2:172.21.15.51:6800/950992045 conn(0x7feb1c02ab00 0x7feb1c02cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:34.968 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.959+0000 7feb49412700 1 -- 172.21.15.31:0/1097427620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feb4406dce0 con 0x7feb44066370 2020-06-27T04:45:34.968 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.959+0000 7feb2b7fe700 1 -- 172.21.15.31:0/1097427620 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7feb3403cca0 con 0x7feb44066370 2020-06-27T04:45:34.968 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.959+0000 7feb42ffd700 1 --2- 172.21.15.31:0/1097427620 >> v2:172.21.15.51:6800/950992045 conn(0x7feb1c02ab00 0x7feb1c02cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:34.968 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.959+0000 7feb2b7fe700 1 --2- 172.21.15.31:0/1097427620 >> v2:172.21.15.31:6812/772723559 conn(0x7feb1c033980 0x7feb1c035e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:34.968 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.959+0000 7feb2b7fe700 1 -- 172.21.15.31:0/1097427620 --> v2:172.21.15.31:6812/772723559 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb1c036450 con 0x7feb1c033980 2020-06-27T04:45:34.969 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.959+0000 7feb2b7fe700 1 -- 172.21.15.31:0/1097427620 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb3401de40 con 0x7feb44066370 2020-06-27T04:45:34.969 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.959+0000 7feb43fff700 1 --2- 172.21.15.31:0/1097427620 >> v2:172.21.15.31:6812/772723559 conn(0x7feb1c033980 0x7feb1c035e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:34.969 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.959+0000 7feb42ffd700 1 --2- 172.21.15.31:0/1097427620 >> v2:172.21.15.51:6800/950992045 conn(0x7feb1c02ab00 0x7feb1c02cfc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7feb3800b000 tx=0x7feb3800b040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:34.969 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.959+0000 7feb43fff700 1 --2- 172.21.15.31:0/1097427620 >> v2:172.21.15.31:6812/772723559 conn(0x7feb1c033980 0x7feb1c035e20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:34.969 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.960+0000 7feb2b7fe700 1 -- 172.21.15.31:0/1097427620 <== osd.3 v2:172.21.15.31:6812/772723559 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7feb1c036450 con 0x7feb1c033980 2020-06-27T04:45:34.970 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[31505]: t=2020-06-27T04:45:34+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2020-06-27T04:45:34.970 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[31505]: t=2020-06-27T04:45:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2020-06-27T04:45:34.971 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:34 smithi051 systemd[1]: Stopping Ceph prometheus.a for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:45:34.971 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[30532]: level=warn ts=2020-06-27T04:45:34.762Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2020-06-27T04:45:34.971 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[30532]: level=info ts=2020-06-27T04:45:34.762Z caller=main.go:547 msg="Stopping scrape discovery manager..." 2020-06-27T04:45:34.971 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[30532]: level=info ts=2020-06-27T04:45:34.762Z caller=main.go:561 msg="Stopping notify discovery manager..." 2020-06-27T04:45:34.972 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[30532]: level=info ts=2020-06-27T04:45:34.762Z caller=main.go:583 msg="Stopping scrape manager..." 2020-06-27T04:45:34.972 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[30532]: level=info ts=2020-06-27T04:45:34.762Z caller=main.go:543 msg="Scrape discovery manager stopped" 2020-06-27T04:45:34.972 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[30532]: level=info ts=2020-06-27T04:45:34.762Z caller=manager.go:882 component="rule manager" msg="Stopping rule manager..." 2020-06-27T04:45:34.972 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[30532]: level=info ts=2020-06-27T04:45:34.762Z caller=manager.go:892 component="rule manager" msg="Rule manager stopped" 2020-06-27T04:45:34.972 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[30532]: level=info ts=2020-06-27T04:45:34.762Z caller=main.go:557 msg="Notify discovery manager stopped" 2020-06-27T04:45:34.973 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[30532]: level=info ts=2020-06-27T04:45:34.762Z caller=main.go:577 msg="Scrape manager stopped" 2020-06-27T04:45:34.973 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[30532]: level=info ts=2020-06-27T04:45:34.762Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2020-06-27T04:45:34.973 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[30532]: level=info ts=2020-06-27T04:45:34.762Z caller=main.go:749 msg="Notifier manager stopped" 2020-06-27T04:45:34.973 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:34 smithi051 bash[30532]: level=info ts=2020-06-27T04:45:34.763Z caller=main.go:761 msg="See you next time!" 2020-06-27T04:45:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.978+0000 7feb49412700 1 -- 172.21.15.31:0/1097427620 --> v2:172.21.15.31:6812/772723559 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feb4406e080 con 0x7feb1c033980 2020-06-27T04:45:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.978+0000 7feb2b7fe700 1 -- 172.21.15.31:0/1097427620 <== osd.3 v2:172.21.15.31:6812/772723559 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7feb4406e080 con 0x7feb1c033980 2020-06-27T04:45:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.978+0000 7feb49412700 1 -- 172.21.15.31:0/1097427620 >> v2:172.21.15.31:6812/772723559 conn(0x7feb1c033980 msgr2=0x7feb1c035e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.978+0000 7feb49412700 1 --2- 172.21.15.31:0/1097427620 >> v2:172.21.15.31:6812/772723559 conn(0x7feb1c033980 0x7feb1c035e20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:34.983 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.978+0000 7feb49412700 1 -- 172.21.15.31:0/1097427620 >> v2:172.21.15.51:6800/950992045 conn(0x7feb1c02ab00 msgr2=0x7feb1c02cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:34.983 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.978+0000 7feb49412700 1 --2- 172.21.15.31:0/1097427620 >> v2:172.21.15.51:6800/950992045 conn(0x7feb1c02ab00 0x7feb1c02cfc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7feb3800b000 tx=0x7feb3800b040).stop 2020-06-27T04:45:34.983 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.978+0000 7feb49412700 1 -- 172.21.15.31:0/1097427620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb44066370 msgr2=0x7feb4406cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:34.983 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.978+0000 7feb49412700 1 --2- 172.21.15.31:0/1097427620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb44066370 0x7feb4406cd50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7feb34002f70 tx=0x7feb34009b30).stop 2020-06-27T04:45:34.984 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.978+0000 7feb43fff700 1 -- 172.21.15.31:0/1097427620 reap_dead start 2020-06-27T04:45:34.984 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.978+0000 7feb49412700 1 -- 172.21.15.31:0/1097427620 shutdown_connections 2020-06-27T04:45:34.984 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.978+0000 7feb49412700 1 -- 172.21.15.31:0/1097427620 >> 172.21.15.31:0/1097427620 conn(0x7feb44061840 msgr2=0x7feb4406d360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:34.984 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.979+0000 7feb49412700 1 -- 172.21.15.31:0/1097427620 shutdown_connections 2020-06-27T04:45:34.984 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:34.979+0000 7feb49412700 1 -- 172.21.15.31:0/1097427620 wait complete. 2020-06-27T04:45:35.468 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:35 smithi051 podman[32151]: 2020-06-27 04:45:35.00751276 +0000 UTC m=+0.285533954 container died 87a0fe4361d1d3732cd08c465d59ed7162650f63f9a135381671018191d4d8d6 (image=docker.io/prom/prometheus:v2.18.1, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a) 2020-06-27T04:45:35.468 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:35 smithi051 podman[32151]: 2020-06-27 04:45:35.067001942 +0000 UTC m=+0.345023135 container stop 87a0fe4361d1d3732cd08c465d59ed7162650f63f9a135381671018191d4d8d6 (image=docker.io/prom/prometheus:v2.18.1, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a) 2020-06-27T04:45:35.468 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:35 smithi051 podman[32151]: 87a0fe4361d1d3732cd08c465d59ed7162650f63f9a135381671018191d4d8d6 2020-06-27T04:45:35.468 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:35 smithi051 bash[31505]: t=2020-06-27T04:45:35+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2020-06-27T04:45:35.469 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:35 smithi051 bash[31505]: t=2020-06-27T04:45:35+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2020-06-27T04:45:35.472 INFO:teuthology.orchestra.run.smithi031.stdout:115964117022 2020-06-27T04:45:35.472 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2020-06-27T04:45:35.616 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:35.856 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:35 smithi051 bash[31505]: t=2020-06-27T04:45:35+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2020-06-27T04:45:35.857 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:35 smithi051 bash[31505]: t=2020-06-27T04:45:35+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2020-06-27T04:45:35.857 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:35 smithi051 bash[31505]: t=2020-06-27T04:45:35+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2020-06-27T04:45:35.857 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:35 smithi051 systemd[1]: Stopped Ceph prometheus.a for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:45:35.857 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:35 smithi051 systemd[1]: Starting Ceph prometheus.a for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:45:35.857 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:35 smithi051 podman[32199]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a found: no such container 2020-06-27T04:45:35.858 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:35 smithi051 systemd[1]: Started Ceph prometheus.a for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:45:36.176 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:35 smithi051 bash[32215]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a found: no such container 2020-06-27T04:45:36.176 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:35 smithi051 bash[32215]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a 2020-06-27T04:45:36.177 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:35 smithi051 bash[32215]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a" found: no such container 2020-06-27T04:45:36.177 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:35 smithi051 bash[31505]: t=2020-06-27T04:45:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2020-06-27T04:45:36.177 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:35 smithi051 bash[31505]: t=2020-06-27T04:45:35+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2020-06-27T04:45:36.177 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[31505]: t=2020-06-27T04:45:36+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2020-06-27T04:45:36.471 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 podman[32248]: 2020-06-27 04:45:36.375321427 +0000 UTC m=+0.463098440 container create f55c20db5bf8ac96b240fa4fc793fe04e380739f1da3a7b83362a5327a9b6d10 (image=docker.io/prom/prometheus:v2.18.1, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a) 2020-06-27T04:45:36.472 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[31505]: t=2020-06-27T04:45:36+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2020-06-27T04:45:36.472 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[31505]: t=2020-06-27T04:45:36+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2020-06-27T04:45:36.789 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[31505]: t=2020-06-27T04:45:36+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2020-06-27T04:45:36.789 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[31505]: t=2020-06-27T04:45:36+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2020-06-27T04:45:36.789 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[31505]: t=2020-06-27T04:45:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2020-06-27T04:45:36.790 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: cluster 2020-06-27T04:45:35.145389+0000 mgr.x (mgr.34109) 154 : cluster [DBG] pgmap v146: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2020-06-27T04:45:36.790 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.824550+0000 mon.b (mon.2) 239 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354760\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354899\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355097\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355213\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355323\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355477\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355506\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:36.790 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.825117+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354760\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354899\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355097\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355213\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355323\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355477\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355506\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:36.791 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.829903+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354760\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354899\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355097\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355213\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355323\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355477\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355506\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:45:36.791 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.831044+0000 mon.b (mon.2) 240 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:45:36.791 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.832590+0000 mon.b (mon.2) 241 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi031:9093"}]: dispatch 2020-06-27T04:45:36.791 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.833167+0000 mon.b (mon.2) 242 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi031:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2020-06-27T04:45:36.792 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.833709+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi031:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2020-06-27T04:45:36.792 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.838847+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi031:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2020-06-27T04:45:36.792 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.840724+0000 mon.b (mon.2) 243 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:45:36.792 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.846509+0000 mon.b (mon.2) 244 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi051:9095"}]: dispatch 2020-06-27T04:45:36.792 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.847172+0000 mon.b (mon.2) 245 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi051:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2020-06-27T04:45:36.793 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.847449+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi051:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2020-06-27T04:45:36.793 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.852471+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi051:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2020-06-27T04:45:36.793 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.856152+0000 mon.b (mon.2) 246 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:45:36.793 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.860738+0000 mon.b (mon.2) 247 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi051:3000"}]: dispatch 2020-06-27T04:45:36.793 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.861253+0000 mon.b (mon.2) 248 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config set","value":"https://smithi051:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2020-06-27T04:45:36.794 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.861510+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"https://smithi051:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2020-06-27T04:45:36.794 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.866683+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"https://smithi051:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2020-06-27T04:45:36.794 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.869823+0000 mon.b (mon.2) 249 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:45:36.794 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[18409]: audit 2020-06-27T04:45:35.870089+0000 mon.b (mon.2) 250 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:45:36.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: cluster 2020-06-27T04:45:35.145389+0000 mgr.x (mgr.34109) 154 : cluster [DBG] pgmap v146: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2020-06-27T04:45:36.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.824550+0000 mon.b (mon.2) 239 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354760\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354899\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355097\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355213\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355323\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355477\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355506\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:36.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.825117+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354760\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354899\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355097\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355213\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355323\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355477\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355506\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:36.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.829903+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354760\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354899\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355097\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355213\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355323\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355477\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355506\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:45:36.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.831044+0000 mon.b (mon.2) 240 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:45:36.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.832590+0000 mon.b (mon.2) 241 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi031:9093"}]: dispatch 2020-06-27T04:45:36.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.833167+0000 mon.b (mon.2) 242 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi031:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2020-06-27T04:45:36.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.833709+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi031:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2020-06-27T04:45:36.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.838847+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi031:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2020-06-27T04:45:36.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.840724+0000 mon.b (mon.2) 243 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:45:36.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.846509+0000 mon.b (mon.2) 244 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi051:9095"}]: dispatch 2020-06-27T04:45:36.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.847172+0000 mon.b (mon.2) 245 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi051:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2020-06-27T04:45:36.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.847449+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi051:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2020-06-27T04:45:36.978 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.852471+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi051:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2020-06-27T04:45:36.979 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.856152+0000 mon.b (mon.2) 246 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:45:36.979 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.860738+0000 mon.b (mon.2) 247 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi051:3000"}]: dispatch 2020-06-27T04:45:36.979 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.861253+0000 mon.b (mon.2) 248 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config set","value":"https://smithi051:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2020-06-27T04:45:36.979 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.861510+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"https://smithi051:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2020-06-27T04:45:36.979 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.866683+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"https://smithi051:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2020-06-27T04:45:36.980 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.869823+0000 mon.b (mon.2) 249 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:45:36.980 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[18426]: audit 2020-06-27T04:45:35.870089+0000 mon.b (mon.2) 250 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:45:36.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: cluster 2020-06-27T04:45:35.145389+0000 mgr.x (mgr.34109) 154 : cluster [DBG] pgmap v146: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2020-06-27T04:45:36.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.824550+0000 mon.b (mon.2) 239 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354760\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354899\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355097\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355213\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355323\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355477\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355506\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:36.981 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.825117+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354760\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354899\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355097\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355213\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355323\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355477\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355506\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:36.981 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.829903+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354760\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.354899\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355097\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355213\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355323\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355477\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:25.355506\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:45:36.981 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.831044+0000 mon.b (mon.2) 240 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:45:36.981 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.832590+0000 mon.b (mon.2) 241 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi031:9093"}]: dispatch 2020-06-27T04:45:36.982 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.833167+0000 mon.b (mon.2) 242 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi031:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2020-06-27T04:45:36.982 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.833709+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi031:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2020-06-27T04:45:36.982 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.838847+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi031:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2020-06-27T04:45:36.982 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.840724+0000 mon.b (mon.2) 243 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:45:36.982 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.846509+0000 mon.b (mon.2) 244 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi051:9095"}]: dispatch 2020-06-27T04:45:36.983 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.847172+0000 mon.b (mon.2) 245 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi051:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2020-06-27T04:45:36.983 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.847449+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi051:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2020-06-27T04:45:36.983 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.852471+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi051:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2020-06-27T04:45:36.983 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.856152+0000 mon.b (mon.2) 246 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:45:36.983 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.860738+0000 mon.b (mon.2) 247 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi051:3000"}]: dispatch 2020-06-27T04:45:36.984 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.861253+0000 mon.b (mon.2) 248 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config set","value":"https://smithi051:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2020-06-27T04:45:36.984 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.861510+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"https://smithi051:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2020-06-27T04:45:36.984 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.866683+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"https://smithi051:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2020-06-27T04:45:36.984 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.869823+0000 mon.b (mon.2) 249 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:45:36.984 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:36 smithi031 bash[22603]: audit 2020-06-27T04:45:35.870089+0000 mon.b (mon.2) 250 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:45:37.056 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[31505]: t=2020-06-27T04:45:36+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2020-06-27T04:45:37.057 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[31505]: t=2020-06-27T04:45:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2020-06-27T04:45:37.057 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[31505]: t=2020-06-27T04:45:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2020-06-27T04:45:37.057 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 podman[32248]: 2020-06-27 04:45:36.786446237 +0000 UTC m=+0.874223268 container init f55c20db5bf8ac96b240fa4fc793fe04e380739f1da3a7b83362a5327a9b6d10 (image=docker.io/prom/prometheus:v2.18.1, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a) 2020-06-27T04:45:37.057 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 podman[32248]: 2020-06-27 04:45:36.881698462 +0000 UTC m=+0.969475470 container start f55c20db5bf8ac96b240fa4fc793fe04e380739f1da3a7b83362a5327a9b6d10 (image=docker.io/prom/prometheus:v2.18.1, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a) 2020-06-27T04:45:37.057 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 podman[32248]: 2020-06-27 04:45:36.881968475 +0000 UTC m=+0.969745515 container attach f55c20db5bf8ac96b240fa4fc793fe04e380739f1da3a7b83362a5327a9b6d10 (image=docker.io/prom/prometheus:v2.18.1, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-prometheus.a) 2020-06-27T04:45:37.058 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[32215]: level=info ts=2020-06-27T04:45:36.829Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2020-06-27T04:45:37.058 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[32215]: level=info ts=2020-06-27T04:45:36.829Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2020-06-27T04:45:37.058 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[32215]: level=info ts=2020-06-27T04:45:36.829Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2020-06-27T04:45:37.058 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[32215]: level=info ts=2020-06-27T04:45:36.829Z caller=main.go:339 host_details="(Linux 4.18.0-193.6.3.el8_2.x86_64 #1 SMP Wed Jun 10 11:09:32 UTC 2020 x86_64 smithi051 (none))" 2020-06-27T04:45:37.058 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[32215]: level=info ts=2020-06-27T04:45:36.829Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2020-06-27T04:45:37.059 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[32215]: level=info ts=2020-06-27T04:45:36.829Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2020-06-27T04:45:37.059 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[32215]: level=info ts=2020-06-27T04:45:36.831Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2020-06-27T04:45:37.059 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[32215]: level=info ts=2020-06-27T04:45:36.831Z caller=main.go:678 msg="Starting TSDB ..." 2020-06-27T04:45:37.059 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[32215]: level=info ts=2020-06-27T04:45:36.834Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2020-06-27T04:45:37.059 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[32215]: level=info ts=2020-06-27T04:45:36.834Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2020-06-27T04:45:37.060 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[32215]: level=info ts=2020-06-27T04:45:36.835Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2020-06-27T04:45:37.060 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[32215]: level=info ts=2020-06-27T04:45:36.835Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=313.943µs 2020-06-27T04:45:37.060 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[32215]: level=info ts=2020-06-27T04:45:36.835Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2020-06-27T04:45:37.060 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[32215]: level=info ts=2020-06-27T04:45:36.835Z caller=main.go:695 msg="TSDB started" 2020-06-27T04:45:37.060 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[32215]: level=info ts=2020-06-27T04:45:36.835Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2020-06-27T04:45:37.061 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[32215]: level=info ts=2020-06-27T04:45:36.836Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2020-06-27T04:45:37.061 INFO:ceph.prometheus.a.smithi051.stdout:Jun 27 04:45:36 smithi051 bash[32215]: level=info ts=2020-06-27T04:45:36.836Z caller=main.go:646 msg="Server is ready to receive web requests." 2020-06-27T04:45:37.254 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.250+0000 7f696cc13700 1 Processor -- start 2020-06-27T04:45:37.254 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.250+0000 7f696cc13700 1 -- start start 2020-06-27T04:45:37.254 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.250+0000 7f696cc13700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69680678c0 0x7f6968074330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:37.254 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.250+0000 7f696cc13700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f696806be40 0x7f6968074a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:37.255 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.250+0000 7f696cc13700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6968077930 0x7f6968077db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:37.255 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.250+0000 7f696cc13700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6968078400 con 0x7f6968077930 2020-06-27T04:45:37.255 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.250+0000 7f696cc13700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6968078570 con 0x7f696806be40 2020-06-27T04:45:37.255 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.250+0000 7f696cc13700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6968078730 con 0x7f69680678c0 2020-06-27T04:45:37.255 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.251+0000 7f696659c700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f696806be40 0x7f6968074a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:37.256 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.251+0000 7f696659c700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f696806be40 0x7f6968074a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.51:3300/0 says I am v2:172.21.15.31:42446/0 (socket says 172.21.15.31:42446) 2020-06-27T04:45:37.256 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.251+0000 7f696659c700 1 -- 172.21.15.31:0/2310972326 learned_addr learned my addr 172.21.15.31:0/2310972326 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:37.256 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.251+0000 7f6966d9d700 1 --2- 172.21.15.31:0/2310972326 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69680678c0 0x7f6968074330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:37.256 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.251+0000 7f696759e700 1 --2- 172.21.15.31:0/2310972326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6968077930 0x7f6968077db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:37.256 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.251+0000 7f696659c700 1 -- 172.21.15.31:0/2310972326 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69680678c0 msgr2=0x7f6968074330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:37.257 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.251+0000 7f696659c700 1 --2- 172.21.15.31:0/2310972326 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69680678c0 0x7f6968074330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:37.257 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.251+0000 7f696659c700 1 -- 172.21.15.31:0/2310972326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6968077930 msgr2=0x7f6968077db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:37.257 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.251+0000 7f696659c700 1 --2- 172.21.15.31:0/2310972326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6968077930 0x7f6968077db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:37.257 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.251+0000 7f696659c700 1 -- 172.21.15.31:0/2310972326 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69680788f0 con 0x7f696806be40 2020-06-27T04:45:37.257 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.251+0000 7f696759e700 1 --2- 172.21.15.31:0/2310972326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6968077930 0x7f6968077db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-27T04:45:37.258 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.251+0000 7f696659c700 1 --2- 172.21.15.31:0/2310972326 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f696806be40 0x7f6968074a20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f695c002f70 tx=0x7f695c009b30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:37.258 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.251+0000 7f6956ffd700 1 -- 172.21.15.31:0/2310972326 <== mon.2 v2:172.21.15.51:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f695c01a070 con 0x7f696806be40 2020-06-27T04:45:37.258 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.251+0000 7f6956ffd700 1 -- 172.21.15.31:0/2310972326 <== mon.2 v2:172.21.15.51:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f695c0138b0 con 0x7f696806be40 2020-06-27T04:45:37.258 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.251+0000 7f696cc13700 1 -- 172.21.15.31:0/2310972326 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6968078b40 con 0x7f696806be40 2020-06-27T04:45:37.258 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.251+0000 7f6956ffd700 1 -- 172.21.15.31:0/2310972326 <== mon.2 v2:172.21.15.51:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f695c00e040 con 0x7f696806be40 2020-06-27T04:45:37.259 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.251+0000 7f696cc13700 1 -- 172.21.15.31:0/2310972326 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6968122e70 con 0x7f696806be40 2020-06-27T04:45:37.260 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.252+0000 7f696cc13700 1 -- 172.21.15.31:0/2310972326 --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f69680693a0 con 0x7f696806be40 2020-06-27T04:45:37.260 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.252+0000 7f6956ffd700 1 -- 172.21.15.31:0/2310972326 <== mon.2 v2:172.21.15.51:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f695c026060 con 0x7f696806be40 2020-06-27T04:45:37.260 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.252+0000 7f6956ffd700 1 --2- 172.21.15.31:0/2310972326 >> v2:172.21.15.51:6800/950992045 conn(0x7f694802aab0 0x7f694802cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:37.261 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.252+0000 7f6956ffd700 1 -- 172.21.15.31:0/2310972326 <== mon.2 v2:172.21.15.51:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7f695c03c150 con 0x7f696806be40 2020-06-27T04:45:37.261 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.252+0000 7f6956ffd700 1 --2- 172.21.15.31:0/2310972326 >> v2:172.21.15.51:6801/3547494673 conn(0x7f6948033930 0x7f6948035dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:37.261 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.253+0000 7f6956ffd700 1 -- 172.21.15.31:0/2310972326 --> v2:172.21.15.51:6801/3547494673 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6948036400 con 0x7f6948033930 2020-06-27T04:45:37.261 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.253+0000 7f6956ffd700 1 -- 172.21.15.31:0/2310972326 <== mon.2 v2:172.21.15.51:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f695c01f6d0 con 0x7f696806be40 2020-06-27T04:45:37.261 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.253+0000 7f6966d9d700 1 --2- 172.21.15.31:0/2310972326 >> v2:172.21.15.51:6800/950992045 conn(0x7f694802aab0 0x7f694802cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:37.262 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.253+0000 7f696759e700 1 --2- 172.21.15.31:0/2310972326 >> v2:172.21.15.51:6801/3547494673 conn(0x7f6948033930 0x7f6948035dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:37.262 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.253+0000 7f6966d9d700 1 --2- 172.21.15.31:0/2310972326 >> v2:172.21.15.51:6800/950992045 conn(0x7f694802aab0 0x7f694802cf70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f695800b000 tx=0x7f695800b040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:37.262 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.253+0000 7f696759e700 1 --2- 172.21.15.31:0/2310972326 >> v2:172.21.15.51:6801/3547494673 conn(0x7f6948033930 0x7f6948035dd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:37.262 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.254+0000 7f6956ffd700 1 -- 172.21.15.31:0/2310972326 <== osd.4 v2:172.21.15.51:6801/3547494673 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f6948036400 con 0x7f6948033930 2020-06-27T04:45:37.275 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.273+0000 7f696cc13700 1 -- 172.21.15.31:0/2310972326 --> v2:172.21.15.51:6801/3547494673 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6968069740 con 0x7f6948033930 2020-06-27T04:45:37.275 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.273+0000 7f6956ffd700 1 -- 172.21.15.31:0/2310972326 <== osd.4 v2:172.21.15.51:6801/3547494673 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6968069740 con 0x7f6948033930 2020-06-27T04:45:37.276 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.273+0000 7f696cc13700 1 -- 172.21.15.31:0/2310972326 >> v2:172.21.15.51:6801/3547494673 conn(0x7f6948033930 msgr2=0x7f6948035dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:37.276 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.273+0000 7f696cc13700 1 --2- 172.21.15.31:0/2310972326 >> v2:172.21.15.51:6801/3547494673 conn(0x7f6948033930 0x7f6948035dd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:37.277 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.274+0000 7f696cc13700 1 -- 172.21.15.31:0/2310972326 >> v2:172.21.15.51:6800/950992045 conn(0x7f694802aab0 msgr2=0x7f694802cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:37.277 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.274+0000 7f696cc13700 1 --2- 172.21.15.31:0/2310972326 >> v2:172.21.15.51:6800/950992045 conn(0x7f694802aab0 0x7f694802cf70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f695800b000 tx=0x7f695800b040).stop 2020-06-27T04:45:37.277 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.274+0000 7f696cc13700 1 -- 172.21.15.31:0/2310972326 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f696806be40 msgr2=0x7f6968074a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:37.277 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.274+0000 7f696cc13700 1 --2- 172.21.15.31:0/2310972326 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f696806be40 0x7f6968074a20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f695c002f70 tx=0x7f695c009b30).stop 2020-06-27T04:45:37.278 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.274+0000 7f696759e700 1 -- 172.21.15.31:0/2310972326 reap_dead start 2020-06-27T04:45:37.278 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.274+0000 7f696cc13700 1 -- 172.21.15.31:0/2310972326 shutdown_connections 2020-06-27T04:45:37.278 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.274+0000 7f696cc13700 1 -- 172.21.15.31:0/2310972326 >> 172.21.15.31:0/2310972326 conn(0x7f6968061840 msgr2=0x7f696806b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:37.278 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.274+0000 7f696cc13700 1 -- 172.21.15.31:0/2310972326 shutdown_connections 2020-06-27T04:45:37.278 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:37.274+0000 7f696cc13700 1 -- 172.21.15.31:0/2310972326 wait complete. 2020-06-27T04:45:37.308 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[31505]: t=2020-06-27T04:45:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2020-06-27T04:45:37.308 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[31505]: t=2020-06-27T04:45:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2020-06-27T04:45:37.308 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[31505]: t=2020-06-27T04:45:37+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2020-06-27T04:45:37.309 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[31505]: t=2020-06-27T04:45:37+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2020-06-27T04:45:37.643 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[31505]: t=2020-06-27T04:45:37+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2020-06-27T04:45:37.643 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[31505]: t=2020-06-27T04:45:37+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2020-06-27T04:45:37.644 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[31505]: t=2020-06-27T04:45:37+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2020-06-27T04:45:37.644 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[31505]: t=2020-06-27T04:45:37+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2020-06-27T04:45:37.774 INFO:teuthology.orchestra.run.smithi031.stdout:137438953499 2020-06-27T04:45:37.775 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2020-06-27T04:45:37.911 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[31505]: t=2020-06-27T04:45:37+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2020-06-27T04:45:37.912 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[31505]: t=2020-06-27T04:45:37+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2020-06-27T04:45:37.912 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[18409]: audit 2020-06-27T04:45:35.831349+0000 mgr.x (mgr.34109) 155 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:45:37.912 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[18409]: cephadm 2020-06-27T04:45:35.832205+0000 mgr.x (mgr.34109) 156 : cephadm [INF] Setting Dashboard config for AlertManager: command: {'prefix': 'dashboard set-alertmanager-api-host', 'value': 'http://smithi031:9093'} 2020-06-27T04:45:37.912 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[18409]: audit 2020-06-27T04:45:35.832893+0000 mgr.x (mgr.34109) 157 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi031:9093"}]: dispatch 2020-06-27T04:45:37.913 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[18409]: audit 2020-06-27T04:45:35.841079+0000 mgr.x (mgr.34109) 158 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:45:37.913 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[18409]: cephadm 2020-06-27T04:45:35.846127+0000 mgr.x (mgr.34109) 159 : cephadm [INF] Setting Dashboard config for Prometheus: command: {'prefix': 'dashboard set-prometheus-api-host', 'value': 'http://smithi051:9095'} 2020-06-27T04:45:37.913 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[18409]: audit 2020-06-27T04:45:35.846969+0000 mgr.x (mgr.34109) 160 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi051:9095"}]: dispatch 2020-06-27T04:45:37.913 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[18409]: audit 2020-06-27T04:45:35.856560+0000 mgr.x (mgr.34109) 161 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:45:37.913 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[18409]: cephadm 2020-06-27T04:45:35.860359+0000 mgr.x (mgr.34109) 162 : cephadm [INF] Setting Dashboard config for Grafana: command: {'prefix': 'dashboard set-grafana-api-url', 'value': 'https://smithi051:3000'} 2020-06-27T04:45:37.914 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[18409]: audit 2020-06-27T04:45:35.861038+0000 mgr.x (mgr.34109) 163 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi051:3000"}]: dispatch 2020-06-27T04:45:37.935 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:37.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:37 smithi031 bash[18426]: audit 2020-06-27T04:45:35.831349+0000 mgr.x (mgr.34109) 155 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:45:37.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:37 smithi031 bash[18426]: cephadm 2020-06-27T04:45:35.832205+0000 mgr.x (mgr.34109) 156 : cephadm [INF] Setting Dashboard config for AlertManager: command: {'prefix': 'dashboard set-alertmanager-api-host', 'value': 'http://smithi031:9093'} 2020-06-27T04:45:37.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:37 smithi031 bash[18426]: audit 2020-06-27T04:45:35.832893+0000 mgr.x (mgr.34109) 157 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi031:9093"}]: dispatch 2020-06-27T04:45:37.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:37 smithi031 bash[18426]: audit 2020-06-27T04:45:35.841079+0000 mgr.x (mgr.34109) 158 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:45:37.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:37 smithi031 bash[18426]: cephadm 2020-06-27T04:45:35.846127+0000 mgr.x (mgr.34109) 159 : cephadm [INF] Setting Dashboard config for Prometheus: command: {'prefix': 'dashboard set-prometheus-api-host', 'value': 'http://smithi051:9095'} 2020-06-27T04:45:37.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:37 smithi031 bash[18426]: audit 2020-06-27T04:45:35.846969+0000 mgr.x (mgr.34109) 160 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi051:9095"}]: dispatch 2020-06-27T04:45:37.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:37 smithi031 bash[18426]: audit 2020-06-27T04:45:35.856560+0000 mgr.x (mgr.34109) 161 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:45:37.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:37 smithi031 bash[18426]: cephadm 2020-06-27T04:45:35.860359+0000 mgr.x (mgr.34109) 162 : cephadm [INF] Setting Dashboard config for Grafana: command: {'prefix': 'dashboard set-grafana-api-url', 'value': 'https://smithi051:3000'} 2020-06-27T04:45:37.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:37 smithi031 bash[18426]: audit 2020-06-27T04:45:35.861038+0000 mgr.x (mgr.34109) 163 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi051:3000"}]: dispatch 2020-06-27T04:45:37.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:37 smithi031 bash[22603]: audit 2020-06-27T04:45:35.831349+0000 mgr.x (mgr.34109) 155 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:45:37.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:37 smithi031 bash[22603]: cephadm 2020-06-27T04:45:35.832205+0000 mgr.x (mgr.34109) 156 : cephadm [INF] Setting Dashboard config for AlertManager: command: {'prefix': 'dashboard set-alertmanager-api-host', 'value': 'http://smithi031:9093'} 2020-06-27T04:45:37.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:37 smithi031 bash[22603]: audit 2020-06-27T04:45:35.832893+0000 mgr.x (mgr.34109) 157 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi031:9093"}]: dispatch 2020-06-27T04:45:37.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:37 smithi031 bash[22603]: audit 2020-06-27T04:45:35.841079+0000 mgr.x (mgr.34109) 158 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:45:37.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:37 smithi031 bash[22603]: cephadm 2020-06-27T04:45:35.846127+0000 mgr.x (mgr.34109) 159 : cephadm [INF] Setting Dashboard config for Prometheus: command: {'prefix': 'dashboard set-prometheus-api-host', 'value': 'http://smithi051:9095'} 2020-06-27T04:45:37.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:37 smithi031 bash[22603]: audit 2020-06-27T04:45:35.846969+0000 mgr.x (mgr.34109) 160 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi051:9095"}]: dispatch 2020-06-27T04:45:37.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:37 smithi031 bash[22603]: audit 2020-06-27T04:45:35.856560+0000 mgr.x (mgr.34109) 161 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:45:37.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:37 smithi031 bash[22603]: cephadm 2020-06-27T04:45:35.860359+0000 mgr.x (mgr.34109) 162 : cephadm [INF] Setting Dashboard config for Grafana: command: {'prefix': 'dashboard set-grafana-api-url', 'value': 'https://smithi051:3000'} 2020-06-27T04:45:37.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:37 smithi031 bash[22603]: audit 2020-06-27T04:45:35.861038+0000 mgr.x (mgr.34109) 163 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi051:3000"}]: dispatch 2020-06-27T04:45:38.188 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:37 smithi051 bash[31505]: t=2020-06-27T04:45:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2020-06-27T04:45:38.189 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:38 smithi051 bash[31505]: t=2020-06-27T04:45:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2020-06-27T04:45:38.189 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:38 smithi051 bash[31505]: t=2020-06-27T04:45:38+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2020-06-27T04:45:38.440 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:38 smithi051 bash[31505]: t=2020-06-27T04:45:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2020-06-27T04:45:38.440 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:38 smithi051 bash[31505]: t=2020-06-27T04:45:38+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2020-06-27T04:45:38.440 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:38 smithi051 bash[31505]: t=2020-06-27T04:45:38+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2020-06-27T04:45:38.441 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:38 smithi051 bash[31505]: t=2020-06-27T04:45:38+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2020-06-27T04:45:38.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:38 smithi051 bash[18409]: cluster 2020-06-27T04:45:37.145914+0000 mgr.x (mgr.34109) 164 : cluster [DBG] pgmap v147: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:38.718 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:38 smithi051 bash[31505]: t=2020-06-27T04:45:38+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2020-06-27T04:45:38.718 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:38 smithi051 bash[31505]: t=2020-06-27T04:45:38+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2020-06-27T04:45:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:38 smithi031 bash[22603]: cluster 2020-06-27T04:45:37.145914+0000 mgr.x (mgr.34109) 164 : cluster [DBG] pgmap v147: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:38 smithi031 bash[18426]: cluster 2020-06-27T04:45:37.145914+0000 mgr.x (mgr.34109) 164 : cluster [DBG] pgmap v147: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:39.085 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:38 smithi051 bash[31505]: t=2020-06-27T04:45:38+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2020-06-27T04:45:39.086 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:38 smithi051 bash[31505]: t=2020-06-27T04:45:38+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2020-06-27T04:45:39.086 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:38 smithi051 bash[31505]: t=2020-06-27T04:45:38+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2020-06-27T04:45:39.086 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:38 smithi051 bash[31505]: t=2020-06-27T04:45:38+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2020-06-27T04:45:39.086 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:38 smithi051 bash[31505]: t=2020-06-27T04:45:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2020-06-27T04:45:39.087 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[31505]: t=2020-06-27T04:45:39+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2020-06-27T04:45:39.420 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[31505]: t=2020-06-27T04:45:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2020-06-27T04:45:39.421 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[31505]: t=2020-06-27T04:45:39+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2020-06-27T04:45:39.421 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[31505]: t=2020-06-27T04:45:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2020-06-27T04:45:39.421 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[31505]: t=2020-06-27T04:45:39+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2020-06-27T04:45:39.673 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[31505]: t=2020-06-27T04:45:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2020-06-27T04:45:39.673 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[31505]: t=2020-06-27T04:45:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2020-06-27T04:45:39.674 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[31505]: t=2020-06-27T04:45:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2020-06-27T04:45:39.674 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[31505]: t=2020-06-27T04:45:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2020-06-27T04:45:39.674 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[18409]: audit 2020-06-27T04:45:38.698399+0000 mon.b (mon.2) 251 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696774\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696854\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696889\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697084\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697203\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697316\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697434\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697472\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697503\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:38.697585\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:39.674 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[18409]: audit 2020-06-27T04:45:38.698996+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696774\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696854\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696889\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697084\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697203\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697316\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697434\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697472\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697503\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:38.697585\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:39.675 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[18409]: audit 2020-06-27T04:45:38.701963+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696774\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696854\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696889\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697084\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697203\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697316\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697434\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697472\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697503\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:38.697585\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:45:39.675 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[18409]: audit 2020-06-27T04:45:39.346085+0000 mon.b (mon.2) 252 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344172\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344267\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344561\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344715\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344859\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344998\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.345043\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.345078\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:39.345181\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:39.675 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[18409]: audit 2020-06-27T04:45:39.346737+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344172\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344267\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344561\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344715\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344859\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344998\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.345043\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.345078\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:39.345181\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:39.676 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[18409]: audit 2020-06-27T04:45:39.349354+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344172\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344267\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344561\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344715\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344859\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344998\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.345043\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.345078\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:39.345181\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:45:39.676 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[18409]: audit 2020-06-27T04:45:39.353642+0000 mon.b (mon.2) 253 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:45:39.676 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[18409]: audit 2020-06-27T04:45:39.355100+0000 mon.b (mon.2) 254 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:45:39.676 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[18409]: audit 2020-06-27T04:45:39.356327+0000 mon.b (mon.2) 255 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:45:39.677 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[18409]: audit 2020-06-27T04:45:39.357995+0000 mon.b (mon.2) 256 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:45:39.677 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[18409]: audit 2020-06-27T04:45:39.358476+0000 mon.b (mon.2) 257 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:45:39.880 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.876+0000 7f0988146700 1 Processor -- start 2020-06-27T04:45:39.881 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.876+0000 7f0988146700 1 -- start start 2020-06-27T04:45:39.881 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.876+0000 7f0988146700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0980066370 0x7f09800730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:39.881 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.876+0000 7f0988146700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f098006be40 0x7f09800737d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:39.881 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.876+0000 7f0988146700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0980078740 0x7f0980120ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:39.881 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.876+0000 7f0988146700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0980078d20 con 0x7f098006be40 2020-06-27T04:45:39.882 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.876+0000 7f0988146700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0980121190 con 0x7f0980066370 2020-06-27T04:45:39.882 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.876+0000 7f0988146700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0980121320 con 0x7f0980078740 2020-06-27T04:45:39.882 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.876+0000 7f0986ee4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0980078740 0x7f0980120ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:39.882 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.876+0000 7f0985ee2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f098006be40 0x7f09800737d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:39.882 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.876+0000 7f0986ee4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0980078740 0x7f0980120ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35840/0 (socket says 172.21.15.31:35840) 2020-06-27T04:45:39.883 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.876+0000 7f0986ee4700 1 -- 172.21.15.31:0/4205226852 learned_addr learned my addr 172.21.15.31:0/4205226852 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:39.883 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.876+0000 7f09866e3700 1 --2- 172.21.15.31:0/4205226852 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0980066370 0x7f09800730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:39.883 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.876+0000 7f0985ee2700 1 -- 172.21.15.31:0/4205226852 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0980078740 msgr2=0x7f0980120ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:39.883 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.876+0000 7f0985ee2700 1 --2- 172.21.15.31:0/4205226852 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0980078740 0x7f0980120ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:39.883 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.877+0000 7f0985ee2700 1 -- 172.21.15.31:0/4205226852 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0980066370 msgr2=0x7f09800730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:39.884 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.877+0000 7f0985ee2700 1 --2- 172.21.15.31:0/4205226852 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0980066370 0x7f09800730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:39.884 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.877+0000 7f0985ee2700 1 -- 172.21.15.31:0/4205226852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09801214e0 con 0x7f098006be40 2020-06-27T04:45:39.884 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.877+0000 7f0986ee4700 1 --2- 172.21.15.31:0/4205226852 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0980078740 0x7f0980120ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:45:39.884 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.877+0000 7f09866e3700 1 --2- 172.21.15.31:0/4205226852 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0980066370 0x7f09800730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:45:39.884 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.877+0000 7f0985ee2700 1 --2- 172.21.15.31:0/4205226852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f098006be40 0x7f09800737d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f0970005000 tx=0x7f0970007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:39.885 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.877+0000 7f09767fc700 1 -- 172.21.15.31:0/4205226852 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f097000a560 con 0x7f098006be40 2020-06-27T04:45:39.885 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.877+0000 7f0988146700 1 -- 172.21.15.31:0/4205226852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0980121790 con 0x7f098006be40 2020-06-27T04:45:39.885 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.877+0000 7f09767fc700 1 -- 172.21.15.31:0/4205226852 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f097000ab00 con 0x7f098006be40 2020-06-27T04:45:39.886 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.877+0000 7f09767fc700 1 -- 172.21.15.31:0/4205226852 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0970012810 con 0x7f098006be40 2020-06-27T04:45:39.887 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.877+0000 7f0988146700 1 -- 172.21.15.31:0/4205226852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0980121d30 con 0x7f098006be40 2020-06-27T04:45:39.887 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.878+0000 7f09767fc700 1 -- 172.21.15.31:0/4205226852 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f0970010070 con 0x7f098006be40 2020-06-27T04:45:39.887 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.878+0000 7f0988146700 1 -- 172.21.15.31:0/4205226852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f098006dba0 con 0x7f098006be40 2020-06-27T04:45:39.887 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.878+0000 7f09767fc700 1 --2- 172.21.15.31:0/4205226852 >> v2:172.21.15.51:6800/950992045 conn(0x7f095c02ab00 0x7f095c02cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:39.888 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.878+0000 7f09767fc700 1 -- 172.21.15.31:0/4205226852 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7f097003a5c0 con 0x7f098006be40 2020-06-27T04:45:39.888 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.878+0000 7f09767fc700 1 --2- 172.21.15.31:0/4205226852 >> v2:172.21.15.51:6805/1207065717 conn(0x7f095c033980 0x7f095c035e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:39.888 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.878+0000 7f09767fc700 1 -- 172.21.15.31:0/4205226852 --> v2:172.21.15.51:6805/1207065717 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f095c036450 con 0x7f095c033980 2020-06-27T04:45:39.888 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.878+0000 7f09767fc700 1 -- 172.21.15.31:0/4205226852 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f097001b400 con 0x7f098006be40 2020-06-27T04:45:39.888 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.878+0000 7f09866e3700 1 --2- 172.21.15.31:0/4205226852 >> v2:172.21.15.51:6800/950992045 conn(0x7f095c02ab00 0x7f095c02cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:39.888 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.878+0000 7f0986ee4700 1 --2- 172.21.15.31:0/4205226852 >> v2:172.21.15.51:6805/1207065717 conn(0x7f095c033980 0x7f095c035e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:39.889 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.878+0000 7f09866e3700 1 --2- 172.21.15.31:0/4205226852 >> v2:172.21.15.51:6800/950992045 conn(0x7f095c02ab00 0x7f095c02cfc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f097c016000 tx=0x7f097c009b30).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:39.889 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.879+0000 7f0986ee4700 1 --2- 172.21.15.31:0/4205226852 >> v2:172.21.15.51:6805/1207065717 conn(0x7f095c033980 0x7f095c035e20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:39.889 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.880+0000 7f09767fc700 1 -- 172.21.15.31:0/4205226852 <== osd.5 v2:172.21.15.51:6805/1207065717 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f095c036450 con 0x7f095c033980 2020-06-27T04:45:39.901 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.898+0000 7f0988146700 1 -- 172.21.15.31:0/4205226852 --> v2:172.21.15.51:6805/1207065717 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f098006df40 con 0x7f095c033980 2020-06-27T04:45:39.903 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.899+0000 7f09767fc700 1 -- 172.21.15.31:0/4205226852 <== osd.5 v2:172.21.15.51:6805/1207065717 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f098006df40 con 0x7f095c033980 2020-06-27T04:45:39.903 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.899+0000 7f0988146700 1 -- 172.21.15.31:0/4205226852 >> v2:172.21.15.51:6805/1207065717 conn(0x7f095c033980 msgr2=0x7f095c035e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:39.903 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.899+0000 7f0988146700 1 --2- 172.21.15.31:0/4205226852 >> v2:172.21.15.51:6805/1207065717 conn(0x7f095c033980 0x7f095c035e20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:39.903 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.899+0000 7f0988146700 1 -- 172.21.15.31:0/4205226852 >> v2:172.21.15.51:6800/950992045 conn(0x7f095c02ab00 msgr2=0x7f095c02cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:39.903 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.899+0000 7f0988146700 1 --2- 172.21.15.31:0/4205226852 >> v2:172.21.15.51:6800/950992045 conn(0x7f095c02ab00 0x7f095c02cfc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f097c016000 tx=0x7f097c009b30).stop 2020-06-27T04:45:39.904 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.899+0000 7f0988146700 1 -- 172.21.15.31:0/4205226852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f098006be40 msgr2=0x7f09800737d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:39.904 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.899+0000 7f0988146700 1 --2- 172.21.15.31:0/4205226852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f098006be40 0x7f09800737d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f0970005000 tx=0x7f0970007c50).stop 2020-06-27T04:45:39.904 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.899+0000 7f0986ee4700 1 -- 172.21.15.31:0/4205226852 reap_dead start 2020-06-27T04:45:39.904 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.900+0000 7f0988146700 1 -- 172.21.15.31:0/4205226852 shutdown_connections 2020-06-27T04:45:39.904 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.900+0000 7f0988146700 1 -- 172.21.15.31:0/4205226852 >> 172.21.15.31:0/4205226852 conn(0x7f0980061840 msgr2=0x7f098006c250 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:39.905 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.900+0000 7f0988146700 1 -- 172.21.15.31:0/4205226852 shutdown_connections 2020-06-27T04:45:39.905 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:39.900+0000 7f0988146700 1 -- 172.21.15.31:0/4205226852 wait complete. 2020-06-27T04:45:39.925 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[18426]: audit 2020-06-27T04:45:38.698399+0000 mon.b (mon.2) 251 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696774\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696854\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696889\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697084\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697203\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697316\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697434\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697472\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697503\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:38.697585\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:39.926 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[18426]: audit 2020-06-27T04:45:38.698996+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696774\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696854\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696889\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697084\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697203\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697316\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697434\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697472\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697503\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:38.697585\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:39.926 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[18426]: audit 2020-06-27T04:45:38.701963+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696774\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696854\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696889\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697084\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697203\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697316\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697434\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697472\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697503\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:38.697585\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:45:39.926 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[18426]: audit 2020-06-27T04:45:39.346085+0000 mon.b (mon.2) 252 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344172\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344267\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344561\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344715\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344859\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344998\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.345043\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.345078\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:39.345181\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:39.927 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[18426]: audit 2020-06-27T04:45:39.346737+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344172\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344267\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344561\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344715\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344859\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344998\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.345043\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.345078\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:39.345181\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:39.927 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[18426]: audit 2020-06-27T04:45:39.349354+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344172\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344267\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344561\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344715\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344859\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344998\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.345043\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.345078\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:39.345181\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:45:39.927 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[18426]: audit 2020-06-27T04:45:39.353642+0000 mon.b (mon.2) 253 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:45:39.928 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[18426]: audit 2020-06-27T04:45:39.355100+0000 mon.b (mon.2) 254 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:45:39.928 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[18426]: audit 2020-06-27T04:45:39.356327+0000 mon.b (mon.2) 255 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:45:39.928 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[18426]: audit 2020-06-27T04:45:39.357995+0000 mon.b (mon.2) 256 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:45:39.928 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[18426]: audit 2020-06-27T04:45:39.358476+0000 mon.b (mon.2) 257 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:45:39.929 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[22603]: audit 2020-06-27T04:45:38.698399+0000 mon.b (mon.2) 251 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696774\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696854\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696889\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697084\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697203\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697316\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697434\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697472\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697503\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:38.697585\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:39.930 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[22603]: audit 2020-06-27T04:45:38.698996+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696774\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696854\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696889\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697084\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697203\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697316\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697434\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697472\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697503\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:38.697585\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:39.932 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[22603]: audit 2020-06-27T04:45:38.701963+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696774\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696854\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.696889\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697084\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697203\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697316\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697434\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697472\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:38.697503\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:38.697585\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:45:39.932 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[22603]: audit 2020-06-27T04:45:39.346085+0000 mon.b (mon.2) 252 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344172\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344267\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344561\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344715\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344859\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344998\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.345043\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.345078\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:39.345181\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:39.933 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[22603]: audit 2020-06-27T04:45:39.346737+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344172\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344267\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344561\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344715\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344859\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344998\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.345043\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.345078\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:39.345181\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:39.933 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[22603]: audit 2020-06-27T04:45:39.349354+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344172\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344267\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344561\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344715\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344859\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.344998\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.345043\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:39.345078\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:39.345181\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:45:39.933 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[22603]: audit 2020-06-27T04:45:39.353642+0000 mon.b (mon.2) 253 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:45:39.934 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[22603]: audit 2020-06-27T04:45:39.355100+0000 mon.b (mon.2) 254 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:45:39.934 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[22603]: audit 2020-06-27T04:45:39.356327+0000 mon.b (mon.2) 255 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:45:39.934 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[22603]: audit 2020-06-27T04:45:39.357995+0000 mon.b (mon.2) 256 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:45:39.934 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:39 smithi031 bash[22603]: audit 2020-06-27T04:45:39.358476+0000 mon.b (mon.2) 257 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:45:39.951 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[31505]: t=2020-06-27T04:45:39+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2020-06-27T04:45:39.952 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[31505]: t=2020-06-27T04:45:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2020-06-27T04:45:40.209 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:39 smithi051 bash[31505]: t=2020-06-27T04:45:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2020-06-27T04:45:40.209 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:40 smithi051 bash[31505]: t=2020-06-27T04:45:40+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2020-06-27T04:45:40.209 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:40 smithi051 bash[31505]: t=2020-06-27T04:45:40+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2020-06-27T04:45:40.209 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:40 smithi051 bash[31505]: t=2020-06-27T04:45:40+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2020-06-27T04:45:40.467 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:40 smithi051 bash[31505]: t=2020-06-27T04:45:40+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2020-06-27T04:45:40.468 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:40 smithi051 bash[31505]: t=2020-06-27T04:45:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2020-06-27T04:45:40.468 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:40 smithi051 bash[31505]: t=2020-06-27T04:45:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2020-06-27T04:45:40.468 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:40 smithi051 bash[31505]: t=2020-06-27T04:45:40+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2020-06-27T04:45:40.519 INFO:teuthology.orchestra.run.smithi031.stdout:158913789976 2020-06-27T04:45:40.519 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2020-06-27T04:45:40.692 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:40.821 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:40 smithi051 bash[31505]: t=2020-06-27T04:45:40+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2020-06-27T04:45:40.821 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:40 smithi051 bash[31505]: t=2020-06-27T04:45:40+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2020-06-27T04:45:40.822 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:40 smithi051 bash[31505]: t=2020-06-27T04:45:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2020-06-27T04:45:40.822 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:40 smithi051 bash[31505]: t=2020-06-27T04:45:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2020-06-27T04:45:40.822 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:40 smithi051 bash[18409]: cluster 2020-06-27T04:45:39.146747+0000 mgr.x (mgr.34109) 165 : cluster [DBG] pgmap v148: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:40.822 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:40 smithi051 bash[18409]: audit 2020-06-27T04:45:39.354018+0000 mgr.x (mgr.34109) 166 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:45:40.822 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:40 smithi051 bash[18409]: audit 2020-06-27T04:45:39.355435+0000 mgr.x (mgr.34109) 167 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:45:40.823 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:40 smithi051 bash[18409]: audit 2020-06-27T04:45:39.356613+0000 mgr.x (mgr.34109) 168 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:45:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:40 smithi031 bash[18426]: cluster 2020-06-27T04:45:39.146747+0000 mgr.x (mgr.34109) 165 : cluster [DBG] pgmap v148: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:40 smithi031 bash[18426]: audit 2020-06-27T04:45:39.354018+0000 mgr.x (mgr.34109) 166 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:45:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:40 smithi031 bash[18426]: audit 2020-06-27T04:45:39.355435+0000 mgr.x (mgr.34109) 167 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:45:40.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:40 smithi031 bash[18426]: audit 2020-06-27T04:45:39.356613+0000 mgr.x (mgr.34109) 168 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:45:40.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:40 smithi031 bash[22603]: cluster 2020-06-27T04:45:39.146747+0000 mgr.x (mgr.34109) 165 : cluster [DBG] pgmap v148: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:40.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:40 smithi031 bash[22603]: audit 2020-06-27T04:45:39.354018+0000 mgr.x (mgr.34109) 166 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:45:40.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:40 smithi031 bash[22603]: audit 2020-06-27T04:45:39.355435+0000 mgr.x (mgr.34109) 167 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:45:40.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:40 smithi031 bash[22603]: audit 2020-06-27T04:45:39.356613+0000 mgr.x (mgr.34109) 168 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:45:41.106 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:40 smithi051 bash[31505]: t=2020-06-27T04:45:40+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2020-06-27T04:45:41.106 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:40 smithi051 bash[31505]: t=2020-06-27T04:45:40+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2020-06-27T04:45:41.107 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:40 smithi051 bash[31505]: t=2020-06-27T04:45:40+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2020-06-27T04:45:41.107 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:41 smithi051 bash[31505]: t=2020-06-27T04:45:41+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2020-06-27T04:45:41.107 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:41 smithi051 bash[31505]: t=2020-06-27T04:45:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2020-06-27T04:45:41.433 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:41 smithi051 bash[31505]: t=2020-06-27T04:45:41+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2020-06-27T04:45:41.434 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:41 smithi051 bash[31505]: t=2020-06-27T04:45:41+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2020-06-27T04:45:41.717 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:41 smithi051 bash[31505]: t=2020-06-27T04:45:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2020-06-27T04:45:41.718 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:41 smithi051 bash[31505]: t=2020-06-27T04:45:41+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2020-06-27T04:45:41.718 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:41 smithi051 bash[31505]: t=2020-06-27T04:45:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2020-06-27T04:45:41.718 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:41 smithi051 bash[31505]: t=2020-06-27T04:45:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2020-06-27T04:45:41.720 INFO:ceph.alertmanager.a.smithi031.stdout:Jun 27 04:45:41 smithi031 bash[37082]: level=info ts=2020-06-27T04:45:41.284Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.00084924s 2020-06-27T04:45:42.054 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:41 smithi051 bash[31505]: t=2020-06-27T04:45:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2020-06-27T04:45:42.054 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:41 smithi051 bash[31505]: t=2020-06-27T04:45:41+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2020-06-27T04:45:42.055 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:41 smithi051 bash[31505]: t=2020-06-27T04:45:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2020-06-27T04:45:42.055 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[31505]: t=2020-06-27T04:45:42+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2020-06-27T04:45:42.055 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[31505]: t=2020-06-27T04:45:42+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2020-06-27T04:45:42.347 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[31505]: t=2020-06-27T04:45:42+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2020-06-27T04:45:42.348 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[31505]: t=2020-06-27T04:45:42+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2020-06-27T04:45:42.348 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[31505]: t=2020-06-27T04:45:42+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2020-06-27T04:45:42.348 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[31505]: t=2020-06-27T04:45:42+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2020-06-27T04:45:42.603 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[31505]: t=2020-06-27T04:45:42+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2020-06-27T04:45:42.603 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[31505]: t=2020-06-27T04:45:42+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2020-06-27T04:45:42.604 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[31505]: t=2020-06-27T04:45:42+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2020-06-27T04:45:42.604 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[31505]: t=2020-06-27T04:45:42+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2020-06-27T04:45:42.658 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.654+0000 7f0a2ee42700 1 Processor -- start 2020-06-27T04:45:42.659 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.654+0000 7f0a2ee42700 1 -- start start 2020-06-27T04:45:42.659 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.654+0000 7f0a2ee42700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a28066370 0x7f0a28067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:42.659 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.654+0000 7f0a2ee42700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a280678c0 0x7f0a280685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:42.659 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.654+0000 7f0a2ee42700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0a280767e0 0x7f0a28076c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:42.659 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.654+0000 7f0a2ee42700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a28077290 con 0x7f0a28066370 2020-06-27T04:45:42.660 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.654+0000 7f0a2ee42700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a28077400 con 0x7f0a280767e0 2020-06-27T04:45:42.660 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.654+0000 7f0a2ee42700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a280775c0 con 0x7f0a280678c0 2020-06-27T04:45:42.660 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.655+0000 7f0a2cbde700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a280678c0 0x7f0a280685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:42.660 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.655+0000 7f0a2cbde700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a280678c0 0x7f0a280685e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35854/0 (socket says 172.21.15.31:35854) 2020-06-27T04:45:42.660 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.655+0000 7f0a2cbde700 1 -- 172.21.15.31:0/727809016 learned_addr learned my addr 172.21.15.31:0/727809016 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:42.661 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.655+0000 7f0a2d3df700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a28066370 0x7f0a28067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:42.661 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.655+0000 7f0a2dbe0700 1 --2- 172.21.15.31:0/727809016 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0a280767e0 0x7f0a28076c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:42.661 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.655+0000 7f0a2cbde700 1 -- 172.21.15.31:0/727809016 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0a280767e0 msgr2=0x7f0a28076c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:42.661 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.655+0000 7f0a2cbde700 1 --2- 172.21.15.31:0/727809016 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0a280767e0 0x7f0a28076c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:42.661 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.655+0000 7f0a2cbde700 1 -- 172.21.15.31:0/727809016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a28066370 msgr2=0x7f0a28067fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:42.662 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.655+0000 7f0a2cbde700 1 --2- 172.21.15.31:0/727809016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a28066370 0x7f0a28067fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:42.663 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.655+0000 7f0a2cbde700 1 -- 172.21.15.31:0/727809016 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a280778e0 con 0x7f0a280678c0 2020-06-27T04:45:42.664 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.655+0000 7f0a2dbe0700 1 --2- 172.21.15.31:0/727809016 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0a280767e0 0x7f0a28076c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-06-27T04:45:42.664 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.655+0000 7f0a2cbde700 1 --2- 172.21.15.31:0/727809016 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a280678c0 0x7f0a280685e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f0a2400c000 tx=0x7f0a2400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:42.664 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.655+0000 7f0a197fa700 1 -- 172.21.15.31:0/727809016 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a2400cd10 con 0x7f0a280678c0 2020-06-27T04:45:42.664 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.655+0000 7f0a197fa700 1 -- 172.21.15.31:0/727809016 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f0a2400f040 con 0x7f0a280678c0 2020-06-27T04:45:42.665 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.655+0000 7f0a2ee42700 1 -- 172.21.15.31:0/727809016 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a28077b30 con 0x7f0a280678c0 2020-06-27T04:45:42.665 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.655+0000 7f0a197fa700 1 -- 172.21.15.31:0/727809016 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a24007d10 con 0x7f0a280678c0 2020-06-27T04:45:42.665 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.655+0000 7f0a2ee42700 1 -- 172.21.15.31:0/727809016 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a280780d0 con 0x7f0a280678c0 2020-06-27T04:45:42.665 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.656+0000 7f0a197fa700 1 -- 172.21.15.31:0/727809016 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f0a24014460 con 0x7f0a280678c0 2020-06-27T04:45:42.665 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.656+0000 7f0a197fa700 1 --2- 172.21.15.31:0/727809016 >> v2:172.21.15.51:6800/950992045 conn(0x7f0a0402ab50 0x7f0a0402d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:42.666 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.656+0000 7f0a197fa700 1 -- 172.21.15.31:0/727809016 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7f0a2403bc50 con 0x7f0a280678c0 2020-06-27T04:45:42.666 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.656+0000 7f0a2ee42700 1 --2- 172.21.15.31:0/727809016 >> v2:172.21.15.51:6809/2568976317 conn(0x7f0a280560c0 0x7f0a280564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:42.666 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.656+0000 7f0a2ee42700 1 -- 172.21.15.31:0/727809016 --> v2:172.21.15.51:6809/2568976317 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a2805f390 con 0x7f0a280560c0 2020-06-27T04:45:42.666 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.656+0000 7f0a2d3df700 1 --2- 172.21.15.31:0/727809016 >> v2:172.21.15.51:6800/950992045 conn(0x7f0a0402ab50 0x7f0a0402d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:42.666 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.657+0000 7f0a2dbe0700 1 --2- 172.21.15.31:0/727809016 >> v2:172.21.15.51:6809/2568976317 conn(0x7f0a280560c0 0x7f0a280564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:42.667 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.657+0000 7f0a2d3df700 1 --2- 172.21.15.31:0/727809016 >> v2:172.21.15.51:6800/950992045 conn(0x7f0a0402ab50 0x7f0a0402d010 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f0a1c00c000 tx=0x7f0a1c004d40).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:42.667 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.657+0000 7f0a2dbe0700 1 --2- 172.21.15.31:0/727809016 >> v2:172.21.15.51:6809/2568976317 conn(0x7f0a280560c0 0x7f0a280564a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:42.667 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.658+0000 7f0a197fa700 1 -- 172.21.15.31:0/727809016 <== osd.6 v2:172.21.15.51:6809/2568976317 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f0a20004590 con 0x7f0a280560c0 2020-06-27T04:45:42.679 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.676+0000 7f0a2ee42700 1 -- 172.21.15.31:0/727809016 --> v2:172.21.15.51:6809/2568976317 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0a2805e210 con 0x7f0a280560c0 2020-06-27T04:45:42.680 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.677+0000 7f0a197fa700 1 -- 172.21.15.31:0/727809016 <== osd.6 v2:172.21.15.51:6809/2568976317 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0a2805e210 con 0x7f0a280560c0 2020-06-27T04:45:42.681 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.677+0000 7f0a2ee42700 1 -- 172.21.15.31:0/727809016 >> v2:172.21.15.51:6809/2568976317 conn(0x7f0a280560c0 msgr2=0x7f0a280564a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:42.681 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.677+0000 7f0a2ee42700 1 --2- 172.21.15.31:0/727809016 >> v2:172.21.15.51:6809/2568976317 conn(0x7f0a280560c0 0x7f0a280564a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:42.681 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.677+0000 7f0a2ee42700 1 -- 172.21.15.31:0/727809016 >> v2:172.21.15.51:6800/950992045 conn(0x7f0a0402ab50 msgr2=0x7f0a0402d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:42.681 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.677+0000 7f0a2ee42700 1 --2- 172.21.15.31:0/727809016 >> v2:172.21.15.51:6800/950992045 conn(0x7f0a0402ab50 0x7f0a0402d010 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f0a1c00c000 tx=0x7f0a1c004d40).stop 2020-06-27T04:45:42.682 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.677+0000 7f0a2ee42700 1 -- 172.21.15.31:0/727809016 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a280678c0 msgr2=0x7f0a280685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:42.682 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.677+0000 7f0a2ee42700 1 --2- 172.21.15.31:0/727809016 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a280678c0 0x7f0a280685e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f0a2400c000 tx=0x7f0a2400b040).stop 2020-06-27T04:45:42.682 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.677+0000 7f0a2dbe0700 1 -- 172.21.15.31:0/727809016 reap_dead start 2020-06-27T04:45:42.682 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.677+0000 7f0a2ee42700 1 -- 172.21.15.31:0/727809016 shutdown_connections 2020-06-27T04:45:42.683 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.677+0000 7f0a2ee42700 1 -- 172.21.15.31:0/727809016 >> 172.21.15.31:0/727809016 conn(0x7f0a28061840 msgr2=0x7f0a28062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:42.683 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.677+0000 7f0a2ee42700 1 -- 172.21.15.31:0/727809016 shutdown_connections 2020-06-27T04:45:42.683 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:42.677+0000 7f0a2ee42700 1 -- 172.21.15.31:0/727809016 wait complete. 2020-06-27T04:45:42.889 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[31505]: t=2020-06-27T04:45:42+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2020-06-27T04:45:42.889 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[31505]: t=2020-06-27T04:45:42+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2020-06-27T04:45:42.889 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[31505]: t=2020-06-27T04:45:42+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2020-06-27T04:45:42.890 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[31505]: t=2020-06-27T04:45:42+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2020-06-27T04:45:42.890 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[31505]: t=2020-06-27T04:45:42+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2020-06-27T04:45:42.890 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[18409]: cluster 2020-06-27T04:45:41.147189+0000 mgr.x (mgr.34109) 169 : cluster [DBG] pgmap v149: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:42.890 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[18409]: audit 2020-06-27T04:45:41.822701+0000 mon.b (mon.2) 258 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821142\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821218\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821251\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821446\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821562\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821671\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821778\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821813\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821843\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:41.821923\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:42.891 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[18409]: audit 2020-06-27T04:45:41.823539+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821142\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821218\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821251\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821446\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821562\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821671\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821778\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821813\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821843\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:41.821923\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:42.891 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[18409]: audit 2020-06-27T04:45:41.828601+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821142\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821218\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821251\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821446\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821562\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821671\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821778\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821813\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821843\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:41.821923\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:45:42.892 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[18409]: audit 2020-06-27T04:45:42.386854+0000 mon.b (mon.2) 259 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385193\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385273\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385523\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385652\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385773\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385892\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385931\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385963\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:42.386049\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:42.892 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[18409]: audit 2020-06-27T04:45:42.387521+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385193\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385273\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385523\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385652\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385773\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385892\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385931\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385963\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:42.386049\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:42.892 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[18409]: audit 2020-06-27T04:45:42.392086+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385193\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385273\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385523\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385652\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385773\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385892\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385931\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385963\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:42.386049\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:45:42.893 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[18409]: audit 2020-06-27T04:45:42.394953+0000 mon.b (mon.2) 260 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:45:42.893 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[18409]: audit 2020-06-27T04:45:42.396091+0000 mon.b (mon.2) 261 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:45:42.893 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[18409]: audit 2020-06-27T04:45:42.397026+0000 mon.b (mon.2) 262 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:45:42.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[22603]: cluster 2020-06-27T04:45:41.147189+0000 mgr.x (mgr.34109) 169 : cluster [DBG] pgmap v149: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:42.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[22603]: audit 2020-06-27T04:45:41.822701+0000 mon.b (mon.2) 258 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821142\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821218\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821251\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821446\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821562\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821671\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821778\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821813\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821843\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:41.821923\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:42.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[22603]: audit 2020-06-27T04:45:41.823539+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821142\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821218\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821251\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821446\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821562\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821671\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821778\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821813\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821843\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:41.821923\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:42.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[22603]: audit 2020-06-27T04:45:41.828601+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821142\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821218\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821251\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821446\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821562\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821671\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821778\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821813\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821843\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:41.821923\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:45:42.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[22603]: audit 2020-06-27T04:45:42.386854+0000 mon.b (mon.2) 259 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385193\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385273\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385523\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385652\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385773\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385892\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385931\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385963\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:42.386049\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:42.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[22603]: audit 2020-06-27T04:45:42.387521+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385193\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385273\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385523\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385652\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385773\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385892\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385931\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385963\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:42.386049\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:42.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[22603]: audit 2020-06-27T04:45:42.392086+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385193\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385273\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385523\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385652\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385773\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385892\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385931\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385963\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:42.386049\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:45:42.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[22603]: audit 2020-06-27T04:45:42.394953+0000 mon.b (mon.2) 260 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:45:42.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[22603]: audit 2020-06-27T04:45:42.396091+0000 mon.b (mon.2) 261 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:45:42.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[22603]: audit 2020-06-27T04:45:42.397026+0000 mon.b (mon.2) 262 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:45:42.978 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[18426]: cluster 2020-06-27T04:45:41.147189+0000 mgr.x (mgr.34109) 169 : cluster [DBG] pgmap v149: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:42.978 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[18426]: audit 2020-06-27T04:45:41.822701+0000 mon.b (mon.2) 258 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821142\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821218\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821251\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821446\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821562\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821671\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821778\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821813\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821843\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:41.821923\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:42.979 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[18426]: audit 2020-06-27T04:45:41.823539+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821142\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821218\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821251\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821446\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821562\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821671\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821778\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821813\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821843\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:41.821923\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]: dispatch 2020-06-27T04:45:42.979 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[18426]: audit 2020-06-27T04:45:41.828601+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821142\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821218\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821251\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821446\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821562\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821671\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821778\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821813\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821843\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:41.821923\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:41:09.414905\"}"}]': finished 2020-06-27T04:45:42.982 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[18426]: audit 2020-06-27T04:45:42.386854+0000 mon.b (mon.2) 259 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385193\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385273\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385523\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385652\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385773\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385892\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385931\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385963\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:42.386049\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:42.982 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[18426]: audit 2020-06-27T04:45:42.387521+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385193\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385273\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385523\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385652\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385773\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385892\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385931\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385963\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:42.386049\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]: dispatch 2020-06-27T04:45:42.982 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[18426]: audit 2020-06-27T04:45:42.392086+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385193\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385273\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385523\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385652\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385773\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385892\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385931\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385963\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:42.386049\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:40:04.294120\"}"}]': finished 2020-06-27T04:45:42.983 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[18426]: audit 2020-06-27T04:45:42.394953+0000 mon.b (mon.2) 260 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:45:42.983 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[18426]: audit 2020-06-27T04:45:42.396091+0000 mon.b (mon.2) 261 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:45:42.983 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:42 smithi031 bash[18426]: audit 2020-06-27T04:45:42.397026+0000 mon.b (mon.2) 262 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:45:43.161 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:42 smithi051 bash[31505]: t=2020-06-27T04:45:42+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2020-06-27T04:45:43.162 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2020-06-27T04:45:43.162 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2020-06-27T04:45:43.162 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2020-06-27T04:45:43.285 INFO:teuthology.orchestra.run.smithi031.stdout:180388626454 2020-06-27T04:45:43.286 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2020-06-27T04:45:43.413 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2020-06-27T04:45:43.413 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2020-06-27T04:45:43.413 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2020-06-27T04:45:43.434 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:43.716 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2020-06-27T04:45:43.717 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2020-06-27T04:45:43.717 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2020-06-27T04:45:43.717 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2020-06-27T04:45:43.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[18409]: audit 2020-06-27T04:45:42.395253+0000 mgr.x (mgr.34109) 170 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:45:43.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[18409]: audit 2020-06-27T04:45:42.396362+0000 mgr.x (mgr.34109) 171 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:45:43.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[18409]: audit 2020-06-27T04:45:42.397270+0000 mgr.x (mgr.34109) 172 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:45:43.969 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2020-06-27T04:45:43.969 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2020-06-27T04:45:43.969 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2020-06-27T04:45:43.969 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing HTTPServer" logger=server 2020-06-27T04:45:43.970 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2020-06-27T04:45:43.970 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing PluginManager" logger=server 2020-06-27T04:45:43.970 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Starting plugin search" logger=plugins 2020-06-27T04:45:43.970 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2020-06-27T04:45:43.971 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2020-06-27T04:45:43.971 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing HooksService" logger=server 2020-06-27T04:45:43.971 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2020-06-27T04:45:43.971 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2020-06-27T04:45:43.971 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing RemoteCache" logger=server 2020-06-27T04:45:43.972 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing QuotaService" logger=server 2020-06-27T04:45:43.972 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing ServerLockService" logger=server 2020-06-27T04:45:43.972 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2020-06-27T04:45:43.972 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing RenderingService" logger=server 2020-06-27T04:45:43.972 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing AlertEngine" logger=server 2020-06-27T04:45:43.973 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2020-06-27T04:45:43.973 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing LoginService" logger=server 2020-06-27T04:45:43.973 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing SearchService" logger=server 2020-06-27T04:45:43.973 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing TracingService" logger=server 2020-06-27T04:45:43.973 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2020-06-27T04:45:43.973 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing CleanUpService" logger=server 2020-06-27T04:45:43.974 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing NotificationService" logger=server 2020-06-27T04:45:43.974 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2020-06-27T04:45:43.974 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2020-06-27T04:45:43.974 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:43 smithi051 bash[31505]: t=2020-06-27T04:45:43+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 2020-06-27T04:45:43.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:43 smithi031 bash[18426]: audit 2020-06-27T04:45:42.395253+0000 mgr.x (mgr.34109) 170 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:45:43.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:43 smithi031 bash[18426]: audit 2020-06-27T04:45:42.396362+0000 mgr.x (mgr.34109) 171 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:45:43.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:43 smithi031 bash[18426]: audit 2020-06-27T04:45:42.397270+0000 mgr.x (mgr.34109) 172 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:45:43.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:43 smithi031 bash[22603]: audit 2020-06-27T04:45:42.395253+0000 mgr.x (mgr.34109) 170 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:45:43.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:43 smithi031 bash[22603]: audit 2020-06-27T04:45:42.396362+0000 mgr.x (mgr.34109) 171 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:45:43.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:43 smithi031 bash[22603]: audit 2020-06-27T04:45:42.397270+0000 mgr.x (mgr.34109) 172 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:45:44.467 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:44 smithi051 bash[31505]: t=2020-06-27T04:45:44+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2020-06-27T04:45:44.468 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:44 smithi051 bash[31505]: t=2020-06-27T04:45:44+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin." logger=rendering renderer=phantomJS 2020-06-27T04:45:44.468 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:44 smithi051 bash[31505]: t=2020-06-27T04:45:44+0000 lvl=info msg="Initializing Stream Manager" 2020-06-27T04:45:44.468 INFO:ceph.grafana.a.smithi051.stdout:Jun 27 04:45:44 smithi051 bash[31505]: t=2020-06-27T04:45:44+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2020-06-27T04:45:44.838 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:44 smithi031 bash[18426]: cluster 2020-06-27T04:45:43.147726+0000 mgr.x (mgr.34109) 173 : cluster [DBG] pgmap v150: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:44.839 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:44 smithi031 bash[22603]: cluster 2020-06-27T04:45:43.147726+0000 mgr.x (mgr.34109) 173 : cluster [DBG] pgmap v150: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:45.042 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d84bb700 1 Processor -- start 2020-06-27T04:45:45.043 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d84bb700 1 -- start start 2020-06-27T04:45:45.043 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d84bb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2d0066370 0x7fc2d0074310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:45.043 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d84bb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2d006be40 0x7fc2d0074a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:45.043 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d84bb700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc2d0077960 0x7fc2d0077de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d84bb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d0078430 con 0x7fc2d006be40 2020-06-27T04:45:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d84bb700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d00785a0 con 0x7fc2d0077960 2020-06-27T04:45:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d84bb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d0078760 con 0x7fc2d0066370 2020-06-27T04:45:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d6a58700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2d0066370 0x7fc2d0074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d6a58700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2d0066370 0x7fc2d0074310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35868/0 (socket says 172.21.15.31:35868) 2020-06-27T04:45:45.045 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d6a58700 1 -- 172.21.15.31:0/2870598803 learned_addr learned my addr 172.21.15.31:0/2870598803 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:45.045 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d6257700 1 --2- 172.21.15.31:0/2870598803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2d006be40 0x7fc2d0074a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:45.046 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d7259700 1 --2- 172.21.15.31:0/2870598803 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc2d0077960 0x7fc2d0077de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:45.046 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d6a58700 1 -- 172.21.15.31:0/2870598803 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc2d0077960 msgr2=0x7fc2d0077de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:45.046 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d6a58700 1 --2- 172.21.15.31:0/2870598803 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc2d0077960 0x7fc2d0077de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:45.046 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d6a58700 1 -- 172.21.15.31:0/2870598803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2d006be40 msgr2=0x7fc2d0074a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d6a58700 1 --2- 172.21.15.31:0/2870598803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2d006be40 0x7fc2d0074a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d6a58700 1 -- 172.21.15.31:0/2870598803 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d0078920 con 0x7fc2d0066370 2020-06-27T04:45:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.037+0000 7fc2d6a58700 1 --2- 172.21.15.31:0/2870598803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2d0066370 0x7fc2d0074310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc2cc002f70 tx=0x7fc2cc009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.038+0000 7fc2c2ffd700 1 -- 172.21.15.31:0/2870598803 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2cc00e030 con 0x7fc2d0066370 2020-06-27T04:45:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.038+0000 7fc2c2ffd700 1 -- 172.21.15.31:0/2870598803 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fc2cc013cb0 con 0x7fc2d0066370 2020-06-27T04:45:45.048 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.038+0000 7fc2d84bb700 1 -- 172.21.15.31:0/2870598803 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d0078b70 con 0x7fc2d0066370 2020-06-27T04:45:45.048 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.038+0000 7fc2c2ffd700 1 -- 172.21.15.31:0/2870598803 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2cc018070 con 0x7fc2d0066370 2020-06-27T04:45:45.048 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.038+0000 7fc2d84bb700 1 -- 172.21.15.31:0/2870598803 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d0122e70 con 0x7fc2d0066370 2020-06-27T04:45:45.048 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.038+0000 7fc2c2ffd700 1 -- 172.21.15.31:0/2870598803 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7fc2cc01dbd0 con 0x7fc2d0066370 2020-06-27T04:45:45.048 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.038+0000 7fc2d84bb700 1 -- 172.21.15.31:0/2870598803 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc2d006dce0 con 0x7fc2d0066370 2020-06-27T04:45:45.048 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.039+0000 7fc2c2ffd700 1 --2- 172.21.15.31:0/2870598803 >> v2:172.21.15.51:6800/950992045 conn(0x7fc2b402ab00 0x7fc2b402cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:45.049 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.039+0000 7fc2c2ffd700 1 -- 172.21.15.31:0/2870598803 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7fc2cc03c9c0 con 0x7fc2d0066370 2020-06-27T04:45:45.049 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.039+0000 7fc2c2ffd700 1 --2- 172.21.15.31:0/2870598803 >> v2:172.21.15.51:6813/1443623027 conn(0x7fc2b4033980 0x7fc2b4035e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:45.049 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.039+0000 7fc2c2ffd700 1 -- 172.21.15.31:0/2870598803 --> v2:172.21.15.51:6813/1443623027 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2b4036450 con 0x7fc2b4033980 2020-06-27T04:45:45.049 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.039+0000 7fc2c2ffd700 1 -- 172.21.15.31:0/2870598803 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2cc004610 con 0x7fc2d0066370 2020-06-27T04:45:45.049 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.039+0000 7fc2d6257700 1 --2- 172.21.15.31:0/2870598803 >> v2:172.21.15.51:6800/950992045 conn(0x7fc2b402ab00 0x7fc2b402cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:45.050 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.039+0000 7fc2d7259700 1 --2- 172.21.15.31:0/2870598803 >> v2:172.21.15.51:6813/1443623027 conn(0x7fc2b4033980 0x7fc2b4035e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:45.050 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.039+0000 7fc2d6257700 1 --2- 172.21.15.31:0/2870598803 >> v2:172.21.15.51:6800/950992045 conn(0x7fc2b402ab00 0x7fc2b402cfc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fc2c400b000 tx=0x7fc2c400b040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:45.050 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.039+0000 7fc2d7259700 1 --2- 172.21.15.31:0/2870598803 >> v2:172.21.15.51:6813/1443623027 conn(0x7fc2b4033980 0x7fc2b4035e20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:45.051 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.040+0000 7fc2c2ffd700 1 -- 172.21.15.31:0/2870598803 <== osd.7 v2:172.21.15.51:6813/1443623027 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7fc2b4036450 con 0x7fc2b4033980 2020-06-27T04:45:45.061 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.058+0000 7fc2d84bb700 1 -- 172.21.15.31:0/2870598803 --> v2:172.21.15.51:6813/1443623027 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc2d006e080 con 0x7fc2b4033980 2020-06-27T04:45:45.062 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.059+0000 7fc2c2ffd700 1 -- 172.21.15.31:0/2870598803 <== osd.7 v2:172.21.15.51:6813/1443623027 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc2d006e080 con 0x7fc2b4033980 2020-06-27T04:45:45.063 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.059+0000 7fc2d84bb700 1 -- 172.21.15.31:0/2870598803 >> v2:172.21.15.51:6813/1443623027 conn(0x7fc2b4033980 msgr2=0x7fc2b4035e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:45.063 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.059+0000 7fc2d84bb700 1 --2- 172.21.15.31:0/2870598803 >> v2:172.21.15.51:6813/1443623027 conn(0x7fc2b4033980 0x7fc2b4035e20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:45.063 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.059+0000 7fc2d84bb700 1 -- 172.21.15.31:0/2870598803 >> v2:172.21.15.51:6800/950992045 conn(0x7fc2b402ab00 msgr2=0x7fc2b402cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:45.063 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.059+0000 7fc2d84bb700 1 --2- 172.21.15.31:0/2870598803 >> v2:172.21.15.51:6800/950992045 conn(0x7fc2b402ab00 0x7fc2b402cfc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fc2c400b000 tx=0x7fc2c400b040).stop 2020-06-27T04:45:45.064 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.059+0000 7fc2d84bb700 1 -- 172.21.15.31:0/2870598803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2d0066370 msgr2=0x7fc2d0074310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:45.064 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.059+0000 7fc2d84bb700 1 --2- 172.21.15.31:0/2870598803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2d0066370 0x7fc2d0074310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc2cc002f70 tx=0x7fc2cc009b30).stop 2020-06-27T04:45:45.064 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.059+0000 7fc2d7259700 1 -- 172.21.15.31:0/2870598803 reap_dead start 2020-06-27T04:45:45.064 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.059+0000 7fc2d84bb700 1 -- 172.21.15.31:0/2870598803 shutdown_connections 2020-06-27T04:45:45.064 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.059+0000 7fc2d84bb700 1 -- 172.21.15.31:0/2870598803 >> 172.21.15.31:0/2870598803 conn(0x7fc2d0061840 msgr2=0x7fc2d006d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:45.065 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.059+0000 7fc2d84bb700 1 -- 172.21.15.31:0/2870598803 shutdown_connections 2020-06-27T04:45:45.065 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:45.059+0000 7fc2d84bb700 1 -- 172.21.15.31:0/2870598803 wait complete. 2020-06-27T04:45:45.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:44 smithi051 bash[18409]: cluster 2020-06-27T04:45:43.147726+0000 mgr.x (mgr.34109) 173 : cluster [DBG] pgmap v150: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:45.570 INFO:teuthology.orchestra.run.smithi031.stdout:201863462930 2020-06-27T04:45:45.570 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph osd last-stat-seq osd.0 2020-06-27T04:45:45.723 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:46.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:46 smithi031 bash[22603]: cluster 2020-06-27T04:45:45.148487+0000 mgr.x (mgr.34109) 174 : cluster [DBG] pgmap v151: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:47.057 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:46 smithi031 bash[18426]: cluster 2020-06-27T04:45:45.148487+0000 mgr.x (mgr.34109) 174 : cluster [DBG] pgmap v151: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:47.217 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:46 smithi051 bash[18409]: cluster 2020-06-27T04:45:45.148487+0000 mgr.x (mgr.34109) 174 : cluster [DBG] pgmap v151: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:47.275 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f359e700 1 Processor -- start 2020-06-27T04:45:47.275 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f359e700 1 -- start start 2020-06-27T04:45:47.276 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74f4066220 0x7f74f40650a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:47.276 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f359e700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f74f40676c0 0x7f74f4077fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:47.276 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f40785e0 0x7f74f4122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:47.276 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f4078cd0 con 0x7f74f40785e0 2020-06-27T04:45:47.276 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f359e700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f41231a0 con 0x7f74f40676c0 2020-06-27T04:45:47.277 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f41232e0 con 0x7f74f4066220 2020-06-27T04:45:47.277 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f2d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74f4066220 0x7f74f40650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:47.277 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f2d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74f4066220 0x7f74f40650a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35884/0 (socket says 172.21.15.31:35884) 2020-06-27T04:45:47.277 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f8f99700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f40785e0 0x7f74f4122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:47.277 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f2d9d700 1 -- 172.21.15.31:0/2616721402 learned_addr learned my addr 172.21.15.31:0/2616721402 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:47.278 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f259c700 1 --2- 172.21.15.31:0/2616721402 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f74f40676c0 0x7f74f4077fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:47.278 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f8f99700 1 -- 172.21.15.31:0/2616721402 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74f4066220 msgr2=0x7f74f40650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:47.278 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f8f99700 1 --2- 172.21.15.31:0/2616721402 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74f4066220 0x7f74f40650a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:47.278 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f8f99700 1 -- 172.21.15.31:0/2616721402 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f74f40676c0 msgr2=0x7f74f4077fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:47.278 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f8f99700 1 --2- 172.21.15.31:0/2616721402 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f74f40676c0 0x7f74f4077fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:47.279 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f8f99700 1 -- 172.21.15.31:0/2616721402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f41234a0 con 0x7f74f40785e0 2020-06-27T04:45:47.279 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f2d9d700 1 --2- 172.21.15.31:0/2616721402 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74f4066220 0x7f74f40650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:45:47.279 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.271+0000 7f74f8f99700 1 --2- 172.21.15.31:0/2616721402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f40785e0 0x7f74f4122cb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f74ec0032f0 tx=0x7f74ec004cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:47.279 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.272+0000 7f74eaffd700 1 -- 172.21.15.31:0/2616721402 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74ec00e030 con 0x7f74f40785e0 2020-06-27T04:45:47.279 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.272+0000 7f74f359e700 1 -- 172.21.15.31:0/2616721402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f41236f0 con 0x7f74f40785e0 2020-06-27T04:45:47.280 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.272+0000 7f74eaffd700 1 -- 172.21.15.31:0/2616721402 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f74ec013ac0 con 0x7f74f40785e0 2020-06-27T04:45:47.280 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.272+0000 7f74eaffd700 1 -- 172.21.15.31:0/2616721402 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74ec018070 con 0x7f74f40785e0 2020-06-27T04:45:47.280 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.272+0000 7f74f359e700 1 -- 172.21.15.31:0/2616721402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f4123bb0 con 0x7f74f40785e0 2020-06-27T04:45:47.281 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.272+0000 7f74eaffd700 1 -- 172.21.15.31:0/2616721402 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f74ec013680 con 0x7f74f40785e0 2020-06-27T04:45:47.281 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.273+0000 7f74eaffd700 1 --2- 172.21.15.31:0/2616721402 >> v2:172.21.15.51:6800/950992045 conn(0x7f74cc02ab00 0x7f74cc02cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:47.282 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.273+0000 7f74eaffd700 1 -- 172.21.15.31:0/2616721402 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7f74ec03c830 con 0x7f74f40785e0 2020-06-27T04:45:47.283 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.273+0000 7f74f359e700 1 -- 172.21.15.31:0/2616721402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f405e210 con 0x7f74f40785e0 2020-06-27T04:45:47.283 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.273+0000 7f74f2d9d700 1 --2- 172.21.15.31:0/2616721402 >> v2:172.21.15.51:6800/950992045 conn(0x7f74cc02ab00 0x7f74cc02cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:47.283 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.273+0000 7f74f2d9d700 1 --2- 172.21.15.31:0/2616721402 >> v2:172.21.15.51:6800/950992045 conn(0x7f74cc02ab00 0x7f74cc02cfc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f74e400d000 tx=0x7f74e4007d50).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:47.283 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.277+0000 7f74eaffd700 1 -- 172.21.15.31:0/2616721402 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f74ec011370 con 0x7f74f40785e0 2020-06-27T04:45:47.439 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.435+0000 7f74f359e700 1 -- 172.21.15.31:0/2616721402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f74f405c320 con 0x7f74f40785e0 2020-06-27T04:45:47.439 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.435+0000 7f74eaffd700 1 -- 172.21.15.31:0/2616721402 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74ec012bc0 con 0x7f74f40785e0 2020-06-27T04:45:47.439 INFO:teuthology.orchestra.run.smithi031.stdout:47244640297 2020-06-27T04:45:47.440 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.437+0000 7f74f359e700 1 -- 172.21.15.31:0/2616721402 >> v2:172.21.15.51:6800/950992045 conn(0x7f74cc02ab00 msgr2=0x7f74cc02cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:47.440 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.437+0000 7f74f359e700 1 --2- 172.21.15.31:0/2616721402 >> v2:172.21.15.51:6800/950992045 conn(0x7f74cc02ab00 0x7f74cc02cfc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f74e400d000 tx=0x7f74e4007d50).stop 2020-06-27T04:45:47.441 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.437+0000 7f74f359e700 1 -- 172.21.15.31:0/2616721402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f40785e0 msgr2=0x7f74f4122cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:47.441 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.437+0000 7f74f359e700 1 --2- 172.21.15.31:0/2616721402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f40785e0 0x7f74f4122cb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f74ec0032f0 tx=0x7f74ec004cf0).stop 2020-06-27T04:45:47.441 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.437+0000 7f74f359e700 1 -- 172.21.15.31:0/2616721402 shutdown_connections 2020-06-27T04:45:47.441 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.437+0000 7f74f359e700 1 --2- 172.21.15.31:0/2616721402 >> v2:172.21.15.51:6800/950992045 conn(0x7f74cc02ab00 0x7f74cc02cfc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:47.442 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.437+0000 7f74f359e700 1 --2- 172.21.15.31:0/2616721402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f40785e0 0x7f74f4122cb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:47.442 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.437+0000 7f74f359e700 1 --2- 172.21.15.31:0/2616721402 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74f4066220 0x7f74f40650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:47.442 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.437+0000 7f74f359e700 1 --2- 172.21.15.31:0/2616721402 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f74f40676c0 0x7f74f4077fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:47.442 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.437+0000 7f74f359e700 1 -- 172.21.15.31:0/2616721402 >> 172.21.15.31:0/2616721402 conn(0x7f74f4025510 msgr2=0x7f74f406c910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:47.442 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.437+0000 7f74f359e700 1 -- 172.21.15.31:0/2616721402 shutdown_connections 2020-06-27T04:45:47.443 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:47.437+0000 7f74f359e700 1 -- 172.21.15.31:0/2616721402 wait complete. 2020-06-27T04:45:47.956 INFO:tasks.cephadm.ceph_manager.ceph:need seq 47244640293 got 47244640297 for osd.0 2020-06-27T04:45:47.957 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph osd last-stat-seq osd.1 2020-06-27T04:45:48.102 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:48.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:48 smithi031 bash[18426]: cluster 2020-06-27T04:45:47.149100+0000 mgr.x (mgr.34109) 175 : cluster [DBG] pgmap v152: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:48.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:48 smithi031 bash[18426]: audit 2020-06-27T04:45:47.437033+0000 mon.a (mon.0) 525 : audit [DBG] from='client.? 172.21.15.31:0/2616721402' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2020-06-27T04:45:48.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:48 smithi031 bash[22603]: cluster 2020-06-27T04:45:47.149100+0000 mgr.x (mgr.34109) 175 : cluster [DBG] pgmap v152: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:48.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:48 smithi031 bash[22603]: audit 2020-06-27T04:45:47.437033+0000 mon.a (mon.0) 525 : audit [DBG] from='client.? 172.21.15.31:0/2616721402' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2020-06-27T04:45:48.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:48 smithi051 bash[18409]: cluster 2020-06-27T04:45:47.149100+0000 mgr.x (mgr.34109) 175 : cluster [DBG] pgmap v152: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:48.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:48 smithi051 bash[18409]: audit 2020-06-27T04:45:47.437033+0000 mon.a (mon.0) 525 : audit [DBG] from='client.? 172.21.15.31:0/2616721402' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2020-06-27T04:45:49.699 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f4b59e700 1 Processor -- start 2020-06-27T04:45:49.700 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f4b59e700 1 -- start start 2020-06-27T04:45:49.700 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f4b59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f4c066220 0x7f7f4c06d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:49.700 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f4b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f4c06bc70 0x7f7f4c078130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:49.701 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f4b59e700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f7f4c078760 0x7f7f4c122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:49.701 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f4b59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4c1231a0 con 0x7f7f4c06bc70 2020-06-27T04:45:49.701 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f4b59e700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4c1232e0 con 0x7f7f4c078760 2020-06-27T04:45:49.701 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f4b59e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4c123420 con 0x7f7f4c066220 2020-06-27T04:45:49.701 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f4ad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f4c066220 0x7f7f4c06d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:49.702 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f4ad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f4c066220 0x7f7f4c06d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35898/0 (socket says 172.21.15.31:35898) 2020-06-27T04:45:49.702 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f4ad9d700 1 -- 172.21.15.31:0/1216896630 learned_addr learned my addr 172.21.15.31:0/1216896630 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:49.702 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f4a59c700 1 --2- 172.21.15.31:0/1216896630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f4c06bc70 0x7f7f4c078130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:49.702 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f50a8f700 1 --2- 172.21.15.31:0/1216896630 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f7f4c078760 0x7f7f4c122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:49.704 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f4ad9d700 1 -- 172.21.15.31:0/1216896630 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f7f4c078760 msgr2=0x7f7f4c122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:49.704 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f4ad9d700 1 --2- 172.21.15.31:0/1216896630 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f7f4c078760 0x7f7f4c122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:49.704 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f4ad9d700 1 -- 172.21.15.31:0/1216896630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f4c06bc70 msgr2=0x7f7f4c078130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:49.704 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f4ad9d700 1 --2- 172.21.15.31:0/1216896630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f4c06bc70 0x7f7f4c078130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:49.704 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f4ad9d700 1 -- 172.21.15.31:0/1216896630 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4c1235e0 con 0x7f7f4c066220 2020-06-27T04:45:49.705 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.696+0000 7f7f4ad9d700 1 --2- 172.21.15.31:0/1216896630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f4c066220 0x7f7f4c06d430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7f34002f70 tx=0x7f7f34009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:49.705 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.697+0000 7f7f42ffd700 1 -- 172.21.15.31:0/1216896630 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f3400e030 con 0x7f7f4c066220 2020-06-27T04:45:49.705 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.697+0000 7f7f42ffd700 1 -- 172.21.15.31:0/1216896630 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f7f34013aa0 con 0x7f7f4c066220 2020-06-27T04:45:49.705 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.697+0000 7f7f4b59e700 1 -- 172.21.15.31:0/1216896630 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4c123830 con 0x7f7f4c066220 2020-06-27T04:45:49.705 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.697+0000 7f7f42ffd700 1 -- 172.21.15.31:0/1216896630 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f34018070 con 0x7f7f4c066220 2020-06-27T04:45:49.706 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.697+0000 7f7f4b59e700 1 -- 172.21.15.31:0/1216896630 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4c123cf0 con 0x7f7f4c066220 2020-06-27T04:45:49.706 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.698+0000 7f7f42ffd700 1 -- 172.21.15.31:0/1216896630 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f7f3401d7e0 con 0x7f7f4c066220 2020-06-27T04:45:49.706 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.698+0000 7f7f42ffd700 1 --2- 172.21.15.31:0/1216896630 >> v2:172.21.15.51:6800/950992045 conn(0x7f7f2402ab50 0x7f7f2402d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:49.706 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.698+0000 7f7f42ffd700 1 -- 172.21.15.31:0/1216896630 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7f7f3403c600 con 0x7f7f4c066220 2020-06-27T04:45:49.706 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.698+0000 7f7f4a59c700 1 --2- 172.21.15.31:0/1216896630 >> v2:172.21.15.51:6800/950992045 conn(0x7f7f2402ab50 0x7f7f2402d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:49.707 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.699+0000 7f7f4b59e700 1 -- 172.21.15.31:0/1216896630 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4c05e210 con 0x7f7f4c066220 2020-06-27T04:45:49.707 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.699+0000 7f7f4a59c700 1 --2- 172.21.15.31:0/1216896630 >> v2:172.21.15.51:6800/950992045 conn(0x7f7f2402ab50 0x7f7f2402d010 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f7f3c00c000 tx=0x7f7f3c009040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:49.707 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.702+0000 7f7f42ffd700 1 -- 172.21.15.31:0/1216896630 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f7f34027440 con 0x7f7f4c066220 2020-06-27T04:45:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.853+0000 7f7f4b59e700 1 -- 172.21.15.31:0/1216896630 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7f4c05c320 con 0x7f7f4c066220 2020-06-27T04:45:49.857 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.853+0000 7f7f42ffd700 1 -- 172.21.15.31:0/1216896630 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f340123d0 con 0x7f7f4c066220 2020-06-27T04:45:49.857 INFO:teuthology.orchestra.run.smithi031.stdout:73014444071 2020-06-27T04:45:49.858 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.854+0000 7f7f4b59e700 1 -- 172.21.15.31:0/1216896630 >> v2:172.21.15.51:6800/950992045 conn(0x7f7f2402ab50 msgr2=0x7f7f2402d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:49.858 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.854+0000 7f7f4b59e700 1 --2- 172.21.15.31:0/1216896630 >> v2:172.21.15.51:6800/950992045 conn(0x7f7f2402ab50 0x7f7f2402d010 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f7f3c00c000 tx=0x7f7f3c009040).stop 2020-06-27T04:45:49.858 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.854+0000 7f7f4b59e700 1 -- 172.21.15.31:0/1216896630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f4c066220 msgr2=0x7f7f4c06d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:49.858 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.854+0000 7f7f4b59e700 1 --2- 172.21.15.31:0/1216896630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f4c066220 0x7f7f4c06d430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7f34002f70 tx=0x7f7f34009b30).stop 2020-06-27T04:45:49.859 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.854+0000 7f7f4b59e700 1 -- 172.21.15.31:0/1216896630 shutdown_connections 2020-06-27T04:45:49.859 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.854+0000 7f7f4b59e700 1 --2- 172.21.15.31:0/1216896630 >> v2:172.21.15.51:6800/950992045 conn(0x7f7f2402ab50 0x7f7f2402d010 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:49.859 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.854+0000 7f7f4b59e700 1 --2- 172.21.15.31:0/1216896630 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f7f4c078760 0x7f7f4c122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:49.859 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.854+0000 7f7f4b59e700 1 --2- 172.21.15.31:0/1216896630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f4c066220 0x7f7f4c06d430 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:49.859 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.854+0000 7f7f4b59e700 1 --2- 172.21.15.31:0/1216896630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f4c06bc70 0x7f7f4c078130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:49.860 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.855+0000 7f7f4b59e700 1 -- 172.21.15.31:0/1216896630 >> 172.21.15.31:0/1216896630 conn(0x7f7f4c025510 msgr2=0x7f7f4c06da20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:49.860 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.855+0000 7f7f4b59e700 1 -- 172.21.15.31:0/1216896630 shutdown_connections 2020-06-27T04:45:49.860 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:49.855+0000 7f7f4b59e700 1 -- 172.21.15.31:0/1216896630 wait complete. 2020-06-27T04:45:50.208 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:50 smithi031 bash[18426]: cluster 2020-06-27T04:45:49.149880+0000 mgr.x (mgr.34109) 176 : cluster [DBG] pgmap v153: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:50.209 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:50 smithi031 bash[18426]: audit 2020-06-27T04:45:49.854657+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.31:0/1216896630' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2020-06-27T04:45:50.355 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444067 got 73014444071 for osd.1 2020-06-27T04:45:50.356 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph osd last-stat-seq osd.2 2020-06-27T04:45:50.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:50 smithi051 bash[18409]: cluster 2020-06-27T04:45:49.149880+0000 mgr.x (mgr.34109) 176 : cluster [DBG] pgmap v153: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:50.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:50 smithi051 bash[18409]: audit 2020-06-27T04:45:49.854657+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.31:0/1216896630' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2020-06-27T04:45:50.472 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:50 smithi031 bash[22603]: cluster 2020-06-27T04:45:49.149880+0000 mgr.x (mgr.34109) 176 : cluster [DBG] pgmap v153: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:50.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:50 smithi031 bash[22603]: audit 2020-06-27T04:45:49.854657+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.31:0/1216896630' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2020-06-27T04:45:50.502 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:52.069 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.064+0000 7f0f1e0e6700 1 Processor -- start 2020-06-27T04:45:52.069 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.064+0000 7f0f1e0e6700 1 -- start start 2020-06-27T04:45:52.069 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.064+0000 7f0f1e0e6700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0f18066370 0x7f0f1806cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:52.069 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0f1e0e6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f1806be40 0x7f0f180782a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:52.070 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0f1e0e6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f180788d0 0x7f0f18122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:52.070 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0f1e0e6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f18123280 con 0x7f0f180788d0 2020-06-27T04:45:52.070 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0f1e0e6700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f181233f0 con 0x7f0f18066370 2020-06-27T04:45:52.070 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0f1e0e6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f181235b0 con 0x7f0f1806be40 2020-06-27T04:45:52.070 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0f177fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f1806be40 0x7f0f180782a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:52.071 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0f177fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f1806be40 0x7f0f180782a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35912/0 (socket says 172.21.15.31:35912) 2020-06-27T04:45:52.071 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0f177fe700 1 -- 172.21.15.31:0/376917870 learned_addr learned my addr 172.21.15.31:0/376917870 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:52.071 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0f1ce84700 1 --2- 172.21.15.31:0/376917870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f180788d0 0x7f0f18122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:52.071 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0f17fff700 1 --2- 172.21.15.31:0/376917870 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0f18066370 0x7f0f1806cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:52.071 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0f177fe700 1 -- 172.21.15.31:0/376917870 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0f18066370 msgr2=0x7f0f1806cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:52.072 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0f177fe700 1 --2- 172.21.15.31:0/376917870 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0f18066370 0x7f0f1806cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:52.072 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0f177fe700 1 -- 172.21.15.31:0/376917870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f180788d0 msgr2=0x7f0f18122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:52.072 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0f177fe700 1 --2- 172.21.15.31:0/376917870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f180788d0 0x7f0f18122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:52.072 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0f177fe700 1 -- 172.21.15.31:0/376917870 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f18123770 con 0x7f0f1806be40 2020-06-27T04:45:52.072 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0f177fe700 1 --2- 172.21.15.31:0/376917870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f1806be40 0x7f0f180782a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f0f0c004370 tx=0x7f0f0c009d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:52.072 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0efffff700 1 -- 172.21.15.31:0/376917870 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f0c00d7a0 con 0x7f0f1806be40 2020-06-27T04:45:52.073 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0efffff700 1 -- 172.21.15.31:0/376917870 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f0f0c00f040 con 0x7f0f1806be40 2020-06-27T04:45:52.073 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0f1e0e6700 1 -- 172.21.15.31:0/376917870 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f18123a20 con 0x7f0f1806be40 2020-06-27T04:45:52.073 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0efffff700 1 -- 172.21.15.31:0/376917870 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f0c013a40 con 0x7f0f1806be40 2020-06-27T04:45:52.074 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.065+0000 7f0f1e0e6700 1 -- 172.21.15.31:0/376917870 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f18123f40 con 0x7f0f1806be40 2020-06-27T04:45:52.075 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.066+0000 7f0efffff700 1 -- 172.21.15.31:0/376917870 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f0f0c019070 con 0x7f0f1806be40 2020-06-27T04:45:52.075 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.066+0000 7f0efffff700 1 --2- 172.21.15.31:0/376917870 >> v2:172.21.15.51:6800/950992045 conn(0x7f0ef402ab00 0x7f0ef402cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:52.075 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.066+0000 7f0efffff700 1 -- 172.21.15.31:0/376917870 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7f0f0c03a510 con 0x7f0f1806be40 2020-06-27T04:45:52.075 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.066+0000 7f0f1e0e6700 1 -- 172.21.15.31:0/376917870 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f1805e210 con 0x7f0f1806be40 2020-06-27T04:45:52.076 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.066+0000 7f0f17fff700 1 --2- 172.21.15.31:0/376917870 >> v2:172.21.15.51:6800/950992045 conn(0x7f0ef402ab00 0x7f0ef402cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:52.076 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.067+0000 7f0f17fff700 1 --2- 172.21.15.31:0/376917870 >> v2:172.21.15.51:6800/950992045 conn(0x7f0ef402ab00 0x7f0ef402cfc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f0f08014000 tx=0x7f0f08009b30).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:52.076 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.070+0000 7f0efffff700 1 -- 172.21.15.31:0/376917870 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f0f0c018260 con 0x7f0f1806be40 2020-06-27T04:45:52.229 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.225+0000 7f0f1e0e6700 1 -- 172.21.15.31:0/376917870 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0f181241f0 con 0x7f0f1806be40 2020-06-27T04:45:52.229 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.225+0000 7f0efffff700 1 -- 172.21.15.31:0/376917870 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0f0c01be60 con 0x7f0f1806be40 2020-06-27T04:45:52.229 INFO:teuthology.orchestra.run.smithi031.stdout:94489280547 2020-06-27T04:45:52.230 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.227+0000 7f0f1e0e6700 1 -- 172.21.15.31:0/376917870 >> v2:172.21.15.51:6800/950992045 conn(0x7f0ef402ab00 msgr2=0x7f0ef402cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:52.231 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.227+0000 7f0f1e0e6700 1 --2- 172.21.15.31:0/376917870 >> v2:172.21.15.51:6800/950992045 conn(0x7f0ef402ab00 0x7f0ef402cfc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f0f08014000 tx=0x7f0f08009b30).stop 2020-06-27T04:45:52.231 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.227+0000 7f0f1e0e6700 1 -- 172.21.15.31:0/376917870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f1806be40 msgr2=0x7f0f180782a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:52.231 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.227+0000 7f0f1e0e6700 1 --2- 172.21.15.31:0/376917870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f1806be40 0x7f0f180782a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f0f0c004370 tx=0x7f0f0c009d50).stop 2020-06-27T04:45:52.231 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.227+0000 7f0f1e0e6700 1 -- 172.21.15.31:0/376917870 shutdown_connections 2020-06-27T04:45:52.231 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.227+0000 7f0f1e0e6700 1 --2- 172.21.15.31:0/376917870 >> v2:172.21.15.51:6800/950992045 conn(0x7f0ef402ab00 0x7f0ef402cfc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:52.232 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.227+0000 7f0f1e0e6700 1 --2- 172.21.15.31:0/376917870 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f0f18066370 0x7f0f1806cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:52.232 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.227+0000 7f0f1e0e6700 1 --2- 172.21.15.31:0/376917870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f180788d0 0x7f0f18122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:52.232 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.227+0000 7f0f1e0e6700 1 --2- 172.21.15.31:0/376917870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f1806be40 0x7f0f180782a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:52.232 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.227+0000 7f0f1e0e6700 1 -- 172.21.15.31:0/376917870 >> 172.21.15.31:0/376917870 conn(0x7f0f18061840 msgr2=0x7f0f1806d360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:52.232 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.227+0000 7f0f1e0e6700 1 -- 172.21.15.31:0/376917870 shutdown_connections 2020-06-27T04:45:52.232 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:52.227+0000 7f0f1e0e6700 1 -- 172.21.15.31:0/376917870 wait complete. 2020-06-27T04:45:52.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:52 smithi051 bash[18409]: cluster 2020-06-27T04:45:51.150462+0000 mgr.x (mgr.34109) 177 : cluster [DBG] pgmap v154: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:52.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:52 smithi031 bash[18426]: cluster 2020-06-27T04:45:51.150462+0000 mgr.x (mgr.34109) 177 : cluster [DBG] pgmap v154: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:52.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:52 smithi031 bash[22603]: cluster 2020-06-27T04:45:51.150462+0000 mgr.x (mgr.34109) 177 : cluster [DBG] pgmap v154: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:52.774 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280543 got 94489280547 for osd.2 2020-06-27T04:45:52.774 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph osd last-stat-seq osd.3 2020-06-27T04:45:52.922 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:53.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:53 smithi031 bash[18426]: audit 2020-06-27T04:45:52.226979+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.31:0/376917870' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2020-06-27T04:45:53.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:53 smithi031 bash[22603]: audit 2020-06-27T04:45:52.226979+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.31:0/376917870' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2020-06-27T04:45:53.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:53 smithi051 bash[18409]: audit 2020-06-27T04:45:52.226979+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.31:0/376917870' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2020-06-27T04:45:54.320 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:54 smithi031 bash[18426]: cluster 2020-06-27T04:45:53.151082+0000 mgr.x (mgr.34109) 178 : cluster [DBG] pgmap v155: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:54.320 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:54 smithi031 bash[22603]: cluster 2020-06-27T04:45:53.151082+0000 mgr.x (mgr.34109) 178 : cluster [DBG] pgmap v155: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:54.582 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.578+0000 7fa7cceab700 1 Processor -- start 2020-06-27T04:45:54.583 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.578+0000 7fa7cceab700 1 -- start start 2020-06-27T04:45:54.583 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.578+0000 7fa7cceab700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7c8066370 0x7fa7c8074310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:54.583 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.578+0000 7fa7cceab700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fa7c806be40 0x7fa7c8074a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:54.583 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.578+0000 7fa7cceab700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7c8077910 0x7fa7c8077d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:54.584 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.578+0000 7fa7cceab700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c80783e0 con 0x7fa7c8077910 2020-06-27T04:45:54.584 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.578+0000 7fa7cceab700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c8078550 con 0x7fa7c806be40 2020-06-27T04:45:54.584 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.578+0000 7fa7cceab700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c8078710 con 0x7fa7c8066370 2020-06-27T04:45:54.584 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.578+0000 7fa7c6d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7c8066370 0x7fa7c8074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:54.584 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.578+0000 7fa7c6d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7c8066370 0x7fa7c8074310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35924/0 (socket says 172.21.15.31:35924) 2020-06-27T04:45:54.585 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.578+0000 7fa7c759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7c8077910 0x7fa7c8077d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:54.585 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.578+0000 7fa7c6d9d700 1 -- 172.21.15.31:0/2541924406 learned_addr learned my addr 172.21.15.31:0/2541924406 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:54.585 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.578+0000 7fa7be59c700 1 --2- 172.21.15.31:0/2541924406 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fa7c806be40 0x7fa7c8074a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:54.585 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.579+0000 7fa7c6d9d700 1 -- 172.21.15.31:0/2541924406 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fa7c806be40 msgr2=0x7fa7c8074a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:54.585 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.579+0000 7fa7c6d9d700 1 --2- 172.21.15.31:0/2541924406 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fa7c806be40 0x7fa7c8074a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:54.586 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.579+0000 7fa7c6d9d700 1 -- 172.21.15.31:0/2541924406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7c8077910 msgr2=0x7fa7c8077d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:54.586 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.579+0000 7fa7c6d9d700 1 --2- 172.21.15.31:0/2541924406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7c8077910 0x7fa7c8077d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:54.586 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.579+0000 7fa7c6d9d700 1 -- 172.21.15.31:0/2541924406 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c80788d0 con 0x7fa7c8066370 2020-06-27T04:45:54.586 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.579+0000 7fa7c759e700 1 --2- 172.21.15.31:0/2541924406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7c8077910 0x7fa7c8077d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:45:54.587 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.579+0000 7fa7c6d9d700 1 --2- 172.21.15.31:0/2541924406 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7c8066370 0x7fa7c8074310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa7b8002f70 tx=0x7fa7b8009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:54.587 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.579+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2541924406 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7b800e030 con 0x7fa7c8066370 2020-06-27T04:45:54.587 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.579+0000 7fa7cceab700 1 -- 172.21.15.31:0/2541924406 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c8078b20 con 0x7fa7c8066370 2020-06-27T04:45:54.587 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.579+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2541924406 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fa7b8013cb0 con 0x7fa7c8066370 2020-06-27T04:45:54.588 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.579+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2541924406 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7b8018070 con 0x7fa7c8066370 2020-06-27T04:45:54.588 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.579+0000 7fa7cceab700 1 -- 172.21.15.31:0/2541924406 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c8122e70 con 0x7fa7c8066370 2020-06-27T04:45:54.589 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.580+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2541924406 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7fa7b801db30 con 0x7fa7c8066370 2020-06-27T04:45:54.589 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.580+0000 7fa7bf7fe700 1 --2- 172.21.15.31:0/2541924406 >> v2:172.21.15.51:6800/950992045 conn(0x7fa7a402ab50 0x7fa7a402d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:54.589 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.580+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2541924406 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7fa7b803c800 con 0x7fa7c8066370 2020-06-27T04:45:54.589 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.580+0000 7fa7cceab700 1 -- 172.21.15.31:0/2541924406 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c805e210 con 0x7fa7c8066370 2020-06-27T04:45:54.590 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.580+0000 7fa7be59c700 1 --2- 172.21.15.31:0/2541924406 >> v2:172.21.15.51:6800/950992045 conn(0x7fa7a402ab50 0x7fa7a402d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:54.590 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.581+0000 7fa7be59c700 1 --2- 172.21.15.31:0/2541924406 >> v2:172.21.15.51:6800/950992045 conn(0x7fa7a402ab50 0x7fa7a402d010 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fa7b000b000 tx=0x7fa7b000b040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:54.590 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.584+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2541924406 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fa7b8013e20 con 0x7fa7c8066370 2020-06-27T04:45:54.717 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:54 smithi051 bash[18409]: cluster 2020-06-27T04:45:53.151082+0000 mgr.x (mgr.34109) 178 : cluster [DBG] pgmap v155: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.737+0000 7fa7cceab700 1 -- 172.21.15.31:0/2541924406 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa7c8123000 con 0x7fa7c8066370 2020-06-27T04:45:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.737+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2541924406 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa7b80123d0 con 0x7fa7c8066370 2020-06-27T04:45:54.741 INFO:teuthology.orchestra.run.smithi031.stdout:115964117025 2020-06-27T04:45:54.742 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.739+0000 7fa7cceab700 1 -- 172.21.15.31:0/2541924406 >> v2:172.21.15.51:6800/950992045 conn(0x7fa7a402ab50 msgr2=0x7fa7a402d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:54.742 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.739+0000 7fa7cceab700 1 --2- 172.21.15.31:0/2541924406 >> v2:172.21.15.51:6800/950992045 conn(0x7fa7a402ab50 0x7fa7a402d010 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fa7b000b000 tx=0x7fa7b000b040).stop 2020-06-27T04:45:54.743 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.739+0000 7fa7cceab700 1 -- 172.21.15.31:0/2541924406 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7c8066370 msgr2=0x7fa7c8074310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:54.743 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.739+0000 7fa7cceab700 1 --2- 172.21.15.31:0/2541924406 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7c8066370 0x7fa7c8074310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa7b8002f70 tx=0x7fa7b8009b30).stop 2020-06-27T04:45:54.743 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.739+0000 7fa7cceab700 1 -- 172.21.15.31:0/2541924406 shutdown_connections 2020-06-27T04:45:54.743 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.739+0000 7fa7cceab700 1 --2- 172.21.15.31:0/2541924406 >> v2:172.21.15.51:6800/950992045 conn(0x7fa7a402ab50 0x7fa7a402d010 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:54.743 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.739+0000 7fa7cceab700 1 --2- 172.21.15.31:0/2541924406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7c8077910 0x7fa7c8077d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:54.744 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.739+0000 7fa7cceab700 1 --2- 172.21.15.31:0/2541924406 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7c8066370 0x7fa7c8074310 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:54.744 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.739+0000 7fa7cceab700 1 --2- 172.21.15.31:0/2541924406 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fa7c806be40 0x7fa7c8074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:54.744 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.739+0000 7fa7cceab700 1 -- 172.21.15.31:0/2541924406 >> 172.21.15.31:0/2541924406 conn(0x7fa7c8061840 msgr2=0x7fa7c806d360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:54.744 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.739+0000 7fa7cceab700 1 -- 172.21.15.31:0/2541924406 shutdown_connections 2020-06-27T04:45:54.744 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:54.739+0000 7fa7cceab700 1 -- 172.21.15.31:0/2541924406 wait complete. 2020-06-27T04:45:55.247 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117022 got 115964117025 for osd.3 2020-06-27T04:45:55.248 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph osd last-stat-seq osd.4 2020-06-27T04:45:55.393 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:55.662 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:55 smithi031 bash[18426]: audit 2020-06-27T04:45:54.738663+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.31:0/2541924406' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2020-06-27T04:45:55.663 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:55 smithi031 bash[22603]: audit 2020-06-27T04:45:54.738663+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.31:0/2541924406' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2020-06-27T04:45:55.717 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:55 smithi051 bash[18409]: audit 2020-06-27T04:45:54.738663+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.31:0/2541924406' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2020-06-27T04:45:56.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:56 smithi031 bash[18426]: cluster 2020-06-27T04:45:55.151785+0000 mgr.x (mgr.34109) 179 : cluster [DBG] pgmap v156: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:56.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:56 smithi031 bash[22603]: cluster 2020-06-27T04:45:55.151785+0000 mgr.x (mgr.34109) 179 : cluster [DBG] pgmap v156: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:56.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:56 smithi051 bash[18409]: cluster 2020-06-27T04:45:55.151785+0000 mgr.x (mgr.34109) 179 : cluster [DBG] pgmap v156: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:57.026 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.021+0000 7f2735e06700 1 Processor -- start 2020-06-27T04:45:57.026 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.021+0000 7f2735e06700 1 -- start start 2020-06-27T04:45:57.026 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f2735e06700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f2730066370 0x7f27300742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:57.027 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f2735e06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f273006be40 0x7f27300749a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:57.027 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f2735e06700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2730077900 0x7f2730077d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:57.027 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f2735e06700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27300783d0 con 0x7f273006be40 2020-06-27T04:45:57.027 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f2735e06700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2730078540 con 0x7f2730066370 2020-06-27T04:45:57.027 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f2735e06700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2730078700 con 0x7f2730077900 2020-06-27T04:45:57.028 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f2727fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f273006be40 0x7f27300749a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:57.028 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f2734ba4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2730077900 0x7f2730077d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:57.028 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f2727fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f273006be40 0x7f27300749a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39692/0 (socket says 172.21.15.31:39692) 2020-06-27T04:45:57.028 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f2727fff700 1 -- 172.21.15.31:0/1752842777 learned_addr learned my addr 172.21.15.31:0/1752842777 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:57.028 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f272ffff700 1 --2- 172.21.15.31:0/1752842777 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f2730066370 0x7f27300742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:57.029 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f2734ba4700 1 -- 172.21.15.31:0/1752842777 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f2730066370 msgr2=0x7f27300742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:57.029 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f2734ba4700 1 --2- 172.21.15.31:0/1752842777 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f2730066370 0x7f27300742b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:57.029 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f2734ba4700 1 -- 172.21.15.31:0/1752842777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f273006be40 msgr2=0x7f27300749a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:57.029 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f2734ba4700 1 --2- 172.21.15.31:0/1752842777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f273006be40 0x7f27300749a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:57.029 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f2734ba4700 1 -- 172.21.15.31:0/1752842777 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27300788c0 con 0x7f2730077900 2020-06-27T04:45:57.030 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f2727fff700 1 --2- 172.21.15.31:0/1752842777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f273006be40 0x7f27300749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:45:57.030 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f2734ba4700 1 --2- 172.21.15.31:0/1752842777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2730077900 0x7f2730077d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f272800c000 tx=0x7f272800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:57.030 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f272cff9700 1 -- 172.21.15.31:0/1752842777 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27280094d0 con 0x7f2730077900 2020-06-27T04:45:57.030 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f2735e06700 1 -- 172.21.15.31:0/1752842777 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2730078b70 con 0x7f2730077900 2020-06-27T04:45:57.030 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f272cff9700 1 -- 172.21.15.31:0/1752842777 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f272800f040 con 0x7f2730077900 2020-06-27T04:45:57.031 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.022+0000 7f272cff9700 1 -- 172.21.15.31:0/1752842777 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2728007c60 con 0x7f2730077900 2020-06-27T04:45:57.031 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.023+0000 7f2735e06700 1 -- 172.21.15.31:0/1752842777 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2730122f20 con 0x7f2730077900 2020-06-27T04:45:57.032 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.023+0000 7f272cff9700 1 -- 172.21.15.31:0/1752842777 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f2728014460 con 0x7f2730077900 2020-06-27T04:45:57.032 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.023+0000 7f272cff9700 1 --2- 172.21.15.31:0/1752842777 >> v2:172.21.15.51:6800/950992045 conn(0x7f270802ab00 0x7f270802cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:57.032 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.023+0000 7f272cff9700 1 -- 172.21.15.31:0/1752842777 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7f272803ae90 con 0x7f2730077900 2020-06-27T04:45:57.033 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.023+0000 7f2735e06700 1 -- 172.21.15.31:0/1752842777 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273005e210 con 0x7f2730077900 2020-06-27T04:45:57.033 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.024+0000 7f272ffff700 1 --2- 172.21.15.31:0/1752842777 >> v2:172.21.15.51:6800/950992045 conn(0x7f270802ab00 0x7f270802cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:57.033 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.024+0000 7f272ffff700 1 --2- 172.21.15.31:0/1752842777 >> v2:172.21.15.51:6800/950992045 conn(0x7f270802ab00 0x7f270802cfc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f2720016000 tx=0x7f2720009b30).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:57.033 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.027+0000 7f272cff9700 1 -- 172.21.15.31:0/1752842777 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f272805c3d0 con 0x7f2730077900 2020-06-27T04:45:57.185 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.181+0000 7f2735e06700 1 -- 172.21.15.31:0/1752842777 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2730123110 con 0x7f2730077900 2020-06-27T04:45:57.185 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.182+0000 7f272cff9700 1 -- 172.21.15.31:0/1752842777 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2728019070 con 0x7f2730077900 2020-06-27T04:45:57.185 INFO:teuthology.orchestra.run.smithi031.stdout:137438953503 2020-06-27T04:45:57.190 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.183+0000 7f2735e06700 1 -- 172.21.15.31:0/1752842777 >> v2:172.21.15.51:6800/950992045 conn(0x7f270802ab00 msgr2=0x7f270802cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:57.191 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.183+0000 7f2735e06700 1 --2- 172.21.15.31:0/1752842777 >> v2:172.21.15.51:6800/950992045 conn(0x7f270802ab00 0x7f270802cfc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f2720016000 tx=0x7f2720009b30).stop 2020-06-27T04:45:57.191 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.183+0000 7f2735e06700 1 -- 172.21.15.31:0/1752842777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2730077900 msgr2=0x7f2730077d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:57.191 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.183+0000 7f2735e06700 1 --2- 172.21.15.31:0/1752842777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2730077900 0x7f2730077d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f272800c000 tx=0x7f272800b040).stop 2020-06-27T04:45:57.191 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.183+0000 7f2735e06700 1 -- 172.21.15.31:0/1752842777 shutdown_connections 2020-06-27T04:45:57.191 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.183+0000 7f2735e06700 1 --2- 172.21.15.31:0/1752842777 >> v2:172.21.15.51:6800/950992045 conn(0x7f270802ab00 0x7f270802cfc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:57.192 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.183+0000 7f2735e06700 1 --2- 172.21.15.31:0/1752842777 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f2730066370 0x7f27300742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:57.192 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.183+0000 7f2735e06700 1 --2- 172.21.15.31:0/1752842777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2730077900 0x7f2730077d80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:57.192 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.183+0000 7f2735e06700 1 --2- 172.21.15.31:0/1752842777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f273006be40 0x7f27300749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:57.192 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.183+0000 7f2735e06700 1 -- 172.21.15.31:0/1752842777 >> 172.21.15.31:0/1752842777 conn(0x7f2730061840 msgr2=0x7f273006d360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:57.192 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.183+0000 7f2735e06700 1 -- 172.21.15.31:0/1752842777 shutdown_connections 2020-06-27T04:45:57.193 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:57.183+0000 7f2735e06700 1 -- 172.21.15.31:0/1752842777 wait complete. 2020-06-27T04:45:57.788 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953499 got 137438953503 for osd.4 2020-06-27T04:45:57.789 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph osd last-stat-seq osd.5 2020-06-27T04:45:57.933 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:45:58.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:58 smithi051 bash[18409]: cluster 2020-06-27T04:45:57.152388+0000 mgr.x (mgr.34109) 180 : cluster [DBG] pgmap v157: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:58.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:45:58 smithi051 bash[18409]: audit 2020-06-27T04:45:57.183178+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.31:0/1752842777' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2020-06-27T04:45:58.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:58 smithi031 bash[18426]: cluster 2020-06-27T04:45:57.152388+0000 mgr.x (mgr.34109) 180 : cluster [DBG] pgmap v157: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:58.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:45:58 smithi031 bash[18426]: audit 2020-06-27T04:45:57.183178+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.31:0/1752842777' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2020-06-27T04:45:58.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:58 smithi031 bash[22603]: cluster 2020-06-27T04:45:57.152388+0000 mgr.x (mgr.34109) 180 : cluster [DBG] pgmap v157: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:45:58.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:45:58 smithi031 bash[22603]: audit 2020-06-27T04:45:57.183178+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.31:0/1752842777' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2020-06-27T04:45:59.615 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.610+0000 7f4449b64700 1 Processor -- start 2020-06-27T04:45:59.615 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.610+0000 7f4449b64700 1 -- start start 2020-06-27T04:45:59.615 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4449b64700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4444066370 0x7f444406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:59.616 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4449b64700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f444406be40 0x7f4444078280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:59.616 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4449b64700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f4444078900 0x7f4444122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:59.616 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4449b64700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4444123310 con 0x7f4444066370 2020-06-27T04:45:59.616 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4449b64700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4444123480 con 0x7f4444078900 2020-06-27T04:45:59.616 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4449b64700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4444123640 con 0x7f444406be40 2020-06-27T04:45:59.617 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4443fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4444066370 0x7f444406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:59.617 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4443fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4444066370 0x7f444406cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39702/0 (socket says 172.21.15.31:39702) 2020-06-27T04:45:59.617 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4443fff700 1 -- 172.21.15.31:0/32888500 learned_addr learned my addr 172.21.15.31:0/32888500 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:45:59.617 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f443bfff700 1 --2- 172.21.15.31:0/32888500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f444406be40 0x7f4444078280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:59.617 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4448902700 1 --2- 172.21.15.31:0/32888500 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f4444078900 0x7f4444122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:59.618 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4443fff700 1 -- 172.21.15.31:0/32888500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f444406be40 msgr2=0x7f4444078280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:59.618 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4443fff700 1 --2- 172.21.15.31:0/32888500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f444406be40 0x7f4444078280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:59.618 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4443fff700 1 -- 172.21.15.31:0/32888500 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f4444078900 msgr2=0x7f4444122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:59.618 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4443fff700 1 --2- 172.21.15.31:0/32888500 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f4444078900 0x7f4444122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:59.618 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4443fff700 1 -- 172.21.15.31:0/32888500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4444123800 con 0x7f4444066370 2020-06-27T04:45:59.618 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4448902700 1 --2- 172.21.15.31:0/32888500 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f4444078900 0x7f4444122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-27T04:45:59.619 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4443fff700 1 --2- 172.21.15.31:0/32888500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4444066370 0x7f444406cd00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f4434002f70 tx=0x7f4434009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:59.619 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4440ff9700 1 -- 172.21.15.31:0/32888500 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f443400e030 con 0x7f4444066370 2020-06-27T04:45:59.619 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4449b64700 1 -- 172.21.15.31:0/32888500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4444123a50 con 0x7f4444066370 2020-06-27T04:45:59.619 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4440ff9700 1 -- 172.21.15.31:0/32888500 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f4434013cb0 con 0x7f4444066370 2020-06-27T04:45:59.619 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4440ff9700 1 -- 172.21.15.31:0/32888500 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4434018070 con 0x7f4444066370 2020-06-27T04:45:59.620 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.611+0000 7f4449b64700 1 -- 172.21.15.31:0/32888500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4444123f90 con 0x7f4444066370 2020-06-27T04:45:59.621 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.612+0000 7f4440ff9700 1 -- 172.21.15.31:0/32888500 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f443401db30 con 0x7f4444066370 2020-06-27T04:45:59.621 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.612+0000 7f4440ff9700 1 --2- 172.21.15.31:0/32888500 >> v2:172.21.15.51:6800/950992045 conn(0x7f441c02ab00 0x7f441c02cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:45:59.621 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.612+0000 7f4440ff9700 1 -- 172.21.15.31:0/32888500 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7f443403c9d0 con 0x7f4444066370 2020-06-27T04:45:59.621 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.612+0000 7f4449b64700 1 -- 172.21.15.31:0/32888500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f444405e210 con 0x7f4444066370 2020-06-27T04:45:59.622 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.613+0000 7f443bfff700 1 --2- 172.21.15.31:0/32888500 >> v2:172.21.15.51:6800/950992045 conn(0x7f441c02ab00 0x7f441c02cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:45:59.622 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.613+0000 7f443bfff700 1 --2- 172.21.15.31:0/32888500 >> v2:172.21.15.51:6800/950992045 conn(0x7f441c02ab00 0x7f441c02cfc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f442c00d000 tx=0x7f442c007cb0).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:45:59.622 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.616+0000 7f4440ff9700 1 -- 172.21.15.31:0/32888500 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f4434011370 con 0x7f4444066370 2020-06-27T04:45:59.771 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.768+0000 7f4449b64700 1 -- 172.21.15.31:0/32888500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4444124180 con 0x7f4444066370 2020-06-27T04:45:59.771 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.768+0000 7f4440ff9700 1 -- 172.21.15.31:0/32888500 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4434012bc0 con 0x7f4444066370 2020-06-27T04:45:59.772 INFO:teuthology.orchestra.run.smithi031.stdout:158913789980 2020-06-27T04:45:59.772 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.769+0000 7f4449b64700 1 -- 172.21.15.31:0/32888500 >> v2:172.21.15.51:6800/950992045 conn(0x7f441c02ab00 msgr2=0x7f441c02cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:59.773 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.769+0000 7f4449b64700 1 --2- 172.21.15.31:0/32888500 >> v2:172.21.15.51:6800/950992045 conn(0x7f441c02ab00 0x7f441c02cfc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f442c00d000 tx=0x7f442c007cb0).stop 2020-06-27T04:45:59.773 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.769+0000 7f4449b64700 1 -- 172.21.15.31:0/32888500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4444066370 msgr2=0x7f444406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:45:59.773 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.769+0000 7f4449b64700 1 --2- 172.21.15.31:0/32888500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4444066370 0x7f444406cd00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f4434002f70 tx=0x7f4434009b30).stop 2020-06-27T04:45:59.773 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.769+0000 7f4449b64700 1 -- 172.21.15.31:0/32888500 shutdown_connections 2020-06-27T04:45:59.773 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.769+0000 7f4449b64700 1 --2- 172.21.15.31:0/32888500 >> v2:172.21.15.51:6800/950992045 conn(0x7f441c02ab00 0x7f441c02cfc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:59.774 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.769+0000 7f4449b64700 1 --2- 172.21.15.31:0/32888500 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f4444078900 0x7f4444122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:59.774 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.769+0000 7f4449b64700 1 --2- 172.21.15.31:0/32888500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4444066370 0x7f444406cd00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:59.774 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.769+0000 7f4449b64700 1 --2- 172.21.15.31:0/32888500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f444406be40 0x7f4444078280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:45:59.774 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.769+0000 7f4449b64700 1 -- 172.21.15.31:0/32888500 >> 172.21.15.31:0/32888500 conn(0x7f4444061840 msgr2=0x7f444406d360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:45:59.774 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.769+0000 7f4449b64700 1 -- 172.21.15.31:0/32888500 shutdown_connections 2020-06-27T04:45:59.775 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:45:59.769+0000 7f4449b64700 1 -- 172.21.15.31:0/32888500 wait complete. 2020-06-27T04:46:00.211 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:00 smithi031 bash[18426]: cluster 2020-06-27T04:45:59.153204+0000 mgr.x (mgr.34109) 181 : cluster [DBG] pgmap v158: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:00.211 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:00 smithi031 bash[18426]: audit 2020-06-27T04:45:59.769409+0000 mon.a (mon.0) 526 : audit [DBG] from='client.? 172.21.15.31:0/32888500' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2020-06-27T04:46:00.278 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789976 got 158913789980 for osd.5 2020-06-27T04:46:00.279 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph osd last-stat-seq osd.6 2020-06-27T04:46:00.423 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:46:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:00 smithi051 bash[18409]: cluster 2020-06-27T04:45:59.153204+0000 mgr.x (mgr.34109) 181 : cluster [DBG] pgmap v158: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:00 smithi051 bash[18409]: audit 2020-06-27T04:45:59.769409+0000 mon.a (mon.0) 526 : audit [DBG] from='client.? 172.21.15.31:0/32888500' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2020-06-27T04:46:00.472 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:00 smithi031 bash[22603]: cluster 2020-06-27T04:45:59.153204+0000 mgr.x (mgr.34109) 181 : cluster [DBG] pgmap v158: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:00.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:00 smithi031 bash[22603]: audit 2020-06-27T04:45:59.769409+0000 mon.a (mon.0) 526 : audit [DBG] from='client.? 172.21.15.31:0/32888500' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2020-06-27T04:46:02.008 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.003+0000 7fd18e3e4700 1 Processor -- start 2020-06-27T04:46:02.008 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.003+0000 7fd18e3e4700 1 -- start start 2020-06-27T04:46:02.008 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.003+0000 7fd18e3e4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd188066370 0x7fd18806cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:02.009 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.003+0000 7fd18e3e4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd18806be40 0x7fd188078380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:02.009 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.003+0000 7fd18e3e4700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd1880789b0 0x7fd188122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:02.009 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.003+0000 7fd18e3e4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd188123320 con 0x7fd18806be40 2020-06-27T04:46:02.009 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.003+0000 7fd18e3e4700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd188123490 con 0x7fd1880789b0 2020-06-27T04:46:02.009 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.003+0000 7fd18e3e4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd188123650 con 0x7fd188066370 2020-06-27T04:46:02.010 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.003+0000 7fd18c981700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd188066370 0x7fd18806cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:02.010 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.003+0000 7fd187fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd18806be40 0x7fd188078380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:02.010 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.003+0000 7fd18c981700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd188066370 0x7fd18806cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35964/0 (socket says 172.21.15.31:35964) 2020-06-27T04:46:02.010 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.004+0000 7fd18c981700 1 -- 172.21.15.31:0/3039885021 learned_addr learned my addr 172.21.15.31:0/3039885021 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:46:02.010 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.004+0000 7fd18d182700 1 --2- 172.21.15.31:0/3039885021 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd1880789b0 0x7fd188122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.004+0000 7fd18c981700 1 -- 172.21.15.31:0/3039885021 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd1880789b0 msgr2=0x7fd188122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.004+0000 7fd18c981700 1 --2- 172.21.15.31:0/3039885021 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd1880789b0 0x7fd188122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.004+0000 7fd18c981700 1 -- 172.21.15.31:0/3039885021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd18806be40 msgr2=0x7fd188078380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.004+0000 7fd18c981700 1 --2- 172.21.15.31:0/3039885021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd18806be40 0x7fd188078380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.004+0000 7fd18c981700 1 -- 172.21.15.31:0/3039885021 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd188123810 con 0x7fd188066370 2020-06-27T04:46:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.004+0000 7fd187fff700 1 --2- 172.21.15.31:0/3039885021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd18806be40 0x7fd188078380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:46:02.012 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.004+0000 7fd18c981700 1 --2- 172.21.15.31:0/3039885021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd188066370 0x7fd18806cd50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd170002f70 tx=0x7fd170009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:46:02.012 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.004+0000 7fd184ff9700 1 -- 172.21.15.31:0/3039885021 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd17000e030 con 0x7fd188066370 2020-06-27T04:46:02.012 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.004+0000 7fd184ff9700 1 -- 172.21.15.31:0/3039885021 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fd170013cb0 con 0x7fd188066370 2020-06-27T04:46:02.012 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.004+0000 7fd18e3e4700 1 -- 172.21.15.31:0/3039885021 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd188074030 con 0x7fd188066370 2020-06-27T04:46:02.012 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.004+0000 7fd184ff9700 1 -- 172.21.15.31:0/3039885021 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd170018070 con 0x7fd188066370 2020-06-27T04:46:02.013 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.004+0000 7fd18e3e4700 1 -- 172.21.15.31:0/3039885021 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd188074570 con 0x7fd188066370 2020-06-27T04:46:02.014 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.005+0000 7fd184ff9700 1 -- 172.21.15.31:0/3039885021 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7fd17001daa0 con 0x7fd188066370 2020-06-27T04:46:02.014 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.005+0000 7fd184ff9700 1 --2- 172.21.15.31:0/3039885021 >> v2:172.21.15.51:6800/950992045 conn(0x7fd16002ab00 0x7fd16002cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:02.014 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.005+0000 7fd184ff9700 1 -- 172.21.15.31:0/3039885021 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7fd17003c920 con 0x7fd188066370 2020-06-27T04:46:02.014 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.005+0000 7fd18e3e4700 1 -- 172.21.15.31:0/3039885021 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18805e210 con 0x7fd188066370 2020-06-27T04:46:02.015 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.005+0000 7fd187fff700 1 --2- 172.21.15.31:0/3039885021 >> v2:172.21.15.51:6800/950992045 conn(0x7fd16002ab00 0x7fd16002cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:02.015 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.006+0000 7fd187fff700 1 --2- 172.21.15.31:0/3039885021 >> v2:172.21.15.51:6800/950992045 conn(0x7fd16002ab00 0x7fd16002cfc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fd178010000 tx=0x7fd178009c20).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:46:02.015 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.009+0000 7fd184ff9700 1 -- 172.21.15.31:0/3039885021 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fd170004610 con 0x7fd188066370 2020-06-27T04:46:02.165 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.162+0000 7fd18e3e4700 1 -- 172.21.15.31:0/3039885021 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd1880747e0 con 0x7fd188066370 2020-06-27T04:46:02.166 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.162+0000 7fd184ff9700 1 -- 172.21.15.31:0/3039885021 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd170012b80 con 0x7fd188066370 2020-06-27T04:46:02.166 INFO:teuthology.orchestra.run.smithi031.stdout:180388626458 2020-06-27T04:46:02.167 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.163+0000 7fd18e3e4700 1 -- 172.21.15.31:0/3039885021 >> v2:172.21.15.51:6800/950992045 conn(0x7fd16002ab00 msgr2=0x7fd16002cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:02.167 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.164+0000 7fd18e3e4700 1 --2- 172.21.15.31:0/3039885021 >> v2:172.21.15.51:6800/950992045 conn(0x7fd16002ab00 0x7fd16002cfc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fd178010000 tx=0x7fd178009c20).stop 2020-06-27T04:46:02.167 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.164+0000 7fd18e3e4700 1 -- 172.21.15.31:0/3039885021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd188066370 msgr2=0x7fd18806cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:02.168 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.164+0000 7fd18e3e4700 1 --2- 172.21.15.31:0/3039885021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd188066370 0x7fd18806cd50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd170002f70 tx=0x7fd170009b30).stop 2020-06-27T04:46:02.168 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.164+0000 7fd18e3e4700 1 -- 172.21.15.31:0/3039885021 shutdown_connections 2020-06-27T04:46:02.168 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.164+0000 7fd18e3e4700 1 --2- 172.21.15.31:0/3039885021 >> v2:172.21.15.51:6800/950992045 conn(0x7fd16002ab00 0x7fd16002cfc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:02.168 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.164+0000 7fd18e3e4700 1 --2- 172.21.15.31:0/3039885021 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fd1880789b0 0x7fd188122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:02.168 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.164+0000 7fd18e3e4700 1 --2- 172.21.15.31:0/3039885021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd188066370 0x7fd18806cd50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.164+0000 7fd18e3e4700 1 --2- 172.21.15.31:0/3039885021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd18806be40 0x7fd188078380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.164+0000 7fd18e3e4700 1 -- 172.21.15.31:0/3039885021 >> 172.21.15.31:0/3039885021 conn(0x7fd188061840 msgr2=0x7fd18806d360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:46:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.164+0000 7fd18e3e4700 1 -- 172.21.15.31:0/3039885021 shutdown_connections 2020-06-27T04:46:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:02.164+0000 7fd18e3e4700 1 -- 172.21.15.31:0/3039885021 wait complete. 2020-06-27T04:46:02.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:02 smithi051 bash[18409]: cluster 2020-06-27T04:46:01.153820+0000 mgr.x (mgr.34109) 182 : cluster [DBG] pgmap v159: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:02.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:02 smithi051 bash[18409]: audit 2020-06-27T04:46:02.163711+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.31:0/3039885021' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2020-06-27T04:46:02.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:02 smithi031 bash[18426]: cluster 2020-06-27T04:46:01.153820+0000 mgr.x (mgr.34109) 182 : cluster [DBG] pgmap v159: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:02.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:02 smithi031 bash[18426]: audit 2020-06-27T04:46:02.163711+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.31:0/3039885021' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2020-06-27T04:46:02.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:02 smithi031 bash[22603]: cluster 2020-06-27T04:46:01.153820+0000 mgr.x (mgr.34109) 182 : cluster [DBG] pgmap v159: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:02.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:02 smithi031 bash[22603]: audit 2020-06-27T04:46:02.163711+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.31:0/3039885021' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2020-06-27T04:46:02.677 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626454 got 180388626458 for osd.6 2020-06-27T04:46:02.677 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph osd last-stat-seq osd.7 2020-06-27T04:46:02.822 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:46:04.406 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.402+0000 7f1c92e2c700 1 Processor -- start 2020-06-27T04:46:04.407 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.402+0000 7f1c92e2c700 1 -- start start 2020-06-27T04:46:04.407 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.402+0000 7f1c92e2c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c8c066370 0x7f1c8c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:04.407 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.402+0000 7f1c92e2c700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f1c8c0678c0 0x7f1c8c073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:04.407 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.402+0000 7f1c92e2c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c8c074430 0x7f1c8c0768c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:04.408 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.402+0000 7f1c92e2c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c076e70 con 0x7f1c8c066370 2020-06-27T04:46:04.408 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.402+0000 7f1c92e2c700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c076fe0 con 0x7f1c8c0678c0 2020-06-27T04:46:04.408 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.402+0000 7f1c92e2c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c0771a0 con 0x7f1c8c074430 2020-06-27T04:46:04.409 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.402+0000 7f1c913c9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c8c066370 0x7f1c8c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:04.409 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.402+0000 7f1c913c9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c8c066370 0x7f1c8c0687b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39728/0 (socket says 172.21.15.31:39728) 2020-06-27T04:46:04.409 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.402+0000 7f1c913c9700 1 -- 172.21.15.31:0/430490108 learned_addr learned my addr 172.21.15.31:0/430490108 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:46:04.409 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.402+0000 7f1c91bca700 1 --2- 172.21.15.31:0/430490108 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c8c074430 0x7f1c8c0768c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:04.409 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.402+0000 7f1c90bc8700 1 --2- 172.21.15.31:0/430490108 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f1c8c0678c0 0x7f1c8c073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:04.410 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.402+0000 7f1c913c9700 1 -- 172.21.15.31:0/430490108 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c8c074430 msgr2=0x7f1c8c0768c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:04.410 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.402+0000 7f1c913c9700 1 --2- 172.21.15.31:0/430490108 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c8c074430 0x7f1c8c0768c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:04.410 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.402+0000 7f1c913c9700 1 -- 172.21.15.31:0/430490108 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f1c8c0678c0 msgr2=0x7f1c8c073f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:04.410 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.402+0000 7f1c913c9700 1 --2- 172.21.15.31:0/430490108 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f1c8c0678c0 0x7f1c8c073f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:04.410 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.402+0000 7f1c913c9700 1 -- 172.21.15.31:0/430490108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c077360 con 0x7f1c8c066370 2020-06-27T04:46:04.411 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.403+0000 7f1c91bca700 1 --2- 172.21.15.31:0/430490108 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c8c074430 0x7f1c8c0768c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:46:04.411 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.403+0000 7f1c913c9700 1 --2- 172.21.15.31:0/430490108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c8c066370 0x7f1c8c0687b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f1c8800a000 tx=0x7f1c88009d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:46:04.411 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.403+0000 7f1c7d7fa700 1 -- 172.21.15.31:0/430490108 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c8800d7a0 con 0x7f1c8c066370 2020-06-27T04:46:04.411 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.403+0000 7f1c7d7fa700 1 -- 172.21.15.31:0/430490108 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f1c8800f040 con 0x7f1c8c066370 2020-06-27T04:46:04.411 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.403+0000 7f1c92e2c700 1 -- 172.21.15.31:0/430490108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8c077610 con 0x7f1c8c066370 2020-06-27T04:46:04.411 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.403+0000 7f1c7d7fa700 1 -- 172.21.15.31:0/430490108 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c880139d0 con 0x7f1c8c066370 2020-06-27T04:46:04.412 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.403+0000 7f1c92e2c700 1 -- 172.21.15.31:0/430490108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8c077bb0 con 0x7f1c8c066370 2020-06-27T04:46:04.412 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.403+0000 7f1c7d7fa700 1 -- 172.21.15.31:0/430490108 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f1c88013c60 con 0x7f1c8c066370 2020-06-27T04:46:04.413 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.404+0000 7f1c7d7fa700 1 --2- 172.21.15.31:0/430490108 >> v2:172.21.15.51:6800/950992045 conn(0x7f1c6802ab00 0x7f1c6802cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:04.413 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.404+0000 7f1c7d7fa700 1 -- 172.21.15.31:0/430490108 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7f1c8803a5a0 con 0x7f1c8c066370 2020-06-27T04:46:04.413 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.404+0000 7f1c92e2c700 1 -- 172.21.15.31:0/430490108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8c05e210 con 0x7f1c8c066370 2020-06-27T04:46:04.413 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.404+0000 7f1c90bc8700 1 --2- 172.21.15.31:0/430490108 >> v2:172.21.15.51:6800/950992045 conn(0x7f1c6802ab00 0x7f1c6802cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:04.414 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.404+0000 7f1c90bc8700 1 --2- 172.21.15.31:0/430490108 >> v2:172.21.15.51:6800/950992045 conn(0x7f1c6802ab00 0x7f1c6802cfc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1c8000b000 tx=0x7f1c8000b040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:46:04.414 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.408+0000 7f1c7d7fa700 1 -- 172.21.15.31:0/430490108 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f1c88010250 con 0x7f1c8c066370 2020-06-27T04:46:04.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:04 smithi031 bash[18426]: cluster 2020-06-27T04:46:03.154541+0000 mgr.x (mgr.34109) 183 : cluster [DBG] pgmap v160: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:04.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:04 smithi031 bash[22603]: cluster 2020-06-27T04:46:03.154541+0000 mgr.x (mgr.34109) 183 : cluster [DBG] pgmap v160: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:04.564 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.561+0000 7f1c92e2c700 1 -- 172.21.15.31:0/430490108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1c8c06af40 con 0x7f1c8c066370 2020-06-27T04:46:04.565 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.561+0000 7f1c7d7fa700 1 -- 172.21.15.31:0/430490108 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c88027090 con 0x7f1c8c066370 2020-06-27T04:46:04.565 INFO:teuthology.orchestra.run.smithi031.stdout:201863462933 2020-06-27T04:46:04.566 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.563+0000 7f1c92e2c700 1 -- 172.21.15.31:0/430490108 >> v2:172.21.15.51:6800/950992045 conn(0x7f1c6802ab00 msgr2=0x7f1c6802cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:04.566 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.563+0000 7f1c92e2c700 1 --2- 172.21.15.31:0/430490108 >> v2:172.21.15.51:6800/950992045 conn(0x7f1c6802ab00 0x7f1c6802cfc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1c8000b000 tx=0x7f1c8000b040).stop 2020-06-27T04:46:04.566 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.563+0000 7f1c92e2c700 1 -- 172.21.15.31:0/430490108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c8c066370 msgr2=0x7f1c8c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:04.566 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.563+0000 7f1c92e2c700 1 --2- 172.21.15.31:0/430490108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c8c066370 0x7f1c8c0687b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f1c8800a000 tx=0x7f1c88009d20).stop 2020-06-27T04:46:04.567 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.563+0000 7f1c92e2c700 1 -- 172.21.15.31:0/430490108 shutdown_connections 2020-06-27T04:46:04.567 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.563+0000 7f1c92e2c700 1 --2- 172.21.15.31:0/430490108 >> v2:172.21.15.51:6800/950992045 conn(0x7f1c6802ab00 0x7f1c6802cfc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:04.567 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.563+0000 7f1c92e2c700 1 --2- 172.21.15.31:0/430490108 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c8c074430 0x7f1c8c0768c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:04.567 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.563+0000 7f1c92e2c700 1 --2- 172.21.15.31:0/430490108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c8c066370 0x7f1c8c0687b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:04.567 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.563+0000 7f1c92e2c700 1 --2- 172.21.15.31:0/430490108 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f1c8c0678c0 0x7f1c8c073f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:04.568 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.563+0000 7f1c92e2c700 1 -- 172.21.15.31:0/430490108 >> 172.21.15.31:0/430490108 conn(0x7f1c8c061840 msgr2=0x7f1c8c062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:46:04.568 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.563+0000 7f1c92e2c700 1 -- 172.21.15.31:0/430490108 shutdown_connections 2020-06-27T04:46:04.568 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:04.563+0000 7f1c92e2c700 1 -- 172.21.15.31:0/430490108 wait complete. 2020-06-27T04:46:04.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:04 smithi051 bash[18409]: cluster 2020-06-27T04:46:03.154541+0000 mgr.x (mgr.34109) 183 : cluster [DBG] pgmap v160: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:05.086 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462930 got 201863462933 for osd.7 2020-06-27T04:46:05.086 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2020-06-27T04:46:05.087 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph pg dump --format=json 2020-06-27T04:46:05.236 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:46:05.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:05 smithi031 bash[18426]: audit 2020-06-27T04:46:04.562704+0000 mon.a (mon.0) 527 : audit [DBG] from='client.? 172.21.15.31:0/430490108' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2020-06-27T04:46:05.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:05 smithi031 bash[22603]: audit 2020-06-27T04:46:04.562704+0000 mon.a (mon.0) 527 : audit [DBG] from='client.? 172.21.15.31:0/430490108' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2020-06-27T04:46:05.717 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:05 smithi051 bash[18409]: audit 2020-06-27T04:46:04.562704+0000 mon.a (mon.0) 527 : audit [DBG] from='client.? 172.21.15.31:0/430490108' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2020-06-27T04:46:06.599 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:06 smithi031 bash[18426]: cluster 2020-06-27T04:46:05.155091+0000 mgr.x (mgr.34109) 184 : cluster [DBG] pgmap v161: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:06.599 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:06 smithi031 bash[22603]: cluster 2020-06-27T04:46:05.155091+0000 mgr.x (mgr.34109) 184 : cluster [DBG] pgmap v161: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:06.717 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:06 smithi051 bash[18409]: cluster 2020-06-27T04:46:05.155091+0000 mgr.x (mgr.34109) 184 : cluster [DBG] pgmap v161: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:06.823 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.819+0000 7f1fea041700 1 Processor -- start 2020-06-27T04:46:06.824 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.819+0000 7f1fea041700 1 -- start start 2020-06-27T04:46:06.824 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.819+0000 7f1fea041700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fe4066220 0x7f1fe40740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:06.824 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.819+0000 7f1fea041700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fe40676c0 0x7f1fe40747e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:06.824 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.819+0000 7f1fea041700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f1fe40776a0 0x7f1fe4077b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:06.825 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.819+0000 7f1fea041700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4078170 con 0x7f1fe4066220 2020-06-27T04:46:06.825 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.819+0000 7f1fea041700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40782e0 con 0x7f1fe40776a0 2020-06-27T04:46:06.825 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.819+0000 7f1fea041700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40784a0 con 0x7f1fe40676c0 2020-06-27T04:46:06.825 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.819+0000 7f1fe9840700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fe4066220 0x7f1fe40740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:06.825 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.819+0000 7f1fe9840700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fe4066220 0x7f1fe40740f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39742/0 (socket says 172.21.15.31:39742) 2020-06-27T04:46:06.826 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.819+0000 7f1fe9840700 1 -- 172.21.15.31:0/4224004685 learned_addr learned my addr 172.21.15.31:0/4224004685 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:46:06.826 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.819+0000 7f1fe903f700 1 --2- 172.21.15.31:0/4224004685 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fe40676c0 0x7f1fe40747e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:06.826 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.820+0000 7f1feb2a3700 1 --2- 172.21.15.31:0/4224004685 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f1fe40776a0 0x7f1fe4077b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:06.826 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.820+0000 7f1fe9840700 1 -- 172.21.15.31:0/4224004685 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fe40676c0 msgr2=0x7f1fe40747e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:06.826 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.820+0000 7f1fe9840700 1 --2- 172.21.15.31:0/4224004685 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fe40676c0 0x7f1fe40747e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:06.827 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.820+0000 7f1fe9840700 1 -- 172.21.15.31:0/4224004685 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f1fe40776a0 msgr2=0x7f1fe4077b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:06.827 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.820+0000 7f1fe9840700 1 --2- 172.21.15.31:0/4224004685 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f1fe40776a0 0x7f1fe4077b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:06.827 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.820+0000 7f1fe9840700 1 -- 172.21.15.31:0/4224004685 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe4078660 con 0x7f1fe4066220 2020-06-27T04:46:06.827 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.820+0000 7f1fe903f700 1 --2- 172.21.15.31:0/4224004685 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fe40676c0 0x7f1fe40747e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:46:06.827 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.820+0000 7f1feb2a3700 1 --2- 172.21.15.31:0/4224004685 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f1fe40776a0 0x7f1fe4077b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-27T04:46:06.828 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.820+0000 7f1fe9840700 1 --2- 172.21.15.31:0/4224004685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fe4066220 0x7f1fe40740f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f1fd4004540 tx=0x7f1fd400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:46:06.828 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.820+0000 7f1fe1ffb700 1 -- 172.21.15.31:0/4224004685 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fd4009a60 con 0x7f1fe4066220 2020-06-27T04:46:06.828 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.820+0000 7f1fea041700 1 -- 172.21.15.31:0/4224004685 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe40788b0 con 0x7f1fe4066220 2020-06-27T04:46:06.828 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.820+0000 7f1fea041700 1 -- 172.21.15.31:0/4224004685 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe4122cb0 con 0x7f1fe4066220 2020-06-27T04:46:06.828 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.820+0000 7f1fe1ffb700 1 -- 172.21.15.31:0/4224004685 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f1fd400f040 con 0x7f1fe4066220 2020-06-27T04:46:06.828 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.820+0000 7f1fe1ffb700 1 -- 172.21.15.31:0/4224004685 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fd400cea0 con 0x7f1fe4066220 2020-06-27T04:46:06.829 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.821+0000 7f1fe1ffb700 1 -- 172.21.15.31:0/4224004685 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f1fd40135b0 con 0x7f1fe4066220 2020-06-27T04:46:06.830 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.821+0000 7f1fea041700 1 -- 172.21.15.31:0/4224004685 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe405e210 con 0x7f1fe4066220 2020-06-27T04:46:06.830 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.821+0000 7f1fe1ffb700 1 --2- 172.21.15.31:0/4224004685 >> v2:172.21.15.51:6800/950992045 conn(0x7f1fc802ab00 0x7f1fc802cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:06.830 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.821+0000 7f1fe1ffb700 1 -- 172.21.15.31:0/4224004685 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7f1fd403b370 con 0x7f1fe4066220 2020-06-27T04:46:06.830 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.821+0000 7f1fe903f700 1 --2- 172.21.15.31:0/4224004685 >> v2:172.21.15.51:6800/950992045 conn(0x7f1fc802ab00 0x7f1fc802cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:06.831 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.822+0000 7f1fe903f700 1 --2- 172.21.15.31:0/4224004685 >> v2:172.21.15.51:6800/950992045 conn(0x7f1fc802ab00 0x7f1fc802cfc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f1fd800b000 tx=0x7f1fd800b040).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:46:06.831 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.825+0000 7f1fe1ffb700 1 -- 172.21.15.31:0/4224004685 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f1fd4012bc0 con 0x7f1fe4066220 2020-06-27T04:46:06.974 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.971+0000 7f1fea041700 1 -- 172.21.15.31:0/4224004685 --> v2:172.21.15.51:6800/950992045 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1fe405f390 con 0x7f1fc802ab00 2020-06-27T04:46:06.986 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.983+0000 7f1fe1ffb700 1 -- 172.21.15.31:0/4224004685 <== mgr.34109 v2:172.21.15.51:6800/950992045 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+338263 (secure 0 0 0) 0x7f1fd800f040 con 0x7f1fc802ab00 2020-06-27T04:46:06.991 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:46:06.994 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.985+0000 7f1fea041700 1 -- 172.21.15.31:0/4224004685 >> v2:172.21.15.51:6800/950992045 conn(0x7f1fc802ab00 msgr2=0x7f1fc802cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:06.995 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.985+0000 7f1fea041700 1 --2- 172.21.15.31:0/4224004685 >> v2:172.21.15.51:6800/950992045 conn(0x7f1fc802ab00 0x7f1fc802cfc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f1fd800b000 tx=0x7f1fd800b040).stop 2020-06-27T04:46:06.995 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.985+0000 7f1fea041700 1 -- 172.21.15.31:0/4224004685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fe4066220 msgr2=0x7f1fe40740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:06.995 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.985+0000 7f1fea041700 1 --2- 172.21.15.31:0/4224004685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fe4066220 0x7f1fe40740f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f1fd4004540 tx=0x7f1fd400b040).stop 2020-06-27T04:46:06.996 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.986+0000 7f1fea041700 1 -- 172.21.15.31:0/4224004685 shutdown_connections 2020-06-27T04:46:06.996 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.986+0000 7f1fea041700 1 --2- 172.21.15.31:0/4224004685 >> v2:172.21.15.51:6800/950992045 conn(0x7f1fc802ab00 0x7f1fc802cfc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:06.996 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.986+0000 7f1fea041700 1 --2- 172.21.15.31:0/4224004685 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f1fe40776a0 0x7f1fe4077b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:06.996 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.986+0000 7f1fea041700 1 --2- 172.21.15.31:0/4224004685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fe4066220 0x7f1fe40740f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:06.996 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.986+0000 7f1fea041700 1 --2- 172.21.15.31:0/4224004685 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1fe40676c0 0x7f1fe40747e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:06.997 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.986+0000 7f1fea041700 1 -- 172.21.15.31:0/4224004685 >> 172.21.15.31:0/4224004685 conn(0x7f1fe4025510 msgr2=0x7f1fe4068290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:46:06.997 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.986+0000 7f1fea041700 1 -- 172.21.15.31:0/4224004685 shutdown_connections 2020-06-27T04:46:06.997 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:06.986+0000 7f1fea041700 1 -- 172.21.15.31:0/4224004685 wait complete. 2020-06-27T04:46:06.997 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2020-06-27T04:46:07.477 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2020-06-27T04:46:05.154710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5434,"num_objects":229,"num_object_clones":0,"num_object_copies":687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":1080,"num_read_kb":810,"num_write":623,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":46,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":607,"ondisk_log_size":607,"up":387,"acting":387,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":387,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":8393508,"kb_used_data":4836,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":741567708,"statfs":{"total":767960285184,"available":759365332992,"internally_reserved":8589934592,"allocated":4952064,"data_stored":1867148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003985"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137480+0000","last_change":"2020-06-27T04:44:39.425173+0000","last_active":"2020-06-27T04:45:18.137480+0000","last_peered":"2020-06-27T04:45:18.137480+0000","last_clean":"2020-06-27T04:45:18.137480+0000","last_became_active":"2020-06-27T04:44:39.424677+0000","last_became_peered":"2020-06-27T04:44:39.424677+0000","last_unstale":"2020-06-27T04:45:18.137480+0000","last_undegraded":"2020-06-27T04:45:18.137480+0000","last_fullsized":"2020-06-27T04:45:18.137480+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138672+0000","last_change":"2020-06-27T04:44:37.395300+0000","last_active":"2020-06-27T04:45:18.138672+0000","last_peered":"2020-06-27T04:45:18.138672+0000","last_clean":"2020-06-27T04:45:18.138672+0000","last_became_active":"2020-06-27T04:44:37.394845+0000","last_became_peered":"2020-06-27T04:44:37.394845+0000","last_unstale":"2020-06-27T04:45:18.138672+0000","last_undegraded":"2020-06-27T04:45:18.138672+0000","last_fullsized":"2020-06-27T04:45:18.138672+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"48'1","reported_seq":"26","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153262+0000","last_change":"2020-06-27T04:44:24.281004+0000","last_active":"2020-06-27T04:45:18.153262+0000","last_peered":"2020-06-27T04:45:18.153262+0000","last_clean":"2020-06-27T04:45:18.153262+0000","last_became_active":"2020-06-27T04:44:24.280399+0000","last_became_peered":"2020-06-27T04:44:24.280399+0000","last_unstale":"2020-06-27T04:45:18.153262+0000","last_undegraded":"2020-06-27T04:45:18.153262+0000","last_fullsized":"2020-06-27T04:45:18.153262+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":247,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"57'16","reported_seq":"46","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.141050+0000","last_change":"2020-06-27T04:44:35.840413+0000","last_active":"2020-06-27T04:45:18.141050+0000","last_peered":"2020-06-27T04:45:18.141050+0000","last_clean":"2020-06-27T04:45:18.141050+0000","last_became_active":"2020-06-27T04:44:35.839966+0000","last_became_peered":"2020-06-27T04:44:35.839966+0000","last_unstale":"2020-06-27T04:45:18.141050+0000","last_undegraded":"2020-06-27T04:45:18.141050+0000","last_fullsized":"2020-06-27T04:45:18.141050+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137896+0000","last_change":"2020-06-27T04:44:39.409977+0000","last_active":"2020-06-27T04:45:18.137896+0000","last_peered":"2020-06-27T04:45:18.137896+0000","last_clean":"2020-06-27T04:45:18.137896+0000","last_became_active":"2020-06-27T04:44:39.409541+0000","last_became_peered":"2020-06-27T04:44:39.409541+0000","last_unstale":"2020-06-27T04:45:18.137896+0000","last_undegraded":"2020-06-27T04:45:18.137896+0000","last_fullsized":"2020-06-27T04:45:18.137896+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138332+0000","last_change":"2020-06-27T04:44:37.398345+0000","last_active":"2020-06-27T04:45:18.138332+0000","last_peered":"2020-06-27T04:45:18.138332+0000","last_clean":"2020-06-27T04:45:18.138332+0000","last_became_active":"2020-06-27T04:44:37.397877+0000","last_became_peered":"2020-06-27T04:44:37.397877+0000","last_unstale":"2020-06-27T04:45:18.138332+0000","last_undegraded":"2020-06-27T04:45:18.138332+0000","last_fullsized":"2020-06-27T04:45:18.138332+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":"21","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.141157+0000","last_change":"2020-06-27T04:44:22.268675+0000","last_active":"2020-06-27T04:45:18.141157+0000","last_peered":"2020-06-27T04:45:18.141157+0000","last_clean":"2020-06-27T04:45:18.141157+0000","last_became_active":"2020-06-27T04:44:22.268070+0000","last_became_peered":"2020-06-27T04:44:22.268070+0000","last_unstale":"2020-06-27T04:45:18.141157+0000","last_undegraded":"2020-06-27T04:45:18.141157+0000","last_fullsized":"2020-06-27T04:45:18.141157+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"57'17","reported_seq":"50","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153263+0000","last_change":"2020-06-27T04:44:35.843244+0000","last_active":"2020-06-27T04:45:18.153263+0000","last_peered":"2020-06-27T04:45:18.153263+0000","last_clean":"2020-06-27T04:45:18.153263+0000","last_became_active":"2020-06-27T04:44:35.842717+0000","last_became_peered":"2020-06-27T04:44:35.842717+0000","last_unstale":"2020-06-27T04:45:18.153263+0000","last_undegraded":"2020-06-27T04:45:18.153263+0000","last_fullsized":"2020-06-27T04:45:18.153263+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133535+0000","last_change":"2020-06-27T04:44:39.427751+0000","last_active":"2020-06-27T04:45:18.133535+0000","last_peered":"2020-06-27T04:45:18.133535+0000","last_clean":"2020-06-27T04:45:18.133535+0000","last_became_active":"2020-06-27T04:44:39.427330+0000","last_became_peered":"2020-06-27T04:44:39.427330+0000","last_unstale":"2020-06-27T04:45:18.133535+0000","last_undegraded":"2020-06-27T04:45:18.133535+0000","last_fullsized":"2020-06-27T04:45:18.133535+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:19.142224+0000","last_change":"2020-06-27T04:45:19.142224+0000","last_active":"2020-06-27T04:45:19.142224+0000","last_peered":"2020-06-27T04:45:19.142224+0000","last_clean":"2020-06-27T04:45:19.142224+0000","last_became_active":"2020-06-27T04:45:19.141570+0000","last_became_peered":"2020-06-27T04:45:19.141570+0000","last_unstale":"2020-06-27T04:45:19.142224+0000","last_undegraded":"2020-06-27T04:45:19.142224+0000","last_fullsized":"2020-06-27T04:45:19.142224+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":"19","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.134126+0000","last_change":"2020-06-27T04:44:24.285272+0000","last_active":"2020-06-27T04:45:18.134126+0000","last_peered":"2020-06-27T04:45:18.134126+0000","last_clean":"2020-06-27T04:45:18.134126+0000","last_became_active":"2020-06-27T04:44:24.284718+0000","last_became_peered":"2020-06-27T04:44:24.284718+0000","last_unstale":"2020-06-27T04:45:18.134126+0000","last_undegraded":"2020-06-27T04:45:18.134126+0000","last_fullsized":"2020-06-27T04:45:18.134126+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"57'15","reported_seq":"41","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137019+0000","last_change":"2020-06-27T04:44:35.402583+0000","last_active":"2020-06-27T04:45:18.137019+0000","last_peered":"2020-06-27T04:45:18.137019+0000","last_clean":"2020-06-27T04:45:18.137019+0000","last_became_active":"2020-06-27T04:44:35.402171+0000","last_became_peered":"2020-06-27T04:44:35.402171+0000","last_unstale":"2020-06-27T04:45:18.137019+0000","last_undegraded":"2020-06-27T04:45:18.137019+0000","last_fullsized":"2020-06-27T04:45:18.137019+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136624+0000","last_change":"2020-06-27T04:44:39.419949+0000","last_active":"2020-06-27T04:45:18.136624+0000","last_peered":"2020-06-27T04:45:18.136624+0000","last_clean":"2020-06-27T04:45:18.136624+0000","last_became_active":"2020-06-27T04:44:39.419456+0000","last_became_peered":"2020-06-27T04:44:39.419456+0000","last_unstale":"2020-06-27T04:45:18.136624+0000","last_undegraded":"2020-06-27T04:45:18.136624+0000","last_fullsized":"2020-06-27T04:45:18.136624+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.139123+0000","last_change":"2020-06-27T04:44:37.394278+0000","last_active":"2020-06-27T04:45:18.139123+0000","last_peered":"2020-06-27T04:45:18.139123+0000","last_clean":"2020-06-27T04:45:18.139123+0000","last_became_active":"2020-06-27T04:44:37.393894+0000","last_became_peered":"2020-06-27T04:44:37.393894+0000","last_unstale":"2020-06-27T04:45:18.139123+0000","last_undegraded":"2020-06-27T04:45:18.139123+0000","last_fullsized":"2020-06-27T04:45:18.139123+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"49'1","reported_seq":"22","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133652+0000","last_change":"2020-06-27T04:44:24.281930+0000","last_active":"2020-06-27T04:45:18.133652+0000","last_peered":"2020-06-27T04:45:18.133652+0000","last_clean":"2020-06-27T04:45:18.133652+0000","last_became_active":"2020-06-27T04:44:24.280134+0000","last_became_peered":"2020-06-27T04:44:24.280134+0000","last_unstale":"2020-06-27T04:45:18.133652+0000","last_undegraded":"2020-06-27T04:45:18.133652+0000","last_fullsized":"2020-06-27T04:45:18.133652+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":815,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"57'12","reported_seq":"39","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137802+0000","last_change":"2020-06-27T04:44:35.402939+0000","last_active":"2020-06-27T04:45:18.137802+0000","last_peered":"2020-06-27T04:45:18.137802+0000","last_clean":"2020-06-27T04:45:18.137802+0000","last_became_active":"2020-06-27T04:44:35.402507+0000","last_became_peered":"2020-06-27T04:44:35.402507+0000","last_unstale":"2020-06-27T04:45:18.137802+0000","last_undegraded":"2020-06-27T04:45:18.137802+0000","last_fullsized":"2020-06-27T04:45:18.137802+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138691+0000","last_change":"2020-06-27T04:44:39.427020+0000","last_active":"2020-06-27T04:45:18.138691+0000","last_peered":"2020-06-27T04:45:18.138691+0000","last_clean":"2020-06-27T04:45:18.138691+0000","last_became_active":"2020-06-27T04:44:39.426429+0000","last_became_peered":"2020-06-27T04:44:39.426429+0000","last_unstale":"2020-06-27T04:45:18.138691+0000","last_undegraded":"2020-06-27T04:45:18.138691+0000","last_fullsized":"2020-06-27T04:45:18.138691+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140774+0000","last_change":"2020-06-27T04:44:37.406752+0000","last_active":"2020-06-27T04:45:18.140774+0000","last_peered":"2020-06-27T04:45:18.140774+0000","last_clean":"2020-06-27T04:45:18.140774+0000","last_became_active":"2020-06-27T04:44:37.404812+0000","last_became_peered":"2020-06-27T04:44:37.404812+0000","last_unstale":"2020-06-27T04:45:18.140774+0000","last_undegraded":"2020-06-27T04:45:18.140774+0000","last_fullsized":"2020-06-27T04:45:18.140774+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"30","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140686+0000","last_change":"2020-06-27T04:44:24.274055+0000","last_active":"2020-06-27T04:45:18.140686+0000","last_peered":"2020-06-27T04:45:18.140686+0000","last_clean":"2020-06-27T04:45:18.140686+0000","last_became_active":"2020-06-27T04:44:24.273515+0000","last_became_peered":"2020-06-27T04:44:24.273515+0000","last_unstale":"2020-06-27T04:45:18.140686+0000","last_undegraded":"2020-06-27T04:45:18.140686+0000","last_fullsized":"2020-06-27T04:45:18.140686+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"57'21","reported_seq":"63","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138836+0000","last_change":"2020-06-27T04:44:35.840316+0000","last_active":"2020-06-27T04:45:18.138836+0000","last_peered":"2020-06-27T04:45:18.138836+0000","last_clean":"2020-06-27T04:45:18.138836+0000","last_became_active":"2020-06-27T04:44:35.839925+0000","last_became_peered":"2020-06-27T04:44:35.839925+0000","last_unstale":"2020-06-27T04:45:18.138836+0000","last_undegraded":"2020-06-27T04:45:18.138836+0000","last_fullsized":"2020-06-27T04:45:18.138836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137067+0000","last_change":"2020-06-27T04:44:39.420275+0000","last_active":"2020-06-27T04:45:18.137067+0000","last_peered":"2020-06-27T04:45:18.137067+0000","last_clean":"2020-06-27T04:45:18.137067+0000","last_became_active":"2020-06-27T04:44:39.419841+0000","last_became_peered":"2020-06-27T04:44:39.419841+0000","last_unstale":"2020-06-27T04:45:18.137067+0000","last_undegraded":"2020-06-27T04:45:18.137067+0000","last_fullsized":"2020-06-27T04:45:18.137067+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136357+0000","last_change":"2020-06-27T04:44:37.403587+0000","last_active":"2020-06-27T04:45:18.136357+0000","last_peered":"2020-06-27T04:45:18.136357+0000","last_clean":"2020-06-27T04:45:18.136357+0000","last_became_active":"2020-06-27T04:44:37.403112+0000","last_became_peered":"2020-06-27T04:44:37.403112+0000","last_unstale":"2020-06-27T04:45:18.136357+0000","last_undegraded":"2020-06-27T04:45:18.136357+0000","last_fullsized":"2020-06-27T04:45:18.136357+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"49'2","reported_seq":"25","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152961+0000","last_change":"2020-06-27T04:44:24.280993+0000","last_active":"2020-06-27T04:45:18.152961+0000","last_peered":"2020-06-27T04:45:18.152961+0000","last_clean":"2020-06-27T04:45:18.152961+0000","last_became_active":"2020-06-27T04:44:24.280517+0000","last_became_peered":"2020-06-27T04:44:24.280517+0000","last_unstale":"2020-06-27T04:45:18.152961+0000","last_undegraded":"2020-06-27T04:45:18.152961+0000","last_fullsized":"2020-06-27T04:45:18.152961+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"57'11","reported_seq":"41","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152699+0000","last_change":"2020-06-27T04:44:35.386900+0000","last_active":"2020-06-27T04:45:18.152699+0000","last_peered":"2020-06-27T04:45:18.152699+0000","last_clean":"2020-06-27T04:45:18.152699+0000","last_became_active":"2020-06-27T04:44:35.386365+0000","last_became_peered":"2020-06-27T04:44:35.386365+0000","last_unstale":"2020-06-27T04:45:18.152699+0000","last_undegraded":"2020-06-27T04:45:18.152699+0000","last_fullsized":"2020-06-27T04:45:18.152699+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":18,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153221+0000","last_change":"2020-06-27T04:44:39.417036+0000","last_active":"2020-06-27T04:45:18.153221+0000","last_peered":"2020-06-27T04:45:18.153221+0000","last_clean":"2020-06-27T04:45:18.153221+0000","last_became_active":"2020-06-27T04:44:39.416478+0000","last_became_peered":"2020-06-27T04:44:39.416478+0000","last_unstale":"2020-06-27T04:45:18.153221+0000","last_undegraded":"2020-06-27T04:45:18.153221+0000","last_fullsized":"2020-06-27T04:45:18.153221+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"53'2","reported_seq":"33","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:53.722803+0000","last_change":"2020-06-27T04:44:37.401523+0000","last_active":"2020-06-27T04:45:53.722803+0000","last_peered":"2020-06-27T04:45:53.722803+0000","last_clean":"2020-06-27T04:45:53.722803+0000","last_became_active":"2020-06-27T04:44:37.400527+0000","last_became_peered":"2020-06-27T04:44:37.400527+0000","last_unstale":"2020-06-27T04:45:53.722803+0000","last_undegraded":"2020-06-27T04:45:53.722803+0000","last_fullsized":"2020-06-27T04:45:53.722803+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"21","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138774+0000","last_change":"2020-06-27T04:44:22.272053+0000","last_active":"2020-06-27T04:45:18.138774+0000","last_peered":"2020-06-27T04:45:18.138774+0000","last_clean":"2020-06-27T04:45:18.138774+0000","last_became_active":"2020-06-27T04:44:22.270158+0000","last_became_peered":"2020-06-27T04:44:22.270158+0000","last_unstale":"2020-06-27T04:45:18.138774+0000","last_undegraded":"2020-06-27T04:45:18.138774+0000","last_fullsized":"2020-06-27T04:45:18.138774+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"57'15","reported_seq":"47","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138638+0000","last_change":"2020-06-27T04:44:35.389694+0000","last_active":"2020-06-27T04:45:18.138638+0000","last_peered":"2020-06-27T04:45:18.138638+0000","last_clean":"2020-06-27T04:45:18.138638+0000","last_became_active":"2020-06-27T04:44:35.388870+0000","last_became_peered":"2020-06-27T04:44:35.388870+0000","last_unstale":"2020-06-27T04:45:18.138638+0000","last_undegraded":"2020-06-27T04:45:18.138638+0000","last_fullsized":"2020-06-27T04:45:18.138638+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":22,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153722+0000","last_change":"2020-06-27T04:44:39.413763+0000","last_active":"2020-06-27T04:45:18.153722+0000","last_peered":"2020-06-27T04:45:18.153722+0000","last_clean":"2020-06-27T04:45:18.153722+0000","last_became_active":"2020-06-27T04:44:39.413329+0000","last_became_peered":"2020-06-27T04:44:39.413329+0000","last_unstale":"2020-06-27T04:45:18.153722+0000","last_undegraded":"2020-06-27T04:45:18.153722+0000","last_fullsized":"2020-06-27T04:45:18.153722+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153022+0000","last_change":"2020-06-27T04:44:37.443657+0000","last_active":"2020-06-27T04:45:18.153022+0000","last_peered":"2020-06-27T04:45:18.153022+0000","last_clean":"2020-06-27T04:45:18.153022+0000","last_became_active":"2020-06-27T04:44:37.443163+0000","last_became_peered":"2020-06-27T04:44:37.443163+0000","last_unstale":"2020-06-27T04:45:18.153022+0000","last_undegraded":"2020-06-27T04:45:18.153022+0000","last_fullsized":"2020-06-27T04:45:18.153022+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"30","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136192+0000","last_change":"2020-06-27T04:44:24.288100+0000","last_active":"2020-06-27T04:45:18.136192+0000","last_peered":"2020-06-27T04:45:18.136192+0000","last_clean":"2020-06-27T04:45:18.136192+0000","last_became_active":"2020-06-27T04:44:24.287581+0000","last_became_peered":"2020-06-27T04:44:24.287581+0000","last_unstale":"2020-06-27T04:45:18.136192+0000","last_undegraded":"2020-06-27T04:45:18.136192+0000","last_fullsized":"2020-06-27T04:45:18.136192+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"57'39","reported_seq":"102","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138667+0000","last_change":"2020-06-27T04:44:35.384882+0000","last_active":"2020-06-27T04:45:18.138667+0000","last_peered":"2020-06-27T04:45:18.138667+0000","last_clean":"2020-06-27T04:45:18.138667+0000","last_became_active":"2020-06-27T04:44:35.384313+0000","last_became_peered":"2020-06-27T04:44:35.384313+0000","last_unstale":"2020-06-27T04:45:18.138667+0000","last_undegraded":"2020-06-27T04:45:18.138667+0000","last_fullsized":"2020-06-27T04:45:18.138667+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.134246+0000","last_change":"2020-06-27T04:44:39.422012+0000","last_active":"2020-06-27T04:45:18.134246+0000","last_peered":"2020-06-27T04:45:18.134246+0000","last_clean":"2020-06-27T04:45:18.134246+0000","last_became_active":"2020-06-27T04:44:39.421552+0000","last_became_peered":"2020-06-27T04:44:39.421552+0000","last_unstale":"2020-06-27T04:45:18.134246+0000","last_undegraded":"2020-06-27T04:45:18.134246+0000","last_fullsized":"2020-06-27T04:45:18.134246+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.139838+0000","last_change":"2020-06-27T04:44:37.446490+0000","last_active":"2020-06-27T04:45:18.139838+0000","last_peered":"2020-06-27T04:45:18.139838+0000","last_clean":"2020-06-27T04:45:18.139838+0000","last_became_active":"2020-06-27T04:44:37.445958+0000","last_became_peered":"2020-06-27T04:44:37.445958+0000","last_unstale":"2020-06-27T04:45:18.139838+0000","last_undegraded":"2020-06-27T04:45:18.139838+0000","last_fullsized":"2020-06-27T04:45:18.139838+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"48'1","reported_seq":"24","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153652+0000","last_change":"2020-06-27T04:44:23.271918+0000","last_active":"2020-06-27T04:45:18.153652+0000","last_peered":"2020-06-27T04:45:18.153652+0000","last_clean":"2020-06-27T04:45:18.153652+0000","last_became_active":"2020-06-27T04:44:23.271384+0000","last_became_peered":"2020-06-27T04:44:23.271384+0000","last_unstale":"2020-06-27T04:45:18.153652+0000","last_undegraded":"2020-06-27T04:45:18.153652+0000","last_fullsized":"2020-06-27T04:45:18.153652+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"57'21","reported_seq":"62","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137128+0000","last_change":"2020-06-27T04:44:35.399723+0000","last_active":"2020-06-27T04:45:18.137128+0000","last_peered":"2020-06-27T04:45:18.137128+0000","last_clean":"2020-06-27T04:45:18.137128+0000","last_became_active":"2020-06-27T04:44:35.399347+0000","last_became_peered":"2020-06-27T04:44:35.399347+0000","last_unstale":"2020-06-27T04:45:18.137128+0000","last_undegraded":"2020-06-27T04:45:18.137128+0000","last_fullsized":"2020-06-27T04:45:18.137128+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152938+0000","last_change":"2020-06-27T04:44:39.419907+0000","last_active":"2020-06-27T04:45:18.152938+0000","last_peered":"2020-06-27T04:45:18.152938+0000","last_clean":"2020-06-27T04:45:18.152938+0000","last_became_active":"2020-06-27T04:44:39.419454+0000","last_became_peered":"2020-06-27T04:44:39.419454+0000","last_unstale":"2020-06-27T04:45:18.152938+0000","last_undegraded":"2020-06-27T04:45:18.152938+0000","last_fullsized":"2020-06-27T04:45:18.152938+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138551+0000","last_change":"2020-06-27T04:44:37.403584+0000","last_active":"2020-06-27T04:45:18.138551+0000","last_peered":"2020-06-27T04:45:18.138551+0000","last_clean":"2020-06-27T04:45:18.138551+0000","last_became_active":"2020-06-27T04:44:37.403112+0000","last_became_peered":"2020-06-27T04:44:37.403112+0000","last_unstale":"2020-06-27T04:45:18.138551+0000","last_undegraded":"2020-06-27T04:45:18.138551+0000","last_fullsized":"2020-06-27T04:45:18.138551+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"21","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136995+0000","last_change":"2020-06-27T04:44:22.270942+0000","last_active":"2020-06-27T04:45:18.136995+0000","last_peered":"2020-06-27T04:45:18.136995+0000","last_clean":"2020-06-27T04:45:18.136995+0000","last_became_active":"2020-06-27T04:44:22.270529+0000","last_became_peered":"2020-06-27T04:44:22.270529+0000","last_unstale":"2020-06-27T04:45:18.136995+0000","last_undegraded":"2020-06-27T04:45:18.136995+0000","last_fullsized":"2020-06-27T04:45:18.136995+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"57'12","reported_seq":"40","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153169+0000","last_change":"2020-06-27T04:44:35.393098+0000","last_active":"2020-06-27T04:45:18.153169+0000","last_peered":"2020-06-27T04:45:18.153169+0000","last_clean":"2020-06-27T04:45:18.153169+0000","last_became_active":"2020-06-27T04:44:35.392678+0000","last_became_peered":"2020-06-27T04:44:35.392678+0000","last_unstale":"2020-06-27T04:45:18.153169+0000","last_undegraded":"2020-06-27T04:45:18.153169+0000","last_fullsized":"2020-06-27T04:45:18.153169+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140190+0000","last_change":"2020-06-27T04:44:39.423674+0000","last_active":"2020-06-27T04:45:18.140190+0000","last_peered":"2020-06-27T04:45:18.140190+0000","last_clean":"2020-06-27T04:45:18.140190+0000","last_became_active":"2020-06-27T04:44:39.423266+0000","last_became_peered":"2020-06-27T04:44:39.423266+0000","last_unstale":"2020-06-27T04:45:18.140190+0000","last_undegraded":"2020-06-27T04:45:18.140190+0000","last_fullsized":"2020-06-27T04:45:18.140190+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.139964+0000","last_change":"2020-06-27T04:44:37.399474+0000","last_active":"2020-06-27T04:45:18.139964+0000","last_peered":"2020-06-27T04:45:18.139964+0000","last_clean":"2020-06-27T04:45:18.139964+0000","last_became_active":"2020-06-27T04:44:37.399083+0000","last_became_peered":"2020-06-27T04:44:37.399083+0000","last_unstale":"2020-06-27T04:45:18.139964+0000","last_undegraded":"2020-06-27T04:45:18.139964+0000","last_fullsized":"2020-06-27T04:45:18.139964+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"49'2","reported_seq":"27","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136665+0000","last_change":"2020-06-27T04:44:22.275137+0000","last_active":"2020-06-27T04:45:18.136665+0000","last_peered":"2020-06-27T04:45:18.136665+0000","last_clean":"2020-06-27T04:45:18.136665+0000","last_became_active":"2020-06-27T04:44:22.274652+0000","last_became_peered":"2020-06-27T04:44:22.274652+0000","last_unstale":"2020-06-27T04:45:18.136665+0000","last_undegraded":"2020-06-27T04:45:18.136665+0000","last_fullsized":"2020-06-27T04:45:18.136665+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":391,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"57'22","reported_seq":"62","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.141760+0000","last_change":"2020-06-27T04:44:35.400737+0000","last_active":"2020-06-27T04:45:18.141760+0000","last_peered":"2020-06-27T04:45:18.141760+0000","last_clean":"2020-06-27T04:45:18.141760+0000","last_became_active":"2020-06-27T04:44:35.400211+0000","last_became_peered":"2020-06-27T04:44:35.400211+0000","last_unstale":"2020-06-27T04:45:18.141760+0000","last_undegraded":"2020-06-27T04:45:18.141760+0000","last_fullsized":"2020-06-27T04:45:18.141760+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":32,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.139846+0000","last_change":"2020-06-27T04:44:39.432167+0000","last_active":"2020-06-27T04:45:18.139846+0000","last_peered":"2020-06-27T04:45:18.139846+0000","last_clean":"2020-06-27T04:45:18.139846+0000","last_became_active":"2020-06-27T04:44:39.431664+0000","last_became_peered":"2020-06-27T04:44:39.431664+0000","last_unstale":"2020-06-27T04:45:18.139846+0000","last_undegraded":"2020-06-27T04:45:18.139846+0000","last_fullsized":"2020-06-27T04:45:18.139846+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.139421+0000","last_change":"2020-06-27T04:44:37.408211+0000","last_active":"2020-06-27T04:45:18.139421+0000","last_peered":"2020-06-27T04:45:18.139421+0000","last_clean":"2020-06-27T04:45:18.139421+0000","last_became_active":"2020-06-27T04:44:37.407741+0000","last_became_peered":"2020-06-27T04:44:37.407741+0000","last_unstale":"2020-06-27T04:45:18.139421+0000","last_undegraded":"2020-06-27T04:45:18.139421+0000","last_fullsized":"2020-06-27T04:45:18.139421+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"48'1","reported_seq":"22","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153435+0000","last_change":"2020-06-27T04:44:22.272729+0000","last_active":"2020-06-27T04:45:18.153435+0000","last_peered":"2020-06-27T04:45:18.153435+0000","last_clean":"2020-06-27T04:45:18.153435+0000","last_became_active":"2020-06-27T04:44:22.271994+0000","last_became_peered":"2020-06-27T04:44:22.271994+0000","last_unstale":"2020-06-27T04:45:18.153435+0000","last_undegraded":"2020-06-27T04:45:18.153435+0000","last_fullsized":"2020-06-27T04:45:18.153435+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"57'15","reported_seq":"47","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.134377+0000","last_change":"2020-06-27T04:44:35.385618+0000","last_active":"2020-06-27T04:45:18.134377+0000","last_peered":"2020-06-27T04:45:18.134377+0000","last_clean":"2020-06-27T04:45:18.134377+0000","last_became_active":"2020-06-27T04:44:35.385276+0000","last_became_peered":"2020-06-27T04:44:35.385276+0000","last_unstale":"2020-06-27T04:45:18.134377+0000","last_undegraded":"2020-06-27T04:45:18.134377+0000","last_fullsized":"2020-06-27T04:45:18.134377+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":22,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140851+0000","last_change":"2020-06-27T04:44:39.432292+0000","last_active":"2020-06-27T04:45:18.140851+0000","last_peered":"2020-06-27T04:45:18.140851+0000","last_clean":"2020-06-27T04:45:18.140851+0000","last_became_active":"2020-06-27T04:44:39.431203+0000","last_became_peered":"2020-06-27T04:44:39.431203+0000","last_unstale":"2020-06-27T04:45:18.140851+0000","last_undegraded":"2020-06-27T04:45:18.140851+0000","last_fullsized":"2020-06-27T04:45:18.140851+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"53'2","reported_seq":"33","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:53.722818+0000","last_change":"2020-06-27T04:44:37.443931+0000","last_active":"2020-06-27T04:45:53.722818+0000","last_peered":"2020-06-27T04:45:53.722818+0000","last_clean":"2020-06-27T04:45:53.722818+0000","last_became_active":"2020-06-27T04:44:37.443506+0000","last_became_peered":"2020-06-27T04:44:37.443506+0000","last_unstale":"2020-06-27T04:45:53.722818+0000","last_undegraded":"2020-06-27T04:45:53.722818+0000","last_fullsized":"2020-06-27T04:45:53.722818+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":"21","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152588+0000","last_change":"2020-06-27T04:44:22.265700+0000","last_active":"2020-06-27T04:45:18.152588+0000","last_peered":"2020-06-27T04:45:18.152588+0000","last_clean":"2020-06-27T04:45:18.152588+0000","last_became_active":"2020-06-27T04:44:22.264166+0000","last_became_peered":"2020-06-27T04:44:22.264166+0000","last_unstale":"2020-06-27T04:45:18.152588+0000","last_undegraded":"2020-06-27T04:45:18.152588+0000","last_fullsized":"2020-06-27T04:45:18.152588+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"57'9","reported_seq":"32","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152279+0000","last_change":"2020-06-27T04:44:35.388595+0000","last_active":"2020-06-27T04:45:18.152279+0000","last_peered":"2020-06-27T04:45:18.152279+0000","last_clean":"2020-06-27T04:45:18.152279+0000","last_became_active":"2020-06-27T04:44:35.387403+0000","last_became_peered":"2020-06-27T04:44:35.387403+0000","last_unstale":"2020-06-27T04:45:18.152279+0000","last_undegraded":"2020-06-27T04:45:18.152279+0000","last_fullsized":"2020-06-27T04:45:18.152279+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137965+0000","last_change":"2020-06-27T04:44:39.419900+0000","last_active":"2020-06-27T04:45:18.137965+0000","last_peered":"2020-06-27T04:45:18.137965+0000","last_clean":"2020-06-27T04:45:18.137965+0000","last_became_active":"2020-06-27T04:44:39.419298+0000","last_became_peered":"2020-06-27T04:44:39.419298+0000","last_unstale":"2020-06-27T04:45:18.137965+0000","last_undegraded":"2020-06-27T04:45:18.137965+0000","last_fullsized":"2020-06-27T04:45:18.137965+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"59'3","reported_seq":"47","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:53.722674+0000","last_change":"2020-06-27T04:45:19.147164+0000","last_active":"2020-06-27T04:45:53.722674+0000","last_peered":"2020-06-27T04:45:53.722674+0000","last_clean":"2020-06-27T04:45:53.722674+0000","last_became_active":"2020-06-27T04:45:19.141877+0000","last_became_peered":"2020-06-27T04:45:19.141877+0000","last_unstale":"2020-06-27T04:45:53.722674+0000","last_undegraded":"2020-06-27T04:45:53.722674+0000","last_fullsized":"2020-06-27T04:45:53.722674+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"48'2","reported_seq":"39","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:19.148254+0000","last_change":"2020-06-27T04:45:19.148254+0000","last_active":"2020-06-27T04:45:19.148254+0000","last_peered":"2020-06-27T04:45:19.148254+0000","last_clean":"2020-06-27T04:45:19.148254+0000","last_became_active":"2020-06-27T04:45:19.139903+0000","last_became_peered":"2020-06-27T04:45:19.139903+0000","last_unstale":"2020-06-27T04:45:19.148254+0000","last_undegraded":"2020-06-27T04:45:19.148254+0000","last_fullsized":"2020-06-27T04:45:19.148254+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"57'11","reported_seq":"35","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133852+0000","last_change":"2020-06-27T04:44:35.840568+0000","last_active":"2020-06-27T04:45:18.133852+0000","last_peered":"2020-06-27T04:45:18.133852+0000","last_clean":"2020-06-27T04:45:18.133852+0000","last_became_active":"2020-06-27T04:44:35.840155+0000","last_became_peered":"2020-06-27T04:44:35.840155+0000","last_unstale":"2020-06-27T04:45:18.133852+0000","last_undegraded":"2020-06-27T04:45:18.133852+0000","last_fullsized":"2020-06-27T04:45:18.133852+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136854+0000","last_change":"2020-06-27T04:44:39.428338+0000","last_active":"2020-06-27T04:45:18.136854+0000","last_peered":"2020-06-27T04:45:18.136854+0000","last_clean":"2020-06-27T04:45:18.136854+0000","last_became_active":"2020-06-27T04:44:39.427932+0000","last_became_peered":"2020-06-27T04:44:39.427932+0000","last_unstale":"2020-06-27T04:45:18.136854+0000","last_undegraded":"2020-06-27T04:45:18.136854+0000","last_fullsized":"2020-06-27T04:45:18.136854+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140865+0000","last_change":"2020-06-27T04:44:37.443727+0000","last_active":"2020-06-27T04:45:18.140865+0000","last_peered":"2020-06-27T04:45:18.140865+0000","last_clean":"2020-06-27T04:45:18.140865+0000","last_became_active":"2020-06-27T04:44:37.443200+0000","last_became_peered":"2020-06-27T04:44:37.443200+0000","last_unstale":"2020-06-27T04:45:18.140865+0000","last_undegraded":"2020-06-27T04:45:18.140865+0000","last_fullsized":"2020-06-27T04:45:18.140865+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"49'1","reported_seq":"23","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153015+0000","last_change":"2020-06-27T04:44:22.270387+0000","last_active":"2020-06-27T04:45:18.153015+0000","last_peered":"2020-06-27T04:45:18.153015+0000","last_clean":"2020-06-27T04:45:18.153015+0000","last_became_active":"2020-06-27T04:44:22.269844+0000","last_became_peered":"2020-06-27T04:44:22.269844+0000","last_unstale":"2020-06-27T04:45:18.153015+0000","last_undegraded":"2020-06-27T04:45:18.153015+0000","last_fullsized":"2020-06-27T04:45:18.153015+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"57'4","reported_seq":"22","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152824+0000","last_change":"2020-06-27T04:44:35.395038+0000","last_active":"2020-06-27T04:45:18.152824+0000","last_peered":"2020-06-27T04:45:18.152824+0000","last_clean":"2020-06-27T04:45:18.152824+0000","last_became_active":"2020-06-27T04:44:35.394618+0000","last_became_peered":"2020-06-27T04:44:35.394618+0000","last_unstale":"2020-06-27T04:45:18.152824+0000","last_undegraded":"2020-06-27T04:45:18.152824+0000","last_fullsized":"2020-06-27T04:45:18.152824+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140987+0000","last_change":"2020-06-27T04:44:39.429769+0000","last_active":"2020-06-27T04:45:18.140987+0000","last_peered":"2020-06-27T04:45:18.140987+0000","last_clean":"2020-06-27T04:45:18.140987+0000","last_became_active":"2020-06-27T04:44:39.429316+0000","last_became_peered":"2020-06-27T04:44:39.429316+0000","last_unstale":"2020-06-27T04:45:18.140987+0000","last_undegraded":"2020-06-27T04:45:18.140987+0000","last_fullsized":"2020-06-27T04:45:18.140987+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153233+0000","last_change":"2020-06-27T04:44:37.444777+0000","last_active":"2020-06-27T04:45:18.153233+0000","last_peered":"2020-06-27T04:45:18.153233+0000","last_clean":"2020-06-27T04:45:18.153233+0000","last_became_active":"2020-06-27T04:44:37.444359+0000","last_became_peered":"2020-06-27T04:44:37.444359+0000","last_unstale":"2020-06-27T04:45:18.153233+0000","last_undegraded":"2020-06-27T04:45:18.153233+0000","last_fullsized":"2020-06-27T04:45:18.153233+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"22","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.135321+0000","last_change":"2020-06-27T04:44:22.275538+0000","last_active":"2020-06-27T04:45:18.135321+0000","last_peered":"2020-06-27T04:45:18.135321+0000","last_clean":"2020-06-27T04:45:18.135321+0000","last_became_active":"2020-06-27T04:44:22.275099+0000","last_became_peered":"2020-06-27T04:44:22.275099+0000","last_unstale":"2020-06-27T04:45:18.135321+0000","last_undegraded":"2020-06-27T04:45:18.135321+0000","last_fullsized":"2020-06-27T04:45:18.135321+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"57'17","reported_seq":"50","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133295+0000","last_change":"2020-06-27T04:44:35.394374+0000","last_active":"2020-06-27T04:45:18.133295+0000","last_peered":"2020-06-27T04:45:18.133295+0000","last_clean":"2020-06-27T04:45:18.133295+0000","last_became_active":"2020-06-27T04:44:35.394031+0000","last_became_peered":"2020-06-27T04:44:35.394031+0000","last_unstale":"2020-06-27T04:45:18.133295+0000","last_undegraded":"2020-06-27T04:45:18.133295+0000","last_fullsized":"2020-06-27T04:45:18.133295+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.135321+0000","last_change":"2020-06-27T04:44:39.415729+0000","last_active":"2020-06-27T04:45:18.135321+0000","last_peered":"2020-06-27T04:45:18.135321+0000","last_clean":"2020-06-27T04:45:18.135321+0000","last_became_active":"2020-06-27T04:44:39.415243+0000","last_became_peered":"2020-06-27T04:44:39.415243+0000","last_unstale":"2020-06-27T04:45:18.135321+0000","last_undegraded":"2020-06-27T04:45:18.135321+0000","last_fullsized":"2020-06-27T04:45:18.135321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"49'1","reported_seq":"34","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.142256+0000","last_change":"2020-06-27T04:44:24.274049+0000","last_active":"2020-06-27T04:45:18.142256+0000","last_peered":"2020-06-27T04:45:18.142256+0000","last_clean":"2020-06-27T04:45:18.142256+0000","last_became_active":"2020-06-27T04:44:24.273494+0000","last_became_peered":"2020-06-27T04:44:24.273494+0000","last_unstale":"2020-06-27T04:45:18.142256+0000","last_undegraded":"2020-06-27T04:45:18.142256+0000","last_fullsized":"2020-06-27T04:45:18.142256+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"57'17","reported_seq":"50","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.134696+0000","last_change":"2020-06-27T04:44:35.389934+0000","last_active":"2020-06-27T04:45:18.134696+0000","last_peered":"2020-06-27T04:45:18.134696+0000","last_clean":"2020-06-27T04:45:18.134696+0000","last_became_active":"2020-06-27T04:44:35.389527+0000","last_became_peered":"2020-06-27T04:44:35.389527+0000","last_unstale":"2020-06-27T04:45:18.134696+0000","last_undegraded":"2020-06-27T04:45:18.134696+0000","last_fullsized":"2020-06-27T04:45:18.134696+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"59'3","reported_seq":"48","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:53.723137+0000","last_change":"2020-06-27T04:45:19.149549+0000","last_active":"2020-06-27T04:45:53.723137+0000","last_peered":"2020-06-27T04:45:53.723137+0000","last_clean":"2020-06-27T04:45:53.723137+0000","last_became_active":"2020-06-27T04:45:19.141809+0000","last_became_peered":"2020-06-27T04:45:19.141809+0000","last_unstale":"2020-06-27T04:45:53.723137+0000","last_undegraded":"2020-06-27T04:45:53.723137+0000","last_fullsized":"2020-06-27T04:45:53.723137+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3],"acting":[4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152494+0000","last_change":"2020-06-27T04:44:39.424612+0000","last_active":"2020-06-27T04:45:18.152494+0000","last_peered":"2020-06-27T04:45:18.152494+0000","last_clean":"2020-06-27T04:45:18.152494+0000","last_became_active":"2020-06-27T04:44:39.424194+0000","last_became_peered":"2020-06-27T04:44:39.424194+0000","last_unstale":"2020-06-27T04:45:18.152494+0000","last_undegraded":"2020-06-27T04:45:18.152494+0000","last_fullsized":"2020-06-27T04:45:18.152494+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"57'5","reported_seq":"59","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:51.541707+0000","last_change":"2020-06-27T04:44:24.276239+0000","last_active":"2020-06-27T04:45:51.541707+0000","last_peered":"2020-06-27T04:45:51.541707+0000","last_clean":"2020-06-27T04:45:51.541707+0000","last_became_active":"2020-06-27T04:44:24.275664+0000","last_became_peered":"2020-06-27T04:44:24.275664+0000","last_unstale":"2020-06-27T04:45:51.541707+0000","last_undegraded":"2020-06-27T04:45:51.541707+0000","last_fullsized":"2020-06-27T04:45:51.541707+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"57'12","reported_seq":"34","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137588+0000","last_change":"2020-06-27T04:44:35.840202+0000","last_active":"2020-06-27T04:45:18.137588+0000","last_peered":"2020-06-27T04:45:18.137588+0000","last_clean":"2020-06-27T04:45:18.137588+0000","last_became_active":"2020-06-27T04:44:35.839722+0000","last_became_peered":"2020-06-27T04:44:35.839722+0000","last_unstale":"2020-06-27T04:45:18.137588+0000","last_undegraded":"2020-06-27T04:45:18.137588+0000","last_fullsized":"2020-06-27T04:45:18.137588+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140113+0000","last_change":"2020-06-27T04:44:37.404369+0000","last_active":"2020-06-27T04:45:18.140113+0000","last_peered":"2020-06-27T04:45:18.140113+0000","last_clean":"2020-06-27T04:45:18.140113+0000","last_became_active":"2020-06-27T04:44:37.402477+0000","last_became_peered":"2020-06-27T04:44:37.402477+0000","last_unstale":"2020-06-27T04:45:18.140113+0000","last_undegraded":"2020-06-27T04:45:18.140113+0000","last_fullsized":"2020-06-27T04:45:18.140113+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152927+0000","last_change":"2020-06-27T04:44:39.428415+0000","last_active":"2020-06-27T04:45:18.152927+0000","last_peered":"2020-06-27T04:45:18.152927+0000","last_clean":"2020-06-27T04:45:18.152927+0000","last_became_active":"2020-06-27T04:44:39.427940+0000","last_became_peered":"2020-06-27T04:44:39.427940+0000","last_unstale":"2020-06-27T04:45:18.152927+0000","last_undegraded":"2020-06-27T04:45:18.152927+0000","last_fullsized":"2020-06-27T04:45:18.152927+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"21","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137101+0000","last_change":"2020-06-27T04:44:22.273175+0000","last_active":"2020-06-27T04:45:18.137101+0000","last_peered":"2020-06-27T04:45:18.137101+0000","last_clean":"2020-06-27T04:45:18.137101+0000","last_became_active":"2020-06-27T04:44:22.272748+0000","last_became_peered":"2020-06-27T04:44:22.272748+0000","last_unstale":"2020-06-27T04:45:18.137101+0000","last_undegraded":"2020-06-27T04:45:18.137101+0000","last_fullsized":"2020-06-27T04:45:18.137101+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"57'25","reported_seq":"68","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140380+0000","last_change":"2020-06-27T04:44:35.390970+0000","last_active":"2020-06-27T04:45:18.140380+0000","last_peered":"2020-06-27T04:45:18.140380+0000","last_clean":"2020-06-27T04:45:18.140380+0000","last_became_active":"2020-06-27T04:44:35.390562+0000","last_became_peered":"2020-06-27T04:44:35.390562+0000","last_unstale":"2020-06-27T04:45:18.140380+0000","last_undegraded":"2020-06-27T04:45:18.140380+0000","last_fullsized":"2020-06-27T04:45:18.140380+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137504+0000","last_change":"2020-06-27T04:44:37.407157+0000","last_active":"2020-06-27T04:45:18.137504+0000","last_peered":"2020-06-27T04:45:18.137504+0000","last_clean":"2020-06-27T04:45:18.137504+0000","last_became_active":"2020-06-27T04:44:37.406717+0000","last_became_peered":"2020-06-27T04:44:37.406717+0000","last_unstale":"2020-06-27T04:45:18.137504+0000","last_undegraded":"2020-06-27T04:45:18.137504+0000","last_fullsized":"2020-06-27T04:45:18.137504+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137690+0000","last_change":"2020-06-27T04:44:39.414652+0000","last_active":"2020-06-27T04:45:18.137690+0000","last_peered":"2020-06-27T04:45:18.137690+0000","last_clean":"2020-06-27T04:45:18.137690+0000","last_became_active":"2020-06-27T04:44:39.414186+0000","last_became_peered":"2020-06-27T04:44:39.414186+0000","last_unstale":"2020-06-27T04:45:18.137690+0000","last_undegraded":"2020-06-27T04:45:18.137690+0000","last_fullsized":"2020-06-27T04:45:18.137690+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"57'30","reported_seq":"79","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137039+0000","last_change":"2020-06-27T04:44:35.840256+0000","last_active":"2020-06-27T04:45:18.137039+0000","last_peered":"2020-06-27T04:45:18.137039+0000","last_clean":"2020-06-27T04:45:18.137039+0000","last_became_active":"2020-06-27T04:44:35.839807+0000","last_became_peered":"2020-06-27T04:44:35.839807+0000","last_unstale":"2020-06-27T04:45:18.137039+0000","last_undegraded":"2020-06-27T04:45:18.137039+0000","last_fullsized":"2020-06-27T04:45:18.137039+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":44,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"22","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.135771+0000","last_change":"2020-06-27T04:44:22.278293+0000","last_active":"2020-06-27T04:45:18.135771+0000","last_peered":"2020-06-27T04:45:18.135771+0000","last_clean":"2020-06-27T04:45:18.135771+0000","last_became_active":"2020-06-27T04:44:22.277807+0000","last_became_peered":"2020-06-27T04:44:22.277807+0000","last_unstale":"2020-06-27T04:45:18.135771+0000","last_undegraded":"2020-06-27T04:45:18.135771+0000","last_fullsized":"2020-06-27T04:45:18.135771+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136938+0000","last_change":"2020-06-27T04:44:37.401934+0000","last_active":"2020-06-27T04:45:18.136938+0000","last_peered":"2020-06-27T04:45:18.136938+0000","last_clean":"2020-06-27T04:45:18.136938+0000","last_became_active":"2020-06-27T04:44:37.401495+0000","last_became_peered":"2020-06-27T04:44:37.401495+0000","last_unstale":"2020-06-27T04:45:18.136938+0000","last_undegraded":"2020-06-27T04:45:18.136938+0000","last_fullsized":"2020-06-27T04:45:18.136938+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133365+0000","last_change":"2020-06-27T04:44:39.421103+0000","last_active":"2020-06-27T04:45:18.133365+0000","last_peered":"2020-06-27T04:45:18.133365+0000","last_clean":"2020-06-27T04:45:18.133365+0000","last_became_active":"2020-06-27T04:44:39.420653+0000","last_became_peered":"2020-06-27T04:44:39.420653+0000","last_unstale":"2020-06-27T04:45:18.133365+0000","last_undegraded":"2020-06-27T04:45:18.133365+0000","last_fullsized":"2020-06-27T04:45:18.133365+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"57'16","reported_seq":"46","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140097+0000","last_change":"2020-06-27T04:44:35.395372+0000","last_active":"2020-06-27T04:45:18.140097+0000","last_peered":"2020-06-27T04:45:18.140097+0000","last_clean":"2020-06-27T04:45:18.140097+0000","last_became_active":"2020-06-27T04:44:35.394585+0000","last_became_peered":"2020-06-27T04:44:35.394585+0000","last_unstale":"2020-06-27T04:45:18.140097+0000","last_undegraded":"2020-06-27T04:45:18.140097+0000","last_fullsized":"2020-06-27T04:45:18.140097+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"23","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136600+0000","last_change":"2020-06-27T04:44:24.281285+0000","last_active":"2020-06-27T04:45:18.136600+0000","last_peered":"2020-06-27T04:45:18.136600+0000","last_clean":"2020-06-27T04:45:18.136600+0000","last_became_active":"2020-06-27T04:44:24.280676+0000","last_became_peered":"2020-06-27T04:44:24.280676+0000","last_unstale":"2020-06-27T04:45:18.136600+0000","last_undegraded":"2020-06-27T04:45:18.136600+0000","last_fullsized":"2020-06-27T04:45:18.136600+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'2","reported_seq":"26","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133765+0000","last_change":"2020-06-27T04:44:24.295963+0000","last_active":"2020-06-27T04:45:18.133765+0000","last_peered":"2020-06-27T04:45:18.133765+0000","last_clean":"2020-06-27T04:45:18.133765+0000","last_became_active":"2020-06-27T04:44:24.285786+0000","last_became_peered":"2020-06-27T04:44:24.285786+0000","last_unstale":"2020-06-27T04:45:18.133765+0000","last_undegraded":"2020-06-27T04:45:18.133765+0000","last_fullsized":"2020-06-27T04:45:18.133765+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:39:48.364090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:39:48.364090+0000","last_clean_scrub_stamp":"2020-06-27T04:39:48.364090+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153509+0000","last_change":"2020-06-27T04:44:37.446369+0000","last_active":"2020-06-27T04:45:18.153509+0000","last_peered":"2020-06-27T04:45:18.153509+0000","last_clean":"2020-06-27T04:45:18.153509+0000","last_became_active":"2020-06-27T04:44:37.445862+0000","last_became_peered":"2020-06-27T04:44:37.445862+0000","last_unstale":"2020-06-27T04:45:18.153509+0000","last_undegraded":"2020-06-27T04:45:18.153509+0000","last_fullsized":"2020-06-27T04:45:18.153509+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140255+0000","last_change":"2020-06-27T04:44:39.420638+0000","last_active":"2020-06-27T04:45:18.140255+0000","last_peered":"2020-06-27T04:45:18.140255+0000","last_clean":"2020-06-27T04:45:18.140255+0000","last_became_active":"2020-06-27T04:44:39.420238+0000","last_became_peered":"2020-06-27T04:44:39.420238+0000","last_unstale":"2020-06-27T04:45:18.140255+0000","last_undegraded":"2020-06-27T04:45:18.140255+0000","last_fullsized":"2020-06-27T04:45:18.140255+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"57'20","reported_seq":"52","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152122+0000","last_change":"2020-06-27T04:44:35.387967+0000","last_active":"2020-06-27T04:45:18.152122+0000","last_peered":"2020-06-27T04:45:18.152122+0000","last_clean":"2020-06-27T04:45:18.152122+0000","last_became_active":"2020-06-27T04:44:35.387339+0000","last_became_peered":"2020-06-27T04:44:35.387339+0000","last_unstale":"2020-06-27T04:45:18.152122+0000","last_undegraded":"2020-06-27T04:45:18.152122+0000","last_fullsized":"2020-06-27T04:45:18.152122+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"19","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133099+0000","last_change":"2020-06-27T04:44:24.287552+0000","last_active":"2020-06-27T04:45:18.133099+0000","last_peered":"2020-06-27T04:45:18.133099+0000","last_clean":"2020-06-27T04:45:18.133099+0000","last_became_active":"2020-06-27T04:44:24.286639+0000","last_became_peered":"2020-06-27T04:44:24.286639+0000","last_unstale":"2020-06-27T04:45:18.133099+0000","last_undegraded":"2020-06-27T04:45:18.133099+0000","last_fullsized":"2020-06-27T04:45:18.133099+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153132+0000","last_change":"2020-06-27T04:44:37.404797+0000","last_active":"2020-06-27T04:45:18.153132+0000","last_peered":"2020-06-27T04:45:18.153132+0000","last_clean":"2020-06-27T04:45:18.153132+0000","last_became_active":"2020-06-27T04:44:37.404213+0000","last_became_peered":"2020-06-27T04:44:37.404213+0000","last_unstale":"2020-06-27T04:45:18.153132+0000","last_undegraded":"2020-06-27T04:45:18.153132+0000","last_fullsized":"2020-06-27T04:45:18.153132+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152995+0000","last_change":"2020-06-27T04:44:39.417129+0000","last_active":"2020-06-27T04:45:18.152995+0000","last_peered":"2020-06-27T04:45:18.152995+0000","last_clean":"2020-06-27T04:45:18.152995+0000","last_became_active":"2020-06-27T04:44:39.416606+0000","last_became_peered":"2020-06-27T04:44:39.416606+0000","last_unstale":"2020-06-27T04:45:18.152995+0000","last_undegraded":"2020-06-27T04:45:18.152995+0000","last_fullsized":"2020-06-27T04:45:18.152995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"19","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133994+0000","last_change":"2020-06-27T04:44:24.286053+0000","last_active":"2020-06-27T04:45:18.133994+0000","last_peered":"2020-06-27T04:45:18.133994+0000","last_clean":"2020-06-27T04:45:18.133994+0000","last_became_active":"2020-06-27T04:44:24.285230+0000","last_became_peered":"2020-06-27T04:44:24.285230+0000","last_unstale":"2020-06-27T04:45:18.133994+0000","last_undegraded":"2020-06-27T04:45:18.133994+0000","last_fullsized":"2020-06-27T04:45:18.133994+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"57'27","reported_seq":"71","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137812+0000","last_change":"2020-06-27T04:44:35.840204+0000","last_active":"2020-06-27T04:45:18.137812+0000","last_peered":"2020-06-27T04:45:18.137812+0000","last_clean":"2020-06-27T04:45:18.137812+0000","last_became_active":"2020-06-27T04:44:35.839671+0000","last_became_peered":"2020-06-27T04:44:35.839671+0000","last_unstale":"2020-06-27T04:45:18.137812+0000","last_undegraded":"2020-06-27T04:45:18.137812+0000","last_fullsized":"2020-06-27T04:45:18.137812+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":54,"num_read_kb":38,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"53'2","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:58.723990+0000","last_change":"2020-06-27T04:44:37.443731+0000","last_active":"2020-06-27T04:45:58.723990+0000","last_peered":"2020-06-27T04:45:58.723990+0000","last_clean":"2020-06-27T04:45:58.723990+0000","last_became_active":"2020-06-27T04:44:37.443291+0000","last_became_peered":"2020-06-27T04:44:37.443291+0000","last_unstale":"2020-06-27T04:45:58.723990+0000","last_undegraded":"2020-06-27T04:45:58.723990+0000","last_fullsized":"2020-06-27T04:45:58.723990+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140522+0000","last_change":"2020-06-27T04:44:39.426137+0000","last_active":"2020-06-27T04:45:18.140522+0000","last_peered":"2020-06-27T04:45:18.140522+0000","last_clean":"2020-06-27T04:45:18.140522+0000","last_became_active":"2020-06-27T04:44:39.425701+0000","last_became_peered":"2020-06-27T04:44:39.425701+0000","last_unstale":"2020-06-27T04:45:18.140522+0000","last_undegraded":"2020-06-27T04:45:18.140522+0000","last_fullsized":"2020-06-27T04:45:18.140522+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"23","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136651+0000","last_change":"2020-06-27T04:44:23.270266+0000","last_active":"2020-06-27T04:45:18.136651+0000","last_peered":"2020-06-27T04:45:18.136651+0000","last_clean":"2020-06-27T04:45:18.136651+0000","last_became_active":"2020-06-27T04:44:23.269757+0000","last_became_peered":"2020-06-27T04:44:23.269757+0000","last_unstale":"2020-06-27T04:45:18.136651+0000","last_undegraded":"2020-06-27T04:45:18.136651+0000","last_fullsized":"2020-06-27T04:45:18.136651+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"57'19","reported_seq":"58","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.141077+0000","last_change":"2020-06-27T04:44:35.396160+0000","last_active":"2020-06-27T04:45:18.141077+0000","last_peered":"2020-06-27T04:45:18.141077+0000","last_clean":"2020-06-27T04:45:18.141077+0000","last_became_active":"2020-06-27T04:44:35.395643+0000","last_became_peered":"2020-06-27T04:44:35.395643+0000","last_unstale":"2020-06-27T04:45:18.141077+0000","last_undegraded":"2020-06-27T04:45:18.141077+0000","last_fullsized":"2020-06-27T04:45:18.141077+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":42,"num_read_kb":30,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"53'2","reported_seq":"33","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:53.722640+0000","last_change":"2020-06-27T04:44:37.446598+0000","last_active":"2020-06-27T04:45:53.722640+0000","last_peered":"2020-06-27T04:45:53.722640+0000","last_clean":"2020-06-27T04:45:53.722640+0000","last_became_active":"2020-06-27T04:44:37.446117+0000","last_became_peered":"2020-06-27T04:44:37.446117+0000","last_unstale":"2020-06-27T04:45:53.722640+0000","last_undegraded":"2020-06-27T04:45:53.722640+0000","last_fullsized":"2020-06-27T04:45:53.722640+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138419+0000","last_change":"2020-06-27T04:44:39.424495+0000","last_active":"2020-06-27T04:45:18.138419+0000","last_peered":"2020-06-27T04:45:18.138419+0000","last_clean":"2020-06-27T04:45:18.138419+0000","last_became_active":"2020-06-27T04:44:39.420809+0000","last_became_peered":"2020-06-27T04:44:39.420809+0000","last_unstale":"2020-06-27T04:45:18.138419+0000","last_undegraded":"2020-06-27T04:45:18.138419+0000","last_fullsized":"2020-06-27T04:45:18.138419+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"30","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153804+0000","last_change":"2020-06-27T04:44:24.278200+0000","last_active":"2020-06-27T04:45:18.153804+0000","last_peered":"2020-06-27T04:45:18.153804+0000","last_clean":"2020-06-27T04:45:18.153804+0000","last_became_active":"2020-06-27T04:44:24.277655+0000","last_became_peered":"2020-06-27T04:44:24.277655+0000","last_unstale":"2020-06-27T04:45:18.153804+0000","last_undegraded":"2020-06-27T04:45:18.153804+0000","last_fullsized":"2020-06-27T04:45:18.153804+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"57'12","reported_seq":"34","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152982+0000","last_change":"2020-06-27T04:44:35.390301+0000","last_active":"2020-06-27T04:45:18.152982+0000","last_peered":"2020-06-27T04:45:18.152982+0000","last_clean":"2020-06-27T04:45:18.152982+0000","last_became_active":"2020-06-27T04:44:35.389836+0000","last_became_peered":"2020-06-27T04:44:35.389836+0000","last_unstale":"2020-06-27T04:45:18.152982+0000","last_undegraded":"2020-06-27T04:45:18.152982+0000","last_fullsized":"2020-06-27T04:45:18.152982+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.141236+0000","last_change":"2020-06-27T04:44:37.393072+0000","last_active":"2020-06-27T04:45:18.141236+0000","last_peered":"2020-06-27T04:45:18.141236+0000","last_clean":"2020-06-27T04:45:18.141236+0000","last_became_active":"2020-06-27T04:44:37.392599+0000","last_became_peered":"2020-06-27T04:44:37.392599+0000","last_unstale":"2020-06-27T04:45:18.141236+0000","last_undegraded":"2020-06-27T04:45:18.141236+0000","last_fullsized":"2020-06-27T04:45:18.141236+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138434+0000","last_change":"2020-06-27T04:44:39.422798+0000","last_active":"2020-06-27T04:45:18.138434+0000","last_peered":"2020-06-27T04:45:18.138434+0000","last_clean":"2020-06-27T04:45:18.138434+0000","last_became_active":"2020-06-27T04:44:39.422385+0000","last_became_peered":"2020-06-27T04:44:39.422385+0000","last_unstale":"2020-06-27T04:45:18.138434+0000","last_undegraded":"2020-06-27T04:45:18.138434+0000","last_fullsized":"2020-06-27T04:45:18.138434+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"53'2","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:53.722977+0000","last_change":"2020-06-27T04:44:37.410680+0000","last_active":"2020-06-27T04:45:53.722977+0000","last_peered":"2020-06-27T04:45:53.722977+0000","last_clean":"2020-06-27T04:45:53.722977+0000","last_became_active":"2020-06-27T04:44:37.410216+0000","last_became_peered":"2020-06-27T04:44:37.410216+0000","last_unstale":"2020-06-27T04:45:53.722977+0000","last_undegraded":"2020-06-27T04:45:53.722977+0000","last_fullsized":"2020-06-27T04:45:53.722977+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"19","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133013+0000","last_change":"2020-06-27T04:44:24.287163+0000","last_active":"2020-06-27T04:45:18.133013+0000","last_peered":"2020-06-27T04:45:18.133013+0000","last_clean":"2020-06-27T04:45:18.133013+0000","last_became_active":"2020-06-27T04:44:24.285206+0000","last_became_peered":"2020-06-27T04:44:24.285206+0000","last_unstale":"2020-06-27T04:45:18.133013+0000","last_undegraded":"2020-06-27T04:45:18.133013+0000","last_fullsized":"2020-06-27T04:45:18.133013+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"57'25","reported_seq":"71","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140999+0000","last_change":"2020-06-27T04:44:35.840211+0000","last_active":"2020-06-27T04:45:18.140999+0000","last_peered":"2020-06-27T04:45:18.140999+0000","last_clean":"2020-06-27T04:45:18.140999+0000","last_became_active":"2020-06-27T04:44:35.839758+0000","last_became_peered":"2020-06-27T04:44:35.839758+0000","last_unstale":"2020-06-27T04:45:18.140999+0000","last_undegraded":"2020-06-27T04:45:18.140999+0000","last_fullsized":"2020-06-27T04:45:18.140999+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":38,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.142295+0000","last_change":"2020-06-27T04:44:39.429402+0000","last_active":"2020-06-27T04:45:18.142295+0000","last_peered":"2020-06-27T04:45:18.142295+0000","last_clean":"2020-06-27T04:45:18.142295+0000","last_became_active":"2020-06-27T04:44:39.428988+0000","last_became_peered":"2020-06-27T04:44:39.428988+0000","last_unstale":"2020-06-27T04:45:18.142295+0000","last_undegraded":"2020-06-27T04:45:18.142295+0000","last_fullsized":"2020-06-27T04:45:18.142295+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137071+0000","last_change":"2020-06-27T04:44:37.406808+0000","last_active":"2020-06-27T04:45:18.137071+0000","last_peered":"2020-06-27T04:45:18.137071+0000","last_clean":"2020-06-27T04:45:18.137071+0000","last_became_active":"2020-06-27T04:44:37.406243+0000","last_became_peered":"2020-06-27T04:44:37.406243+0000","last_unstale":"2020-06-27T04:45:18.137071+0000","last_undegraded":"2020-06-27T04:45:18.137071+0000","last_fullsized":"2020-06-27T04:45:18.137071+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"24","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138605+0000","last_change":"2020-06-27T04:44:24.274796+0000","last_active":"2020-06-27T04:45:18.138605+0000","last_peered":"2020-06-27T04:45:18.138605+0000","last_clean":"2020-06-27T04:45:18.138605+0000","last_became_active":"2020-06-27T04:44:24.274139+0000","last_became_peered":"2020-06-27T04:44:24.274139+0000","last_unstale":"2020-06-27T04:45:18.138605+0000","last_undegraded":"2020-06-27T04:45:18.138605+0000","last_fullsized":"2020-06-27T04:45:18.138605+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"57'27","reported_seq":"71","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138559+0000","last_change":"2020-06-27T04:44:35.389333+0000","last_active":"2020-06-27T04:45:18.138559+0000","last_peered":"2020-06-27T04:45:18.138559+0000","last_clean":"2020-06-27T04:45:18.138559+0000","last_became_active":"2020-06-27T04:44:35.388099+0000","last_became_peered":"2020-06-27T04:44:35.388099+0000","last_unstale":"2020-06-27T04:45:18.138559+0000","last_undegraded":"2020-06-27T04:45:18.138559+0000","last_fullsized":"2020-06-27T04:45:18.138559+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136220+0000","last_change":"2020-06-27T04:44:39.416284+0000","last_active":"2020-06-27T04:45:18.136220+0000","last_peered":"2020-06-27T04:45:18.136220+0000","last_clean":"2020-06-27T04:45:18.136220+0000","last_became_active":"2020-06-27T04:44:39.415824+0000","last_became_peered":"2020-06-27T04:44:39.415824+0000","last_unstale":"2020-06-27T04:45:18.136220+0000","last_undegraded":"2020-06-27T04:45:18.136220+0000","last_fullsized":"2020-06-27T04:45:18.136220+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"24","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.139512+0000","last_change":"2020-06-27T04:44:24.276328+0000","last_active":"2020-06-27T04:45:18.139512+0000","last_peered":"2020-06-27T04:45:18.139512+0000","last_clean":"2020-06-27T04:45:18.139512+0000","last_became_active":"2020-06-27T04:44:24.275626+0000","last_became_peered":"2020-06-27T04:44:24.275626+0000","last_unstale":"2020-06-27T04:45:18.139512+0000","last_undegraded":"2020-06-27T04:45:18.139512+0000","last_fullsized":"2020-06-27T04:45:18.139512+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"57'15","reported_seq":"47","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.139962+0000","last_change":"2020-06-27T04:44:35.390776+0000","last_active":"2020-06-27T04:45:18.139962+0000","last_peered":"2020-06-27T04:45:18.139962+0000","last_clean":"2020-06-27T04:45:18.139962+0000","last_became_active":"2020-06-27T04:44:35.388560+0000","last_became_peered":"2020-06-27T04:44:35.388560+0000","last_unstale":"2020-06-27T04:45:18.139962+0000","last_undegraded":"2020-06-27T04:45:18.139962+0000","last_fullsized":"2020-06-27T04:45:18.139962+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":22,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.141757+0000","last_change":"2020-06-27T04:44:37.398579+0000","last_active":"2020-06-27T04:45:18.141757+0000","last_peered":"2020-06-27T04:45:18.141757+0000","last_clean":"2020-06-27T04:45:18.141757+0000","last_became_active":"2020-06-27T04:44:37.398170+0000","last_became_peered":"2020-06-27T04:44:37.398170+0000","last_unstale":"2020-06-27T04:45:18.141757+0000","last_undegraded":"2020-06-27T04:45:18.141757+0000","last_fullsized":"2020-06-27T04:45:18.141757+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137408+0000","last_change":"2020-06-27T04:44:39.420940+0000","last_active":"2020-06-27T04:45:18.137408+0000","last_peered":"2020-06-27T04:45:18.137408+0000","last_clean":"2020-06-27T04:45:18.137408+0000","last_became_active":"2020-06-27T04:44:39.420413+0000","last_became_peered":"2020-06-27T04:44:39.420413+0000","last_unstale":"2020-06-27T04:45:18.137408+0000","last_undegraded":"2020-06-27T04:45:18.137408+0000","last_fullsized":"2020-06-27T04:45:18.137408+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"53'2","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:53.723028+0000","last_change":"2020-06-27T04:44:37.410635+0000","last_active":"2020-06-27T04:45:53.723028+0000","last_peered":"2020-06-27T04:45:53.723028+0000","last_clean":"2020-06-27T04:45:53.723028+0000","last_became_active":"2020-06-27T04:44:37.410236+0000","last_became_peered":"2020-06-27T04:44:37.410236+0000","last_unstale":"2020-06-27T04:45:53.723028+0000","last_undegraded":"2020-06-27T04:45:53.723028+0000","last_fullsized":"2020-06-27T04:45:53.723028+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"19","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133640+0000","last_change":"2020-06-27T04:44:24.280785+0000","last_active":"2020-06-27T04:45:18.133640+0000","last_peered":"2020-06-27T04:45:18.133640+0000","last_clean":"2020-06-27T04:45:18.133640+0000","last_became_active":"2020-06-27T04:44:24.280237+0000","last_became_peered":"2020-06-27T04:44:24.280237+0000","last_unstale":"2020-06-27T04:45:18.133640+0000","last_undegraded":"2020-06-27T04:45:18.133640+0000","last_fullsized":"2020-06-27T04:45:18.133640+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"57'25","reported_seq":"62","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153237+0000","last_change":"2020-06-27T04:44:35.393147+0000","last_active":"2020-06-27T04:45:18.153237+0000","last_peered":"2020-06-27T04:45:18.153237+0000","last_clean":"2020-06-27T04:45:18.153237+0000","last_became_active":"2020-06-27T04:44:35.392550+0000","last_became_peered":"2020-06-27T04:44:35.392550+0000","last_unstale":"2020-06-27T04:45:18.153237+0000","last_undegraded":"2020-06-27T04:45:18.153237+0000","last_fullsized":"2020-06-27T04:45:18.153237+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":44,"num_read_kb":32,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.135511+0000","last_change":"2020-06-27T04:44:39.415902+0000","last_active":"2020-06-27T04:45:18.135511+0000","last_peered":"2020-06-27T04:45:18.135511+0000","last_clean":"2020-06-27T04:45:18.135511+0000","last_became_active":"2020-06-27T04:44:39.415429+0000","last_became_peered":"2020-06-27T04:44:39.415429+0000","last_unstale":"2020-06-27T04:45:18.135511+0000","last_undegraded":"2020-06-27T04:45:18.135511+0000","last_fullsized":"2020-06-27T04:45:18.135511+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"22","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136143+0000","last_change":"2020-06-27T04:44:22.277035+0000","last_active":"2020-06-27T04:45:18.136143+0000","last_peered":"2020-06-27T04:45:18.136143+0000","last_clean":"2020-06-27T04:45:18.136143+0000","last_became_active":"2020-06-27T04:44:22.276533+0000","last_became_peered":"2020-06-27T04:44:22.276533+0000","last_unstale":"2020-06-27T04:45:18.136143+0000","last_undegraded":"2020-06-27T04:45:18.136143+0000","last_fullsized":"2020-06-27T04:45:18.136143+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"57'17","reported_seq":"44","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.134259+0000","last_change":"2020-06-27T04:44:35.398011+0000","last_active":"2020-06-27T04:45:18.134259+0000","last_peered":"2020-06-27T04:45:18.134259+0000","last_clean":"2020-06-27T04:45:18.134259+0000","last_became_active":"2020-06-27T04:44:35.397575+0000","last_became_peered":"2020-06-27T04:44:35.397575+0000","last_unstale":"2020-06-27T04:45:18.134259+0000","last_undegraded":"2020-06-27T04:45:18.134259+0000","last_fullsized":"2020-06-27T04:45:18.134259+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153184+0000","last_change":"2020-06-27T04:44:37.446398+0000","last_active":"2020-06-27T04:45:18.153184+0000","last_peered":"2020-06-27T04:45:18.153184+0000","last_clean":"2020-06-27T04:45:18.153184+0000","last_became_active":"2020-06-27T04:44:37.445878+0000","last_became_peered":"2020-06-27T04:44:37.445878+0000","last_unstale":"2020-06-27T04:45:18.153184+0000","last_undegraded":"2020-06-27T04:45:18.153184+0000","last_fullsized":"2020-06-27T04:45:18.153184+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.135929+0000","last_change":"2020-06-27T04:44:39.431904+0000","last_active":"2020-06-27T04:45:18.135929+0000","last_peered":"2020-06-27T04:45:18.135929+0000","last_clean":"2020-06-27T04:45:18.135929+0000","last_became_active":"2020-06-27T04:44:39.431533+0000","last_became_peered":"2020-06-27T04:44:39.431533+0000","last_unstale":"2020-06-27T04:45:18.135929+0000","last_undegraded":"2020-06-27T04:45:18.135929+0000","last_fullsized":"2020-06-27T04:45:18.135929+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"22","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136873+0000","last_change":"2020-06-27T04:44:22.269873+0000","last_active":"2020-06-27T04:45:18.136873+0000","last_peered":"2020-06-27T04:45:18.136873+0000","last_clean":"2020-06-27T04:45:18.136873+0000","last_became_active":"2020-06-27T04:44:22.269430+0000","last_became_peered":"2020-06-27T04:44:22.269430+0000","last_unstale":"2020-06-27T04:45:18.136873+0000","last_undegraded":"2020-06-27T04:45:18.136873+0000","last_fullsized":"2020-06-27T04:45:18.136873+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"57'10","reported_seq":"31","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136853+0000","last_change":"2020-06-27T04:44:35.398464+0000","last_active":"2020-06-27T04:45:18.136853+0000","last_peered":"2020-06-27T04:45:18.136853+0000","last_clean":"2020-06-27T04:45:18.136853+0000","last_became_active":"2020-06-27T04:44:35.398011+0000","last_became_peered":"2020-06-27T04:44:35.398011+0000","last_unstale":"2020-06-27T04:45:18.136853+0000","last_undegraded":"2020-06-27T04:45:18.136853+0000","last_fullsized":"2020-06-27T04:45:18.136853+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152792+0000","last_change":"2020-06-27T04:44:37.402307+0000","last_active":"2020-06-27T04:45:18.152792+0000","last_peered":"2020-06-27T04:45:18.152792+0000","last_clean":"2020-06-27T04:45:18.152792+0000","last_became_active":"2020-06-27T04:44:37.401787+0000","last_became_peered":"2020-06-27T04:44:37.401787+0000","last_unstale":"2020-06-27T04:45:18.152792+0000","last_undegraded":"2020-06-27T04:45:18.152792+0000","last_fullsized":"2020-06-27T04:45:18.152792+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133734+0000","last_change":"2020-06-27T04:44:39.427264+0000","last_active":"2020-06-27T04:45:18.133734+0000","last_peered":"2020-06-27T04:45:18.133734+0000","last_clean":"2020-06-27T04:45:18.133734+0000","last_became_active":"2020-06-27T04:44:39.426886+0000","last_became_peered":"2020-06-27T04:44:39.426886+0000","last_unstale":"2020-06-27T04:45:18.133734+0000","last_undegraded":"2020-06-27T04:45:18.133734+0000","last_fullsized":"2020-06-27T04:45:18.133734+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"49'1","reported_seq":"33","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137903+0000","last_change":"2020-06-27T04:44:24.275183+0000","last_active":"2020-06-27T04:45:18.137903+0000","last_peered":"2020-06-27T04:45:18.137903+0000","last_clean":"2020-06-27T04:45:18.137903+0000","last_became_active":"2020-06-27T04:44:24.274604+0000","last_became_peered":"2020-06-27T04:44:24.274604+0000","last_unstale":"2020-06-27T04:45:18.137903+0000","last_undegraded":"2020-06-27T04:45:18.137903+0000","last_fullsized":"2020-06-27T04:45:18.137903+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"57'15","reported_seq":"41","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.135646+0000","last_change":"2020-06-27T04:44:35.388854+0000","last_active":"2020-06-27T04:45:18.135646+0000","last_peered":"2020-06-27T04:45:18.135646+0000","last_clean":"2020-06-27T04:45:18.135646+0000","last_became_active":"2020-06-27T04:44:35.388435+0000","last_became_peered":"2020-06-27T04:44:35.388435+0000","last_unstale":"2020-06-27T04:45:18.135646+0000","last_undegraded":"2020-06-27T04:45:18.135646+0000","last_fullsized":"2020-06-27T04:45:18.135646+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136075+0000","last_change":"2020-06-27T04:44:37.444833+0000","last_active":"2020-06-27T04:45:18.136075+0000","last_peered":"2020-06-27T04:45:18.136075+0000","last_clean":"2020-06-27T04:45:18.136075+0000","last_became_active":"2020-06-27T04:44:37.444425+0000","last_became_peered":"2020-06-27T04:44:37.444425+0000","last_unstale":"2020-06-27T04:45:18.136075+0000","last_undegraded":"2020-06-27T04:45:18.136075+0000","last_fullsized":"2020-06-27T04:45:18.136075+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3520,"num_objects":206,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":206,"num_whiteouts":0,"num_read":1057,"num_read_kb":787,"num_write":600,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":10560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":569,"ondisk_log_size":569,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1914,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":21,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":5742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":47,"seq":201863462934,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049212,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695940,"statfs":{"total":95995035648,"available":94920642560,"internally_reserved":1073741824,"allocated":643072,"data_stored":234431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 27 04:45:25 2020","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":1.05},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.93400000000000005}]},{"osd":1,"last update":"Sat Jun 27 04:45:25 2020","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.77000000000000002}]},{"osd":2,"last update":"Sat Jun 27 04:45:25 2020","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.105}]},{"osd":3,"last update":"Sat Jun 27 04:45:25 2020","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.998},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.244}]},{"osd":4,"last update":"Sat Jun 27 04:45:25 2020","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":3.7509999999999999,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":1.206}]},{"osd":5,"last update":"Sat Jun 27 04:45:25 2020","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.361}]},{"osd":6,"last update":"Sat Jun 27 04:45:25 2020","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.5},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.1869999999999998,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":1.4199999999999999}]}]},{"osd":6,"up_from":42,"seq":180388626459,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049180,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695972,"statfs":{"total":95995035648,"available":94920675328,"internally_reserved":1073741824,"allocated":610304,"data_stored":232774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 27 04:45:10 2020","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.028},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.84899999999999998}]},{"osd":1,"last update":"Sat Jun 27 04:45:10 2020","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":1.226},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.171}]},{"osd":2,"last update":"Sat Jun 27 04:45:10 2020","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.085},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.86599999999999999}]},{"osd":3,"last update":"Sat Jun 27 04:45:10 2020","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":1.274},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.3720000000000001}]},{"osd":4,"last update":"Sat Jun 27 04:45:10 2020","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":1.542}]},{"osd":5,"last update":"Sat Jun 27 04:45:10 2020","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":1.333},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.397}]},{"osd":7,"last update":"Sat Jun 27 04:45:27 2020","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.702}]}]},{"osd":1,"up_from":17,"seq":73014444074,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049184,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695968,"statfs":{"total":95995035648,"available":94920671232,"internally_reserved":1073741824,"allocated":614400,"data_stored":232860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 27 04:45:54 2020","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.68400000000000005,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69599999999999995,"15min":0.68100000000000005},"min":{"1min":0.504,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.64300000000000002}]},{"osd":2,"last update":"Sat Jun 27 04:45:11 2020","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.76000000000000001,"15min":0.75},"min":{"1min":0.54500000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.55800000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.77700000000000002}]},{"osd":3,"last update":"Sat Jun 27 04:45:32 2020","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.67200000000000004,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3100000000000001,"5min":1.409,"15min":1.409},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.014,"15min":1.022},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.85899999999999999}]},{"osd":4,"last update":"Sat Jun 27 04:45:39 2020","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.135,"15min":1.131},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0349999999999999,"15min":1.0389999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.3109999999999999}]},{"osd":5,"last update":"Sat Jun 27 04:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0640000000000001,"15min":1.0680000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.2529999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2170000000000001,"15min":1.228},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.423,"5min":1.544,"15min":1.544},"last":1.264}]},{"osd":6,"last update":"Sat Jun 27 04:45:11 2020","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":1.417},{"interface":"front","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.2130000000000001}]},{"osd":7,"last update":"Sat Jun 27 04:45:25 2020","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.357},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.157}]}]},{"osd":0,"up_from":11,"seq":47244640301,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049192,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695960,"statfs":{"total":95995035648,"available":94920663040,"internally_reserved":1073741824,"allocated":622592,"data_stored":233585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 27 04:45:52 2020","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.68000000000000005,"15min":0.628},"min":{"1min":0.52600000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.73699999999999999,"15min":0.65500000000000003},"min":{"1min":0.55800000000000005,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":3.3250000000000002,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":0.85399999999999998}]},{"osd":2,"last update":"Sat Jun 27 04:45:11 2020","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.77600000000000002,"15min":0.76400000000000001},"min":{"1min":0.60299999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.83399999999999996,"15min":0.81499999999999995},"min":{"1min":0.71399999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.621}]},{"osd":3,"last update":"Sat Jun 27 04:45:27 2020","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.86499999999999999,"15min":0.85999999999999999},"min":{"1min":0.65200000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.95999999999999996,"15min":0.96799999999999997},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4299999999999999,"5min":1.577,"15min":1.577},"last":0.90100000000000002}]},{"osd":4,"last update":"Sat Jun 27 04:45:37 2020","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2,"15min":1.1919999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.206,"15min":1.1839999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.649,"5min":2.649,"15min":2.649},"last":1.3280000000000001}]},{"osd":5,"last update":"Sat Jun 27 04:45:52 2020","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.216,"15min":1.224},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.01},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.252,"15min":1.2430000000000001},"min":{"1min":0.92400000000000004,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":3.1219999999999999,"5min":3.1219999999999999,"15min":3.1219999999999999},"last":1.0329999999999999}]},{"osd":6,"last update":"Sat Jun 27 04:45:11 2020","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.2669999999999999}]},{"osd":7,"last update":"Sat Jun 27 04:45:27 2020","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.1930000000000001}]}]},{"osd":2,"up_from":22,"seq":94489280550,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049180,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695972,"statfs":{"total":95995035648,"available":94920675328,"internally_reserved":1073741824,"allocated":610304,"data_stored":233519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 27 04:45:09 2020","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.78100000000000003,"15min":0.77400000000000002},"min":{"1min":0.54700000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.70899999999999996,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.3980000000000001,"5min":3.3980000000000001,"15min":3.3980000000000001},"last":0.71199999999999997}]},{"osd":1,"last update":"Sat Jun 27 04:45:09 2020","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.82999999999999996,"15min":0.81000000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.79800000000000004,"15min":0.76800000000000002},"min":{"1min":0.51500000000000001,"5min":0.499,"15min":0.499},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.89000000000000001}]},{"osd":3,"last update":"Sat Jun 27 04:45:27 2020","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.0009999999999999,"15min":0.97999999999999998},"min":{"1min":0.70499999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.94599999999999995,"15min":0.93799999999999994},"min":{"1min":0.63500000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.8849999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.0329999999999999}]},{"osd":4,"last update":"Sat Jun 27 04:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.135,"15min":1.109},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.4039999999999999,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.21,"15min":1.1839999999999999},"min":{"1min":0.93600000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":3.746,"5min":3.746,"15min":3.746},"last":1.409}]},{"osd":5,"last update":"Sat Jun 27 04:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.3169999999999999,"15min":1.2749999999999999},"min":{"1min":0.90300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":4.1189999999999998,"5min":4.1189999999999998,"15min":4.1189999999999998},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.256,"15min":1.2170000000000001},"min":{"1min":1,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":5.0780000000000003,"5min":5.0780000000000003,"15min":5.0780000000000003},"last":1.472}]},{"osd":6,"last update":"Sat Jun 27 04:45:09 2020","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":3.9289999999999998,"5min":3.9289999999999998,"15min":3.9289999999999998},"last":1.5009999999999999}]},{"osd":7,"last update":"Sat Jun 27 04:45:27 2020","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"min":{"1min":1.157,"5min":1.157,"15min":1.157},"max":{"1min":4.1669999999999998,"5min":4.1669999999999998,"15min":4.1669999999999998},"last":1.6299999999999999}]}]},{"osd":3,"up_from":27,"seq":115964117028,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049172,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695980,"statfs":{"total":95995035648,"available":94920683520,"internally_reserved":1073741824,"allocated":602112,"data_stored":232618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 27 04:45:26 2020","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.52200000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.873,"15min":0.85099999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.9989999999999997,"5min":4.9989999999999997,"15min":4.9989999999999997},"last":0.745}]},{"osd":1,"last update":"Sat Jun 27 04:45:26 2020","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.91600000000000004,"15min":0.93200000000000005},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0980000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.622},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.91100000000000003,"15min":0.91300000000000003},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.82399999999999995}]},{"osd":2,"last update":"Sat Jun 27 04:45:26 2020","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.99099999999999999,"15min":0.995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.056},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.91600000000000004,"15min":0.90300000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":4.0739999999999998,"5min":4.0739999999999998,"15min":4.0739999999999998},"last":0.67900000000000005}]},{"osd":4,"last update":"Sat Jun 27 04:45:39 2020","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.169,"15min":1.198},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5109999999999999,"5min":4.4500000000000002,"15min":4.4500000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.115,"15min":1.127},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.88200000000000001}]},{"osd":5,"last update":"Sat Jun 27 04:45:55 2020","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.3,"15min":1.3460000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.456,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.2649999999999999,"15min":1.2809999999999999},"min":{"1min":0.83299999999999996,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.1319999999999999}]},{"osd":6,"last update":"Sat Jun 27 04:45:11 2020","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.256},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":4.9249999999999998,"5min":4.9249999999999998,"15min":4.9249999999999998},"last":0.93700000000000006}]},{"osd":7,"last update":"Sat Jun 27 04:45:24 2020","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":4.5170000000000003,"5min":4.5170000000000003,"15min":4.5170000000000003},"last":1.004}]}]},{"osd":4,"up_from":32,"seq":137438953505,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049212,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695940,"statfs":{"total":95995035648,"available":94920642560,"internally_reserved":1073741824,"allocated":643072,"data_stored":233831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 27 04:45:40 2020","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.97299999999999998,"15min":0.97899999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3660000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.96899999999999997,"15min":0.98899999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.357,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":0.71499999999999997}]},{"osd":1,"last update":"Sat Jun 27 04:45:40 2020","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92000000000000004,"15min":0.91500000000000004},"min":{"1min":0.64300000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.337,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.012,"5min":0.98299999999999998,"15min":0.97799999999999998},"min":{"1min":0.70699999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.77800000000000002}]},{"osd":2,"last update":"Sat Jun 27 04:45:40 2020","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.044,"15min":1.048},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.95599999999999996,"15min":0.96099999999999997},"min":{"1min":0.66300000000000003,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2170000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.069}]},{"osd":3,"last update":"Sat Jun 27 04:45:40 2020","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.95599999999999996,"15min":0.95099999999999996},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.042,"5min":1.008,"15min":1.002},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.0109999999999999}]},{"osd":5,"last update":"Sat Jun 27 04:45:57 2020","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.90700000000000003,"15min":0.88600000000000001},"min":{"1min":0.65300000000000002,"5min":0.627,"15min":0.627},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.024,"15min":1.0049999999999999},"min":{"1min":0.75700000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.508,"5min":1.661,"15min":1.661},"last":1.125}]},{"osd":6,"last update":"Sat Jun 27 04:45:10 2020","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.05}]},{"osd":7,"last update":"Sat Jun 27 04:45:23 2020","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.159},{"interface":"front","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.234}]}]},{"osd":5,"up_from":37,"seq":158913789981,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049176,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695976,"statfs":{"total":95995035648,"available":94920679424,"internally_reserved":1073741824,"allocated":606208,"data_stored":233530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 27 04:45:52 2020","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.92000000000000004,"15min":0.93799999999999994},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2110000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92600000000000005,"15min":0.92100000000000004},"min":{"1min":0.74199999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.96299999999999997}]},{"osd":1,"last update":"Sat Jun 27 04:45:52 2020","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94399999999999995,"15min":0.94299999999999995},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.208,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95999999999999996,"15min":0.96199999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Sat Jun 27 04:45:52 2020","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.71199999999999997,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2949999999999999,"5min":1.371,"15min":1.371},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.121,"5min":0.98999999999999999,"15min":0.96799999999999997},"min":{"1min":0.74399999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.0660000000000001}]},{"osd":3,"last update":"Sat Jun 27 04:45:52 2020","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":0.99199999999999999,"15min":0.96799999999999997},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1200000000000001,"15min":1.1120000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.1519999999999999}]},{"osd":4,"last update":"Sat Jun 27 04:45:52 2020","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.88900000000000001,"15min":0.871},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.131,"5min":0.98599999999999999,"15min":0.96199999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.86199999999999999}]},{"osd":6,"last update":"Sat Jun 27 04:45:10 2020","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.2390000000000001}]},{"osd":7,"last update":"Sat Jun 27 04:45:26 2020","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":1.294},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.3300000000000001}]}]}]}} 2020-06-27T04:46:07.488 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph pg dump --format=json 2020-06-27T04:46:07.633 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:46:08.143 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:08 smithi031 bash[18426]: audit 2020-06-27T04:46:06.973221+0000 mgr.x (mgr.34109) 185 : audit [DBG] from='client.14652 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-06-27T04:46:08.143 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:08 smithi031 bash[18426]: cluster 2020-06-27T04:46:07.155821+0000 mgr.x (mgr.34109) 186 : cluster [DBG] pgmap v162: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:08.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:08 smithi051 bash[18409]: audit 2020-06-27T04:46:06.973221+0000 mgr.x (mgr.34109) 185 : audit [DBG] from='client.14652 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-06-27T04:46:08.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:08 smithi051 bash[18409]: cluster 2020-06-27T04:46:07.155821+0000 mgr.x (mgr.34109) 186 : cluster [DBG] pgmap v162: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:08.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:08 smithi031 bash[22603]: audit 2020-06-27T04:46:06.973221+0000 mgr.x (mgr.34109) 185 : audit [DBG] from='client.14652 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-06-27T04:46:08.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:08 smithi031 bash[22603]: cluster 2020-06-27T04:46:07.155821+0000 mgr.x (mgr.34109) 186 : cluster [DBG] pgmap v162: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:09.222 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.218+0000 7fc5e579d700 1 Processor -- start 2020-06-27T04:46:09.223 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.218+0000 7fc5e579d700 1 -- start start 2020-06-27T04:46:09.223 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.218+0000 7fc5e579d700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc5e0066370 0x7fc5e006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:09.223 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.218+0000 7fc5e579d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5e006be40 0x7fc5e0078370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:09.223 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.218+0000 7fc5e579d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5e00789a0 0x7fc5e0122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:09.224 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.218+0000 7fc5e579d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e01232f0 con 0x7fc5e00789a0 2020-06-27T04:46:09.224 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.218+0000 7fc5e579d700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e0123460 con 0x7fc5e0066370 2020-06-27T04:46:09.224 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.218+0000 7fc5e579d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e0123620 con 0x7fc5e006be40 2020-06-27T04:46:09.224 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.218+0000 7fc5dffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5e00789a0 0x7fc5e0122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:09.224 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.218+0000 7fc5deffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5e006be40 0x7fc5e0078370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:09.225 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.218+0000 7fc5deffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5e006be40 0x7fc5e0078370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:36006/0 (socket says 172.21.15.31:36006) 2020-06-27T04:46:09.225 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.218+0000 7fc5dffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5e00789a0 0x7fc5e0122cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39760/0 (socket says 172.21.15.31:39760) 2020-06-27T04:46:09.225 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.218+0000 7fc5deffd700 1 -- 172.21.15.31:0/183030979 learned_addr learned my addr 172.21.15.31:0/183030979 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:46:09.225 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.219+0000 7fc5df7fe700 1 --2- 172.21.15.31:0/183030979 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc5e0066370 0x7fc5e006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:09.225 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.219+0000 7fc5deffd700 1 -- 172.21.15.31:0/183030979 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc5e0066370 msgr2=0x7fc5e006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:09.226 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.219+0000 7fc5deffd700 1 --2- 172.21.15.31:0/183030979 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc5e0066370 0x7fc5e006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:09.226 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.219+0000 7fc5deffd700 1 -- 172.21.15.31:0/183030979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5e00789a0 msgr2=0x7fc5e0122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:09.226 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.219+0000 7fc5deffd700 1 --2- 172.21.15.31:0/183030979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5e00789a0 0x7fc5e0122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:09.226 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.219+0000 7fc5deffd700 1 -- 172.21.15.31:0/183030979 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e01237e0 con 0x7fc5e006be40 2020-06-27T04:46:09.226 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.219+0000 7fc5dffff700 1 --2- 172.21.15.31:0/183030979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5e00789a0 0x7fc5e0122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:46:09.227 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.219+0000 7fc5deffd700 1 --2- 172.21.15.31:0/183030979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5e006be40 0x7fc5e0078370 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc5c80041c0 tx=0x7fc5c800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:46:09.227 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.219+0000 7fc5d77fe700 1 -- 172.21.15.31:0/183030979 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5c80094d0 con 0x7fc5e006be40 2020-06-27T04:46:09.227 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.219+0000 7fc5d77fe700 1 -- 172.21.15.31:0/183030979 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7fc5c800f040 con 0x7fc5e006be40 2020-06-27T04:46:09.227 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.219+0000 7fc5e579d700 1 -- 172.21.15.31:0/183030979 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e0123a30 con 0x7fc5e006be40 2020-06-27T04:46:09.227 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.219+0000 7fc5d77fe700 1 -- 172.21.15.31:0/183030979 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5c8007c50 con 0x7fc5e006be40 2020-06-27T04:46:09.228 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.219+0000 7fc5e579d700 1 -- 172.21.15.31:0/183030979 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e0123fa0 con 0x7fc5e006be40 2020-06-27T04:46:09.228 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.220+0000 7fc5d77fe700 1 -- 172.21.15.31:0/183030979 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7fc5c8014460 con 0x7fc5e006be40 2020-06-27T04:46:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.220+0000 7fc5d77fe700 1 --2- 172.21.15.31:0/183030979 >> v2:172.21.15.51:6800/950992045 conn(0x7fc5b802ab00 0x7fc5b802cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.220+0000 7fc5d77fe700 1 -- 172.21.15.31:0/183030979 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7fc5c803aec0 con 0x7fc5e006be40 2020-06-27T04:46:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.220+0000 7fc5df7fe700 1 --2- 172.21.15.31:0/183030979 >> v2:172.21.15.51:6800/950992045 conn(0x7fc5b802ab00 0x7fc5b802cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.220+0000 7fc5e579d700 1 -- 172.21.15.31:0/183030979 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e005e210 con 0x7fc5e006be40 2020-06-27T04:46:09.230 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.220+0000 7fc5df7fe700 1 --2- 172.21.15.31:0/183030979 >> v2:172.21.15.51:6800/950992045 conn(0x7fc5b802ab00 0x7fc5b802cfc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fc5d8014000 tx=0x7fc5d8004c30).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:46:09.230 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.224+0000 7fc5d77fe700 1 -- 172.21.15.31:0/183030979 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7fc5c800c8b0 con 0x7fc5e006be40 2020-06-27T04:46:09.374 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.371+0000 7fc5e579d700 1 -- 172.21.15.31:0/183030979 --> v2:172.21.15.51:6800/950992045 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc5e005f390 con 0x7fc5b802ab00 2020-06-27T04:46:09.384 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.381+0000 7fc5d77fe700 1 -- 172.21.15.31:0/183030979 <== mgr.34109 v2:172.21.15.51:6800/950992045 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+338234 (secure 0 0 0) 0x7fc5d8009de0 con 0x7fc5b802ab00 2020-06-27T04:46:09.389 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:46:09.392 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.384+0000 7fc5e579d700 1 -- 172.21.15.31:0/183030979 >> v2:172.21.15.51:6800/950992045 conn(0x7fc5b802ab00 msgr2=0x7fc5b802cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:09.392 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.384+0000 7fc5e579d700 1 --2- 172.21.15.31:0/183030979 >> v2:172.21.15.51:6800/950992045 conn(0x7fc5b802ab00 0x7fc5b802cfc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fc5d8014000 tx=0x7fc5d8004c30).stop 2020-06-27T04:46:09.392 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.384+0000 7fc5e579d700 1 -- 172.21.15.31:0/183030979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5e006be40 msgr2=0x7fc5e0078370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:09.393 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.384+0000 7fc5e579d700 1 --2- 172.21.15.31:0/183030979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5e006be40 0x7fc5e0078370 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc5c80041c0 tx=0x7fc5c800b040).stop 2020-06-27T04:46:09.393 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.384+0000 7fc5e579d700 1 -- 172.21.15.31:0/183030979 shutdown_connections 2020-06-27T04:46:09.393 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.384+0000 7fc5e579d700 1 --2- 172.21.15.31:0/183030979 >> v2:172.21.15.51:6800/950992045 conn(0x7fc5b802ab00 0x7fc5b802cfc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:09.393 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.384+0000 7fc5e579d700 1 --2- 172.21.15.31:0/183030979 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7fc5e0066370 0x7fc5e006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:09.394 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.384+0000 7fc5e579d700 1 --2- 172.21.15.31:0/183030979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5e00789a0 0x7fc5e0122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:09.394 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.384+0000 7fc5e579d700 1 --2- 172.21.15.31:0/183030979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5e006be40 0x7fc5e0078370 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:09.394 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.384+0000 7fc5e579d700 1 -- 172.21.15.31:0/183030979 >> 172.21.15.31:0/183030979 conn(0x7fc5e0061840 msgr2=0x7fc5e006d360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:46:09.394 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.384+0000 7fc5e579d700 1 -- 172.21.15.31:0/183030979 shutdown_connections 2020-06-27T04:46:09.394 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:09.384+0000 7fc5e579d700 1 -- 172.21.15.31:0/183030979 wait complete. 2020-06-27T04:46:09.394 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2020-06-27T04:46:09.893 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2020-06-27T04:46:09.156094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5434,"num_objects":229,"num_object_clones":0,"num_object_copies":687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":1080,"num_read_kb":810,"num_write":623,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":46,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":607,"ondisk_log_size":607,"up":387,"acting":387,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":387,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":8393508,"kb_used_data":4836,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":741567708,"statfs":{"total":767960285184,"available":759365332992,"internally_reserved":8589934592,"allocated":4952064,"data_stored":1867148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004058"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137480+0000","last_change":"2020-06-27T04:44:39.425173+0000","last_active":"2020-06-27T04:45:18.137480+0000","last_peered":"2020-06-27T04:45:18.137480+0000","last_clean":"2020-06-27T04:45:18.137480+0000","last_became_active":"2020-06-27T04:44:39.424677+0000","last_became_peered":"2020-06-27T04:44:39.424677+0000","last_unstale":"2020-06-27T04:45:18.137480+0000","last_undegraded":"2020-06-27T04:45:18.137480+0000","last_fullsized":"2020-06-27T04:45:18.137480+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138672+0000","last_change":"2020-06-27T04:44:37.395300+0000","last_active":"2020-06-27T04:45:18.138672+0000","last_peered":"2020-06-27T04:45:18.138672+0000","last_clean":"2020-06-27T04:45:18.138672+0000","last_became_active":"2020-06-27T04:44:37.394845+0000","last_became_peered":"2020-06-27T04:44:37.394845+0000","last_unstale":"2020-06-27T04:45:18.138672+0000","last_undegraded":"2020-06-27T04:45:18.138672+0000","last_fullsized":"2020-06-27T04:45:18.138672+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"48'1","reported_seq":"26","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153262+0000","last_change":"2020-06-27T04:44:24.281004+0000","last_active":"2020-06-27T04:45:18.153262+0000","last_peered":"2020-06-27T04:45:18.153262+0000","last_clean":"2020-06-27T04:45:18.153262+0000","last_became_active":"2020-06-27T04:44:24.280399+0000","last_became_peered":"2020-06-27T04:44:24.280399+0000","last_unstale":"2020-06-27T04:45:18.153262+0000","last_undegraded":"2020-06-27T04:45:18.153262+0000","last_fullsized":"2020-06-27T04:45:18.153262+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":247,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"57'16","reported_seq":"46","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.141050+0000","last_change":"2020-06-27T04:44:35.840413+0000","last_active":"2020-06-27T04:45:18.141050+0000","last_peered":"2020-06-27T04:45:18.141050+0000","last_clean":"2020-06-27T04:45:18.141050+0000","last_became_active":"2020-06-27T04:44:35.839966+0000","last_became_peered":"2020-06-27T04:44:35.839966+0000","last_unstale":"2020-06-27T04:45:18.141050+0000","last_undegraded":"2020-06-27T04:45:18.141050+0000","last_fullsized":"2020-06-27T04:45:18.141050+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137896+0000","last_change":"2020-06-27T04:44:39.409977+0000","last_active":"2020-06-27T04:45:18.137896+0000","last_peered":"2020-06-27T04:45:18.137896+0000","last_clean":"2020-06-27T04:45:18.137896+0000","last_became_active":"2020-06-27T04:44:39.409541+0000","last_became_peered":"2020-06-27T04:44:39.409541+0000","last_unstale":"2020-06-27T04:45:18.137896+0000","last_undegraded":"2020-06-27T04:45:18.137896+0000","last_fullsized":"2020-06-27T04:45:18.137896+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138332+0000","last_change":"2020-06-27T04:44:37.398345+0000","last_active":"2020-06-27T04:45:18.138332+0000","last_peered":"2020-06-27T04:45:18.138332+0000","last_clean":"2020-06-27T04:45:18.138332+0000","last_became_active":"2020-06-27T04:44:37.397877+0000","last_became_peered":"2020-06-27T04:44:37.397877+0000","last_unstale":"2020-06-27T04:45:18.138332+0000","last_undegraded":"2020-06-27T04:45:18.138332+0000","last_fullsized":"2020-06-27T04:45:18.138332+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":"21","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.141157+0000","last_change":"2020-06-27T04:44:22.268675+0000","last_active":"2020-06-27T04:45:18.141157+0000","last_peered":"2020-06-27T04:45:18.141157+0000","last_clean":"2020-06-27T04:45:18.141157+0000","last_became_active":"2020-06-27T04:44:22.268070+0000","last_became_peered":"2020-06-27T04:44:22.268070+0000","last_unstale":"2020-06-27T04:45:18.141157+0000","last_undegraded":"2020-06-27T04:45:18.141157+0000","last_fullsized":"2020-06-27T04:45:18.141157+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"57'17","reported_seq":"50","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153263+0000","last_change":"2020-06-27T04:44:35.843244+0000","last_active":"2020-06-27T04:45:18.153263+0000","last_peered":"2020-06-27T04:45:18.153263+0000","last_clean":"2020-06-27T04:45:18.153263+0000","last_became_active":"2020-06-27T04:44:35.842717+0000","last_became_peered":"2020-06-27T04:44:35.842717+0000","last_unstale":"2020-06-27T04:45:18.153263+0000","last_undegraded":"2020-06-27T04:45:18.153263+0000","last_fullsized":"2020-06-27T04:45:18.153263+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133535+0000","last_change":"2020-06-27T04:44:39.427751+0000","last_active":"2020-06-27T04:45:18.133535+0000","last_peered":"2020-06-27T04:45:18.133535+0000","last_clean":"2020-06-27T04:45:18.133535+0000","last_became_active":"2020-06-27T04:44:39.427330+0000","last_became_peered":"2020-06-27T04:44:39.427330+0000","last_unstale":"2020-06-27T04:45:18.133535+0000","last_undegraded":"2020-06-27T04:45:18.133535+0000","last_fullsized":"2020-06-27T04:45:18.133535+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:19.142224+0000","last_change":"2020-06-27T04:45:19.142224+0000","last_active":"2020-06-27T04:45:19.142224+0000","last_peered":"2020-06-27T04:45:19.142224+0000","last_clean":"2020-06-27T04:45:19.142224+0000","last_became_active":"2020-06-27T04:45:19.141570+0000","last_became_peered":"2020-06-27T04:45:19.141570+0000","last_unstale":"2020-06-27T04:45:19.142224+0000","last_undegraded":"2020-06-27T04:45:19.142224+0000","last_fullsized":"2020-06-27T04:45:19.142224+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":"19","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.134126+0000","last_change":"2020-06-27T04:44:24.285272+0000","last_active":"2020-06-27T04:45:18.134126+0000","last_peered":"2020-06-27T04:45:18.134126+0000","last_clean":"2020-06-27T04:45:18.134126+0000","last_became_active":"2020-06-27T04:44:24.284718+0000","last_became_peered":"2020-06-27T04:44:24.284718+0000","last_unstale":"2020-06-27T04:45:18.134126+0000","last_undegraded":"2020-06-27T04:45:18.134126+0000","last_fullsized":"2020-06-27T04:45:18.134126+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"57'15","reported_seq":"41","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137019+0000","last_change":"2020-06-27T04:44:35.402583+0000","last_active":"2020-06-27T04:45:18.137019+0000","last_peered":"2020-06-27T04:45:18.137019+0000","last_clean":"2020-06-27T04:45:18.137019+0000","last_became_active":"2020-06-27T04:44:35.402171+0000","last_became_peered":"2020-06-27T04:44:35.402171+0000","last_unstale":"2020-06-27T04:45:18.137019+0000","last_undegraded":"2020-06-27T04:45:18.137019+0000","last_fullsized":"2020-06-27T04:45:18.137019+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136624+0000","last_change":"2020-06-27T04:44:39.419949+0000","last_active":"2020-06-27T04:45:18.136624+0000","last_peered":"2020-06-27T04:45:18.136624+0000","last_clean":"2020-06-27T04:45:18.136624+0000","last_became_active":"2020-06-27T04:44:39.419456+0000","last_became_peered":"2020-06-27T04:44:39.419456+0000","last_unstale":"2020-06-27T04:45:18.136624+0000","last_undegraded":"2020-06-27T04:45:18.136624+0000","last_fullsized":"2020-06-27T04:45:18.136624+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.139123+0000","last_change":"2020-06-27T04:44:37.394278+0000","last_active":"2020-06-27T04:45:18.139123+0000","last_peered":"2020-06-27T04:45:18.139123+0000","last_clean":"2020-06-27T04:45:18.139123+0000","last_became_active":"2020-06-27T04:44:37.393894+0000","last_became_peered":"2020-06-27T04:44:37.393894+0000","last_unstale":"2020-06-27T04:45:18.139123+0000","last_undegraded":"2020-06-27T04:45:18.139123+0000","last_fullsized":"2020-06-27T04:45:18.139123+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"49'1","reported_seq":"22","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133652+0000","last_change":"2020-06-27T04:44:24.281930+0000","last_active":"2020-06-27T04:45:18.133652+0000","last_peered":"2020-06-27T04:45:18.133652+0000","last_clean":"2020-06-27T04:45:18.133652+0000","last_became_active":"2020-06-27T04:44:24.280134+0000","last_became_peered":"2020-06-27T04:44:24.280134+0000","last_unstale":"2020-06-27T04:45:18.133652+0000","last_undegraded":"2020-06-27T04:45:18.133652+0000","last_fullsized":"2020-06-27T04:45:18.133652+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":815,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"57'12","reported_seq":"39","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137802+0000","last_change":"2020-06-27T04:44:35.402939+0000","last_active":"2020-06-27T04:45:18.137802+0000","last_peered":"2020-06-27T04:45:18.137802+0000","last_clean":"2020-06-27T04:45:18.137802+0000","last_became_active":"2020-06-27T04:44:35.402507+0000","last_became_peered":"2020-06-27T04:44:35.402507+0000","last_unstale":"2020-06-27T04:45:18.137802+0000","last_undegraded":"2020-06-27T04:45:18.137802+0000","last_fullsized":"2020-06-27T04:45:18.137802+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138691+0000","last_change":"2020-06-27T04:44:39.427020+0000","last_active":"2020-06-27T04:45:18.138691+0000","last_peered":"2020-06-27T04:45:18.138691+0000","last_clean":"2020-06-27T04:45:18.138691+0000","last_became_active":"2020-06-27T04:44:39.426429+0000","last_became_peered":"2020-06-27T04:44:39.426429+0000","last_unstale":"2020-06-27T04:45:18.138691+0000","last_undegraded":"2020-06-27T04:45:18.138691+0000","last_fullsized":"2020-06-27T04:45:18.138691+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140774+0000","last_change":"2020-06-27T04:44:37.406752+0000","last_active":"2020-06-27T04:45:18.140774+0000","last_peered":"2020-06-27T04:45:18.140774+0000","last_clean":"2020-06-27T04:45:18.140774+0000","last_became_active":"2020-06-27T04:44:37.404812+0000","last_became_peered":"2020-06-27T04:44:37.404812+0000","last_unstale":"2020-06-27T04:45:18.140774+0000","last_undegraded":"2020-06-27T04:45:18.140774+0000","last_fullsized":"2020-06-27T04:45:18.140774+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"30","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140686+0000","last_change":"2020-06-27T04:44:24.274055+0000","last_active":"2020-06-27T04:45:18.140686+0000","last_peered":"2020-06-27T04:45:18.140686+0000","last_clean":"2020-06-27T04:45:18.140686+0000","last_became_active":"2020-06-27T04:44:24.273515+0000","last_became_peered":"2020-06-27T04:44:24.273515+0000","last_unstale":"2020-06-27T04:45:18.140686+0000","last_undegraded":"2020-06-27T04:45:18.140686+0000","last_fullsized":"2020-06-27T04:45:18.140686+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"57'21","reported_seq":"63","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138836+0000","last_change":"2020-06-27T04:44:35.840316+0000","last_active":"2020-06-27T04:45:18.138836+0000","last_peered":"2020-06-27T04:45:18.138836+0000","last_clean":"2020-06-27T04:45:18.138836+0000","last_became_active":"2020-06-27T04:44:35.839925+0000","last_became_peered":"2020-06-27T04:44:35.839925+0000","last_unstale":"2020-06-27T04:45:18.138836+0000","last_undegraded":"2020-06-27T04:45:18.138836+0000","last_fullsized":"2020-06-27T04:45:18.138836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137067+0000","last_change":"2020-06-27T04:44:39.420275+0000","last_active":"2020-06-27T04:45:18.137067+0000","last_peered":"2020-06-27T04:45:18.137067+0000","last_clean":"2020-06-27T04:45:18.137067+0000","last_became_active":"2020-06-27T04:44:39.419841+0000","last_became_peered":"2020-06-27T04:44:39.419841+0000","last_unstale":"2020-06-27T04:45:18.137067+0000","last_undegraded":"2020-06-27T04:45:18.137067+0000","last_fullsized":"2020-06-27T04:45:18.137067+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136357+0000","last_change":"2020-06-27T04:44:37.403587+0000","last_active":"2020-06-27T04:45:18.136357+0000","last_peered":"2020-06-27T04:45:18.136357+0000","last_clean":"2020-06-27T04:45:18.136357+0000","last_became_active":"2020-06-27T04:44:37.403112+0000","last_became_peered":"2020-06-27T04:44:37.403112+0000","last_unstale":"2020-06-27T04:45:18.136357+0000","last_undegraded":"2020-06-27T04:45:18.136357+0000","last_fullsized":"2020-06-27T04:45:18.136357+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"49'2","reported_seq":"25","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152961+0000","last_change":"2020-06-27T04:44:24.280993+0000","last_active":"2020-06-27T04:45:18.152961+0000","last_peered":"2020-06-27T04:45:18.152961+0000","last_clean":"2020-06-27T04:45:18.152961+0000","last_became_active":"2020-06-27T04:44:24.280517+0000","last_became_peered":"2020-06-27T04:44:24.280517+0000","last_unstale":"2020-06-27T04:45:18.152961+0000","last_undegraded":"2020-06-27T04:45:18.152961+0000","last_fullsized":"2020-06-27T04:45:18.152961+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"57'11","reported_seq":"41","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152699+0000","last_change":"2020-06-27T04:44:35.386900+0000","last_active":"2020-06-27T04:45:18.152699+0000","last_peered":"2020-06-27T04:45:18.152699+0000","last_clean":"2020-06-27T04:45:18.152699+0000","last_became_active":"2020-06-27T04:44:35.386365+0000","last_became_peered":"2020-06-27T04:44:35.386365+0000","last_unstale":"2020-06-27T04:45:18.152699+0000","last_undegraded":"2020-06-27T04:45:18.152699+0000","last_fullsized":"2020-06-27T04:45:18.152699+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":18,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153221+0000","last_change":"2020-06-27T04:44:39.417036+0000","last_active":"2020-06-27T04:45:18.153221+0000","last_peered":"2020-06-27T04:45:18.153221+0000","last_clean":"2020-06-27T04:45:18.153221+0000","last_became_active":"2020-06-27T04:44:39.416478+0000","last_became_peered":"2020-06-27T04:44:39.416478+0000","last_unstale":"2020-06-27T04:45:18.153221+0000","last_undegraded":"2020-06-27T04:45:18.153221+0000","last_fullsized":"2020-06-27T04:45:18.153221+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"53'2","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:58.724204+0000","last_change":"2020-06-27T04:44:37.401523+0000","last_active":"2020-06-27T04:45:58.724204+0000","last_peered":"2020-06-27T04:45:58.724204+0000","last_clean":"2020-06-27T04:45:58.724204+0000","last_became_active":"2020-06-27T04:44:37.400527+0000","last_became_peered":"2020-06-27T04:44:37.400527+0000","last_unstale":"2020-06-27T04:45:58.724204+0000","last_undegraded":"2020-06-27T04:45:58.724204+0000","last_fullsized":"2020-06-27T04:45:58.724204+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"21","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138774+0000","last_change":"2020-06-27T04:44:22.272053+0000","last_active":"2020-06-27T04:45:18.138774+0000","last_peered":"2020-06-27T04:45:18.138774+0000","last_clean":"2020-06-27T04:45:18.138774+0000","last_became_active":"2020-06-27T04:44:22.270158+0000","last_became_peered":"2020-06-27T04:44:22.270158+0000","last_unstale":"2020-06-27T04:45:18.138774+0000","last_undegraded":"2020-06-27T04:45:18.138774+0000","last_fullsized":"2020-06-27T04:45:18.138774+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"57'15","reported_seq":"47","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138638+0000","last_change":"2020-06-27T04:44:35.389694+0000","last_active":"2020-06-27T04:45:18.138638+0000","last_peered":"2020-06-27T04:45:18.138638+0000","last_clean":"2020-06-27T04:45:18.138638+0000","last_became_active":"2020-06-27T04:44:35.388870+0000","last_became_peered":"2020-06-27T04:44:35.388870+0000","last_unstale":"2020-06-27T04:45:18.138638+0000","last_undegraded":"2020-06-27T04:45:18.138638+0000","last_fullsized":"2020-06-27T04:45:18.138638+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":22,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153722+0000","last_change":"2020-06-27T04:44:39.413763+0000","last_active":"2020-06-27T04:45:18.153722+0000","last_peered":"2020-06-27T04:45:18.153722+0000","last_clean":"2020-06-27T04:45:18.153722+0000","last_became_active":"2020-06-27T04:44:39.413329+0000","last_became_peered":"2020-06-27T04:44:39.413329+0000","last_unstale":"2020-06-27T04:45:18.153722+0000","last_undegraded":"2020-06-27T04:45:18.153722+0000","last_fullsized":"2020-06-27T04:45:18.153722+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153022+0000","last_change":"2020-06-27T04:44:37.443657+0000","last_active":"2020-06-27T04:45:18.153022+0000","last_peered":"2020-06-27T04:45:18.153022+0000","last_clean":"2020-06-27T04:45:18.153022+0000","last_became_active":"2020-06-27T04:44:37.443163+0000","last_became_peered":"2020-06-27T04:44:37.443163+0000","last_unstale":"2020-06-27T04:45:18.153022+0000","last_undegraded":"2020-06-27T04:45:18.153022+0000","last_fullsized":"2020-06-27T04:45:18.153022+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"30","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136192+0000","last_change":"2020-06-27T04:44:24.288100+0000","last_active":"2020-06-27T04:45:18.136192+0000","last_peered":"2020-06-27T04:45:18.136192+0000","last_clean":"2020-06-27T04:45:18.136192+0000","last_became_active":"2020-06-27T04:44:24.287581+0000","last_became_peered":"2020-06-27T04:44:24.287581+0000","last_unstale":"2020-06-27T04:45:18.136192+0000","last_undegraded":"2020-06-27T04:45:18.136192+0000","last_fullsized":"2020-06-27T04:45:18.136192+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"57'39","reported_seq":"102","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138667+0000","last_change":"2020-06-27T04:44:35.384882+0000","last_active":"2020-06-27T04:45:18.138667+0000","last_peered":"2020-06-27T04:45:18.138667+0000","last_clean":"2020-06-27T04:45:18.138667+0000","last_became_active":"2020-06-27T04:44:35.384313+0000","last_became_peered":"2020-06-27T04:44:35.384313+0000","last_unstale":"2020-06-27T04:45:18.138667+0000","last_undegraded":"2020-06-27T04:45:18.138667+0000","last_fullsized":"2020-06-27T04:45:18.138667+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.134246+0000","last_change":"2020-06-27T04:44:39.422012+0000","last_active":"2020-06-27T04:45:18.134246+0000","last_peered":"2020-06-27T04:45:18.134246+0000","last_clean":"2020-06-27T04:45:18.134246+0000","last_became_active":"2020-06-27T04:44:39.421552+0000","last_became_peered":"2020-06-27T04:44:39.421552+0000","last_unstale":"2020-06-27T04:45:18.134246+0000","last_undegraded":"2020-06-27T04:45:18.134246+0000","last_fullsized":"2020-06-27T04:45:18.134246+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.139838+0000","last_change":"2020-06-27T04:44:37.446490+0000","last_active":"2020-06-27T04:45:18.139838+0000","last_peered":"2020-06-27T04:45:18.139838+0000","last_clean":"2020-06-27T04:45:18.139838+0000","last_became_active":"2020-06-27T04:44:37.445958+0000","last_became_peered":"2020-06-27T04:44:37.445958+0000","last_unstale":"2020-06-27T04:45:18.139838+0000","last_undegraded":"2020-06-27T04:45:18.139838+0000","last_fullsized":"2020-06-27T04:45:18.139838+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"48'1","reported_seq":"24","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153652+0000","last_change":"2020-06-27T04:44:23.271918+0000","last_active":"2020-06-27T04:45:18.153652+0000","last_peered":"2020-06-27T04:45:18.153652+0000","last_clean":"2020-06-27T04:45:18.153652+0000","last_became_active":"2020-06-27T04:44:23.271384+0000","last_became_peered":"2020-06-27T04:44:23.271384+0000","last_unstale":"2020-06-27T04:45:18.153652+0000","last_undegraded":"2020-06-27T04:45:18.153652+0000","last_fullsized":"2020-06-27T04:45:18.153652+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"57'21","reported_seq":"62","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137128+0000","last_change":"2020-06-27T04:44:35.399723+0000","last_active":"2020-06-27T04:45:18.137128+0000","last_peered":"2020-06-27T04:45:18.137128+0000","last_clean":"2020-06-27T04:45:18.137128+0000","last_became_active":"2020-06-27T04:44:35.399347+0000","last_became_peered":"2020-06-27T04:44:35.399347+0000","last_unstale":"2020-06-27T04:45:18.137128+0000","last_undegraded":"2020-06-27T04:45:18.137128+0000","last_fullsized":"2020-06-27T04:45:18.137128+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152938+0000","last_change":"2020-06-27T04:44:39.419907+0000","last_active":"2020-06-27T04:45:18.152938+0000","last_peered":"2020-06-27T04:45:18.152938+0000","last_clean":"2020-06-27T04:45:18.152938+0000","last_became_active":"2020-06-27T04:44:39.419454+0000","last_became_peered":"2020-06-27T04:44:39.419454+0000","last_unstale":"2020-06-27T04:45:18.152938+0000","last_undegraded":"2020-06-27T04:45:18.152938+0000","last_fullsized":"2020-06-27T04:45:18.152938+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138551+0000","last_change":"2020-06-27T04:44:37.403584+0000","last_active":"2020-06-27T04:45:18.138551+0000","last_peered":"2020-06-27T04:45:18.138551+0000","last_clean":"2020-06-27T04:45:18.138551+0000","last_became_active":"2020-06-27T04:44:37.403112+0000","last_became_peered":"2020-06-27T04:44:37.403112+0000","last_unstale":"2020-06-27T04:45:18.138551+0000","last_undegraded":"2020-06-27T04:45:18.138551+0000","last_fullsized":"2020-06-27T04:45:18.138551+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"21","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136995+0000","last_change":"2020-06-27T04:44:22.270942+0000","last_active":"2020-06-27T04:45:18.136995+0000","last_peered":"2020-06-27T04:45:18.136995+0000","last_clean":"2020-06-27T04:45:18.136995+0000","last_became_active":"2020-06-27T04:44:22.270529+0000","last_became_peered":"2020-06-27T04:44:22.270529+0000","last_unstale":"2020-06-27T04:45:18.136995+0000","last_undegraded":"2020-06-27T04:45:18.136995+0000","last_fullsized":"2020-06-27T04:45:18.136995+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"57'12","reported_seq":"40","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153169+0000","last_change":"2020-06-27T04:44:35.393098+0000","last_active":"2020-06-27T04:45:18.153169+0000","last_peered":"2020-06-27T04:45:18.153169+0000","last_clean":"2020-06-27T04:45:18.153169+0000","last_became_active":"2020-06-27T04:44:35.392678+0000","last_became_peered":"2020-06-27T04:44:35.392678+0000","last_unstale":"2020-06-27T04:45:18.153169+0000","last_undegraded":"2020-06-27T04:45:18.153169+0000","last_fullsized":"2020-06-27T04:45:18.153169+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140190+0000","last_change":"2020-06-27T04:44:39.423674+0000","last_active":"2020-06-27T04:45:18.140190+0000","last_peered":"2020-06-27T04:45:18.140190+0000","last_clean":"2020-06-27T04:45:18.140190+0000","last_became_active":"2020-06-27T04:44:39.423266+0000","last_became_peered":"2020-06-27T04:44:39.423266+0000","last_unstale":"2020-06-27T04:45:18.140190+0000","last_undegraded":"2020-06-27T04:45:18.140190+0000","last_fullsized":"2020-06-27T04:45:18.140190+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.139964+0000","last_change":"2020-06-27T04:44:37.399474+0000","last_active":"2020-06-27T04:45:18.139964+0000","last_peered":"2020-06-27T04:45:18.139964+0000","last_clean":"2020-06-27T04:45:18.139964+0000","last_became_active":"2020-06-27T04:44:37.399083+0000","last_became_peered":"2020-06-27T04:44:37.399083+0000","last_unstale":"2020-06-27T04:45:18.139964+0000","last_undegraded":"2020-06-27T04:45:18.139964+0000","last_fullsized":"2020-06-27T04:45:18.139964+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"49'2","reported_seq":"27","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136665+0000","last_change":"2020-06-27T04:44:22.275137+0000","last_active":"2020-06-27T04:45:18.136665+0000","last_peered":"2020-06-27T04:45:18.136665+0000","last_clean":"2020-06-27T04:45:18.136665+0000","last_became_active":"2020-06-27T04:44:22.274652+0000","last_became_peered":"2020-06-27T04:44:22.274652+0000","last_unstale":"2020-06-27T04:45:18.136665+0000","last_undegraded":"2020-06-27T04:45:18.136665+0000","last_fullsized":"2020-06-27T04:45:18.136665+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":391,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"57'22","reported_seq":"62","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.141760+0000","last_change":"2020-06-27T04:44:35.400737+0000","last_active":"2020-06-27T04:45:18.141760+0000","last_peered":"2020-06-27T04:45:18.141760+0000","last_clean":"2020-06-27T04:45:18.141760+0000","last_became_active":"2020-06-27T04:44:35.400211+0000","last_became_peered":"2020-06-27T04:44:35.400211+0000","last_unstale":"2020-06-27T04:45:18.141760+0000","last_undegraded":"2020-06-27T04:45:18.141760+0000","last_fullsized":"2020-06-27T04:45:18.141760+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":32,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.139846+0000","last_change":"2020-06-27T04:44:39.432167+0000","last_active":"2020-06-27T04:45:18.139846+0000","last_peered":"2020-06-27T04:45:18.139846+0000","last_clean":"2020-06-27T04:45:18.139846+0000","last_became_active":"2020-06-27T04:44:39.431664+0000","last_became_peered":"2020-06-27T04:44:39.431664+0000","last_unstale":"2020-06-27T04:45:18.139846+0000","last_undegraded":"2020-06-27T04:45:18.139846+0000","last_fullsized":"2020-06-27T04:45:18.139846+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.139421+0000","last_change":"2020-06-27T04:44:37.408211+0000","last_active":"2020-06-27T04:45:18.139421+0000","last_peered":"2020-06-27T04:45:18.139421+0000","last_clean":"2020-06-27T04:45:18.139421+0000","last_became_active":"2020-06-27T04:44:37.407741+0000","last_became_peered":"2020-06-27T04:44:37.407741+0000","last_unstale":"2020-06-27T04:45:18.139421+0000","last_undegraded":"2020-06-27T04:45:18.139421+0000","last_fullsized":"2020-06-27T04:45:18.139421+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"48'1","reported_seq":"22","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153435+0000","last_change":"2020-06-27T04:44:22.272729+0000","last_active":"2020-06-27T04:45:18.153435+0000","last_peered":"2020-06-27T04:45:18.153435+0000","last_clean":"2020-06-27T04:45:18.153435+0000","last_became_active":"2020-06-27T04:44:22.271994+0000","last_became_peered":"2020-06-27T04:44:22.271994+0000","last_unstale":"2020-06-27T04:45:18.153435+0000","last_undegraded":"2020-06-27T04:45:18.153435+0000","last_fullsized":"2020-06-27T04:45:18.153435+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"57'15","reported_seq":"47","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.134377+0000","last_change":"2020-06-27T04:44:35.385618+0000","last_active":"2020-06-27T04:45:18.134377+0000","last_peered":"2020-06-27T04:45:18.134377+0000","last_clean":"2020-06-27T04:45:18.134377+0000","last_became_active":"2020-06-27T04:44:35.385276+0000","last_became_peered":"2020-06-27T04:44:35.385276+0000","last_unstale":"2020-06-27T04:45:18.134377+0000","last_undegraded":"2020-06-27T04:45:18.134377+0000","last_fullsized":"2020-06-27T04:45:18.134377+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":22,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140851+0000","last_change":"2020-06-27T04:44:39.432292+0000","last_active":"2020-06-27T04:45:18.140851+0000","last_peered":"2020-06-27T04:45:18.140851+0000","last_clean":"2020-06-27T04:45:18.140851+0000","last_became_active":"2020-06-27T04:44:39.431203+0000","last_became_peered":"2020-06-27T04:44:39.431203+0000","last_unstale":"2020-06-27T04:45:18.140851+0000","last_undegraded":"2020-06-27T04:45:18.140851+0000","last_fullsized":"2020-06-27T04:45:18.140851+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"53'2","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:58.724628+0000","last_change":"2020-06-27T04:44:37.443931+0000","last_active":"2020-06-27T04:45:58.724628+0000","last_peered":"2020-06-27T04:45:58.724628+0000","last_clean":"2020-06-27T04:45:58.724628+0000","last_became_active":"2020-06-27T04:44:37.443506+0000","last_became_peered":"2020-06-27T04:44:37.443506+0000","last_unstale":"2020-06-27T04:45:58.724628+0000","last_undegraded":"2020-06-27T04:45:58.724628+0000","last_fullsized":"2020-06-27T04:45:58.724628+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":"21","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152588+0000","last_change":"2020-06-27T04:44:22.265700+0000","last_active":"2020-06-27T04:45:18.152588+0000","last_peered":"2020-06-27T04:45:18.152588+0000","last_clean":"2020-06-27T04:45:18.152588+0000","last_became_active":"2020-06-27T04:44:22.264166+0000","last_became_peered":"2020-06-27T04:44:22.264166+0000","last_unstale":"2020-06-27T04:45:18.152588+0000","last_undegraded":"2020-06-27T04:45:18.152588+0000","last_fullsized":"2020-06-27T04:45:18.152588+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"57'9","reported_seq":"32","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152279+0000","last_change":"2020-06-27T04:44:35.388595+0000","last_active":"2020-06-27T04:45:18.152279+0000","last_peered":"2020-06-27T04:45:18.152279+0000","last_clean":"2020-06-27T04:45:18.152279+0000","last_became_active":"2020-06-27T04:44:35.387403+0000","last_became_peered":"2020-06-27T04:44:35.387403+0000","last_unstale":"2020-06-27T04:45:18.152279+0000","last_undegraded":"2020-06-27T04:45:18.152279+0000","last_fullsized":"2020-06-27T04:45:18.152279+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137965+0000","last_change":"2020-06-27T04:44:39.419900+0000","last_active":"2020-06-27T04:45:18.137965+0000","last_peered":"2020-06-27T04:45:18.137965+0000","last_clean":"2020-06-27T04:45:18.137965+0000","last_became_active":"2020-06-27T04:44:39.419298+0000","last_became_peered":"2020-06-27T04:44:39.419298+0000","last_unstale":"2020-06-27T04:45:18.137965+0000","last_undegraded":"2020-06-27T04:45:18.137965+0000","last_fullsized":"2020-06-27T04:45:18.137965+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"59'3","reported_seq":"48","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:58.724066+0000","last_change":"2020-06-27T04:45:19.147164+0000","last_active":"2020-06-27T04:45:58.724066+0000","last_peered":"2020-06-27T04:45:58.724066+0000","last_clean":"2020-06-27T04:45:58.724066+0000","last_became_active":"2020-06-27T04:45:19.141877+0000","last_became_peered":"2020-06-27T04:45:19.141877+0000","last_unstale":"2020-06-27T04:45:58.724066+0000","last_undegraded":"2020-06-27T04:45:58.724066+0000","last_fullsized":"2020-06-27T04:45:58.724066+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"48'2","reported_seq":"39","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:19.148254+0000","last_change":"2020-06-27T04:45:19.148254+0000","last_active":"2020-06-27T04:45:19.148254+0000","last_peered":"2020-06-27T04:45:19.148254+0000","last_clean":"2020-06-27T04:45:19.148254+0000","last_became_active":"2020-06-27T04:45:19.139903+0000","last_became_peered":"2020-06-27T04:45:19.139903+0000","last_unstale":"2020-06-27T04:45:19.148254+0000","last_undegraded":"2020-06-27T04:45:19.148254+0000","last_fullsized":"2020-06-27T04:45:19.148254+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"57'11","reported_seq":"35","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133852+0000","last_change":"2020-06-27T04:44:35.840568+0000","last_active":"2020-06-27T04:45:18.133852+0000","last_peered":"2020-06-27T04:45:18.133852+0000","last_clean":"2020-06-27T04:45:18.133852+0000","last_became_active":"2020-06-27T04:44:35.840155+0000","last_became_peered":"2020-06-27T04:44:35.840155+0000","last_unstale":"2020-06-27T04:45:18.133852+0000","last_undegraded":"2020-06-27T04:45:18.133852+0000","last_fullsized":"2020-06-27T04:45:18.133852+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136854+0000","last_change":"2020-06-27T04:44:39.428338+0000","last_active":"2020-06-27T04:45:18.136854+0000","last_peered":"2020-06-27T04:45:18.136854+0000","last_clean":"2020-06-27T04:45:18.136854+0000","last_became_active":"2020-06-27T04:44:39.427932+0000","last_became_peered":"2020-06-27T04:44:39.427932+0000","last_unstale":"2020-06-27T04:45:18.136854+0000","last_undegraded":"2020-06-27T04:45:18.136854+0000","last_fullsized":"2020-06-27T04:45:18.136854+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140865+0000","last_change":"2020-06-27T04:44:37.443727+0000","last_active":"2020-06-27T04:45:18.140865+0000","last_peered":"2020-06-27T04:45:18.140865+0000","last_clean":"2020-06-27T04:45:18.140865+0000","last_became_active":"2020-06-27T04:44:37.443200+0000","last_became_peered":"2020-06-27T04:44:37.443200+0000","last_unstale":"2020-06-27T04:45:18.140865+0000","last_undegraded":"2020-06-27T04:45:18.140865+0000","last_fullsized":"2020-06-27T04:45:18.140865+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"49'1","reported_seq":"23","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153015+0000","last_change":"2020-06-27T04:44:22.270387+0000","last_active":"2020-06-27T04:45:18.153015+0000","last_peered":"2020-06-27T04:45:18.153015+0000","last_clean":"2020-06-27T04:45:18.153015+0000","last_became_active":"2020-06-27T04:44:22.269844+0000","last_became_peered":"2020-06-27T04:44:22.269844+0000","last_unstale":"2020-06-27T04:45:18.153015+0000","last_undegraded":"2020-06-27T04:45:18.153015+0000","last_fullsized":"2020-06-27T04:45:18.153015+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"57'4","reported_seq":"22","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152824+0000","last_change":"2020-06-27T04:44:35.395038+0000","last_active":"2020-06-27T04:45:18.152824+0000","last_peered":"2020-06-27T04:45:18.152824+0000","last_clean":"2020-06-27T04:45:18.152824+0000","last_became_active":"2020-06-27T04:44:35.394618+0000","last_became_peered":"2020-06-27T04:44:35.394618+0000","last_unstale":"2020-06-27T04:45:18.152824+0000","last_undegraded":"2020-06-27T04:45:18.152824+0000","last_fullsized":"2020-06-27T04:45:18.152824+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140987+0000","last_change":"2020-06-27T04:44:39.429769+0000","last_active":"2020-06-27T04:45:18.140987+0000","last_peered":"2020-06-27T04:45:18.140987+0000","last_clean":"2020-06-27T04:45:18.140987+0000","last_became_active":"2020-06-27T04:44:39.429316+0000","last_became_peered":"2020-06-27T04:44:39.429316+0000","last_unstale":"2020-06-27T04:45:18.140987+0000","last_undegraded":"2020-06-27T04:45:18.140987+0000","last_fullsized":"2020-06-27T04:45:18.140987+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153233+0000","last_change":"2020-06-27T04:44:37.444777+0000","last_active":"2020-06-27T04:45:18.153233+0000","last_peered":"2020-06-27T04:45:18.153233+0000","last_clean":"2020-06-27T04:45:18.153233+0000","last_became_active":"2020-06-27T04:44:37.444359+0000","last_became_peered":"2020-06-27T04:44:37.444359+0000","last_unstale":"2020-06-27T04:45:18.153233+0000","last_undegraded":"2020-06-27T04:45:18.153233+0000","last_fullsized":"2020-06-27T04:45:18.153233+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"22","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.135321+0000","last_change":"2020-06-27T04:44:22.275538+0000","last_active":"2020-06-27T04:45:18.135321+0000","last_peered":"2020-06-27T04:45:18.135321+0000","last_clean":"2020-06-27T04:45:18.135321+0000","last_became_active":"2020-06-27T04:44:22.275099+0000","last_became_peered":"2020-06-27T04:44:22.275099+0000","last_unstale":"2020-06-27T04:45:18.135321+0000","last_undegraded":"2020-06-27T04:45:18.135321+0000","last_fullsized":"2020-06-27T04:45:18.135321+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"57'17","reported_seq":"50","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133295+0000","last_change":"2020-06-27T04:44:35.394374+0000","last_active":"2020-06-27T04:45:18.133295+0000","last_peered":"2020-06-27T04:45:18.133295+0000","last_clean":"2020-06-27T04:45:18.133295+0000","last_became_active":"2020-06-27T04:44:35.394031+0000","last_became_peered":"2020-06-27T04:44:35.394031+0000","last_unstale":"2020-06-27T04:45:18.133295+0000","last_undegraded":"2020-06-27T04:45:18.133295+0000","last_fullsized":"2020-06-27T04:45:18.133295+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.135321+0000","last_change":"2020-06-27T04:44:39.415729+0000","last_active":"2020-06-27T04:45:18.135321+0000","last_peered":"2020-06-27T04:45:18.135321+0000","last_clean":"2020-06-27T04:45:18.135321+0000","last_became_active":"2020-06-27T04:44:39.415243+0000","last_became_peered":"2020-06-27T04:44:39.415243+0000","last_unstale":"2020-06-27T04:45:18.135321+0000","last_undegraded":"2020-06-27T04:45:18.135321+0000","last_fullsized":"2020-06-27T04:45:18.135321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"49'1","reported_seq":"34","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.142256+0000","last_change":"2020-06-27T04:44:24.274049+0000","last_active":"2020-06-27T04:45:18.142256+0000","last_peered":"2020-06-27T04:45:18.142256+0000","last_clean":"2020-06-27T04:45:18.142256+0000","last_became_active":"2020-06-27T04:44:24.273494+0000","last_became_peered":"2020-06-27T04:44:24.273494+0000","last_unstale":"2020-06-27T04:45:18.142256+0000","last_undegraded":"2020-06-27T04:45:18.142256+0000","last_fullsized":"2020-06-27T04:45:18.142256+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"57'17","reported_seq":"50","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.134696+0000","last_change":"2020-06-27T04:44:35.389934+0000","last_active":"2020-06-27T04:45:18.134696+0000","last_peered":"2020-06-27T04:45:18.134696+0000","last_clean":"2020-06-27T04:45:18.134696+0000","last_became_active":"2020-06-27T04:44:35.389527+0000","last_became_peered":"2020-06-27T04:44:35.389527+0000","last_unstale":"2020-06-27T04:45:18.134696+0000","last_undegraded":"2020-06-27T04:45:18.134696+0000","last_fullsized":"2020-06-27T04:45:18.134696+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"59'3","reported_seq":"49","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:58.724337+0000","last_change":"2020-06-27T04:45:19.149549+0000","last_active":"2020-06-27T04:45:58.724337+0000","last_peered":"2020-06-27T04:45:58.724337+0000","last_clean":"2020-06-27T04:45:58.724337+0000","last_became_active":"2020-06-27T04:45:19.141809+0000","last_became_peered":"2020-06-27T04:45:19.141809+0000","last_unstale":"2020-06-27T04:45:58.724337+0000","last_undegraded":"2020-06-27T04:45:58.724337+0000","last_fullsized":"2020-06-27T04:45:58.724337+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3],"acting":[4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152494+0000","last_change":"2020-06-27T04:44:39.424612+0000","last_active":"2020-06-27T04:45:18.152494+0000","last_peered":"2020-06-27T04:45:18.152494+0000","last_clean":"2020-06-27T04:45:18.152494+0000","last_became_active":"2020-06-27T04:44:39.424194+0000","last_became_peered":"2020-06-27T04:44:39.424194+0000","last_unstale":"2020-06-27T04:45:18.152494+0000","last_undegraded":"2020-06-27T04:45:18.152494+0000","last_fullsized":"2020-06-27T04:45:18.152494+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"57'5","reported_seq":"60","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:56.542660+0000","last_change":"2020-06-27T04:44:24.276239+0000","last_active":"2020-06-27T04:45:56.542660+0000","last_peered":"2020-06-27T04:45:56.542660+0000","last_clean":"2020-06-27T04:45:56.542660+0000","last_became_active":"2020-06-27T04:44:24.275664+0000","last_became_peered":"2020-06-27T04:44:24.275664+0000","last_unstale":"2020-06-27T04:45:56.542660+0000","last_undegraded":"2020-06-27T04:45:56.542660+0000","last_fullsized":"2020-06-27T04:45:56.542660+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"57'12","reported_seq":"34","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137588+0000","last_change":"2020-06-27T04:44:35.840202+0000","last_active":"2020-06-27T04:45:18.137588+0000","last_peered":"2020-06-27T04:45:18.137588+0000","last_clean":"2020-06-27T04:45:18.137588+0000","last_became_active":"2020-06-27T04:44:35.839722+0000","last_became_peered":"2020-06-27T04:44:35.839722+0000","last_unstale":"2020-06-27T04:45:18.137588+0000","last_undegraded":"2020-06-27T04:45:18.137588+0000","last_fullsized":"2020-06-27T04:45:18.137588+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140113+0000","last_change":"2020-06-27T04:44:37.404369+0000","last_active":"2020-06-27T04:45:18.140113+0000","last_peered":"2020-06-27T04:45:18.140113+0000","last_clean":"2020-06-27T04:45:18.140113+0000","last_became_active":"2020-06-27T04:44:37.402477+0000","last_became_peered":"2020-06-27T04:44:37.402477+0000","last_unstale":"2020-06-27T04:45:18.140113+0000","last_undegraded":"2020-06-27T04:45:18.140113+0000","last_fullsized":"2020-06-27T04:45:18.140113+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152927+0000","last_change":"2020-06-27T04:44:39.428415+0000","last_active":"2020-06-27T04:45:18.152927+0000","last_peered":"2020-06-27T04:45:18.152927+0000","last_clean":"2020-06-27T04:45:18.152927+0000","last_became_active":"2020-06-27T04:44:39.427940+0000","last_became_peered":"2020-06-27T04:44:39.427940+0000","last_unstale":"2020-06-27T04:45:18.152927+0000","last_undegraded":"2020-06-27T04:45:18.152927+0000","last_fullsized":"2020-06-27T04:45:18.152927+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"21","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137101+0000","last_change":"2020-06-27T04:44:22.273175+0000","last_active":"2020-06-27T04:45:18.137101+0000","last_peered":"2020-06-27T04:45:18.137101+0000","last_clean":"2020-06-27T04:45:18.137101+0000","last_became_active":"2020-06-27T04:44:22.272748+0000","last_became_peered":"2020-06-27T04:44:22.272748+0000","last_unstale":"2020-06-27T04:45:18.137101+0000","last_undegraded":"2020-06-27T04:45:18.137101+0000","last_fullsized":"2020-06-27T04:45:18.137101+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"57'25","reported_seq":"68","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140380+0000","last_change":"2020-06-27T04:44:35.390970+0000","last_active":"2020-06-27T04:45:18.140380+0000","last_peered":"2020-06-27T04:45:18.140380+0000","last_clean":"2020-06-27T04:45:18.140380+0000","last_became_active":"2020-06-27T04:44:35.390562+0000","last_became_peered":"2020-06-27T04:44:35.390562+0000","last_unstale":"2020-06-27T04:45:18.140380+0000","last_undegraded":"2020-06-27T04:45:18.140380+0000","last_fullsized":"2020-06-27T04:45:18.140380+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137504+0000","last_change":"2020-06-27T04:44:37.407157+0000","last_active":"2020-06-27T04:45:18.137504+0000","last_peered":"2020-06-27T04:45:18.137504+0000","last_clean":"2020-06-27T04:45:18.137504+0000","last_became_active":"2020-06-27T04:44:37.406717+0000","last_became_peered":"2020-06-27T04:44:37.406717+0000","last_unstale":"2020-06-27T04:45:18.137504+0000","last_undegraded":"2020-06-27T04:45:18.137504+0000","last_fullsized":"2020-06-27T04:45:18.137504+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137690+0000","last_change":"2020-06-27T04:44:39.414652+0000","last_active":"2020-06-27T04:45:18.137690+0000","last_peered":"2020-06-27T04:45:18.137690+0000","last_clean":"2020-06-27T04:45:18.137690+0000","last_became_active":"2020-06-27T04:44:39.414186+0000","last_became_peered":"2020-06-27T04:44:39.414186+0000","last_unstale":"2020-06-27T04:45:18.137690+0000","last_undegraded":"2020-06-27T04:45:18.137690+0000","last_fullsized":"2020-06-27T04:45:18.137690+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"57'30","reported_seq":"79","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137039+0000","last_change":"2020-06-27T04:44:35.840256+0000","last_active":"2020-06-27T04:45:18.137039+0000","last_peered":"2020-06-27T04:45:18.137039+0000","last_clean":"2020-06-27T04:45:18.137039+0000","last_became_active":"2020-06-27T04:44:35.839807+0000","last_became_peered":"2020-06-27T04:44:35.839807+0000","last_unstale":"2020-06-27T04:45:18.137039+0000","last_undegraded":"2020-06-27T04:45:18.137039+0000","last_fullsized":"2020-06-27T04:45:18.137039+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":44,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"22","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.135771+0000","last_change":"2020-06-27T04:44:22.278293+0000","last_active":"2020-06-27T04:45:18.135771+0000","last_peered":"2020-06-27T04:45:18.135771+0000","last_clean":"2020-06-27T04:45:18.135771+0000","last_became_active":"2020-06-27T04:44:22.277807+0000","last_became_peered":"2020-06-27T04:44:22.277807+0000","last_unstale":"2020-06-27T04:45:18.135771+0000","last_undegraded":"2020-06-27T04:45:18.135771+0000","last_fullsized":"2020-06-27T04:45:18.135771+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136938+0000","last_change":"2020-06-27T04:44:37.401934+0000","last_active":"2020-06-27T04:45:18.136938+0000","last_peered":"2020-06-27T04:45:18.136938+0000","last_clean":"2020-06-27T04:45:18.136938+0000","last_became_active":"2020-06-27T04:44:37.401495+0000","last_became_peered":"2020-06-27T04:44:37.401495+0000","last_unstale":"2020-06-27T04:45:18.136938+0000","last_undegraded":"2020-06-27T04:45:18.136938+0000","last_fullsized":"2020-06-27T04:45:18.136938+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133365+0000","last_change":"2020-06-27T04:44:39.421103+0000","last_active":"2020-06-27T04:45:18.133365+0000","last_peered":"2020-06-27T04:45:18.133365+0000","last_clean":"2020-06-27T04:45:18.133365+0000","last_became_active":"2020-06-27T04:44:39.420653+0000","last_became_peered":"2020-06-27T04:44:39.420653+0000","last_unstale":"2020-06-27T04:45:18.133365+0000","last_undegraded":"2020-06-27T04:45:18.133365+0000","last_fullsized":"2020-06-27T04:45:18.133365+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"57'16","reported_seq":"46","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140097+0000","last_change":"2020-06-27T04:44:35.395372+0000","last_active":"2020-06-27T04:45:18.140097+0000","last_peered":"2020-06-27T04:45:18.140097+0000","last_clean":"2020-06-27T04:45:18.140097+0000","last_became_active":"2020-06-27T04:44:35.394585+0000","last_became_peered":"2020-06-27T04:44:35.394585+0000","last_unstale":"2020-06-27T04:45:18.140097+0000","last_undegraded":"2020-06-27T04:45:18.140097+0000","last_fullsized":"2020-06-27T04:45:18.140097+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"23","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136600+0000","last_change":"2020-06-27T04:44:24.281285+0000","last_active":"2020-06-27T04:45:18.136600+0000","last_peered":"2020-06-27T04:45:18.136600+0000","last_clean":"2020-06-27T04:45:18.136600+0000","last_became_active":"2020-06-27T04:44:24.280676+0000","last_became_peered":"2020-06-27T04:44:24.280676+0000","last_unstale":"2020-06-27T04:45:18.136600+0000","last_undegraded":"2020-06-27T04:45:18.136600+0000","last_fullsized":"2020-06-27T04:45:18.136600+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'2","reported_seq":"26","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133765+0000","last_change":"2020-06-27T04:44:24.295963+0000","last_active":"2020-06-27T04:45:18.133765+0000","last_peered":"2020-06-27T04:45:18.133765+0000","last_clean":"2020-06-27T04:45:18.133765+0000","last_became_active":"2020-06-27T04:44:24.285786+0000","last_became_peered":"2020-06-27T04:44:24.285786+0000","last_unstale":"2020-06-27T04:45:18.133765+0000","last_undegraded":"2020-06-27T04:45:18.133765+0000","last_fullsized":"2020-06-27T04:45:18.133765+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:39:48.364090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:39:48.364090+0000","last_clean_scrub_stamp":"2020-06-27T04:39:48.364090+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153509+0000","last_change":"2020-06-27T04:44:37.446369+0000","last_active":"2020-06-27T04:45:18.153509+0000","last_peered":"2020-06-27T04:45:18.153509+0000","last_clean":"2020-06-27T04:45:18.153509+0000","last_became_active":"2020-06-27T04:44:37.445862+0000","last_became_peered":"2020-06-27T04:44:37.445862+0000","last_unstale":"2020-06-27T04:45:18.153509+0000","last_undegraded":"2020-06-27T04:45:18.153509+0000","last_fullsized":"2020-06-27T04:45:18.153509+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140255+0000","last_change":"2020-06-27T04:44:39.420638+0000","last_active":"2020-06-27T04:45:18.140255+0000","last_peered":"2020-06-27T04:45:18.140255+0000","last_clean":"2020-06-27T04:45:18.140255+0000","last_became_active":"2020-06-27T04:44:39.420238+0000","last_became_peered":"2020-06-27T04:44:39.420238+0000","last_unstale":"2020-06-27T04:45:18.140255+0000","last_undegraded":"2020-06-27T04:45:18.140255+0000","last_fullsized":"2020-06-27T04:45:18.140255+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"57'20","reported_seq":"52","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152122+0000","last_change":"2020-06-27T04:44:35.387967+0000","last_active":"2020-06-27T04:45:18.152122+0000","last_peered":"2020-06-27T04:45:18.152122+0000","last_clean":"2020-06-27T04:45:18.152122+0000","last_became_active":"2020-06-27T04:44:35.387339+0000","last_became_peered":"2020-06-27T04:44:35.387339+0000","last_unstale":"2020-06-27T04:45:18.152122+0000","last_undegraded":"2020-06-27T04:45:18.152122+0000","last_fullsized":"2020-06-27T04:45:18.152122+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"19","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133099+0000","last_change":"2020-06-27T04:44:24.287552+0000","last_active":"2020-06-27T04:45:18.133099+0000","last_peered":"2020-06-27T04:45:18.133099+0000","last_clean":"2020-06-27T04:45:18.133099+0000","last_became_active":"2020-06-27T04:44:24.286639+0000","last_became_peered":"2020-06-27T04:44:24.286639+0000","last_unstale":"2020-06-27T04:45:18.133099+0000","last_undegraded":"2020-06-27T04:45:18.133099+0000","last_fullsized":"2020-06-27T04:45:18.133099+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153132+0000","last_change":"2020-06-27T04:44:37.404797+0000","last_active":"2020-06-27T04:45:18.153132+0000","last_peered":"2020-06-27T04:45:18.153132+0000","last_clean":"2020-06-27T04:45:18.153132+0000","last_became_active":"2020-06-27T04:44:37.404213+0000","last_became_peered":"2020-06-27T04:44:37.404213+0000","last_unstale":"2020-06-27T04:45:18.153132+0000","last_undegraded":"2020-06-27T04:45:18.153132+0000","last_fullsized":"2020-06-27T04:45:18.153132+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152995+0000","last_change":"2020-06-27T04:44:39.417129+0000","last_active":"2020-06-27T04:45:18.152995+0000","last_peered":"2020-06-27T04:45:18.152995+0000","last_clean":"2020-06-27T04:45:18.152995+0000","last_became_active":"2020-06-27T04:44:39.416606+0000","last_became_peered":"2020-06-27T04:44:39.416606+0000","last_unstale":"2020-06-27T04:45:18.152995+0000","last_undegraded":"2020-06-27T04:45:18.152995+0000","last_fullsized":"2020-06-27T04:45:18.152995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"19","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133994+0000","last_change":"2020-06-27T04:44:24.286053+0000","last_active":"2020-06-27T04:45:18.133994+0000","last_peered":"2020-06-27T04:45:18.133994+0000","last_clean":"2020-06-27T04:45:18.133994+0000","last_became_active":"2020-06-27T04:44:24.285230+0000","last_became_peered":"2020-06-27T04:44:24.285230+0000","last_unstale":"2020-06-27T04:45:18.133994+0000","last_undegraded":"2020-06-27T04:45:18.133994+0000","last_fullsized":"2020-06-27T04:45:18.133994+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"57'27","reported_seq":"71","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137812+0000","last_change":"2020-06-27T04:44:35.840204+0000","last_active":"2020-06-27T04:45:18.137812+0000","last_peered":"2020-06-27T04:45:18.137812+0000","last_clean":"2020-06-27T04:45:18.137812+0000","last_became_active":"2020-06-27T04:44:35.839671+0000","last_became_peered":"2020-06-27T04:44:35.839671+0000","last_unstale":"2020-06-27T04:45:18.137812+0000","last_undegraded":"2020-06-27T04:45:18.137812+0000","last_fullsized":"2020-06-27T04:45:18.137812+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":54,"num_read_kb":38,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"53'2","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:58.723990+0000","last_change":"2020-06-27T04:44:37.443731+0000","last_active":"2020-06-27T04:45:58.723990+0000","last_peered":"2020-06-27T04:45:58.723990+0000","last_clean":"2020-06-27T04:45:58.723990+0000","last_became_active":"2020-06-27T04:44:37.443291+0000","last_became_peered":"2020-06-27T04:44:37.443291+0000","last_unstale":"2020-06-27T04:45:58.723990+0000","last_undegraded":"2020-06-27T04:45:58.723990+0000","last_fullsized":"2020-06-27T04:45:58.723990+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140522+0000","last_change":"2020-06-27T04:44:39.426137+0000","last_active":"2020-06-27T04:45:18.140522+0000","last_peered":"2020-06-27T04:45:18.140522+0000","last_clean":"2020-06-27T04:45:18.140522+0000","last_became_active":"2020-06-27T04:44:39.425701+0000","last_became_peered":"2020-06-27T04:44:39.425701+0000","last_unstale":"2020-06-27T04:45:18.140522+0000","last_undegraded":"2020-06-27T04:45:18.140522+0000","last_fullsized":"2020-06-27T04:45:18.140522+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"23","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136651+0000","last_change":"2020-06-27T04:44:23.270266+0000","last_active":"2020-06-27T04:45:18.136651+0000","last_peered":"2020-06-27T04:45:18.136651+0000","last_clean":"2020-06-27T04:45:18.136651+0000","last_became_active":"2020-06-27T04:44:23.269757+0000","last_became_peered":"2020-06-27T04:44:23.269757+0000","last_unstale":"2020-06-27T04:45:18.136651+0000","last_undegraded":"2020-06-27T04:45:18.136651+0000","last_fullsized":"2020-06-27T04:45:18.136651+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"57'19","reported_seq":"58","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.141077+0000","last_change":"2020-06-27T04:44:35.396160+0000","last_active":"2020-06-27T04:45:18.141077+0000","last_peered":"2020-06-27T04:45:18.141077+0000","last_clean":"2020-06-27T04:45:18.141077+0000","last_became_active":"2020-06-27T04:44:35.395643+0000","last_became_peered":"2020-06-27T04:44:35.395643+0000","last_unstale":"2020-06-27T04:45:18.141077+0000","last_undegraded":"2020-06-27T04:45:18.141077+0000","last_fullsized":"2020-06-27T04:45:18.141077+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":42,"num_read_kb":30,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"53'2","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:58.723976+0000","last_change":"2020-06-27T04:44:37.446598+0000","last_active":"2020-06-27T04:45:58.723976+0000","last_peered":"2020-06-27T04:45:58.723976+0000","last_clean":"2020-06-27T04:45:58.723976+0000","last_became_active":"2020-06-27T04:44:37.446117+0000","last_became_peered":"2020-06-27T04:44:37.446117+0000","last_unstale":"2020-06-27T04:45:58.723976+0000","last_undegraded":"2020-06-27T04:45:58.723976+0000","last_fullsized":"2020-06-27T04:45:58.723976+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138419+0000","last_change":"2020-06-27T04:44:39.424495+0000","last_active":"2020-06-27T04:45:18.138419+0000","last_peered":"2020-06-27T04:45:18.138419+0000","last_clean":"2020-06-27T04:45:18.138419+0000","last_became_active":"2020-06-27T04:44:39.420809+0000","last_became_peered":"2020-06-27T04:44:39.420809+0000","last_unstale":"2020-06-27T04:45:18.138419+0000","last_undegraded":"2020-06-27T04:45:18.138419+0000","last_fullsized":"2020-06-27T04:45:18.138419+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"30","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153804+0000","last_change":"2020-06-27T04:44:24.278200+0000","last_active":"2020-06-27T04:45:18.153804+0000","last_peered":"2020-06-27T04:45:18.153804+0000","last_clean":"2020-06-27T04:45:18.153804+0000","last_became_active":"2020-06-27T04:44:24.277655+0000","last_became_peered":"2020-06-27T04:44:24.277655+0000","last_unstale":"2020-06-27T04:45:18.153804+0000","last_undegraded":"2020-06-27T04:45:18.153804+0000","last_fullsized":"2020-06-27T04:45:18.153804+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"57'12","reported_seq":"34","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152982+0000","last_change":"2020-06-27T04:44:35.390301+0000","last_active":"2020-06-27T04:45:18.152982+0000","last_peered":"2020-06-27T04:45:18.152982+0000","last_clean":"2020-06-27T04:45:18.152982+0000","last_became_active":"2020-06-27T04:44:35.389836+0000","last_became_peered":"2020-06-27T04:44:35.389836+0000","last_unstale":"2020-06-27T04:45:18.152982+0000","last_undegraded":"2020-06-27T04:45:18.152982+0000","last_fullsized":"2020-06-27T04:45:18.152982+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.141236+0000","last_change":"2020-06-27T04:44:37.393072+0000","last_active":"2020-06-27T04:45:18.141236+0000","last_peered":"2020-06-27T04:45:18.141236+0000","last_clean":"2020-06-27T04:45:18.141236+0000","last_became_active":"2020-06-27T04:44:37.392599+0000","last_became_peered":"2020-06-27T04:44:37.392599+0000","last_unstale":"2020-06-27T04:45:18.141236+0000","last_undegraded":"2020-06-27T04:45:18.141236+0000","last_fullsized":"2020-06-27T04:45:18.141236+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138434+0000","last_change":"2020-06-27T04:44:39.422798+0000","last_active":"2020-06-27T04:45:18.138434+0000","last_peered":"2020-06-27T04:45:18.138434+0000","last_clean":"2020-06-27T04:45:18.138434+0000","last_became_active":"2020-06-27T04:44:39.422385+0000","last_became_peered":"2020-06-27T04:44:39.422385+0000","last_unstale":"2020-06-27T04:45:18.138434+0000","last_undegraded":"2020-06-27T04:45:18.138434+0000","last_fullsized":"2020-06-27T04:45:18.138434+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"53'2","reported_seq":"35","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:58.724149+0000","last_change":"2020-06-27T04:44:37.410680+0000","last_active":"2020-06-27T04:45:58.724149+0000","last_peered":"2020-06-27T04:45:58.724149+0000","last_clean":"2020-06-27T04:45:58.724149+0000","last_became_active":"2020-06-27T04:44:37.410216+0000","last_became_peered":"2020-06-27T04:44:37.410216+0000","last_unstale":"2020-06-27T04:45:58.724149+0000","last_undegraded":"2020-06-27T04:45:58.724149+0000","last_fullsized":"2020-06-27T04:45:58.724149+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"19","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133013+0000","last_change":"2020-06-27T04:44:24.287163+0000","last_active":"2020-06-27T04:45:18.133013+0000","last_peered":"2020-06-27T04:45:18.133013+0000","last_clean":"2020-06-27T04:45:18.133013+0000","last_became_active":"2020-06-27T04:44:24.285206+0000","last_became_peered":"2020-06-27T04:44:24.285206+0000","last_unstale":"2020-06-27T04:45:18.133013+0000","last_undegraded":"2020-06-27T04:45:18.133013+0000","last_fullsized":"2020-06-27T04:45:18.133013+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"57'25","reported_seq":"71","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.140999+0000","last_change":"2020-06-27T04:44:35.840211+0000","last_active":"2020-06-27T04:45:18.140999+0000","last_peered":"2020-06-27T04:45:18.140999+0000","last_clean":"2020-06-27T04:45:18.140999+0000","last_became_active":"2020-06-27T04:44:35.839758+0000","last_became_peered":"2020-06-27T04:44:35.839758+0000","last_unstale":"2020-06-27T04:45:18.140999+0000","last_undegraded":"2020-06-27T04:45:18.140999+0000","last_fullsized":"2020-06-27T04:45:18.140999+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":38,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.142295+0000","last_change":"2020-06-27T04:44:39.429402+0000","last_active":"2020-06-27T04:45:18.142295+0000","last_peered":"2020-06-27T04:45:18.142295+0000","last_clean":"2020-06-27T04:45:18.142295+0000","last_became_active":"2020-06-27T04:44:39.428988+0000","last_became_peered":"2020-06-27T04:44:39.428988+0000","last_unstale":"2020-06-27T04:45:18.142295+0000","last_undegraded":"2020-06-27T04:45:18.142295+0000","last_fullsized":"2020-06-27T04:45:18.142295+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137071+0000","last_change":"2020-06-27T04:44:37.406808+0000","last_active":"2020-06-27T04:45:18.137071+0000","last_peered":"2020-06-27T04:45:18.137071+0000","last_clean":"2020-06-27T04:45:18.137071+0000","last_became_active":"2020-06-27T04:44:37.406243+0000","last_became_peered":"2020-06-27T04:44:37.406243+0000","last_unstale":"2020-06-27T04:45:18.137071+0000","last_undegraded":"2020-06-27T04:45:18.137071+0000","last_fullsized":"2020-06-27T04:45:18.137071+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"24","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138605+0000","last_change":"2020-06-27T04:44:24.274796+0000","last_active":"2020-06-27T04:45:18.138605+0000","last_peered":"2020-06-27T04:45:18.138605+0000","last_clean":"2020-06-27T04:45:18.138605+0000","last_became_active":"2020-06-27T04:44:24.274139+0000","last_became_peered":"2020-06-27T04:44:24.274139+0000","last_unstale":"2020-06-27T04:45:18.138605+0000","last_undegraded":"2020-06-27T04:45:18.138605+0000","last_fullsized":"2020-06-27T04:45:18.138605+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"57'27","reported_seq":"71","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.138559+0000","last_change":"2020-06-27T04:44:35.389333+0000","last_active":"2020-06-27T04:45:18.138559+0000","last_peered":"2020-06-27T04:45:18.138559+0000","last_clean":"2020-06-27T04:45:18.138559+0000","last_became_active":"2020-06-27T04:44:35.388099+0000","last_became_peered":"2020-06-27T04:44:35.388099+0000","last_unstale":"2020-06-27T04:45:18.138559+0000","last_undegraded":"2020-06-27T04:45:18.138559+0000","last_fullsized":"2020-06-27T04:45:18.138559+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136220+0000","last_change":"2020-06-27T04:44:39.416284+0000","last_active":"2020-06-27T04:45:18.136220+0000","last_peered":"2020-06-27T04:45:18.136220+0000","last_clean":"2020-06-27T04:45:18.136220+0000","last_became_active":"2020-06-27T04:44:39.415824+0000","last_became_peered":"2020-06-27T04:44:39.415824+0000","last_unstale":"2020-06-27T04:45:18.136220+0000","last_undegraded":"2020-06-27T04:45:18.136220+0000","last_fullsized":"2020-06-27T04:45:18.136220+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"24","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.139512+0000","last_change":"2020-06-27T04:44:24.276328+0000","last_active":"2020-06-27T04:45:18.139512+0000","last_peered":"2020-06-27T04:45:18.139512+0000","last_clean":"2020-06-27T04:45:18.139512+0000","last_became_active":"2020-06-27T04:44:24.275626+0000","last_became_peered":"2020-06-27T04:44:24.275626+0000","last_unstale":"2020-06-27T04:45:18.139512+0000","last_undegraded":"2020-06-27T04:45:18.139512+0000","last_fullsized":"2020-06-27T04:45:18.139512+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"57'15","reported_seq":"47","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.139962+0000","last_change":"2020-06-27T04:44:35.390776+0000","last_active":"2020-06-27T04:45:18.139962+0000","last_peered":"2020-06-27T04:45:18.139962+0000","last_clean":"2020-06-27T04:45:18.139962+0000","last_became_active":"2020-06-27T04:44:35.388560+0000","last_became_peered":"2020-06-27T04:44:35.388560+0000","last_unstale":"2020-06-27T04:45:18.139962+0000","last_undegraded":"2020-06-27T04:45:18.139962+0000","last_fullsized":"2020-06-27T04:45:18.139962+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":22,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":"15","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.141757+0000","last_change":"2020-06-27T04:44:37.398579+0000","last_active":"2020-06-27T04:45:18.141757+0000","last_peered":"2020-06-27T04:45:18.141757+0000","last_clean":"2020-06-27T04:45:18.141757+0000","last_became_active":"2020-06-27T04:44:37.398170+0000","last_became_peered":"2020-06-27T04:44:37.398170+0000","last_unstale":"2020-06-27T04:45:18.141757+0000","last_undegraded":"2020-06-27T04:45:18.141757+0000","last_fullsized":"2020-06-27T04:45:18.141757+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137408+0000","last_change":"2020-06-27T04:44:39.420940+0000","last_active":"2020-06-27T04:45:18.137408+0000","last_peered":"2020-06-27T04:45:18.137408+0000","last_clean":"2020-06-27T04:45:18.137408+0000","last_became_active":"2020-06-27T04:44:39.420413+0000","last_became_peered":"2020-06-27T04:44:39.420413+0000","last_unstale":"2020-06-27T04:45:18.137408+0000","last_undegraded":"2020-06-27T04:45:18.137408+0000","last_fullsized":"2020-06-27T04:45:18.137408+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"53'2","reported_seq":"35","reported_epoch":"59","state":"active+clean","last_fresh":"2020-06-27T04:45:58.724303+0000","last_change":"2020-06-27T04:44:37.410635+0000","last_active":"2020-06-27T04:45:58.724303+0000","last_peered":"2020-06-27T04:45:58.724303+0000","last_clean":"2020-06-27T04:45:58.724303+0000","last_became_active":"2020-06-27T04:44:37.410236+0000","last_became_peered":"2020-06-27T04:44:37.410236+0000","last_unstale":"2020-06-27T04:45:58.724303+0000","last_undegraded":"2020-06-27T04:45:58.724303+0000","last_fullsized":"2020-06-27T04:45:58.724303+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"19","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133640+0000","last_change":"2020-06-27T04:44:24.280785+0000","last_active":"2020-06-27T04:45:18.133640+0000","last_peered":"2020-06-27T04:45:18.133640+0000","last_clean":"2020-06-27T04:45:18.133640+0000","last_became_active":"2020-06-27T04:44:24.280237+0000","last_became_peered":"2020-06-27T04:44:24.280237+0000","last_unstale":"2020-06-27T04:45:18.133640+0000","last_undegraded":"2020-06-27T04:45:18.133640+0000","last_fullsized":"2020-06-27T04:45:18.133640+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"57'25","reported_seq":"62","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153237+0000","last_change":"2020-06-27T04:44:35.393147+0000","last_active":"2020-06-27T04:45:18.153237+0000","last_peered":"2020-06-27T04:45:18.153237+0000","last_clean":"2020-06-27T04:45:18.153237+0000","last_became_active":"2020-06-27T04:44:35.392550+0000","last_became_peered":"2020-06-27T04:44:35.392550+0000","last_unstale":"2020-06-27T04:45:18.153237+0000","last_undegraded":"2020-06-27T04:45:18.153237+0000","last_fullsized":"2020-06-27T04:45:18.153237+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":44,"num_read_kb":32,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.135511+0000","last_change":"2020-06-27T04:44:39.415902+0000","last_active":"2020-06-27T04:45:18.135511+0000","last_peered":"2020-06-27T04:45:18.135511+0000","last_clean":"2020-06-27T04:45:18.135511+0000","last_became_active":"2020-06-27T04:44:39.415429+0000","last_became_peered":"2020-06-27T04:44:39.415429+0000","last_unstale":"2020-06-27T04:45:18.135511+0000","last_undegraded":"2020-06-27T04:45:18.135511+0000","last_fullsized":"2020-06-27T04:45:18.135511+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"22","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136143+0000","last_change":"2020-06-27T04:44:22.277035+0000","last_active":"2020-06-27T04:45:18.136143+0000","last_peered":"2020-06-27T04:45:18.136143+0000","last_clean":"2020-06-27T04:45:18.136143+0000","last_became_active":"2020-06-27T04:44:22.276533+0000","last_became_peered":"2020-06-27T04:44:22.276533+0000","last_unstale":"2020-06-27T04:45:18.136143+0000","last_undegraded":"2020-06-27T04:45:18.136143+0000","last_fullsized":"2020-06-27T04:45:18.136143+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"57'17","reported_seq":"44","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.134259+0000","last_change":"2020-06-27T04:44:35.398011+0000","last_active":"2020-06-27T04:45:18.134259+0000","last_peered":"2020-06-27T04:45:18.134259+0000","last_clean":"2020-06-27T04:45:18.134259+0000","last_became_active":"2020-06-27T04:44:35.397575+0000","last_became_peered":"2020-06-27T04:44:35.397575+0000","last_unstale":"2020-06-27T04:45:18.134259+0000","last_undegraded":"2020-06-27T04:45:18.134259+0000","last_fullsized":"2020-06-27T04:45:18.134259+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.153184+0000","last_change":"2020-06-27T04:44:37.446398+0000","last_active":"2020-06-27T04:45:18.153184+0000","last_peered":"2020-06-27T04:45:18.153184+0000","last_clean":"2020-06-27T04:45:18.153184+0000","last_became_active":"2020-06-27T04:44:37.445878+0000","last_became_peered":"2020-06-27T04:44:37.445878+0000","last_unstale":"2020-06-27T04:45:18.153184+0000","last_undegraded":"2020-06-27T04:45:18.153184+0000","last_fullsized":"2020-06-27T04:45:18.153184+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"13","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.135929+0000","last_change":"2020-06-27T04:44:39.431904+0000","last_active":"2020-06-27T04:45:18.135929+0000","last_peered":"2020-06-27T04:45:18.135929+0000","last_clean":"2020-06-27T04:45:18.135929+0000","last_became_active":"2020-06-27T04:44:39.431533+0000","last_became_peered":"2020-06-27T04:44:39.431533+0000","last_unstale":"2020-06-27T04:45:18.135929+0000","last_undegraded":"2020-06-27T04:45:18.135929+0000","last_fullsized":"2020-06-27T04:45:18.135929+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"22","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136873+0000","last_change":"2020-06-27T04:44:22.269873+0000","last_active":"2020-06-27T04:45:18.136873+0000","last_peered":"2020-06-27T04:45:18.136873+0000","last_clean":"2020-06-27T04:45:18.136873+0000","last_became_active":"2020-06-27T04:44:22.269430+0000","last_became_peered":"2020-06-27T04:44:22.269430+0000","last_unstale":"2020-06-27T04:45:18.136873+0000","last_undegraded":"2020-06-27T04:45:18.136873+0000","last_fullsized":"2020-06-27T04:45:18.136873+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"57'10","reported_seq":"31","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136853+0000","last_change":"2020-06-27T04:44:35.398464+0000","last_active":"2020-06-27T04:45:18.136853+0000","last_peered":"2020-06-27T04:45:18.136853+0000","last_clean":"2020-06-27T04:45:18.136853+0000","last_became_active":"2020-06-27T04:44:35.398011+0000","last_became_peered":"2020-06-27T04:44:35.398011+0000","last_unstale":"2020-06-27T04:45:18.136853+0000","last_undegraded":"2020-06-27T04:45:18.136853+0000","last_fullsized":"2020-06-27T04:45:18.136853+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.152792+0000","last_change":"2020-06-27T04:44:37.402307+0000","last_active":"2020-06-27T04:45:18.152792+0000","last_peered":"2020-06-27T04:45:18.152792+0000","last_clean":"2020-06-27T04:45:18.152792+0000","last_became_active":"2020-06-27T04:44:37.401787+0000","last_became_peered":"2020-06-27T04:44:37.401787+0000","last_unstale":"2020-06-27T04:45:18.152792+0000","last_undegraded":"2020-06-27T04:45:18.152792+0000","last_fullsized":"2020-06-27T04:45:18.152792+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":"12","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.133734+0000","last_change":"2020-06-27T04:44:39.427264+0000","last_active":"2020-06-27T04:45:18.133734+0000","last_peered":"2020-06-27T04:45:18.133734+0000","last_clean":"2020-06-27T04:45:18.133734+0000","last_became_active":"2020-06-27T04:44:39.426886+0000","last_became_peered":"2020-06-27T04:44:39.426886+0000","last_unstale":"2020-06-27T04:45:18.133734+0000","last_undegraded":"2020-06-27T04:45:18.133734+0000","last_fullsized":"2020-06-27T04:45:18.133734+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:38.392547+0000","last_clean_scrub_stamp":"2020-06-27T04:44:38.392547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"49'1","reported_seq":"33","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.137903+0000","last_change":"2020-06-27T04:44:24.275183+0000","last_active":"2020-06-27T04:45:18.137903+0000","last_peered":"2020-06-27T04:45:18.137903+0000","last_clean":"2020-06-27T04:45:18.137903+0000","last_became_active":"2020-06-27T04:44:24.274604+0000","last_became_peered":"2020-06-27T04:44:24.274604+0000","last_unstale":"2020-06-27T04:45:18.137903+0000","last_undegraded":"2020-06-27T04:45:18.137903+0000","last_fullsized":"2020-06-27T04:45:18.137903+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:21.250427+0000","last_clean_scrub_stamp":"2020-06-27T04:44:21.250427+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"57'15","reported_seq":"41","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.135646+0000","last_change":"2020-06-27T04:44:35.388854+0000","last_active":"2020-06-27T04:45:18.135646+0000","last_peered":"2020-06-27T04:45:18.135646+0000","last_clean":"2020-06-27T04:45:18.135646+0000","last_became_active":"2020-06-27T04:44:35.388435+0000","last_became_peered":"2020-06-27T04:44:35.388435+0000","last_unstale":"2020-06-27T04:45:18.135646+0000","last_undegraded":"2020-06-27T04:45:18.135646+0000","last_fullsized":"2020-06-27T04:45:18.135646+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:34.362567+0000","last_clean_scrub_stamp":"2020-06-27T04:44:34.362567+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":"14","reported_epoch":"58","state":"active+clean","last_fresh":"2020-06-27T04:45:18.136075+0000","last_change":"2020-06-27T04:44:37.444833+0000","last_active":"2020-06-27T04:45:18.136075+0000","last_peered":"2020-06-27T04:45:18.136075+0000","last_clean":"2020-06-27T04:45:18.136075+0000","last_became_active":"2020-06-27T04:44:37.444425+0000","last_became_peered":"2020-06-27T04:44:37.444425+0000","last_unstale":"2020-06-27T04:45:18.136075+0000","last_undegraded":"2020-06-27T04:45:18.136075+0000","last_fullsized":"2020-06-27T04:45:18.136075+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:44:36.375720+0000","last_clean_scrub_stamp":"2020-06-27T04:44:36.375720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3520,"num_objects":206,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":206,"num_whiteouts":0,"num_read":1057,"num_read_kb":787,"num_write":600,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":10560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":569,"ondisk_log_size":569,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1914,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":21,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":5742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":47,"seq":201863462935,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049212,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695940,"statfs":{"total":95995035648,"available":94920642560,"internally_reserved":1073741824,"allocated":643072,"data_stored":234431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 27 04:45:25 2020","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.92300000000000004}]},{"osd":1,"last update":"Sat Jun 27 04:45:25 2020","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.88100000000000001}]},{"osd":2,"last update":"Sat Jun 27 04:45:25 2020","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.1559999999999999}]},{"osd":3,"last update":"Sat Jun 27 04:45:25 2020","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.044}]},{"osd":4,"last update":"Sat Jun 27 04:45:25 2020","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":3.7509999999999999,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Sat Jun 27 04:45:25 2020","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.343},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.4350000000000001}]},{"osd":6,"last update":"Sat Jun 27 04:45:25 2020","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.1869999999999998,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":1.111}]}]},{"osd":6,"up_from":42,"seq":180388626460,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049180,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695972,"statfs":{"total":95995035648,"available":94920675328,"internally_reserved":1073741824,"allocated":610304,"data_stored":232774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 27 04:45:10 2020","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.81999999999999995}]},{"osd":1,"last update":"Sat Jun 27 04:45:10 2020","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.97199999999999998}]},{"osd":2,"last update":"Sat Jun 27 04:45:10 2020","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.077},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.1080000000000001}]},{"osd":3,"last update":"Sat Jun 27 04:45:10 2020","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":1.2},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.238}]},{"osd":4,"last update":"Sat Jun 27 04:45:10 2020","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":1.419}]},{"osd":5,"last update":"Sat Jun 27 04:45:10 2020","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.371}]},{"osd":7,"last update":"Sat Jun 27 04:45:27 2020","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.53},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.55}]}]},{"osd":1,"up_from":17,"seq":73014444075,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049184,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695968,"statfs":{"total":95995035648,"available":94920671232,"internally_reserved":1073741824,"allocated":614400,"data_stored":232860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 27 04:45:54 2020","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.68400000000000005,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69599999999999995,"15min":0.68100000000000005},"min":{"1min":0.504,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.66600000000000004}]},{"osd":2,"last update":"Sat Jun 27 04:45:11 2020","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.76000000000000001,"15min":0.75},"min":{"1min":0.54500000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.55800000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.88600000000000001}]},{"osd":3,"last update":"Sat Jun 27 04:45:32 2020","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.67200000000000004,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3100000000000001,"5min":1.409,"15min":1.409},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.014,"15min":1.022},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.99199999999999999}]},{"osd":4,"last update":"Sat Jun 27 04:45:39 2020","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.135,"15min":1.131},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0349999999999999,"15min":1.0389999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.74099999999999999}]},{"osd":5,"last update":"Sat Jun 27 04:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0640000000000001,"15min":1.0680000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.2529999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2170000000000001,"15min":1.228},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.423,"5min":1.544,"15min":1.544},"last":1.022}]},{"osd":6,"last update":"Sat Jun 27 04:45:11 2020","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":1.391},{"interface":"front","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.1339999999999999}]},{"osd":7,"last update":"Sat Jun 27 04:45:25 2020","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.296},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1850000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640301,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049192,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695960,"statfs":{"total":95995035648,"available":94920663040,"internally_reserved":1073741824,"allocated":622592,"data_stored":233585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 27 04:45:52 2020","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.68000000000000005,"15min":0.628},"min":{"1min":0.52600000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.73699999999999999,"15min":0.65500000000000003},"min":{"1min":0.55800000000000005,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":3.3250000000000002,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":0.85399999999999998}]},{"osd":2,"last update":"Sat Jun 27 04:45:11 2020","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.77600000000000002,"15min":0.76400000000000001},"min":{"1min":0.60299999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.83399999999999996,"15min":0.81499999999999995},"min":{"1min":0.71399999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.621}]},{"osd":3,"last update":"Sat Jun 27 04:45:27 2020","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.86499999999999999,"15min":0.85999999999999999},"min":{"1min":0.65200000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.95999999999999996,"15min":0.96799999999999997},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4299999999999999,"5min":1.577,"15min":1.577},"last":0.90100000000000002}]},{"osd":4,"last update":"Sat Jun 27 04:45:37 2020","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2,"15min":1.1919999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.206,"15min":1.1839999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.649,"5min":2.649,"15min":2.649},"last":1.3280000000000001}]},{"osd":5,"last update":"Sat Jun 27 04:45:52 2020","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.216,"15min":1.224},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.01},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.252,"15min":1.2430000000000001},"min":{"1min":0.92400000000000004,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":3.1219999999999999,"5min":3.1219999999999999,"15min":3.1219999999999999},"last":1.0329999999999999}]},{"osd":6,"last update":"Sat Jun 27 04:45:11 2020","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.2669999999999999}]},{"osd":7,"last update":"Sat Jun 27 04:45:27 2020","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.1930000000000001}]}]},{"osd":2,"up_from":22,"seq":94489280551,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049180,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695972,"statfs":{"total":95995035648,"available":94920675328,"internally_reserved":1073741824,"allocated":610304,"data_stored":233519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 27 04:45:09 2020","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.78100000000000003,"15min":0.77400000000000002},"min":{"1min":0.54700000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.70899999999999996,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.3980000000000001,"5min":3.3980000000000001,"15min":3.3980000000000001},"last":0.57899999999999996}]},{"osd":1,"last update":"Sat Jun 27 04:45:09 2020","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.82999999999999996,"15min":0.81000000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.79800000000000004,"15min":0.76800000000000002},"min":{"1min":0.51500000000000001,"5min":0.499,"15min":0.499},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.68400000000000005}]},{"osd":3,"last update":"Sat Jun 27 04:45:27 2020","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.0009999999999999,"15min":0.97999999999999998},"min":{"1min":0.70499999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.94599999999999995,"15min":0.93799999999999994},"min":{"1min":0.63500000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.8849999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":0.90400000000000003}]},{"osd":4,"last update":"Sat Jun 27 04:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.135,"15min":1.109},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.4039999999999999,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":1.393},{"interface":"front","average":{"1min":1.369,"5min":1.21,"15min":1.1839999999999999},"min":{"1min":0.93600000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":3.746,"5min":3.746,"15min":3.746},"last":1.018}]},{"osd":5,"last update":"Sat Jun 27 04:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.3169999999999999,"15min":1.2749999999999999},"min":{"1min":0.90300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":4.1189999999999998,"5min":4.1189999999999998,"15min":4.1189999999999998},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.256,"15min":1.2170000000000001},"min":{"1min":1,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":5.0780000000000003,"5min":5.0780000000000003,"15min":5.0780000000000003},"last":1.0429999999999999}]},{"osd":6,"last update":"Sat Jun 27 04:45:09 2020","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.159},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":3.9289999999999998,"5min":3.9289999999999998,"15min":3.9289999999999998},"last":1.4239999999999999}]},{"osd":7,"last update":"Sat Jun 27 04:45:27 2020","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":1.274},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"min":{"1min":1.157,"5min":1.157,"15min":1.157},"max":{"1min":4.1669999999999998,"5min":4.1669999999999998,"15min":4.1669999999999998},"last":1.5089999999999999}]}]},{"osd":3,"up_from":27,"seq":115964117029,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049172,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695980,"statfs":{"total":95995035648,"available":94920683520,"internally_reserved":1073741824,"allocated":602112,"data_stored":232618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 27 04:45:26 2020","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.52200000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.873,"15min":0.85099999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.9989999999999997,"5min":4.9989999999999997,"15min":4.9989999999999997},"last":0.83499999999999996}]},{"osd":1,"last update":"Sat Jun 27 04:45:26 2020","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.91600000000000004,"15min":0.93200000000000005},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0980000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.91100000000000003,"15min":0.91300000000000003},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.80100000000000005}]},{"osd":2,"last update":"Sat Jun 27 04:45:26 2020","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.99099999999999999,"15min":0.995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.91600000000000004,"15min":0.90300000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":4.0739999999999998,"5min":4.0739999999999998,"15min":4.0739999999999998},"last":1.107}]},{"osd":4,"last update":"Sat Jun 27 04:45:39 2020","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.169,"15min":1.198},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5109999999999999,"5min":4.4500000000000002,"15min":4.4500000000000002},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.115,"15min":1.127},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":1.202}]},{"osd":5,"last update":"Sat Jun 27 04:45:55 2020","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.3,"15min":1.3460000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.456,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.2649999999999999,"15min":1.2809999999999999},"min":{"1min":0.83299999999999996,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.0780000000000001}]},{"osd":6,"last update":"Sat Jun 27 04:45:11 2020","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":4.9249999999999998,"5min":4.9249999999999998,"15min":4.9249999999999998},"last":1.47}]},{"osd":7,"last update":"Sat Jun 27 04:45:24 2020","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.242},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":4.5170000000000003,"5min":4.5170000000000003,"15min":4.5170000000000003},"last":1.603}]}]},{"osd":4,"up_from":32,"seq":137438953506,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049212,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695940,"statfs":{"total":95995035648,"available":94920642560,"internally_reserved":1073741824,"allocated":643072,"data_stored":233831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 27 04:45:40 2020","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.97299999999999998,"15min":0.97899999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3660000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.96899999999999997,"15min":0.98899999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.357,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":0.82399999999999995}]},{"osd":1,"last update":"Sat Jun 27 04:45:40 2020","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92000000000000004,"15min":0.91500000000000004},"min":{"1min":0.64300000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.337,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.046},{"interface":"front","average":{"1min":1.012,"5min":0.98299999999999998,"15min":0.97799999999999998},"min":{"1min":0.70699999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":5.1189999999999998}]},{"osd":2,"last update":"Sat Jun 27 04:45:40 2020","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.044,"15min":1.048},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.95599999999999996,"15min":0.96099999999999997},"min":{"1min":0.66300000000000003,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2170000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0980000000000001}]},{"osd":3,"last update":"Sat Jun 27 04:45:40 2020","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.95599999999999996,"15min":0.95099999999999996},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.042,"5min":1.008,"15min":1.002},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":5.4279999999999999}]},{"osd":5,"last update":"Sat Jun 27 04:45:57 2020","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.90700000000000003,"15min":0.88600000000000001},"min":{"1min":0.65300000000000002,"5min":0.627,"15min":0.627},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.024,"15min":1.0049999999999999},"min":{"1min":0.75700000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.508,"5min":1.661,"15min":1.661},"last":0.96799999999999997}]},{"osd":6,"last update":"Sat Jun 27 04:45:10 2020","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.399}]},{"osd":7,"last update":"Sat Jun 27 04:45:23 2020","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.161},{"interface":"front","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.3140000000000001}]}]},{"osd":5,"up_from":37,"seq":158913789982,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049176,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695976,"statfs":{"total":95995035648,"available":94920679424,"internally_reserved":1073741824,"allocated":606208,"data_stored":233530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 27 04:45:52 2020","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.92000000000000004,"15min":0.93799999999999994},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2110000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.099},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92600000000000005,"15min":0.92100000000000004},"min":{"1min":0.74199999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.175}]},{"osd":1,"last update":"Sat Jun 27 04:45:52 2020","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94399999999999995,"15min":0.94299999999999995},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.208,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.204},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95999999999999996,"15min":0.96199999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.876}]},{"osd":2,"last update":"Sat Jun 27 04:45:52 2020","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.71199999999999997,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2949999999999999,"5min":1.371,"15min":1.371},"last":0.749},{"interface":"front","average":{"1min":1.121,"5min":0.98999999999999999,"15min":0.96799999999999997},"min":{"1min":0.74399999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.341}]},{"osd":3,"last update":"Sat Jun 27 04:45:52 2020","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":0.99199999999999999,"15min":0.96799999999999997},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1200000000000001,"15min":1.1120000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.4350000000000001}]},{"osd":4,"last update":"Sat Jun 27 04:45:52 2020","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.88900000000000001,"15min":0.871},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.131,"5min":0.98599999999999999,"15min":0.96199999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.022}]},{"osd":6,"last update":"Sat Jun 27 04:45:10 2020","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.502}]},{"osd":7,"last update":"Sat Jun 27 04:45:26 2020","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":1.232},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.581}]}]}]}} 2020-06-27T04:46:09.906 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2020-06-27T04:46:09.906 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-06-27T04:46:09.907 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2020-06-27T04:46:09.907 INFO:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 shell --fsid 12892ae2-b830-11ea-a06d-001a4aab830c -- ceph health --format=json 2020-06-27T04:46:10.054 INFO:teuthology.orchestra.run.smithi031.stderr:INFO:cephadm:Inferring config /var/lib/ceph/12892ae2-b830-11ea-a06d-001a4aab830c/mon.a/config 2020-06-27T04:46:10.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:10 smithi051 bash[18409]: cluster 2020-06-27T04:46:09.156523+0000 mgr.x (mgr.34109) 187 : cluster [DBG] pgmap v163: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:10.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:10 smithi051 bash[18409]: audit 2020-06-27T04:46:09.372522+0000 mgr.x (mgr.34109) 188 : audit [DBG] from='client.24571 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-06-27T04:46:10.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:10 smithi031 bash[18426]: cluster 2020-06-27T04:46:09.156523+0000 mgr.x (mgr.34109) 187 : cluster [DBG] pgmap v163: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:10.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:10 smithi031 bash[18426]: audit 2020-06-27T04:46:09.372522+0000 mgr.x (mgr.34109) 188 : audit [DBG] from='client.24571 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-06-27T04:46:10.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:10 smithi031 bash[22603]: cluster 2020-06-27T04:46:09.156523+0000 mgr.x (mgr.34109) 187 : cluster [DBG] pgmap v163: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:10.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:10 smithi031 bash[22603]: audit 2020-06-27T04:46:09.372522+0000 mgr.x (mgr.34109) 188 : audit [DBG] from='client.24571 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-06-27T04:46:11.663 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f811d371700 1 Processor -- start 2020-06-27T04:46:11.664 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f811d371700 1 -- start start 2020-06-27T04:46:11.664 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f811d371700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81180678c0 0x7f8118078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:11.664 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f811d371700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811806be40 0x7f811806c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:11.664 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f811d371700 1 --2- >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f811806cd70 0x7f8118122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:11.664 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f811d371700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81181232b0 con 0x7f81180678c0 2020-06-27T04:46:11.665 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f811d371700 1 -- --> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8118123420 con 0x7f811806cd70 2020-06-27T04:46:11.665 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f811d371700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81181235e0 con 0x7f811806be40 2020-06-27T04:46:11.665 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f8116ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811806be40 0x7f811806c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:11.665 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f8116ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811806be40 0x7f811806c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:36020/0 (socket says 172.21.15.31:36020) 2020-06-27T04:46:11.665 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f8116ffd700 1 -- 172.21.15.31:0/2301567135 learned_addr learned my addr 172.21.15.31:0/2301567135 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-06-27T04:46:11.666 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f81177fe700 1 --2- 172.21.15.31:0/2301567135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81180678c0 0x7f8118078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:11.666 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f8117fff700 1 --2- 172.21.15.31:0/2301567135 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f811806cd70 0x7f8118122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:11.666 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f8116ffd700 1 -- 172.21.15.31:0/2301567135 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f811806cd70 msgr2=0x7f8118122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:11.666 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f8116ffd700 1 --2- 172.21.15.31:0/2301567135 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f811806cd70 0x7f8118122cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:11.667 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f8116ffd700 1 -- 172.21.15.31:0/2301567135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81180678c0 msgr2=0x7f8118078990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:11.667 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f8116ffd700 1 --2- 172.21.15.31:0/2301567135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81180678c0 0x7f8118078990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:11.667 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f8116ffd700 1 -- 172.21.15.31:0/2301567135 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81181237a0 con 0x7f811806be40 2020-06-27T04:46:11.667 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.658+0000 7f81177fe700 1 --2- 172.21.15.31:0/2301567135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81180678c0 0x7f8118078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-27T04:46:11.667 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.659+0000 7f8116ffd700 1 --2- 172.21.15.31:0/2301567135 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811806be40 0x7f811806c740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f81080032f0 tx=0x7f8108004cf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:46:11.668 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.659+0000 7f810f7fe700 1 -- 172.21.15.31:0/2301567135 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f810800e030 con 0x7f811806be40 2020-06-27T04:46:11.668 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.659+0000 7f811d371700 1 -- 172.21.15.31:0/2301567135 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81181239f0 con 0x7f811806be40 2020-06-27T04:46:11.668 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.659+0000 7f810f7fe700 1 -- 172.21.15.31:0/2301567135 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(23 keys) v1 ==== 963+0+0 (secure 0 0 0) 0x7f8108013cb0 con 0x7f811806be40 2020-06-27T04:46:11.668 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.659+0000 7f810f7fe700 1 -- 172.21.15.31:0/2301567135 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8108018070 con 0x7f811806be40 2020-06-27T04:46:11.668 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.659+0000 7f811d371700 1 -- 172.21.15.31:0/2301567135 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8118123eb0 con 0x7f811806be40 2020-06-27T04:46:11.669 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.659+0000 7f810f7fe700 1 -- 172.21.15.31:0/2301567135 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 17) v1 ==== 31843+0+0 (secure 0 0 0) 0x7f8108024060 con 0x7f811806be40 2020-06-27T04:46:11.669 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.660+0000 7f810f7fe700 1 --2- 172.21.15.31:0/2301567135 >> v2:172.21.15.51:6800/950992045 conn(0x7f80f002ab00 0x7f80f002cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-06-27T04:46:11.669 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.660+0000 7f810f7fe700 1 -- 172.21.15.31:0/2301567135 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5894+0+0 (secure 0 0 0) 0x7f810803c4e0 con 0x7f811806be40 2020-06-27T04:46:11.669 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.660+0000 7f81177fe700 1 --2- 172.21.15.31:0/2301567135 >> v2:172.21.15.51:6800/950992045 conn(0x7f80f002ab00 0x7f80f002cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-06-27T04:46:11.669 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.660+0000 7f811d371700 1 -- 172.21.15.31:0/2301567135 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811805e210 con 0x7f811806be40 2020-06-27T04:46:11.670 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.660+0000 7f81177fe700 1 --2- 172.21.15.31:0/2301567135 >> v2:172.21.15.51:6800/950992045 conn(0x7f80f002ab00 0x7f80f002cfc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f810000d000 tx=0x7f8100007c50).ready entity=mgr.34109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-27T04:46:11.670 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.663+0000 7f810f7fe700 1 -- 172.21.15.31:0/2301567135 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132018 (secure 0 0 0) 0x7f8108012c30 con 0x7f811806be40 2020-06-27T04:46:11.877 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.874+0000 7f811d371700 1 -- 172.21.15.31:0/2301567135 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8118124040 con 0x7f811806be40 2020-06-27T04:46:11.878 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.874+0000 7f810f7fe700 1 -- 172.21.15.31:0/2301567135 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f810802e040 con 0x7f811806be40 2020-06-27T04:46:11.878 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-06-27T04:46:11.879 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.876+0000 7f811d371700 1 -- 172.21.15.31:0/2301567135 >> v2:172.21.15.51:6800/950992045 conn(0x7f80f002ab00 msgr2=0x7f80f002cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:11.879 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.876+0000 7f811d371700 1 --2- 172.21.15.31:0/2301567135 >> v2:172.21.15.51:6800/950992045 conn(0x7f80f002ab00 0x7f80f002cfc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f810000d000 tx=0x7f8100007c50).stop 2020-06-27T04:46:11.879 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.876+0000 7f811d371700 1 -- 172.21.15.31:0/2301567135 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811806be40 msgr2=0x7f811806c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:46:11.880 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.876+0000 7f811d371700 1 --2- 172.21.15.31:0/2301567135 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811806be40 0x7f811806c740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f81080032f0 tx=0x7f8108004cf0).stop 2020-06-27T04:46:11.880 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.876+0000 7f811d371700 1 -- 172.21.15.31:0/2301567135 shutdown_connections 2020-06-27T04:46:11.880 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.876+0000 7f811d371700 1 --2- 172.21.15.31:0/2301567135 >> v2:172.21.15.51:6800/950992045 conn(0x7f80f002ab00 0x7f80f002cfc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:11.880 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.876+0000 7f811d371700 1 --2- 172.21.15.31:0/2301567135 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x7f811806cd70 0x7f8118122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:11.880 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.876+0000 7f811d371700 1 --2- 172.21.15.31:0/2301567135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81180678c0 0x7f8118078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:11.881 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.876+0000 7f811d371700 1 --2- 172.21.15.31:0/2301567135 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811806be40 0x7f811806c740 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:46:11.881 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.876+0000 7f811d371700 1 -- 172.21.15.31:0/2301567135 >> 172.21.15.31:0/2301567135 conn(0x7f8118061840 msgr2=0x7f811806d360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:46:11.881 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.876+0000 7f811d371700 1 -- 172.21.15.31:0/2301567135 shutdown_connections 2020-06-27T04:46:11.881 INFO:teuthology.orchestra.run.smithi031.stderr:2020-06-27T04:46:11.876+0000 7f811d371700 1 -- 172.21.15.31:0/2301567135 wait complete. 2020-06-27T04:46:12.408 INFO:teuthology.orchestra.run.smithi031.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-06-27T04:46:12.409 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2020-06-27T04:46:12.410 INFO:tasks.cephadm:Setup complete, yielding 2020-06-27T04:46:12.410 INFO:teuthology.run_tasks:Running task workunit... 2020-06-27T04:46:12.426 INFO:tasks.workunit:Pulling workunits from ref 77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 2020-06-27T04:46:12.428 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-06-27T04:46:12.428 INFO:teuthology.orchestra.run.smithi031:> stat -- /home/ubuntu/cephtest/mnt.0 2020-06-27T04:46:12.447 INFO:teuthology.orchestra.run.smithi031.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-06-27T04:46:12.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-27T04:46:12.450 INFO:teuthology.orchestra.run.smithi031:> mkdir -- /home/ubuntu/cephtest/mnt.0 2020-06-27T04:46:12.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:12 smithi031 bash[22603]: cluster 2020-06-27T04:46:11.157166+0000 mgr.x (mgr.34109) 189 : cluster [DBG] pgmap v164: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:12.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:12 smithi031 bash[22603]: audit 2020-06-27T04:46:11.875808+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.31:0/2301567135' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2020-06-27T04:46:12.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:12 smithi031 bash[18426]: cluster 2020-06-27T04:46:11.157166+0000 mgr.x (mgr.34109) 189 : cluster [DBG] pgmap v164: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:12.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:12 smithi031 bash[18426]: audit 2020-06-27T04:46:11.875808+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.31:0/2301567135' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2020-06-27T04:46:12.489 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2020-06-27T04:46:12.489 INFO:teuthology.orchestra.run.smithi031:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2020-06-27T04:46:12.543 INFO:tasks.workunit:timeout=3h 2020-06-27T04:46:12.544 INFO:tasks.workunit:cleanup=True 2020-06-27T04:46:12.544 INFO:teuthology.orchestra.run.smithi031:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 2020-06-27T04:46:12.599 INFO:tasks.workunit.client.0.smithi031.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-06-27T04:46:12.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:12 smithi051 bash[18409]: cluster 2020-06-27T04:46:11.157166+0000 mgr.x (mgr.34109) 189 : cluster [DBG] pgmap v164: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:12.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:12 smithi051 bash[18409]: audit 2020-06-27T04:46:11.875808+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.31:0/2301567135' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2020-06-27T04:46:14.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:14 smithi031 bash[18426]: cluster 2020-06-27T04:46:13.157737+0000 mgr.x (mgr.34109) 190 : cluster [DBG] pgmap v165: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:14.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:14 smithi031 bash[22603]: cluster 2020-06-27T04:46:13.157737+0000 mgr.x (mgr.34109) 190 : cluster [DBG] pgmap v165: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:14.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:14 smithi051 bash[18409]: cluster 2020-06-27T04:46:13.157737+0000 mgr.x (mgr.34109) 190 : cluster [DBG] pgmap v165: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:16.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:16 smithi051 bash[18409]: cluster 2020-06-27T04:46:15.158509+0000 mgr.x (mgr.34109) 191 : cluster [DBG] pgmap v166: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:16.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:16 smithi031 bash[18426]: cluster 2020-06-27T04:46:15.158509+0000 mgr.x (mgr.34109) 191 : cluster [DBG] pgmap v166: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:16.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:16 smithi031 bash[22603]: cluster 2020-06-27T04:46:15.158509+0000 mgr.x (mgr.34109) 191 : cluster [DBG] pgmap v166: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:18.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:18 smithi051 bash[18409]: cluster 2020-06-27T04:46:17.159091+0000 mgr.x (mgr.34109) 192 : cluster [DBG] pgmap v167: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:18.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:18 smithi031 bash[18426]: cluster 2020-06-27T04:46:17.159091+0000 mgr.x (mgr.34109) 192 : cluster [DBG] pgmap v167: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:18.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:18 smithi031 bash[22603]: cluster 2020-06-27T04:46:17.159091+0000 mgr.x (mgr.34109) 192 : cluster [DBG] pgmap v167: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:20.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:20 smithi031 bash[18426]: cluster 2020-06-27T04:46:19.159844+0000 mgr.x (mgr.34109) 193 : cluster [DBG] pgmap v168: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:20.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:20 smithi031 bash[22603]: cluster 2020-06-27T04:46:19.159844+0000 mgr.x (mgr.34109) 193 : cluster [DBG] pgmap v168: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:20.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:20 smithi051 bash[18409]: cluster 2020-06-27T04:46:19.159844+0000 mgr.x (mgr.34109) 193 : cluster [DBG] pgmap v168: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:22.724 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:22 smithi051 bash[18409]: cluster 2020-06-27T04:46:21.160443+0000 mgr.x (mgr.34109) 194 : cluster [DBG] pgmap v169: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:22.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:22 smithi031 bash[18426]: cluster 2020-06-27T04:46:21.160443+0000 mgr.x (mgr.34109) 194 : cluster [DBG] pgmap v169: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:22.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:22 smithi031 bash[22603]: cluster 2020-06-27T04:46:21.160443+0000 mgr.x (mgr.34109) 194 : cluster [DBG] pgmap v169: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:24.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:24 smithi051 bash[18409]: cluster 2020-06-27T04:46:23.160926+0000 mgr.x (mgr.34109) 195 : cluster [DBG] pgmap v170: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:24.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:24 smithi031 bash[18426]: cluster 2020-06-27T04:46:23.160926+0000 mgr.x (mgr.34109) 195 : cluster [DBG] pgmap v170: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:24.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:24 smithi031 bash[22603]: cluster 2020-06-27T04:46:23.160926+0000 mgr.x (mgr.34109) 195 : cluster [DBG] pgmap v170: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:26.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:26 smithi051 bash[18409]: cluster 2020-06-27T04:46:25.161586+0000 mgr.x (mgr.34109) 196 : cluster [DBG] pgmap v171: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:26.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:26 smithi031 bash[18426]: cluster 2020-06-27T04:46:25.161586+0000 mgr.x (mgr.34109) 196 : cluster [DBG] pgmap v171: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:26.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:26 smithi031 bash[22603]: cluster 2020-06-27T04:46:25.161586+0000 mgr.x (mgr.34109) 196 : cluster [DBG] pgmap v171: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:28.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:28 smithi051 bash[18409]: cluster 2020-06-27T04:46:27.162114+0000 mgr.x (mgr.34109) 197 : cluster [DBG] pgmap v172: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:28.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:28 smithi031 bash[18426]: cluster 2020-06-27T04:46:27.162114+0000 mgr.x (mgr.34109) 197 : cluster [DBG] pgmap v172: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:28.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:28 smithi031 bash[22603]: cluster 2020-06-27T04:46:27.162114+0000 mgr.x (mgr.34109) 197 : cluster [DBG] pgmap v172: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:30.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:30 smithi031 bash[18426]: cluster 2020-06-27T04:46:29.162997+0000 mgr.x (mgr.34109) 198 : cluster [DBG] pgmap v173: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:30.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:30 smithi031 bash[22603]: cluster 2020-06-27T04:46:29.162997+0000 mgr.x (mgr.34109) 198 : cluster [DBG] pgmap v173: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:30.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:30 smithi051 bash[18409]: cluster 2020-06-27T04:46:29.162997+0000 mgr.x (mgr.34109) 198 : cluster [DBG] pgmap v173: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:32.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:32 smithi051 bash[18409]: cluster 2020-06-27T04:46:31.163732+0000 mgr.x (mgr.34109) 199 : cluster [DBG] pgmap v174: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:32.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:32 smithi031 bash[18426]: cluster 2020-06-27T04:46:31.163732+0000 mgr.x (mgr.34109) 199 : cluster [DBG] pgmap v174: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:32.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:32 smithi031 bash[22603]: cluster 2020-06-27T04:46:31.163732+0000 mgr.x (mgr.34109) 199 : cluster [DBG] pgmap v174: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:34.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:34 smithi051 bash[18409]: cluster 2020-06-27T04:46:33.164260+0000 mgr.x (mgr.34109) 200 : cluster [DBG] pgmap v175: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:34.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:34 smithi031 bash[18426]: cluster 2020-06-27T04:46:33.164260+0000 mgr.x (mgr.34109) 200 : cluster [DBG] pgmap v175: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:34.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:34 smithi031 bash[22603]: cluster 2020-06-27T04:46:33.164260+0000 mgr.x (mgr.34109) 200 : cluster [DBG] pgmap v175: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:36.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:36 smithi051 bash[18409]: cluster 2020-06-27T04:46:35.164982+0000 mgr.x (mgr.34109) 201 : cluster [DBG] pgmap v176: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:36.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:36 smithi031 bash[18426]: cluster 2020-06-27T04:46:35.164982+0000 mgr.x (mgr.34109) 201 : cluster [DBG] pgmap v176: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:36.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:36 smithi031 bash[22603]: cluster 2020-06-27T04:46:35.164982+0000 mgr.x (mgr.34109) 201 : cluster [DBG] pgmap v176: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:38.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:38 smithi051 bash[18409]: cluster 2020-06-27T04:46:37.165524+0000 mgr.x (mgr.34109) 202 : cluster [DBG] pgmap v177: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:38.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:38 smithi031 bash[22603]: cluster 2020-06-27T04:46:37.165524+0000 mgr.x (mgr.34109) 202 : cluster [DBG] pgmap v177: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:38.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:38 smithi031 bash[18426]: cluster 2020-06-27T04:46:37.165524+0000 mgr.x (mgr.34109) 202 : cluster [DBG] pgmap v177: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:40.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:40 smithi051 bash[18409]: cluster 2020-06-27T04:46:39.166108+0000 mgr.x (mgr.34109) 203 : cluster [DBG] pgmap v178: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:40.722 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:40 smithi031 bash[22603]: cluster 2020-06-27T04:46:39.166108+0000 mgr.x (mgr.34109) 203 : cluster [DBG] pgmap v178: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:40.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:40 smithi031 bash[18426]: cluster 2020-06-27T04:46:39.166108+0000 mgr.x (mgr.34109) 203 : cluster [DBG] pgmap v178: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:42.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:42 smithi051 bash[18409]: cluster 2020-06-27T04:46:41.166791+0000 mgr.x (mgr.34109) 204 : cluster [DBG] pgmap v179: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:42.722 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:42 smithi031 bash[22603]: cluster 2020-06-27T04:46:41.166791+0000 mgr.x (mgr.34109) 204 : cluster [DBG] pgmap v179: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:42.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:42 smithi031 bash[18426]: cluster 2020-06-27T04:46:41.166791+0000 mgr.x (mgr.34109) 204 : cluster [DBG] pgmap v179: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:44.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:44 smithi051 bash[18409]: cluster 2020-06-27T04:46:43.167248+0000 mgr.x (mgr.34109) 205 : cluster [DBG] pgmap v180: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:44.722 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:44 smithi031 bash[22603]: cluster 2020-06-27T04:46:43.167248+0000 mgr.x (mgr.34109) 205 : cluster [DBG] pgmap v180: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:44.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:44 smithi031 bash[18426]: cluster 2020-06-27T04:46:43.167248+0000 mgr.x (mgr.34109) 205 : cluster [DBG] pgmap v180: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:46.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:46 smithi051 bash[18409]: cluster 2020-06-27T04:46:45.168023+0000 mgr.x (mgr.34109) 206 : cluster [DBG] pgmap v181: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:46.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:46 smithi031 bash[18426]: cluster 2020-06-27T04:46:45.168023+0000 mgr.x (mgr.34109) 206 : cluster [DBG] pgmap v181: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:46.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:46 smithi031 bash[22603]: cluster 2020-06-27T04:46:45.168023+0000 mgr.x (mgr.34109) 206 : cluster [DBG] pgmap v181: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:48.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:48 smithi051 bash[18409]: cluster 2020-06-27T04:46:47.168681+0000 mgr.x (mgr.34109) 207 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:48.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:48 smithi031 bash[22603]: cluster 2020-06-27T04:46:47.168681+0000 mgr.x (mgr.34109) 207 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:48.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:48 smithi031 bash[18426]: cluster 2020-06-27T04:46:47.168681+0000 mgr.x (mgr.34109) 207 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:50.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:50 smithi051 bash[18409]: cluster 2020-06-27T04:46:49.169488+0000 mgr.x (mgr.34109) 208 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:50.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:50 smithi031 bash[18426]: cluster 2020-06-27T04:46:49.169488+0000 mgr.x (mgr.34109) 208 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:50.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:50 smithi031 bash[22603]: cluster 2020-06-27T04:46:49.169488+0000 mgr.x (mgr.34109) 208 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:52.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:52 smithi051 bash[18409]: cluster 2020-06-27T04:46:51.170113+0000 mgr.x (mgr.34109) 209 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:52.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:52 smithi031 bash[18426]: cluster 2020-06-27T04:46:51.170113+0000 mgr.x (mgr.34109) 209 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:52.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:52 smithi031 bash[22603]: cluster 2020-06-27T04:46:51.170113+0000 mgr.x (mgr.34109) 209 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:54.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:54 smithi051 bash[18409]: cluster 2020-06-27T04:46:53.170740+0000 mgr.x (mgr.34109) 210 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:54.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:54 smithi031 bash[18426]: cluster 2020-06-27T04:46:53.170740+0000 mgr.x (mgr.34109) 210 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:54.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:54 smithi031 bash[22603]: cluster 2020-06-27T04:46:53.170740+0000 mgr.x (mgr.34109) 210 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:56.077 INFO:tasks.workunit.client.0.smithi031.stderr:Note: checking out '77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5'. 2020-06-27T04:46:56.077 INFO:tasks.workunit.client.0.smithi031.stderr: 2020-06-27T04:46:56.077 INFO:tasks.workunit.client.0.smithi031.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-06-27T04:46:56.077 INFO:tasks.workunit.client.0.smithi031.stderr:changes and commit them, and you can discard any commits you make in this 2020-06-27T04:46:56.078 INFO:tasks.workunit.client.0.smithi031.stderr:state without impacting any branches by performing another checkout. 2020-06-27T04:46:56.078 INFO:tasks.workunit.client.0.smithi031.stderr: 2020-06-27T04:46:56.078 INFO:tasks.workunit.client.0.smithi031.stderr:If you want to create a new branch to retain commits you create, you may 2020-06-27T04:46:56.078 INFO:tasks.workunit.client.0.smithi031.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-06-27T04:46:56.078 INFO:tasks.workunit.client.0.smithi031.stderr: 2020-06-27T04:46:56.079 INFO:tasks.workunit.client.0.smithi031.stderr: git checkout -b 2020-06-27T04:46:56.079 INFO:tasks.workunit.client.0.smithi031.stderr: 2020-06-27T04:46:56.079 INFO:tasks.workunit.client.0.smithi031.stderr:HEAD is now at 77ddaecfcb0 Merge branch 'wip-mgr-track-pending-module' of https://github.com/tchaikov/ceph into wip-kefu-testing-2020-06-26-1211 2020-06-27T04:46:56.082 INFO:teuthology.orchestra.run.smithi031:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-06-27T04:46:56.156 INFO:tasks.workunit.client.0.smithi031.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-06-27T04:46:56.158 INFO:tasks.workunit.client.0.smithi031.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-06-27T04:46:56.158 INFO:tasks.workunit.client.0.smithi031.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-06-27T04:46:56.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:56 smithi051 bash[18409]: cluster 2020-06-27T04:46:55.171368+0000 mgr.x (mgr.34109) 211 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:56.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:56 smithi031 bash[18426]: cluster 2020-06-27T04:46:55.171368+0000 mgr.x (mgr.34109) 211 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:56.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:56 smithi031 bash[22603]: cluster 2020-06-27T04:46:55.171368+0000 mgr.x (mgr.34109) 211 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:46:56.781 INFO:tasks.workunit.client.0.smithi031.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-06-27T04:46:56.835 INFO:tasks.workunit.client.0.smithi031.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-06-27T04:46:56.874 INFO:tasks.workunit.client.0.smithi031.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-06-27T04:46:56.876 INFO:tasks.workunit.client.0.smithi031.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-06-27T04:46:56.876 INFO:tasks.workunit.client.0.smithi031.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-06-27T04:46:56.914 INFO:tasks.workunit.client.0.smithi031.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-06-27T04:46:56.987 DEBUG:teuthology.orchestra.remote:smithi031:/home/ubuntu/cephtest/workunits.list.client.0 is 5KB 2020-06-27T04:46:57.036 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2020-06-27T04:46:57.037 INFO:tasks.workunit:Running workunit rados/test.sh... 2020-06-27T04:46:57.037 INFO:teuthology.orchestra.run.smithi031:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2020-06-27T04:46:57.192 INFO:tasks.workunit.client.0.smithi031.stderr:+ parallel=1 2020-06-27T04:46:57.192 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' '' = --serial ']' 2020-06-27T04:46:57.192 INFO:tasks.workunit.client.0.smithi031.stderr:+ color= 2020-06-27T04:46:57.193 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' -t 1 ']' 2020-06-27T04:46:57.193 INFO:tasks.workunit.client.0.smithi031.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2020-06-27T04:46:57.193 INFO:tasks.workunit.client.0.smithi031.stderr:+ declare -A pids 2020-06-27T04:46:57.193 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.194 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.194 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_aio 2020-06-27T04:46:57.194 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_aio' 2020-06-27T04:46:57.194 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_aio 2020-06-27T04:46:57.194 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.196 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_aio 2020-06-27T04:46:57.196 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41110 2020-06-27T04:46:57.196 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_aio on pid 41110' 2020-06-27T04:46:57.196 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41110 2020-06-27T04:46:57.196 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.197 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.197 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2020-06-27T04:46:57.197 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_aio_pp 2020-06-27T04:46:57.197 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_aio_pp' 2020-06-27T04:46:57.197 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_aio_pp 2020-06-27T04:46:57.198 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.198 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_aio 2020-06-27T04:46:57.198 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_aio.log 2020-06-27T04:46:57.198 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_aio: /' 2020-06-27T04:46:57.198 INFO:tasks.workunit.client.0.smithi031.stdout:test api_aio on pid 41110 2020-06-27T04:46:57.201 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_aio_pp 2020-06-27T04:46:57.201 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41118 2020-06-27T04:46:57.201 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_aio_pp on pid 41118' 2020-06-27T04:46:57.202 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41118 2020-06-27T04:46:57.202 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.202 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.202 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2020-06-27T04:46:57.203 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_io 2020-06-27T04:46:57.203 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_io' 2020-06-27T04:46:57.203 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_io 2020-06-27T04:46:57.203 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.203 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_aio_pp 2020-06-27T04:46:57.206 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_aio_pp: /' 2020-06-27T04:46:57.206 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_io 2020-06-27T04:46:57.206 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41126 2020-06-27T04:46:57.206 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_io on pid 41126' 2020-06-27T04:46:57.206 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41126 2020-06-27T04:46:57.207 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.207 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.207 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2020-06-27T04:46:57.207 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_io_pp 2020-06-27T04:46:57.207 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_aio_pp.log 2020-06-27T04:46:57.208 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_io_pp' 2020-06-27T04:46:57.208 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_io_pp 2020-06-27T04:46:57.208 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.210 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_io.log 2020-06-27T04:46:57.210 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_io 2020-06-27T04:46:57.210 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_io: /' 2020-06-27T04:46:57.210 INFO:tasks.workunit.client.0.smithi031.stdout:test api_aio_pp on pid 41118 2020-06-27T04:46:57.211 INFO:tasks.workunit.client.0.smithi031.stdout:test api_io on pid 41126 2020-06-27T04:46:57.214 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_io_pp 2020-06-27T04:46:57.215 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41134 2020-06-27T04:46:57.215 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_io_pp on pid 41134' 2020-06-27T04:46:57.215 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41134 2020-06-27T04:46:57.215 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.215 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.216 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2020-06-27T04:46:57.216 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_io_pp 2020-06-27T04:46:57.216 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_asio 2020-06-27T04:46:57.216 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_io_pp.log 2020-06-27T04:46:57.216 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_io_pp: /' 2020-06-27T04:46:57.216 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_asio' 2020-06-27T04:46:57.217 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_asio 2020-06-27T04:46:57.217 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.217 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_asio 2020-06-27T04:46:57.217 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41142 2020-06-27T04:46:57.217 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_asio on pid 41142' 2020-06-27T04:46:57.218 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41142 2020-06-27T04:46:57.218 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.218 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.218 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_list 2020-06-27T04:46:57.218 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_list' 2020-06-27T04:46:57.218 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2020-06-27T04:46:57.219 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_list 2020-06-27T04:46:57.219 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.219 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_asio 2020-06-27T04:46:57.219 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_asio.log 2020-06-27T04:46:57.219 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_list 2020-06-27T04:46:57.220 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_asio: /' 2020-06-27T04:46:57.220 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41150 2020-06-27T04:46:57.220 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_list on pid 41150' 2020-06-27T04:46:57.220 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41150 2020-06-27T04:46:57.220 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.220 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.221 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2020-06-27T04:46:57.221 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_lock 2020-06-27T04:46:57.221 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_lock' 2020-06-27T04:46:57.221 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_list 2020-06-27T04:46:57.221 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_list.log 2020-06-27T04:46:57.222 INFO:tasks.workunit.client.0.smithi031.stdout:test api_io_pp on pid 41134 2020-06-27T04:46:57.222 INFO:tasks.workunit.client.0.smithi031.stdout:test api_asio on pid 41142 2020-06-27T04:46:57.222 INFO:tasks.workunit.client.0.smithi031.stdout:test api_list on pid 41150 2020-06-27T04:46:57.223 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.223 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_lock 2020-06-27T04:46:57.224 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_list: /' 2020-06-27T04:46:57.224 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_lock 2020-06-27T04:46:57.224 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41158 2020-06-27T04:46:57.224 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_lock on pid 41158' 2020-06-27T04:46:57.224 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41158 2020-06-27T04:46:57.225 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.225 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.225 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_lock_pp 2020-06-27T04:46:57.225 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_lock_pp' 2020-06-27T04:46:57.226 INFO:tasks.workunit.client.0.smithi031.stdout:test api_lock on pid 41158 2020-06-27T04:46:57.227 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_lock_pp 2020-06-27T04:46:57.227 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2020-06-27T04:46:57.227 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.228 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_lock 2020-06-27T04:46:57.228 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_lock: /' 2020-06-27T04:46:57.228 INFO:tasks.workunit.client.0.smithi031.stdout:test api_lock_pp on pid 41172 2020-06-27T04:46:57.229 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_lock_pp 2020-06-27T04:46:57.229 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41172 2020-06-27T04:46:57.229 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_lock_pp on pid 41172' 2020-06-27T04:46:57.229 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41172 2020-06-27T04:46:57.230 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.230 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.230 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2020-06-27T04:46:57.231 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_lock_pp 2020-06-27T04:46:57.232 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_lock_pp: /' 2020-06-27T04:46:57.232 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_lock.log 2020-06-27T04:46:57.233 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_misc 2020-06-27T04:46:57.234 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_misc' 2020-06-27T04:46:57.235 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_lock_pp.log 2020-06-27T04:46:57.237 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_misc 2020-06-27T04:46:57.237 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.243 INFO:tasks.workunit.client.0.smithi031.stdout:test api_misc on pid 41229 2020-06-27T04:46:57.243 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_misc 2020-06-27T04:46:57.243 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41229 2020-06-27T04:46:57.244 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_misc on pid 41229' 2020-06-27T04:46:57.244 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41229 2020-06-27T04:46:57.244 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.244 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.251 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2020-06-27T04:46:57.251 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_misc_pp 2020-06-27T04:46:57.252 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_misc_pp' 2020-06-27T04:46:57.258 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_misc.log 2020-06-27T04:46:57.270 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_misc_pp 2020-06-27T04:46:57.271 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.271 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_misc 2020-06-27T04:46:57.271 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_misc: /' 2020-06-27T04:46:57.271 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_misc_pp 2020-06-27T04:46:57.271 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41275 2020-06-27T04:46:57.272 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_misc_pp on pid 41275' 2020-06-27T04:46:57.272 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41275 2020-06-27T04:46:57.272 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.272 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.273 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_tier_pp 2020-06-27T04:46:57.273 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_tier_pp' 2020-06-27T04:46:57.273 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2020-06-27T04:46:57.273 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_tier_pp 2020-06-27T04:46:57.273 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.274 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_misc_pp 2020-06-27T04:46:57.274 INFO:tasks.workunit.client.0.smithi031.stdout:test api_misc_pp on pid 41275 2020-06-27T04:46:57.275 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_tier_pp 2020-06-27T04:46:57.275 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41315 2020-06-27T04:46:57.275 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_tier_pp on pid 41315' 2020-06-27T04:46:57.276 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41315 2020-06-27T04:46:57.276 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.276 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.276 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_misc_pp: /' 2020-06-27T04:46:57.276 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2020-06-27T04:46:57.277 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_pool 2020-06-27T04:46:57.277 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_pool' 2020-06-27T04:46:57.277 INFO:tasks.workunit.client.0.smithi031.stdout:test api_tier_pp on pid 41315 2020-06-27T04:46:57.278 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_tier_pp 2020-06-27T04:46:57.278 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_tier_pp.log 2020-06-27T04:46:57.279 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_tier_pp: /' 2020-06-27T04:46:57.279 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_pool 2020-06-27T04:46:57.279 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.280 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_misc_pp.log 2020-06-27T04:46:57.282 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_pool 2020-06-27T04:46:57.282 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41324 2020-06-27T04:46:57.282 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_pool on pid 41324' 2020-06-27T04:46:57.283 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41324 2020-06-27T04:46:57.283 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.283 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.283 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2020-06-27T04:46:57.283 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_snapshots 2020-06-27T04:46:57.284 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_snapshots' 2020-06-27T04:46:57.284 INFO:tasks.workunit.client.0.smithi031.stdout:test api_pool on pid 41324 2020-06-27T04:46:57.284 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_pool 2020-06-27T04:46:57.285 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_pool.log 2020-06-27T04:46:57.285 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_pool: /' 2020-06-27T04:46:57.285 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_snapshots 2020-06-27T04:46:57.286 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.288 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_snapshots 2020-06-27T04:46:57.288 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41332 2020-06-27T04:46:57.288 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_snapshots on pid 41332' 2020-06-27T04:46:57.288 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41332 2020-06-27T04:46:57.289 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.289 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.289 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2020-06-27T04:46:57.289 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_snapshots_pp 2020-06-27T04:46:57.289 INFO:tasks.workunit.client.0.smithi031.stdout:test api_snapshots on pid 41332 2020-06-27T04:46:57.290 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_snapshots_pp' 2020-06-27T04:46:57.291 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_snapshots 2020-06-27T04:46:57.291 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_snapshots.log 2020-06-27T04:46:57.292 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_snapshots: /' 2020-06-27T04:46:57.292 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_snapshots_pp 2020-06-27T04:46:57.292 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.298 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_snapshots_pp 2020-06-27T04:46:57.299 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41346 2020-06-27T04:46:57.299 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_snapshots_pp on pid 41346' 2020-06-27T04:46:57.299 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41346 2020-06-27T04:46:57.299 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.299 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.300 INFO:tasks.workunit.client.0.smithi031.stdout:test api_snapshots_pp on pid 41346 2020-06-27T04:46:57.300 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2020-06-27T04:46:57.300 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_stat 2020-06-27T04:46:57.301 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_stat' 2020-06-27T04:46:57.301 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_snapshots_pp 2020-06-27T04:46:57.302 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2020-06-27T04:46:57.302 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_snapshots_pp: /' 2020-06-27T04:46:57.302 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_stat 2020-06-27T04:46:57.302 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.307 INFO:tasks.workunit.client.0.smithi031.stdout:test api_stat on pid 41359 2020-06-27T04:46:57.307 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_stat 2020-06-27T04:46:57.307 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41359 2020-06-27T04:46:57.307 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_stat on pid 41359' 2020-06-27T04:46:57.308 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41359 2020-06-27T04:46:57.308 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.308 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.309 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2020-06-27T04:46:57.309 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_stat_pp 2020-06-27T04:46:57.309 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_stat_pp' 2020-06-27T04:46:57.311 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_stat_pp 2020-06-27T04:46:57.312 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.313 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_stat 2020-06-27T04:46:57.313 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_stat.log 2020-06-27T04:46:57.314 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_stat: /' 2020-06-27T04:46:57.316 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_stat_pp 2020-06-27T04:46:57.316 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41381 2020-06-27T04:46:57.316 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_stat_pp on pid 41381' 2020-06-27T04:46:57.316 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41381 2020-06-27T04:46:57.317 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.317 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.317 INFO:tasks.workunit.client.0.smithi031.stdout:test api_stat_pp on pid 41381 2020-06-27T04:46:57.318 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2020-06-27T04:46:57.319 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_watch_notify 2020-06-27T04:46:57.319 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_watch_notify' 2020-06-27T04:46:57.322 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_stat_pp 2020-06-27T04:46:57.322 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_stat_pp.log 2020-06-27T04:46:57.323 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_stat_pp: /' 2020-06-27T04:46:57.324 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_watch_notify 2020-06-27T04:46:57.324 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.331 INFO:tasks.workunit.client.0.smithi031.stdout:test api_watch_notify on pid 41427 2020-06-27T04:46:57.331 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_watch_notify 2020-06-27T04:46:57.331 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41427 2020-06-27T04:46:57.332 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_watch_notify on pid 41427' 2020-06-27T04:46:57.332 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41427 2020-06-27T04:46:57.332 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.333 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.333 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2020-06-27T04:46:57.333 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_watch_notify: /' 2020-06-27T04:46:57.334 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_watch_notify.log 2020-06-27T04:46:57.334 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_watch_notify 2020-06-27T04:46:57.335 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_watch_notify_pp 2020-06-27T04:46:57.336 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_watch_notify_pp' 2020-06-27T04:46:57.340 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_watch_notify_pp 2020-06-27T04:46:57.343 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.348 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_watch_notify_pp 2020-06-27T04:46:57.348 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41460 2020-06-27T04:46:57.348 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_watch_notify_pp on pid 41460' 2020-06-27T04:46:57.349 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41460 2020-06-27T04:46:57.349 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.349 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.349 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_cmd 2020-06-27T04:46:57.349 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_cmd' 2020-06-27T04:46:57.350 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2020-06-27T04:46:57.350 INFO:tasks.workunit.client.0.smithi031.stdout:test api_watch_notify_pp on pid 41460 2020-06-27T04:46:57.350 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2020-06-27T04:46:57.351 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2020-06-27T04:46:57.351 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_watch_notify_pp 2020-06-27T04:46:57.354 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.355 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_cmd 2020-06-27T04:46:57.357 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_cmd 2020-06-27T04:46:57.357 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41476 2020-06-27T04:46:57.358 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_cmd on pid 41476' 2020-06-27T04:46:57.358 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41476 2020-06-27T04:46:57.358 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.358 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.358 INFO:tasks.workunit.client.0.smithi031.stdout:test api_cmd on pid 41476 2020-06-27T04:46:57.359 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2020-06-27T04:46:57.360 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_cmd_pp 2020-06-27T04:46:57.360 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_cmd_pp' 2020-06-27T04:46:57.361 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.362 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_cmd_pp 2020-06-27T04:46:57.364 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_cmd 2020-06-27T04:46:57.365 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_cmd.log 2020-06-27T04:46:57.365 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_cmd: /' 2020-06-27T04:46:57.365 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_cmd_pp 2020-06-27T04:46:57.365 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41491 2020-06-27T04:46:57.365 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_cmd_pp on pid 41491' 2020-06-27T04:46:57.366 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41491 2020-06-27T04:46:57.366 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.366 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.367 INFO:tasks.workunit.client.0.smithi031.stdout:test api_cmd_pp on pid 41491 2020-06-27T04:46:57.367 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_service 2020-06-27T04:46:57.368 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_service' 2020-06-27T04:46:57.368 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2020-06-27T04:46:57.368 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_cmd_pp: /' 2020-06-27T04:46:57.369 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2020-06-27T04:46:57.369 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_cmd_pp 2020-06-27T04:46:57.377 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_service 2020-06-27T04:46:57.377 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.379 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_service 2020-06-27T04:46:57.379 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41528 2020-06-27T04:46:57.380 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_service on pid 41528' 2020-06-27T04:46:57.380 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41528 2020-06-27T04:46:57.380 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.380 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.380 INFO:tasks.workunit.client.0.smithi031.stdout:test api_service on pid 41528 2020-06-27T04:46:57.381 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_service_pp 2020-06-27T04:46:57.381 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_service_pp' 2020-06-27T04:46:57.382 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2020-06-27T04:46:57.382 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_service_pp 2020-06-27T04:46:57.382 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.383 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_service: /' 2020-06-27T04:46:57.383 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_service.log 2020-06-27T04:46:57.383 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_service 2020-06-27T04:46:57.384 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_service_pp 2020-06-27T04:46:57.385 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41536 2020-06-27T04:46:57.385 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_service_pp on pid 41536' 2020-06-27T04:46:57.385 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41536 2020-06-27T04:46:57.385 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.386 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.386 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2020-06-27T04:46:57.386 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_c_write_operations 2020-06-27T04:46:57.386 INFO:tasks.workunit.client.0.smithi031.stdout:test api_service_pp on pid 41536 2020-06-27T04:46:57.387 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_c_write_operations' 2020-06-27T04:46:57.387 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_c_write_operations 2020-06-27T04:46:57.387 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.388 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_c_write_operations 2020-06-27T04:46:57.389 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41541 2020-06-27T04:46:57.389 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_c_write_operations on pid 41541' 2020-06-27T04:46:57.390 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41541 2020-06-27T04:46:57.390 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.390 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.390 INFO:tasks.workunit.client.0.smithi031.stdout:test api_c_write_operations on pid 41541 2020-06-27T04:46:57.391 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2020-06-27T04:46:57.392 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s api_c_read_operations 2020-06-27T04:46:57.392 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' api_c_read_operations' 2020-06-27T04:46:57.392 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_service_pp 2020-06-27T04:46:57.392 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_service_pp.log 2020-06-27T04:46:57.393 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_c_write_operations 2020-06-27T04:46:57.393 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_service_pp: /' 2020-06-27T04:46:57.393 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2020-06-27T04:46:57.396 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_c_write_operations: /' 2020-06-27T04:46:57.399 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.401 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo api_c_read_operations 2020-06-27T04:46:57.402 INFO:tasks.workunit.client.0.smithi031.stdout:test api_c_read_operations on pid 41563 2020-06-27T04:46:57.403 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=api_c_read_operations 2020-06-27T04:46:57.403 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41563 2020-06-27T04:46:57.403 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test api_c_read_operations on pid 41563' 2020-06-27T04:46:57.403 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41563 2020-06-27T04:46:57.403 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.404 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.404 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s list_parallel 2020-06-27T04:46:57.404 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2020-06-27T04:46:57.404 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' list_parallel' 2020-06-27T04:46:57.405 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.405 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo list_parallel 2020-06-27T04:46:57.406 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=list_parallel 2020-06-27T04:46:57.406 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41582 2020-06-27T04:46:57.407 INFO:tasks.workunit.client.0.smithi031.stdout:test list_parallel on pid 41582 2020-06-27T04:46:57.407 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test list_parallel on pid 41582' 2020-06-27T04:46:57.407 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41582 2020-06-27T04:46:57.407 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.408 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.408 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2020-06-27T04:46:57.408 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s open_pools_parallel 2020-06-27T04:46:57.409 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' open_pools_parallel' 2020-06-27T04:46:57.409 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_list_parallel 2020-06-27T04:46:57.409 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_list_parallel.log 2020-06-27T04:46:57.410 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ list_parallel: /' 2020-06-27T04:46:57.413 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ api_c_read_operations: /' 2020-06-27T04:46:57.413 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2020-06-27T04:46:57.416 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.425 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo open_pools_parallel 2020-06-27T04:46:57.425 INFO:tasks.workunit.client.0.smithi031.stdout:test open_pools_parallel on pid 41604 2020-06-27T04:46:57.426 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=open_pools_parallel 2020-06-27T04:46:57.426 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41604 2020-06-27T04:46:57.426 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test open_pools_parallel on pid 41604' 2020-06-27T04:46:57.426 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41604 2020-06-27T04:46:57.427 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2020-06-27T04:46:57.427 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.427 INFO:tasks.workunit.client.0.smithi031.stderr:++ printf %25s delete_pools_parallel 2020-06-27T04:46:57.428 INFO:tasks.workunit.client.0.smithi031.stderr:+ r=' delete_pools_parallel' 2020-06-27T04:46:57.428 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2020-06-27T04:46:57.429 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ open_pools_parallel: /' 2020-06-27T04:46:57.429 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2020-06-27T04:46:57.429 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_open_pools_parallel 2020-06-27T04:46:57.430 INFO:tasks.workunit.client.0.smithi031.stderr:++ echo delete_pools_parallel 2020-06-27T04:46:57.432 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_api_c_read_operations 2020-06-27T04:46:57.444 INFO:tasks.workunit.client.0.smithi031.stderr:++ awk '{print $1}' 2020-06-27T04:46:57.449 INFO:tasks.workunit.client.0.smithi031.stderr:+ ff=delete_pools_parallel 2020-06-27T04:46:57.449 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41645 2020-06-27T04:46:57.449 INFO:tasks.workunit.client.0.smithi031.stderr:+ echo 'test delete_pools_parallel on pid 41645' 2020-06-27T04:46:57.450 INFO:tasks.workunit.client.0.smithi031.stderr:+ pids[$f]=41645 2020-06-27T04:46:57.450 INFO:tasks.workunit.client.0.smithi031.stderr:+ ret=0 2020-06-27T04:46:57.450 INFO:tasks.workunit.client.0.smithi031.stderr:+ '[' 1 -eq 1 ']' 2020-06-27T04:46:57.450 INFO:tasks.workunit.client.0.smithi031.stderr:+ for t in "${!pids[@]}" 2020-06-27T04:46:57.450 INFO:tasks.workunit.client.0.smithi031.stderr:+ pid=41332 2020-06-27T04:46:57.451 INFO:tasks.workunit.client.0.smithi031.stderr:+ wait 41332 2020-06-27T04:46:57.451 INFO:tasks.workunit.client.0.smithi031.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2020-06-27T04:46:57.451 INFO:tasks.workunit.client.0.smithi031.stdout:test delete_pools_parallel on pid 41645 2020-06-27T04:46:57.452 INFO:tasks.workunit.client.0.smithi031.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2020-06-27T04:46:57.452 INFO:tasks.workunit.client.0.smithi031.stderr:+ sed 's/^/ delete_pools_parallel: /' 2020-06-27T04:46:57.452 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_rados_delete_pools_parallel 2020-06-27T04:46:58.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:46:58 smithi051 bash[18409]: audit 2020-06-27T04:46:57.417785+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.31:0/3006636955' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2020-06-27T04:46:58.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:46:58 smithi031 bash[18426]: audit 2020-06-27T04:46:57.417785+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.31:0/3006636955' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2020-06-27T04:46:58.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:46:58 smithi031 bash[22603]: audit 2020-06-27T04:46:57.417785+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.31:0/3006636955' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2020-06-27T04:47:04.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:03 smithi051 bash[18409]: cluster 2020-06-27T04:46:57.171917+0000 mgr.x (mgr.34109) 212 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:47:04.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:03 smithi031 bash[18426]: cluster 2020-06-27T04:46:57.171917+0000 mgr.x (mgr.34109) 212 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:47:04.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:03 smithi031 bash[22603]: cluster 2020-06-27T04:46:57.171917+0000 mgr.x (mgr.34109) 212 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:47:07.979 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2020-06-27T04:47:07.980 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [----------] Global test environment set-up. 2020-06-27T04:47:07.980 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [----------] 12 tests from AsioRados 2020-06-27T04:47:07.980 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2020-06-27T04:47:07.980 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (1 ms) 2020-06-27T04:47:07.981 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2020-06-27T04:47:07.981 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (1 ms) 2020-06-27T04:47:07.981 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2020-06-27T04:47:07.981 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (1 ms) 2020-06-27T04:47:07.981 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2020-06-27T04:47:07.982 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (8 ms) 2020-06-27T04:47:07.982 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2020-06-27T04:47:07.982 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (3 ms) 2020-06-27T04:47:07.982 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2020-06-27T04:47:07.982 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (2 ms) 2020-06-27T04:47:07.982 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2020-06-27T04:47:07.983 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (0 ms) 2020-06-27T04:47:07.983 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2020-06-27T04:47:07.983 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (1 ms) 2020-06-27T04:47:07.983 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2020-06-27T04:47:07.983 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (0 ms) 2020-06-27T04:47:07.983 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2020-06-27T04:47:07.984 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (1 ms) 2020-06-27T04:47:07.984 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2020-06-27T04:47:07.984 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (1 ms) 2020-06-27T04:47:07.984 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2020-06-27T04:47:07.984 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (2 ms) 2020-06-27T04:47:07.985 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [----------] 12 tests from AsioRados (22 ms total) 2020-06-27T04:47:07.985 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: 2020-06-27T04:47:07.985 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [----------] Global test environment tear-down 2020-06-27T04:47:07.985 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (10734 ms total) 2020-06-27T04:47:07.985 INFO:tasks.workunit.client.0.smithi031.stdout: api_asio: [ PASSED ] 12 tests. 2020-06-27T04:47:08.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:07 smithi051 bash[18409]: audit 2020-06-27T04:46:58.618137+0000 mon.c (mon.1) 26 : audit [INF] from='client.? 172.21.15.31:0/1184982122' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41131-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:08.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:07 smithi051 bash[18409]: audit 2020-06-27T04:46:58.624323+0000 mon.c (mon.1) 27 : audit [INF] from='client.? 172.21.15.31:0/2637502561' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:08.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:07 smithi051 bash[18409]: cluster 2020-06-27T04:46:59.172444+0000 mgr.x (mgr.34109) 213 : cluster [DBG] pgmap v189: 225 pgs: 96 unknown, 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:47:08.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:07 smithi051 bash[18409]: cluster 2020-06-27T04:47:01.173225+0000 mgr.x (mgr.34109) 214 : cluster [DBG] pgmap v190: 225 pgs: 22 creating+peering, 74 unknown, 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:47:08.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:07 smithi051 bash[18409]: cluster 2020-06-27T04:47:03.173825+0000 mgr.x (mgr.34109) 215 : cluster [DBG] pgmap v191: 225 pgs: 34 creating+peering, 62 unknown, 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:47:08.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:07 smithi051 bash[18409]: cluster 2020-06-27T04:47:03.838105+0000 mon.a (mon.0) 528 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2020-06-27T04:47:08.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:07 smithi051 bash[18409]: audit 2020-06-27T04:47:03.845277+0000 mon.a (mon.0) 529 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41131-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:08.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:07 smithi051 bash[18409]: audit 2020-06-27T04:47:03.845629+0000 mon.a (mon.0) 530 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:08.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:07 smithi051 bash[18409]: audit 2020-06-27T04:47:03.853966+0000 mon.a (mon.0) 531 : audit [INF] from='client.? 172.21.15.31:0/470153951' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41463-1"}]: dispatch 2020-06-27T04:47:08.222 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:07 smithi031 bash[22603]: audit 2020-06-27T04:46:58.618137+0000 mon.c (mon.1) 26 : audit [INF] from='client.? 172.21.15.31:0/1184982122' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41131-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:08.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:07 smithi031 bash[22603]: audit 2020-06-27T04:46:58.624323+0000 mon.c (mon.1) 27 : audit [INF] from='client.? 172.21.15.31:0/2637502561' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:08.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:07 smithi031 bash[22603]: cluster 2020-06-27T04:46:59.172444+0000 mgr.x (mgr.34109) 213 : cluster [DBG] pgmap v189: 225 pgs: 96 unknown, 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:47:08.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:07 smithi031 bash[22603]: cluster 2020-06-27T04:47:01.173225+0000 mgr.x (mgr.34109) 214 : cluster [DBG] pgmap v190: 225 pgs: 22 creating+peering, 74 unknown, 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:47:08.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:07 smithi031 bash[22603]: cluster 2020-06-27T04:47:03.173825+0000 mgr.x (mgr.34109) 215 : cluster [DBG] pgmap v191: 225 pgs: 34 creating+peering, 62 unknown, 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:47:08.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:07 smithi031 bash[22603]: cluster 2020-06-27T04:47:03.838105+0000 mon.a (mon.0) 528 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2020-06-27T04:47:08.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:07 smithi031 bash[22603]: audit 2020-06-27T04:47:03.845277+0000 mon.a (mon.0) 529 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41131-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:08.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:07 smithi031 bash[22603]: audit 2020-06-27T04:47:03.845629+0000 mon.a (mon.0) 530 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:08.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:07 smithi031 bash[22603]: audit 2020-06-27T04:47:03.853966+0000 mon.a (mon.0) 531 : audit [INF] from='client.? 172.21.15.31:0/470153951' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41463-1"}]: dispatch 2020-06-27T04:47:08.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:07 smithi031 bash[18426]: audit 2020-06-27T04:46:58.618137+0000 mon.c (mon.1) 26 : audit [INF] from='client.? 172.21.15.31:0/1184982122' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41131-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:08.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:07 smithi031 bash[18426]: audit 2020-06-27T04:46:58.624323+0000 mon.c (mon.1) 27 : audit [INF] from='client.? 172.21.15.31:0/2637502561' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:08.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:07 smithi031 bash[18426]: cluster 2020-06-27T04:46:59.172444+0000 mgr.x (mgr.34109) 213 : cluster [DBG] pgmap v189: 225 pgs: 96 unknown, 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:47:08.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:07 smithi031 bash[18426]: cluster 2020-06-27T04:47:01.173225+0000 mgr.x (mgr.34109) 214 : cluster [DBG] pgmap v190: 225 pgs: 22 creating+peering, 74 unknown, 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:47:08.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:07 smithi031 bash[18426]: cluster 2020-06-27T04:47:03.173825+0000 mgr.x (mgr.34109) 215 : cluster [DBG] pgmap v191: 225 pgs: 34 creating+peering, 62 unknown, 129 active+clean; 5.3 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:47:08.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:07 smithi031 bash[18426]: cluster 2020-06-27T04:47:03.838105+0000 mon.a (mon.0) 528 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2020-06-27T04:47:08.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:07 smithi031 bash[18426]: audit 2020-06-27T04:47:03.845277+0000 mon.a (mon.0) 529 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41131-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:08.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:07 smithi031 bash[18426]: audit 2020-06-27T04:47:03.845629+0000 mon.a (mon.0) 530 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:08.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:07 smithi031 bash[18426]: audit 2020-06-27T04:47:03.853966+0000 mon.a (mon.0) 531 : audit [INF] from='client.? 172.21.15.31:0/470153951' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41463-1"}]: dispatch 2020-06-27T04:47:09.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:03.864796+0000 mon.c (mon.1) 28 : audit [INF] from='client.? 172.21.15.31:0/738817609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41177-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:03.865921+0000 mon.c (mon.1) 29 : audit [INF] from='client.? 172.21.15.31:0/304875190' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41396-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:03.867246+0000 mon.b (mon.2) 263 : audit [INF] from='client.? 172.21.15.31:0/1483102306' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41166-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:03.867585+0000 mon.b (mon.2) 264 : audit [INF] from='client.? 172.21.15.31:0/4114743058' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41371-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:03.868269+0000 mon.b (mon.2) 265 : audit [INF] from='client.? 172.21.15.31:0/3835153647' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41337-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:03.875510+0000 mon.b (mon.2) 266 : audit [INF] from='client.? 172.21.15.31:0/682599815' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41153-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:03.876387+0000 mon.c (mon.1) 30 : audit [INF] from='client.? 172.21.15.31:0/103969585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41136-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:03.876767+0000 mon.c (mon.1) 31 : audit [INF] from='client.? 172.21.15.31:0/973090219' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: cluster 2020-06-27T04:47:05.174714+0000 mgr.x (mgr.34109) 216 : cluster [DBG] pgmap v193: 609 pgs: 92 creating+peering, 388 unknown, 129 active+clean; 5.3 KiB data, 4.9 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:47:09.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: cluster 2020-06-27T04:47:07.175762+0000 mgr.x (mgr.34109) 217 : cluster [DBG] pgmap v194: 609 pgs: 182 creating+peering, 298 unknown, 129 active+clean; 5.3 KiB data, 4.9 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:47:09.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: cluster 2020-06-27T04:47:07.791267+0000 mon.a (mon.0) 532 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2020-06-27T04:47:09.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.798449+0000 mon.a (mon.0) 533 : audit [INF] from='client.? 172.21.15.31:0/470153951' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41463-1"}]: dispatch 2020-06-27T04:47:09.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.799195+0000 mon.a (mon.0) 534 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41177-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.223 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.799343+0000 mon.a (mon.0) 535 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41166-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.223 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.799458+0000 mon.a (mon.0) 536 : audit [INF] from='client.? 172.21.15.31:0/37249264' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41123-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.223 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.799570+0000 mon.a (mon.0) 537 : audit [INF] from='client.? 172.21.15.31:0/3946992245' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41429-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.224 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.799713+0000 mon.a (mon.0) 538 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41396-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.224 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.799852+0000 mon.a (mon.0) 539 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41371-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.224 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.799991+0000 mon.a (mon.0) 540 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41136-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.225 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.800137+0000 mon.a (mon.0) 541 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41337-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.225 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.800609+0000 mon.a (mon.0) 542 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.225 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.801062+0000 mon.a (mon.0) 543 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41153-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.226 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.827141+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41131-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:09.226 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.827432+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:09.226 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.828869+0000 mon.c (mon.1) 32 : audit [INF] from='client.? 172.21.15.31:0/3753677238' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41349-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.227 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: cluster 2020-06-27T04:47:07.829150+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2020-06-27T04:47:09.227 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.832111+0000 mon.c (mon.1) 33 : audit [INF] from='client.? 172.21.15.31:0/3798049237' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41505-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.227 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.832372+0000 mon.c (mon.1) 34 : audit [INF] from='client.? 172.21.15.31:0/3555432694' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41488-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.228 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.836014+0000 mon.a (mon.0) 547 : audit [INF] from='client.? 172.21.15.31:0/470153951' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41463-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:47:09.228 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.836512+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41349-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.229 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:07.836810+0000 mon.a (mon.0) 549 : audit [INF] from='client.? 172.21.15.31:0/981946889' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41304-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.231 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:08.307035+0000 mon.a (mon.0) 550 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41505-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.232 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:08.307452+0000 mon.a (mon.0) 551 : audit [INF] from='client.? 172.21.15.31:0/3813448681' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.232 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:08.307665+0000 mon.a (mon.0) 552 : audit [INF] from='client.? 172.21.15.31:0/4009817187' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.232 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:08.307877+0000 mon.a (mon.0) 553 : audit [INF] from='client.? 172.21.15.31:0/1629758176' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41585-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.233 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:08 smithi051 bash[18409]: audit 2020-06-27T04:47:08.308145+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41488-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.234 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:03.864796+0000 mon.c (mon.1) 28 : audit [INF] from='client.? 172.21.15.31:0/738817609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41177-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.235 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:03.865921+0000 mon.c (mon.1) 29 : audit [INF] from='client.? 172.21.15.31:0/304875190' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41396-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.235 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:03.867246+0000 mon.b (mon.2) 263 : audit [INF] from='client.? 172.21.15.31:0/1483102306' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41166-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.235 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:03.867585+0000 mon.b (mon.2) 264 : audit [INF] from='client.? 172.21.15.31:0/4114743058' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41371-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.236 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:03.868269+0000 mon.b (mon.2) 265 : audit [INF] from='client.? 172.21.15.31:0/3835153647' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41337-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.236 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:03.875510+0000 mon.b (mon.2) 266 : audit [INF] from='client.? 172.21.15.31:0/682599815' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41153-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.236 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:03.876387+0000 mon.c (mon.1) 30 : audit [INF] from='client.? 172.21.15.31:0/103969585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41136-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.237 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:03.876767+0000 mon.c (mon.1) 31 : audit [INF] from='client.? 172.21.15.31:0/973090219' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.237 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: cluster 2020-06-27T04:47:05.174714+0000 mgr.x (mgr.34109) 216 : cluster [DBG] pgmap v193: 609 pgs: 92 creating+peering, 388 unknown, 129 active+clean; 5.3 KiB data, 4.9 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:47:09.237 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: cluster 2020-06-27T04:47:07.175762+0000 mgr.x (mgr.34109) 217 : cluster [DBG] pgmap v194: 609 pgs: 182 creating+peering, 298 unknown, 129 active+clean; 5.3 KiB data, 4.9 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:47:09.238 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: cluster 2020-06-27T04:47:07.791267+0000 mon.a (mon.0) 532 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2020-06-27T04:47:09.238 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.798449+0000 mon.a (mon.0) 533 : audit [INF] from='client.? 172.21.15.31:0/470153951' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41463-1"}]: dispatch 2020-06-27T04:47:09.238 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.799195+0000 mon.a (mon.0) 534 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41177-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.239 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.799343+0000 mon.a (mon.0) 535 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41166-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.239 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.799458+0000 mon.a (mon.0) 536 : audit [INF] from='client.? 172.21.15.31:0/37249264' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41123-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.239 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.799570+0000 mon.a (mon.0) 537 : audit [INF] from='client.? 172.21.15.31:0/3946992245' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41429-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.240 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.799713+0000 mon.a (mon.0) 538 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41396-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.240 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.799852+0000 mon.a (mon.0) 539 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41371-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.240 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.799991+0000 mon.a (mon.0) 540 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41136-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.241 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.800137+0000 mon.a (mon.0) 541 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41337-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.241 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.800609+0000 mon.a (mon.0) 542 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.241 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.801062+0000 mon.a (mon.0) 543 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41153-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.242 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.827141+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41131-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:09.242 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.827432+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:09.242 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.828869+0000 mon.c (mon.1) 32 : audit [INF] from='client.? 172.21.15.31:0/3753677238' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41349-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.243 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: cluster 2020-06-27T04:47:07.829150+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2020-06-27T04:47:09.243 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.832111+0000 mon.c (mon.1) 33 : audit [INF] from='client.? 172.21.15.31:0/3798049237' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41505-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.243 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.832372+0000 mon.c (mon.1) 34 : audit [INF] from='client.? 172.21.15.31:0/3555432694' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41488-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.244 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.836014+0000 mon.a (mon.0) 547 : audit [INF] from='client.? 172.21.15.31:0/470153951' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41463-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:47:09.244 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.836512+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41349-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.244 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:07.836810+0000 mon.a (mon.0) 549 : audit [INF] from='client.? 172.21.15.31:0/981946889' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41304-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.245 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:08.307035+0000 mon.a (mon.0) 550 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41505-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.245 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:08.307452+0000 mon.a (mon.0) 551 : audit [INF] from='client.? 172.21.15.31:0/3813448681' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.245 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:08.307665+0000 mon.a (mon.0) 552 : audit [INF] from='client.? 172.21.15.31:0/4009817187' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.246 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:08.307877+0000 mon.a (mon.0) 553 : audit [INF] from='client.? 172.21.15.31:0/1629758176' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41585-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.246 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[22603]: audit 2020-06-27T04:47:08.308145+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41488-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.246 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:03.864796+0000 mon.c (mon.1) 28 : audit [INF] from='client.? 172.21.15.31:0/738817609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41177-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.247 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:03.865921+0000 mon.c (mon.1) 29 : audit [INF] from='client.? 172.21.15.31:0/304875190' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41396-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.247 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:03.867246+0000 mon.b (mon.2) 263 : audit [INF] from='client.? 172.21.15.31:0/1483102306' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41166-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.247 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:03.867585+0000 mon.b (mon.2) 264 : audit [INF] from='client.? 172.21.15.31:0/4114743058' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41371-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.249 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:03.868269+0000 mon.b (mon.2) 265 : audit [INF] from='client.? 172.21.15.31:0/3835153647' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41337-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.249 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:03.875510+0000 mon.b (mon.2) 266 : audit [INF] from='client.? 172.21.15.31:0/682599815' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41153-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.250 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:03.876387+0000 mon.c (mon.1) 30 : audit [INF] from='client.? 172.21.15.31:0/103969585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41136-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.250 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:03.876767+0000 mon.c (mon.1) 31 : audit [INF] from='client.? 172.21.15.31:0/973090219' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.250 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: cluster 2020-06-27T04:47:05.174714+0000 mgr.x (mgr.34109) 216 : cluster [DBG] pgmap v193: 609 pgs: 92 creating+peering, 388 unknown, 129 active+clean; 5.3 KiB data, 4.9 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:47:09.251 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: cluster 2020-06-27T04:47:07.175762+0000 mgr.x (mgr.34109) 217 : cluster [DBG] pgmap v194: 609 pgs: 182 creating+peering, 298 unknown, 129 active+clean; 5.3 KiB data, 4.9 MiB used, 707 GiB / 715 GiB avail 2020-06-27T04:47:09.251 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: cluster 2020-06-27T04:47:07.791267+0000 mon.a (mon.0) 532 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2020-06-27T04:47:09.251 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.798449+0000 mon.a (mon.0) 533 : audit [INF] from='client.? 172.21.15.31:0/470153951' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41463-1"}]: dispatch 2020-06-27T04:47:09.252 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.799195+0000 mon.a (mon.0) 534 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41177-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.252 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.799343+0000 mon.a (mon.0) 535 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41166-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.252 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.799458+0000 mon.a (mon.0) 536 : audit [INF] from='client.? 172.21.15.31:0/37249264' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41123-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.253 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.799570+0000 mon.a (mon.0) 537 : audit [INF] from='client.? 172.21.15.31:0/3946992245' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41429-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.253 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.799713+0000 mon.a (mon.0) 538 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41396-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.254 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.799852+0000 mon.a (mon.0) 539 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41371-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.254 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.799991+0000 mon.a (mon.0) 540 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41136-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.254 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.800137+0000 mon.a (mon.0) 541 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41337-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.255 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.800609+0000 mon.a (mon.0) 542 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.255 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.801062+0000 mon.a (mon.0) 543 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41153-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.255 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.827141+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41131-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:09.256 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.827432+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:09.256 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.828869+0000 mon.c (mon.1) 32 : audit [INF] from='client.? 172.21.15.31:0/3753677238' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41349-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.256 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: cluster 2020-06-27T04:47:07.829150+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2020-06-27T04:47:09.257 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.832111+0000 mon.c (mon.1) 33 : audit [INF] from='client.? 172.21.15.31:0/3798049237' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41505-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.257 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.832372+0000 mon.c (mon.1) 34 : audit [INF] from='client.? 172.21.15.31:0/3555432694' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41488-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.257 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.836014+0000 mon.a (mon.0) 547 : audit [INF] from='client.? 172.21.15.31:0/470153951' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41463-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:47:09.258 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.836512+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41349-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.258 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:07.836810+0000 mon.a (mon.0) 549 : audit [INF] from='client.? 172.21.15.31:0/981946889' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41304-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.258 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:08.307035+0000 mon.a (mon.0) 550 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41505-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.259 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:08.307452+0000 mon.a (mon.0) 551 : audit [INF] from='client.? 172.21.15.31:0/3813448681' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.259 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:08.307665+0000 mon.a (mon.0) 552 : audit [INF] from='client.? 172.21.15.31:0/4009817187' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.259 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:08.307877+0000 mon.a (mon.0) 553 : audit [INF] from='client.? 172.21.15.31:0/1629758176' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41585-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.260 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:08 smithi031 bash[18426]: audit 2020-06-27T04:47:08.308145+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41488-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:09.719 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:09.719 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: in thread 7f537a984700 thread_name:tp_osd_tp 2020-06-27T04:47:09.719 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:09.720 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 1: (()+0x12dd0) [0x7f53a3f92dd0] 2020-06-27T04:47:09.720 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5611b94e4707] 2020-06-27T04:47:09.720 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5611b94e4aa0] 2020-06-27T04:47:09.720 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5611b951667a] 2020-06-27T04:47:09.720 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5611b9517a57] 2020-06-27T04:47:09.721 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5611b91a2938] 2020-06-27T04:47:09.721 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5611b935303d] 2020-06-27T04:47:09.721 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5611b91105b0] 2020-06-27T04:47:09.721 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5611b916989d] 2020-06-27T04:47:09.721 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5611b9172380] 2020-06-27T04:47:09.722 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5611b9179590] 2020-06-27T04:47:09.722 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5611b8ff94e9] 2020-06-27T04:47:09.722 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5611b925df78] 2020-06-27T04:47:09.722 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5611b901870f] 2020-06-27T04:47:09.722 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5611b9656b94] 2020-06-27T04:47:09.723 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5611b96597f4] 2020-06-27T04:47:09.723 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 17: (()+0x82de) [0x7f53a3f882de] 2020-06-27T04:47:09.723 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 18: (clone()+0x43) [0x7f53a2cbfe83] 2020-06-27T04:47:09.723 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: debug 2020-06-27T04:47:09.325+0000 7f537a984700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:09.724 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: in thread 7f537a984700 thread_name:tp_osd_tp 2020-06-27T04:47:09.724 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:09.724 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 1: (()+0x12dd0) [0x7f53a3f92dd0] 2020-06-27T04:47:09.724 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5611b94e4707] 2020-06-27T04:47:09.724 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5611b94e4aa0] 2020-06-27T04:47:09.724 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5611b951667a] 2020-06-27T04:47:09.725 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5611b9517a57] 2020-06-27T04:47:09.725 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5611b91a2938] 2020-06-27T04:47:09.725 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5611b935303d] 2020-06-27T04:47:09.725 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5611b91105b0] 2020-06-27T04:47:09.725 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5611b916989d] 2020-06-27T04:47:09.726 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5611b9172380] 2020-06-27T04:47:09.726 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5611b9179590] 2020-06-27T04:47:09.726 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5611b8ff94e9] 2020-06-27T04:47:09.726 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5611b925df78] 2020-06-27T04:47:09.726 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5611b901870f] 2020-06-27T04:47:09.726 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5611b9656b94] 2020-06-27T04:47:09.727 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5611b96597f4] 2020-06-27T04:47:09.727 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 17: (()+0x82de) [0x7f53a3f882de] 2020-06-27T04:47:09.727 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 18: (clone()+0x43) [0x7f53a2cbfe83] 2020-06-27T04:47:09.727 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:09.727 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: debug 0> 2020-06-27T04:47:09.325+0000 7f537a984700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:09.728 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: in thread 7f537a984700 thread_name:tp_osd_tp 2020-06-27T04:47:09.728 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:09.728 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 1: (()+0x12dd0) [0x7f53a3f92dd0] 2020-06-27T04:47:09.728 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5611b94e4707] 2020-06-27T04:47:09.728 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5611b94e4aa0] 2020-06-27T04:47:09.729 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5611b951667a] 2020-06-27T04:47:09.729 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5611b9517a57] 2020-06-27T04:47:09.729 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5611b91a2938] 2020-06-27T04:47:09.729 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5611b935303d] 2020-06-27T04:47:09.729 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5611b91105b0] 2020-06-27T04:47:09.730 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5611b916989d] 2020-06-27T04:47:09.730 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5611b9172380] 2020-06-27T04:47:09.730 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5611b9179590] 2020-06-27T04:47:09.730 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5611b8ff94e9] 2020-06-27T04:47:09.730 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5611b925df78] 2020-06-27T04:47:09.730 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5611b901870f] 2020-06-27T04:47:09.731 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5611b9656b94] 2020-06-27T04:47:09.731 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5611b96597f4] 2020-06-27T04:47:09.731 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 17: (()+0x82de) [0x7f53a3f882de] 2020-06-27T04:47:09.731 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 18: (clone()+0x43) [0x7f53a2cbfe83] 2020-06-27T04:47:09.731 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:09.732 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: debug -9999> 2020-06-27T04:47:09.325+0000 7f537a984700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:09.732 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: in thread 7f537a984700 thread_name:tp_osd_tp 2020-06-27T04:47:09.732 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:09.732 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 1: (()+0x12dd0) [0x7f53a3f92dd0] 2020-06-27T04:47:09.732 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5611b94e4707] 2020-06-27T04:47:09.733 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5611b94e4aa0] 2020-06-27T04:47:09.733 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5611b951667a] 2020-06-27T04:47:09.733 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5611b9517a57] 2020-06-27T04:47:09.733 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5611b91a2938] 2020-06-27T04:47:09.734 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5611b935303d] 2020-06-27T04:47:09.734 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5611b91105b0] 2020-06-27T04:47:09.734 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5611b916989d] 2020-06-27T04:47:09.735 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5611b9172380] 2020-06-27T04:47:09.735 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5611b9179590] 2020-06-27T04:47:09.735 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5611b8ff94e9] 2020-06-27T04:47:09.735 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5611b925df78] 2020-06-27T04:47:09.735 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5611b901870f] 2020-06-27T04:47:09.736 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5611b9656b94] 2020-06-27T04:47:09.736 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5611b96597f4] 2020-06-27T04:47:09.736 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 17: (()+0x82de) [0x7f53a3f882de] 2020-06-27T04:47:09.736 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: 18: (clone()+0x43) [0x7f53a2cbfe83] 2020-06-27T04:47:09.736 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:09.737 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[23354]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:47:09.737 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:09 smithi051 podman[23699]: 2020-06-27 04:47:09.516764365 +0000 UTC m=+202.105544584 container died da4eb380a0b707d99955a8258c8cb527303ef48eae5cf3c5f771aa06c67c7230 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:47:09.737 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:09.737 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: in thread 7f0fe8be9700 thread_name:tp_osd_tp 2020-06-27T04:47:09.737 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:09.738 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 1: (()+0x12dd0) [0x7f10121f7dd0] 2020-06-27T04:47:09.738 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55a78d5d6707] 2020-06-27T04:47:09.738 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55a78d5d6aa0] 2020-06-27T04:47:09.738 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55a78d60867a] 2020-06-27T04:47:09.738 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55a78d609a57] 2020-06-27T04:47:09.739 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55a78d294938] 2020-06-27T04:47:09.739 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55a78d448a70] 2020-06-27T04:47:09.739 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55a78d458dd7] 2020-06-27T04:47:09.739 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55a78d2c7252] 2020-06-27T04:47:09.739 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55a78d26ae2e] 2020-06-27T04:47:09.740 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55a78d0eb4e9] 2020-06-27T04:47:09.740 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55a78d34ff78] 2020-06-27T04:47:09.740 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55a78d10a70f] 2020-06-27T04:47:09.740 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55a78d748b94] 2020-06-27T04:47:09.740 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55a78d74b7f4] 2020-06-27T04:47:09.740 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 16: (()+0x82de) [0x7f10121ed2de] 2020-06-27T04:47:09.741 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 17: (clone()+0x43) [0x7f1010f24e83] 2020-06-27T04:47:09.741 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: debug 2020-06-27T04:47:09.326+0000 7f0fe8be9700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:09.741 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: in thread 7f0fe8be9700 thread_name:tp_osd_tp 2020-06-27T04:47:09.741 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:09.741 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 1: (()+0x12dd0) [0x7f10121f7dd0] 2020-06-27T04:47:09.742 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55a78d5d6707] 2020-06-27T04:47:09.742 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55a78d5d6aa0] 2020-06-27T04:47:09.742 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55a78d60867a] 2020-06-27T04:47:09.742 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55a78d609a57] 2020-06-27T04:47:09.742 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55a78d294938] 2020-06-27T04:47:09.743 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55a78d448a70] 2020-06-27T04:47:09.743 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55a78d458dd7] 2020-06-27T04:47:09.743 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55a78d2c7252] 2020-06-27T04:47:09.743 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55a78d26ae2e] 2020-06-27T04:47:09.743 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55a78d0eb4e9] 2020-06-27T04:47:09.744 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55a78d34ff78] 2020-06-27T04:47:09.745 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55a78d10a70f] 2020-06-27T04:47:09.745 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55a78d748b94] 2020-06-27T04:47:09.745 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55a78d74b7f4] 2020-06-27T04:47:09.746 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 16: (()+0x82de) [0x7f10121ed2de] 2020-06-27T04:47:09.746 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 17: (clone()+0x43) [0x7f1010f24e83] 2020-06-27T04:47:09.746 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:09.746 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: debug 0> 2020-06-27T04:47:09.326+0000 7f0fe8be9700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:09.746 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: in thread 7f0fe8be9700 thread_name:tp_osd_tp 2020-06-27T04:47:09.747 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:09.747 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 1: (()+0x12dd0) [0x7f10121f7dd0] 2020-06-27T04:47:09.747 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55a78d5d6707] 2020-06-27T04:47:09.747 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55a78d5d6aa0] 2020-06-27T04:47:09.747 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55a78d60867a] 2020-06-27T04:47:09.748 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55a78d609a57] 2020-06-27T04:47:09.748 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55a78d294938] 2020-06-27T04:47:09.748 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55a78d448a70] 2020-06-27T04:47:09.748 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55a78d458dd7] 2020-06-27T04:47:09.748 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55a78d2c7252] 2020-06-27T04:47:09.749 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55a78d26ae2e] 2020-06-27T04:47:09.749 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55a78d0eb4e9] 2020-06-27T04:47:09.749 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55a78d34ff78] 2020-06-27T04:47:09.749 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55a78d10a70f] 2020-06-27T04:47:09.749 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55a78d748b94] 2020-06-27T04:47:09.749 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55a78d74b7f4] 2020-06-27T04:47:09.750 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 16: (()+0x82de) [0x7f10121ed2de] 2020-06-27T04:47:09.750 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 17: (clone()+0x43) [0x7f1010f24e83] 2020-06-27T04:47:09.750 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:09.750 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: debug -9999> 2020-06-27T04:47:09.326+0000 7f0fe8be9700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:09.750 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: in thread 7f0fe8be9700 thread_name:tp_osd_tp 2020-06-27T04:47:09.751 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:09.751 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 1: (()+0x12dd0) [0x7f10121f7dd0] 2020-06-27T04:47:09.751 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55a78d5d6707] 2020-06-27T04:47:09.751 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55a78d5d6aa0] 2020-06-27T04:47:09.751 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55a78d60867a] 2020-06-27T04:47:09.751 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55a78d609a57] 2020-06-27T04:47:09.752 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55a78d294938] 2020-06-27T04:47:09.752 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55a78d448a70] 2020-06-27T04:47:09.752 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55a78d458dd7] 2020-06-27T04:47:09.752 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55a78d2c7252] 2020-06-27T04:47:09.752 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55a78d26ae2e] 2020-06-27T04:47:09.753 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55a78d0eb4e9] 2020-06-27T04:47:09.753 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55a78d34ff78] 2020-06-27T04:47:09.753 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55a78d10a70f] 2020-06-27T04:47:09.753 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55a78d748b94] 2020-06-27T04:47:09.753 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55a78d74b7f4] 2020-06-27T04:47:09.754 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 16: (()+0x82de) [0x7f10121ed2de] 2020-06-27T04:47:09.754 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: 17: (clone()+0x43) [0x7f1010f24e83] 2020-06-27T04:47:09.754 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:09.754 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 bash[27665]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:47:09.754 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:09 smithi051 podman[27994]: 2020-06-27 04:47:09.413178034 +0000 UTC m=+170.240439014 container died 6ff3e9a565265712a1d93d02308d35a5a39802881a49facbdd764e07206681e6 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:47:09.757 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:09.757 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: in thread 7fdfce557700 thread_name:tp_osd_tp 2020-06-27T04:47:09.757 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:09.758 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 1: (()+0x12dd0) [0x7fdfefb55dd0] 2020-06-27T04:47:09.758 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5571d8e38707] 2020-06-27T04:47:09.759 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5571d8e38aa0] 2020-06-27T04:47:09.759 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5571d8e6a67a] 2020-06-27T04:47:09.759 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5571d8e6ba57] 2020-06-27T04:47:09.759 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5571d8af6938] 2020-06-27T04:47:09.759 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5571d8caaa70] 2020-06-27T04:47:09.760 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5571d8cbadd7] 2020-06-27T04:47:09.760 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5571d8b29252] 2020-06-27T04:47:09.760 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5571d8acce2e] 2020-06-27T04:47:09.760 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5571d894d4e9] 2020-06-27T04:47:09.760 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5571d8bb1f78] 2020-06-27T04:47:09.760 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5571d896c70f] 2020-06-27T04:47:09.761 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5571d8faab94] 2020-06-27T04:47:09.761 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5571d8fad7f4] 2020-06-27T04:47:09.761 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 16: (()+0x82de) [0x7fdfefb4b2de] 2020-06-27T04:47:09.761 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 17: (clone()+0x43) [0x7fdfee882e83] 2020-06-27T04:47:09.761 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: debug 2020-06-27T04:47:09.325+0000 7fdfce557700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:09.762 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: in thread 7fdfce557700 thread_name:tp_osd_tp 2020-06-27T04:47:09.762 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:09.762 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 1: (()+0x12dd0) [0x7fdfefb55dd0] 2020-06-27T04:47:09.762 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5571d8e38707] 2020-06-27T04:47:09.762 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5571d8e38aa0] 2020-06-27T04:47:09.763 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5571d8e6a67a] 2020-06-27T04:47:09.763 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5571d8e6ba57] 2020-06-27T04:47:09.763 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5571d8af6938] 2020-06-27T04:47:09.763 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5571d8caaa70] 2020-06-27T04:47:09.763 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5571d8cbadd7] 2020-06-27T04:47:09.764 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5571d8b29252] 2020-06-27T04:47:09.764 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5571d8acce2e] 2020-06-27T04:47:09.764 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5571d894d4e9] 2020-06-27T04:47:09.764 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5571d8bb1f78] 2020-06-27T04:47:09.764 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5571d896c70f] 2020-06-27T04:47:09.765 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5571d8faab94] 2020-06-27T04:47:09.765 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5571d8fad7f4] 2020-06-27T04:47:09.765 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 16: (()+0x82de) [0x7fdfefb4b2de] 2020-06-27T04:47:09.765 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 17: (clone()+0x43) [0x7fdfee882e83] 2020-06-27T04:47:09.765 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:09.766 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: debug 0> 2020-06-27T04:47:09.325+0000 7fdfce557700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:09.766 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: in thread 7fdfce557700 thread_name:tp_osd_tp 2020-06-27T04:47:09.766 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:09.766 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 1: (()+0x12dd0) [0x7fdfefb55dd0] 2020-06-27T04:47:09.766 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5571d8e38707] 2020-06-27T04:47:09.767 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5571d8e38aa0] 2020-06-27T04:47:09.767 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5571d8e6a67a] 2020-06-27T04:47:09.767 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5571d8e6ba57] 2020-06-27T04:47:09.767 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5571d8af6938] 2020-06-27T04:47:09.767 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5571d8caaa70] 2020-06-27T04:47:09.768 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5571d8cbadd7] 2020-06-27T04:47:09.768 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5571d8b29252] 2020-06-27T04:47:09.768 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5571d8acce2e] 2020-06-27T04:47:09.768 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5571d894d4e9] 2020-06-27T04:47:09.768 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5571d8bb1f78] 2020-06-27T04:47:09.769 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5571d896c70f] 2020-06-27T04:47:09.769 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5571d8faab94] 2020-06-27T04:47:09.769 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5571d8fad7f4] 2020-06-27T04:47:09.770 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 16: (()+0x82de) [0x7fdfefb4b2de] 2020-06-27T04:47:09.770 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 17: (clone()+0x43) [0x7fdfee882e83] 2020-06-27T04:47:09.770 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:09.770 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: debug -9999> 2020-06-27T04:47:09.325+0000 7fdfce557700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:09.770 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: in thread 7fdfce557700 thread_name:tp_osd_tp 2020-06-27T04:47:09.770 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:09.771 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 1: (()+0x12dd0) [0x7fdfefb55dd0] 2020-06-27T04:47:09.771 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5571d8e38707] 2020-06-27T04:47:09.771 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5571d8e38aa0] 2020-06-27T04:47:09.771 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5571d8e6a67a] 2020-06-27T04:47:09.771 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5571d8e6ba57] 2020-06-27T04:47:09.772 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5571d8af6938] 2020-06-27T04:47:09.772 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5571d8caaa70] 2020-06-27T04:47:09.772 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5571d8cbadd7] 2020-06-27T04:47:09.772 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5571d8b29252] 2020-06-27T04:47:09.772 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5571d8acce2e] 2020-06-27T04:47:09.773 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5571d894d4e9] 2020-06-27T04:47:09.773 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5571d8bb1f78] 2020-06-27T04:47:09.773 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5571d896c70f] 2020-06-27T04:47:09.773 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5571d8faab94] 2020-06-27T04:47:09.773 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5571d8fad7f4] 2020-06-27T04:47:09.774 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 16: (()+0x82de) [0x7fdfefb4b2de] 2020-06-27T04:47:09.774 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: 17: (clone()+0x43) [0x7fdfee882e83] 2020-06-27T04:47:09.774 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:09.774 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 bash[27358]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:47:09.774 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:09 smithi031 podman[27717]: 2020-06-27 04:47:09.437505965 +0000 UTC m=+263.371505118 container died 3c82a83d4166698ffe1ce3ddbcfa4cf9e1952bd66f44df4382953557c8c58b77 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:47:10.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.828424+0000 mon.a (mon.0) 555 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41177-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.828484+0000 mon.a (mon.0) 556 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41166-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.828537+0000 mon.a (mon.0) 557 : audit [INF] from='client.? 172.21.15.31:0/37249264' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41123-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.828585+0000 mon.a (mon.0) 558 : audit [INF] from='client.? 172.21.15.31:0/3946992245' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41429-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.828611+0000 mon.a (mon.0) 559 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41396-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.828645+0000 mon.a (mon.0) 560 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41371-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.828688+0000 mon.a (mon.0) 561 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41136-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.828729+0000 mon.a (mon.0) 562 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41337-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.828776+0000 mon.a (mon.0) 563 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.828897+0000 mon.a (mon.0) 564 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41153-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.829019+0000 mon.a (mon.0) 565 : audit [INF] from='client.? 172.21.15.31:0/470153951' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41463-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2020-06-27T04:47:10.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.829064+0000 mon.a (mon.0) 566 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41349-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.829110+0000 mon.a (mon.0) 567 : audit [INF] from='client.? 172.21.15.31:0/981946889' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41304-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.829210+0000 mon.a (mon.0) 568 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41505-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.829282+0000 mon.a (mon.0) 569 : audit [INF] from='client.? 172.21.15.31:0/3813448681' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.829326+0000 mon.a (mon.0) 570 : audit [INF] from='client.? 172.21.15.31:0/4009817187' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.829362+0000 mon.a (mon.0) 571 : audit [INF] from='client.? 172.21.15.31:0/1629758176' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41585-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.829405+0000 mon.a (mon.0) 572 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41488-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:08.829524+0000 mon.a (mon.0) 573 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2020-06-27T04:47:10.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: audit 2020-06-27T04:47:08.842472+0000 mon.a (mon.0) 574 : audit [INF] from='client.? 172.21.15.31:0/470153951' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41463-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41463-1"}]: dispatch 2020-06-27T04:47:10.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.447843+0000 mon.a (mon.0) 575 : cluster [DBG] osd.7 reported immediately failed by osd.2 2020-06-27T04:47:10.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.447885+0000 mon.a (mon.0) 576 : cluster [INF] osd.7 failed (root=default,host=smithi051) (connection refused reported by osd.2) 2020-06-27T04:47:10.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.448196+0000 mon.a (mon.0) 577 : cluster [DBG] osd.5 reported immediately failed by osd.2 2020-06-27T04:47:10.723 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.448217+0000 mon.a (mon.0) 578 : cluster [INF] osd.5 failed (root=default,host=smithi051) (connection refused reported by osd.2) 2020-06-27T04:47:10.723 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.448470+0000 mon.a (mon.0) 579 : cluster [DBG] osd.5 reported immediately failed by osd.2 2020-06-27T04:47:10.723 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.448758+0000 mon.a (mon.0) 580 : cluster [DBG] osd.7 reported immediately failed by osd.2 2020-06-27T04:47:10.723 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.449389+0000 mon.a (mon.0) 581 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:47:10.723 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.449430+0000 mon.a (mon.0) 582 : cluster [INF] osd.1 failed (root=default,host=smithi031) (connection refused reported by osd.2) 2020-06-27T04:47:10.724 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.451702+0000 mon.a (mon.0) 583 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:10.724 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.452001+0000 mon.a (mon.0) 584 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:10.724 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.452296+0000 mon.a (mon.0) 585 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:47:10.724 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.452602+0000 mon.a (mon.0) 586 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:47:10.724 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.452887+0000 mon.a (mon.0) 587 : cluster [DBG] osd.7 reported immediately failed by osd.0 2020-06-27T04:47:10.725 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.453166+0000 mon.a (mon.0) 588 : cluster [DBG] osd.7 reported immediately failed by osd.0 2020-06-27T04:47:10.725 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.453469+0000 mon.a (mon.0) 589 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:47:10.725 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.453780+0000 mon.a (mon.0) 590 : cluster [DBG] osd.7 reported immediately failed by osd.0 2020-06-27T04:47:10.725 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.454072+0000 mon.a (mon.0) 591 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:10.725 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.465867+0000 mon.a (mon.0) 592 : cluster [DBG] osd.7 reported immediately failed by osd.3 2020-06-27T04:47:10.726 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.466121+0000 mon.a (mon.0) 593 : cluster [DBG] osd.7 reported immediately failed by osd.3 2020-06-27T04:47:10.726 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.466387+0000 mon.a (mon.0) 594 : cluster [DBG] osd.5 reported immediately failed by osd.3 2020-06-27T04:47:10.726 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.466638+0000 mon.a (mon.0) 595 : cluster [DBG] osd.7 reported immediately failed by osd.3 2020-06-27T04:47:10.726 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.466881+0000 mon.a (mon.0) 596 : cluster [DBG] osd.5 reported immediately failed by osd.3 2020-06-27T04:47:10.726 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:10 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.467133+0000 mon.a (mon.0) 597 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:47:10.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.828424+0000 mon.a (mon.0) 555 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41177-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.828484+0000 mon.a (mon.0) 556 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41166-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.828537+0000 mon.a (mon.0) 557 : audit [INF] from='client.? 172.21.15.31:0/37249264' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41123-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.828585+0000 mon.a (mon.0) 558 : audit [INF] from='client.? 172.21.15.31:0/3946992245' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41429-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.828611+0000 mon.a (mon.0) 559 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41396-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.828645+0000 mon.a (mon.0) 560 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41371-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.828688+0000 mon.a (mon.0) 561 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41136-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.828729+0000 mon.a (mon.0) 562 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41337-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.828776+0000 mon.a (mon.0) 563 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.828897+0000 mon.a (mon.0) 564 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41153-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.829019+0000 mon.a (mon.0) 565 : audit [INF] from='client.? 172.21.15.31:0/470153951' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41463-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2020-06-27T04:47:10.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.829064+0000 mon.a (mon.0) 566 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41349-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.829110+0000 mon.a (mon.0) 567 : audit [INF] from='client.? 172.21.15.31:0/981946889' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41304-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.829210+0000 mon.a (mon.0) 568 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41505-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.829282+0000 mon.a (mon.0) 569 : audit [INF] from='client.? 172.21.15.31:0/3813448681' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.829326+0000 mon.a (mon.0) 570 : audit [INF] from='client.? 172.21.15.31:0/4009817187' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.829362+0000 mon.a (mon.0) 571 : audit [INF] from='client.? 172.21.15.31:0/1629758176' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41585-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.829405+0000 mon.a (mon.0) 572 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41488-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:08.829524+0000 mon.a (mon.0) 573 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2020-06-27T04:47:10.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: audit 2020-06-27T04:47:08.842472+0000 mon.a (mon.0) 574 : audit [INF] from='client.? 172.21.15.31:0/470153951' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41463-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41463-1"}]: dispatch 2020-06-27T04:47:10.732 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.447843+0000 mon.a (mon.0) 575 : cluster [DBG] osd.7 reported immediately failed by osd.2 2020-06-27T04:47:10.732 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.447885+0000 mon.a (mon.0) 576 : cluster [INF] osd.7 failed (root=default,host=smithi051) (connection refused reported by osd.2) 2020-06-27T04:47:10.732 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.448196+0000 mon.a (mon.0) 577 : cluster [DBG] osd.5 reported immediately failed by osd.2 2020-06-27T04:47:10.732 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.448217+0000 mon.a (mon.0) 578 : cluster [INF] osd.5 failed (root=default,host=smithi051) (connection refused reported by osd.2) 2020-06-27T04:47:10.732 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.448470+0000 mon.a (mon.0) 579 : cluster [DBG] osd.5 reported immediately failed by osd.2 2020-06-27T04:47:10.733 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.448758+0000 mon.a (mon.0) 580 : cluster [DBG] osd.7 reported immediately failed by osd.2 2020-06-27T04:47:10.733 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.449389+0000 mon.a (mon.0) 581 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:47:10.733 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.449430+0000 mon.a (mon.0) 582 : cluster [INF] osd.1 failed (root=default,host=smithi031) (connection refused reported by osd.2) 2020-06-27T04:47:10.733 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.451702+0000 mon.a (mon.0) 583 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:10.733 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.452001+0000 mon.a (mon.0) 584 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:10.733 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.452296+0000 mon.a (mon.0) 585 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:47:10.734 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.452602+0000 mon.a (mon.0) 586 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:47:10.734 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.452887+0000 mon.a (mon.0) 587 : cluster [DBG] osd.7 reported immediately failed by osd.0 2020-06-27T04:47:10.734 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.453166+0000 mon.a (mon.0) 588 : cluster [DBG] osd.7 reported immediately failed by osd.0 2020-06-27T04:47:10.734 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.453469+0000 mon.a (mon.0) 589 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:47:10.734 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.453780+0000 mon.a (mon.0) 590 : cluster [DBG] osd.7 reported immediately failed by osd.0 2020-06-27T04:47:10.735 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.454072+0000 mon.a (mon.0) 591 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:10.735 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.465867+0000 mon.a (mon.0) 592 : cluster [DBG] osd.7 reported immediately failed by osd.3 2020-06-27T04:47:10.735 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.466121+0000 mon.a (mon.0) 593 : cluster [DBG] osd.7 reported immediately failed by osd.3 2020-06-27T04:47:10.735 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.466387+0000 mon.a (mon.0) 594 : cluster [DBG] osd.5 reported immediately failed by osd.3 2020-06-27T04:47:10.735 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.466638+0000 mon.a (mon.0) 595 : cluster [DBG] osd.7 reported immediately failed by osd.3 2020-06-27T04:47:10.735 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.466881+0000 mon.a (mon.0) 596 : cluster [DBG] osd.5 reported immediately failed by osd.3 2020-06-27T04:47:10.736 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.467133+0000 mon.a (mon.0) 597 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:47:10.736 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.828424+0000 mon.a (mon.0) 555 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41177-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.736 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.828484+0000 mon.a (mon.0) 556 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41166-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.736 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.828537+0000 mon.a (mon.0) 557 : audit [INF] from='client.? 172.21.15.31:0/37249264' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41123-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.737 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.828585+0000 mon.a (mon.0) 558 : audit [INF] from='client.? 172.21.15.31:0/3946992245' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41429-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.737 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.828611+0000 mon.a (mon.0) 559 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41396-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.737 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.828645+0000 mon.a (mon.0) 560 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41371-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.737 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.828688+0000 mon.a (mon.0) 561 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41136-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.737 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.828729+0000 mon.a (mon.0) 562 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41337-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.737 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.828776+0000 mon.a (mon.0) 563 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.738 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.828897+0000 mon.a (mon.0) 564 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41153-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.738 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.829019+0000 mon.a (mon.0) 565 : audit [INF] from='client.? 172.21.15.31:0/470153951' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41463-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2020-06-27T04:47:10.738 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.829064+0000 mon.a (mon.0) 566 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41349-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.738 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.829110+0000 mon.a (mon.0) 567 : audit [INF] from='client.? 172.21.15.31:0/981946889' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41304-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.738 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.829210+0000 mon.a (mon.0) 568 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41505-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.739 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.829282+0000 mon.a (mon.0) 569 : audit [INF] from='client.? 172.21.15.31:0/3813448681' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.739 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.829326+0000 mon.a (mon.0) 570 : audit [INF] from='client.? 172.21.15.31:0/4009817187' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.739 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.829362+0000 mon.a (mon.0) 571 : audit [INF] from='client.? 172.21.15.31:0/1629758176' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41585-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.739 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.829405+0000 mon.a (mon.0) 572 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41488-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:10.739 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:08.829524+0000 mon.a (mon.0) 573 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2020-06-27T04:47:10.740 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: audit 2020-06-27T04:47:08.842472+0000 mon.a (mon.0) 574 : audit [INF] from='client.? 172.21.15.31:0/470153951' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41463-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41463-1"}]: dispatch 2020-06-27T04:47:10.740 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.447843+0000 mon.a (mon.0) 575 : cluster [DBG] osd.7 reported immediately failed by osd.2 2020-06-27T04:47:10.740 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.447885+0000 mon.a (mon.0) 576 : cluster [INF] osd.7 failed (root=default,host=smithi051) (connection refused reported by osd.2) 2020-06-27T04:47:10.740 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.448196+0000 mon.a (mon.0) 577 : cluster [DBG] osd.5 reported immediately failed by osd.2 2020-06-27T04:47:10.740 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.448217+0000 mon.a (mon.0) 578 : cluster [INF] osd.5 failed (root=default,host=smithi051) (connection refused reported by osd.2) 2020-06-27T04:47:10.741 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.448470+0000 mon.a (mon.0) 579 : cluster [DBG] osd.5 reported immediately failed by osd.2 2020-06-27T04:47:10.741 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.448758+0000 mon.a (mon.0) 580 : cluster [DBG] osd.7 reported immediately failed by osd.2 2020-06-27T04:47:10.741 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.449389+0000 mon.a (mon.0) 581 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:47:10.741 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.449430+0000 mon.a (mon.0) 582 : cluster [INF] osd.1 failed (root=default,host=smithi031) (connection refused reported by osd.2) 2020-06-27T04:47:10.741 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.451702+0000 mon.a (mon.0) 583 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:10.742 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.452001+0000 mon.a (mon.0) 584 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:10.742 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.452296+0000 mon.a (mon.0) 585 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:47:10.742 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.452602+0000 mon.a (mon.0) 586 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:47:10.742 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.452887+0000 mon.a (mon.0) 587 : cluster [DBG] osd.7 reported immediately failed by osd.0 2020-06-27T04:47:10.743 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.453166+0000 mon.a (mon.0) 588 : cluster [DBG] osd.7 reported immediately failed by osd.0 2020-06-27T04:47:10.743 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.453469+0000 mon.a (mon.0) 589 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:47:10.743 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.453780+0000 mon.a (mon.0) 590 : cluster [DBG] osd.7 reported immediately failed by osd.0 2020-06-27T04:47:10.743 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.454072+0000 mon.a (mon.0) 591 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:10.743 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.465867+0000 mon.a (mon.0) 592 : cluster [DBG] osd.7 reported immediately failed by osd.3 2020-06-27T04:47:10.744 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.466121+0000 mon.a (mon.0) 593 : cluster [DBG] osd.7 reported immediately failed by osd.3 2020-06-27T04:47:10.744 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.466387+0000 mon.a (mon.0) 594 : cluster [DBG] osd.5 reported immediately failed by osd.3 2020-06-27T04:47:10.744 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.466638+0000 mon.a (mon.0) 595 : cluster [DBG] osd.7 reported immediately failed by osd.3 2020-06-27T04:47:10.744 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.466881+0000 mon.a (mon.0) 596 : cluster [DBG] osd.5 reported immediately failed by osd.3 2020-06-27T04:47:10.744 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:10 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.467133+0000 mon.a (mon.0) 597 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:47:11.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:11 smithi051 podman[23699]: 2020-06-27 04:47:11.308856302 +0000 UTC m=+203.897636564 container remove da4eb380a0b707d99955a8258c8cb527303ef48eae5cf3c5f771aa06c67c7230 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:47:11.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:11 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:47:11.469 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:11 smithi051 podman[27994]: 2020-06-27 04:47:11.198863103 +0000 UTC m=+172.026124107 container remove 6ff3e9a565265712a1d93d02308d35a5a39802881a49facbdd764e07206681e6 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:47:11.469 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:11 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:47:11.808 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:11 smithi051 podman[33240]: 2020-06-27 04:47:11.733287133 +0000 UTC m=+0.383269814 container create bb5799ebebc839da618019d8e32b56de13f1ce9ce668a1f67e5c22d9b5e0cfce (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:47:11.809 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:11 smithi051 podman[33223]: 2020-06-27 04:47:11.552775226 +0000 UTC m=+0.329181537 container create 50508868e147e3970675aaaad26997c18c5bbb3068b42d6904b34dfd0f881c98 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:47:12.097 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:11 smithi051 podman[33240]: 2020-06-27 04:47:11.883300807 +0000 UTC m=+0.533283490 container init bb5799ebebc839da618019d8e32b56de13f1ce9ce668a1f67e5c22d9b5e0cfce (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:47:12.098 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:11 smithi051 podman[33240]: 2020-06-27 04:47:11.91660517 +0000 UTC m=+0.566587860 container start bb5799ebebc839da618019d8e32b56de13f1ce9ce668a1f67e5c22d9b5e0cfce (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:47:12.098 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:11 smithi051 podman[33240]: 2020-06-27 04:47:11.916676628 +0000 UTC m=+0.566659340 container attach bb5799ebebc839da618019d8e32b56de13f1ce9ce668a1f67e5c22d9b5e0cfce (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:47:12.098 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:11 smithi051 podman[33223]: 2020-06-27 04:47:11.822600304 +0000 UTC m=+0.599006703 container init 50508868e147e3970675aaaad26997c18c5bbb3068b42d6904b34dfd0f881c98 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:47:12.098 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:11 smithi051 podman[33223]: 2020-06-27 04:47:11.858305862 +0000 UTC m=+0.634712154 container start 50508868e147e3970675aaaad26997c18c5bbb3068b42d6904b34dfd0f881c98 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:47:12.099 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:11 smithi051 podman[33223]: 2020-06-27 04:47:11.858382139 +0000 UTC m=+0.634788482 container attach 50508868e147e3970675aaaad26997c18c5bbb3068b42d6904b34dfd0f881c98 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:47:12.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:12 smithi051 podman[33240]: 2020-06-27 04:47:12.228747598 +0000 UTC m=+0.878730301 container died bb5799ebebc839da618019d8e32b56de13f1ce9ce668a1f67e5c22d9b5e0cfce (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:47:12.468 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:12 smithi051 podman[33223]: 2020-06-27 04:47:12.110687816 +0000 UTC m=+0.887094165 container died 50508868e147e3970675aaaad26997c18c5bbb3068b42d6904b34dfd0f881c98 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:47:12.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:12 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.176348+0000 mgr.x (mgr.34109) 218 : cluster [DBG] pgmap v197: 897 pgs: 431 creating+peering, 310 unknown, 156 active+clean; 5.4 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2020-06-27T04:47:12.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:12 smithi051 bash[18409]: cluster 2020-06-27T04:47:09.910451+0000 mon.a (mon.0) 598 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2020-06-27T04:47:12.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:12 smithi051 bash[18409]: audit 2020-06-27T04:47:10.384988+0000 mon.c (mon.1) 35 : audit [INF] from='client.? 172.21.15.31:0/2228952571' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:12.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:12 smithi051 bash[18409]: cluster 2020-06-27T04:47:10.385069+0000 mon.a (mon.0) 599 : cluster [DBG] osdmap e64: 8 total, 5 up, 8 in 2020-06-27T04:47:12.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:12 smithi051 bash[18409]: audit 2020-06-27T04:47:10.387798+0000 mon.a (mon.0) 600 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:12.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:12 smithi051 bash[18409]: audit 2020-06-27T04:47:10.390780+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:12.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:12 smithi051 bash[18409]: audit 2020-06-27T04:47:10.403849+0000 mon.a (mon.0) 601 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:12.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:12 smithi051 bash[18409]: audit 2020-06-27T04:47:10.415470+0000 mon.a (mon.0) 602 : audit [INF] from='client.? 172.21.15.31:0/3995737424' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41396-7"}]: dispatch 2020-06-27T04:47:12.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:12 smithi051 bash[18409]: audit 2020-06-27T04:47:10.416509+0000 mon.a (mon.0) 603 : audit [INF] from='client.? 172.21.15.31:0/3995737424' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41396-7"}]: dispatch 2020-06-27T04:47:12.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:12 smithi051 bash[18409]: audit 2020-06-27T04:47:10.416860+0000 mon.a (mon.0) 604 : audit [INF] from='client.? 172.21.15.31:0/3995737424' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41396-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:47:12.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.176348+0000 mgr.x (mgr.34109) 218 : cluster [DBG] pgmap v197: 897 pgs: 431 creating+peering, 310 unknown, 156 active+clean; 5.4 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2020-06-27T04:47:12.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[22603]: cluster 2020-06-27T04:47:09.910451+0000 mon.a (mon.0) 598 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2020-06-27T04:47:12.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[22603]: audit 2020-06-27T04:47:10.384988+0000 mon.c (mon.1) 35 : audit [INF] from='client.? 172.21.15.31:0/2228952571' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:12.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[22603]: cluster 2020-06-27T04:47:10.385069+0000 mon.a (mon.0) 599 : cluster [DBG] osdmap e64: 8 total, 5 up, 8 in 2020-06-27T04:47:12.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[22603]: audit 2020-06-27T04:47:10.387798+0000 mon.a (mon.0) 600 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:12.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[22603]: audit 2020-06-27T04:47:10.390780+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:12.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[22603]: audit 2020-06-27T04:47:10.403849+0000 mon.a (mon.0) 601 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:12.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[22603]: audit 2020-06-27T04:47:10.415470+0000 mon.a (mon.0) 602 : audit [INF] from='client.? 172.21.15.31:0/3995737424' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41396-7"}]: dispatch 2020-06-27T04:47:12.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[22603]: audit 2020-06-27T04:47:10.416509+0000 mon.a (mon.0) 603 : audit [INF] from='client.? 172.21.15.31:0/3995737424' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41396-7"}]: dispatch 2020-06-27T04:47:12.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[22603]: audit 2020-06-27T04:47:10.416860+0000 mon.a (mon.0) 604 : audit [INF] from='client.? 172.21.15.31:0/3995737424' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41396-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:47:12.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.176348+0000 mgr.x (mgr.34109) 218 : cluster [DBG] pgmap v197: 897 pgs: 431 creating+peering, 310 unknown, 156 active+clean; 5.4 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2020-06-27T04:47:12.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[18426]: cluster 2020-06-27T04:47:09.910451+0000 mon.a (mon.0) 598 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2020-06-27T04:47:12.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[18426]: audit 2020-06-27T04:47:10.384988+0000 mon.c (mon.1) 35 : audit [INF] from='client.? 172.21.15.31:0/2228952571' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:12.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[18426]: cluster 2020-06-27T04:47:10.385069+0000 mon.a (mon.0) 599 : cluster [DBG] osdmap e64: 8 total, 5 up, 8 in 2020-06-27T04:47:12.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[18426]: audit 2020-06-27T04:47:10.387798+0000 mon.a (mon.0) 600 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:12.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[18426]: audit 2020-06-27T04:47:10.390780+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:12.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[18426]: audit 2020-06-27T04:47:10.403849+0000 mon.a (mon.0) 601 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:12.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[18426]: audit 2020-06-27T04:47:10.415470+0000 mon.a (mon.0) 602 : audit [INF] from='client.? 172.21.15.31:0/3995737424' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41396-7"}]: dispatch 2020-06-27T04:47:12.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[18426]: audit 2020-06-27T04:47:10.416509+0000 mon.a (mon.0) 603 : audit [INF] from='client.? 172.21.15.31:0/3995737424' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41396-7"}]: dispatch 2020-06-27T04:47:12.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:12 smithi031 bash[18426]: audit 2020-06-27T04:47:10.416860+0000 mon.a (mon.0) 604 : audit [INF] from='client.? 172.21.15.31:0/3995737424' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41396-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:47:12.760 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: Running main() from gmock_main.cc 2020-06-27T04:47:12.760 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [==========] Running 16 tests from 1 test suite. 2020-06-27T04:47:12.760 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [----------] Global test environment set-up. 2020-06-27T04:47:12.761 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [----------] 16 tests from CReadOpsTest 2020-06-27T04:47:12.761 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2020-06-27T04:47:12.761 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2020-06-27T04:47:12.761 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2020-06-27T04:47:12.761 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (313 ms) 2020-06-27T04:47:12.762 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2020-06-27T04:47:12.762 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (60 ms) 2020-06-27T04:47:12.762 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2020-06-27T04:47:12.762 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (70 ms) 2020-06-27T04:47:12.762 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2020-06-27T04:47:12.763 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (2249 ms) 2020-06-27T04:47:12.763 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2020-06-27T04:47:12.763 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (9 ms) 2020-06-27T04:47:12.763 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2020-06-27T04:47:12.763 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (6 ms) 2020-06-27T04:47:12.763 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2020-06-27T04:47:12.764 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (4 ms) 2020-06-27T04:47:12.764 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2020-06-27T04:47:12.764 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (8 ms) 2020-06-27T04:47:12.764 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2020-06-27T04:47:12.764 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (3 ms) 2020-06-27T04:47:12.765 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2020-06-27T04:47:12.765 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (3 ms) 2020-06-27T04:47:12.765 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2020-06-27T04:47:12.765 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (5 ms) 2020-06-27T04:47:12.765 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2020-06-27T04:47:12.765 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (11 ms) 2020-06-27T04:47:12.766 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2020-06-27T04:47:12.766 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (11 ms) 2020-06-27T04:47:12.766 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2020-06-27T04:47:12.766 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (8 ms) 2020-06-27T04:47:12.766 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2020-06-27T04:47:12.767 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (5 ms) 2020-06-27T04:47:12.767 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [----------] 16 tests from CReadOpsTest (2765 ms total) 2020-06-27T04:47:12.767 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: 2020-06-27T04:47:12.767 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [----------] Global test environment tear-down 2020-06-27T04:47:12.768 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [==========] 16 tests from 1 test suite ran. (15310 ms total) 2020-06-27T04:47:12.768 INFO:tasks.workunit.client.0.smithi031.stdout: api_c_read_operations: [ PASSED ] 16 tests. 2020-06-27T04:47:13.468 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:13 smithi051 podman[33223]: 2020-06-27 04:47:13.167002826 +0000 UTC m=+1.943409146 container remove 50508868e147e3970675aaaad26997c18c5bbb3068b42d6904b34dfd0f881c98 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:47:13.468 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:13 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Failed with result 'exit-code'. 2020-06-27T04:47:13.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:13 smithi051 podman[33240]: 2020-06-27 04:47:13.269476911 +0000 UTC m=+1.919459617 container remove bb5799ebebc839da618019d8e32b56de13f1ce9ce668a1f67e5c22d9b5e0cfce (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:47:13.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:13 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Failed with result 'exit-code'. 2020-06-27T04:47:13.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: cluster 2020-06-27T04:47:11.177485+0000 mgr.x (mgr.34109) 219 : cluster [DBG] pgmap v199: 833 pgs: 123 peering, 48 stale+active+clean, 178 creating+peering, 243 unknown, 133 stale+creating+peering, 108 active+clean; 8.2 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 341 B/s rd, 4.8 KiB/s wr, 7 op/s 2020-06-27T04:47:13.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:11.298986+0000 mon.a (mon.0) 605 : audit [INF] from='client.? 172.21.15.31:0/470153951' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41463-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41463-1"}]': finished 2020-06-27T04:47:13.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:11.299109+0000 mon.a (mon.0) 606 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-2","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:13.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:11.299182+0000 mon.a (mon.0) 607 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-4","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:13.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:11.299287+0000 mon.a (mon.0) 608 : audit [INF] from='client.? 172.21.15.31:0/3995737424' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41396-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2020-06-27T04:47:13.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: cluster 2020-06-27T04:47:11.299381+0000 mon.a (mon.0) 609 : cluster [DBG] osdmap e65: 8 total, 5 up, 8 in 2020-06-27T04:47:13.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:11.306275+0000 mon.b (mon.2) 267 : audit [INF] from='client.? 172.21.15.31:0/3208380055' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:11.306623+0000 mon.b (mon.2) 268 : audit [INF] from='client.? 172.21.15.31:0/1566790810' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: cluster 2020-06-27T04:47:11.798208+0000 mon.a (mon.0) 610 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive, 10 pgs peering (PG_AVAILABILITY) 2020-06-27T04:47:13.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: cluster 2020-06-27T04:47:11.798254+0000 mon.a (mon.0) 611 : cluster [WRN] Health check failed: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:47:13.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:11.798866+0000 mon.a (mon.0) 612 : audit [INF] from='client.? 172.21.15.31:0/3995737424' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41396-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41396-7"}]: dispatch 2020-06-27T04:47:13.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:12.238863+0000 mon.a (mon.0) 613 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:12.241435+0000 mon.a (mon.0) 614 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:12.242753+0000 mon.c (mon.1) 37 : audit [INF] from='client.? 172.21.15.31:0/414926987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41371-6"}]: dispatch 2020-06-27T04:47:13.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:12.256836+0000 mon.a (mon.0) 615 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41371-6"}]: dispatch 2020-06-27T04:47:13.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:12.257303+0000 mon.c (mon.1) 38 : audit [INF] from='client.? 172.21.15.31:0/414926987' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41371-6"}]: dispatch 2020-06-27T04:47:13.473 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:12.257695+0000 mon.a (mon.0) 616 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41371-6"}]: dispatch 2020-06-27T04:47:13.473 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:12.258073+0000 mon.c (mon.1) 39 : audit [INF] from='client.? 172.21.15.31:0/414926987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41371-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:47:13.473 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:12.258470+0000 mon.a (mon.0) 617 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41371-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:47:13.473 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:12.753845+0000 mon.a (mon.0) 618 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-2","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:13.473 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:12.753894+0000 mon.a (mon.0) 619 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-2","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:13.474 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:12.753978+0000 mon.a (mon.0) 620 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41371-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2020-06-27T04:47:13.474 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: cluster 2020-06-27T04:47:12.754010+0000 mon.a (mon.0) 621 : cluster [DBG] osdmap e66: 8 total, 5 up, 8 in 2020-06-27T04:47:13.474 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:12.754970+0000 mon.c (mon.1) 40 : audit [INF] from='client.? 172.21.15.31:0/414926987' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41371-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41371-6"}]: dispatch 2020-06-27T04:47:13.474 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:12.755250+0000 mon.c (mon.1) 41 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.474 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:12.756364+0000 mon.a (mon.0) 622 : audit [INF] from='client.? 172.21.15.31:0/4264311892' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41123-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.475 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:12.760641+0000 mon.a (mon.0) 623 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41371-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41371-6"}]: dispatch 2020-06-27T04:47:13.475 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:13 smithi051 bash[18409]: audit 2020-06-27T04:47:12.761064+0000 mon.a (mon.0) 624 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: cluster 2020-06-27T04:47:11.177485+0000 mgr.x (mgr.34109) 219 : cluster [DBG] pgmap v199: 833 pgs: 123 peering, 48 stale+active+clean, 178 creating+peering, 243 unknown, 133 stale+creating+peering, 108 active+clean; 8.2 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 341 B/s rd, 4.8 KiB/s wr, 7 op/s 2020-06-27T04:47:13.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:11.298986+0000 mon.a (mon.0) 605 : audit [INF] from='client.? 172.21.15.31:0/470153951' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41463-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41463-1"}]': finished 2020-06-27T04:47:13.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:11.299109+0000 mon.a (mon.0) 606 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-2","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:13.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:11.299182+0000 mon.a (mon.0) 607 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-4","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:13.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:11.299287+0000 mon.a (mon.0) 608 : audit [INF] from='client.? 172.21.15.31:0/3995737424' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41396-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2020-06-27T04:47:13.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: cluster 2020-06-27T04:47:11.299381+0000 mon.a (mon.0) 609 : cluster [DBG] osdmap e65: 8 total, 5 up, 8 in 2020-06-27T04:47:13.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:11.306275+0000 mon.b (mon.2) 267 : audit [INF] from='client.? 172.21.15.31:0/3208380055' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:11.306623+0000 mon.b (mon.2) 268 : audit [INF] from='client.? 172.21.15.31:0/1566790810' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: cluster 2020-06-27T04:47:11.798208+0000 mon.a (mon.0) 610 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive, 10 pgs peering (PG_AVAILABILITY) 2020-06-27T04:47:13.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: cluster 2020-06-27T04:47:11.798254+0000 mon.a (mon.0) 611 : cluster [WRN] Health check failed: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:47:13.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:11.798866+0000 mon.a (mon.0) 612 : audit [INF] from='client.? 172.21.15.31:0/3995737424' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41396-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41396-7"}]: dispatch 2020-06-27T04:47:13.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:12.238863+0000 mon.a (mon.0) 613 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:12.241435+0000 mon.a (mon.0) 614 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:12.242753+0000 mon.c (mon.1) 37 : audit [INF] from='client.? 172.21.15.31:0/414926987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41371-6"}]: dispatch 2020-06-27T04:47:13.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:12.256836+0000 mon.a (mon.0) 615 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41371-6"}]: dispatch 2020-06-27T04:47:13.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:12.257303+0000 mon.c (mon.1) 38 : audit [INF] from='client.? 172.21.15.31:0/414926987' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41371-6"}]: dispatch 2020-06-27T04:47:13.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:12.257695+0000 mon.a (mon.0) 616 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41371-6"}]: dispatch 2020-06-27T04:47:13.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:12.258073+0000 mon.c (mon.1) 39 : audit [INF] from='client.? 172.21.15.31:0/414926987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41371-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:47:13.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:12.258470+0000 mon.a (mon.0) 617 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41371-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:47:13.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:12.753845+0000 mon.a (mon.0) 618 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-2","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:13.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:12.753894+0000 mon.a (mon.0) 619 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-2","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:13.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:12.753978+0000 mon.a (mon.0) 620 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41371-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2020-06-27T04:47:13.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: cluster 2020-06-27T04:47:12.754010+0000 mon.a (mon.0) 621 : cluster [DBG] osdmap e66: 8 total, 5 up, 8 in 2020-06-27T04:47:13.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:12.754970+0000 mon.c (mon.1) 40 : audit [INF] from='client.? 172.21.15.31:0/414926987' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41371-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41371-6"}]: dispatch 2020-06-27T04:47:13.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:12.755250+0000 mon.c (mon.1) 41 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:12.756364+0000 mon.a (mon.0) 622 : audit [INF] from='client.? 172.21.15.31:0/4264311892' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41123-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:12.760641+0000 mon.a (mon.0) 623 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41371-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41371-6"}]: dispatch 2020-06-27T04:47:13.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[18426]: audit 2020-06-27T04:47:12.761064+0000 mon.a (mon.0) 624 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.730 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:13.730 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: in thread 7f8c366af700 thread_name:tp_osd_tp 2020-06-27T04:47:13.730 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:13.730 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 1: (()+0x12dd0) [0x7f8c56cabdd0] 2020-06-27T04:47:13.731 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x559210c16707] 2020-06-27T04:47:13.731 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x559210c16aa0] 2020-06-27T04:47:13.731 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x559210c4867a] 2020-06-27T04:47:13.731 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x559210c49a57] 2020-06-27T04:47:13.731 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5592108d4938] 2020-06-27T04:47:13.731 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x559210a8503d] 2020-06-27T04:47:13.732 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5592108425b0] 2020-06-27T04:47:13.732 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55921089b89d] 2020-06-27T04:47:13.732 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5592108a4380] 2020-06-27T04:47:13.732 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5592108ab590] 2020-06-27T04:47:13.732 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55921072b4e9] 2020-06-27T04:47:13.733 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55921098ff78] 2020-06-27T04:47:13.733 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55921074a70f] 2020-06-27T04:47:13.733 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x559210d88b94] 2020-06-27T04:47:13.733 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x559210d8b7f4] 2020-06-27T04:47:13.733 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 17: (()+0x82de) [0x7f8c56ca12de] 2020-06-27T04:47:13.734 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 18: (clone()+0x43) [0x7f8c559d8e83] 2020-06-27T04:47:13.734 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: debug 2020-06-27T04:47:13.412+0000 7f8c366af700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:13.734 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: in thread 7f8c366af700 thread_name:tp_osd_tp 2020-06-27T04:47:13.734 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:13.734 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 1: (()+0x12dd0) [0x7f8c56cabdd0] 2020-06-27T04:47:13.734 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x559210c16707] 2020-06-27T04:47:13.735 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x559210c16aa0] 2020-06-27T04:47:13.735 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x559210c4867a] 2020-06-27T04:47:13.735 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x559210c49a57] 2020-06-27T04:47:13.735 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5592108d4938] 2020-06-27T04:47:13.735 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x559210a8503d] 2020-06-27T04:47:13.736 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5592108425b0] 2020-06-27T04:47:13.736 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55921089b89d] 2020-06-27T04:47:13.736 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5592108a4380] 2020-06-27T04:47:13.736 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5592108ab590] 2020-06-27T04:47:13.736 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55921072b4e9] 2020-06-27T04:47:13.737 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55921098ff78] 2020-06-27T04:47:13.737 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55921074a70f] 2020-06-27T04:47:13.737 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x559210d88b94] 2020-06-27T04:47:13.737 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x559210d8b7f4] 2020-06-27T04:47:13.737 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 17: (()+0x82de) [0x7f8c56ca12de] 2020-06-27T04:47:13.738 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 18: (clone()+0x43) [0x7f8c559d8e83] 2020-06-27T04:47:13.738 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:13.738 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: debug 0> 2020-06-27T04:47:13.412+0000 7f8c366af700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:13.739 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: in thread 7f8c366af700 thread_name:tp_osd_tp 2020-06-27T04:47:13.739 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:13.739 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 1: (()+0x12dd0) [0x7f8c56cabdd0] 2020-06-27T04:47:13.739 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x559210c16707] 2020-06-27T04:47:13.739 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x559210c16aa0] 2020-06-27T04:47:13.740 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x559210c4867a] 2020-06-27T04:47:13.740 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x559210c49a57] 2020-06-27T04:47:13.740 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5592108d4938] 2020-06-27T04:47:13.740 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x559210a8503d] 2020-06-27T04:47:13.740 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5592108425b0] 2020-06-27T04:47:13.741 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55921089b89d] 2020-06-27T04:47:13.741 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5592108a4380] 2020-06-27T04:47:13.741 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5592108ab590] 2020-06-27T04:47:13.741 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55921072b4e9] 2020-06-27T04:47:13.741 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55921098ff78] 2020-06-27T04:47:13.741 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55921074a70f] 2020-06-27T04:47:13.742 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x559210d88b94] 2020-06-27T04:47:13.742 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x559210d8b7f4] 2020-06-27T04:47:13.742 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 17: (()+0x82de) [0x7f8c56ca12de] 2020-06-27T04:47:13.742 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 18: (clone()+0x43) [0x7f8c559d8e83] 2020-06-27T04:47:13.742 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:13.743 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: debug -9999> 2020-06-27T04:47:13.412+0000 7f8c366af700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:13.743 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: in thread 7f8c366af700 thread_name:tp_osd_tp 2020-06-27T04:47:13.743 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:13.743 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 1: (()+0x12dd0) [0x7f8c56cabdd0] 2020-06-27T04:47:13.743 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x559210c16707] 2020-06-27T04:47:13.744 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x559210c16aa0] 2020-06-27T04:47:13.744 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x559210c4867a] 2020-06-27T04:47:13.744 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x559210c49a57] 2020-06-27T04:47:13.744 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5592108d4938] 2020-06-27T04:47:13.744 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x559210a8503d] 2020-06-27T04:47:13.744 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5592108425b0] 2020-06-27T04:47:13.745 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55921089b89d] 2020-06-27T04:47:13.745 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5592108a4380] 2020-06-27T04:47:13.745 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5592108ab590] 2020-06-27T04:47:13.745 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55921072b4e9] 2020-06-27T04:47:13.745 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55921098ff78] 2020-06-27T04:47:13.746 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55921074a70f] 2020-06-27T04:47:13.746 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x559210d88b94] 2020-06-27T04:47:13.746 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x559210d8b7f4] 2020-06-27T04:47:13.746 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 17: (()+0x82de) [0x7f8c56ca12de] 2020-06-27T04:47:13.746 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: 18: (clone()+0x43) [0x7f8c559d8e83] 2020-06-27T04:47:13.747 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:13.747 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[31715]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:47:13.747 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:13.747 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: in thread 7f043458d700 thread_name:tp_osd_tp 2020-06-27T04:47:13.747 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:13.748 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 1: (()+0x12dd0) [0x7f045cb99dd0] 2020-06-27T04:47:13.748 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x560f1af3c707] 2020-06-27T04:47:13.748 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x560f1af3caa0] 2020-06-27T04:47:13.748 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x560f1af6e67a] 2020-06-27T04:47:13.748 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x560f1af6fa57] 2020-06-27T04:47:13.748 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x560f1abfa938] 2020-06-27T04:47:13.749 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x560f1adaea70] 2020-06-27T04:47:13.749 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x560f1adbedd7] 2020-06-27T04:47:13.749 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x560f1ac2d252] 2020-06-27T04:47:13.749 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x560f1abd0e2e] 2020-06-27T04:47:13.749 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x560f1aa514e9] 2020-06-27T04:47:13.750 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x560f1acb5f78] 2020-06-27T04:47:13.750 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x560f1aa7070f] 2020-06-27T04:47:13.750 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x560f1b0aeb94] 2020-06-27T04:47:13.750 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x560f1b0b17f4] 2020-06-27T04:47:13.750 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 16: (()+0x82de) [0x7f045cb8f2de] 2020-06-27T04:47:13.751 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 17: (clone()+0x43) [0x7f045b8c6e83] 2020-06-27T04:47:13.751 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: debug 2020-06-27T04:47:13.412+0000 7f043458d700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:13.751 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: in thread 7f043458d700 thread_name:tp_osd_tp 2020-06-27T04:47:13.751 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:13.751 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 1: (()+0x12dd0) [0x7f045cb99dd0] 2020-06-27T04:47:13.751 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x560f1af3c707] 2020-06-27T04:47:13.752 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x560f1af3caa0] 2020-06-27T04:47:13.752 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x560f1af6e67a] 2020-06-27T04:47:13.752 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x560f1af6fa57] 2020-06-27T04:47:13.752 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x560f1abfa938] 2020-06-27T04:47:13.752 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x560f1adaea70] 2020-06-27T04:47:13.753 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x560f1adbedd7] 2020-06-27T04:47:13.753 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x560f1ac2d252] 2020-06-27T04:47:13.753 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x560f1abd0e2e] 2020-06-27T04:47:13.753 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x560f1aa514e9] 2020-06-27T04:47:13.753 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x560f1acb5f78] 2020-06-27T04:47:13.754 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x560f1aa7070f] 2020-06-27T04:47:13.754 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x560f1b0aeb94] 2020-06-27T04:47:13.754 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x560f1b0b17f4] 2020-06-27T04:47:13.754 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 16: (()+0x82de) [0x7f045cb8f2de] 2020-06-27T04:47:13.754 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 17: (clone()+0x43) [0x7f045b8c6e83] 2020-06-27T04:47:13.754 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:13.755 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: debug 0> 2020-06-27T04:47:13.412+0000 7f043458d700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:13.755 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: in thread 7f043458d700 thread_name:tp_osd_tp 2020-06-27T04:47:13.755 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:13.755 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 1: (()+0x12dd0) [0x7f045cb99dd0] 2020-06-27T04:47:13.755 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x560f1af3c707] 2020-06-27T04:47:13.756 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x560f1af3caa0] 2020-06-27T04:47:13.756 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x560f1af6e67a] 2020-06-27T04:47:13.756 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x560f1af6fa57] 2020-06-27T04:47:13.756 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x560f1abfa938] 2020-06-27T04:47:13.756 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x560f1adaea70] 2020-06-27T04:47:13.756 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x560f1adbedd7] 2020-06-27T04:47:13.757 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x560f1ac2d252] 2020-06-27T04:47:13.757 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x560f1abd0e2e] 2020-06-27T04:47:13.757 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x560f1aa514e9] 2020-06-27T04:47:13.757 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x560f1acb5f78] 2020-06-27T04:47:13.757 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x560f1aa7070f] 2020-06-27T04:47:13.758 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x560f1b0aeb94] 2020-06-27T04:47:13.758 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x560f1b0b17f4] 2020-06-27T04:47:13.758 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 16: (()+0x82de) [0x7f045cb8f2de] 2020-06-27T04:47:13.758 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 17: (clone()+0x43) [0x7f045b8c6e83] 2020-06-27T04:47:13.758 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:13.759 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: debug -9999> 2020-06-27T04:47:13.412+0000 7f043458d700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:13.759 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: in thread 7f043458d700 thread_name:tp_osd_tp 2020-06-27T04:47:13.759 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:13.759 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 1: (()+0x12dd0) [0x7f045cb99dd0] 2020-06-27T04:47:13.760 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x560f1af3c707] 2020-06-27T04:47:13.760 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x560f1af3caa0] 2020-06-27T04:47:13.760 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x560f1af6e67a] 2020-06-27T04:47:13.760 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x560f1af6fa57] 2020-06-27T04:47:13.760 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x560f1abfa938] 2020-06-27T04:47:13.761 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x560f1adaea70] 2020-06-27T04:47:13.761 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x560f1adbedd7] 2020-06-27T04:47:13.761 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x560f1ac2d252] 2020-06-27T04:47:13.761 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x560f1abd0e2e] 2020-06-27T04:47:13.761 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x560f1aa514e9] 2020-06-27T04:47:13.761 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x560f1acb5f78] 2020-06-27T04:47:13.774 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x560f1aa7070f] 2020-06-27T04:47:13.774 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x560f1b0aeb94] 2020-06-27T04:47:13.774 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x560f1b0b17f4] 2020-06-27T04:47:13.774 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 16: (()+0x82de) [0x7f045cb8f2de] 2020-06-27T04:47:13.775 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: 17: (clone()+0x43) [0x7f045b8c6e83] 2020-06-27T04:47:13.775 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:13.775 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[29513]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:47:13.775 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: cluster 2020-06-27T04:47:11.177485+0000 mgr.x (mgr.34109) 219 : cluster [DBG] pgmap v199: 833 pgs: 123 peering, 48 stale+active+clean, 178 creating+peering, 243 unknown, 133 stale+creating+peering, 108 active+clean; 8.2 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 341 B/s rd, 4.8 KiB/s wr, 7 op/s 2020-06-27T04:47:13.775 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:11.298986+0000 mon.a (mon.0) 605 : audit [INF] from='client.? 172.21.15.31:0/470153951' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41463-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41463-1"}]': finished 2020-06-27T04:47:13.776 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:11.299109+0000 mon.a (mon.0) 606 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-2","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:13.776 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:11.299182+0000 mon.a (mon.0) 607 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-4","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:13.776 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:11.299287+0000 mon.a (mon.0) 608 : audit [INF] from='client.? 172.21.15.31:0/3995737424' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41396-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2020-06-27T04:47:13.776 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: cluster 2020-06-27T04:47:11.299381+0000 mon.a (mon.0) 609 : cluster [DBG] osdmap e65: 8 total, 5 up, 8 in 2020-06-27T04:47:13.776 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:11.306275+0000 mon.b (mon.2) 267 : audit [INF] from='client.? 172.21.15.31:0/3208380055' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.777 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:11.306623+0000 mon.b (mon.2) 268 : audit [INF] from='client.? 172.21.15.31:0/1566790810' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.777 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: cluster 2020-06-27T04:47:11.798208+0000 mon.a (mon.0) 610 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive, 10 pgs peering (PG_AVAILABILITY) 2020-06-27T04:47:13.777 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: cluster 2020-06-27T04:47:11.798254+0000 mon.a (mon.0) 611 : cluster [WRN] Health check failed: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:47:13.777 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:11.798866+0000 mon.a (mon.0) 612 : audit [INF] from='client.? 172.21.15.31:0/3995737424' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41396-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41396-7"}]: dispatch 2020-06-27T04:47:13.777 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:12.238863+0000 mon.a (mon.0) 613 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.778 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:12.241435+0000 mon.a (mon.0) 614 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.778 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:12.242753+0000 mon.c (mon.1) 37 : audit [INF] from='client.? 172.21.15.31:0/414926987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41371-6"}]: dispatch 2020-06-27T04:47:13.778 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:12.256836+0000 mon.a (mon.0) 615 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41371-6"}]: dispatch 2020-06-27T04:47:13.778 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:12.257303+0000 mon.c (mon.1) 38 : audit [INF] from='client.? 172.21.15.31:0/414926987' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41371-6"}]: dispatch 2020-06-27T04:47:13.778 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:12.257695+0000 mon.a (mon.0) 616 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41371-6"}]: dispatch 2020-06-27T04:47:13.779 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:12.258073+0000 mon.c (mon.1) 39 : audit [INF] from='client.? 172.21.15.31:0/414926987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41371-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:47:13.779 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:12.258470+0000 mon.a (mon.0) 617 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41371-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:47:13.779 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:12.753845+0000 mon.a (mon.0) 618 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-2","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:13.779 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:12.753894+0000 mon.a (mon.0) 619 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-2","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:13.779 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:12.753978+0000 mon.a (mon.0) 620 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41371-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2020-06-27T04:47:13.780 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: cluster 2020-06-27T04:47:12.754010+0000 mon.a (mon.0) 621 : cluster [DBG] osdmap e66: 8 total, 5 up, 8 in 2020-06-27T04:47:13.780 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:12.754970+0000 mon.c (mon.1) 40 : audit [INF] from='client.? 172.21.15.31:0/414926987' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41371-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41371-6"}]: dispatch 2020-06-27T04:47:13.780 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:12.755250+0000 mon.c (mon.1) 41 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.780 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:12.756364+0000 mon.a (mon.0) 622 : audit [INF] from='client.? 172.21.15.31:0/4264311892' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41123-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:13.780 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:12.760641+0000 mon.a (mon.0) 623 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41371-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41371-6"}]: dispatch 2020-06-27T04:47:13.781 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:13 smithi031 bash[22603]: audit 2020-06-27T04:47:12.761064+0000 mon.a (mon.0) 624 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:14.030 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:13 smithi031 podman[29874]: 2020-06-27 04:47:13.74240891 +0000 UTC m=+251.257409339 container died c299b703ddeca1e5c11e37c5eadac42f3200285eb182feaf3222976dd3045b5c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:47:14.031 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:13 smithi031 podman[31986]: 2020-06-27 04:47:13.945561604 +0000 UTC m=+235.307566497 container died 97568baaffaca0ed49cbc603d48d13a4c5a1c85f21d2fc61fe1ca627ee825630 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:47:14.473 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:14 smithi031 podman[27717]: 2020-06-27 04:47:14.028550469 +0000 UTC m=+267.962549627 container remove 3c82a83d4166698ffe1ce3ddbcfa4cf9e1952bd66f44df4382953557c8c58b77 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:47:14.473 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:14 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:47:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:14 smithi051 bash[18409]: cluster 2020-06-27T04:47:13.300072+0000 mon.a (mon.0) 625 : cluster [WRN] Health check failed: Degraded data redundancy: 159/891 objects degraded (17.845%), 47 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:14 smithi051 bash[18409]: audit 2020-06-27T04:47:13.312659+0000 mon.a (mon.0) 626 : audit [INF] from='client.? 172.21.15.31:0/3995737424' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41396-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41396-7"}]': finished 2020-06-27T04:47:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:14 smithi051 bash[18409]: audit 2020-06-27T04:47:13.312774+0000 mon.a (mon.0) 627 : audit [INF] from='client.? 172.21.15.31:0/4264311892' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41123-2","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:14.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:14 smithi051 bash[18409]: audit 2020-06-27T04:47:13.772357+0000 mon.a (mon.0) 628 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:14.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:14 smithi051 bash[18409]: cluster 2020-06-27T04:47:13.772597+0000 mon.a (mon.0) 629 : cluster [DBG] osdmap e67: 8 total, 5 up, 8 in 2020-06-27T04:47:14.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:14 smithi051 bash[18409]: audit 2020-06-27T04:47:13.774067+0000 mon.c (mon.1) 42 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41319-4", "tierpool": "test-rados-api-smithi031-41319-4-cache"}]: dispatch 2020-06-27T04:47:14.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:14 smithi051 bash[18409]: audit 2020-06-27T04:47:14.234132+0000 mon.a (mon.0) 630 : audit [INF] from='client.? 172.21.15.31:0/3308998563' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41177-10"}]: dispatch 2020-06-27T04:47:14.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:14 smithi051 bash[18409]: audit 2020-06-27T04:47:14.234331+0000 mon.a (mon.0) 631 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41319-4", "tierpool": "test-rados-api-smithi031-41319-4-cache"}]: dispatch 2020-06-27T04:47:14.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:14 smithi051 bash[18409]: audit 2020-06-27T04:47:14.234544+0000 mon.a (mon.0) 632 : audit [INF] from='client.? 172.21.15.31:0/3308998563' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41177-10"}]: dispatch 2020-06-27T04:47:14.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:14 smithi051 bash[18409]: audit 2020-06-27T04:47:14.234777+0000 mon.a (mon.0) 633 : audit [INF] from='client.? 172.21.15.31:0/3308998563' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41177-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:47:14.973 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:14 smithi031 podman[29874]: 2020-06-27 04:47:14.71494914 +0000 UTC m=+252.229949565 container remove c299b703ddeca1e5c11e37c5eadac42f3200285eb182feaf3222976dd3045b5c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:47:14.973 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:14 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:47:14.973 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:14 smithi031 podman[31986]: 2020-06-27 04:47:14.799698858 +0000 UTC m=+236.161703761 container remove 97568baaffaca0ed49cbc603d48d13a4c5a1c85f21d2fc61fe1ca627ee825630 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:47:14.973 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:14 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:47:14.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[22603]: cluster 2020-06-27T04:47:13.300072+0000 mon.a (mon.0) 625 : cluster [WRN] Health check failed: Degraded data redundancy: 159/891 objects degraded (17.845%), 47 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:14.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[22603]: audit 2020-06-27T04:47:13.312659+0000 mon.a (mon.0) 626 : audit [INF] from='client.? 172.21.15.31:0/3995737424' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41396-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41396-7"}]': finished 2020-06-27T04:47:14.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[22603]: audit 2020-06-27T04:47:13.312774+0000 mon.a (mon.0) 627 : audit [INF] from='client.? 172.21.15.31:0/4264311892' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41123-2","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:14.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[22603]: audit 2020-06-27T04:47:13.772357+0000 mon.a (mon.0) 628 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:14.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[22603]: cluster 2020-06-27T04:47:13.772597+0000 mon.a (mon.0) 629 : cluster [DBG] osdmap e67: 8 total, 5 up, 8 in 2020-06-27T04:47:14.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[22603]: audit 2020-06-27T04:47:13.774067+0000 mon.c (mon.1) 42 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41319-4", "tierpool": "test-rados-api-smithi031-41319-4-cache"}]: dispatch 2020-06-27T04:47:14.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[22603]: audit 2020-06-27T04:47:14.234132+0000 mon.a (mon.0) 630 : audit [INF] from='client.? 172.21.15.31:0/3308998563' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41177-10"}]: dispatch 2020-06-27T04:47:14.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[22603]: audit 2020-06-27T04:47:14.234331+0000 mon.a (mon.0) 631 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41319-4", "tierpool": "test-rados-api-smithi031-41319-4-cache"}]: dispatch 2020-06-27T04:47:14.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[22603]: audit 2020-06-27T04:47:14.234544+0000 mon.a (mon.0) 632 : audit [INF] from='client.? 172.21.15.31:0/3308998563' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41177-10"}]: dispatch 2020-06-27T04:47:14.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[22603]: audit 2020-06-27T04:47:14.234777+0000 mon.a (mon.0) 633 : audit [INF] from='client.? 172.21.15.31:0/3308998563' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41177-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:47:14.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[18426]: cluster 2020-06-27T04:47:13.300072+0000 mon.a (mon.0) 625 : cluster [WRN] Health check failed: Degraded data redundancy: 159/891 objects degraded (17.845%), 47 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:14.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[18426]: audit 2020-06-27T04:47:13.312659+0000 mon.a (mon.0) 626 : audit [INF] from='client.? 172.21.15.31:0/3995737424' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41396-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41396-7"}]': finished 2020-06-27T04:47:14.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[18426]: audit 2020-06-27T04:47:13.312774+0000 mon.a (mon.0) 627 : audit [INF] from='client.? 172.21.15.31:0/4264311892' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41123-2","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:14.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[18426]: audit 2020-06-27T04:47:13.772357+0000 mon.a (mon.0) 628 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:14.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[18426]: cluster 2020-06-27T04:47:13.772597+0000 mon.a (mon.0) 629 : cluster [DBG] osdmap e67: 8 total, 5 up, 8 in 2020-06-27T04:47:14.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[18426]: audit 2020-06-27T04:47:13.774067+0000 mon.c (mon.1) 42 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41319-4", "tierpool": "test-rados-api-smithi031-41319-4-cache"}]: dispatch 2020-06-27T04:47:14.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[18426]: audit 2020-06-27T04:47:14.234132+0000 mon.a (mon.0) 630 : audit [INF] from='client.? 172.21.15.31:0/3308998563' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41177-10"}]: dispatch 2020-06-27T04:47:14.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[18426]: audit 2020-06-27T04:47:14.234331+0000 mon.a (mon.0) 631 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41319-4", "tierpool": "test-rados-api-smithi031-41319-4-cache"}]: dispatch 2020-06-27T04:47:14.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[18426]: audit 2020-06-27T04:47:14.234544+0000 mon.a (mon.0) 632 : audit [INF] from='client.? 172.21.15.31:0/3308998563' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41177-10"}]: dispatch 2020-06-27T04:47:14.978 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:14 smithi031 bash[18426]: audit 2020-06-27T04:47:14.234777+0000 mon.a (mon.0) 633 : audit [INF] from='client.? 172.21.15.31:0/3308998563' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41177-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:47:15.365 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:15 smithi031 podman[42238]: 2020-06-27 04:47:15.062844232 +0000 UTC m=+1.015117003 container create 17551f25bc1b3863c9e226eb75092ba8d9166a480927ee0b96b724911f2b7b3f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:47:15.631 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:15 smithi031 podman[42270]: 2020-06-27 04:47:15.362817313 +0000 UTC m=+0.630143675 container create 5e27f397f29bbd59ecf1c9a221a7bb7fb874f541a4d05767246fb5be18dbed70 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:47:15.632 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:15 smithi031 podman[42238]: 2020-06-27 04:47:15.439017498 +0000 UTC m=+1.391290249 container init 17551f25bc1b3863c9e226eb75092ba8d9166a480927ee0b96b724911f2b7b3f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:47:15.632 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:15 smithi031 podman[42238]: 2020-06-27 04:47:15.489352133 +0000 UTC m=+1.441624785 container start 17551f25bc1b3863c9e226eb75092ba8d9166a480927ee0b96b724911f2b7b3f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:47:15.632 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:15 smithi031 podman[42238]: 2020-06-27 04:47:15.489423742 +0000 UTC m=+1.441696398 container attach 17551f25bc1b3863c9e226eb75092ba8d9166a480927ee0b96b724911f2b7b3f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:47:15.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:13.179364+0000 mgr.x (mgr.34109) 220 : cluster [DBG] pgmap v202: 905 pgs: 16 undersized+degraded+peered, 31 active+undersized+degraded, 145 active+undersized, 66 undersized+peered, 134 active+clean, 1 creating+incomplete, 61 stale+creating+peering, 166 unknown, 154 creating+peering, 23 stale+active+clean, 108 peering; 13 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 0 B/s rd, 16 KiB/s wr, 21 op/s; 159/891 objects degraded (17.845%) 2020-06-27T04:47:15.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: audit 2020-06-27T04:47:14.684214+0000 mon.a (mon.0) 634 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41371-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41371-6"}]': finished 2020-06-27T04:47:15.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: audit 2020-06-27T04:47:14.684361+0000 mon.a (mon.0) 635 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41319-4", "tierpool": "test-rados-api-smithi031-41319-4-cache"}]': finished 2020-06-27T04:47:15.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: audit 2020-06-27T04:47:14.684435+0000 mon.a (mon.0) 636 : audit [INF] from='client.? 172.21.15.31:0/3308998563' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41177-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2020-06-27T04:47:15.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.685260+0000 mon.a (mon.0) 637 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.685350+0000 mon.a (mon.0) 638 : cluster [INF] osd.2 failed (root=default,host=smithi031) (connection refused reported by osd.0) 2020-06-27T04:47:15.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.685514+0000 mon.a (mon.0) 639 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.685539+0000 mon.a (mon.0) 640 : cluster [INF] osd.3 failed (root=default,host=smithi031) (connection refused reported by osd.0) 2020-06-27T04:47:15.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.685655+0000 mon.a (mon.0) 641 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.685737+0000 mon.a (mon.0) 642 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: audit 2020-06-27T04:47:14.685872+0000 mon.c (mon.1) 43 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi031-41319-4", "overlaypool": "test-rados-api-smithi031-41319-4-cache"}]: dispatch 2020-06-27T04:47:15.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.685906+0000 mon.a (mon.0) 643 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.686020+0000 mon.a (mon.0) 644 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.686108+0000 mon.a (mon.0) 645 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.686195+0000 mon.a (mon.0) 646 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.686264+0000 mon.a (mon.0) 647 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.686380+0000 mon.a (mon.0) 648 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.686448+0000 mon.a (mon.0) 649 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.686512+0000 mon.a (mon.0) 650 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.686572+0000 mon.a (mon.0) 651 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.686637+0000 mon.a (mon.0) 652 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.686711+0000 mon.a (mon.0) 653 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.973 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.686787+0000 mon.a (mon.0) 654 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.973 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.686863+0000 mon.a (mon.0) 655 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.973 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.687021+0000 mon.a (mon.0) 656 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:15.973 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.687083+0000 mon.a (mon.0) 657 : cluster [DBG] osd.3 reported immediately failed by osd.4 2020-06-27T04:47:15.973 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.687165+0000 mon.a (mon.0) 658 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:15.973 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.687233+0000 mon.a (mon.0) 659 : cluster [DBG] osd.3 reported immediately failed by osd.4 2020-06-27T04:47:15.974 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.687342+0000 mon.a (mon.0) 660 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.974 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.687428+0000 mon.a (mon.0) 661 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.974 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.687502+0000 mon.a (mon.0) 662 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.974 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.687563+0000 mon.a (mon.0) 663 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.974 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.687628+0000 mon.a (mon.0) 664 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.975 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.687699+0000 mon.a (mon.0) 665 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:15.975 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.687784+0000 mon.a (mon.0) 666 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:15.975 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.687862+0000 mon.a (mon.0) 667 : cluster [DBG] osd.3 reported immediately failed by osd.4 2020-06-27T04:47:15.975 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: audit 2020-06-27T04:47:14.687932+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.31:0/2761249844' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:15.975 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.687961+0000 mon.a (mon.0) 668 : cluster [DBG] osd.3 reported immediately failed by osd.4 2020-06-27T04:47:15.976 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.687994+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e68: 8 total, 5 up, 8 in 2020-06-27T04:47:15.976 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: audit 2020-06-27T04:47:14.691724+0000 mon.a (mon.0) 670 : audit [INF] from='client.? 172.21.15.31:0/3308998563' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41177-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41177-10"}]: dispatch 2020-06-27T04:47:15.976 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: audit 2020-06-27T04:47:14.692073+0000 mon.a (mon.0) 671 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi031-41319-4", "overlaypool": "test-rados-api-smithi031-41319-4-cache"}]: dispatch 2020-06-27T04:47:15.976 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: audit 2020-06-27T04:47:14.692336+0000 mon.a (mon.0) 672 : audit [INF] from='client.? 172.21.15.31:0/4264311892' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41123-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:15.976 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: audit 2020-06-27T04:47:14.692583+0000 mon.a (mon.0) 673 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:15.977 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.692863+0000 mon.a (mon.0) 674 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.977 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.693018+0000 mon.a (mon.0) 675 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:15.977 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.699197+0000 mon.a (mon.0) 676 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.977 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.699330+0000 mon.a (mon.0) 677 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.977 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.867673+0000 mon.a (mon.0) 678 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.977 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.867761+0000 mon.a (mon.0) 679 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.978 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.868293+0000 mon.a (mon.0) 680 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.978 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.868408+0000 mon.a (mon.0) 681 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.978 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.868515+0000 mon.a (mon.0) 682 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.978 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.868613+0000 mon.a (mon.0) 683 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.978 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.868943+0000 mon.a (mon.0) 684 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.979 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.873497+0000 mon.a (mon.0) 685 : cluster [DBG] osd.3 reported immediately failed by osd.4 2020-06-27T04:47:15.979 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.873638+0000 mon.a (mon.0) 686 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:15.979 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.873734+0000 mon.a (mon.0) 687 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.979 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.873832+0000 mon.a (mon.0) 688 : cluster [DBG] osd.3 reported immediately failed by osd.4 2020-06-27T04:47:15.979 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.873923+0000 mon.a (mon.0) 689 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.980 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.874015+0000 mon.a (mon.0) 690 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:15.980 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.890285+0000 mon.a (mon.0) 691 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.980 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.890989+0000 mon.a (mon.0) 692 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:15.980 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:14.899409+0000 mon.a (mon.0) 693 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.980 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:15.291424+0000 mon.a (mon.0) 694 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.980 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:15.291983+0000 mon.a (mon.0) 695 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:15.981 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:15 smithi051 bash[18409]: cluster 2020-06-27T04:47:15.300470+0000 mon.a (mon.0) 696 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.982 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:15 smithi031 podman[42238]: 2020-06-27 04:47:15.725522803 +0000 UTC m=+1.677795459 container died 17551f25bc1b3863c9e226eb75092ba8d9166a480927ee0b96b724911f2b7b3f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:47:15.982 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:15 smithi031 podman[42270]: 2020-06-27 04:47:15.72100473 +0000 UTC m=+0.988331031 container init 5e27f397f29bbd59ecf1c9a221a7bb7fb874f541a4d05767246fb5be18dbed70 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:47:15.983 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:15 smithi031 podman[42287]: 2020-06-27 04:47:15.629307343 +0000 UTC m=+0.808436446 container create d9c3003f3b239c737eedc9dfe249575abb36428d02fa6597086589fe3584364a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:47:15.983 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:13.179364+0000 mgr.x (mgr.34109) 220 : cluster [DBG] pgmap v202: 905 pgs: 16 undersized+degraded+peered, 31 active+undersized+degraded, 145 active+undersized, 66 undersized+peered, 134 active+clean, 1 creating+incomplete, 61 stale+creating+peering, 166 unknown, 154 creating+peering, 23 stale+active+clean, 108 peering; 13 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 0 B/s rd, 16 KiB/s wr, 21 op/s; 159/891 objects degraded (17.845%) 2020-06-27T04:47:15.983 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: audit 2020-06-27T04:47:14.684214+0000 mon.a (mon.0) 634 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41371-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41371-6"}]': finished 2020-06-27T04:47:15.983 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: audit 2020-06-27T04:47:14.684361+0000 mon.a (mon.0) 635 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41319-4", "tierpool": "test-rados-api-smithi031-41319-4-cache"}]': finished 2020-06-27T04:47:15.984 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: audit 2020-06-27T04:47:14.684435+0000 mon.a (mon.0) 636 : audit [INF] from='client.? 172.21.15.31:0/3308998563' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41177-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2020-06-27T04:47:15.984 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.685260+0000 mon.a (mon.0) 637 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.984 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.685350+0000 mon.a (mon.0) 638 : cluster [INF] osd.2 failed (root=default,host=smithi031) (connection refused reported by osd.0) 2020-06-27T04:47:15.984 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.685514+0000 mon.a (mon.0) 639 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.984 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.685539+0000 mon.a (mon.0) 640 : cluster [INF] osd.3 failed (root=default,host=smithi031) (connection refused reported by osd.0) 2020-06-27T04:47:15.985 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.685655+0000 mon.a (mon.0) 641 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.985 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.685737+0000 mon.a (mon.0) 642 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.985 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: audit 2020-06-27T04:47:14.685872+0000 mon.c (mon.1) 43 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi031-41319-4", "overlaypool": "test-rados-api-smithi031-41319-4-cache"}]: dispatch 2020-06-27T04:47:15.985 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.685906+0000 mon.a (mon.0) 643 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.985 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.686020+0000 mon.a (mon.0) 644 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.986 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.686108+0000 mon.a (mon.0) 645 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.986 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.686195+0000 mon.a (mon.0) 646 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.986 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.686264+0000 mon.a (mon.0) 647 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.986 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.686380+0000 mon.a (mon.0) 648 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.986 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.686448+0000 mon.a (mon.0) 649 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.986 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.686512+0000 mon.a (mon.0) 650 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.987 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.686572+0000 mon.a (mon.0) 651 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.987 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.686637+0000 mon.a (mon.0) 652 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.987 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.686711+0000 mon.a (mon.0) 653 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.987 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.686787+0000 mon.a (mon.0) 654 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.987 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.686863+0000 mon.a (mon.0) 655 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.988 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.687021+0000 mon.a (mon.0) 656 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:15.988 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.687083+0000 mon.a (mon.0) 657 : cluster [DBG] osd.3 reported immediately failed by osd.4 2020-06-27T04:47:15.988 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.687165+0000 mon.a (mon.0) 658 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:15.988 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.687233+0000 mon.a (mon.0) 659 : cluster [DBG] osd.3 reported immediately failed by osd.4 2020-06-27T04:47:15.988 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.687342+0000 mon.a (mon.0) 660 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.989 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.687428+0000 mon.a (mon.0) 661 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.989 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.687502+0000 mon.a (mon.0) 662 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.989 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.687563+0000 mon.a (mon.0) 663 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.989 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.687628+0000 mon.a (mon.0) 664 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.989 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.687699+0000 mon.a (mon.0) 665 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:15.990 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.687784+0000 mon.a (mon.0) 666 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:15.990 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.687862+0000 mon.a (mon.0) 667 : cluster [DBG] osd.3 reported immediately failed by osd.4 2020-06-27T04:47:15.990 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: audit 2020-06-27T04:47:14.687932+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.31:0/2761249844' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:15.990 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.687961+0000 mon.a (mon.0) 668 : cluster [DBG] osd.3 reported immediately failed by osd.4 2020-06-27T04:47:15.990 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.687994+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e68: 8 total, 5 up, 8 in 2020-06-27T04:47:15.990 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: audit 2020-06-27T04:47:14.691724+0000 mon.a (mon.0) 670 : audit [INF] from='client.? 172.21.15.31:0/3308998563' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41177-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41177-10"}]: dispatch 2020-06-27T04:47:15.991 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: audit 2020-06-27T04:47:14.692073+0000 mon.a (mon.0) 671 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi031-41319-4", "overlaypool": "test-rados-api-smithi031-41319-4-cache"}]: dispatch 2020-06-27T04:47:15.991 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: audit 2020-06-27T04:47:14.692336+0000 mon.a (mon.0) 672 : audit [INF] from='client.? 172.21.15.31:0/4264311892' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41123-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:15.991 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: audit 2020-06-27T04:47:14.692583+0000 mon.a (mon.0) 673 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:15.991 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.692863+0000 mon.a (mon.0) 674 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.991 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.693018+0000 mon.a (mon.0) 675 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:15.992 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.699197+0000 mon.a (mon.0) 676 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.992 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.699330+0000 mon.a (mon.0) 677 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.992 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.867673+0000 mon.a (mon.0) 678 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.992 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.867761+0000 mon.a (mon.0) 679 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.992 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.868293+0000 mon.a (mon.0) 680 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.993 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.868408+0000 mon.a (mon.0) 681 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.993 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.868515+0000 mon.a (mon.0) 682 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.993 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.868613+0000 mon.a (mon.0) 683 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.993 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.868943+0000 mon.a (mon.0) 684 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.993 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.873497+0000 mon.a (mon.0) 685 : cluster [DBG] osd.3 reported immediately failed by osd.4 2020-06-27T04:47:15.994 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.873638+0000 mon.a (mon.0) 686 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:15.994 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.873734+0000 mon.a (mon.0) 687 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.994 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.873832+0000 mon.a (mon.0) 688 : cluster [DBG] osd.3 reported immediately failed by osd.4 2020-06-27T04:47:15.994 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.873923+0000 mon.a (mon.0) 689 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.994 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.874015+0000 mon.a (mon.0) 690 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:15.994 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.890285+0000 mon.a (mon.0) 691 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.995 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.890989+0000 mon.a (mon.0) 692 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:15.995 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:14.899409+0000 mon.a (mon.0) 693 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.995 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:15.291424+0000 mon.a (mon.0) 694 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.995 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:15.291983+0000 mon.a (mon.0) 695 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:15.995 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[22603]: cluster 2020-06-27T04:47:15.300470+0000 mon.a (mon.0) 696 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.996 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:13.179364+0000 mgr.x (mgr.34109) 220 : cluster [DBG] pgmap v202: 905 pgs: 16 undersized+degraded+peered, 31 active+undersized+degraded, 145 active+undersized, 66 undersized+peered, 134 active+clean, 1 creating+incomplete, 61 stale+creating+peering, 166 unknown, 154 creating+peering, 23 stale+active+clean, 108 peering; 13 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 0 B/s rd, 16 KiB/s wr, 21 op/s; 159/891 objects degraded (17.845%) 2020-06-27T04:47:15.996 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: audit 2020-06-27T04:47:14.684214+0000 mon.a (mon.0) 634 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41371-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41371-6"}]': finished 2020-06-27T04:47:15.996 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: audit 2020-06-27T04:47:14.684361+0000 mon.a (mon.0) 635 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41319-4", "tierpool": "test-rados-api-smithi031-41319-4-cache"}]': finished 2020-06-27T04:47:15.996 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: audit 2020-06-27T04:47:14.684435+0000 mon.a (mon.0) 636 : audit [INF] from='client.? 172.21.15.31:0/3308998563' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41177-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2020-06-27T04:47:15.996 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.685260+0000 mon.a (mon.0) 637 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.997 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.685350+0000 mon.a (mon.0) 638 : cluster [INF] osd.2 failed (root=default,host=smithi031) (connection refused reported by osd.0) 2020-06-27T04:47:15.997 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.685514+0000 mon.a (mon.0) 639 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.997 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.685539+0000 mon.a (mon.0) 640 : cluster [INF] osd.3 failed (root=default,host=smithi031) (connection refused reported by osd.0) 2020-06-27T04:47:15.997 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.685655+0000 mon.a (mon.0) 641 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.997 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.685737+0000 mon.a (mon.0) 642 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.998 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: audit 2020-06-27T04:47:14.685872+0000 mon.c (mon.1) 43 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi031-41319-4", "overlaypool": "test-rados-api-smithi031-41319-4-cache"}]: dispatch 2020-06-27T04:47:15.998 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.685906+0000 mon.a (mon.0) 643 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.998 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.686020+0000 mon.a (mon.0) 644 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.998 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.686108+0000 mon.a (mon.0) 645 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.998 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.686195+0000 mon.a (mon.0) 646 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:15.999 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.686264+0000 mon.a (mon.0) 647 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.999 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.686380+0000 mon.a (mon.0) 648 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:15.999 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.686448+0000 mon.a (mon.0) 649 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.999 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.686512+0000 mon.a (mon.0) 650 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:15.999 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.686572+0000 mon.a (mon.0) 651 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:15.999 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.686637+0000 mon.a (mon.0) 652 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:16.000 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.686711+0000 mon.a (mon.0) 653 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:16.000 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.686787+0000 mon.a (mon.0) 654 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:16.000 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.686863+0000 mon.a (mon.0) 655 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:16.000 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.687021+0000 mon.a (mon.0) 656 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:16.000 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.687083+0000 mon.a (mon.0) 657 : cluster [DBG] osd.3 reported immediately failed by osd.4 2020-06-27T04:47:16.001 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.687165+0000 mon.a (mon.0) 658 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:16.001 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.687233+0000 mon.a (mon.0) 659 : cluster [DBG] osd.3 reported immediately failed by osd.4 2020-06-27T04:47:16.001 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.687342+0000 mon.a (mon.0) 660 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:16.001 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.687428+0000 mon.a (mon.0) 661 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:16.001 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.687502+0000 mon.a (mon.0) 662 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:16.002 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.687563+0000 mon.a (mon.0) 663 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:16.002 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.687628+0000 mon.a (mon.0) 664 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:16.002 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.687699+0000 mon.a (mon.0) 665 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:16.002 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.687784+0000 mon.a (mon.0) 666 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:16.002 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.687862+0000 mon.a (mon.0) 667 : cluster [DBG] osd.3 reported immediately failed by osd.4 2020-06-27T04:47:16.003 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: audit 2020-06-27T04:47:14.687932+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.31:0/2761249844' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:16.003 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.687961+0000 mon.a (mon.0) 668 : cluster [DBG] osd.3 reported immediately failed by osd.4 2020-06-27T04:47:16.003 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.687994+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e68: 8 total, 5 up, 8 in 2020-06-27T04:47:16.003 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: audit 2020-06-27T04:47:14.691724+0000 mon.a (mon.0) 670 : audit [INF] from='client.? 172.21.15.31:0/3308998563' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41177-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41177-10"}]: dispatch 2020-06-27T04:47:16.003 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: audit 2020-06-27T04:47:14.692073+0000 mon.a (mon.0) 671 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi031-41319-4", "overlaypool": "test-rados-api-smithi031-41319-4-cache"}]: dispatch 2020-06-27T04:47:16.003 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: audit 2020-06-27T04:47:14.692336+0000 mon.a (mon.0) 672 : audit [INF] from='client.? 172.21.15.31:0/4264311892' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41123-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:16.004 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: audit 2020-06-27T04:47:14.692583+0000 mon.a (mon.0) 673 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:16.004 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.692863+0000 mon.a (mon.0) 674 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:16.004 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.693018+0000 mon.a (mon.0) 675 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:16.004 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.699197+0000 mon.a (mon.0) 676 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:16.004 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.699330+0000 mon.a (mon.0) 677 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:16.005 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.867673+0000 mon.a (mon.0) 678 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:16.005 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.867761+0000 mon.a (mon.0) 679 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:16.005 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.868293+0000 mon.a (mon.0) 680 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:16.005 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.868408+0000 mon.a (mon.0) 681 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:16.005 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.868515+0000 mon.a (mon.0) 682 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:16.006 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.868613+0000 mon.a (mon.0) 683 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:16.006 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.868943+0000 mon.a (mon.0) 684 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:47:16.006 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.873497+0000 mon.a (mon.0) 685 : cluster [DBG] osd.3 reported immediately failed by osd.4 2020-06-27T04:47:16.006 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.873638+0000 mon.a (mon.0) 686 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:16.006 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.873734+0000 mon.a (mon.0) 687 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:16.007 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.873832+0000 mon.a (mon.0) 688 : cluster [DBG] osd.3 reported immediately failed by osd.4 2020-06-27T04:47:16.007 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.873923+0000 mon.a (mon.0) 689 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:47:16.007 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.874015+0000 mon.a (mon.0) 690 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:16.007 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.890285+0000 mon.a (mon.0) 691 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:16.007 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.890989+0000 mon.a (mon.0) 692 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:16.007 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:14.899409+0000 mon.a (mon.0) 693 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:16.008 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:15.291424+0000 mon.a (mon.0) 694 : cluster [DBG] osd.2 reported immediately failed by osd.6 2020-06-27T04:47:16.008 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:15.291983+0000 mon.a (mon.0) 695 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:47:16.008 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:15 smithi031 bash[18426]: cluster 2020-06-27T04:47:15.300470+0000 mon.a (mon.0) 696 : cluster [DBG] osd.2 reported immediately failed by osd.0 2020-06-27T04:47:16.372 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:16 smithi031 podman[42270]: 2020-06-27 04:47:16.139831972 +0000 UTC m=+1.407158253 container start 5e27f397f29bbd59ecf1c9a221a7bb7fb874f541a4d05767246fb5be18dbed70 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:47:16.373 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:16 smithi031 podman[42270]: 2020-06-27 04:47:16.139894387 +0000 UTC m=+1.407220696 container attach 5e27f397f29bbd59ecf1c9a221a7bb7fb874f541a4d05767246fb5be18dbed70 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:47:16.635 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:16 smithi031 podman[42270]: 2020-06-27 04:47:16.509261682 +0000 UTC m=+1.776587990 container died 5e27f397f29bbd59ecf1c9a221a7bb7fb874f541a4d05767246fb5be18dbed70 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:47:16.636 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:16 smithi031 podman[42238]: 2020-06-27 04:47:16.571245474 +0000 UTC m=+2.523518146 container remove 17551f25bc1b3863c9e226eb75092ba8d9166a480927ee0b96b724911f2b7b3f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:47:16.636 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:16 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Failed with result 'exit-code'. 2020-06-27T04:47:16.636 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:16 smithi031 podman[42287]: 2020-06-27 04:47:16.370287349 +0000 UTC m=+1.549416559 container init d9c3003f3b239c737eedc9dfe249575abb36428d02fa6597086589fe3584364a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:47:16.636 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:16 smithi031 podman[42287]: 2020-06-27 04:47:16.485023155 +0000 UTC m=+1.664152266 container start d9c3003f3b239c737eedc9dfe249575abb36428d02fa6597086589fe3584364a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:47:16.636 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:16 smithi031 podman[42287]: 2020-06-27 04:47:16.485098043 +0000 UTC m=+1.664227160 container attach d9c3003f3b239c737eedc9dfe249575abb36428d02fa6597086589fe3584364a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:47:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:16 smithi051 bash[18409]: cluster 2020-06-27T04:47:15.180850+0000 mgr.x (mgr.34109) 221 : cluster [DBG] pgmap v205: 921 pgs: 43 undersized+degraded+peered, 71 active+undersized+degraded, 381 active+undersized, 160 undersized+peered, 131 active+clean, 3 creating+incomplete, 3 stale+creating+peering, 63 unknown, 64 creating+peering, 2 stale+active+clean; 17 KiB data, 6.4 MiB used, 707 GiB / 715 GiB avail; 18 KiB/s wr, 20 op/s; 363/990 objects degraded (36.667%) 2020-06-27T04:47:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:16 smithi051 bash[18409]: cluster 2020-06-27T04:47:15.686217+0000 mon.a (mon.0) 697 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:47:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:16 smithi051 bash[18409]: audit 2020-06-27T04:47:16.171014+0000 mon.a (mon.0) 698 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi031-41319-4", "overlaypool": "test-rados-api-smithi031-41319-4-cache"}]': finished 2020-06-27T04:47:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:16 smithi051 bash[18409]: audit 2020-06-27T04:47:16.171120+0000 mon.a (mon.0) 699 : audit [INF] from='client.? 172.21.15.31:0/4264311892' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41123-3","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:16.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:16 smithi051 bash[18409]: audit 2020-06-27T04:47:16.171191+0000 mon.a (mon.0) 700 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-3","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:16.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:16 smithi051 bash[18409]: cluster 2020-06-27T04:47:16.171318+0000 mon.a (mon.0) 701 : cluster [DBG] osdmap e69: 8 total, 3 up, 8 in 2020-06-27T04:47:16.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:16 smithi051 bash[18409]: audit 2020-06-27T04:47:16.171702+0000 mon.c (mon.1) 45 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi031-41319-4-cache", "mode": "writeback"}]: dispatch 2020-06-27T04:47:16.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:16 smithi051 bash[18409]: audit 2020-06-27T04:47:16.172233+0000 mon.a (mon.0) 702 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi031-41319-4-cache", "mode": "writeback"}]: dispatch 2020-06-27T04:47:16.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:16 smithi051 bash[18409]: audit 2020-06-27T04:47:16.173354+0000 mon.a (mon.0) 703 : audit [INF] from='client.? 172.21.15.31:0/4264311892' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi031-41123-3", "field": "max_bytes", "val": "4096"}]: dispatch 2020-06-27T04:47:16.973 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:16 smithi031 podman[42287]: 2020-06-27 04:47:16.766426151 +0000 UTC m=+1.945555280 container died d9c3003f3b239c737eedc9dfe249575abb36428d02fa6597086589fe3584364a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:47:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:16 smithi031 bash[18426]: cluster 2020-06-27T04:47:15.180850+0000 mgr.x (mgr.34109) 221 : cluster [DBG] pgmap v205: 921 pgs: 43 undersized+degraded+peered, 71 active+undersized+degraded, 381 active+undersized, 160 undersized+peered, 131 active+clean, 3 creating+incomplete, 3 stale+creating+peering, 63 unknown, 64 creating+peering, 2 stale+active+clean; 17 KiB data, 6.4 MiB used, 707 GiB / 715 GiB avail; 18 KiB/s wr, 20 op/s; 363/990 objects degraded (36.667%) 2020-06-27T04:47:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:16 smithi031 bash[18426]: cluster 2020-06-27T04:47:15.686217+0000 mon.a (mon.0) 697 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:47:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:16 smithi031 bash[18426]: audit 2020-06-27T04:47:16.171014+0000 mon.a (mon.0) 698 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi031-41319-4", "overlaypool": "test-rados-api-smithi031-41319-4-cache"}]': finished 2020-06-27T04:47:16.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:16 smithi031 bash[18426]: audit 2020-06-27T04:47:16.171120+0000 mon.a (mon.0) 699 : audit [INF] from='client.? 172.21.15.31:0/4264311892' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41123-3","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:16.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:16 smithi031 bash[18426]: audit 2020-06-27T04:47:16.171191+0000 mon.a (mon.0) 700 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-3","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:16.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:16 smithi031 bash[18426]: cluster 2020-06-27T04:47:16.171318+0000 mon.a (mon.0) 701 : cluster [DBG] osdmap e69: 8 total, 3 up, 8 in 2020-06-27T04:47:16.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:16 smithi031 bash[18426]: audit 2020-06-27T04:47:16.171702+0000 mon.c (mon.1) 45 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi031-41319-4-cache", "mode": "writeback"}]: dispatch 2020-06-27T04:47:16.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:16 smithi031 bash[18426]: audit 2020-06-27T04:47:16.172233+0000 mon.a (mon.0) 702 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi031-41319-4-cache", "mode": "writeback"}]: dispatch 2020-06-27T04:47:16.978 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:16 smithi031 bash[18426]: audit 2020-06-27T04:47:16.173354+0000 mon.a (mon.0) 703 : audit [INF] from='client.? 172.21.15.31:0/4264311892' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi031-41123-3", "field": "max_bytes", "val": "4096"}]: dispatch 2020-06-27T04:47:16.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:16 smithi031 bash[22603]: cluster 2020-06-27T04:47:15.180850+0000 mgr.x (mgr.34109) 221 : cluster [DBG] pgmap v205: 921 pgs: 43 undersized+degraded+peered, 71 active+undersized+degraded, 381 active+undersized, 160 undersized+peered, 131 active+clean, 3 creating+incomplete, 3 stale+creating+peering, 63 unknown, 64 creating+peering, 2 stale+active+clean; 17 KiB data, 6.4 MiB used, 707 GiB / 715 GiB avail; 18 KiB/s wr, 20 op/s; 363/990 objects degraded (36.667%) 2020-06-27T04:47:16.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:16 smithi031 bash[22603]: cluster 2020-06-27T04:47:15.686217+0000 mon.a (mon.0) 697 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:47:16.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:16 smithi031 bash[22603]: audit 2020-06-27T04:47:16.171014+0000 mon.a (mon.0) 698 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi031-41319-4", "overlaypool": "test-rados-api-smithi031-41319-4-cache"}]': finished 2020-06-27T04:47:16.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:16 smithi031 bash[22603]: audit 2020-06-27T04:47:16.171120+0000 mon.a (mon.0) 699 : audit [INF] from='client.? 172.21.15.31:0/4264311892' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41123-3","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:16.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:16 smithi031 bash[22603]: audit 2020-06-27T04:47:16.171191+0000 mon.a (mon.0) 700 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-3","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:16.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:16 smithi031 bash[22603]: cluster 2020-06-27T04:47:16.171318+0000 mon.a (mon.0) 701 : cluster [DBG] osdmap e69: 8 total, 3 up, 8 in 2020-06-27T04:47:16.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:16 smithi031 bash[22603]: audit 2020-06-27T04:47:16.171702+0000 mon.c (mon.1) 45 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi031-41319-4-cache", "mode": "writeback"}]: dispatch 2020-06-27T04:47:16.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:16 smithi031 bash[22603]: audit 2020-06-27T04:47:16.172233+0000 mon.a (mon.0) 702 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi031-41319-4-cache", "mode": "writeback"}]: dispatch 2020-06-27T04:47:16.981 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:16 smithi031 bash[22603]: audit 2020-06-27T04:47:16.173354+0000 mon.a (mon.0) 703 : audit [INF] from='client.? 172.21.15.31:0/4264311892' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi031-41123-3", "field": "max_bytes", "val": "4096"}]: dispatch 2020-06-27T04:47:17.473 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:17 smithi031 podman[42270]: 2020-06-27 04:47:17.004726978 +0000 UTC m=+2.272053288 container remove 5e27f397f29bbd59ecf1c9a221a7bb7fb874f541a4d05767246fb5be18dbed70 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:47:17.473 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:17 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Failed with result 'exit-code'. 2020-06-27T04:47:17.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:17 smithi051 bash[18409]: cluster 2020-06-27T04:47:16.692835+0000 mon.a (mon.0) 704 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2020-06-27T04:47:17.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:17 smithi051 bash[18409]: audit 2020-06-27T04:47:16.698695+0000 mon.a (mon.0) 705 : audit [INF] from='client.? 172.21.15.31:0/3308998563' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41177-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41177-10"}]': finished 2020-06-27T04:47:17.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:17 smithi051 bash[18409]: audit 2020-06-27T04:47:16.698771+0000 mon.a (mon.0) 706 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi031-41319-4-cache", "mode": "writeback"}]': finished 2020-06-27T04:47:17.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:17 smithi051 bash[18409]: audit 2020-06-27T04:47:16.698898+0000 mon.a (mon.0) 707 : audit [INF] from='client.? 172.21.15.31:0/4264311892' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi031-41123-3", "field": "max_bytes", "val": "4096"}]': finished 2020-06-27T04:47:17.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:17 smithi051 bash[18409]: cluster 2020-06-27T04:47:16.698992+0000 mon.a (mon.0) 708 : cluster [DBG] osdmap e70: 8 total, 3 up, 8 in 2020-06-27T04:47:17.973 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:17 smithi031 podman[42287]: 2020-06-27 04:47:17.52372205 +0000 UTC m=+2.702851165 container remove d9c3003f3b239c737eedc9dfe249575abb36428d02fa6597086589fe3584364a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:47:17.973 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:17 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2020-06-27T04:47:17.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:17 smithi031 bash[18426]: cluster 2020-06-27T04:47:16.692835+0000 mon.a (mon.0) 704 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2020-06-27T04:47:17.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:17 smithi031 bash[18426]: audit 2020-06-27T04:47:16.698695+0000 mon.a (mon.0) 705 : audit [INF] from='client.? 172.21.15.31:0/3308998563' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41177-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41177-10"}]': finished 2020-06-27T04:47:17.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:17 smithi031 bash[18426]: audit 2020-06-27T04:47:16.698771+0000 mon.a (mon.0) 706 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi031-41319-4-cache", "mode": "writeback"}]': finished 2020-06-27T04:47:17.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:17 smithi031 bash[18426]: audit 2020-06-27T04:47:16.698898+0000 mon.a (mon.0) 707 : audit [INF] from='client.? 172.21.15.31:0/4264311892' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi031-41123-3", "field": "max_bytes", "val": "4096"}]': finished 2020-06-27T04:47:17.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:17 smithi031 bash[18426]: cluster 2020-06-27T04:47:16.698992+0000 mon.a (mon.0) 708 : cluster [DBG] osdmap e70: 8 total, 3 up, 8 in 2020-06-27T04:47:17.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:17 smithi031 bash[22603]: cluster 2020-06-27T04:47:16.692835+0000 mon.a (mon.0) 704 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2020-06-27T04:47:17.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:17 smithi031 bash[22603]: audit 2020-06-27T04:47:16.698695+0000 mon.a (mon.0) 705 : audit [INF] from='client.? 172.21.15.31:0/3308998563' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41177-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41177-10"}]': finished 2020-06-27T04:47:17.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:17 smithi031 bash[22603]: audit 2020-06-27T04:47:16.698771+0000 mon.a (mon.0) 706 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi031-41319-4-cache", "mode": "writeback"}]': finished 2020-06-27T04:47:17.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:17 smithi031 bash[22603]: audit 2020-06-27T04:47:16.698898+0000 mon.a (mon.0) 707 : audit [INF] from='client.? 172.21.15.31:0/4264311892' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi031-41123-3", "field": "max_bytes", "val": "4096"}]': finished 2020-06-27T04:47:17.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:17 smithi031 bash[22603]: cluster 2020-06-27T04:47:16.698992+0000 mon.a (mon.0) 708 : cluster [DBG] osdmap e70: 8 total, 3 up, 8 in 2020-06-27T04:47:18.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:18 smithi051 bash[18409]: cluster 2020-06-27T04:47:17.181813+0000 mgr.x (mgr.34109) 222 : cluster [DBG] pgmap v208: 897 pgs: 2 stale+creating+incomplete, 139 stale+active+undersized, 79 stale+undersized+peered, 21 undersized+degraded+peered, 51 active+undersized+degraded, 242 active+undersized, 81 undersized+peered, 79 active+clean, 1 creating+incomplete, 25 stale+creating+peering, 22 stale+undersized+degraded+peered, 20 stale+active+undersized+degraded, 46 unknown, 35 creating+peering, 54 stale+active+clean; 17 KiB data, 6.4 MiB used, 707 GiB / 715 GiB avail; 8.5 KiB/s wr, 7 op/s; 363/990 objects degraded (36.667%) 2020-06-27T04:47:18.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:18 smithi051 bash[18409]: cluster 2020-06-27T04:47:17.708589+0000 mon.a (mon.0) 709 : cluster [DBG] osdmap e71: 8 total, 3 up, 8 in 2020-06-27T04:47:18.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:18 smithi051 bash[18409]: audit 2020-06-27T04:47:17.709668+0000 mon.c (mon.1) 46 : audit [INF] from='client.? 172.21.15.31:0/3879254433' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:18.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:18 smithi051 bash[18409]: audit 2020-06-27T04:47:17.710067+0000 mon.a (mon.0) 710 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:18 smithi031 bash[18426]: cluster 2020-06-27T04:47:17.181813+0000 mgr.x (mgr.34109) 222 : cluster [DBG] pgmap v208: 897 pgs: 2 stale+creating+incomplete, 139 stale+active+undersized, 79 stale+undersized+peered, 21 undersized+degraded+peered, 51 active+undersized+degraded, 242 active+undersized, 81 undersized+peered, 79 active+clean, 1 creating+incomplete, 25 stale+creating+peering, 22 stale+undersized+degraded+peered, 20 stale+active+undersized+degraded, 46 unknown, 35 creating+peering, 54 stale+active+clean; 17 KiB data, 6.4 MiB used, 707 GiB / 715 GiB avail; 8.5 KiB/s wr, 7 op/s; 363/990 objects degraded (36.667%) 2020-06-27T04:47:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:18 smithi031 bash[18426]: cluster 2020-06-27T04:47:17.708589+0000 mon.a (mon.0) 709 : cluster [DBG] osdmap e71: 8 total, 3 up, 8 in 2020-06-27T04:47:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:18 smithi031 bash[18426]: audit 2020-06-27T04:47:17.709668+0000 mon.c (mon.1) 46 : audit [INF] from='client.? 172.21.15.31:0/3879254433' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:18.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:18 smithi031 bash[18426]: audit 2020-06-27T04:47:17.710067+0000 mon.a (mon.0) 710 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:18.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:18 smithi031 bash[22603]: cluster 2020-06-27T04:47:17.181813+0000 mgr.x (mgr.34109) 222 : cluster [DBG] pgmap v208: 897 pgs: 2 stale+creating+incomplete, 139 stale+active+undersized, 79 stale+undersized+peered, 21 undersized+degraded+peered, 51 active+undersized+degraded, 242 active+undersized, 81 undersized+peered, 79 active+clean, 1 creating+incomplete, 25 stale+creating+peering, 22 stale+undersized+degraded+peered, 20 stale+active+undersized+degraded, 46 unknown, 35 creating+peering, 54 stale+active+clean; 17 KiB data, 6.4 MiB used, 707 GiB / 715 GiB avail; 8.5 KiB/s wr, 7 op/s; 363/990 objects degraded (36.667%) 2020-06-27T04:47:18.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:18 smithi031 bash[22603]: cluster 2020-06-27T04:47:17.708589+0000 mon.a (mon.0) 709 : cluster [DBG] osdmap e71: 8 total, 3 up, 8 in 2020-06-27T04:47:18.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:18 smithi031 bash[22603]: audit 2020-06-27T04:47:17.709668+0000 mon.c (mon.1) 46 : audit [INF] from='client.? 172.21.15.31:0/3879254433' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:18.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:18 smithi031 bash[22603]: audit 2020-06-27T04:47:17.710067+0000 mon.a (mon.0) 710 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:20.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:19 smithi051 bash[18409]: audit 2020-06-27T04:47:18.710784+0000 mon.a (mon.0) 711 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-4","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:20.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:19 smithi051 bash[18409]: cluster 2020-06-27T04:47:18.710917+0000 mon.a (mon.0) 712 : cluster [DBG] osdmap e72: 8 total, 3 up, 8 in 2020-06-27T04:47:20.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:19 smithi051 bash[18409]: cluster 2020-06-27T04:47:19.231056+0000 mon.a (mon.0) 713 : cluster [WRN] Health check update: Reduced data availability: 18 pgs inactive, 3 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:47:20.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:19 smithi051 bash[18409]: cluster 2020-06-27T04:47:19.231114+0000 mon.a (mon.0) 714 : cluster [WRN] Health check update: Degraded data redundancy: 363/990 objects degraded (36.667%), 114 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:20.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:19 smithi051 bash[18409]: cluster 2020-06-27T04:47:19.231141+0000 mon.a (mon.0) 715 : cluster [WRN] Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:47:20.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:19 smithi031 bash[18426]: audit 2020-06-27T04:47:18.710784+0000 mon.a (mon.0) 711 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-4","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:20.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:19 smithi031 bash[18426]: cluster 2020-06-27T04:47:18.710917+0000 mon.a (mon.0) 712 : cluster [DBG] osdmap e72: 8 total, 3 up, 8 in 2020-06-27T04:47:20.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:19 smithi031 bash[18426]: cluster 2020-06-27T04:47:19.231056+0000 mon.a (mon.0) 713 : cluster [WRN] Health check update: Reduced data availability: 18 pgs inactive, 3 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:47:20.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:19 smithi031 bash[18426]: cluster 2020-06-27T04:47:19.231114+0000 mon.a (mon.0) 714 : cluster [WRN] Health check update: Degraded data redundancy: 363/990 objects degraded (36.667%), 114 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:20.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:19 smithi031 bash[18426]: cluster 2020-06-27T04:47:19.231141+0000 mon.a (mon.0) 715 : cluster [WRN] Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:47:20.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:19 smithi031 bash[22603]: audit 2020-06-27T04:47:18.710784+0000 mon.a (mon.0) 711 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-4","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:20.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:19 smithi031 bash[22603]: cluster 2020-06-27T04:47:18.710917+0000 mon.a (mon.0) 712 : cluster [DBG] osdmap e72: 8 total, 3 up, 8 in 2020-06-27T04:47:20.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:19 smithi031 bash[22603]: cluster 2020-06-27T04:47:19.231056+0000 mon.a (mon.0) 713 : cluster [WRN] Health check update: Reduced data availability: 18 pgs inactive, 3 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:47:20.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:19 smithi031 bash[22603]: cluster 2020-06-27T04:47:19.231114+0000 mon.a (mon.0) 714 : cluster [WRN] Health check update: Degraded data redundancy: 363/990 objects degraded (36.667%), 114 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:20.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:19 smithi031 bash[22603]: cluster 2020-06-27T04:47:19.231141+0000 mon.a (mon.0) 715 : cluster [WRN] Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:47:21.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:20 smithi051 bash[18409]: cluster 2020-06-27T04:47:19.183079+0000 mgr.x (mgr.34109) 223 : cluster [DBG] pgmap v211: 929 pgs: 1 down, 17 stale+active+clean, 25 creating+peering, 41 unknown, 22 stale+undersized+degraded+peered, 2 creating+down, 13 stale+creating+peering, 5 creating+incomplete, 236 active+undersized, 45 active+undersized+degraded, 12 stale+active+undersized+degraded, 47 undersized+degraded+peered, 36 active+clean, 79 stale+undersized+peered, 276 undersized+peered, 70 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 6.7 MiB used, 707 GiB / 715 GiB avail; 767 B/s wr, 0 op/s; 462/996 objects degraded (46.386%) 2020-06-27T04:47:21.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:20 smithi051 bash[18409]: cluster 2020-06-27T04:47:19.729795+0000 mon.a (mon.0) 716 : cluster [DBG] osdmap e73: 8 total, 3 up, 8 in 2020-06-27T04:47:21.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:20 smithi031 bash[18426]: cluster 2020-06-27T04:47:19.183079+0000 mgr.x (mgr.34109) 223 : cluster [DBG] pgmap v211: 929 pgs: 1 down, 17 stale+active+clean, 25 creating+peering, 41 unknown, 22 stale+undersized+degraded+peered, 2 creating+down, 13 stale+creating+peering, 5 creating+incomplete, 236 active+undersized, 45 active+undersized+degraded, 12 stale+active+undersized+degraded, 47 undersized+degraded+peered, 36 active+clean, 79 stale+undersized+peered, 276 undersized+peered, 70 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 6.7 MiB used, 707 GiB / 715 GiB avail; 767 B/s wr, 0 op/s; 462/996 objects degraded (46.386%) 2020-06-27T04:47:21.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:20 smithi031 bash[18426]: cluster 2020-06-27T04:47:19.729795+0000 mon.a (mon.0) 716 : cluster [DBG] osdmap e73: 8 total, 3 up, 8 in 2020-06-27T04:47:21.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:20 smithi031 bash[22603]: cluster 2020-06-27T04:47:19.183079+0000 mgr.x (mgr.34109) 223 : cluster [DBG] pgmap v211: 929 pgs: 1 down, 17 stale+active+clean, 25 creating+peering, 41 unknown, 22 stale+undersized+degraded+peered, 2 creating+down, 13 stale+creating+peering, 5 creating+incomplete, 236 active+undersized, 45 active+undersized+degraded, 12 stale+active+undersized+degraded, 47 undersized+degraded+peered, 36 active+clean, 79 stale+undersized+peered, 276 undersized+peered, 70 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 6.7 MiB used, 707 GiB / 715 GiB avail; 767 B/s wr, 0 op/s; 462/996 objects degraded (46.386%) 2020-06-27T04:47:21.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:20 smithi031 bash[22603]: cluster 2020-06-27T04:47:19.729795+0000 mon.a (mon.0) 716 : cluster [DBG] osdmap e73: 8 total, 3 up, 8 in 2020-06-27T04:47:22.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:21 smithi051 bash[18409]: cluster 2020-06-27T04:47:20.733804+0000 mon.a (mon.0) 717 : cluster [DBG] osdmap e74: 8 total, 3 up, 8 in 2020-06-27T04:47:22.222 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:21 smithi031 bash[18426]: cluster 2020-06-27T04:47:20.733804+0000 mon.a (mon.0) 717 : cluster [DBG] osdmap e74: 8 total, 3 up, 8 in 2020-06-27T04:47:22.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:21 smithi031 bash[22603]: cluster 2020-06-27T04:47:20.733804+0000 mon.a (mon.0) 717 : cluster [DBG] osdmap e74: 8 total, 3 up, 8 in 2020-06-27T04:47:22.517 INFO:tasks.workunit.client.0.smithi031.stdout: api_service: [==========] Running 3 tests from 1 test suite. 2020-06-27T04:47:22.517 INFO:tasks.workunit.client.0.smithi031.stdout: api_service: [----------] Global test environment set-up. 2020-06-27T04:47:22.518 INFO:tasks.workunit.client.0.smithi031.stdout: api_service: [----------] 3 tests from LibRadosService 2020-06-27T04:47:22.518 INFO:tasks.workunit.client.0.smithi031.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2020-06-27T04:47:22.518 INFO:tasks.workunit.client.0.smithi031.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5048 ms) 2020-06-27T04:47:22.518 INFO:tasks.workunit.client.0.smithi031.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2020-06-27T04:47:22.518 INFO:tasks.workunit.client.0.smithi031.stdout: api_service: [ OK ] LibRadosService.RegisterLate (34 ms) 2020-06-27T04:47:22.519 INFO:tasks.workunit.client.0.smithi031.stdout: api_service: [ RUN ] LibRadosService.Status 2020-06-27T04:47:22.519 INFO:tasks.workunit.client.0.smithi031.stdout: api_service: [ OK ] LibRadosService.Status (20016 ms) 2020-06-27T04:47:22.519 INFO:tasks.workunit.client.0.smithi031.stdout: api_service: [----------] 3 tests from LibRadosService (25098 ms total) 2020-06-27T04:47:22.519 INFO:tasks.workunit.client.0.smithi031.stdout: api_service: 2020-06-27T04:47:22.519 INFO:tasks.workunit.client.0.smithi031.stdout: api_service: [----------] Global test environment tear-down 2020-06-27T04:47:22.520 INFO:tasks.workunit.client.0.smithi031.stdout: api_service: [==========] 3 tests from 1 test suite ran. (25098 ms total) 2020-06-27T04:47:22.520 INFO:tasks.workunit.client.0.smithi031.stdout: api_service: [ PASSED ] 3 tests. 2020-06-27T04:47:23.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:22 smithi051 bash[18409]: cluster 2020-06-27T04:47:21.184355+0000 mgr.x (mgr.34109) 224 : cluster [DBG] pgmap v214: 929 pgs: 4 down, 2 stale+active+clean, 1 creating+peering, 46 unknown, 22 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 8 creating+incomplete, 220 active+undersized, 41 active+undersized+degraded, 7 stale+active+undersized+degraded, 62 undersized+degraded+peered, 13 active+clean, 79 stale+undersized+peered, 372 undersized+peered, 40 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail; 1023 B/s wr, 0 op/s; 517/999 objects degraded (51.752%) 2020-06-27T04:47:23.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:22 smithi051 bash[18409]: cluster 2020-06-27T04:47:21.736320+0000 mon.a (mon.0) 718 : cluster [DBG] osdmap e75: 8 total, 3 up, 8 in 2020-06-27T04:47:23.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:22 smithi031 bash[18426]: cluster 2020-06-27T04:47:21.184355+0000 mgr.x (mgr.34109) 224 : cluster [DBG] pgmap v214: 929 pgs: 4 down, 2 stale+active+clean, 1 creating+peering, 46 unknown, 22 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 8 creating+incomplete, 220 active+undersized, 41 active+undersized+degraded, 7 stale+active+undersized+degraded, 62 undersized+degraded+peered, 13 active+clean, 79 stale+undersized+peered, 372 undersized+peered, 40 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail; 1023 B/s wr, 0 op/s; 517/999 objects degraded (51.752%) 2020-06-27T04:47:23.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:22 smithi031 bash[18426]: cluster 2020-06-27T04:47:21.736320+0000 mon.a (mon.0) 718 : cluster [DBG] osdmap e75: 8 total, 3 up, 8 in 2020-06-27T04:47:23.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:22 smithi031 bash[22603]: cluster 2020-06-27T04:47:21.184355+0000 mgr.x (mgr.34109) 224 : cluster [DBG] pgmap v214: 929 pgs: 4 down, 2 stale+active+clean, 1 creating+peering, 46 unknown, 22 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 8 creating+incomplete, 220 active+undersized, 41 active+undersized+degraded, 7 stale+active+undersized+degraded, 62 undersized+degraded+peered, 13 active+clean, 79 stale+undersized+peered, 372 undersized+peered, 40 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail; 1023 B/s wr, 0 op/s; 517/999 objects degraded (51.752%) 2020-06-27T04:47:23.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:22 smithi031 bash[22603]: cluster 2020-06-27T04:47:21.736320+0000 mon.a (mon.0) 718 : cluster [DBG] osdmap e75: 8 total, 3 up, 8 in 2020-06-27T04:47:23.470 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:23 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:47:23.470 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:23 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Scheduled restart job, restart counter is at 1. 2020-06-27T04:47:23.471 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:23 smithi051 systemd[1]: Stopped Ceph osd.5 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:23.471 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:23 smithi051 systemd[1]: Starting Ceph osd.5 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:47:23.471 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:23 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:47:23.472 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:23 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Scheduled restart job, restart counter is at 1. 2020-06-27T04:47:23.472 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:23 smithi051 systemd[1]: Stopped Ceph osd.7 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:23.472 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:23 smithi051 systemd[1]: Starting Ceph osd.7 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:47:23.473 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:23 smithi051 podman[33387]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7 found: no such container 2020-06-27T04:47:23.473 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:23 smithi051 systemd[1]: Started Ceph osd.7 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:23.763 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:23 smithi051 podman[33421]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5 found: no such container 2020-06-27T04:47:23.764 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:23 smithi051 systemd[1]: Started Ceph osd.5 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:23.764 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:23 smithi051 podman[33405]: 2020-06-27 04:47:23.498141878 +0000 UTC m=+0.216264046 container create 33580cfe0b0aea5f7af3eacc8707db374698ea29276862566bcd0bc4dd3d42dd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:47:23.765 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:23 smithi051 podman[33405]: 2020-06-27 04:47:23.614788423 +0000 UTC m=+0.332910673 container init 33580cfe0b0aea5f7af3eacc8707db374698ea29276862566bcd0bc4dd3d42dd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:47:23.765 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:23 smithi051 podman[33405]: 2020-06-27 04:47:23.679125344 +0000 UTC m=+0.397247484 container start 33580cfe0b0aea5f7af3eacc8707db374698ea29276862566bcd0bc4dd3d42dd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:47:23.765 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:23 smithi051 podman[33405]: 2020-06-27 04:47:23.679196879 +0000 UTC m=+0.397319030 container attach 33580cfe0b0aea5f7af3eacc8707db374698ea29276862566bcd0bc4dd3d42dd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:47:24.017 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:23 smithi051 podman[33456]: 2020-06-27 04:47:23.93146795 +0000 UTC m=+0.352641795 container create bf3a29dbcd2ae9821f8b0fb28a4e5ae3548372f1f42755c2abb2a2ee1e868bf7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:47:24.018 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:23 smithi051 bash[18409]: cluster 2020-06-27T04:47:22.744694+0000 mon.a (mon.0) 719 : cluster [DBG] osdmap e76: 8 total, 3 up, 8 in 2020-06-27T04:47:24.018 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:23 smithi051 bash[18409]: audit 2020-06-27T04:47:22.751776+0000 mon.c (mon.1) 47 : audit [INF] from='client.? 172.21.15.31:0/575492504' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:24.018 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:23 smithi051 bash[18409]: audit 2020-06-27T04:47:22.752167+0000 mon.a (mon.0) 720 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:24.019 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:23 smithi051 bash[33403]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-06-27T04:47:24.019 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:23 smithi051 bash[33403]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2020-06-27T04:47:24.019 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:23 smithi051 bash[33403]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2020-06-27T04:47:24.019 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:23 smithi051 bash[33403]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2020-06-27T04:47:24.019 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:23 smithi051 bash[33403]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2020-06-27T04:47:24.020 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:23 smithi051 bash[33403]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-06-27T04:47:24.020 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:23 smithi051 bash[33403]: --> ceph-volume lvm activate successful for osd ID: 7 2020-06-27T04:47:24.020 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:23 smithi051 podman[33405]: 2020-06-27 04:47:23.96580753 +0000 UTC m=+0.683929696 container died 33580cfe0b0aea5f7af3eacc8707db374698ea29276862566bcd0bc4dd3d42dd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:47:24.222 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:23 smithi031 bash[18426]: cluster 2020-06-27T04:47:22.744694+0000 mon.a (mon.0) 719 : cluster [DBG] osdmap e76: 8 total, 3 up, 8 in 2020-06-27T04:47:24.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:23 smithi031 bash[18426]: audit 2020-06-27T04:47:22.751776+0000 mon.c (mon.1) 47 : audit [INF] from='client.? 172.21.15.31:0/575492504' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:24.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:23 smithi031 bash[18426]: audit 2020-06-27T04:47:22.752167+0000 mon.a (mon.0) 720 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:24.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:23 smithi031 bash[22603]: cluster 2020-06-27T04:47:22.744694+0000 mon.a (mon.0) 719 : cluster [DBG] osdmap e76: 8 total, 3 up, 8 in 2020-06-27T04:47:24.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:23 smithi031 bash[22603]: audit 2020-06-27T04:47:22.751776+0000 mon.c (mon.1) 47 : audit [INF] from='client.? 172.21.15.31:0/575492504' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:24.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:23 smithi031 bash[22603]: audit 2020-06-27T04:47:22.752167+0000 mon.a (mon.0) 720 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:24.717 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:24 smithi051 podman[33456]: 2020-06-27 04:47:24.445589608 +0000 UTC m=+0.866763598 container init bf3a29dbcd2ae9821f8b0fb28a4e5ae3548372f1f42755c2abb2a2ee1e868bf7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:47:25.014 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:24 smithi051 bash[18409]: cluster 2020-06-27T04:47:23.185616+0000 mgr.x (mgr.34109) 225 : cluster [DBG] pgmap v217: 929 pgs: 4 down, 2 stale+active+clean, 46 unknown, 22 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 8 creating+incomplete, 221 active+undersized, 41 active+undersized+degraded, 7 stale+active+undersized+degraded, 62 undersized+degraded+peered, 13 active+clean, 79 stale+undersized+peered, 372 undersized+peered, 40 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 7.0 MiB used, 707 GiB / 715 GiB avail; 255 B/s wr, 0 op/s; 517/999 objects degraded (51.752%) 2020-06-27T04:47:25.014 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:24 smithi051 bash[18409]: audit 2020-06-27T04:47:23.757661+0000 mon.a (mon.0) 721 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-5","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:25.015 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:24 smithi051 bash[18409]: cluster 2020-06-27T04:47:23.757938+0000 mon.a (mon.0) 722 : cluster [DBG] osdmap e77: 8 total, 3 up, 8 in 2020-06-27T04:47:25.015 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:24 smithi051 bash[18409]: cluster 2020-06-27T04:47:24.233434+0000 mon.a (mon.0) 723 : cluster [WRN] Health check update: Reduced data availability: 22 pgs inactive, 7 pgs down, 10 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:47:25.015 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:24 smithi051 bash[18409]: cluster 2020-06-27T04:47:24.233467+0000 mon.a (mon.0) 724 : cluster [WRN] Health check update: Degraded data redundancy: 517/999 objects degraded (51.752%), 132 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:25.015 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:24 smithi051 podman[33456]: 2020-06-27 04:47:24.739636538 +0000 UTC m=+1.160810514 container start bf3a29dbcd2ae9821f8b0fb28a4e5ae3548372f1f42755c2abb2a2ee1e868bf7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:47:25.016 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:24 smithi051 podman[33456]: 2020-06-27 04:47:24.739743923 +0000 UTC m=+1.160917808 container attach bf3a29dbcd2ae9821f8b0fb28a4e5ae3548372f1f42755c2abb2a2ee1e868bf7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:47:25.016 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:24 smithi051 bash[33454]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-06-27T04:47:25.016 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:24 smithi051 bash[33454]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2020-06-27T04:47:25.016 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:24 smithi051 bash[33454]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2020-06-27T04:47:25.016 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:24 smithi051 bash[33454]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2020-06-27T04:47:25.017 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:24 smithi051 bash[33454]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2020-06-27T04:47:25.017 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:24 smithi051 bash[33454]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-06-27T04:47:25.017 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:24 smithi051 bash[33454]: --> ceph-volume lvm activate successful for osd ID: 5 2020-06-27T04:47:25.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:24 smithi031 bash[18426]: cluster 2020-06-27T04:47:23.185616+0000 mgr.x (mgr.34109) 225 : cluster [DBG] pgmap v217: 929 pgs: 4 down, 2 stale+active+clean, 46 unknown, 22 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 8 creating+incomplete, 221 active+undersized, 41 active+undersized+degraded, 7 stale+active+undersized+degraded, 62 undersized+degraded+peered, 13 active+clean, 79 stale+undersized+peered, 372 undersized+peered, 40 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 7.0 MiB used, 707 GiB / 715 GiB avail; 255 B/s wr, 0 op/s; 517/999 objects degraded (51.752%) 2020-06-27T04:47:25.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:24 smithi031 bash[18426]: audit 2020-06-27T04:47:23.757661+0000 mon.a (mon.0) 721 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-5","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:25.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:24 smithi031 bash[18426]: cluster 2020-06-27T04:47:23.757938+0000 mon.a (mon.0) 722 : cluster [DBG] osdmap e77: 8 total, 3 up, 8 in 2020-06-27T04:47:25.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:24 smithi031 bash[18426]: cluster 2020-06-27T04:47:24.233434+0000 mon.a (mon.0) 723 : cluster [WRN] Health check update: Reduced data availability: 22 pgs inactive, 7 pgs down, 10 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:47:25.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:24 smithi031 bash[18426]: cluster 2020-06-27T04:47:24.233467+0000 mon.a (mon.0) 724 : cluster [WRN] Health check update: Degraded data redundancy: 517/999 objects degraded (51.752%), 132 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:25.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:24 smithi031 bash[22603]: cluster 2020-06-27T04:47:23.185616+0000 mgr.x (mgr.34109) 225 : cluster [DBG] pgmap v217: 929 pgs: 4 down, 2 stale+active+clean, 46 unknown, 22 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 8 creating+incomplete, 221 active+undersized, 41 active+undersized+degraded, 7 stale+active+undersized+degraded, 62 undersized+degraded+peered, 13 active+clean, 79 stale+undersized+peered, 372 undersized+peered, 40 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 7.0 MiB used, 707 GiB / 715 GiB avail; 255 B/s wr, 0 op/s; 517/999 objects degraded (51.752%) 2020-06-27T04:47:25.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:24 smithi031 bash[22603]: audit 2020-06-27T04:47:23.757661+0000 mon.a (mon.0) 721 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-5","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:25.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:24 smithi031 bash[22603]: cluster 2020-06-27T04:47:23.757938+0000 mon.a (mon.0) 722 : cluster [DBG] osdmap e77: 8 total, 3 up, 8 in 2020-06-27T04:47:25.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:24 smithi031 bash[22603]: cluster 2020-06-27T04:47:24.233434+0000 mon.a (mon.0) 723 : cluster [WRN] Health check update: Reduced data availability: 22 pgs inactive, 7 pgs down, 10 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:47:25.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:24 smithi031 bash[22603]: cluster 2020-06-27T04:47:24.233467+0000 mon.a (mon.0) 724 : cluster [WRN] Health check update: Degraded data redundancy: 517/999 objects degraded (51.752%), 132 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:25.467 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:25 smithi051 podman[33456]: 2020-06-27 04:47:25.011692502 +0000 UTC m=+1.432866358 container died bf3a29dbcd2ae9821f8b0fb28a4e5ae3548372f1f42755c2abb2a2ee1e868bf7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:47:25.896 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:25 smithi051 bash[18409]: cluster 2020-06-27T04:47:24.763658+0000 mon.a (mon.0) 725 : cluster [DBG] osdmap e78: 8 total, 3 up, 8 in 2020-06-27T04:47:25.897 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:25 smithi051 podman[33405]: 2020-06-27 04:47:25.617641769 +0000 UTC m=+2.335763926 container remove 33580cfe0b0aea5f7af3eacc8707db374698ea29276862566bcd0bc4dd3d42dd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:47:25.897 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:25 smithi051 bash[33403]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7 found: no such container 2020-06-27T04:47:26.150 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:25 smithi051 podman[33456]: 2020-06-27 04:47:25.894630802 +0000 UTC m=+2.315804671 container remove bf3a29dbcd2ae9821f8b0fb28a4e5ae3548372f1f42755c2abb2a2ee1e868bf7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:47:26.150 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5 found: no such container 2020-06-27T04:47:26.151 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:25 smithi051 bash[33403]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7 2020-06-27T04:47:26.151 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:25 smithi051 bash[33403]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7" found: no such container 2020-06-27T04:47:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:25 smithi031 bash[18426]: cluster 2020-06-27T04:47:24.763658+0000 mon.a (mon.0) 725 : cluster [DBG] osdmap e78: 8 total, 3 up, 8 in 2020-06-27T04:47:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:25 smithi031 bash[22603]: cluster 2020-06-27T04:47:24.763658+0000 mon.a (mon.0) 725 : cluster [DBG] osdmap e78: 8 total, 3 up, 8 in 2020-06-27T04:47:26.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5 2020-06-27T04:47:26.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5" found: no such container 2020-06-27T04:47:26.469 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:26 smithi051 podman[33601]: 2020-06-27 04:47:26.147659993 +0000 UTC m=+0.237869840 container create 857a8d7b9a2ff98916ac27b1070e3a875b6bd7d8bd6532dc477018358b158d9a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:47:26.469 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:26 smithi051 podman[33601]: 2020-06-27 04:47:26.314441755 +0000 UTC m=+0.404651708 container init 857a8d7b9a2ff98916ac27b1070e3a875b6bd7d8bd6532dc477018358b158d9a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:47:26.470 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:26 smithi051 podman[33601]: 2020-06-27 04:47:26.390209262 +0000 UTC m=+0.480419098 container start 857a8d7b9a2ff98916ac27b1070e3a875b6bd7d8bd6532dc477018358b158d9a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:47:26.470 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:26 smithi051 podman[33601]: 2020-06-27 04:47:26.390279414 +0000 UTC m=+0.480489254 container attach 857a8d7b9a2ff98916ac27b1070e3a875b6bd7d8bd6532dc477018358b158d9a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:47:26.781 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 podman[33644]: 2020-06-27 04:47:26.495018879 +0000 UTC m=+0.327679458 container create b26656bd12a50e67b834e5f2f0631658d3958aef7adf709a0054d8a67801fe80 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:47:26.787 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 podman[33644]: 2020-06-27 04:47:26.597634457 +0000 UTC m=+0.430295155 container init b26656bd12a50e67b834e5f2f0631658d3958aef7adf709a0054d8a67801fe80 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:47:26.787 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 podman[33644]: 2020-06-27 04:47:26.664386761 +0000 UTC m=+0.497047344 container start b26656bd12a50e67b834e5f2f0631658d3958aef7adf709a0054d8a67801fe80 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:47:26.788 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 podman[33644]: 2020-06-27 04:47:26.664490002 +0000 UTC m=+0.497150593 container attach b26656bd12a50e67b834e5f2f0631658d3958aef7adf709a0054d8a67801fe80 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:47:26.788 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 10 -- 172.21.15.51:0/2246553420 shutdown 172.21.15.51:0/2246553420 2020-06-27T04:47:26.788 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 10 Processor -- stop 2020-06-27T04:47:26.789 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 20 Event(0x55bfa89bce00 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:26.789 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 1 -- 172.21.15.51:0/2246553420 shutdown_connections 2020-06-27T04:47:26.789 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 5 -- 172.21.15.51:0/2246553420 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55bfa8a29400 2020-06-27T04:47:26.790 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 1 --2- 172.21.15.51:0/2246553420 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55bfa8a29400 0x55bfa899a300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:26.790 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 5 -- 172.21.15.51:0/2246553420 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55bfa8a28c00 2020-06-27T04:47:26.790 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 1 --2- 172.21.15.51:0/2246553420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bfa8a28c00 0x55bfa8999400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:26.790 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 5 -- 172.21.15.51:0/2246553420 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55bfa8a29000 2020-06-27T04:47:26.791 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 1 --2- 172.21.15.51:0/2246553420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55bfa8a29000 0x55bfa8999e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:26.792 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 5 -- 172.21.15.51:0/2246553420 shutdown_connections delete 0x55bfa8a28c00 2020-06-27T04:47:26.793 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 5 -- 172.21.15.51:0/2246553420 shutdown_connections delete 0x55bfa8a29000 2020-06-27T04:47:26.793 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 5 -- 172.21.15.51:0/2246553420 shutdown_connections delete 0x55bfa8a29400 2020-06-27T04:47:26.793 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 1 -- 172.21.15.51:0/2246553420 >> 172.21.15.51:0/2246553420 conn(0x55bfa8a28800 msgr2=0x55bfa8a91000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:47:26.793 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 20 --1- 172.21.15.51:0/2246553420 >> 172.21.15.51:0/2246553420 conn(0x55bfa8a28800 0x55bfa8a91000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:26.794 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 2 --1- 172.21.15.51:0/2246553420 >> 172.21.15.51:0/2246553420 conn(0x55bfa8a28800 0x55bfa8a91000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:26.794 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 5 --1- 172.21.15.51:0/2246553420 >> 172.21.15.51:0/2246553420 conn(0x55bfa8a28800 0x55bfa8a91000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:47:26.794 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 20 Event(0x55bfa89bce00 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:26.794 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 10 --1- 172.21.15.51:0/2246553420 >> 172.21.15.51:0/2246553420 conn(0x55bfa8a28800 0x55bfa8a91000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:47:26.794 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 20 Event(0x55bfa89bce00 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:26.795 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 20 Event(0x55bfa89bd040 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:26.795 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f2937e93700 5 --1- 172.21.15.51:0/2246553420 >> 172.21.15.51:0/2246553420 conn(0x55bfa8a28800 0x55bfa8a91000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:47:26.795 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 20 Event(0x55bfa89bd280 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:26.795 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f2937e93700 5 --1- 172.21.15.51:0/2246553420 >> 172.21.15.51:0/2246553420 conn(0x55bfa8a28800 0x55bfa8a91000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:47:26.796 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 10 -- 172.21.15.51:0/2246553420 wait: waiting for dispatch queue 2020-06-27T04:47:26.796 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 10 -- 172.21.15.51:0/2246553420 wait: dispatch queue is stopped 2020-06-27T04:47:26.796 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 1 -- 172.21.15.51:0/2246553420 shutdown_connections 2020-06-27T04:47:26.796 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 5 -- 172.21.15.51:0/2246553420 shutdown_connections delete 0x55bfa8a28800 2020-06-27T04:47:26.797 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 20 Event(0x55bfa89bce00 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:26.797 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 20 Event(0x55bfa89bd040 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:26.797 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 20 Event(0x55bfa89bd280 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:26.798 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 10 -- 172.21.15.51:0/2246553420 wait: done. 2020-06-27T04:47:26.798 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33454]: debug 2020-06-27T04:47:26.619+0000 7f293e110f40 1 -- 172.21.15.51:0/2246553420 wait complete. 2020-06-27T04:47:27.071 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:26 smithi031 bash[18426]: cluster 2020-06-27T04:47:25.187210+0000 mgr.x (mgr.34109) 226 : cluster [DBG] pgmap v220: 961 pgs: 23 creating+peering, 4 down, 2 stale+active+clean, 45 unknown, 22 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 8 creating+incomplete, 223 active+undersized, 41 active+undersized+degraded, 7 stale+active+undersized+degraded, 62 undersized+degraded+peered, 13 active+clean, 79 stale+undersized+peered, 380 undersized+peered, 40 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 7.3 MiB used, 707 GiB / 715 GiB avail; 517/999 objects degraded (51.752%) 2020-06-27T04:47:27.072 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:26 smithi031 bash[18426]: cluster 2020-06-27T04:47:25.770676+0000 mon.a (mon.0) 726 : cluster [DBG] osdmap e79: 8 total, 3 up, 8 in 2020-06-27T04:47:27.072 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:26 smithi031 bash[22603]: cluster 2020-06-27T04:47:25.187210+0000 mgr.x (mgr.34109) 226 : cluster [DBG] pgmap v220: 961 pgs: 23 creating+peering, 4 down, 2 stale+active+clean, 45 unknown, 22 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 8 creating+incomplete, 223 active+undersized, 41 active+undersized+degraded, 7 stale+active+undersized+degraded, 62 undersized+degraded+peered, 13 active+clean, 79 stale+undersized+peered, 380 undersized+peered, 40 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 7.3 MiB used, 707 GiB / 715 GiB avail; 517/999 objects degraded (51.752%) 2020-06-27T04:47:27.072 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:26 smithi031 bash[22603]: cluster 2020-06-27T04:47:25.770676+0000 mon.a (mon.0) 726 : cluster [DBG] osdmap e79: 8 total, 3 up, 8 in 2020-06-27T04:47:27.072 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:26 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:47:27.073 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:26 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Scheduled restart job, restart counter is at 1. 2020-06-27T04:47:27.073 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:26 smithi031 systemd[1]: Stopped Ceph osd.1 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:27.073 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:26 smithi031 systemd[1]: Starting Ceph osd.1 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:47:27.074 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:26 smithi031 podman[42540]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1 found: no such container 2020-06-27T04:47:27.074 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:26 smithi031 systemd[1]: Started Ceph osd.1 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:27.143 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[33403]: debug 2020-06-27T04:47:26.860+0000 7f636aee5f40 -1 Falling back to public interface 2020-06-27T04:47:27.145 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[18409]: cluster 2020-06-27T04:47:25.187210+0000 mgr.x (mgr.34109) 226 : cluster [DBG] pgmap v220: 961 pgs: 23 creating+peering, 4 down, 2 stale+active+clean, 45 unknown, 22 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 8 creating+incomplete, 223 active+undersized, 41 active+undersized+degraded, 7 stale+active+undersized+degraded, 62 undersized+degraded+peered, 13 active+clean, 79 stale+undersized+peered, 380 undersized+peered, 40 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 7.3 MiB used, 707 GiB / 715 GiB avail; 517/999 objects degraded (51.752%) 2020-06-27T04:47:27.145 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:26 smithi051 bash[18409]: cluster 2020-06-27T04:47:25.770676+0000 mon.a (mon.0) 726 : cluster [DBG] osdmap e79: 8 total, 3 up, 8 in 2020-06-27T04:47:27.467 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:27 smithi051 bash[33454]: debug 2020-06-27T04:47:27.140+0000 7f293e110f40 -1 Falling back to public interface 2020-06-27T04:47:27.473 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:27 smithi031 podman[42556]: 2020-06-27 04:47:27.06908295 +0000 UTC m=+0.268323844 container create 2a59dc937bbe484b9f696af3456b769fefb005f921a2e6af301184a657c55d19 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:47:27.473 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:27 smithi031 podman[42556]: 2020-06-27 04:47:27.26087915 +0000 UTC m=+0.460120174 container init 2a59dc937bbe484b9f696af3456b769fefb005f921a2e6af301184a657c55d19 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:47:27.473 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:27 smithi031 podman[42556]: 2020-06-27 04:47:27.319290877 +0000 UTC m=+0.518531764 container start 2a59dc937bbe484b9f696af3456b769fefb005f921a2e6af301184a657c55d19 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:47:27.473 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:27 smithi031 podman[42556]: 2020-06-27 04:47:27.319364642 +0000 UTC m=+0.518605586 container attach 2a59dc937bbe484b9f696af3456b769fefb005f921a2e6af301184a657c55d19 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:47:27.474 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:27 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:47:27.474 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:27 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Scheduled restart job, restart counter is at 1. 2020-06-27T04:47:27.474 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:27 smithi031 systemd[1]: Stopped Ceph osd.2 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:27.474 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:27 smithi031 systemd[1]: Starting Ceph osd.2 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:47:27.474 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:27 smithi031 podman[42588]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2 found: no such container 2020-06-27T04:47:27.475 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:27 smithi031 systemd[1]: Started Ceph osd.2 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:27.786 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:27 smithi031 podman[42607]: 2020-06-27 04:47:27.502320832 +0000 UTC m=+0.365630568 container create f3877a1a554f4ad4e89287ed4e8048508da1ddaa1cfa0629ee0c28f5869a3a5a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:47:27.787 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:27 smithi031 podman[42607]: 2020-06-27 04:47:27.660635779 +0000 UTC m=+0.523945521 container init f3877a1a554f4ad4e89287ed4e8048508da1ddaa1cfa0629ee0c28f5869a3a5a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:47:27.787 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:27 smithi031 podman[42607]: 2020-06-27 04:47:27.702336148 +0000 UTC m=+0.565645872 container start f3877a1a554f4ad4e89287ed4e8048508da1ddaa1cfa0629ee0c28f5869a3a5a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:47:27.787 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:27 smithi031 podman[42607]: 2020-06-27 04:47:27.702409896 +0000 UTC m=+0.565719637 container attach f3877a1a554f4ad4e89287ed4e8048508da1ddaa1cfa0629ee0c28f5869a3a5a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:47:27.787 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[42554]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-06-27T04:47:27.787 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[42554]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2020-06-27T04:47:27.788 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[42554]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2020-06-27T04:47:27.788 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[42554]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2020-06-27T04:47:27.788 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[42554]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2020-06-27T04:47:27.788 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[42554]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-06-27T04:47:27.788 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[42554]: --> ceph-volume lvm activate successful for osd ID: 1 2020-06-27T04:47:27.789 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:27 smithi031 podman[42556]: 2020-06-27 04:47:27.71056884 +0000 UTC m=+0.909809772 container died 2a59dc937bbe484b9f696af3456b769fefb005f921a2e6af301184a657c55d19 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:47:27.789 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:27 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:47:27.789 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:27 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 1. 2020-06-27T04:47:27.789 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:27 smithi031 systemd[1]: Stopped Ceph osd.3 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:27.790 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:27 smithi031 systemd[1]: Starting Ceph osd.3 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:47:27.790 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:27 smithi031 podman[42661]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3 found: no such container 2020-06-27T04:47:27.790 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:27 smithi031 systemd[1]: Started Ceph osd.3 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:27.828 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:27 smithi051 bash[18409]: cluster 2020-06-27T04:47:26.772659+0000 mon.a (mon.0) 727 : cluster [DBG] osdmap e80: 8 total, 3 up, 8 in 2020-06-27T04:47:27.828 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:27 smithi051 bash[18409]: audit 2020-06-27T04:47:27.561299+0000 mon.b (mon.2) 269 : audit [INF] from='osd.7 v2:172.21.15.51:6805/3127604155' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:47:27.828 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:27 smithi051 bash[18409]: audit 2020-06-27T04:47:27.561724+0000 mon.a (mon.0) 728 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:47:27.829 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:27 smithi051 bash[18409]: audit 2020-06-27T04:47:27.562314+0000 mon.b (mon.2) 270 : audit [INF] from='osd.7 v2:172.21.15.51:6805/3127604155' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:27.829 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:27 smithi051 bash[18409]: audit 2020-06-27T04:47:27.562618+0000 mon.a (mon.0) 729 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:27.829 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:27 smithi051 bash[33454]: debug 2020-06-27T04:47:27.823+0000 7f293e110f40 -1 osd.5 63 log_to_monitors {default=true} 2020-06-27T04:47:27.829 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:27 smithi051 bash[33403]: debug 2020-06-27T04:47:27.556+0000 7f636aee5f40 -1 osd.7 63 log_to_monitors {default=true} 2020-06-27T04:47:28.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[22603]: cluster 2020-06-27T04:47:26.772659+0000 mon.a (mon.0) 727 : cluster [DBG] osdmap e80: 8 total, 3 up, 8 in 2020-06-27T04:47:28.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[22603]: audit 2020-06-27T04:47:27.561299+0000 mon.b (mon.2) 269 : audit [INF] from='osd.7 v2:172.21.15.51:6805/3127604155' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:47:28.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[22603]: audit 2020-06-27T04:47:27.561724+0000 mon.a (mon.0) 728 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:47:28.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[22603]: audit 2020-06-27T04:47:27.562314+0000 mon.b (mon.2) 270 : audit [INF] from='osd.7 v2:172.21.15.51:6805/3127604155' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:28.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[22603]: audit 2020-06-27T04:47:27.562618+0000 mon.a (mon.0) 729 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:28.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[18426]: cluster 2020-06-27T04:47:26.772659+0000 mon.a (mon.0) 727 : cluster [DBG] osdmap e80: 8 total, 3 up, 8 in 2020-06-27T04:47:28.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[18426]: audit 2020-06-27T04:47:27.561299+0000 mon.b (mon.2) 269 : audit [INF] from='osd.7 v2:172.21.15.51:6805/3127604155' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:47:28.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[18426]: audit 2020-06-27T04:47:27.561724+0000 mon.a (mon.0) 728 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:47:28.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[18426]: audit 2020-06-27T04:47:27.562314+0000 mon.b (mon.2) 270 : audit [INF] from='osd.7 v2:172.21.15.51:6805/3127604155' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:28.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[18426]: audit 2020-06-27T04:47:27.562618+0000 mon.a (mon.0) 729 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:28.225 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[42602]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-06-27T04:47:28.225 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[42602]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2020-06-27T04:47:28.226 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[42602]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2020-06-27T04:47:28.226 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[42602]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2020-06-27T04:47:28.226 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[42602]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2020-06-27T04:47:28.226 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[42602]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-06-27T04:47:28.226 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:27 smithi031 bash[42602]: --> ceph-volume lvm activate successful for osd ID: 2 2020-06-27T04:47:28.723 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:28 smithi031 podman[42607]: 2020-06-27 04:47:28.396382331 +0000 UTC m=+1.259692067 container died f3877a1a554f4ad4e89287ed4e8048508da1ddaa1cfa0629ee0c28f5869a3a5a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:47:29.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:28 smithi051 bash[18409]: cluster 2020-06-27T04:47:27.188232+0000 mgr.x (mgr.34109) 227 : cluster [DBG] pgmap v223: 897 pgs: 4 down, 2 stale+active+clean, 14 unknown, 22 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 8 creating+incomplete, 221 active+undersized, 41 active+undersized+degraded, 7 stale+active+undersized+degraded, 62 undersized+degraded+peered, 13 active+clean, 79 stale+undersized+peered, 372 undersized+peered, 40 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 7.3 MiB used, 707 GiB / 715 GiB avail; 517/999 objects degraded (51.752%) 2020-06-27T04:47:29.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:28 smithi051 bash[18409]: cluster 2020-06-27T04:47:27.779842+0000 mon.a (mon.0) 730 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:47:29.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:28 smithi051 bash[18409]: cluster 2020-06-27T04:47:27.786993+0000 mon.a (mon.0) 731 : cluster [INF] osd.7 v2:172.21.15.51:6805/3127604155 boot 2020-06-27T04:47:29.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:28 smithi051 bash[18409]: cluster 2020-06-27T04:47:27.787031+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e81: 8 total, 4 up, 8 in 2020-06-27T04:47:29.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:28 smithi051 bash[18409]: audit 2020-06-27T04:47:27.788087+0000 mon.a (mon.0) 733 : audit [INF] from='client.? 172.21.15.31:0/3365720754' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:29.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:28 smithi051 bash[18409]: audit 2020-06-27T04:47:27.789129+0000 mon.b (mon.2) 271 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:47:29.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:28 smithi051 bash[18409]: audit 2020-06-27T04:47:27.830652+0000 mon.c (mon.1) 48 : audit [INF] from='osd.5 v2:172.21.15.51:6813/602910667' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:47:29.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:28 smithi051 bash[18409]: audit 2020-06-27T04:47:27.830963+0000 mon.a (mon.0) 734 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:47:29.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:28 smithi051 bash[18409]: audit 2020-06-27T04:47:27.831724+0000 mon.c (mon.1) 49 : audit [INF] from='osd.5 v2:172.21.15.51:6813/602910667' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:29.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:28 smithi051 bash[18409]: audit 2020-06-27T04:47:27.831984+0000 mon.a (mon.0) 735 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:29.223 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:28 smithi031 podman[42556]: 2020-06-27 04:47:28.831754681 +0000 UTC m=+2.030995626 container remove 2a59dc937bbe484b9f696af3456b769fefb005f921a2e6af301184a657c55d19 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:47:29.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[22603]: cluster 2020-06-27T04:47:27.188232+0000 mgr.x (mgr.34109) 227 : cluster [DBG] pgmap v223: 897 pgs: 4 down, 2 stale+active+clean, 14 unknown, 22 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 8 creating+incomplete, 221 active+undersized, 41 active+undersized+degraded, 7 stale+active+undersized+degraded, 62 undersized+degraded+peered, 13 active+clean, 79 stale+undersized+peered, 372 undersized+peered, 40 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 7.3 MiB used, 707 GiB / 715 GiB avail; 517/999 objects degraded (51.752%) 2020-06-27T04:47:29.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[22603]: cluster 2020-06-27T04:47:27.779842+0000 mon.a (mon.0) 730 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:47:29.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[22603]: cluster 2020-06-27T04:47:27.786993+0000 mon.a (mon.0) 731 : cluster [INF] osd.7 v2:172.21.15.51:6805/3127604155 boot 2020-06-27T04:47:29.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[22603]: cluster 2020-06-27T04:47:27.787031+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e81: 8 total, 4 up, 8 in 2020-06-27T04:47:29.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[22603]: audit 2020-06-27T04:47:27.788087+0000 mon.a (mon.0) 733 : audit [INF] from='client.? 172.21.15.31:0/3365720754' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:29.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[22603]: audit 2020-06-27T04:47:27.789129+0000 mon.b (mon.2) 271 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:47:29.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[22603]: audit 2020-06-27T04:47:27.830652+0000 mon.c (mon.1) 48 : audit [INF] from='osd.5 v2:172.21.15.51:6813/602910667' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:47:29.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[22603]: audit 2020-06-27T04:47:27.830963+0000 mon.a (mon.0) 734 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:47:29.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[22603]: audit 2020-06-27T04:47:27.831724+0000 mon.c (mon.1) 49 : audit [INF] from='osd.5 v2:172.21.15.51:6813/602910667' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:29.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[22603]: audit 2020-06-27T04:47:27.831984+0000 mon.a (mon.0) 735 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:29.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[18426]: cluster 2020-06-27T04:47:27.188232+0000 mgr.x (mgr.34109) 227 : cluster [DBG] pgmap v223: 897 pgs: 4 down, 2 stale+active+clean, 14 unknown, 22 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 8 creating+incomplete, 221 active+undersized, 41 active+undersized+degraded, 7 stale+active+undersized+degraded, 62 undersized+degraded+peered, 13 active+clean, 79 stale+undersized+peered, 372 undersized+peered, 40 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 7.3 MiB used, 707 GiB / 715 GiB avail; 517/999 objects degraded (51.752%) 2020-06-27T04:47:29.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[18426]: cluster 2020-06-27T04:47:27.779842+0000 mon.a (mon.0) 730 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:47:29.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[18426]: cluster 2020-06-27T04:47:27.786993+0000 mon.a (mon.0) 731 : cluster [INF] osd.7 v2:172.21.15.51:6805/3127604155 boot 2020-06-27T04:47:29.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[18426]: cluster 2020-06-27T04:47:27.787031+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e81: 8 total, 4 up, 8 in 2020-06-27T04:47:29.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[18426]: audit 2020-06-27T04:47:27.788087+0000 mon.a (mon.0) 733 : audit [INF] from='client.? 172.21.15.31:0/3365720754' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:29.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[18426]: audit 2020-06-27T04:47:27.789129+0000 mon.b (mon.2) 271 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:47:29.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[18426]: audit 2020-06-27T04:47:27.830652+0000 mon.c (mon.1) 48 : audit [INF] from='osd.5 v2:172.21.15.51:6813/602910667' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:47:29.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[18426]: audit 2020-06-27T04:47:27.830963+0000 mon.a (mon.0) 734 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:47:29.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[18426]: audit 2020-06-27T04:47:27.831724+0000 mon.c (mon.1) 49 : audit [INF] from='osd.5 v2:172.21.15.51:6813/602910667' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:29.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:28 smithi031 bash[18426]: audit 2020-06-27T04:47:27.831984+0000 mon.a (mon.0) 735 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:29.236 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2020-06-27T04:47:29.236 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: [----------] Global test environment set-up. 2020-06-27T04:47:29.236 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2020-06-27T04:47:29.237 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2020-06-27T04:47:29.237 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5054 ms) 2020-06-27T04:47:29.237 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2020-06-27T04:47:29.237 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (1395 ms) 2020-06-27T04:47:29.237 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2020-06-27T04:47:29.238 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20043 ms) 2020-06-27T04:47:29.238 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2020-06-27T04:47:29.238 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: attempt 0 of 20 2020-06-27T04:47:29.238 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: failed to deregister: 2020-06-27T04:47:29.238 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: { 2020-06-27T04:47:29.239 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "epoch": 7, 2020-06-27T04:47:29.239 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "modified": "2020-06-27T04:47:25.186510+0000", 2020-06-27T04:47:29.239 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "services": { 2020-06-27T04:47:29.239 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "laundry": { 2020-06-27T04:47:29.239 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "daemons": { 2020-06-27T04:47:29.239 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "summary": "", 2020-06-27T04:47:29.240 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "close-test-pid41543": { 2020-06-27T04:47:29.240 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "start_epoch": 7, 2020-06-27T04:47:29.240 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "start_stamp": "2020-06-27T04:47:24.218515+0000", 2020-06-27T04:47:29.240 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "gid": 14919, 2020-06-27T04:47:29.240 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "addr": "172.21.15.31:0/2093730354", 2020-06-27T04:47:29.241 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "metadata": { 2020-06-27T04:47:29.241 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "arch": "x86_64", 2020-06-27T04:47:29.241 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "ceph_release": "pacific", 2020-06-27T04:47:29.241 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "ceph_version": "ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev)", 2020-06-27T04:47:29.241 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "ceph_version_short": "16.0.0-2978-g77ddaecfcb0", 2020-06-27T04:47:29.242 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-06-27T04:47:29.242 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "distro": "centos", 2020-06-27T04:47:29.242 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "distro_description": "CentOS Linux 8 (Core)", 2020-06-27T04:47:29.242 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "distro_version": "8", 2020-06-27T04:47:29.242 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "foo": "bar", 2020-06-27T04:47:29.242 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "hostname": "smithi031", 2020-06-27T04:47:29.243 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "kernel_description": "#1 SMP Wed Jun 10 11:09:32 UTC 2020", 2020-06-27T04:47:29.243 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "kernel_version": "4.18.0-193.6.3.el8_2.x86_64", 2020-06-27T04:47:29.243 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "mem_swap_kb": "0", 2020-06-27T04:47:29.243 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "mem_total_kb": "32659352", 2020-06-27T04:47:29.243 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "os": "Linux", 2020-06-27T04:47:29.243 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "this": "that" 2020-06-27T04:47:29.244 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: }, 2020-06-27T04:47:29.244 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "task_status": {} 2020-06-27T04:47:29.244 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: } 2020-06-27T04:47:29.244 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: } 2020-06-27T04:47:29.244 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: }, 2020-06-27T04:47:29.245 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "rgw": { 2020-06-27T04:47:29.245 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "daemons": { 2020-06-27T04:47:29.245 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "summary": "", 2020-06-27T04:47:29.245 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "realm.zone.a": { 2020-06-27T04:47:29.245 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "start_epoch": 2, 2020-06-27T04:47:29.245 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "start_stamp": "2020-06-27T04:44:41.522957+0000", 2020-06-27T04:47:29.246 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "gid": 24388, 2020-06-27T04:47:29.246 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "addr": "172.21.15.31:0/3636044534", 2020-06-27T04:47:29.246 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "metadata": { 2020-06-27T04:47:29.246 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "arch": "x86_64", 2020-06-27T04:47:29.246 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "ceph_release": "pacific", 2020-06-27T04:47:29.723 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[42554]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1 found: no such container 2020-06-27T04:47:29.723 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[42554]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1 2020-06-27T04:47:29.723 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[42554]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1" found: no such container 2020-06-27T04:47:29.724 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:29 smithi031 podman[42702]: 2020-06-27 04:47:29.557332527 +0000 UTC m=+1.961928227 container create e7bc5bb209b3e1f1ceda7e0855867ceb52f397b367b38e85c01bb334fe40d38a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:47:29.724 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:29 smithi031 podman[42702]: 2020-06-27 04:47:29.702014912 +0000 UTC m=+2.106610495 container init e7bc5bb209b3e1f1ceda7e0855867ceb52f397b367b38e85c01bb334fe40d38a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:47:29.724 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:29 smithi031 podman[42607]: 2020-06-27 04:47:29.452400147 +0000 UTC m=+2.315709901 container remove f3877a1a554f4ad4e89287ed4e8048508da1ddaa1cfa0629ee0c28f5869a3a5a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:47:29.724 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[42602]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2 found: no such container 2020-06-27T04:47:29.724 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[42602]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2 2020-06-27T04:47:29.725 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[42602]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2" found: no such container 2020-06-27T04:47:30.085 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:29 smithi031 podman[42858]: 2020-06-27 04:47:29.951929047 +0000 UTC m=+0.431680416 container create ec26ecd0171d95f31dc6c67c215371177ce8c9bac55bd062468492b3234802a9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:47:30.086 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[18426]: audit 2020-06-27T04:47:28.793001+0000 mon.a (mon.0) 736 : audit [INF] from='client.? 172.21.15.31:0/3365720754' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-6","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:30.086 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[18426]: cluster 2020-06-27T04:47:28.793113+0000 mon.a (mon.0) 737 : cluster [INF] osd.5 v2:172.21.15.51:6813/602910667 boot 2020-06-27T04:47:30.086 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[18426]: cluster 2020-06-27T04:47:28.793164+0000 mon.a (mon.0) 738 : cluster [DBG] osdmap e82: 8 total, 5 up, 8 in 2020-06-27T04:47:30.087 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[18426]: audit 2020-06-27T04:47:28.795062+0000 mon.b (mon.2) 272 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:47:30.087 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[18426]: audit 2020-06-27T04:47:29.233229+0000 mon.c (mon.1) 50 : audit [DBG] from='client.? 172.21.15.31:0/1072245737' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2020-06-27T04:47:30.087 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:29 smithi031 podman[42702]: 2020-06-27 04:47:29.795480141 +0000 UTC m=+2.200075740 container start e7bc5bb209b3e1f1ceda7e0855867ceb52f397b367b38e85c01bb334fe40d38a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:47:30.087 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:29 smithi031 podman[42702]: 2020-06-27 04:47:29.795581268 +0000 UTC m=+2.200176859 container attach e7bc5bb209b3e1f1ceda7e0855867ceb52f397b367b38e85c01bb334fe40d38a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:47:30.088 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[42700]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-06-27T04:47:30.088 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[42700]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2020-06-27T04:47:30.088 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[42700]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2020-06-27T04:47:30.088 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[42700]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2020-06-27T04:47:30.088 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[42700]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2020-06-27T04:47:30.089 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[42700]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-06-27T04:47:30.089 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[42700]: --> ceph-volume lvm activate successful for osd ID: 3 2020-06-27T04:47:30.089 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:30 smithi031 podman[42702]: 2020-06-27 04:47:30.083332127 +0000 UTC m=+2.487927738 container died e7bc5bb209b3e1f1ceda7e0855867ceb52f397b367b38e85c01bb334fe40d38a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:47:30.089 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[22603]: audit 2020-06-27T04:47:28.793001+0000 mon.a (mon.0) 736 : audit [INF] from='client.? 172.21.15.31:0/3365720754' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-6","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:30.089 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[22603]: cluster 2020-06-27T04:47:28.793113+0000 mon.a (mon.0) 737 : cluster [INF] osd.5 v2:172.21.15.51:6813/602910667 boot 2020-06-27T04:47:30.090 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[22603]: cluster 2020-06-27T04:47:28.793164+0000 mon.a (mon.0) 738 : cluster [DBG] osdmap e82: 8 total, 5 up, 8 in 2020-06-27T04:47:30.090 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[22603]: audit 2020-06-27T04:47:28.795062+0000 mon.b (mon.2) 272 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:47:30.090 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:29 smithi031 bash[22603]: audit 2020-06-27T04:47:29.233229+0000 mon.c (mon.1) 50 : audit [DBG] from='client.? 172.21.15.31:0/1072245737' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2020-06-27T04:47:30.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:29 smithi051 bash[18409]: audit 2020-06-27T04:47:28.793001+0000 mon.a (mon.0) 736 : audit [INF] from='client.? 172.21.15.31:0/3365720754' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-6","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:30.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:29 smithi051 bash[18409]: cluster 2020-06-27T04:47:28.793113+0000 mon.a (mon.0) 737 : cluster [INF] osd.5 v2:172.21.15.51:6813/602910667 boot 2020-06-27T04:47:30.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:29 smithi051 bash[18409]: cluster 2020-06-27T04:47:28.793164+0000 mon.a (mon.0) 738 : cluster [DBG] osdmap e82: 8 total, 5 up, 8 in 2020-06-27T04:47:30.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:29 smithi051 bash[18409]: audit 2020-06-27T04:47:28.795062+0000 mon.b (mon.2) 272 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:47:30.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:29 smithi051 bash[18409]: audit 2020-06-27T04:47:29.233229+0000 mon.c (mon.1) 50 : audit [DBG] from='client.? 172.21.15.31:0/1072245737' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2020-06-27T04:47:30.668 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:30 smithi031 podman[42909]: 2020-06-27 04:47:30.367538837 +0000 UTC m=+0.702079608 container create 88462962afdbc5d51aaaf0c11b8b6ae4a752929ce1bbe9c00d1df8eb549ea18f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:47:30.921 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[18426]: cluster 2020-06-27T04:47:29.189469+0000 mgr.x (mgr.34109) 228 : cluster [DBG] pgmap v226: 929 pgs: 11 creating+peering, 33 peering, 4 down, 2 stale+active+clean, 40 unknown, 22 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 8 creating+incomplete, 211 active+undersized, 40 active+undersized+degraded, 7 stale+active+undersized+degraded, 61 undersized+degraded+peered, 13 active+clean, 79 stale+undersized+peered, 346 undersized+peered, 40 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 7.9 MiB used, 707 GiB / 715 GiB avail; 514/999 objects degraded (51.451%) 2020-06-27T04:47:30.921 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[18426]: audit 2020-06-27T04:47:29.233490+0000 mgr.x (mgr.34109) 229 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2020-06-27T04:47:30.921 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[18426]: cluster 2020-06-27T04:47:29.797844+0000 mon.a (mon.0) 739 : cluster [DBG] osdmap e83: 8 total, 5 up, 8 in 2020-06-27T04:47:30.921 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[18426]: cluster 2020-06-27T04:47:30.284385+0000 mon.a (mon.0) 740 : cluster [WRN] Health check update: Degraded data redundancy: 514/999 objects degraded (51.451%), 130 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:30.922 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[18426]: cluster 2020-06-27T04:47:30.797848+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e84: 8 total, 5 up, 8 in 2020-06-27T04:47:30.922 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[18426]: audit 2020-06-27T04:47:30.800356+0000 mon.b (mon.2) 273 : audit [INF] from='client.? 172.21.15.31:0/3211300995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:30.922 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[18426]: audit 2020-06-27T04:47:30.800936+0000 mon.a (mon.0) 742 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:30.922 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[22603]: cluster 2020-06-27T04:47:29.189469+0000 mgr.x (mgr.34109) 228 : cluster [DBG] pgmap v226: 929 pgs: 11 creating+peering, 33 peering, 4 down, 2 stale+active+clean, 40 unknown, 22 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 8 creating+incomplete, 211 active+undersized, 40 active+undersized+degraded, 7 stale+active+undersized+degraded, 61 undersized+degraded+peered, 13 active+clean, 79 stale+undersized+peered, 346 undersized+peered, 40 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 7.9 MiB used, 707 GiB / 715 GiB avail; 514/999 objects degraded (51.451%) 2020-06-27T04:47:30.923 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[22603]: audit 2020-06-27T04:47:29.233490+0000 mgr.x (mgr.34109) 229 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2020-06-27T04:47:30.923 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[22603]: cluster 2020-06-27T04:47:29.797844+0000 mon.a (mon.0) 739 : cluster [DBG] osdmap e83: 8 total, 5 up, 8 in 2020-06-27T04:47:30.923 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[22603]: cluster 2020-06-27T04:47:30.284385+0000 mon.a (mon.0) 740 : cluster [WRN] Health check update: Degraded data redundancy: 514/999 objects degraded (51.451%), 130 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:30.923 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[22603]: cluster 2020-06-27T04:47:30.797848+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e84: 8 total, 5 up, 8 in 2020-06-27T04:47:30.923 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[22603]: audit 2020-06-27T04:47:30.800356+0000 mon.b (mon.2) 273 : audit [INF] from='client.? 172.21.15.31:0/3211300995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:30.924 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[22603]: audit 2020-06-27T04:47:30.800936+0000 mon.a (mon.0) 742 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:31.190 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 podman[42702]: 2020-06-27 04:47:31.003201743 +0000 UTC m=+3.407797356 container remove e7bc5bb209b3e1f1ceda7e0855867ceb52f397b367b38e85c01bb334fe40d38a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:47:31.190 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3 found: no such container 2020-06-27T04:47:31.190 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 podman[42858]: 2020-06-27 04:47:30.918445282 +0000 UTC m=+1.398196631 container init ec26ecd0171d95f31dc6c67c215371177ce8c9bac55bd062468492b3234802a9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:47:31.191 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 podman[42858]: 2020-06-27 04:47:30.994531588 +0000 UTC m=+1.474282940 container start ec26ecd0171d95f31dc6c67c215371177ce8c9bac55bd062468492b3234802a9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:47:31.191 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 podman[42858]: 2020-06-27 04:47:30.994596011 +0000 UTC m=+1.474347358 container attach ec26ecd0171d95f31dc6c67c215371177ce8c9bac55bd062468492b3234802a9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:47:31.191 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f8843c23700 5 --2- 172.21.15.31:0/22340301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55fbfa333000 0x55fbfa2a3e00 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0x55fbfa2b5a70 tx=0x55fbfa282c00).reset_recv_state (warped) reseting crypto handlers 2020-06-27T04:47:31.191 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f8843c23700 5 --2- 172.21.15.31:0/22340301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55fbfa333000 0x55fbfa2a3e00 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0x55fbfa2b5a70 tx=0x55fbfa282c00).reset_security 2020-06-27T04:47:31.191 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f8843c23700 20 EpollDriver.del_event del event fd=16 cur_mask=1 delmask=3 to 11 2020-06-27T04:47:31.192 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 10 -- 172.21.15.31:0/22340301 shutdown 172.21.15.31:0/22340301 2020-06-27T04:47:31.192 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 10 Processor -- stop 2020-06-27T04:47:31.192 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 20 Event(0x55fbfa2c6e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:31.192 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 1 -- 172.21.15.31:0/22340301 shutdown_connections 2020-06-27T04:47:31.193 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 5 -- 172.21.15.31:0/22340301 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55fbfa333400 2020-06-27T04:47:31.193 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 1 --2- 172.21.15.31:0/22340301 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55fbfa333400 0x55fbfa2a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:31.193 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 5 -- 172.21.15.31:0/22340301 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55fbfa332c00 2020-06-27T04:47:31.193 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 1 --2- 172.21.15.31:0/22340301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbfa332c00 0x55fbfa2a3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:31.193 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 5 -- 172.21.15.31:0/22340301 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55fbfa333000 2020-06-27T04:47:31.194 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 1 --2- 172.21.15.31:0/22340301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55fbfa333000 0x55fbfa2a3e00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:31.194 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 5 -- 172.21.15.31:0/22340301 shutdown_connections delete 0x55fbfa332c00 2020-06-27T04:47:31.194 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 5 -- 172.21.15.31:0/22340301 shutdown_connections delete 0x55fbfa333000 2020-06-27T04:47:31.194 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 5 -- 172.21.15.31:0/22340301 shutdown_connections delete 0x55fbfa333400 2020-06-27T04:47:31.194 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 1 -- 172.21.15.31:0/22340301 >> 172.21.15.31:0/22340301 conn(0x55fbfa332800 msgr2=0x55fbfa39b000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:47:31.195 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 20 --1- 172.21.15.31:0/22340301 >> 172.21.15.31:0/22340301 conn(0x55fbfa332800 0x55fbfa39b000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:31.195 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 2 --1- 172.21.15.31:0/22340301 >> 172.21.15.31:0/22340301 conn(0x55fbfa332800 0x55fbfa39b000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:31.195 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 5 --1- 172.21.15.31:0/22340301 >> 172.21.15.31:0/22340301 conn(0x55fbfa332800 0x55fbfa39b000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:47:31.195 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 20 Event(0x55fbfa2c6e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:31.195 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 10 --1- 172.21.15.31:0/22340301 >> 172.21.15.31:0/22340301 conn(0x55fbfa332800 0x55fbfa39b000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:47:31.196 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 20 Event(0x55fbfa2c6e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:31.196 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 20 Event(0x55fbfa2c7040 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:31.196 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f8844c25700 5 --1- 172.21.15.31:0/22340301 >> 172.21.15.31:0/22340301 conn(0x55fbfa332800 0x55fbfa39b000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:47:31.198 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 20 Event(0x55fbfa2c7280 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:31.199 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f8844c25700 5 --1- 172.21.15.31:0/22340301 >> 172.21.15.31:0/22340301 conn(0x55fbfa332800 0x55fbfa39b000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:47:31.199 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 10 -- 172.21.15.31:0/22340301 wait: waiting for dispatch queue 2020-06-27T04:47:31.199 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 10 -- 172.21.15.31:0/22340301 wait: dispatch queue is stopped 2020-06-27T04:47:31.199 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 1 -- 172.21.15.31:0/22340301 shutdown_connections 2020-06-27T04:47:31.200 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 5 -- 172.21.15.31:0/22340301 shutdown_connections delete 0x55fbfa332800 2020-06-27T04:47:31.200 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 20 Event(0x55fbfa2c6e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:31.200 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 20 Event(0x55fbfa2c7040 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:31.200 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.951+0000 7f884aea2f40 20 Event(0x55fbfa2c7280 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:31.200 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.952+0000 7f884aea2f40 10 -- 172.21.15.31:0/22340301 wait: done. 2020-06-27T04:47:31.201 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:30 smithi031 bash[42554]: debug 2020-06-27T04:47:30.952+0000 7f884aea2f40 1 -- 172.21.15.31:0/22340301 wait complete. 2020-06-27T04:47:31.201 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 podman[42909]: 2020-06-27 04:47:31.085071902 +0000 UTC m=+1.419612565 container init 88462962afdbc5d51aaaf0c11b8b6ae4a752929ce1bbe9c00d1df8eb549ea18f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:47:31.201 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 podman[42909]: 2020-06-27 04:47:31.143436383 +0000 UTC m=+1.477977040 container start 88462962afdbc5d51aaaf0c11b8b6ae4a752929ce1bbe9c00d1df8eb549ea18f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:47:31.201 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 podman[42909]: 2020-06-27 04:47:31.143506923 +0000 UTC m=+1.478047618 container attach 88462962afdbc5d51aaaf0c11b8b6ae4a752929ce1bbe9c00d1df8eb549ea18f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:47:31.202 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.118+0000 7ff6f87b7700 5 --2- 172.21.15.31:0/1383258269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55ba844ef000 0x55ba8445fe00 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0x55ba84471a70 tx=0x55ba8443ec00).reset_recv_state (warped) reseting crypto handlers 2020-06-27T04:47:31.202 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6f87b7700 5 --2- 172.21.15.31:0/1383258269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55ba844ef000 0x55ba8445fe00 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0x55ba84471a70 tx=0x55ba8443ec00).reset_security 2020-06-27T04:47:31.202 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6f87b7700 20 EpollDriver.del_event del event fd=15 cur_mask=1 delmask=3 to 11 2020-06-27T04:47:31.202 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 10 -- 172.21.15.31:0/1383258269 shutdown 172.21.15.31:0/1383258269 2020-06-27T04:47:31.202 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 10 Processor -- stop 2020-06-27T04:47:31.203 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 20 Event(0x55ba84482e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:31.203 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 1 -- 172.21.15.31:0/1383258269 shutdown_connections 2020-06-27T04:47:31.203 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 5 -- 172.21.15.31:0/1383258269 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55ba844ef400 2020-06-27T04:47:31.204 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 1 --2- 172.21.15.31:0/1383258269 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55ba844ef400 0x55ba84460300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:31.204 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 5 -- 172.21.15.31:0/1383258269 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55ba844eec00 2020-06-27T04:47:31.204 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 1 --2- 172.21.15.31:0/1383258269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba844eec00 0x55ba8445f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:31.204 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 5 -- 172.21.15.31:0/1383258269 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55ba844ef000 2020-06-27T04:47:31.205 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 1 --2- 172.21.15.31:0/1383258269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55ba844ef000 0x55ba8445fe00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:31.205 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 5 -- 172.21.15.31:0/1383258269 shutdown_connections delete 0x55ba844eec00 2020-06-27T04:47:31.205 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 5 -- 172.21.15.31:0/1383258269 shutdown_connections delete 0x55ba844ef000 2020-06-27T04:47:31.205 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 5 -- 172.21.15.31:0/1383258269 shutdown_connections delete 0x55ba844ef400 2020-06-27T04:47:31.205 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 1 -- 172.21.15.31:0/1383258269 >> 172.21.15.31:0/1383258269 conn(0x55ba844ee800 msgr2=0x55ba84557000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:47:31.206 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 20 --1- 172.21.15.31:0/1383258269 >> 172.21.15.31:0/1383258269 conn(0x55ba844ee800 0x55ba84557000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:31.206 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 2 --1- 172.21.15.31:0/1383258269 >> 172.21.15.31:0/1383258269 conn(0x55ba844ee800 0x55ba84557000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:31.206 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 5 --1- 172.21.15.31:0/1383258269 >> 172.21.15.31:0/1383258269 conn(0x55ba844ee800 0x55ba84557000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:47:31.206 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 20 Event(0x55ba84482e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:31.208 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 10 --1- 172.21.15.31:0/1383258269 >> 172.21.15.31:0/1383258269 conn(0x55ba844ee800 0x55ba84557000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:47:31.209 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 20 Event(0x55ba84483040 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:31.209 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 20 Event(0x55ba84483280 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:31.209 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6f97b9700 5 --1- 172.21.15.31:0/1383258269 >> 172.21.15.31:0/1383258269 conn(0x55ba844ee800 0x55ba84557000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:47:31.209 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6f97b9700 5 --1- 172.21.15.31:0/1383258269 >> 172.21.15.31:0/1383258269 conn(0x55ba844ee800 0x55ba84557000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:47:31.210 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 10 -- 172.21.15.31:0/1383258269 wait: waiting for dispatch queue 2020-06-27T04:47:31.210 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 10 -- 172.21.15.31:0/1383258269 wait: dispatch queue is stopped 2020-06-27T04:47:31.210 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 1 -- 172.21.15.31:0/1383258269 shutdown_connections 2020-06-27T04:47:31.210 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 5 -- 172.21.15.31:0/1383258269 shutdown_connections delete 0x55ba844ee800 2020-06-27T04:47:31.210 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 20 Event(0x55ba84482e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:31.211 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 20 Event(0x55ba84483040 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:31.211 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 20 Event(0x55ba84483280 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:31.211 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 10 -- 172.21.15.31:0/1383258269 wait: done. 2020-06-27T04:47:31.211 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.119+0000 7ff6ffa36f40 1 -- 172.21.15.31:0/1383258269 wait complete. 2020-06-27T04:47:31.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:30 smithi051 bash[18409]: cluster 2020-06-27T04:47:29.189469+0000 mgr.x (mgr.34109) 228 : cluster [DBG] pgmap v226: 929 pgs: 11 creating+peering, 33 peering, 4 down, 2 stale+active+clean, 40 unknown, 22 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 8 creating+incomplete, 211 active+undersized, 40 active+undersized+degraded, 7 stale+active+undersized+degraded, 61 undersized+degraded+peered, 13 active+clean, 79 stale+undersized+peered, 346 undersized+peered, 40 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 7.9 MiB used, 707 GiB / 715 GiB avail; 514/999 objects degraded (51.451%) 2020-06-27T04:47:31.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:30 smithi051 bash[18409]: audit 2020-06-27T04:47:29.233490+0000 mgr.x (mgr.34109) 229 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2020-06-27T04:47:31.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:30 smithi051 bash[18409]: cluster 2020-06-27T04:47:29.797844+0000 mon.a (mon.0) 739 : cluster [DBG] osdmap e83: 8 total, 5 up, 8 in 2020-06-27T04:47:31.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:30 smithi051 bash[18409]: cluster 2020-06-27T04:47:30.284385+0000 mon.a (mon.0) 740 : cluster [WRN] Health check update: Degraded data redundancy: 514/999 objects degraded (51.451%), 130 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:31.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:30 smithi051 bash[18409]: cluster 2020-06-27T04:47:30.797848+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e84: 8 total, 5 up, 8 in 2020-06-27T04:47:31.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:30 smithi051 bash[18409]: audit 2020-06-27T04:47:30.800356+0000 mon.b (mon.2) 273 : audit [INF] from='client.? 172.21.15.31:0/3211300995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:31.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:30 smithi051 bash[18409]: audit 2020-06-27T04:47:30.800936+0000 mon.a (mon.0) 742 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:31.471 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3 2020-06-27T04:47:31.472 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3" found: no such container 2020-06-27T04:47:31.472 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 podman[43117]: 2020-06-27 04:47:31.410108879 +0000 UTC m=+0.208251202 container create 4e55b1b20e108a1e36f330e88baece7260633d563fdf529442d912b4a8671d2a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:47:31.723 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42602]: debug 2020-06-27T04:47:31.636+0000 7ff6ffa36f40 -1 Falling back to public interface 2020-06-27T04:47:31.723 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42554]: debug 2020-06-27T04:47:31.468+0000 7f884aea2f40 -1 Falling back to public interface 2020-06-27T04:47:31.724 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 podman[43117]: 2020-06-27 04:47:31.55997547 +0000 UTC m=+0.358117644 container init 4e55b1b20e108a1e36f330e88baece7260633d563fdf529442d912b4a8671d2a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:47:31.724 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 podman[43117]: 2020-06-27 04:47:31.59334762 +0000 UTC m=+0.391489793 container start 4e55b1b20e108a1e36f330e88baece7260633d563fdf529442d912b4a8671d2a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:47:31.724 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 podman[43117]: 2020-06-27 04:47:31.593416895 +0000 UTC m=+0.391559098 container attach 4e55b1b20e108a1e36f330e88baece7260633d563fdf529442d912b4a8671d2a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:47:31.724 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.581+0000 7ff167e67f40 10 -- 172.21.15.31:0/39981725 shutdown 172.21.15.31:0/39981725 2020-06-27T04:47:31.725 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.581+0000 7ff167e67f40 10 Processor -- stop 2020-06-27T04:47:31.725 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.581+0000 7ff167e67f40 20 Event(0x55b0672e0e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:31.725 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.581+0000 7ff167e67f40 1 -- 172.21.15.31:0/39981725 shutdown_connections 2020-06-27T04:47:31.725 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.581+0000 7ff167e67f40 5 -- 172.21.15.31:0/39981725 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55b06734d400 2020-06-27T04:47:31.725 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.581+0000 7ff167e67f40 1 --2- 172.21.15.31:0/39981725 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55b06734d400 0x55b0672be300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:31.726 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.581+0000 7ff167e67f40 5 -- 172.21.15.31:0/39981725 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55b06734cc00 2020-06-27T04:47:31.726 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.581+0000 7ff167e67f40 1 --2- 172.21.15.31:0/39981725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55b06734cc00 0x55b0672bd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:31.726 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.581+0000 7ff167e67f40 5 -- 172.21.15.31:0/39981725 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55b06734d000 2020-06-27T04:47:31.726 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.581+0000 7ff167e67f40 1 --2- 172.21.15.31:0/39981725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06734d000 0x55b0672bde00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:31.727 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.581+0000 7ff167e67f40 5 -- 172.21.15.31:0/39981725 shutdown_connections delete 0x55b06734cc00 2020-06-27T04:47:31.727 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.581+0000 7ff167e67f40 5 -- 172.21.15.31:0/39981725 shutdown_connections delete 0x55b06734d000 2020-06-27T04:47:31.727 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.581+0000 7ff167e67f40 5 -- 172.21.15.31:0/39981725 shutdown_connections delete 0x55b06734d400 2020-06-27T04:47:31.727 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.581+0000 7ff167e67f40 1 -- 172.21.15.31:0/39981725 >> 172.21.15.31:0/39981725 conn(0x55b06734c800 msgr2=0x55b0673b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:47:31.727 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.581+0000 7ff167e67f40 20 --1- 172.21.15.31:0/39981725 >> 172.21.15.31:0/39981725 conn(0x55b06734c800 0x55b0673b5000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:31.728 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.581+0000 7ff167e67f40 2 --1- 172.21.15.31:0/39981725 >> 172.21.15.31:0/39981725 conn(0x55b06734c800 0x55b0673b5000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:31.728 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.581+0000 7ff167e67f40 5 --1- 172.21.15.31:0/39981725 >> 172.21.15.31:0/39981725 conn(0x55b06734c800 0x55b0673b5000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:47:31.728 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.582+0000 7ff167e67f40 20 Event(0x55b0672e0e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:31.728 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.582+0000 7ff167e67f40 10 --1- 172.21.15.31:0/39981725 >> 172.21.15.31:0/39981725 conn(0x55b06734c800 0x55b0673b5000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:47:31.728 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.582+0000 7ff167e67f40 20 Event(0x55b0672e0e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:31.729 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.582+0000 7ff167e67f40 20 Event(0x55b0672e1040 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:31.729 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.582+0000 7ff161bea700 5 --1- 172.21.15.31:0/39981725 >> 172.21.15.31:0/39981725 conn(0x55b06734c800 0x55b0673b5000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:47:31.729 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.582+0000 7ff161bea700 5 --1- 172.21.15.31:0/39981725 >> 172.21.15.31:0/39981725 conn(0x55b06734c800 0x55b0673b5000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:47:31.729 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.582+0000 7ff167e67f40 20 Event(0x55b0672e1280 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:31.729 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.582+0000 7ff167e67f40 10 -- 172.21.15.31:0/39981725 wait: waiting for dispatch queue 2020-06-27T04:47:31.730 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.582+0000 7ff167e67f40 10 -- 172.21.15.31:0/39981725 wait: dispatch queue is stopped 2020-06-27T04:47:31.730 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.582+0000 7ff167e67f40 1 -- 172.21.15.31:0/39981725 shutdown_connections 2020-06-27T04:47:31.730 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.582+0000 7ff167e67f40 5 -- 172.21.15.31:0/39981725 shutdown_connections delete 0x55b06734c800 2020-06-27T04:47:31.730 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.582+0000 7ff167e67f40 20 Event(0x55b0672e0e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:31.730 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.582+0000 7ff167e67f40 20 Event(0x55b0672e1040 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:31.731 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.582+0000 7ff167e67f40 20 Event(0x55b0672e1280 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:31.731 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.582+0000 7ff167e67f40 10 -- 172.21.15.31:0/39981725 wait: done. 2020-06-27T04:47:31.731 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:31 smithi031 bash[42700]: debug 2020-06-27T04:47:31.582+0000 7ff167e67f40 1 -- 172.21.15.31:0/39981725 wait complete. 2020-06-27T04:47:32.473 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[42554]: debug 2020-06-27T04:47:32.162+0000 7f884aea2f40 -1 osd.1 63 log_to_monitors {default=true} 2020-06-27T04:47:32.473 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[42602]: debug 2020-06-27T04:47:32.350+0000 7ff6ffa36f40 -1 osd.2 67 log_to_monitors {default=true} 2020-06-27T04:47:32.473 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[42700]: debug 2020-06-27T04:47:32.103+0000 7ff167e67f40 -1 Falling back to public interface 2020-06-27T04:47:32.718 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:32.719 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: in thread 7f291687d700 thread_name:tp_osd_tp 2020-06-27T04:47:32.719 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:32.719 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 1: (()+0x12dd0) [0x7f293be83dd0] 2020-06-27T04:47:32.720 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55bf9dd3e707] 2020-06-27T04:47:32.720 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55bf9dd3eaa0] 2020-06-27T04:47:32.720 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55bf9dd7067a] 2020-06-27T04:47:32.720 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55bf9dd71a57] 2020-06-27T04:47:32.720 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55bf9d9fc938] 2020-06-27T04:47:32.721 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55bf9dbad03d] 2020-06-27T04:47:32.721 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55bf9d96a5b0] 2020-06-27T04:47:32.721 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55bf9d9c389d] 2020-06-27T04:47:32.721 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55bf9d9cc380] 2020-06-27T04:47:32.721 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55bf9d9d3590] 2020-06-27T04:47:32.722 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55bf9d8534e9] 2020-06-27T04:47:32.722 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55bf9dab7f78] 2020-06-27T04:47:32.722 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55bf9d87270f] 2020-06-27T04:47:32.722 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55bf9deb0b94] 2020-06-27T04:47:32.722 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55bf9deb37f4] 2020-06-27T04:47:32.722 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 17: (()+0x82de) [0x7f293be792de] 2020-06-27T04:47:32.723 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 18: (clone()+0x43) [0x7f293abb0e83] 2020-06-27T04:47:32.723 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: debug 2020-06-27T04:47:32.269+0000 7f291687d700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:32.723 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: in thread 7f291687d700 thread_name:tp_osd_tp 2020-06-27T04:47:32.723 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:32.723 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 1: (()+0x12dd0) [0x7f293be83dd0] 2020-06-27T04:47:32.724 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55bf9dd3e707] 2020-06-27T04:47:32.724 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55bf9dd3eaa0] 2020-06-27T04:47:32.724 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55bf9dd7067a] 2020-06-27T04:47:32.724 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55bf9dd71a57] 2020-06-27T04:47:32.724 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55bf9d9fc938] 2020-06-27T04:47:32.724 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55bf9dbad03d] 2020-06-27T04:47:32.725 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55bf9d96a5b0] 2020-06-27T04:47:32.725 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55bf9d9c389d] 2020-06-27T04:47:32.725 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55bf9d9cc380] 2020-06-27T04:47:32.725 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55bf9d9d3590] 2020-06-27T04:47:32.725 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55bf9d8534e9] 2020-06-27T04:47:32.726 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55bf9dab7f78] 2020-06-27T04:47:32.726 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55bf9d87270f] 2020-06-27T04:47:32.726 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55bf9deb0b94] 2020-06-27T04:47:32.726 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55bf9deb37f4] 2020-06-27T04:47:32.726 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 17: (()+0x82de) [0x7f293be792de] 2020-06-27T04:47:32.727 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 18: (clone()+0x43) [0x7f293abb0e83] 2020-06-27T04:47:32.727 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:32.727 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: debug -9999> 2020-06-27T04:47:32.269+0000 7f291687d700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:32.727 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: in thread 7f291687d700 thread_name:tp_osd_tp 2020-06-27T04:47:32.727 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:32.728 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 1: (()+0x12dd0) [0x7f293be83dd0] 2020-06-27T04:47:32.728 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55bf9dd3e707] 2020-06-27T04:47:32.728 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55bf9dd3eaa0] 2020-06-27T04:47:32.728 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:32.728 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: in thread 7f633f64a700 thread_name:tp_osd_tp 2020-06-27T04:47:32.729 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:32.729 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 1: (()+0x12dd0) [0x7f6368c58dd0] 2020-06-27T04:47:32.729 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55d1e1c65707] 2020-06-27T04:47:32.729 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55d1e1c65aa0] 2020-06-27T04:47:32.729 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55d1e1c9767a] 2020-06-27T04:47:32.730 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55d1e1c98a57] 2020-06-27T04:47:32.730 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55d1e1923938] 2020-06-27T04:47:32.730 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55d1e1ad7a70] 2020-06-27T04:47:32.730 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55d1e1ae7dd7] 2020-06-27T04:47:32.730 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55d1e1956252] 2020-06-27T04:47:32.731 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55d1e18f9e2e] 2020-06-27T04:47:32.731 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55d1e177a4e9] 2020-06-27T04:47:32.731 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55d1e19def78] 2020-06-27T04:47:32.731 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55d1e179970f] 2020-06-27T04:47:32.731 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55d1e1dd7b94] 2020-06-27T04:47:32.731 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55d1e1dda7f4] 2020-06-27T04:47:32.732 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 16: (()+0x82de) [0x7f6368c4e2de] 2020-06-27T04:47:32.732 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 17: (clone()+0x43) [0x7f6367985e83] 2020-06-27T04:47:32.732 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: debug 2020-06-27T04:47:32.269+0000 7f633f64a700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:32.732 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: in thread 7f633f64a700 thread_name:tp_osd_tp 2020-06-27T04:47:32.732 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:32.733 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 1: (()+0x12dd0) [0x7f6368c58dd0] 2020-06-27T04:47:32.733 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55d1e1c65707] 2020-06-27T04:47:32.733 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55d1e1c65aa0] 2020-06-27T04:47:32.733 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55d1e1c9767a] 2020-06-27T04:47:32.733 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55d1e1c98a57] 2020-06-27T04:47:32.734 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55d1e1923938] 2020-06-27T04:47:32.734 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55d1e1ad7a70] 2020-06-27T04:47:32.734 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55d1e1ae7dd7] 2020-06-27T04:47:32.734 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55d1e1956252] 2020-06-27T04:47:32.738 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55d1e18f9e2e] 2020-06-27T04:47:32.738 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55d1e177a4e9] 2020-06-27T04:47:32.738 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55d1e19def78] 2020-06-27T04:47:32.739 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55d1e179970f] 2020-06-27T04:47:32.739 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55d1e1dd7b94] 2020-06-27T04:47:32.739 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55d1e1dda7f4] 2020-06-27T04:47:32.739 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 16: (()+0x82de) [0x7f6368c4e2de] 2020-06-27T04:47:32.739 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 17: (clone()+0x43) [0x7f6367985e83] 2020-06-27T04:47:32.740 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:32.740 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: debug -9999> 2020-06-27T04:47:32.269+0000 7f633f64a700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:32.740 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: in thread 7f633f64a700 thread_name:tp_osd_tp 2020-06-27T04:47:32.740 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:32.740 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 1: (()+0x12dd0) [0x7f6368c58dd0] 2020-06-27T04:47:32.741 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55d1e1c65707] 2020-06-27T04:47:32.741 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55d1e1c65aa0] 2020-06-27T04:47:32.741 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55d1e1c9767a] 2020-06-27T04:47:32.741 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55d1e1c98a57] 2020-06-27T04:47:32.741 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55d1e1923938] 2020-06-27T04:47:32.742 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55d1e1ad7a70] 2020-06-27T04:47:32.742 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55d1e1ae7dd7] 2020-06-27T04:47:32.743 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55bf9dd7067a] 2020-06-27T04:47:32.743 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55bf9dd71a57] 2020-06-27T04:47:32.743 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55bf9d9fc938] 2020-06-27T04:47:32.743 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55bf9dbad03d] 2020-06-27T04:47:32.744 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55bf9d96a5b0] 2020-06-27T04:47:32.744 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55bf9d9c389d] 2020-06-27T04:47:32.744 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55bf9d9cc380] 2020-06-27T04:47:32.744 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55bf9d9d3590] 2020-06-27T04:47:32.744 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55bf9d8534e9] 2020-06-27T04:47:32.745 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55bf9dab7f78] 2020-06-27T04:47:32.745 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55bf9d87270f] 2020-06-27T04:47:32.745 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55bf9deb0b94] 2020-06-27T04:47:32.745 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55bf9deb37f4] 2020-06-27T04:47:32.745 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 17: (()+0x82de) [0x7f293be792de] 2020-06-27T04:47:32.746 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 18: (clone()+0x43) [0x7f293abb0e83] 2020-06-27T04:47:32.746 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:32.746 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: debug -9999> 2020-06-27T04:47:32.269+0000 7f291687d700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:32.746 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: in thread 7f291687d700 thread_name:tp_osd_tp 2020-06-27T04:47:32.746 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:32.746 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 1: (()+0x12dd0) [0x7f293be83dd0] 2020-06-27T04:47:32.747 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55bf9dd3e707] 2020-06-27T04:47:32.747 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55bf9dd3eaa0] 2020-06-27T04:47:32.747 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55bf9dd7067a] 2020-06-27T04:47:32.747 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55bf9dd71a57] 2020-06-27T04:47:32.747 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55bf9d9fc938] 2020-06-27T04:47:32.748 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55bf9dbad03d] 2020-06-27T04:47:32.748 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55bf9d96a5b0] 2020-06-27T04:47:32.748 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55bf9d9c389d] 2020-06-27T04:47:32.748 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55bf9d9cc380] 2020-06-27T04:47:32.748 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55bf9d9d3590] 2020-06-27T04:47:32.749 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55bf9d8534e9] 2020-06-27T04:47:32.749 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55bf9dab7f78] 2020-06-27T04:47:32.749 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55bf9d87270f] 2020-06-27T04:47:32.749 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55bf9deb0b94] 2020-06-27T04:47:32.749 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55bf9deb37f4] 2020-06-27T04:47:32.750 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 17: (()+0x82de) [0x7f293be792de] 2020-06-27T04:47:32.750 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: 18: (clone()+0x43) [0x7f293abb0e83] 2020-06-27T04:47:32.750 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:32.751 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33454]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:47:32.751 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:32 smithi051 podman[33644]: 2020-06-27 04:47:32.364672098 +0000 UTC m=+6.197332681 container died b26656bd12a50e67b834e5f2f0631658d3958aef7adf709a0054d8a67801fe80 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:47:32.751 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55d1e1956252] 2020-06-27T04:47:32.751 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55d1e18f9e2e] 2020-06-27T04:47:32.752 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55d1e177a4e9] 2020-06-27T04:47:32.752 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55d1e19def78] 2020-06-27T04:47:32.752 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55d1e179970f] 2020-06-27T04:47:32.752 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55d1e1dd7b94] 2020-06-27T04:47:32.753 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55d1e1dda7f4] 2020-06-27T04:47:32.753 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 16: (()+0x82de) [0x7f6368c4e2de] 2020-06-27T04:47:32.753 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 17: (clone()+0x43) [0x7f6367985e83] 2020-06-27T04:47:32.753 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:32.753 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: debug -9999> 2020-06-27T04:47:32.269+0000 7f633f64a700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:32.754 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: in thread 7f633f64a700 thread_name:tp_osd_tp 2020-06-27T04:47:32.754 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:32.754 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 1: (()+0x12dd0) [0x7f6368c58dd0] 2020-06-27T04:47:32.754 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55d1e1c65707] 2020-06-27T04:47:32.754 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55d1e1c65aa0] 2020-06-27T04:47:32.755 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55d1e1c9767a] 2020-06-27T04:47:32.755 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55d1e1c98a57] 2020-06-27T04:47:32.755 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55d1e1923938] 2020-06-27T04:47:32.755 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55d1e1ad7a70] 2020-06-27T04:47:32.756 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55d1e1ae7dd7] 2020-06-27T04:47:32.756 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55d1e1956252] 2020-06-27T04:47:32.756 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55d1e18f9e2e] 2020-06-27T04:47:32.756 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55d1e177a4e9] 2020-06-27T04:47:32.756 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55d1e19def78] 2020-06-27T04:47:32.757 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55d1e179970f] 2020-06-27T04:47:32.757 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55d1e1dd7b94] 2020-06-27T04:47:32.757 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55d1e1dda7f4] 2020-06-27T04:47:32.757 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 16: (()+0x82de) [0x7f6368c4e2de] 2020-06-27T04:47:32.757 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: 17: (clone()+0x43) [0x7f6367985e83] 2020-06-27T04:47:32.758 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:32.758 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[33403]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:47:32.758 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:32 smithi051 podman[33601]: 2020-06-27 04:47:32.442672864 +0000 UTC m=+6.532882725 container died 857a8d7b9a2ff98916ac27b1070e3a875b6bd7d8bd6532dc477018358b158d9a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:47:33.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:31.190656+0000 mgr.x (mgr.34109) 230 : cluster [DBG] pgmap v229: 865 pgs: 10 creating+peering, 29 peering, 4 down, 2 stale+active+clean, 64 unknown, 22 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 7 creating+incomplete, 199 active+undersized, 45 active+undersized+degraded, 7 stale+active+undersized+degraded, 48 undersized+degraded+peered, 46 active+clean, 69 stale+undersized+peered, 264 undersized+peered, 37 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 8.0 MiB used, 707 GiB / 715 GiB avail; 511 B/s rd, 0 B/s wr, 1 op/s; 476/999 objects degraded (47.648%); 95 B/s, 0 objects/s recovering 2020-06-27T04:47:33.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: audit 2020-06-27T04:47:31.806899+0000 mon.a (mon.0) 743 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-3","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:33.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:31.807364+0000 mon.a (mon.0) 744 : cluster [DBG] osdmap e85: 8 total, 5 up, 8 in 2020-06-27T04:47:33.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:31.812418+0000 mon.a (mon.0) 745 : cluster [WRN] Health check update: Reduced data availability: 22 pgs inactive, 7 pgs down, 9 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:47:33.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: audit 2020-06-27T04:47:31.815651+0000 mon.a (mon.0) 746 : audit [INF] from='client.? 172.21.15.31:0/4287042902' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:33.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: audit 2020-06-27T04:47:32.353949+0000 mon.c (mon.1) 51 : audit [INF] from='osd.2 v2:172.21.15.31:6808/1535516093' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:47:33.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.726051+0000 mon.a (mon.0) 747 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:33.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.726090+0000 mon.a (mon.0) 748 : cluster [INF] osd.5 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:47:33.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.726863+0000 mon.a (mon.0) 749 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:33.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.727319+0000 mon.a (mon.0) 750 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:33.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.727821+0000 mon.a (mon.0) 751 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:33.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: audit 2020-06-27T04:47:32.728159+0000 mon.a (mon.0) 752 : audit [INF] from='osd.1 v2:172.21.15.31:6804/3247359993' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:47:33.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.728709+0000 mon.a (mon.0) 753 : cluster [DBG] osd.7 reported immediately failed by osd.0 2020-06-27T04:47:33.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.728750+0000 mon.a (mon.0) 754 : cluster [INF] osd.7 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:47:33.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.729021+0000 mon.a (mon.0) 755 : cluster [DBG] osd.7 reported immediately failed by osd.0 2020-06-27T04:47:33.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: audit 2020-06-27T04:47:32.729197+0000 mon.a (mon.0) 756 : audit [INF] from='osd.1 v2:172.21.15.31:6804/3247359993' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:33.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: audit 2020-06-27T04:47:32.729755+0000 mon.a (mon.0) 757 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:47:33.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.731351+0000 mon.a (mon.0) 758 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:33.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.731557+0000 mon.a (mon.0) 759 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:33.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.731723+0000 mon.a (mon.0) 760 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:33.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.731840+0000 mon.a (mon.0) 761 : cluster [DBG] osd.7 reported immediately failed by osd.4 2020-06-27T04:47:33.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.731971+0000 mon.a (mon.0) 762 : cluster [DBG] osd.7 reported immediately failed by osd.4 2020-06-27T04:47:33.223 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.732108+0000 mon.a (mon.0) 763 : cluster [DBG] osd.7 reported immediately failed by osd.6 2020-06-27T04:47:33.223 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.732235+0000 mon.a (mon.0) 764 : cluster [DBG] osd.7 reported immediately failed by osd.6 2020-06-27T04:47:33.223 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.732366+0000 mon.a (mon.0) 765 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:33.223 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.732595+0000 mon.a (mon.0) 766 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:33.223 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: audit 2020-06-27T04:47:32.732601+0000 mon.c (mon.1) 52 : audit [INF] from='osd.2 v2:172.21.15.31:6808/1535516093' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:33.224 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.732745+0000 mon.a (mon.0) 767 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:33.224 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.732926+0000 mon.a (mon.0) 768 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:33.224 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.733234+0000 mon.a (mon.0) 769 : cluster [DBG] osd.7 reported immediately failed by osd.6 2020-06-27T04:47:33.224 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: audit 2020-06-27T04:47:32.733445+0000 mon.a (mon.0) 770 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:33.224 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.733788+0000 mon.a (mon.0) 771 : cluster [DBG] osd.7 reported immediately failed by osd.6 2020-06-27T04:47:33.224 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.733948+0000 mon.a (mon.0) 772 : cluster [DBG] osd.7 reported immediately failed by osd.4 2020-06-27T04:47:33.225 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:32 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.734076+0000 mon.a (mon.0) 773 : cluster [DBG] osd.7 reported immediately failed by osd.4 2020-06-27T04:47:33.226 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[42700]: debug 2020-06-27T04:47:32.874+0000 7ff167e67f40 -1 osd.3 67 log_to_monitors {default=true} 2020-06-27T04:47:33.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:31.190656+0000 mgr.x (mgr.34109) 230 : cluster [DBG] pgmap v229: 865 pgs: 10 creating+peering, 29 peering, 4 down, 2 stale+active+clean, 64 unknown, 22 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 7 creating+incomplete, 199 active+undersized, 45 active+undersized+degraded, 7 stale+active+undersized+degraded, 48 undersized+degraded+peered, 46 active+clean, 69 stale+undersized+peered, 264 undersized+peered, 37 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 8.0 MiB used, 707 GiB / 715 GiB avail; 511 B/s rd, 0 B/s wr, 1 op/s; 476/999 objects degraded (47.648%); 95 B/s, 0 objects/s recovering 2020-06-27T04:47:33.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: audit 2020-06-27T04:47:31.806899+0000 mon.a (mon.0) 743 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-3","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:33.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:31.807364+0000 mon.a (mon.0) 744 : cluster [DBG] osdmap e85: 8 total, 5 up, 8 in 2020-06-27T04:47:33.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:31.812418+0000 mon.a (mon.0) 745 : cluster [WRN] Health check update: Reduced data availability: 22 pgs inactive, 7 pgs down, 9 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:47:33.228 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: audit 2020-06-27T04:47:31.815651+0000 mon.a (mon.0) 746 : audit [INF] from='client.? 172.21.15.31:0/4287042902' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:33.228 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: audit 2020-06-27T04:47:32.353949+0000 mon.c (mon.1) 51 : audit [INF] from='osd.2 v2:172.21.15.31:6808/1535516093' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:47:33.228 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.726051+0000 mon.a (mon.0) 747 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:33.228 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.726090+0000 mon.a (mon.0) 748 : cluster [INF] osd.5 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:47:33.228 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.726863+0000 mon.a (mon.0) 749 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:33.229 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.727319+0000 mon.a (mon.0) 750 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:33.229 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.727821+0000 mon.a (mon.0) 751 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:33.229 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: audit 2020-06-27T04:47:32.728159+0000 mon.a (mon.0) 752 : audit [INF] from='osd.1 v2:172.21.15.31:6804/3247359993' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:47:33.229 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.728709+0000 mon.a (mon.0) 753 : cluster [DBG] osd.7 reported immediately failed by osd.0 2020-06-27T04:47:33.229 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.728750+0000 mon.a (mon.0) 754 : cluster [INF] osd.7 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:47:33.230 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.729021+0000 mon.a (mon.0) 755 : cluster [DBG] osd.7 reported immediately failed by osd.0 2020-06-27T04:47:33.230 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: audit 2020-06-27T04:47:32.729197+0000 mon.a (mon.0) 756 : audit [INF] from='osd.1 v2:172.21.15.31:6804/3247359993' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:33.235 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: audit 2020-06-27T04:47:32.729755+0000 mon.a (mon.0) 757 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:47:33.235 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.731351+0000 mon.a (mon.0) 758 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:33.235 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.731557+0000 mon.a (mon.0) 759 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:33.235 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.731723+0000 mon.a (mon.0) 760 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:33.236 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.731840+0000 mon.a (mon.0) 761 : cluster [DBG] osd.7 reported immediately failed by osd.4 2020-06-27T04:47:33.236 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.731971+0000 mon.a (mon.0) 762 : cluster [DBG] osd.7 reported immediately failed by osd.4 2020-06-27T04:47:33.236 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.732108+0000 mon.a (mon.0) 763 : cluster [DBG] osd.7 reported immediately failed by osd.6 2020-06-27T04:47:33.236 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.732235+0000 mon.a (mon.0) 764 : cluster [DBG] osd.7 reported immediately failed by osd.6 2020-06-27T04:47:33.236 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.732366+0000 mon.a (mon.0) 765 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:33.236 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.732595+0000 mon.a (mon.0) 766 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:33.237 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: audit 2020-06-27T04:47:32.732601+0000 mon.c (mon.1) 52 : audit [INF] from='osd.2 v2:172.21.15.31:6808/1535516093' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:33.237 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.732745+0000 mon.a (mon.0) 767 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:33.237 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.732926+0000 mon.a (mon.0) 768 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:33.237 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.733234+0000 mon.a (mon.0) 769 : cluster [DBG] osd.7 reported immediately failed by osd.6 2020-06-27T04:47:33.237 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: audit 2020-06-27T04:47:32.733445+0000 mon.a (mon.0) 770 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:33.238 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.733788+0000 mon.a (mon.0) 771 : cluster [DBG] osd.7 reported immediately failed by osd.6 2020-06-27T04:47:33.238 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.733948+0000 mon.a (mon.0) 772 : cluster [DBG] osd.7 reported immediately failed by osd.4 2020-06-27T04:47:33.238 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.734076+0000 mon.a (mon.0) 773 : cluster [DBG] osd.7 reported immediately failed by osd.4 2020-06-27T04:47:33.238 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:31.190656+0000 mgr.x (mgr.34109) 230 : cluster [DBG] pgmap v229: 865 pgs: 10 creating+peering, 29 peering, 4 down, 2 stale+active+clean, 64 unknown, 22 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 7 creating+incomplete, 199 active+undersized, 45 active+undersized+degraded, 7 stale+active+undersized+degraded, 48 undersized+degraded+peered, 46 active+clean, 69 stale+undersized+peered, 264 undersized+peered, 37 stale+active+undersized, 2 stale+creating+incomplete; 18 KiB data, 8.0 MiB used, 707 GiB / 715 GiB avail; 511 B/s rd, 0 B/s wr, 1 op/s; 476/999 objects degraded (47.648%); 95 B/s, 0 objects/s recovering 2020-06-27T04:47:33.239 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: audit 2020-06-27T04:47:31.806899+0000 mon.a (mon.0) 743 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-3","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:33.239 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:31.807364+0000 mon.a (mon.0) 744 : cluster [DBG] osdmap e85: 8 total, 5 up, 8 in 2020-06-27T04:47:33.239 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:31.812418+0000 mon.a (mon.0) 745 : cluster [WRN] Health check update: Reduced data availability: 22 pgs inactive, 7 pgs down, 9 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:47:33.239 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: audit 2020-06-27T04:47:31.815651+0000 mon.a (mon.0) 746 : audit [INF] from='client.? 172.21.15.31:0/4287042902' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:33.239 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: audit 2020-06-27T04:47:32.353949+0000 mon.c (mon.1) 51 : audit [INF] from='osd.2 v2:172.21.15.31:6808/1535516093' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:47:33.239 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.726051+0000 mon.a (mon.0) 747 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:33.240 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.726090+0000 mon.a (mon.0) 748 : cluster [INF] osd.5 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:47:33.242 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.726863+0000 mon.a (mon.0) 749 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:33.242 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.727319+0000 mon.a (mon.0) 750 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:33.242 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.727821+0000 mon.a (mon.0) 751 : cluster [DBG] osd.5 reported immediately failed by osd.0 2020-06-27T04:47:33.242 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: audit 2020-06-27T04:47:32.728159+0000 mon.a (mon.0) 752 : audit [INF] from='osd.1 v2:172.21.15.31:6804/3247359993' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:47:33.242 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.728709+0000 mon.a (mon.0) 753 : cluster [DBG] osd.7 reported immediately failed by osd.0 2020-06-27T04:47:33.243 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.728750+0000 mon.a (mon.0) 754 : cluster [INF] osd.7 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:47:33.243 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.729021+0000 mon.a (mon.0) 755 : cluster [DBG] osd.7 reported immediately failed by osd.0 2020-06-27T04:47:33.243 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: audit 2020-06-27T04:47:32.729197+0000 mon.a (mon.0) 756 : audit [INF] from='osd.1 v2:172.21.15.31:6804/3247359993' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:33.243 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: audit 2020-06-27T04:47:32.729755+0000 mon.a (mon.0) 757 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:47:33.243 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.731351+0000 mon.a (mon.0) 758 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:33.244 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.731557+0000 mon.a (mon.0) 759 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:33.244 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.731723+0000 mon.a (mon.0) 760 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:33.244 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.731840+0000 mon.a (mon.0) 761 : cluster [DBG] osd.7 reported immediately failed by osd.4 2020-06-27T04:47:33.244 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.731971+0000 mon.a (mon.0) 762 : cluster [DBG] osd.7 reported immediately failed by osd.4 2020-06-27T04:47:33.244 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.732108+0000 mon.a (mon.0) 763 : cluster [DBG] osd.7 reported immediately failed by osd.6 2020-06-27T04:47:33.245 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.732235+0000 mon.a (mon.0) 764 : cluster [DBG] osd.7 reported immediately failed by osd.6 2020-06-27T04:47:33.245 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.732366+0000 mon.a (mon.0) 765 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:33.245 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.732595+0000 mon.a (mon.0) 766 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:33.245 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: audit 2020-06-27T04:47:32.732601+0000 mon.c (mon.1) 52 : audit [INF] from='osd.2 v2:172.21.15.31:6808/1535516093' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:33.245 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.732745+0000 mon.a (mon.0) 767 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:33.245 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.732926+0000 mon.a (mon.0) 768 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:33.246 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.733234+0000 mon.a (mon.0) 769 : cluster [DBG] osd.7 reported immediately failed by osd.6 2020-06-27T04:47:33.246 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: audit 2020-06-27T04:47:32.733445+0000 mon.a (mon.0) 770 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:33.246 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.733788+0000 mon.a (mon.0) 771 : cluster [DBG] osd.7 reported immediately failed by osd.6 2020-06-27T04:47:33.246 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.733948+0000 mon.a (mon.0) 772 : cluster [DBG] osd.7 reported immediately failed by osd.4 2020-06-27T04:47:33.247 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:32 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.734076+0000 mon.a (mon.0) 773 : cluster [DBG] osd.7 reported immediately failed by osd.4 2020-06-27T04:47:34.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:33 smithi051 bash[18409]: audit 2020-06-27T04:47:32.808148+0000 mon.b (mon.2) 274 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:47:34.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:33 smithi051 bash[18409]: audit 2020-06-27T04:47:32.808306+0000 mon.b (mon.2) 275 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:47:34.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:33 smithi051 bash[18409]: audit 2020-06-27T04:47:32.808830+0000 mon.a (mon.0) 774 : audit [INF] from='client.? 172.21.15.31:0/4287042902' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-3","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:34.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:33 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.809179+0000 mon.a (mon.0) 775 : cluster [INF] osd.1 v2:172.21.15.31:6804/3247359993 boot 2020-06-27T04:47:34.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:33 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.809285+0000 mon.a (mon.0) 776 : cluster [INF] osd.2 v2:172.21.15.31:6808/1535516093 boot 2020-06-27T04:47:34.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:33 smithi051 bash[18409]: cluster 2020-06-27T04:47:32.809325+0000 mon.a (mon.0) 777 : cluster [DBG] osdmap e86: 8 total, 5 up, 8 in 2020-06-27T04:47:34.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:33 smithi051 bash[18409]: audit 2020-06-27T04:47:32.810204+0000 mon.c (mon.1) 53 : audit [INF] from='client.? 172.21.15.31:0/14122093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:34.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:33 smithi051 bash[18409]: audit 2020-06-27T04:47:32.822468+0000 mon.a (mon.0) 778 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:34.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:33 smithi051 bash[18409]: audit 2020-06-27T04:47:32.827338+0000 mon.a (mon.0) 779 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:34.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:33 smithi051 bash[18409]: audit 2020-06-27T04:47:32.885906+0000 mon.c (mon.1) 54 : audit [INF] from='osd.3 v2:172.21.15.31:6812/859187411' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:47:34.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:33 smithi051 bash[18409]: audit 2020-06-27T04:47:33.380570+0000 mon.a (mon.0) 780 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:47:34.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:33 smithi051 bash[18409]: audit 2020-06-27T04:47:33.381317+0000 mon.c (mon.1) 55 : audit [INF] from='osd.3 v2:172.21.15.31:6812/859187411' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:34.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:33 smithi051 bash[18409]: audit 2020-06-27T04:47:33.383215+0000 mon.a (mon.0) 781 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:34.221 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:33 smithi051 podman[33644]: 2020-06-27 04:47:33.911256355 +0000 UTC m=+7.743916942 container remove b26656bd12a50e67b834e5f2f0631658d3958aef7adf709a0054d8a67801fe80 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:47:34.222 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:33 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:47:34.222 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:34 smithi051 podman[33601]: 2020-06-27 04:47:34.01334437 +0000 UTC m=+8.103554220 container remove 857a8d7b9a2ff98916ac27b1070e3a875b6bd7d8bd6532dc477018358b158d9a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:47:34.222 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:34 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:47:34.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[18426]: audit 2020-06-27T04:47:32.808148+0000 mon.b (mon.2) 274 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:47:34.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[18426]: audit 2020-06-27T04:47:32.808306+0000 mon.b (mon.2) 275 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:47:34.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[18426]: audit 2020-06-27T04:47:32.808830+0000 mon.a (mon.0) 774 : audit [INF] from='client.? 172.21.15.31:0/4287042902' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-3","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:34.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.809179+0000 mon.a (mon.0) 775 : cluster [INF] osd.1 v2:172.21.15.31:6804/3247359993 boot 2020-06-27T04:47:34.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.809285+0000 mon.a (mon.0) 776 : cluster [INF] osd.2 v2:172.21.15.31:6808/1535516093 boot 2020-06-27T04:47:34.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[18426]: cluster 2020-06-27T04:47:32.809325+0000 mon.a (mon.0) 777 : cluster [DBG] osdmap e86: 8 total, 5 up, 8 in 2020-06-27T04:47:34.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[18426]: audit 2020-06-27T04:47:32.810204+0000 mon.c (mon.1) 53 : audit [INF] from='client.? 172.21.15.31:0/14122093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:34.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[18426]: audit 2020-06-27T04:47:32.822468+0000 mon.a (mon.0) 778 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:34.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[18426]: audit 2020-06-27T04:47:32.827338+0000 mon.a (mon.0) 779 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:34.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[18426]: audit 2020-06-27T04:47:32.885906+0000 mon.c (mon.1) 54 : audit [INF] from='osd.3 v2:172.21.15.31:6812/859187411' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:47:34.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[18426]: audit 2020-06-27T04:47:33.380570+0000 mon.a (mon.0) 780 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:47:34.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[18426]: audit 2020-06-27T04:47:33.381317+0000 mon.c (mon.1) 55 : audit [INF] from='osd.3 v2:172.21.15.31:6812/859187411' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:34.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[18426]: audit 2020-06-27T04:47:33.383215+0000 mon.a (mon.0) 781 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:34.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[22603]: audit 2020-06-27T04:47:32.808148+0000 mon.b (mon.2) 274 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:47:34.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[22603]: audit 2020-06-27T04:47:32.808306+0000 mon.b (mon.2) 275 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:47:34.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[22603]: audit 2020-06-27T04:47:32.808830+0000 mon.a (mon.0) 774 : audit [INF] from='client.? 172.21.15.31:0/4287042902' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-3","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:34.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.809179+0000 mon.a (mon.0) 775 : cluster [INF] osd.1 v2:172.21.15.31:6804/3247359993 boot 2020-06-27T04:47:34.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.809285+0000 mon.a (mon.0) 776 : cluster [INF] osd.2 v2:172.21.15.31:6808/1535516093 boot 2020-06-27T04:47:34.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[22603]: cluster 2020-06-27T04:47:32.809325+0000 mon.a (mon.0) 777 : cluster [DBG] osdmap e86: 8 total, 5 up, 8 in 2020-06-27T04:47:34.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[22603]: audit 2020-06-27T04:47:32.810204+0000 mon.c (mon.1) 53 : audit [INF] from='client.? 172.21.15.31:0/14122093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:34.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[22603]: audit 2020-06-27T04:47:32.822468+0000 mon.a (mon.0) 778 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:34.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[22603]: audit 2020-06-27T04:47:32.827338+0000 mon.a (mon.0) 779 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:34.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[22603]: audit 2020-06-27T04:47:32.885906+0000 mon.c (mon.1) 54 : audit [INF] from='osd.3 v2:172.21.15.31:6812/859187411' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:47:34.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[22603]: audit 2020-06-27T04:47:33.380570+0000 mon.a (mon.0) 780 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:47:34.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[22603]: audit 2020-06-27T04:47:33.381317+0000 mon.c (mon.1) 55 : audit [INF] from='osd.3 v2:172.21.15.31:6812/859187411' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:34.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:33 smithi031 bash[22603]: audit 2020-06-27T04:47:33.383215+0000 mon.a (mon.0) 781 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:34.381 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "ceph_version": "ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev)", 2020-06-27T04:47:34.382 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "ceph_version_short": "16.0.0-2978-g77ddaecfcb0", 2020-06-27T04:47:34.382 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "container_hostname": "smithi031", 2020-06-27T04:47:34.382 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "container_image": "quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5", 2020-06-27T04:47:34.382 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-06-27T04:47:34.382 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "distro": "centos", 2020-06-27T04:47:34.383 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "distro_description": "CentOS Linux 8 (Core)", 2020-06-27T04:47:34.383 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "distro_version": "8", 2020-06-27T04:47:34.383 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "frontend_config#0": "beast port=80", 2020-06-27T04:47:34.383 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "frontend_type#0": "beast", 2020-06-27T04:47:34.383 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "hostname": "smithi031", 2020-06-27T04:47:34.384 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "kernel_description": "#1 SMP Wed Jun 10 11:09:32 UTC 2020", 2020-06-27T04:47:34.384 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "kernel_version": "4.18.0-193.6.3.el8_2.x86_64", 2020-06-27T04:47:34.384 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "mem_swap_kb": "0", 2020-06-27T04:47:34.384 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "mem_total_kb": "32659352", 2020-06-27T04:47:34.384 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "num_handles": "1", 2020-06-27T04:47:34.384 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "os": "Linux", 2020-06-27T04:47:34.385 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "pid": "1", 2020-06-27T04:47:34.385 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "zone_id": "2170d6b9-4c2b-4044-aea7-e8f368afbe30", 2020-06-27T04:47:34.385 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "zone_name": "zone", 2020-06-27T04:47:34.385 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "zonegroup_id": "056f2207-b25d-4454-ba77-b8f232cd23bd", 2020-06-27T04:47:34.385 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "zonegroup_name": "default" 2020-06-27T04:47:34.386 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: }, 2020-06-27T04:47:34.386 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: "task_status": {} 2020-06-27T04:47:34.386 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: } 2020-06-27T04:47:34.386 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: } 2020-06-27T04:47:34.386 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: } 2020-06-27T04:47:34.386 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: } 2020-06-27T04:47:34.387 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: } 2020-06-27T04:47:34.387 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: 2020-06-27T04:47:34.387 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: attempt 1 of 20 2020-06-27T04:47:34.387 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (10467 ms) 2020-06-27T04:47:34.387 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (36959 ms total) 2020-06-27T04:47:34.388 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: 2020-06-27T04:47:34.388 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: [----------] Global test environment tear-down 2020-06-27T04:47:34.388 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (36959 ms total) 2020-06-27T04:47:34.388 INFO:tasks.workunit.client.0.smithi031.stdout: api_service_pp: [ PASSED ] 4 tests. 2020-06-27T04:47:34.554 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:34 smithi051 podman[34453]: 2020-06-27 04:47:34.289891732 +0000 UTC m=+0.354778829 container create e1dd8b4c09f8b7b04bfce869b0fe58d7b3a1ad06114f9c54654aeac05cab4c3c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:47:34.555 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:34 smithi051 podman[34468]: 2020-06-27 04:47:34.471401123 +0000 UTC m=+0.427454854 container create 2fbe9febef6c5d47ae4db5bd12cb52e46015ea0c29d70aa736ccb1d5dd151e77 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:47:34.831 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:34 smithi051 podman[34453]: 2020-06-27 04:47:34.56309101 +0000 UTC m=+0.627978140 container init e1dd8b4c09f8b7b04bfce869b0fe58d7b3a1ad06114f9c54654aeac05cab4c3c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:47:34.832 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:34 smithi051 podman[34453]: 2020-06-27 04:47:34.596376648 +0000 UTC m=+0.661263666 container start e1dd8b4c09f8b7b04bfce869b0fe58d7b3a1ad06114f9c54654aeac05cab4c3c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:47:34.832 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:34 smithi051 podman[34453]: 2020-06-27 04:47:34.596509512 +0000 UTC m=+0.661396559 container attach e1dd8b4c09f8b7b04bfce869b0fe58d7b3a1ad06114f9c54654aeac05cab4c3c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:47:34.832 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:34 smithi051 podman[34468]: 2020-06-27 04:47:34.629655447 +0000 UTC m=+0.585709202 container init 2fbe9febef6c5d47ae4db5bd12cb52e46015ea0c29d70aa736ccb1d5dd151e77 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:47:34.833 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:34 smithi051 podman[34468]: 2020-06-27 04:47:34.663027421 +0000 UTC m=+0.619081145 container start 2fbe9febef6c5d47ae4db5bd12cb52e46015ea0c29d70aa736ccb1d5dd151e77 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:47:34.833 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:34 smithi051 podman[34468]: 2020-06-27 04:47:34.663105151 +0000 UTC m=+0.619158906 container attach 2fbe9febef6c5d47ae4db5bd12cb52e46015ea0c29d70aa736ccb1d5dd151e77 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:47:35.116 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.117 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: in thread 7ff6dd1ad700 thread_name:tp_osd_tp 2020-06-27T04:47:35.117 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.117 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 1: (()+0x12dd0) [0x7ff6fd7a9dd0] 2020-06-27T04:47:35.117 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55ba79a3d707] 2020-06-27T04:47:35.118 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55ba79a3daa0] 2020-06-27T04:47:35.118 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55ba79a6f67a] 2020-06-27T04:47:35.118 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55ba79a70a57] 2020-06-27T04:47:35.118 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55ba796fb938] 2020-06-27T04:47:35.118 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55ba798afa70] 2020-06-27T04:47:35.119 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55ba798bfdd7] 2020-06-27T04:47:35.119 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55ba7972e252] 2020-06-27T04:47:35.119 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55ba796d1e2e] 2020-06-27T04:47:35.119 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55ba795524e9] 2020-06-27T04:47:35.119 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55ba797b6f78] 2020-06-27T04:47:35.120 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55ba7957170f] 2020-06-27T04:47:35.120 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55ba79bafb94] 2020-06-27T04:47:35.120 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55ba79bb27f4] 2020-06-27T04:47:35.120 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 16: (()+0x82de) [0x7ff6fd79f2de] 2020-06-27T04:47:35.120 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 17: (clone()+0x43) [0x7ff6fc4d6e83] 2020-06-27T04:47:35.121 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: debug 2020-06-27T04:47:35.092+0000 7ff6dd1ad700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.121 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: in thread 7ff6dd1ad700 thread_name:tp_osd_tp 2020-06-27T04:47:35.121 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.121 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 1: (()+0x12dd0) [0x7ff6fd7a9dd0] 2020-06-27T04:47:35.121 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55ba79a3d707] 2020-06-27T04:47:35.122 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55ba79a3daa0] 2020-06-27T04:47:35.122 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55ba79a6f67a] 2020-06-27T04:47:35.122 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55ba79a70a57] 2020-06-27T04:47:35.122 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55ba796fb938] 2020-06-27T04:47:35.122 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55ba798afa70] 2020-06-27T04:47:35.122 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55ba798bfdd7] 2020-06-27T04:47:35.123 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55ba7972e252] 2020-06-27T04:47:35.123 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55ba796d1e2e] 2020-06-27T04:47:35.123 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55ba795524e9] 2020-06-27T04:47:35.123 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55ba797b6f78] 2020-06-27T04:47:35.123 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55ba7957170f] 2020-06-27T04:47:35.124 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55ba79bafb94] 2020-06-27T04:47:35.124 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55ba79bb27f4] 2020-06-27T04:47:35.124 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 16: (()+0x82de) [0x7ff6fd79f2de] 2020-06-27T04:47:35.124 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 17: (clone()+0x43) [0x7ff6fc4d6e83] 2020-06-27T04:47:35.124 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:35.125 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.125 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: in thread 7f7079a74700 thread_name:tp_osd_tp 2020-06-27T04:47:35.125 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.125 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 1: (()+0x12dd0) [0x7f709c875dd0] 2020-06-27T04:47:35.125 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55ae20793707] 2020-06-27T04:47:35.126 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55ae20793aa0] 2020-06-27T04:47:35.126 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55ae207c567a] 2020-06-27T04:47:35.126 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55ae207c6a57] 2020-06-27T04:47:35.126 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55ae20451938] 2020-06-27T04:47:35.126 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55ae20605a70] 2020-06-27T04:47:35.126 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55ae20615dd7] 2020-06-27T04:47:35.127 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55ae20484252] 2020-06-27T04:47:35.127 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55ae20427e2e] 2020-06-27T04:47:35.127 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55ae202a84e9] 2020-06-27T04:47:35.127 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55ae2050cf78] 2020-06-27T04:47:35.127 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55ae202c770f] 2020-06-27T04:47:35.128 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55ae20905b94] 2020-06-27T04:47:35.128 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55ae209087f4] 2020-06-27T04:47:35.128 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 16: (()+0x82de) [0x7f709c86b2de] 2020-06-27T04:47:35.128 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 17: (clone()+0x43) [0x7f709b5a2e83] 2020-06-27T04:47:35.128 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: debug 2020-06-27T04:47:34.937+0000 7f7079a74700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.129 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: in thread 7f7079a74700 thread_name:tp_osd_tp 2020-06-27T04:47:35.129 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.129 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 1: (()+0x12dd0) [0x7f709c875dd0] 2020-06-27T04:47:35.129 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55ae20793707] 2020-06-27T04:47:35.129 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55ae20793aa0] 2020-06-27T04:47:35.129 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55ae207c567a] 2020-06-27T04:47:35.130 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55ae207c6a57] 2020-06-27T04:47:35.130 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55ae20451938] 2020-06-27T04:47:35.130 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55ae20605a70] 2020-06-27T04:47:35.130 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55ae20615dd7] 2020-06-27T04:47:35.130 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55ae20484252] 2020-06-27T04:47:35.131 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55ae20427e2e] 2020-06-27T04:47:35.131 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55ae202a84e9] 2020-06-27T04:47:35.131 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55ae2050cf78] 2020-06-27T04:47:35.131 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55ae202c770f] 2020-06-27T04:47:35.131 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55ae20905b94] 2020-06-27T04:47:35.132 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55ae209087f4] 2020-06-27T04:47:35.132 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 16: (()+0x82de) [0x7f709c86b2de] 2020-06-27T04:47:35.132 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 17: (clone()+0x43) [0x7f709b5a2e83] 2020-06-27T04:47:35.132 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:35.132 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: debug -346> 2020-06-27T04:47:34.937+0000 7f7079a74700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.132 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: in thread 7f7079a74700 thread_name:tp_osd_tp 2020-06-27T04:47:35.133 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.133 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 1: (()+0x12dd0) [0x7f709c875dd0] 2020-06-27T04:47:35.133 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55ae20793707] 2020-06-27T04:47:35.133 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55ae20793aa0] 2020-06-27T04:47:35.133 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55ae207c567a] 2020-06-27T04:47:35.135 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55ae207c6a57] 2020-06-27T04:47:35.135 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55ae20451938] 2020-06-27T04:47:35.135 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55ae20605a70] 2020-06-27T04:47:35.135 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55ae20615dd7] 2020-06-27T04:47:35.136 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55ae20484252] 2020-06-27T04:47:35.136 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55ae20427e2e] 2020-06-27T04:47:35.136 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55ae202a84e9] 2020-06-27T04:47:35.136 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55ae2050cf78] 2020-06-27T04:47:35.136 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55ae202c770f] 2020-06-27T04:47:35.136 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55ae20905b94] 2020-06-27T04:47:35.137 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55ae209087f4] 2020-06-27T04:47:35.137 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 16: (()+0x82de) [0x7f709c86b2de] 2020-06-27T04:47:35.137 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 17: (clone()+0x43) [0x7f709b5a2e83] 2020-06-27T04:47:35.137 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:35.137 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: debug -9999> 2020-06-27T04:47:34.937+0000 7f7079a74700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.138 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: in thread 7f7079a74700 thread_name:tp_osd_tp 2020-06-27T04:47:35.138 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.138 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 1: (()+0x12dd0) [0x7f709c875dd0] 2020-06-27T04:47:35.138 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55ae20793707] 2020-06-27T04:47:35.138 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55ae20793aa0] 2020-06-27T04:47:35.139 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55ae207c567a] 2020-06-27T04:47:35.139 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55ae207c6a57] 2020-06-27T04:47:35.139 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55ae20451938] 2020-06-27T04:47:35.139 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55ae20605a70] 2020-06-27T04:47:35.139 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55ae20615dd7] 2020-06-27T04:47:35.139 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55ae20484252] 2020-06-27T04:47:35.140 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55ae20427e2e] 2020-06-27T04:47:35.140 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55ae202a84e9] 2020-06-27T04:47:35.140 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55ae2050cf78] 2020-06-27T04:47:35.140 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55ae202c770f] 2020-06-27T04:47:35.140 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55ae20905b94] 2020-06-27T04:47:35.141 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55ae209087f4] 2020-06-27T04:47:35.141 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 16: (()+0x82de) [0x7f709c86b2de] 2020-06-27T04:47:35.141 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: 17: (clone()+0x43) [0x7f709b5a2e83] 2020-06-27T04:47:35.141 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:35.141 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[25253]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:47:35.142 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:35 smithi031 podman[25580]: 2020-06-27 04:47:35.047561317 +0000 UTC m=+305.245914581 container died bf7312b7e1fcc1242bb382d2e29d4f1fe05d5d106a92f24fa770ff816962b70f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:47:35.142 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.142 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: in thread 7f8824611700 thread_name:tp_osd_tp 2020-06-27T04:47:35.142 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.142 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 1: (()+0x12dd0) [0x7f8848c15dd0] 2020-06-27T04:47:35.143 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55fbef6d5707] 2020-06-27T04:47:35.143 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55fbef6d5aa0] 2020-06-27T04:47:35.143 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55fbef70767a] 2020-06-27T04:47:35.143 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55fbef708a57] 2020-06-27T04:47:35.143 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55fbef393938] 2020-06-27T04:47:35.144 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55fbef547a70] 2020-06-27T04:47:35.144 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55fbef557dd7] 2020-06-27T04:47:35.144 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55fbef3c6252] 2020-06-27T04:47:35.144 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55fbef369e2e] 2020-06-27T04:47:35.144 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55fbef1ea4e9] 2020-06-27T04:47:35.144 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55fbef44ef78] 2020-06-27T04:47:35.145 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55fbef20970f] 2020-06-27T04:47:35.145 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55fbef847b94] 2020-06-27T04:47:35.145 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55fbef84a7f4] 2020-06-27T04:47:35.145 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 16: (()+0x82de) [0x7f8848c0b2de] 2020-06-27T04:47:35.145 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 17: (clone()+0x43) [0x7f8847942e83] 2020-06-27T04:47:35.146 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: debug 2020-06-27T04:47:35.091+0000 7f8824611700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.146 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: in thread 7f8824611700 thread_name:tp_osd_tp 2020-06-27T04:47:35.146 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.146 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 1: (()+0x12dd0) [0x7f8848c15dd0] 2020-06-27T04:47:35.146 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55fbef6d5707] 2020-06-27T04:47:35.146 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55fbef6d5aa0] 2020-06-27T04:47:35.148 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55fbef70767a] 2020-06-27T04:47:35.148 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55fbef708a57] 2020-06-27T04:47:35.148 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55fbef393938] 2020-06-27T04:47:35.149 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55fbef547a70] 2020-06-27T04:47:35.149 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55fbef557dd7] 2020-06-27T04:47:35.149 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55fbef3c6252] 2020-06-27T04:47:35.149 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55fbef369e2e] 2020-06-27T04:47:35.149 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55fbef1ea4e9] 2020-06-27T04:47:35.150 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55fbef44ef78] 2020-06-27T04:47:35.150 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55fbef20970f] 2020-06-27T04:47:35.150 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55fbef847b94] 2020-06-27T04:47:35.150 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55fbef84a7f4] 2020-06-27T04:47:35.151 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 16: (()+0x82de) [0x7f8848c0b2de] 2020-06-27T04:47:35.151 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 17: (clone()+0x43) [0x7f8847942e83] 2020-06-27T04:47:35.151 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:35.151 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: debug 0> 2020-06-27T04:47:35.091+0000 7f8824611700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.151 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: in thread 7f8824611700 thread_name:tp_osd_tp 2020-06-27T04:47:35.151 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.152 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 1: (()+0x12dd0) [0x7f8848c15dd0] 2020-06-27T04:47:35.152 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55fbef6d5707] 2020-06-27T04:47:35.152 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55fbef6d5aa0] 2020-06-27T04:47:35.152 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55fbef70767a] 2020-06-27T04:47:35.152 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55fbef708a57] 2020-06-27T04:47:35.153 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55fbef393938] 2020-06-27T04:47:35.153 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55fbef547a70] 2020-06-27T04:47:35.153 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55fbef557dd7] 2020-06-27T04:47:35.153 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55fbef3c6252] 2020-06-27T04:47:35.153 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55fbef369e2e] 2020-06-27T04:47:35.154 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55fbef1ea4e9] 2020-06-27T04:47:35.154 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55fbef44ef78] 2020-06-27T04:47:35.154 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55fbef20970f] 2020-06-27T04:47:35.154 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55fbef847b94] 2020-06-27T04:47:35.154 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55fbef84a7f4] 2020-06-27T04:47:35.155 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 16: (()+0x82de) [0x7f8848c0b2de] 2020-06-27T04:47:35.155 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 17: (clone()+0x43) [0x7f8847942e83] 2020-06-27T04:47:35.155 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:35.155 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[22603]: cluster 2020-06-27T04:47:33.191577+0000 mgr.x (mgr.34109) 231 : cluster [DBG] pgmap v232: 865 pgs: 5 activating+undersized, 7 creating+peering, 27 peering, 4 down, 2 stale+active+clean, 106 unknown, 11 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 7 creating+incomplete, 196 active+undersized, 45 active+undersized+degraded, 7 stale+active+undersized+degraded, 51 undersized+degraded+peered, 68 active+clean, 38 stale+undersized+peered, 246 undersized+peered, 34 stale+active+undersized, 1 stale+creating+incomplete; 18 KiB data, 8.5 MiB used, 707 GiB / 715 GiB avail; 511 B/s rd, 0 B/s wr, 1 op/s; 452/999 objects degraded (45.245%); 153 B/s, 0 objects/s recovering 2020-06-27T04:47:35.155 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[22603]: cluster 2020-06-27T04:47:33.819583+0000 mon.a (mon.0) 782 : cluster [WRN] Health check update: 2 osds down (OSD_DOWN) 2020-06-27T04:47:35.156 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[22603]: audit 2020-06-27T04:47:33.828088+0000 mon.a (mon.0) 783 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-8","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:35.156 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[22603]: audit 2020-06-27T04:47:33.828452+0000 mon.a (mon.0) 784 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:35.156 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[22603]: cluster 2020-06-27T04:47:33.828645+0000 mon.a (mon.0) 785 : cluster [INF] osd.3 v2:172.21.15.31:6812/859187411 boot 2020-06-27T04:47:35.156 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[22603]: cluster 2020-06-27T04:47:33.828684+0000 mon.a (mon.0) 786 : cluster [DBG] osdmap e87: 8 total, 6 up, 8 in 2020-06-27T04:47:35.157 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[22603]: audit 2020-06-27T04:47:33.835055+0000 mon.a (mon.0) 787 : audit [INF] from='client.? 172.21.15.31:0/3600122411' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:35.157 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[22603]: audit 2020-06-27T04:47:33.876275+0000 mon.b (mon.2) 276 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:47:35.158 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[22603]: audit 2020-06-27T04:47:34.375683+0000 mon.c (mon.1) 56 : audit [DBG] from='client.? 172.21.15.31:0/1317656668' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2020-06-27T04:47:35.158 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.158 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: in thread 7ff1455de700 thread_name:tp_osd_tp 2020-06-27T04:47:35.158 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.158 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 1: (()+0x12dd0) [0x7ff165bdadd0] 2020-06-27T04:47:35.159 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55b05c232707] 2020-06-27T04:47:35.159 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55b05c232aa0] 2020-06-27T04:47:35.159 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55b05c26467a] 2020-06-27T04:47:35.159 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55b05c265a57] 2020-06-27T04:47:35.159 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55b05bef0938] 2020-06-27T04:47:35.160 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55b05c0a103d] 2020-06-27T04:47:35.160 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55b05be5e5b0] 2020-06-27T04:47:35.160 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55b05beb789d] 2020-06-27T04:47:35.160 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55b05bec0380] 2020-06-27T04:47:35.160 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55b05bec7590] 2020-06-27T04:47:35.161 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55b05bd474e9] 2020-06-27T04:47:35.161 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55b05bfabf78] 2020-06-27T04:47:35.161 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55b05bd6670f] 2020-06-27T04:47:35.161 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55b05c3a4b94] 2020-06-27T04:47:35.161 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55b05c3a77f4] 2020-06-27T04:47:35.162 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 17: (()+0x82de) [0x7ff165bd02de] 2020-06-27T04:47:35.162 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 18: (clone()+0x43) [0x7ff164907e83] 2020-06-27T04:47:35.162 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: debug 2020-06-27T04:47:35.095+0000 7ff1455de700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.162 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: in thread 7ff1455de700 thread_name:tp_osd_tp 2020-06-27T04:47:35.170 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.170 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 1: (()+0x12dd0) [0x7ff165bdadd0] 2020-06-27T04:47:35.170 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55b05c232707] 2020-06-27T04:47:35.171 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55b05c232aa0] 2020-06-27T04:47:35.171 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55b05c26467a] 2020-06-27T04:47:35.171 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55b05c265a57] 2020-06-27T04:47:35.171 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55b05bef0938] 2020-06-27T04:47:35.171 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55b05c0a103d] 2020-06-27T04:47:35.172 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55b05be5e5b0] 2020-06-27T04:47:35.172 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55b05beb789d] 2020-06-27T04:47:35.172 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55b05bec0380] 2020-06-27T04:47:35.172 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55b05bec7590] 2020-06-27T04:47:35.172 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55b05bd474e9] 2020-06-27T04:47:35.173 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55b05bfabf78] 2020-06-27T04:47:35.173 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55b05bd6670f] 2020-06-27T04:47:35.173 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55b05c3a4b94] 2020-06-27T04:47:35.173 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55b05c3a77f4] 2020-06-27T04:47:35.173 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 17: (()+0x82de) [0x7ff165bd02de] 2020-06-27T04:47:35.173 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 18: (clone()+0x43) [0x7ff164907e83] 2020-06-27T04:47:35.174 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:35.174 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[18426]: cluster 2020-06-27T04:47:33.191577+0000 mgr.x (mgr.34109) 231 : cluster [DBG] pgmap v232: 865 pgs: 5 activating+undersized, 7 creating+peering, 27 peering, 4 down, 2 stale+active+clean, 106 unknown, 11 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 7 creating+incomplete, 196 active+undersized, 45 active+undersized+degraded, 7 stale+active+undersized+degraded, 51 undersized+degraded+peered, 68 active+clean, 38 stale+undersized+peered, 246 undersized+peered, 34 stale+active+undersized, 1 stale+creating+incomplete; 18 KiB data, 8.5 MiB used, 707 GiB / 715 GiB avail; 511 B/s rd, 0 B/s wr, 1 op/s; 452/999 objects degraded (45.245%); 153 B/s, 0 objects/s recovering 2020-06-27T04:47:35.174 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[18426]: cluster 2020-06-27T04:47:33.819583+0000 mon.a (mon.0) 782 : cluster [WRN] Health check update: 2 osds down (OSD_DOWN) 2020-06-27T04:47:35.174 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[18426]: audit 2020-06-27T04:47:33.828088+0000 mon.a (mon.0) 783 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-8","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:35.175 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[18426]: audit 2020-06-27T04:47:33.828452+0000 mon.a (mon.0) 784 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:35.175 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[18426]: cluster 2020-06-27T04:47:33.828645+0000 mon.a (mon.0) 785 : cluster [INF] osd.3 v2:172.21.15.31:6812/859187411 boot 2020-06-27T04:47:35.175 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[18426]: cluster 2020-06-27T04:47:33.828684+0000 mon.a (mon.0) 786 : cluster [DBG] osdmap e87: 8 total, 6 up, 8 in 2020-06-27T04:47:35.175 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[18426]: audit 2020-06-27T04:47:33.835055+0000 mon.a (mon.0) 787 : audit [INF] from='client.? 172.21.15.31:0/3600122411' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:35.175 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[18426]: audit 2020-06-27T04:47:33.876275+0000 mon.b (mon.2) 276 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:47:35.176 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:34 smithi031 bash[18426]: audit 2020-06-27T04:47:34.375683+0000 mon.c (mon.1) 56 : audit [DBG] from='client.? 172.21.15.31:0/1317656668' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2020-06-27T04:47:35.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[18409]: cluster 2020-06-27T04:47:33.191577+0000 mgr.x (mgr.34109) 231 : cluster [DBG] pgmap v232: 865 pgs: 5 activating+undersized, 7 creating+peering, 27 peering, 4 down, 2 stale+active+clean, 106 unknown, 11 stale+undersized+degraded+peered, 3 creating+down, 7 stale+creating+peering, 7 creating+incomplete, 196 active+undersized, 45 active+undersized+degraded, 7 stale+active+undersized+degraded, 51 undersized+degraded+peered, 68 active+clean, 38 stale+undersized+peered, 246 undersized+peered, 34 stale+active+undersized, 1 stale+creating+incomplete; 18 KiB data, 8.5 MiB used, 707 GiB / 715 GiB avail; 511 B/s rd, 0 B/s wr, 1 op/s; 452/999 objects degraded (45.245%); 153 B/s, 0 objects/s recovering 2020-06-27T04:47:35.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[18409]: cluster 2020-06-27T04:47:33.819583+0000 mon.a (mon.0) 782 : cluster [WRN] Health check update: 2 osds down (OSD_DOWN) 2020-06-27T04:47:35.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[18409]: audit 2020-06-27T04:47:33.828088+0000 mon.a (mon.0) 783 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41327-8","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:35.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[18409]: audit 2020-06-27T04:47:33.828452+0000 mon.a (mon.0) 784 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:35.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[18409]: cluster 2020-06-27T04:47:33.828645+0000 mon.a (mon.0) 785 : cluster [INF] osd.3 v2:172.21.15.31:6812/859187411 boot 2020-06-27T04:47:35.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[18409]: cluster 2020-06-27T04:47:33.828684+0000 mon.a (mon.0) 786 : cluster [DBG] osdmap e87: 8 total, 6 up, 8 in 2020-06-27T04:47:35.223 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[18409]: audit 2020-06-27T04:47:33.835055+0000 mon.a (mon.0) 787 : audit [INF] from='client.? 172.21.15.31:0/3600122411' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:35.223 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[18409]: audit 2020-06-27T04:47:33.876275+0000 mon.b (mon.2) 276 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:47:35.223 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[18409]: audit 2020-06-27T04:47:34.375683+0000 mon.c (mon.1) 56 : audit [DBG] from='client.? 172.21.15.31:0/1317656668' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2020-06-27T04:47:35.223 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:34 smithi051 podman[34468]: 2020-06-27 04:47:34.957718787 +0000 UTC m=+0.913772534 container died 2fbe9febef6c5d47ae4db5bd12cb52e46015ea0c29d70aa736ccb1d5dd151e77 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:47:35.224 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.224 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: in thread 7fa274a76700 thread_name:tp_osd_tp 2020-06-27T04:47:35.224 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.224 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 1: (()+0x12dd0) [0x7fa29f887dd0] 2020-06-27T04:47:35.224 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x562e2c8ac707] 2020-06-27T04:47:35.225 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x562e2c8acaa0] 2020-06-27T04:47:35.225 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x562e2c8de67a] 2020-06-27T04:47:35.225 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x562e2c8dfa57] 2020-06-27T04:47:35.225 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x562e2c56a938] 2020-06-27T04:47:35.225 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x562e2c71b03d] 2020-06-27T04:47:35.226 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x562e2c4d85b0] 2020-06-27T04:47:35.226 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x562e2c53189d] 2020-06-27T04:47:35.226 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x562e2c53a380] 2020-06-27T04:47:35.226 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x562e2c541590] 2020-06-27T04:47:35.226 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x562e2c3c14e9] 2020-06-27T04:47:35.227 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x562e2c625f78] 2020-06-27T04:47:35.227 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x562e2c3e070f] 2020-06-27T04:47:35.227 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x562e2ca1eb94] 2020-06-27T04:47:35.227 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x562e2ca217f4] 2020-06-27T04:47:35.227 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 17: (()+0x82de) [0x7fa29f87d2de] 2020-06-27T04:47:35.227 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 18: (clone()+0x43) [0x7fa29e5b4e83] 2020-06-27T04:47:35.228 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: debug 2020-06-27T04:47:34.930+0000 7fa274a76700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.228 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: in thread 7fa274a76700 thread_name:tp_osd_tp 2020-06-27T04:47:35.228 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.228 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 1: (()+0x12dd0) [0x7fa29f887dd0] 2020-06-27T04:47:35.228 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x562e2c8ac707] 2020-06-27T04:47:35.229 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x562e2c8acaa0] 2020-06-27T04:47:35.229 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x562e2c8de67a] 2020-06-27T04:47:35.229 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x562e2c8dfa57] 2020-06-27T04:47:35.229 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x562e2c56a938] 2020-06-27T04:47:35.229 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x562e2c71b03d] 2020-06-27T04:47:35.230 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x562e2c4d85b0] 2020-06-27T04:47:35.230 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x562e2c53189d] 2020-06-27T04:47:35.230 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x562e2c53a380] 2020-06-27T04:47:35.230 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x562e2c541590] 2020-06-27T04:47:35.230 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x562e2c3c14e9] 2020-06-27T04:47:35.230 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x562e2c625f78] 2020-06-27T04:47:35.231 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x562e2c3e070f] 2020-06-27T04:47:35.231 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x562e2ca1eb94] 2020-06-27T04:47:35.231 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x562e2ca217f4] 2020-06-27T04:47:35.231 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 17: (()+0x82de) [0x7fa29f87d2de] 2020-06-27T04:47:35.231 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 18: (clone()+0x43) [0x7fa29e5b4e83] 2020-06-27T04:47:35.232 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:35.232 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: debug -250> 2020-06-27T04:47:34.930+0000 7fa274a76700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.232 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: in thread 7fa274a76700 thread_name:tp_osd_tp 2020-06-27T04:47:35.232 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.232 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 1: (()+0x12dd0) [0x7fa29f887dd0] 2020-06-27T04:47:35.232 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x562e2c8ac707] 2020-06-27T04:47:35.233 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x562e2c8acaa0] 2020-06-27T04:47:35.233 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x562e2c8de67a] 2020-06-27T04:47:35.233 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x562e2c8dfa57] 2020-06-27T04:47:35.233 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x562e2c56a938] 2020-06-27T04:47:35.238 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x562e2c71b03d] 2020-06-27T04:47:35.238 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x562e2c4d85b0] 2020-06-27T04:47:35.238 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x562e2c53189d] 2020-06-27T04:47:35.238 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x562e2c53a380] 2020-06-27T04:47:35.239 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x562e2c541590] 2020-06-27T04:47:35.239 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x562e2c3c14e9] 2020-06-27T04:47:35.239 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x562e2c625f78] 2020-06-27T04:47:35.240 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x562e2c3e070f] 2020-06-27T04:47:35.240 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x562e2ca1eb94] 2020-06-27T04:47:35.241 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x562e2ca217f4] 2020-06-27T04:47:35.241 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 17: (()+0x82de) [0x7fa29f87d2de] 2020-06-27T04:47:35.241 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 18: (clone()+0x43) [0x7fa29e5b4e83] 2020-06-27T04:47:35.241 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:35.241 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: debug -9999> 2020-06-27T04:47:34.930+0000 7fa274a76700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.242 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: in thread 7fa274a76700 thread_name:tp_osd_tp 2020-06-27T04:47:35.242 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.242 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 1: (()+0x12dd0) [0x7fa29f887dd0] 2020-06-27T04:47:35.242 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x562e2c8ac707] 2020-06-27T04:47:35.242 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x562e2c8acaa0] 2020-06-27T04:47:35.242 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x562e2c8de67a] 2020-06-27T04:47:35.243 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x562e2c8dfa57] 2020-06-27T04:47:35.243 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x562e2c56a938] 2020-06-27T04:47:35.243 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x562e2c71b03d] 2020-06-27T04:47:35.243 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x562e2c4d85b0] 2020-06-27T04:47:35.243 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x562e2c53189d] 2020-06-27T04:47:35.244 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x562e2c53a380] 2020-06-27T04:47:35.244 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x562e2c541590] 2020-06-27T04:47:35.244 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x562e2c3c14e9] 2020-06-27T04:47:35.244 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x562e2c625f78] 2020-06-27T04:47:35.244 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x562e2c3e070f] 2020-06-27T04:47:35.245 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x562e2ca1eb94] 2020-06-27T04:47:35.245 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x562e2ca217f4] 2020-06-27T04:47:35.245 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 17: (()+0x82de) [0x7fa29f87d2de] 2020-06-27T04:47:35.245 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 18: (clone()+0x43) [0x7fa29e5b4e83] 2020-06-27T04:47:35.245 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:35.245 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:47:35.246 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: terminate called after throwing an instance of 'boost::wrapexcept' 2020-06-27T04:47:35.246 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: what(): boost::bad_get: failed value get using boost::get 2020-06-27T04:47:35.246 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: *** Caught signal (Aborted) ** 2020-06-27T04:47:35.246 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: in thread 7fa27a281700 thread_name:tp_osd_tp 2020-06-27T04:47:35.246 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.247 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 1: (()+0x12dd0) [0x7fa29f887dd0] 2020-06-27T04:47:35.247 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 2: (gsignal()+0x10f) [0x7fa29e4f070f] 2020-06-27T04:47:35.247 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 3: (abort()+0x127) [0x7fa29e4dab25] 2020-06-27T04:47:35.247 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 4: (()+0x9006b) [0x7fa29eea506b] 2020-06-27T04:47:35.247 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 5: (()+0x9650c) [0x7fa29eeab50c] 2020-06-27T04:47:35.247 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 6: (()+0x96567) [0x7fa29eeab567] 2020-06-27T04:47:35.248 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 7: (()+0x967c8) [0x7fa29eeab7c8] 2020-06-27T04:47:35.248 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 8: (()+0x605433) [0x562e2c378433] 2020-06-27T04:47:35.248 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 9: (unsigned long const md_config_t::get_val(ConfigValues const&, std::basic_string_view >) const+0x91) [0x562e2c37cf21] 2020-06-27T04:47:35.248 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 10: (PeeringState::choose_async_recovery_replicated(std::map, std::allocator > > const&, pg_info_t const&, std::vector >*, std::set, std::allocator >*, std::shared_ptr) const+0x5cb) [0x562e2c6483ab] 2020-06-27T04:47:35.248 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 11: (PeeringState::choose_acting(pg_shard_t&, bool, bool*, bool)+0xbab) [0x562e2c64922b] 2020-06-27T04:47:35.249 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 12: (PeeringState::GetLog::GetLog(boost::statechart::state, (boost::statechart::history_mode)0>::my_context)+0x16c) [0x562e2c66ef0c] 2020-06-27T04:47:35.249 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 13: (boost::statechart::simple_state, (boost::statechart::history_mode)0>::react_impl(boost::statechart::event_base const&, void const*)+0x107) [0x562e2c699407] 2020-06-27T04:47:35.249 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 14: (boost::statechart::state_machine, boost::statechart::null_exception_translator>::process_event(boost::statechart::event_base const&)+0x167) [0x562e2c4888d7] 2020-06-27T04:47:35.252 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 15: (PG::do_peering_event(std::shared_ptr, PeeringCtx&)+0x2d1) [0x562e2c47b4b1] 2020-06-27T04:47:35.252 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 16: (OSD::dequeue_peering_evt(OSDShard*, PG*, std::shared_ptr, ThreadPool::TPHandle&)+0x29c) [0x562e2c3ed56c] 2020-06-27T04:47:35.252 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 17: (ceph::osd::scheduler::PGPeeringItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x56) [0x562e2c625e16] 2020-06-27T04:47:35.252 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 18: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x562e2c3e070f] 2020-06-27T04:47:35.253 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 19: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x562e2ca1eb94] 2020-06-27T04:47:35.253 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 20: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x562e2ca217f4] 2020-06-27T04:47:35.253 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 21: (()+0x82de) [0x7fa29f87d2de] 2020-06-27T04:47:35.253 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[25495]: 22: (clone()+0x43) [0x7fa29e5b4e83] 2020-06-27T04:47:35.254 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.254 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: in thread 7fac4c737700 thread_name:tp_osd_tp 2020-06-27T04:47:35.254 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.254 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 1: (()+0x12dd0) [0x7fac73540dd0] 2020-06-27T04:47:35.254 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5587fef10707] 2020-06-27T04:47:35.255 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5587fef10aa0] 2020-06-27T04:47:35.255 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5587fef4267a] 2020-06-27T04:47:35.255 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5587fef43a57] 2020-06-27T04:47:35.256 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5587febce938] 2020-06-27T04:47:35.257 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5587fed82a70] 2020-06-27T04:47:35.257 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5587fed92dd7] 2020-06-27T04:47:35.257 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5587fec01252] 2020-06-27T04:47:35.257 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5587feba4e2e] 2020-06-27T04:47:35.257 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5587fea254e9] 2020-06-27T04:47:35.258 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5587fec89f78] 2020-06-27T04:47:35.258 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5587fea4470f] 2020-06-27T04:47:35.258 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5587ff082b94] 2020-06-27T04:47:35.258 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5587ff0857f4] 2020-06-27T04:47:35.258 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 16: (()+0x82de) [0x7fac735362de] 2020-06-27T04:47:35.259 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 17: (clone()+0x43) [0x7fac7226de83] 2020-06-27T04:47:35.259 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: debug 2020-06-27T04:47:34.929+0000 7fac4c737700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.259 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: in thread 7fac4c737700 thread_name:tp_osd_tp 2020-06-27T04:47:35.259 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.259 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 1: (()+0x12dd0) [0x7fac73540dd0] 2020-06-27T04:47:35.259 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5587fef10707] 2020-06-27T04:47:35.260 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5587fef10aa0] 2020-06-27T04:47:35.260 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5587fef4267a] 2020-06-27T04:47:35.260 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5587fef43a57] 2020-06-27T04:47:35.260 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5587febce938] 2020-06-27T04:47:35.260 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5587fed82a70] 2020-06-27T04:47:35.261 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5587fed92dd7] 2020-06-27T04:47:35.261 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5587fec01252] 2020-06-27T04:47:35.261 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5587feba4e2e] 2020-06-27T04:47:35.263 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5587fea254e9] 2020-06-27T04:47:35.263 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5587fec89f78] 2020-06-27T04:47:35.263 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5587fea4470f] 2020-06-27T04:47:35.263 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5587ff082b94] 2020-06-27T04:47:35.264 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5587ff0857f4] 2020-06-27T04:47:35.264 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 16: (()+0x82de) [0x7fac735362de] 2020-06-27T04:47:35.264 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 17: (clone()+0x43) [0x7fac7226de83] 2020-06-27T04:47:35.266 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:35.266 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: debug 0> 2020-06-27T04:47:34.929+0000 7fac4c737700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.266 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: in thread 7fac4c737700 thread_name:tp_osd_tp 2020-06-27T04:47:35.266 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.267 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 1: (()+0x12dd0) [0x7fac73540dd0] 2020-06-27T04:47:35.268 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5587fef10707] 2020-06-27T04:47:35.268 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5587fef10aa0] 2020-06-27T04:47:35.268 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5587fef4267a] 2020-06-27T04:47:35.269 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5587fef43a57] 2020-06-27T04:47:35.269 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5587febce938] 2020-06-27T04:47:35.269 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5587fed82a70] 2020-06-27T04:47:35.269 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5587fed92dd7] 2020-06-27T04:47:35.269 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5587fec01252] 2020-06-27T04:47:35.270 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5587feba4e2e] 2020-06-27T04:47:35.270 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5587fea254e9] 2020-06-27T04:47:35.270 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5587fec89f78] 2020-06-27T04:47:35.270 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5587fea4470f] 2020-06-27T04:47:35.270 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5587ff082b94] 2020-06-27T04:47:35.271 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5587ff0857f4] 2020-06-27T04:47:35.271 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 16: (()+0x82de) [0x7fac735362de] 2020-06-27T04:47:35.271 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 17: (clone()+0x43) [0x7fac7226de83] 2020-06-27T04:47:35.271 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:35.271 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: debug -9999> 2020-06-27T04:47:34.929+0000 7fac4c737700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.271 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: in thread 7fac4c737700 thread_name:tp_osd_tp 2020-06-27T04:47:35.272 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.272 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 1: (()+0x12dd0) [0x7fac73540dd0] 2020-06-27T04:47:35.272 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5587fef10707] 2020-06-27T04:47:35.272 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5587fef10aa0] 2020-06-27T04:47:35.272 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5587fef4267a] 2020-06-27T04:47:35.273 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5587fef43a57] 2020-06-27T04:47:35.273 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5587febce938] 2020-06-27T04:47:35.273 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5587fed82a70] 2020-06-27T04:47:35.273 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5587fed92dd7] 2020-06-27T04:47:35.274 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5587fec01252] 2020-06-27T04:47:35.274 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5587feba4e2e] 2020-06-27T04:47:35.274 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5587fea254e9] 2020-06-27T04:47:35.275 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5587fec89f78] 2020-06-27T04:47:35.275 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5587fea4470f] 2020-06-27T04:47:35.275 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5587ff082b94] 2020-06-27T04:47:35.275 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5587ff0857f4] 2020-06-27T04:47:35.275 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 16: (()+0x82de) [0x7fac735362de] 2020-06-27T04:47:35.276 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: 17: (clone()+0x43) [0x7fac7226de83] 2020-06-27T04:47:35.276 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:35.276 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:34 smithi051 bash[21231]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:47:35.276 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:34 smithi051 podman[34453]: 2020-06-27 04:47:34.844682701 +0000 UTC m=+0.909569728 container died e1dd8b4c09f8b7b04bfce869b0fe58d7b3a1ad06114f9c54654aeac05cab4c3c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:47:35.451 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: debug 0> 2020-06-27T04:47:35.092+0000 7ff6dd1ad700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.451 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: in thread 7ff6dd1ad700 thread_name:tp_osd_tp 2020-06-27T04:47:35.452 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.452 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 1: (()+0x12dd0) [0x7ff6fd7a9dd0] 2020-06-27T04:47:35.452 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55ba79a3d707] 2020-06-27T04:47:35.452 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55ba79a3daa0] 2020-06-27T04:47:35.452 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55ba79a6f67a] 2020-06-27T04:47:35.453 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55ba79a70a57] 2020-06-27T04:47:35.453 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55ba796fb938] 2020-06-27T04:47:35.453 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55ba798afa70] 2020-06-27T04:47:35.453 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55ba798bfdd7] 2020-06-27T04:47:35.453 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55ba7972e252] 2020-06-27T04:47:35.453 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55ba796d1e2e] 2020-06-27T04:47:35.454 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55ba795524e9] 2020-06-27T04:47:35.454 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55ba797b6f78] 2020-06-27T04:47:35.454 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55ba7957170f] 2020-06-27T04:47:35.454 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55ba79bafb94] 2020-06-27T04:47:35.454 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55ba79bb27f4] 2020-06-27T04:47:35.455 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 16: (()+0x82de) [0x7ff6fd79f2de] 2020-06-27T04:47:35.455 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 17: (clone()+0x43) [0x7ff6fc4d6e83] 2020-06-27T04:47:35.455 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:35.455 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: debug -9999> 2020-06-27T04:47:35.092+0000 7ff6dd1ad700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.455 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: in thread 7ff6dd1ad700 thread_name:tp_osd_tp 2020-06-27T04:47:35.456 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.456 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 1: (()+0x12dd0) [0x7ff6fd7a9dd0] 2020-06-27T04:47:35.456 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55ba79a3d707] 2020-06-27T04:47:35.456 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55ba79a3daa0] 2020-06-27T04:47:35.456 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55ba79a6f67a] 2020-06-27T04:47:35.456 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55ba79a70a57] 2020-06-27T04:47:35.457 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55ba796fb938] 2020-06-27T04:47:35.457 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55ba798afa70] 2020-06-27T04:47:35.457 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55ba798bfdd7] 2020-06-27T04:47:35.457 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55ba7972e252] 2020-06-27T04:47:35.457 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55ba796d1e2e] 2020-06-27T04:47:35.458 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55ba795524e9] 2020-06-27T04:47:35.458 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55ba797b6f78] 2020-06-27T04:47:35.458 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55ba7957170f] 2020-06-27T04:47:35.458 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55ba79bafb94] 2020-06-27T04:47:35.458 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55ba79bb27f4] 2020-06-27T04:47:35.459 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 16: (()+0x82de) [0x7ff6fd79f2de] 2020-06-27T04:47:35.459 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: 17: (clone()+0x43) [0x7ff6fc4d6e83] 2020-06-27T04:47:35.464 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:35.470 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42602]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:47:35.470 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: debug 0> 2020-06-27T04:47:35.095+0000 7ff1455de700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.471 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: in thread 7ff1455de700 thread_name:tp_osd_tp 2020-06-27T04:47:35.471 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.471 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 1: (()+0x12dd0) [0x7ff165bdadd0] 2020-06-27T04:47:35.471 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55b05c232707] 2020-06-27T04:47:35.471 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55b05c232aa0] 2020-06-27T04:47:35.472 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55b05c26467a] 2020-06-27T04:47:35.472 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55b05c265a57] 2020-06-27T04:47:35.472 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55b05bef0938] 2020-06-27T04:47:35.472 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55b05c0a103d] 2020-06-27T04:47:35.472 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55b05be5e5b0] 2020-06-27T04:47:35.473 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55b05beb789d] 2020-06-27T04:47:35.473 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55b05bec0380] 2020-06-27T04:47:35.473 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55b05bec7590] 2020-06-27T04:47:35.473 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55b05bd474e9] 2020-06-27T04:47:35.473 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55b05bfabf78] 2020-06-27T04:47:35.474 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55b05bd6670f] 2020-06-27T04:47:35.474 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55b05c3a4b94] 2020-06-27T04:47:35.474 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55b05c3a77f4] 2020-06-27T04:47:35.474 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 17: (()+0x82de) [0x7ff165bd02de] 2020-06-27T04:47:35.474 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 18: (clone()+0x43) [0x7ff164907e83] 2020-06-27T04:47:35.475 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:35.475 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: debug -9999> 2020-06-27T04:47:35.095+0000 7ff1455de700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.475 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: in thread 7ff1455de700 thread_name:tp_osd_tp 2020-06-27T04:47:35.475 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.477 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 1: (()+0x12dd0) [0x7ff165bdadd0] 2020-06-27T04:47:35.477 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55b05c232707] 2020-06-27T04:47:35.477 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55b05c232aa0] 2020-06-27T04:47:35.477 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55b05c26467a] 2020-06-27T04:47:35.478 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55b05c265a57] 2020-06-27T04:47:35.478 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55b05bef0938] 2020-06-27T04:47:35.478 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55b05c0a103d] 2020-06-27T04:47:35.478 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55b05be5e5b0] 2020-06-27T04:47:35.478 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55b05beb789d] 2020-06-27T04:47:35.479 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55b05bec0380] 2020-06-27T04:47:35.479 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55b05bec7590] 2020-06-27T04:47:35.479 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55b05bd474e9] 2020-06-27T04:47:35.479 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55b05bfabf78] 2020-06-27T04:47:35.479 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55b05bd6670f] 2020-06-27T04:47:35.480 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55b05c3a4b94] 2020-06-27T04:47:35.480 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55b05c3a77f4] 2020-06-27T04:47:35.480 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 17: (()+0x82de) [0x7ff165bd02de] 2020-06-27T04:47:35.480 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: 18: (clone()+0x43) [0x7ff164907e83] 2020-06-27T04:47:35.480 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:35.480 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42700]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:47:35.481 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:35 smithi031 podman[43117]: 2020-06-27 04:47:35.448403266 +0000 UTC m=+4.246545460 container died 4e55b1b20e108a1e36f330e88baece7260633d563fdf529442d912b4a8671d2a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:47:35.481 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: debug -9999> 2020-06-27T04:47:35.091+0000 7f8824611700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:35.481 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: in thread 7f8824611700 thread_name:tp_osd_tp 2020-06-27T04:47:35.481 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:35.482 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 1: (()+0x12dd0) [0x7f8848c15dd0] 2020-06-27T04:47:35.482 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55fbef6d5707] 2020-06-27T04:47:35.482 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55fbef6d5aa0] 2020-06-27T04:47:35.482 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55fbef70767a] 2020-06-27T04:47:35.482 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55fbef708a57] 2020-06-27T04:47:35.483 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55fbef393938] 2020-06-27T04:47:35.483 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55fbef547a70] 2020-06-27T04:47:35.483 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55fbef557dd7] 2020-06-27T04:47:35.483 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55fbef3c6252] 2020-06-27T04:47:35.483 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55fbef369e2e] 2020-06-27T04:47:35.483 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55fbef1ea4e9] 2020-06-27T04:47:35.484 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55fbef44ef78] 2020-06-27T04:47:35.484 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55fbef20970f] 2020-06-27T04:47:35.484 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55fbef847b94] 2020-06-27T04:47:35.484 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55fbef84a7f4] 2020-06-27T04:47:35.484 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 16: (()+0x82de) [0x7f8848c0b2de] 2020-06-27T04:47:35.485 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: 17: (clone()+0x43) [0x7f8847942e83] 2020-06-27T04:47:35.485 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:35.485 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[42554]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:47:35.861 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:35 smithi051 podman[21567]: 2020-06-27 04:47:35.467949241 +0000 UTC m=+243.096251233 container died ada5651149315f085f4d10286adbb8fc64d0ca14a34890585b38a0c70cada94f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:47:36.190 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:35 smithi051 podman[25841]: 2020-06-27 04:47:35.872924276 +0000 UTC m=+212.431705071 container died 55271d6c0fdecb4a81bfffc01cd174f4f2a17770b308324d604a2a340c9dba5d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:47:36.191 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: audit 2020-06-27T04:47:34.375846+0000 mgr.x (mgr.34109) 232 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2020-06-27T04:47:36.191 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: audit 2020-06-27T04:47:34.832916+0000 mon.a (mon.0) 788 : audit [INF] from='client.? 172.21.15.31:0/3600122411' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-4","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:36.191 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:34.833133+0000 mon.a (mon.0) 789 : cluster [DBG] osdmap e88: 8 total, 6 up, 8 in 2020-06-27T04:47:36.192 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: audit 2020-06-27T04:47:34.835212+0000 mon.b (mon.2) 277 : audit [INF] from='client.? 172.21.15.31:0/1515995568' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41337-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:36.192 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: audit 2020-06-27T04:47:34.844838+0000 mon.c (mon.1) 57 : audit [INF] from='client.? 172.21.15.31:0/14122093' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41327-8", "tierpool":"test-rados-api-smithi031-41327-8-cache", "force_nonempty":""}]: dispatch 2020-06-27T04:47:36.192 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: audit 2020-06-27T04:47:34.854560+0000 mon.a (mon.0) 790 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41337-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:36.192 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: audit 2020-06-27T04:47:34.858110+0000 mon.a (mon.0) 791 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41327-8", "tierpool":"test-rados-api-smithi031-41327-8-cache", "force_nonempty":""}]: dispatch 2020-06-27T04:47:36.192 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.397221+0000 mon.a (mon.0) 792 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:36.193 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.397257+0000 mon.a (mon.0) 793 : cluster [INF] osd.4 failed (root=default,host=smithi051) (connection refused reported by osd.3) 2020-06-27T04:47:36.193 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.397416+0000 mon.a (mon.0) 794 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:36.193 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.397539+0000 mon.a (mon.0) 795 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:36.193 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.397562+0000 mon.a (mon.0) 796 : cluster [INF] osd.6 failed (root=default,host=smithi051) (connection refused reported by osd.3) 2020-06-27T04:47:36.193 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.397706+0000 mon.a (mon.0) 797 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:36.194 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.397824+0000 mon.a (mon.0) 798 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:36.194 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.397955+0000 mon.a (mon.0) 799 : cluster [DBG] osd.0 reported immediately failed by osd.3 2020-06-27T04:47:36.194 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.397973+0000 mon.a (mon.0) 800 : cluster [INF] osd.0 failed (root=default,host=smithi031) (connection refused reported by osd.3) 2020-06-27T04:47:36.194 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.398119+0000 mon.a (mon.0) 801 : cluster [DBG] osd.0 reported immediately failed by osd.3 2020-06-27T04:47:36.194 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.398241+0000 mon.a (mon.0) 802 : cluster [DBG] osd.0 reported immediately failed by osd.3 2020-06-27T04:47:36.195 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.398480+0000 mon.a (mon.0) 803 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:36.195 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.398606+0000 mon.a (mon.0) 804 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:36.195 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.398735+0000 mon.a (mon.0) 805 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:36.195 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.398917+0000 mon.a (mon.0) 806 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:36.195 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.399045+0000 mon.a (mon.0) 807 : cluster [DBG] osd.0 reported immediately failed by osd.2 2020-06-27T04:47:36.196 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.399167+0000 mon.a (mon.0) 808 : cluster [DBG] osd.0 reported immediately failed by osd.2 2020-06-27T04:47:36.196 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.399299+0000 mon.a (mon.0) 809 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:36.196 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.399487+0000 mon.a (mon.0) 810 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:36.196 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.399611+0000 mon.a (mon.0) 811 : cluster [DBG] osd.0 reported immediately failed by osd.2 2020-06-27T04:47:36.196 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.399736+0000 mon.a (mon.0) 812 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:36.197 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.831368+0000 mon.a (mon.0) 813 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:47:36.197 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: audit 2020-06-27T04:47:35.836629+0000 mon.a (mon.0) 814 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41337-6","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:36.197 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: audit 2020-06-27T04:47:35.836707+0000 mon.a (mon.0) 815 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41327-8", "tierpool":"test-rados-api-smithi031-41327-8-cache", "force_nonempty":""}]': finished 2020-06-27T04:47:36.197 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.836844+0000 mon.a (mon.0) 816 : cluster [DBG] osdmap e89: 8 total, 3 up, 8 in 2020-06-27T04:47:36.197 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: audit 2020-06-27T04:47:35.837835+0000 mon.c (mon.1) 58 : audit [INF] from='client.? 172.21.15.31:0/14122093' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi031-41327-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:36.198 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: audit 2020-06-27T04:47:35.838240+0000 mon.c (mon.1) 59 : audit [INF] from='client.? 172.21.15.31:0/1769229494' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:36.198 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: audit 2020-06-27T04:47:35.838623+0000 mon.a (mon.0) 817 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi031-41327-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:36.198 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:35 smithi051 bash[18409]: audit 2020-06-27T04:47:35.838783+0000 mon.a (mon.0) 818 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:36.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: audit 2020-06-27T04:47:34.375846+0000 mgr.x (mgr.34109) 232 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2020-06-27T04:47:36.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: audit 2020-06-27T04:47:34.832916+0000 mon.a (mon.0) 788 : audit [INF] from='client.? 172.21.15.31:0/3600122411' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-4","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:36.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:34.833133+0000 mon.a (mon.0) 789 : cluster [DBG] osdmap e88: 8 total, 6 up, 8 in 2020-06-27T04:47:36.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: audit 2020-06-27T04:47:34.835212+0000 mon.b (mon.2) 277 : audit [INF] from='client.? 172.21.15.31:0/1515995568' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41337-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:36.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: audit 2020-06-27T04:47:34.844838+0000 mon.c (mon.1) 57 : audit [INF] from='client.? 172.21.15.31:0/14122093' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41327-8", "tierpool":"test-rados-api-smithi031-41327-8-cache", "force_nonempty":""}]: dispatch 2020-06-27T04:47:36.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: audit 2020-06-27T04:47:34.854560+0000 mon.a (mon.0) 790 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41337-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:36.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: audit 2020-06-27T04:47:34.858110+0000 mon.a (mon.0) 791 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41327-8", "tierpool":"test-rados-api-smithi031-41327-8-cache", "force_nonempty":""}]: dispatch 2020-06-27T04:47:36.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.397221+0000 mon.a (mon.0) 792 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:36.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.397257+0000 mon.a (mon.0) 793 : cluster [INF] osd.4 failed (root=default,host=smithi051) (connection refused reported by osd.3) 2020-06-27T04:47:36.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.397416+0000 mon.a (mon.0) 794 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:36.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.397539+0000 mon.a (mon.0) 795 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:36.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.397562+0000 mon.a (mon.0) 796 : cluster [INF] osd.6 failed (root=default,host=smithi051) (connection refused reported by osd.3) 2020-06-27T04:47:36.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.397706+0000 mon.a (mon.0) 797 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:36.228 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.397824+0000 mon.a (mon.0) 798 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:36.228 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.397955+0000 mon.a (mon.0) 799 : cluster [DBG] osd.0 reported immediately failed by osd.3 2020-06-27T04:47:36.228 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.397973+0000 mon.a (mon.0) 800 : cluster [INF] osd.0 failed (root=default,host=smithi031) (connection refused reported by osd.3) 2020-06-27T04:47:36.229 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.398119+0000 mon.a (mon.0) 801 : cluster [DBG] osd.0 reported immediately failed by osd.3 2020-06-27T04:47:36.229 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.398241+0000 mon.a (mon.0) 802 : cluster [DBG] osd.0 reported immediately failed by osd.3 2020-06-27T04:47:36.229 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.398480+0000 mon.a (mon.0) 803 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:36.229 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.398606+0000 mon.a (mon.0) 804 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:36.229 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.398735+0000 mon.a (mon.0) 805 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:36.230 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.398917+0000 mon.a (mon.0) 806 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:36.230 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.399045+0000 mon.a (mon.0) 807 : cluster [DBG] osd.0 reported immediately failed by osd.2 2020-06-27T04:47:36.230 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.399167+0000 mon.a (mon.0) 808 : cluster [DBG] osd.0 reported immediately failed by osd.2 2020-06-27T04:47:36.230 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.399299+0000 mon.a (mon.0) 809 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:36.230 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.399487+0000 mon.a (mon.0) 810 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:36.231 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.399611+0000 mon.a (mon.0) 811 : cluster [DBG] osd.0 reported immediately failed by osd.2 2020-06-27T04:47:36.231 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.399736+0000 mon.a (mon.0) 812 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:36.231 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.831368+0000 mon.a (mon.0) 813 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:47:36.231 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: audit 2020-06-27T04:47:35.836629+0000 mon.a (mon.0) 814 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41337-6","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:36.231 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: audit 2020-06-27T04:47:35.836707+0000 mon.a (mon.0) 815 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41327-8", "tierpool":"test-rados-api-smithi031-41327-8-cache", "force_nonempty":""}]': finished 2020-06-27T04:47:36.232 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.836844+0000 mon.a (mon.0) 816 : cluster [DBG] osdmap e89: 8 total, 3 up, 8 in 2020-06-27T04:47:36.232 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: audit 2020-06-27T04:47:35.837835+0000 mon.c (mon.1) 58 : audit [INF] from='client.? 172.21.15.31:0/14122093' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi031-41327-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:36.232 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: audit 2020-06-27T04:47:35.838240+0000 mon.c (mon.1) 59 : audit [INF] from='client.? 172.21.15.31:0/1769229494' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:36.232 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: audit 2020-06-27T04:47:35.838623+0000 mon.a (mon.0) 817 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi031-41327-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:36.232 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[18426]: audit 2020-06-27T04:47:35.838783+0000 mon.a (mon.0) 818 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:36.233 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: audit 2020-06-27T04:47:34.375846+0000 mgr.x (mgr.34109) 232 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2020-06-27T04:47:36.233 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: audit 2020-06-27T04:47:34.832916+0000 mon.a (mon.0) 788 : audit [INF] from='client.? 172.21.15.31:0/3600122411' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41546-4","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:36.233 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:34.833133+0000 mon.a (mon.0) 789 : cluster [DBG] osdmap e88: 8 total, 6 up, 8 in 2020-06-27T04:47:36.233 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: audit 2020-06-27T04:47:34.835212+0000 mon.b (mon.2) 277 : audit [INF] from='client.? 172.21.15.31:0/1515995568' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41337-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:36.233 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: audit 2020-06-27T04:47:34.844838+0000 mon.c (mon.1) 57 : audit [INF] from='client.? 172.21.15.31:0/14122093' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41327-8", "tierpool":"test-rados-api-smithi031-41327-8-cache", "force_nonempty":""}]: dispatch 2020-06-27T04:47:36.234 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: audit 2020-06-27T04:47:34.854560+0000 mon.a (mon.0) 790 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41337-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:36.234 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: audit 2020-06-27T04:47:34.858110+0000 mon.a (mon.0) 791 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41327-8", "tierpool":"test-rados-api-smithi031-41327-8-cache", "force_nonempty":""}]: dispatch 2020-06-27T04:47:36.234 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.397221+0000 mon.a (mon.0) 792 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:36.234 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.397257+0000 mon.a (mon.0) 793 : cluster [INF] osd.4 failed (root=default,host=smithi051) (connection refused reported by osd.3) 2020-06-27T04:47:36.234 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.397416+0000 mon.a (mon.0) 794 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:36.235 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.397539+0000 mon.a (mon.0) 795 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:36.235 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.397562+0000 mon.a (mon.0) 796 : cluster [INF] osd.6 failed (root=default,host=smithi051) (connection refused reported by osd.3) 2020-06-27T04:47:36.235 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.397706+0000 mon.a (mon.0) 797 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:36.236 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.397824+0000 mon.a (mon.0) 798 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:36.236 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.397955+0000 mon.a (mon.0) 799 : cluster [DBG] osd.0 reported immediately failed by osd.3 2020-06-27T04:47:36.236 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.397973+0000 mon.a (mon.0) 800 : cluster [INF] osd.0 failed (root=default,host=smithi031) (connection refused reported by osd.3) 2020-06-27T04:47:36.236 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.398119+0000 mon.a (mon.0) 801 : cluster [DBG] osd.0 reported immediately failed by osd.3 2020-06-27T04:47:36.236 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.398241+0000 mon.a (mon.0) 802 : cluster [DBG] osd.0 reported immediately failed by osd.3 2020-06-27T04:47:36.236 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.398480+0000 mon.a (mon.0) 803 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:36.237 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.398606+0000 mon.a (mon.0) 804 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:36.237 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.398735+0000 mon.a (mon.0) 805 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:36.237 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.398917+0000 mon.a (mon.0) 806 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:36.237 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.399045+0000 mon.a (mon.0) 807 : cluster [DBG] osd.0 reported immediately failed by osd.2 2020-06-27T04:47:36.237 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.399167+0000 mon.a (mon.0) 808 : cluster [DBG] osd.0 reported immediately failed by osd.2 2020-06-27T04:47:36.238 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.399299+0000 mon.a (mon.0) 809 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:36.238 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.399487+0000 mon.a (mon.0) 810 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:36.238 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.399611+0000 mon.a (mon.0) 811 : cluster [DBG] osd.0 reported immediately failed by osd.2 2020-06-27T04:47:36.238 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.399736+0000 mon.a (mon.0) 812 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:36.238 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.831368+0000 mon.a (mon.0) 813 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:47:36.239 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: audit 2020-06-27T04:47:35.836629+0000 mon.a (mon.0) 814 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41337-6","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:36.239 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: audit 2020-06-27T04:47:35.836707+0000 mon.a (mon.0) 815 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41327-8", "tierpool":"test-rados-api-smithi031-41327-8-cache", "force_nonempty":""}]': finished 2020-06-27T04:47:36.239 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.836844+0000 mon.a (mon.0) 816 : cluster [DBG] osdmap e89: 8 total, 3 up, 8 in 2020-06-27T04:47:36.239 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: audit 2020-06-27T04:47:35.837835+0000 mon.c (mon.1) 58 : audit [INF] from='client.? 172.21.15.31:0/14122093' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi031-41327-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:36.239 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: audit 2020-06-27T04:47:35.838240+0000 mon.c (mon.1) 59 : audit [INF] from='client.? 172.21.15.31:0/1769229494' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:36.240 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: audit 2020-06-27T04:47:35.838623+0000 mon.a (mon.0) 817 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi031-41327-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:36.240 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:35 smithi031 bash[22603]: audit 2020-06-27T04:47:35.838783+0000 mon.a (mon.0) 818 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:36.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:36 smithi051 podman[34453]: 2020-06-27 04:47:36.188358554 +0000 UTC m=+2.253245593 container remove e1dd8b4c09f8b7b04bfce869b0fe58d7b3a1ad06114f9c54654aeac05cab4c3c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:47:36.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:36 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Failed with result 'exit-code'. 2020-06-27T04:47:36.468 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:36 smithi051 podman[34468]: 2020-06-27 04:47:36.289930385 +0000 UTC m=+2.245984122 container remove 2fbe9febef6c5d47ae4db5bd12cb52e46015ea0c29d70aa736ccb1d5dd151e77 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:47:36.722 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:36 smithi031 podman[42858]: 2020-06-27 04:47:36.30053188 +0000 UTC m=+6.780283231 container died ec26ecd0171d95f31dc6c67c215371177ce8c9bac55bd062468492b3234802a9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:47:36.846 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:36 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Failed with result 'exit-code'. 2020-06-27T04:47:36.847 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:36 smithi051 podman[21567]: 2020-06-27 04:47:36.726123552 +0000 UTC m=+244.354425548 container remove ada5651149315f085f4d10286adbb8fc64d0ca14a34890585b38a0c70cada94f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:47:37.139 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:36 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:47:37.140 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:36 smithi051 podman[25841]: 2020-06-27 04:47:36.84434947 +0000 UTC m=+213.403130247 container remove 55271d6c0fdecb4a81bfffc01cd174f4f2a17770b308324d604a2a340c9dba5d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:47:37.140 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:36 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:47:37.140 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:36 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.192527+0000 mgr.x (mgr.34109) 233 : cluster [DBG] pgmap v235: 897 pgs: 20 activating+undersized, 18 creating+peering, 124 peering, 4 down, 2 stale+active+clean, 158 unknown, 3 creating+down, 7 stale+creating+peering, 8 creating+incomplete, 155 active+undersized, 37 active+undersized+degraded, 7 stale+active+undersized+degraded, 46 undersized+degraded+peered, 65 active+clean, 211 undersized+peered, 32 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 1 op/s; 364/1005 objects degraded (36.219%); 89 B/s, 0 objects/s recovering 2020-06-27T04:47:37.141 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:36 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.850012+0000 mon.a (mon.0) 819 : cluster [WRN] Health check update: Degraded data redundancy: 364/1005 objects degraded (36.219%), 90 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:37.141 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:36 smithi051 bash[18409]: cluster 2020-06-27T04:47:35.850035+0000 mon.a (mon.0) 820 : cluster [WRN] Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:47:37.141 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:36 smithi051 bash[18409]: audit 2020-06-27T04:47:36.838758+0000 mon.a (mon.0) 821 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi031-41327-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:37.141 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:36 smithi051 bash[18409]: audit 2020-06-27T04:47:36.838807+0000 mon.a (mon.0) 822 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-4","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:37.141 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:36 smithi051 bash[18409]: cluster 2020-06-27T04:47:36.838871+0000 mon.a (mon.0) 823 : cluster [DBG] osdmap e90: 8 total, 3 up, 8 in 2020-06-27T04:47:37.142 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:36 smithi051 bash[18409]: audit 2020-06-27T04:47:36.840694+0000 mon.c (mon.1) 60 : audit [INF] from='client.? 172.21.15.31:0/14122093' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi031-41327-8", "tierpool":"test-rados-api-smithi031-41327-8-cache"}]: dispatch 2020-06-27T04:47:37.142 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:36 smithi051 bash[18409]: audit 2020-06-27T04:47:36.841052+0000 mon.a (mon.0) 824 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi031-41327-8", "tierpool":"test-rados-api-smithi031-41327-8-cache"}]: dispatch 2020-06-27T04:47:37.223 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:36 smithi031 podman[42909]: 2020-06-27 04:47:36.807844915 +0000 UTC m=+7.142385590 container died 88462962afdbc5d51aaaf0c11b8b6ae4a752929ce1bbe9c00d1df8eb549ea18f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:47:37.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:36 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.192527+0000 mgr.x (mgr.34109) 233 : cluster [DBG] pgmap v235: 897 pgs: 20 activating+undersized, 18 creating+peering, 124 peering, 4 down, 2 stale+active+clean, 158 unknown, 3 creating+down, 7 stale+creating+peering, 8 creating+incomplete, 155 active+undersized, 37 active+undersized+degraded, 7 stale+active+undersized+degraded, 46 undersized+degraded+peered, 65 active+clean, 211 undersized+peered, 32 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 1 op/s; 364/1005 objects degraded (36.219%); 89 B/s, 0 objects/s recovering 2020-06-27T04:47:37.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:36 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.850012+0000 mon.a (mon.0) 819 : cluster [WRN] Health check update: Degraded data redundancy: 364/1005 objects degraded (36.219%), 90 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:37.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:36 smithi031 bash[18426]: cluster 2020-06-27T04:47:35.850035+0000 mon.a (mon.0) 820 : cluster [WRN] Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:47:37.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:36 smithi031 bash[18426]: audit 2020-06-27T04:47:36.838758+0000 mon.a (mon.0) 821 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi031-41327-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:37.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:36 smithi031 bash[18426]: audit 2020-06-27T04:47:36.838807+0000 mon.a (mon.0) 822 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-4","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:37.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:36 smithi031 bash[18426]: cluster 2020-06-27T04:47:36.838871+0000 mon.a (mon.0) 823 : cluster [DBG] osdmap e90: 8 total, 3 up, 8 in 2020-06-27T04:47:37.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:36 smithi031 bash[18426]: audit 2020-06-27T04:47:36.840694+0000 mon.c (mon.1) 60 : audit [INF] from='client.? 172.21.15.31:0/14122093' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi031-41327-8", "tierpool":"test-rados-api-smithi031-41327-8-cache"}]: dispatch 2020-06-27T04:47:37.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:36 smithi031 bash[18426]: audit 2020-06-27T04:47:36.841052+0000 mon.a (mon.0) 824 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi031-41327-8", "tierpool":"test-rados-api-smithi031-41327-8-cache"}]: dispatch 2020-06-27T04:47:37.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:36 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.192527+0000 mgr.x (mgr.34109) 233 : cluster [DBG] pgmap v235: 897 pgs: 20 activating+undersized, 18 creating+peering, 124 peering, 4 down, 2 stale+active+clean, 158 unknown, 3 creating+down, 7 stale+creating+peering, 8 creating+incomplete, 155 active+undersized, 37 active+undersized+degraded, 7 stale+active+undersized+degraded, 46 undersized+degraded+peered, 65 active+clean, 211 undersized+peered, 32 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 1 op/s; 364/1005 objects degraded (36.219%); 89 B/s, 0 objects/s recovering 2020-06-27T04:47:37.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:36 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.850012+0000 mon.a (mon.0) 819 : cluster [WRN] Health check update: Degraded data redundancy: 364/1005 objects degraded (36.219%), 90 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:37.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:36 smithi031 bash[22603]: cluster 2020-06-27T04:47:35.850035+0000 mon.a (mon.0) 820 : cluster [WRN] Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:47:37.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:36 smithi031 bash[22603]: audit 2020-06-27T04:47:36.838758+0000 mon.a (mon.0) 821 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi031-41327-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:37.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:36 smithi031 bash[22603]: audit 2020-06-27T04:47:36.838807+0000 mon.a (mon.0) 822 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-4","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:37.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:36 smithi031 bash[22603]: cluster 2020-06-27T04:47:36.838871+0000 mon.a (mon.0) 823 : cluster [DBG] osdmap e90: 8 total, 3 up, 8 in 2020-06-27T04:47:37.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:36 smithi031 bash[22603]: audit 2020-06-27T04:47:36.840694+0000 mon.c (mon.1) 60 : audit [INF] from='client.? 172.21.15.31:0/14122093' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi031-41327-8", "tierpool":"test-rados-api-smithi031-41327-8-cache"}]: dispatch 2020-06-27T04:47:37.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:36 smithi031 bash[22603]: audit 2020-06-27T04:47:36.841052+0000 mon.a (mon.0) 824 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi031-41327-8", "tierpool":"test-rados-api-smithi031-41327-8-cache"}]: dispatch 2020-06-27T04:47:37.414 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:37 smithi051 podman[34649]: 2020-06-27 04:47:37.137657357 +0000 UTC m=+0.265617289 container create f6bf685e68041bb4ba3ed6c381a420c26fcf15f9bfae5cc4422266f8c3aa6033 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:47:37.415 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:37 smithi051 podman[34650]: 2020-06-27 04:47:37.329257258 +0000 UTC m=+0.457012919 container create dc4e91d84d6eeb875356ac70320aa56a7cd89d4fea0671f10b82c53689d129b1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:47:37.682 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:37 smithi051 podman[34649]: 2020-06-27 04:47:37.412560107 +0000 UTC m=+0.540520039 container init f6bf685e68041bb4ba3ed6c381a420c26fcf15f9bfae5cc4422266f8c3aa6033 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:47:37.682 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:37 smithi051 podman[34649]: 2020-06-27 04:47:37.554226828 +0000 UTC m=+0.682186755 container start f6bf685e68041bb4ba3ed6c381a420c26fcf15f9bfae5cc4422266f8c3aa6033 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:47:37.682 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:37 smithi051 podman[34649]: 2020-06-27 04:47:37.554300177 +0000 UTC m=+0.682260134 container attach f6bf685e68041bb4ba3ed6c381a420c26fcf15f9bfae5cc4422266f8c3aa6033 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:47:37.683 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:37 smithi051 podman[34650]: 2020-06-27 04:47:37.445915135 +0000 UTC m=+0.573670813 container init dc4e91d84d6eeb875356ac70320aa56a7cd89d4fea0671f10b82c53689d129b1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:47:37.683 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:37 smithi051 podman[34650]: 2020-06-27 04:47:37.479219429 +0000 UTC m=+0.606975095 container start dc4e91d84d6eeb875356ac70320aa56a7cd89d4fea0671f10b82c53689d129b1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:47:37.683 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:37 smithi051 podman[34650]: 2020-06-27 04:47:37.479291574 +0000 UTC m=+0.607047275 container attach dc4e91d84d6eeb875356ac70320aa56a7cd89d4fea0671f10b82c53689d129b1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:47:37.968 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:37 smithi051 podman[34649]: 2020-06-27 04:47:37.704303272 +0000 UTC m=+0.832263216 container died f6bf685e68041bb4ba3ed6c381a420c26fcf15f9bfae5cc4422266f8c3aa6033 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:47:37.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:37 smithi051 podman[34650]: 2020-06-27 04:47:37.756704122 +0000 UTC m=+0.884459807 container died dc4e91d84d6eeb875356ac70320aa56a7cd89d4fea0671f10b82c53689d129b1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:47:38.140 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:37 smithi031 podman[25580]: 2020-06-27 04:47:37.784882979 +0000 UTC m=+307.983236220 container remove bf7312b7e1fcc1242bb382d2e29d4f1fe05d5d106a92f24fa770ff816962b70f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:47:38.473 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:38 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:47:38.474 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:38 smithi031 podman[42909]: 2020-06-27 04:47:38.230364816 +0000 UTC m=+8.564905482 container remove 88462962afdbc5d51aaaf0c11b8b6ae4a752929ce1bbe9c00d1df8eb549ea18f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:47:38.474 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:38 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:47:38.474 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:38 smithi031 podman[43117]: 2020-06-27 04:47:38.137990785 +0000 UTC m=+6.936132970 container remove 4e55b1b20e108a1e36f330e88baece7260633d563fdf529442d912b4a8671d2a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:47:38.474 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:38 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:47:38.474 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:38 smithi031 podman[42858]: 2020-06-27 04:47:38.356554055 +0000 UTC m=+8.836305432 container remove ec26ecd0171d95f31dc6c67c215371177ce8c9bac55bd062468492b3234802a9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:47:38.475 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:38 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:47:38.848 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:38 smithi051 podman[34650]: 2020-06-27 04:47:38.637357413 +0000 UTC m=+1.765113095 container remove dc4e91d84d6eeb875356ac70320aa56a7cd89d4fea0671f10b82c53689d129b1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:47:38.848 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:38 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2020-06-27T04:47:38.848 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:38 smithi051 podman[34649]: 2020-06-27 04:47:38.544276506 +0000 UTC m=+1.672236447 container remove f6bf685e68041bb4ba3ed6c381a420c26fcf15f9bfae5cc4422266f8c3aa6033 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:47:38.849 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:38 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Failed with result 'exit-code'. 2020-06-27T04:47:38.936 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:38 smithi031 bash[18426]: cluster 2020-06-27T04:47:37.193766+0000 mgr.x (mgr.34109) 234 : cluster [DBG] pgmap v238: 929 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 190 unknown, 25 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 1 op/s; 364/1005 objects degraded (36.219%); 31 B/s, 0 objects/s recovering 2020-06-27T04:47:38.936 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:38 smithi031 bash[18426]: audit 2020-06-27T04:47:37.841453+0000 mon.a (mon.0) 825 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi031-41327-8", "tierpool":"test-rados-api-smithi031-41327-8-cache"}]': finished 2020-06-27T04:47:38.936 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:38 smithi031 bash[18426]: cluster 2020-06-27T04:47:37.841510+0000 mon.a (mon.0) 826 : cluster [DBG] osdmap e91: 8 total, 3 up, 8 in 2020-06-27T04:47:38.937 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:38 smithi031 podman[44335]: 2020-06-27 04:47:38.633840809 +0000 UTC m=+0.378419325 container create dfbf0cbc4cc0226f3d94c1af3d0029020550bef6ffa2816b8944bcb7572d2aec (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:47:38.937 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:38 smithi031 podman[44334]: 2020-06-27 04:47:38.853108527 +0000 UTC m=+0.597973692 container create 3b686ffa5c65cf1c1f205b1049b7278d8c2f60e96974b8d487f2f0688a154cb4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:47:38.937 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:38 smithi031 bash[22603]: cluster 2020-06-27T04:47:37.193766+0000 mgr.x (mgr.34109) 234 : cluster [DBG] pgmap v238: 929 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 190 unknown, 25 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 1 op/s; 364/1005 objects degraded (36.219%); 31 B/s, 0 objects/s recovering 2020-06-27T04:47:38.937 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:38 smithi031 bash[22603]: audit 2020-06-27T04:47:37.841453+0000 mon.a (mon.0) 825 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi031-41327-8", "tierpool":"test-rados-api-smithi031-41327-8-cache"}]': finished 2020-06-27T04:47:38.938 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:38 smithi031 bash[22603]: cluster 2020-06-27T04:47:37.841510+0000 mon.a (mon.0) 826 : cluster [DBG] osdmap e91: 8 total, 3 up, 8 in 2020-06-27T04:47:39.202 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:39 smithi031 podman[44334]: 2020-06-27 04:47:39.158832281 +0000 UTC m=+0.903697541 container init 3b686ffa5c65cf1c1f205b1049b7278d8c2f60e96974b8d487f2f0688a154cb4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:47:39.202 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:38 smithi031 podman[44335]: 2020-06-27 04:47:38.933836929 +0000 UTC m=+0.678415414 container init dfbf0cbc4cc0226f3d94c1af3d0029020550bef6ffa2816b8944bcb7572d2aec (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:47:39.202 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:39 smithi031 podman[44335]: 2020-06-27 04:47:39.022673906 +0000 UTC m=+0.767252407 container start dfbf0cbc4cc0226f3d94c1af3d0029020550bef6ffa2816b8944bcb7572d2aec (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:47:39.203 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:39 smithi031 podman[44335]: 2020-06-27 04:47:39.022770602 +0000 UTC m=+0.767349119 container attach dfbf0cbc4cc0226f3d94c1af3d0029020550bef6ffa2816b8944bcb7572d2aec (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:47:39.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:38 smithi051 bash[18409]: cluster 2020-06-27T04:47:37.193766+0000 mgr.x (mgr.34109) 234 : cluster [DBG] pgmap v238: 929 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 190 unknown, 25 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 1 op/s; 364/1005 objects degraded (36.219%); 31 B/s, 0 objects/s recovering 2020-06-27T04:47:39.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:38 smithi051 bash[18409]: audit 2020-06-27T04:47:37.841453+0000 mon.a (mon.0) 825 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi031-41327-8", "tierpool":"test-rados-api-smithi031-41327-8-cache"}]': finished 2020-06-27T04:47:39.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:38 smithi051 bash[18409]: cluster 2020-06-27T04:47:37.841510+0000 mon.a (mon.0) 826 : cluster [DBG] osdmap e91: 8 total, 3 up, 8 in 2020-06-27T04:47:39.461 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:39 smithi031 podman[44368]: 2020-06-27 04:47:39.333688654 +0000 UTC m=+0.952467328 container create b83b219ba49dd8ad056892788517fb2017a4f1a2b3031c488ab8f2d232dcf880 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:47:39.462 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:39 smithi031 podman[44335]: 2020-06-27 04:47:39.410670099 +0000 UTC m=+1.155248628 container died dfbf0cbc4cc0226f3d94c1af3d0029020550bef6ffa2816b8944bcb7572d2aec (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:47:39.462 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:39 smithi031 podman[44334]: 2020-06-27 04:47:39.283730244 +0000 UTC m=+1.028595413 container start 3b686ffa5c65cf1c1f205b1049b7278d8c2f60e96974b8d487f2f0688a154cb4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:47:39.462 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:39 smithi031 podman[44334]: 2020-06-27 04:47:39.283809828 +0000 UTC m=+1.028674995 container attach 3b686ffa5c65cf1c1f205b1049b7278d8c2f60e96974b8d487f2f0688a154cb4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:47:39.852 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: Running main() from gmock_main.cc 2020-06-27T04:47:39.852 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [==========] Running 7 tests from 1 test suite. 2020-06-27T04:47:39.852 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [----------] Global test environment set-up. 2020-06-27T04:47:39.852 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [----------] 7 tests from LibRadosPools 2020-06-27T04:47:39.853 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2020-06-27T04:47:39.853 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [ OK ] LibRadosPools.PoolList (13090 ms) 2020-06-27T04:47:39.853 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2020-06-27T04:47:39.853 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3383 ms) 2020-06-27T04:47:39.853 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2020-06-27T04:47:39.854 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (2930 ms) 2020-06-27T04:47:39.854 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2020-06-27T04:47:39.854 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (5035 ms) 2020-06-27T04:47:39.854 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2020-06-27T04:47:39.854 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (5038 ms) 2020-06-27T04:47:39.854 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2020-06-27T04:47:39.855 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5037 ms) 2020-06-27T04:47:39.855 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2020-06-27T04:47:39.855 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (8033 ms) 2020-06-27T04:47:39.855 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [----------] 7 tests from LibRadosPools (42547 ms total) 2020-06-27T04:47:39.855 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: 2020-06-27T04:47:39.856 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [----------] Global test environment tear-down 2020-06-27T04:47:39.856 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [==========] 7 tests from 1 test suite ran. (42547 ms total) 2020-06-27T04:47:39.856 INFO:tasks.workunit.client.0.smithi031.stdout: api_pool: [ PASSED ] 7 tests. 2020-06-27T04:47:39.857 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:39 smithi031 podman[44334]: 2020-06-27 04:47:39.495452522 +0000 UTC m=+1.240317706 container died 3b686ffa5c65cf1c1f205b1049b7278d8c2f60e96974b8d487f2f0688a154cb4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:47:40.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:39 smithi051 bash[18409]: cluster 2020-06-27T04:47:38.843421+0000 mon.a (mon.0) 827 : cluster [DBG] osdmap e92: 8 total, 3 up, 8 in 2020-06-27T04:47:40.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:39 smithi051 bash[18409]: cluster 2020-06-27T04:47:39.371099+0000 mon.a (mon.0) 828 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:47:40.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:39 smithi051 bash[18409]: cluster 2020-06-27T04:47:39.371159+0000 mon.a (mon.0) 829 : cluster [WRN] Health check update: Reduced data availability: 23 pgs inactive, 7 pgs down, 3 pgs peering, 8 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:47:40.223 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:40 smithi031 podman[44368]: 2020-06-27 04:47:40.010389982 +0000 UTC m=+1.629168769 container init b83b219ba49dd8ad056892788517fb2017a4f1a2b3031c488ab8f2d232dcf880 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:47:40.223 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:39 smithi031 podman[44365]: 2020-06-27 04:47:39.94204115 +0000 UTC m=+1.561090966 container create 1f493a19ff16e7267ad6d2471a6caff9b6e2b18b744871ff63b4a62cf78fee17 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:47:40.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:39 smithi031 bash[18426]: cluster 2020-06-27T04:47:38.843421+0000 mon.a (mon.0) 827 : cluster [DBG] osdmap e92: 8 total, 3 up, 8 in 2020-06-27T04:47:40.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:39 smithi031 bash[18426]: cluster 2020-06-27T04:47:39.371099+0000 mon.a (mon.0) 828 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:47:40.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:39 smithi031 bash[18426]: cluster 2020-06-27T04:47:39.371159+0000 mon.a (mon.0) 829 : cluster [WRN] Health check update: Reduced data availability: 23 pgs inactive, 7 pgs down, 3 pgs peering, 8 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:47:40.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:39 smithi031 bash[22603]: cluster 2020-06-27T04:47:38.843421+0000 mon.a (mon.0) 827 : cluster [DBG] osdmap e92: 8 total, 3 up, 8 in 2020-06-27T04:47:40.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:39 smithi031 bash[22603]: cluster 2020-06-27T04:47:39.371099+0000 mon.a (mon.0) 828 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:47:40.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:39 smithi031 bash[22603]: cluster 2020-06-27T04:47:39.371159+0000 mon.a (mon.0) 829 : cluster [WRN] Health check update: Reduced data availability: 23 pgs inactive, 7 pgs down, 3 pgs peering, 8 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:47:40.225 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:40 smithi031 podman[44335]: 2020-06-27 04:47:40.019097418 +0000 UTC m=+1.763675940 container remove dfbf0cbc4cc0226f3d94c1af3d0029020550bef6ffa2816b8944bcb7572d2aec (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:47:40.225 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:40 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2020-06-27T04:47:40.488 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:40 smithi031 podman[44368]: 2020-06-27 04:47:40.232981957 +0000 UTC m=+1.851760731 container start b83b219ba49dd8ad056892788517fb2017a4f1a2b3031c488ab8f2d232dcf880 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:47:40.488 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:40 smithi031 podman[44368]: 2020-06-27 04:47:40.233128671 +0000 UTC m=+1.851907435 container attach b83b219ba49dd8ad056892788517fb2017a4f1a2b3031c488ab8f2d232dcf880 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:47:40.855 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:40 smithi031 podman[44368]: 2020-06-27 04:47:40.486427375 +0000 UTC m=+2.105206054 container died b83b219ba49dd8ad056892788517fb2017a4f1a2b3031c488ab8f2d232dcf880 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:47:40.855 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:40 smithi031 podman[44365]: 2020-06-27 04:47:40.717101164 +0000 UTC m=+2.336150889 container init 1f493a19ff16e7267ad6d2471a6caff9b6e2b18b744871ff63b4a62cf78fee17 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:47:40.855 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:40 smithi031 podman[44334]: 2020-06-27 04:47:40.521467343 +0000 UTC m=+2.266332530 container remove 3b686ffa5c65cf1c1f205b1049b7278d8c2f60e96974b8d487f2f0688a154cb4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:47:40.855 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:40 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2020-06-27T04:47:40.856 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:40 smithi031 bash[18426]: cluster 2020-06-27T04:47:39.194887+0000 mgr.x (mgr.34109) 235 : cluster [DBG] pgmap v241: 897 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 158 unknown, 25 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 364/1005 objects degraded (36.219%) 2020-06-27T04:47:40.856 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:40 smithi031 bash[18426]: cluster 2020-06-27T04:47:39.847238+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e93: 8 total, 3 up, 8 in 2020-06-27T04:47:41.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:40 smithi051 bash[18409]: cluster 2020-06-27T04:47:39.194887+0000 mgr.x (mgr.34109) 235 : cluster [DBG] pgmap v241: 897 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 158 unknown, 25 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 364/1005 objects degraded (36.219%) 2020-06-27T04:47:41.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:40 smithi051 bash[18409]: cluster 2020-06-27T04:47:39.847238+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e93: 8 total, 3 up, 8 in 2020-06-27T04:47:41.223 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:40 smithi031 podman[44368]: 2020-06-27 04:47:40.983117834 +0000 UTC m=+2.601896500 container remove b83b219ba49dd8ad056892788517fb2017a4f1a2b3031c488ab8f2d232dcf880 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:47:41.223 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:40 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Failed with result 'exit-code'. 2020-06-27T04:47:41.223 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:40 smithi031 podman[44365]: 2020-06-27 04:47:40.864695238 +0000 UTC m=+2.483744967 container start 1f493a19ff16e7267ad6d2471a6caff9b6e2b18b744871ff63b4a62cf78fee17 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:47:41.223 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:40 smithi031 podman[44365]: 2020-06-27 04:47:40.864772935 +0000 UTC m=+2.483822709 container attach 1f493a19ff16e7267ad6d2471a6caff9b6e2b18b744871ff63b4a62cf78fee17 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:47:41.224 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:40 smithi031 podman[44365]: 2020-06-27 04:47:40.984360793 +0000 UTC m=+2.603410538 container died 1f493a19ff16e7267ad6d2471a6caff9b6e2b18b744871ff63b4a62cf78fee17 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:47:41.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:40 smithi031 bash[22603]: cluster 2020-06-27T04:47:39.194887+0000 mgr.x (mgr.34109) 235 : cluster [DBG] pgmap v241: 897 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 158 unknown, 25 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 364/1005 objects degraded (36.219%) 2020-06-27T04:47:41.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:40 smithi031 bash[22603]: cluster 2020-06-27T04:47:39.847238+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e93: 8 total, 3 up, 8 in 2020-06-27T04:47:41.723 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:41 smithi031 podman[44365]: 2020-06-27 04:47:41.368084016 +0000 UTC m=+2.987133770 container remove 1f493a19ff16e7267ad6d2471a6caff9b6e2b18b744871ff63b4a62cf78fee17 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:47:41.723 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:41 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Failed with result 'exit-code'. 2020-06-27T04:47:42.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:41 smithi051 bash[18409]: cluster 2020-06-27T04:47:41.196100+0000 mgr.x (mgr.34109) 236 : cluster [DBG] pgmap v243: 865 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 137 unknown, 14 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 364/1005 objects degraded (36.219%) 2020-06-27T04:47:42.222 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:41 smithi031 bash[18426]: cluster 2020-06-27T04:47:41.196100+0000 mgr.x (mgr.34109) 236 : cluster [DBG] pgmap v243: 865 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 137 unknown, 14 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 364/1005 objects degraded (36.219%) 2020-06-27T04:47:42.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:41 smithi031 bash[22603]: cluster 2020-06-27T04:47:41.196100+0000 mgr.x (mgr.34109) 236 : cluster [DBG] pgmap v243: 865 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 137 unknown, 14 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 364/1005 objects degraded (36.219%) 2020-06-27T04:47:44.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:44 smithi051 bash[18409]: cluster 2020-06-27T04:47:43.197358+0000 mgr.x (mgr.34109) 237 : cluster [DBG] pgmap v244: 865 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 137 unknown, 14 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 364/1005 objects degraded (36.219%) 2020-06-27T04:47:44.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:44 smithi031 bash[18426]: cluster 2020-06-27T04:47:43.197358+0000 mgr.x (mgr.34109) 237 : cluster [DBG] pgmap v244: 865 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 137 unknown, 14 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 364/1005 objects degraded (36.219%) 2020-06-27T04:47:44.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:44 smithi031 bash[22603]: cluster 2020-06-27T04:47:43.197358+0000 mgr.x (mgr.34109) 237 : cluster [DBG] pgmap v244: 865 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 137 unknown, 14 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 364/1005 objects degraded (36.219%) 2020-06-27T04:47:46.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:46 smithi051 bash[18409]: cluster 2020-06-27T04:47:45.198612+0000 mgr.x (mgr.34109) 238 : cluster [DBG] pgmap v245: 865 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 137 unknown, 14 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 364/1005 objects degraded (36.219%) 2020-06-27T04:47:46.718 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:46 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:47:46.718 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:46 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Scheduled restart job, restart counter is at 2. 2020-06-27T04:47:46.719 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:46 smithi051 systemd[1]: Stopped Ceph osd.5 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:46.719 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:46 smithi051 systemd[1]: Starting Ceph osd.5 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:47:46.719 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:46 smithi051 podman[34803]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5 found: no such container 2020-06-27T04:47:46.719 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:46 smithi051 systemd[1]: Started Ceph osd.5 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:46.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:46 smithi031 bash[18426]: cluster 2020-06-27T04:47:45.198612+0000 mgr.x (mgr.34109) 238 : cluster [DBG] pgmap v245: 865 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 137 unknown, 14 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 364/1005 objects degraded (36.219%) 2020-06-27T04:47:46.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:46 smithi031 bash[22603]: cluster 2020-06-27T04:47:45.198612+0000 mgr.x (mgr.34109) 238 : cluster [DBG] pgmap v245: 865 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 137 unknown, 14 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 364/1005 objects degraded (36.219%) 2020-06-27T04:47:46.997 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:46 smithi051 podman[34818]: 2020-06-27 04:47:46.786137587 +0000 UTC m=+0.248757257 container create 4697175ad85d6e6f7f3fc7a76b7a2d5ae8bd205edba95bfa7b3a7158aed95fde (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:47:46.997 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:46 smithi051 podman[34818]: 2020-06-27 04:47:46.91938906 +0000 UTC m=+0.382008613 container init 4697175ad85d6e6f7f3fc7a76b7a2d5ae8bd205edba95bfa7b3a7158aed95fde (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:47:46.997 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:46 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:47:46.998 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:46 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Scheduled restart job, restart counter is at 2. 2020-06-27T04:47:46.998 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:46 smithi051 systemd[1]: Stopped Ceph osd.7 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:46.998 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:46 smithi051 systemd[1]: Starting Ceph osd.7 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:47:46.998 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:46 smithi051 podman[34834]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7 found: no such container 2020-06-27T04:47:46.998 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:46 smithi051 systemd[1]: Started Ceph osd.7 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:47.262 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:46 smithi051 podman[34818]: 2020-06-27 04:47:46.994077161 +0000 UTC m=+0.456696719 container start 4697175ad85d6e6f7f3fc7a76b7a2d5ae8bd205edba95bfa7b3a7158aed95fde (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:47:47.262 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:46 smithi051 podman[34818]: 2020-06-27 04:47:46.994154656 +0000 UTC m=+0.456774243 container attach 4697175ad85d6e6f7f3fc7a76b7a2d5ae8bd205edba95bfa7b3a7158aed95fde (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:47:47.263 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:47 smithi051 bash[34816]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-06-27T04:47:47.263 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:47 smithi051 bash[34816]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2020-06-27T04:47:47.263 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:47 smithi051 bash[34816]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2020-06-27T04:47:47.264 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:47 smithi051 bash[34816]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2020-06-27T04:47:47.264 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:47 smithi051 bash[34816]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2020-06-27T04:47:47.264 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:47 smithi051 bash[34816]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-06-27T04:47:47.265 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:47 smithi051 bash[34816]: --> ceph-volume lvm activate successful for osd ID: 5 2020-06-27T04:47:47.265 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:47 smithi051 podman[34818]: 2020-06-27 04:47:47.259658137 +0000 UTC m=+0.722277745 container died 4697175ad85d6e6f7f3fc7a76b7a2d5ae8bd205edba95bfa7b3a7158aed95fde (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:47:47.265 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:47 smithi051 podman[34871]: 2020-06-27 04:47:47.177677595 +0000 UTC m=+0.296485564 container create f9a460e78bba8091c12af3221a714b64c79b4147dcec759ef865994c6438daa4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:47:47.632 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:47 smithi051 podman[34871]: 2020-06-27 04:47:47.630016817 +0000 UTC m=+0.748824790 container init f9a460e78bba8091c12af3221a714b64c79b4147dcec759ef865994c6438daa4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:47:47.896 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:47 smithi051 podman[34818]: 2020-06-27 04:47:47.793701166 +0000 UTC m=+1.256320739 container remove 4697175ad85d6e6f7f3fc7a76b7a2d5ae8bd205edba95bfa7b3a7158aed95fde (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:47:47.896 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:47 smithi051 bash[34816]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5 found: no such container 2020-06-27T04:47:47.896 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:47 smithi051 bash[34816]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5 2020-06-27T04:47:47.897 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:47 smithi051 bash[34816]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5" found: no such container 2020-06-27T04:47:47.897 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:47 smithi051 podman[34871]: 2020-06-27 04:47:47.743752594 +0000 UTC m=+0.862560561 container start f9a460e78bba8091c12af3221a714b64c79b4147dcec759ef865994c6438daa4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:47:47.897 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:47 smithi051 podman[34871]: 2020-06-27 04:47:47.743836898 +0000 UTC m=+0.862644872 container attach f9a460e78bba8091c12af3221a714b64c79b4147dcec759ef865994c6438daa4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:47:48.218 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:47 smithi051 bash[34869]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-06-27T04:47:48.218 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:47 smithi051 bash[34869]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2020-06-27T04:47:48.218 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:47 smithi051 bash[34869]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2020-06-27T04:47:48.218 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:47 smithi051 bash[34869]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2020-06-27T04:47:48.219 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:47 smithi051 bash[34869]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2020-06-27T04:47:48.219 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:47 smithi051 bash[34869]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-06-27T04:47:48.219 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:47 smithi051 bash[34869]: --> ceph-volume lvm activate successful for osd ID: 7 2020-06-27T04:47:48.219 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:47 smithi051 podman[34871]: 2020-06-27 04:47:47.937843053 +0000 UTC m=+1.056651055 container died f9a460e78bba8091c12af3221a714b64c79b4147dcec759ef865994c6438daa4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:47:48.643 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:48 smithi051 bash[18409]: cluster 2020-06-27T04:47:47.199627+0000 mgr.x (mgr.34109) 239 : cluster [DBG] pgmap v246: 865 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 137 unknown, 14 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 364/1005 objects degraded (36.219%) 2020-06-27T04:47:48.647 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:48 smithi051 podman[34994]: 2020-06-27 04:47:48.362839887 +0000 UTC m=+0.471133707 container create 61d9ddfedd14172af27a722f24c07716c763b9eaf8f684df45bb9ae74fee3ae1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:47:48.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:48 smithi031 bash[18426]: cluster 2020-06-27T04:47:47.199627+0000 mgr.x (mgr.34109) 239 : cluster [DBG] pgmap v246: 865 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 137 unknown, 14 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 364/1005 objects degraded (36.219%) 2020-06-27T04:47:48.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:48 smithi031 bash[22603]: cluster 2020-06-27T04:47:47.199627+0000 mgr.x (mgr.34109) 239 : cluster [DBG] pgmap v246: 865 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 137 unknown, 14 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 364/1005 objects degraded (36.219%) 2020-06-27T04:47:48.968 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:48 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:47:48.968 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:48 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Scheduled restart job, restart counter is at 1. 2020-06-27T04:47:48.969 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:48 smithi051 systemd[1]: Stopped Ceph osd.4 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:48.969 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:48 smithi051 systemd[1]: Starting Ceph osd.4 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:47:48.969 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:48 smithi051 podman[35052]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4 found: no such container 2020-06-27T04:47:48.969 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:48 smithi051 systemd[1]: Started Ceph osd.4 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:48.970 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:48 smithi051 podman[34871]: 2020-06-27 04:47:48.740638661 +0000 UTC m=+1.859446645 container remove f9a460e78bba8091c12af3221a714b64c79b4147dcec759ef865994c6438daa4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:47:48.970 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:48 smithi051 bash[34869]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7 found: no such container 2020-06-27T04:47:48.970 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:48 smithi051 bash[34869]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7 2020-06-27T04:47:48.970 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:48 smithi051 bash[34869]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7" found: no such container 2020-06-27T04:47:48.970 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:48 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:47:48.971 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:48 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Scheduled restart job, restart counter is at 1. 2020-06-27T04:47:48.971 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:48 smithi051 systemd[1]: Stopped Ceph osd.6 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:48.971 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:48 smithi051 systemd[1]: Starting Ceph osd.6 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:47:48.971 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:48 smithi051 podman[35051]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6 found: no such container 2020-06-27T04:47:48.971 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:48 smithi051 systemd[1]: Started Ceph osd.6 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:48.972 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:48 smithi051 podman[34994]: 2020-06-27 04:47:48.740223384 +0000 UTC m=+0.848517121 container init 61d9ddfedd14172af27a722f24c07716c763b9eaf8f684df45bb9ae74fee3ae1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:47:48.972 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:48 smithi051 podman[34994]: 2020-06-27 04:47:48.777459329 +0000 UTC m=+0.885753044 container start 61d9ddfedd14172af27a722f24c07716c763b9eaf8f684df45bb9ae74fee3ae1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:47:48.972 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:48 smithi051 podman[34994]: 2020-06-27 04:47:48.777527274 +0000 UTC m=+0.885821021 container attach 61d9ddfedd14172af27a722f24c07716c763b9eaf8f684df45bb9ae74fee3ae1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:47:48.972 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:48 smithi051 bash[34816]: debug 2020-06-27T04:47:48.766+0000 7f7958647f40 10 -- 172.21.15.51:0/3817380990 wait: dispatch queue is stopped 2020-06-27T04:47:48.972 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:48 smithi051 bash[34816]: debug 2020-06-27T04:47:48.766+0000 7f7958647f40 1 -- 172.21.15.51:0/3817380990 shutdown_connections 2020-06-27T04:47:48.973 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:48 smithi051 bash[34816]: debug 2020-06-27T04:47:48.766+0000 7f7958647f40 5 -- 172.21.15.51:0/3817380990 shutdown_connections delete 0x5602e4b5a800 2020-06-27T04:47:48.973 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:48 smithi051 bash[34816]: debug 2020-06-27T04:47:48.766+0000 7f7958647f40 20 Event(0x5602e4aeee00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:48.973 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:48 smithi051 bash[34816]: debug 2020-06-27T04:47:48.766+0000 7f7958647f40 20 Event(0x5602e4aef040 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:48.973 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:48 smithi051 bash[34816]: debug 2020-06-27T04:47:48.766+0000 7f7958647f40 20 Event(0x5602e4aef280 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:48.973 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:48 smithi051 bash[34816]: debug 2020-06-27T04:47:48.766+0000 7f7958647f40 10 -- 172.21.15.51:0/3817380990 wait: done. 2020-06-27T04:47:48.974 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:48 smithi051 bash[34816]: debug 2020-06-27T04:47:48.766+0000 7f7958647f40 1 -- 172.21.15.51:0/3817380990 wait complete. 2020-06-27T04:47:49.293 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34816]: debug 2020-06-27T04:47:49.034+0000 7f7958647f40 -1 Falling back to public interface 2020-06-27T04:47:49.294 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:49 smithi051 podman[35140]: 2020-06-27 04:47:49.101109522 +0000 UTC m=+0.270579619 container create d47f7c5005498dc27305dbb0c0e39a0574ae557dfd50e417348127052c91491d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:47:49.643 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:49 smithi051 podman[35140]: 2020-06-27 04:47:49.378809773 +0000 UTC m=+0.548279995 container init d47f7c5005498dc27305dbb0c0e39a0574ae557dfd50e417348127052c91491d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:47:49.643 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:49 smithi051 podman[35140]: 2020-06-27 04:47:49.444020344 +0000 UTC m=+0.613490450 container start d47f7c5005498dc27305dbb0c0e39a0574ae557dfd50e417348127052c91491d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:47:49.644 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:49 smithi051 podman[35140]: 2020-06-27 04:47:49.444100927 +0000 UTC m=+0.613571047 container attach d47f7c5005498dc27305dbb0c0e39a0574ae557dfd50e417348127052c91491d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:47:49.644 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 podman[35150]: 2020-06-27 04:47:49.627274855 +0000 UTC m=+0.783457126 container create c9b1db8315dbc48329f44d17f7a59baf754467fc35577bcfdb05d1d31966f2cb (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:47:49.644 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:49 smithi051 podman[35175]: 2020-06-27 04:47:49.518975998 +0000 UTC m=+0.638499167 container create c560fcb14c99cff2544c920ee24d126a464e14f76673f737891a9db161e003de (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:47:49.968 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:49 smithi051 podman[35175]: 2020-06-27 04:47:49.743964426 +0000 UTC m=+0.863487618 container init c560fcb14c99cff2544c920ee24d126a464e14f76673f737891a9db161e003de (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:47:49.969 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34816]: debug 2020-06-27T04:47:49.719+0000 7f7958647f40 -1 osd.5 85 log_to_monitors {default=true} 2020-06-27T04:47:49.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[35135]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-06-27T04:47:49.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[35135]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2020-06-27T04:47:49.970 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[35135]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2020-06-27T04:47:49.970 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[35135]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2020-06-27T04:47:49.970 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[35135]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2020-06-27T04:47:49.970 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[35135]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-06-27T04:47:49.970 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[35135]: --> ceph-volume lvm activate successful for osd ID: 6 2020-06-27T04:47:49.971 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:49 smithi051 podman[35140]: 2020-06-27 04:47:49.841772683 +0000 UTC m=+1.011242801 container died d47f7c5005498dc27305dbb0c0e39a0574ae557dfd50e417348127052c91491d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:47:49.971 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 podman[35150]: 2020-06-27 04:47:49.777317895 +0000 UTC m=+0.933500142 container init c9b1db8315dbc48329f44d17f7a59baf754467fc35577bcfdb05d1d31966f2cb (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:47:49.971 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 podman[35150]: 2020-06-27 04:47:49.810570229 +0000 UTC m=+0.966752494 container start c9b1db8315dbc48329f44d17f7a59baf754467fc35577bcfdb05d1d31966f2cb (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:47:49.971 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 podman[35150]: 2020-06-27 04:47:49.810642249 +0000 UTC m=+0.966824535 container attach c9b1db8315dbc48329f44d17f7a59baf754467fc35577bcfdb05d1d31966f2cb (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:47:49.971 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 10 -- 172.21.15.51:0/2552942350 shutdown 172.21.15.51:0/2552942350 2020-06-27T04:47:49.972 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 10 Processor -- stop 2020-06-27T04:47:49.974 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 20 Event(0x55924e3aae00 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:49.974 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 1 -- 172.21.15.51:0/2552942350 shutdown_connections 2020-06-27T04:47:49.974 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 5 -- 172.21.15.51:0/2552942350 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55924e417400 2020-06-27T04:47:49.975 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 1 --2- 172.21.15.51:0/2552942350 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55924e417400 0x55924e388300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:49.975 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 5 -- 172.21.15.51:0/2552942350 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55924e416c00 2020-06-27T04:47:49.975 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 1 --2- 172.21.15.51:0/2552942350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55924e416c00 0x55924e387400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:49.975 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 5 -- 172.21.15.51:0/2552942350 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55924e417000 2020-06-27T04:47:49.975 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 1 --2- 172.21.15.51:0/2552942350 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55924e417000 0x55924e387e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:49.976 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 5 -- 172.21.15.51:0/2552942350 shutdown_connections delete 0x55924e416c00 2020-06-27T04:47:49.976 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 5 -- 172.21.15.51:0/2552942350 shutdown_connections delete 0x55924e417000 2020-06-27T04:47:49.976 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 5 -- 172.21.15.51:0/2552942350 shutdown_connections delete 0x55924e417400 2020-06-27T04:47:49.976 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 1 -- 172.21.15.51:0/2552942350 >> 172.21.15.51:0/2552942350 conn(0x55924e416800 msgr2=0x55924e47f000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:47:49.976 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 20 --1- 172.21.15.51:0/2552942350 >> 172.21.15.51:0/2552942350 conn(0x55924e416800 0x55924e47f000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:49.976 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 2 --1- 172.21.15.51:0/2552942350 >> 172.21.15.51:0/2552942350 conn(0x55924e416800 0x55924e47f000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:49.977 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 5 --1- 172.21.15.51:0/2552942350 >> 172.21.15.51:0/2552942350 conn(0x55924e416800 0x55924e47f000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:47:49.977 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 20 Event(0x55924e3aae00 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:49.977 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 10 --1- 172.21.15.51:0/2552942350 >> 172.21.15.51:0/2552942350 conn(0x55924e416800 0x55924e47f000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:47:49.977 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 20 Event(0x55924e3aae00 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:49.977 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 20 Event(0x55924e3ab040 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:49.978 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e8c74c700 5 --1- 172.21.15.51:0/2552942350 >> 172.21.15.51:0/2552942350 conn(0x55924e416800 0x55924e47f000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:47:49.978 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e8c74c700 5 --1- 172.21.15.51:0/2552942350 >> 172.21.15.51:0/2552942350 conn(0x55924e416800 0x55924e47f000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:47:49.978 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.799+0000 7f8e929c9f40 20 Event(0x55924e3ab280 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:49.978 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.800+0000 7f8e929c9f40 10 -- 172.21.15.51:0/2552942350 wait: waiting for dispatch queue 2020-06-27T04:47:49.978 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.800+0000 7f8e929c9f40 10 -- 172.21.15.51:0/2552942350 wait: dispatch queue is stopped 2020-06-27T04:47:49.979 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.800+0000 7f8e929c9f40 1 -- 172.21.15.51:0/2552942350 shutdown_connections 2020-06-27T04:47:49.979 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.800+0000 7f8e929c9f40 5 -- 172.21.15.51:0/2552942350 shutdown_connections delete 0x55924e416800 2020-06-27T04:47:49.979 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.800+0000 7f8e929c9f40 20 Event(0x55924e3aae00 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:49.979 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.800+0000 7f8e929c9f40 20 Event(0x55924e3ab040 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:49.979 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.800+0000 7f8e929c9f40 20 Event(0x55924e3ab280 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:49.980 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.800+0000 7f8e929c9f40 10 -- 172.21.15.51:0/2552942350 wait: done. 2020-06-27T04:47:49.980 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:49 smithi051 bash[34869]: debug 2020-06-27T04:47:49.800+0000 7f8e929c9f40 1 -- 172.21.15.51:0/2552942350 wait complete. 2020-06-27T04:47:50.392 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[34869]: debug 2020-06-27T04:47:50.322+0000 7f8e929c9f40 -1 Falling back to public interface 2020-06-27T04:47:50.393 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[18409]: cluster 2020-06-27T04:47:49.200788+0000 mgr.x (mgr.34109) 240 : cluster [DBG] pgmap v247: 865 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 137 unknown, 14 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 364/1005 objects degraded (36.219%) 2020-06-27T04:47:50.393 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[18409]: audit 2020-06-27T04:47:49.724339+0000 mon.b (mon.2) 278 : audit [INF] from='osd.5 v2:172.21.15.51:6801/2419134109' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:47:50.393 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[18409]: audit 2020-06-27T04:47:49.724855+0000 mon.a (mon.0) 831 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:47:50.394 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[18409]: audit 2020-06-27T04:47:49.725551+0000 mon.b (mon.2) 279 : audit [INF] from='osd.5 v2:172.21.15.51:6801/2419134109' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:50.394 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[18409]: audit 2020-06-27T04:47:49.725900+0000 mon.a (mon.0) 832 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:50.394 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:50 smithi051 podman[35175]: 2020-06-27 04:47:50.127680316 +0000 UTC m=+1.247203493 container start c560fcb14c99cff2544c920ee24d126a464e14f76673f737891a9db161e003de (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:47:50.394 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:50 smithi051 podman[35175]: 2020-06-27 04:47:50.127748334 +0000 UTC m=+1.247271496 container attach c560fcb14c99cff2544c920ee24d126a464e14f76673f737891a9db161e003de (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:47:50.395 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[35168]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-06-27T04:47:50.395 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[35168]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2020-06-27T04:47:50.395 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[35168]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2020-06-27T04:47:50.395 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[35168]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2020-06-27T04:47:50.395 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[35168]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2020-06-27T04:47:50.396 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[35168]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-06-27T04:47:50.396 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[35168]: --> ceph-volume lvm activate successful for osd ID: 4 2020-06-27T04:47:50.396 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:50 smithi051 podman[35175]: 2020-06-27 04:47:50.304615456 +0000 UTC m=+1.424138629 container died c560fcb14c99cff2544c920ee24d126a464e14f76673f737891a9db161e003de (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:47:50.515 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:50 smithi031 bash[18426]: cluster 2020-06-27T04:47:49.200788+0000 mgr.x (mgr.34109) 240 : cluster [DBG] pgmap v247: 865 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 137 unknown, 14 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 364/1005 objects degraded (36.219%) 2020-06-27T04:47:50.516 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:50 smithi031 bash[18426]: audit 2020-06-27T04:47:49.724339+0000 mon.b (mon.2) 278 : audit [INF] from='osd.5 v2:172.21.15.51:6801/2419134109' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:47:50.516 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:50 smithi031 bash[18426]: audit 2020-06-27T04:47:49.724855+0000 mon.a (mon.0) 831 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:47:50.516 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:50 smithi031 bash[18426]: audit 2020-06-27T04:47:49.725551+0000 mon.b (mon.2) 279 : audit [INF] from='osd.5 v2:172.21.15.51:6801/2419134109' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:50.516 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:50 smithi031 bash[18426]: audit 2020-06-27T04:47:49.725900+0000 mon.a (mon.0) 832 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:50.517 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:50 smithi031 bash[22603]: cluster 2020-06-27T04:47:49.200788+0000 mgr.x (mgr.34109) 240 : cluster [DBG] pgmap v247: 865 pgs: 6 stale+creating+incomplete, 3 stale+creating+down, 4 stale+down, 32 stale+undersized+degraded+peered, 20 activating+undersized, 67 stale+active+clean, 137 unknown, 14 stale+creating+peering, 2 creating+incomplete, 124 stale+peering, 44 stale+active+undersized+degraded, 14 undersized+degraded+peered, 159 stale+undersized+peered, 52 undersized+peered, 187 stale+active+undersized; 18 KiB data, 8.7 MiB used, 707 GiB / 715 GiB avail; 364/1005 objects degraded (36.219%) 2020-06-27T04:47:50.517 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:50 smithi031 bash[22603]: audit 2020-06-27T04:47:49.724339+0000 mon.b (mon.2) 278 : audit [INF] from='osd.5 v2:172.21.15.51:6801/2419134109' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:47:50.517 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:50 smithi031 bash[22603]: audit 2020-06-27T04:47:49.724855+0000 mon.a (mon.0) 831 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:47:50.517 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:50 smithi031 bash[22603]: audit 2020-06-27T04:47:49.725551+0000 mon.b (mon.2) 279 : audit [INF] from='osd.5 v2:172.21.15.51:6801/2419134109' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:50.518 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:50 smithi031 bash[22603]: audit 2020-06-27T04:47:49.725900+0000 mon.a (mon.0) 832 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:50.518 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:50 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:47:50.518 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:50 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 1. 2020-06-27T04:47:50.518 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:50 smithi031 systemd[1]: Stopped Ceph osd.0 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:50.518 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:50 smithi031 systemd[1]: Starting Ceph osd.0 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:47:50.519 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:50 smithi031 podman[44632]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0 found: no such container 2020-06-27T04:47:50.519 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:50 smithi031 systemd[1]: Started Ceph osd.0 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:50.718 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[35135]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6 found: no such container 2020-06-27T04:47:50.929 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:50 smithi031 podman[44649]: 2020-06-27 04:47:50.513246523 +0000 UTC m=+0.219445669 container create 77c321cb3ec5ee6230b038589a1e42832ef7e44d88751a8cf310e5baeb59c719 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:47:50.930 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:50 smithi031 podman[44649]: 2020-06-27 04:47:50.673544654 +0000 UTC m=+0.379743708 container init 77c321cb3ec5ee6230b038589a1e42832ef7e44d88751a8cf310e5baeb59c719 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:47:50.930 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:50 smithi031 podman[44649]: 2020-06-27 04:47:50.742835489 +0000 UTC m=+0.449034548 container start 77c321cb3ec5ee6230b038589a1e42832ef7e44d88751a8cf310e5baeb59c719 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:47:50.930 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:50 smithi031 podman[44649]: 2020-06-27 04:47:50.742912611 +0000 UTC m=+0.449111702 container attach 77c321cb3ec5ee6230b038589a1e42832ef7e44d88751a8cf310e5baeb59c719 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:47:50.930 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:50 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:47:50.931 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:50 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 2. 2020-06-27T04:47:50.931 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:50 smithi031 systemd[1]: Stopped Ceph osd.3 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:50.931 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:50 smithi031 systemd[1]: Starting Ceph osd.3 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:47:50.931 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:50 smithi031 podman[44666]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3 found: no such container 2020-06-27T04:47:50.931 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:50 smithi031 systemd[1]: Started Ceph osd.3 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:51.043 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[35135]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6 2020-06-27T04:47:51.043 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[35135]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6" found: no such container 2020-06-27T04:47:51.043 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:50 smithi051 podman[35175]: 2020-06-27 04:47:50.778268134 +0000 UTC m=+1.897791315 container remove c560fcb14c99cff2544c920ee24d126a464e14f76673f737891a9db161e003de (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:47:51.044 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[35168]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4 found: no such container 2020-06-27T04:47:51.044 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[35168]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4 2020-06-27T04:47:51.044 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:50 smithi051 bash[35168]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4" found: no such container 2020-06-27T04:47:51.223 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:50 smithi031 podman[44705]: 2020-06-27 04:47:50.998433801 +0000 UTC m=+0.362466851 container create 833d2173223687b3a360e2b282274d281f31327c57508e7c9e778c5a41fd6451 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:47:51.223 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:51 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:47:51.224 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:51 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Scheduled restart job, restart counter is at 2. 2020-06-27T04:47:51.224 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:51 smithi031 systemd[1]: Stopped Ceph osd.1 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:51.224 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:51 smithi031 systemd[1]: Starting Ceph osd.1 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:47:51.224 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:50 smithi031 bash[44647]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-06-27T04:47:51.225 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:50 smithi031 bash[44647]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2020-06-27T04:47:51.225 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:50 smithi031 bash[44647]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2020-06-27T04:47:51.225 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:50 smithi031 bash[44647]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2020-06-27T04:47:51.225 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:50 smithi031 bash[44647]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2020-06-27T04:47:51.225 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:50 smithi031 bash[44647]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-06-27T04:47:51.226 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:50 smithi031 bash[44647]: --> ceph-volume lvm activate successful for osd ID: 0 2020-06-27T04:47:51.226 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:51 smithi031 podman[44649]: 2020-06-27 04:47:51.057456001 +0000 UTC m=+0.763655069 container died 77c321cb3ec5ee6230b038589a1e42832ef7e44d88751a8cf310e5baeb59c719 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:47:51.305 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 podman[35867]: 2020-06-27 04:47:51.078595858 +0000 UTC m=+0.283979203 container create cddc408f62d92e1e9e7a9e9134448e5004b3dc787b2313b4c4a079aae3bfe175 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:47:51.306 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[34869]: debug 2020-06-27T04:47:51.040+0000 7f8e929c9f40 -1 osd.7 85 log_to_monitors {default=true} 2020-06-27T04:47:51.690 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:51 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:47:51.690 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:51 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Scheduled restart job, restart counter is at 2. 2020-06-27T04:47:51.691 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:51 smithi031 systemd[1]: Stopped Ceph osd.2 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:51.691 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:51 smithi031 systemd[1]: Starting Ceph osd.2 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:47:51.691 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:51 smithi031 podman[44705]: 2020-06-27 04:47:51.347988104 +0000 UTC m=+0.712021150 container init 833d2173223687b3a360e2b282274d281f31327c57508e7c9e778c5a41fd6451 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:47:51.691 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:51 smithi031 podman[44705]: 2020-06-27 04:47:51.687754663 +0000 UTC m=+1.051787805 container start 833d2173223687b3a360e2b282274d281f31327c57508e7c9e778c5a41fd6451 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:47:51.691 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[18426]: cluster 2020-06-27T04:47:50.383117+0000 mon.a (mon.0) 833 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:47:51.692 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[18426]: cluster 2020-06-27T04:47:50.383147+0000 mon.a (mon.0) 834 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:47:51.692 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[18426]: cluster 2020-06-27T04:47:50.387585+0000 mon.a (mon.0) 835 : cluster [INF] osd.5 v2:172.21.15.51:6801/2419134109 boot 2020-06-27T04:47:51.692 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[18426]: cluster 2020-06-27T04:47:50.387621+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e94: 8 total, 4 up, 8 in 2020-06-27T04:47:51.692 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[18426]: audit 2020-06-27T04:47:50.388433+0000 mon.b (mon.2) 280 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:47:51.693 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[18426]: cluster 2020-06-27T04:47:50.402294+0000 mon.a (mon.0) 837 : cluster [DBG] osd.3 reported immediately failed by osd.5 2020-06-27T04:47:51.693 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[18426]: cluster 2020-06-27T04:47:50.402335+0000 mon.a (mon.0) 838 : cluster [INF] osd.3 failed (root=default,host=smithi031) (connection refused reported by osd.5) 2020-06-27T04:47:51.693 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[18426]: cluster 2020-06-27T04:47:50.402503+0000 mon.a (mon.0) 839 : cluster [DBG] osd.3 reported immediately failed by osd.5 2020-06-27T04:47:51.693 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[18426]: cluster 2020-06-27T04:47:50.402666+0000 mon.a (mon.0) 840 : cluster [DBG] osd.1 reported immediately failed by osd.5 2020-06-27T04:47:51.693 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[18426]: cluster 2020-06-27T04:47:50.402707+0000 mon.a (mon.0) 841 : cluster [INF] osd.1 failed (root=default,host=smithi031) (connection refused reported by osd.5) 2020-06-27T04:47:51.694 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[18426]: audit 2020-06-27T04:47:51.045215+0000 mon.c (mon.1) 61 : audit [INF] from='osd.7 v2:172.21.15.51:6805/823481292' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:47:51.694 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[18426]: audit 2020-06-27T04:47:51.045497+0000 mon.a (mon.0) 842 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:47:51.694 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[18426]: audit 2020-06-27T04:47:51.046031+0000 mon.c (mon.1) 62 : audit [INF] from='osd.7 v2:172.21.15.51:6805/823481292' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:51.694 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[18426]: audit 2020-06-27T04:47:51.046263+0000 mon.a (mon.0) 843 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:51.694 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[22603]: cluster 2020-06-27T04:47:50.383117+0000 mon.a (mon.0) 833 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:47:51.695 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[22603]: cluster 2020-06-27T04:47:50.383147+0000 mon.a (mon.0) 834 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:47:51.695 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[22603]: cluster 2020-06-27T04:47:50.387585+0000 mon.a (mon.0) 835 : cluster [INF] osd.5 v2:172.21.15.51:6801/2419134109 boot 2020-06-27T04:47:51.695 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[22603]: cluster 2020-06-27T04:47:50.387621+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e94: 8 total, 4 up, 8 in 2020-06-27T04:47:51.695 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[22603]: audit 2020-06-27T04:47:50.388433+0000 mon.b (mon.2) 280 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:47:51.696 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[22603]: cluster 2020-06-27T04:47:50.402294+0000 mon.a (mon.0) 837 : cluster [DBG] osd.3 reported immediately failed by osd.5 2020-06-27T04:47:51.696 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[22603]: cluster 2020-06-27T04:47:50.402335+0000 mon.a (mon.0) 838 : cluster [INF] osd.3 failed (root=default,host=smithi031) (connection refused reported by osd.5) 2020-06-27T04:47:51.696 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[22603]: cluster 2020-06-27T04:47:50.402503+0000 mon.a (mon.0) 839 : cluster [DBG] osd.3 reported immediately failed by osd.5 2020-06-27T04:47:51.696 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[22603]: cluster 2020-06-27T04:47:50.402666+0000 mon.a (mon.0) 840 : cluster [DBG] osd.1 reported immediately failed by osd.5 2020-06-27T04:47:51.696 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[22603]: cluster 2020-06-27T04:47:50.402707+0000 mon.a (mon.0) 841 : cluster [INF] osd.1 failed (root=default,host=smithi031) (connection refused reported by osd.5) 2020-06-27T04:47:51.697 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[22603]: audit 2020-06-27T04:47:51.045215+0000 mon.c (mon.1) 61 : audit [INF] from='osd.7 v2:172.21.15.51:6805/823481292' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:47:51.697 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[22603]: audit 2020-06-27T04:47:51.045497+0000 mon.a (mon.0) 842 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:47:51.697 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[22603]: audit 2020-06-27T04:47:51.046031+0000 mon.c (mon.1) 62 : audit [INF] from='osd.7 v2:172.21.15.51:6805/823481292' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:51.697 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[22603]: audit 2020-06-27T04:47:51.046263+0000 mon.a (mon.0) 843 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:51.718 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:51 smithi051 podman[35902]: 2020-06-27 04:47:51.302063023 +0000 UTC m=+0.429239106 container create 2481344bbee9ccf7d174e1163f8c67a0bebc9e36bc548e70d2f7f87948a7bb24 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:47:51.718 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:51 smithi051 podman[35902]: 2020-06-27 04:47:51.452006882 +0000 UTC m=+0.579182978 container init 2481344bbee9ccf7d174e1163f8c67a0bebc9e36bc548e70d2f7f87948a7bb24 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:47:51.719 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:51 smithi051 podman[35902]: 2020-06-27 04:47:51.51998431 +0000 UTC m=+0.647160421 container start 2481344bbee9ccf7d174e1163f8c67a0bebc9e36bc548e70d2f7f87948a7bb24 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:47:51.719 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:51 smithi051 podman[35902]: 2020-06-27 04:47:51.520091094 +0000 UTC m=+0.647267186 container attach 2481344bbee9ccf7d174e1163f8c67a0bebc9e36bc548e70d2f7f87948a7bb24 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:47:51.719 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 podman[35867]: 2020-06-27 04:47:51.360354885 +0000 UTC m=+0.565738248 container init cddc408f62d92e1e9e7a9e9134448e5004b3dc787b2313b4c4a079aae3bfe175 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:47:51.719 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 podman[35867]: 2020-06-27 04:47:51.393706785 +0000 UTC m=+0.599090131 container start cddc408f62d92e1e9e7a9e9134448e5004b3dc787b2313b4c4a079aae3bfe175 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:47:51.719 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 podman[35867]: 2020-06-27 04:47:51.393782785 +0000 UTC m=+0.599166163 container attach cddc408f62d92e1e9e7a9e9134448e5004b3dc787b2313b4c4a079aae3bfe175 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:47:51.720 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 10 -- 172.21.15.51:0/3519538395 shutdown 172.21.15.51:0/3519538395 2020-06-27T04:47:51.720 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 10 Processor -- stop 2020-06-27T04:47:51.720 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 20 Event(0x55a436ea2e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:51.720 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 1 -- 172.21.15.51:0/3519538395 shutdown_connections 2020-06-27T04:47:51.720 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 5 -- 172.21.15.51:0/3519538395 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55a436f0f400 2020-06-27T04:47:51.721 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 1 --2- 172.21.15.51:0/3519538395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a436f0f400 0x55a436e80300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:51.721 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 5 -- 172.21.15.51:0/3519538395 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55a436f0ec00 2020-06-27T04:47:51.721 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 1 --2- 172.21.15.51:0/3519538395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a436f0ec00 0x55a436e7f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:51.721 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 5 -- 172.21.15.51:0/3519538395 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55a436f0f000 2020-06-27T04:47:51.722 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 1 --2- 172.21.15.51:0/3519538395 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55a436f0f000 0x55a436e7fe00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:51.722 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 5 -- 172.21.15.51:0/3519538395 shutdown_connections delete 0x55a436f0ec00 2020-06-27T04:47:51.722 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 5 -- 172.21.15.51:0/3519538395 shutdown_connections delete 0x55a436f0f000 2020-06-27T04:47:51.722 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 5 -- 172.21.15.51:0/3519538395 shutdown_connections delete 0x55a436f0f400 2020-06-27T04:47:51.722 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 1 -- 172.21.15.51:0/3519538395 >> 172.21.15.51:0/3519538395 conn(0x55a436f0e800 msgr2=0x55a436f77000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:47:51.723 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 20 --1- 172.21.15.51:0/3519538395 >> 172.21.15.51:0/3519538395 conn(0x55a436f0e800 0x55a436f77000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:51.723 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 2 --1- 172.21.15.51:0/3519538395 >> 172.21.15.51:0/3519538395 conn(0x55a436f0e800 0x55a436f77000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:51.723 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 5 --1- 172.21.15.51:0/3519538395 >> 172.21.15.51:0/3519538395 conn(0x55a436f0e800 0x55a436f77000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:47:51.723 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 20 Event(0x55a436ea2e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:51.723 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 10 --1- 172.21.15.51:0/3519538395 >> 172.21.15.51:0/3519538395 conn(0x55a436f0e800 0x55a436f77000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:47:51.726 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 20 Event(0x55a436ea3040 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:51.726 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 20 Event(0x55a436ea3280 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:51.726 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8221cf5700 5 --1- 172.21.15.51:0/3519538395 >> 172.21.15.51:0/3519538395 conn(0x55a436f0e800 0x55a436f77000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:47:51.727 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8221cf5700 5 --1- 172.21.15.51:0/3519538395 >> 172.21.15.51:0/3519538395 conn(0x55a436f0e800 0x55a436f77000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:47:51.727 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 10 -- 172.21.15.51:0/3519538395 wait: waiting for dispatch queue 2020-06-27T04:47:51.728 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 10 -- 172.21.15.51:0/3519538395 wait: dispatch queue is stopped 2020-06-27T04:47:51.729 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 1 -- 172.21.15.51:0/3519538395 shutdown_connections 2020-06-27T04:47:51.729 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 5 -- 172.21.15.51:0/3519538395 shutdown_connections delete 0x55a436f0e800 2020-06-27T04:47:51.730 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 20 Event(0x55a436ea2e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:51.730 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 20 Event(0x55a436ea3040 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:51.730 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 20 Event(0x55a436ea3280 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:51.730 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 10 -- 172.21.15.51:0/3519538395 wait: done. 2020-06-27T04:47:51.730 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.383+0000 7f8227f72f40 1 -- 172.21.15.51:0/3519538395 wait complete. 2020-06-27T04:47:51.731 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[18409]: cluster 2020-06-27T04:47:50.383117+0000 mon.a (mon.0) 833 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:47:51.731 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[18409]: cluster 2020-06-27T04:47:50.383147+0000 mon.a (mon.0) 834 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:47:51.731 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[18409]: cluster 2020-06-27T04:47:50.387585+0000 mon.a (mon.0) 835 : cluster [INF] osd.5 v2:172.21.15.51:6801/2419134109 boot 2020-06-27T04:47:51.731 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[18409]: cluster 2020-06-27T04:47:50.387621+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e94: 8 total, 4 up, 8 in 2020-06-27T04:47:51.732 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[18409]: audit 2020-06-27T04:47:50.388433+0000 mon.b (mon.2) 280 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:47:51.732 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[18409]: cluster 2020-06-27T04:47:50.402294+0000 mon.a (mon.0) 837 : cluster [DBG] osd.3 reported immediately failed by osd.5 2020-06-27T04:47:51.732 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[18409]: cluster 2020-06-27T04:47:50.402335+0000 mon.a (mon.0) 838 : cluster [INF] osd.3 failed (root=default,host=smithi031) (connection refused reported by osd.5) 2020-06-27T04:47:51.732 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[18409]: cluster 2020-06-27T04:47:50.402503+0000 mon.a (mon.0) 839 : cluster [DBG] osd.3 reported immediately failed by osd.5 2020-06-27T04:47:51.732 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[18409]: cluster 2020-06-27T04:47:50.402666+0000 mon.a (mon.0) 840 : cluster [DBG] osd.1 reported immediately failed by osd.5 2020-06-27T04:47:51.733 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[18409]: cluster 2020-06-27T04:47:50.402707+0000 mon.a (mon.0) 841 : cluster [INF] osd.1 failed (root=default,host=smithi031) (connection refused reported by osd.5) 2020-06-27T04:47:51.733 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[18409]: audit 2020-06-27T04:47:51.045215+0000 mon.c (mon.1) 61 : audit [INF] from='osd.7 v2:172.21.15.51:6805/823481292' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:47:51.733 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[18409]: audit 2020-06-27T04:47:51.045497+0000 mon.a (mon.0) 842 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:47:51.733 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[18409]: audit 2020-06-27T04:47:51.046031+0000 mon.c (mon.1) 62 : audit [INF] from='osd.7 v2:172.21.15.51:6805/823481292' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:51.733 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[18409]: audit 2020-06-27T04:47:51.046263+0000 mon.a (mon.0) 843 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:51.973 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:51 smithi031 podman[44740]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1 found: no such container 2020-06-27T04:47:51.973 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:51 smithi031 systemd[1]: Started Ceph osd.1 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:51.974 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:51 smithi031 podman[44649]: 2020-06-27 04:47:51.858518424 +0000 UTC m=+1.564717493 container remove 77c321cb3ec5ee6230b038589a1e42832ef7e44d88751a8cf310e5baeb59c719 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:47:51.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:51 smithi031 podman[44705]: 2020-06-27 04:47:51.687850594 +0000 UTC m=+1.051883634 container attach 833d2173223687b3a360e2b282274d281f31327c57508e7c9e778c5a41fd6451 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:47:51.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[44699]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-06-27T04:47:51.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[44699]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2020-06-27T04:47:51.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[44699]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2020-06-27T04:47:51.975 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[44699]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2020-06-27T04:47:51.975 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[44699]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2020-06-27T04:47:51.975 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[44699]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-06-27T04:47:51.975 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:51 smithi031 bash[44699]: --> ceph-volume lvm activate successful for osd ID: 3 2020-06-27T04:47:51.976 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:51 smithi031 podman[44705]: 2020-06-27 04:47:51.834356652 +0000 UTC m=+1.198389705 container died 833d2173223687b3a360e2b282274d281f31327c57508e7c9e778c5a41fd6451 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:47:52.218 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[35168]: debug 2020-06-27T04:47:52.016+0000 7fd11cc26f40 -1 Falling back to public interface 2020-06-27T04:47:52.218 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:51 smithi051 bash[35135]: debug 2020-06-27T04:47:51.900+0000 7f8227f72f40 -1 Falling back to public interface 2020-06-27T04:47:52.557 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:52 smithi031 podman[44821]: 2020-06-27 04:47:52.486908204 +0000 UTC m=+0.770751121 container create b4210996aeb9b12cdfa8086ad62b4867f372286249b870705dc142eee8045cc9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:47:52.557 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:52 smithi031 podman[44797]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2 found: no such container 2020-06-27T04:47:52.558 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:52 smithi031 systemd[1]: Started Ceph osd.2 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:47:52.558 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[44647]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0 found: no such container 2020-06-27T04:47:52.558 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[18426]: cluster 2020-06-27T04:47:51.202090+0000 mgr.x (mgr.34109) 241 : cluster [DBG] pgmap v249: 865 pgs: 2 creating+down, 25 down, 160 peering, 2 stale+creating+incomplete, 1 stale+creating+down, 1 stale+down, 15 stale+undersized+degraded+peered, 4 activating+undersized, 65 stale+active+clean, 124 unknown, 9 stale+creating+peering, 5 creating+incomplete, 124 stale+peering, 34 stale+active+undersized+degraded, 10 undersized+degraded+peered, 83 stale+undersized+peered, 47 undersized+peered, 154 stale+active+undersized; 18 KiB data, 9.9 MiB used, 707 GiB / 715 GiB avail; 204 B/s wr, 0 op/s; 229/1014 objects degraded (22.584%); 4 B/s, 0 objects/s recovering 2020-06-27T04:47:52.558 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[18426]: cluster 2020-06-27T04:47:51.389104+0000 mon.a (mon.0) 844 : cluster [WRN] Health check update: Reduced data availability: 15 pgs inactive, 29 pgs down, 3 pgs peering, 7 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:47:52.559 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[18426]: cluster 2020-06-27T04:47:51.389141+0000 mon.a (mon.0) 845 : cluster [WRN] Health check update: Degraded data redundancy: 229/1014 objects degraded (22.584%), 59 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:52.559 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[18426]: cluster 2020-06-27T04:47:51.389151+0000 mon.a (mon.0) 846 : cluster [WRN] Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:47:52.559 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[18426]: cluster 2020-06-27T04:47:51.399644+0000 mon.a (mon.0) 847 : cluster [INF] osd.7 v2:172.21.15.51:6805/823481292 boot 2020-06-27T04:47:52.559 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[18426]: cluster 2020-06-27T04:47:51.399691+0000 mon.a (mon.0) 848 : cluster [DBG] osdmap e95: 8 total, 3 up, 8 in 2020-06-27T04:47:52.559 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[18426]: cluster 2020-06-27T04:47:51.415564+0000 mon.a (mon.0) 849 : cluster [DBG] osd.2 reported immediately failed by osd.7 2020-06-27T04:47:52.560 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[18426]: cluster 2020-06-27T04:47:51.415600+0000 mon.a (mon.0) 850 : cluster [INF] osd.2 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:47:52.560 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[18426]: audit 2020-06-27T04:47:51.447148+0000 mon.b (mon.2) 281 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:47:52.560 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[22603]: cluster 2020-06-27T04:47:51.202090+0000 mgr.x (mgr.34109) 241 : cluster [DBG] pgmap v249: 865 pgs: 2 creating+down, 25 down, 160 peering, 2 stale+creating+incomplete, 1 stale+creating+down, 1 stale+down, 15 stale+undersized+degraded+peered, 4 activating+undersized, 65 stale+active+clean, 124 unknown, 9 stale+creating+peering, 5 creating+incomplete, 124 stale+peering, 34 stale+active+undersized+degraded, 10 undersized+degraded+peered, 83 stale+undersized+peered, 47 undersized+peered, 154 stale+active+undersized; 18 KiB data, 9.9 MiB used, 707 GiB / 715 GiB avail; 204 B/s wr, 0 op/s; 229/1014 objects degraded (22.584%); 4 B/s, 0 objects/s recovering 2020-06-27T04:47:52.560 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[22603]: cluster 2020-06-27T04:47:51.389104+0000 mon.a (mon.0) 844 : cluster [WRN] Health check update: Reduced data availability: 15 pgs inactive, 29 pgs down, 3 pgs peering, 7 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:47:52.561 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[22603]: cluster 2020-06-27T04:47:51.389141+0000 mon.a (mon.0) 845 : cluster [WRN] Health check update: Degraded data redundancy: 229/1014 objects degraded (22.584%), 59 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:52.561 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[22603]: cluster 2020-06-27T04:47:51.389151+0000 mon.a (mon.0) 846 : cluster [WRN] Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:47:52.561 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[22603]: cluster 2020-06-27T04:47:51.399644+0000 mon.a (mon.0) 847 : cluster [INF] osd.7 v2:172.21.15.51:6805/823481292 boot 2020-06-27T04:47:52.561 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[22603]: cluster 2020-06-27T04:47:51.399691+0000 mon.a (mon.0) 848 : cluster [DBG] osdmap e95: 8 total, 3 up, 8 in 2020-06-27T04:47:52.561 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[22603]: cluster 2020-06-27T04:47:51.415564+0000 mon.a (mon.0) 849 : cluster [DBG] osd.2 reported immediately failed by osd.7 2020-06-27T04:47:52.562 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[22603]: cluster 2020-06-27T04:47:51.415600+0000 mon.a (mon.0) 850 : cluster [INF] osd.2 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:47:52.562 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[22603]: audit 2020-06-27T04:47:51.447148+0000 mon.b (mon.2) 281 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:47:52.718 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[35135]: debug 2020-06-27T04:47:52.640+0000 7f8227f72f40 -1 osd.6 88 log_to_monitors {default=true} 2020-06-27T04:47:52.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[18409]: cluster 2020-06-27T04:47:51.202090+0000 mgr.x (mgr.34109) 241 : cluster [DBG] pgmap v249: 865 pgs: 2 creating+down, 25 down, 160 peering, 2 stale+creating+incomplete, 1 stale+creating+down, 1 stale+down, 15 stale+undersized+degraded+peered, 4 activating+undersized, 65 stale+active+clean, 124 unknown, 9 stale+creating+peering, 5 creating+incomplete, 124 stale+peering, 34 stale+active+undersized+degraded, 10 undersized+degraded+peered, 83 stale+undersized+peered, 47 undersized+peered, 154 stale+active+undersized; 18 KiB data, 9.9 MiB used, 707 GiB / 715 GiB avail; 204 B/s wr, 0 op/s; 229/1014 objects degraded (22.584%); 4 B/s, 0 objects/s recovering 2020-06-27T04:47:52.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[18409]: cluster 2020-06-27T04:47:51.389104+0000 mon.a (mon.0) 844 : cluster [WRN] Health check update: Reduced data availability: 15 pgs inactive, 29 pgs down, 3 pgs peering, 7 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:47:52.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[18409]: cluster 2020-06-27T04:47:51.389141+0000 mon.a (mon.0) 845 : cluster [WRN] Health check update: Degraded data redundancy: 229/1014 objects degraded (22.584%), 59 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:52.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[18409]: cluster 2020-06-27T04:47:51.389151+0000 mon.a (mon.0) 846 : cluster [WRN] Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:47:52.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[18409]: cluster 2020-06-27T04:47:51.399644+0000 mon.a (mon.0) 847 : cluster [INF] osd.7 v2:172.21.15.51:6805/823481292 boot 2020-06-27T04:47:52.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[18409]: cluster 2020-06-27T04:47:51.399691+0000 mon.a (mon.0) 848 : cluster [DBG] osdmap e95: 8 total, 3 up, 8 in 2020-06-27T04:47:52.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[18409]: cluster 2020-06-27T04:47:51.415564+0000 mon.a (mon.0) 849 : cluster [DBG] osd.2 reported immediately failed by osd.7 2020-06-27T04:47:52.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[18409]: cluster 2020-06-27T04:47:51.415600+0000 mon.a (mon.0) 850 : cluster [INF] osd.2 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:47:52.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[18409]: audit 2020-06-27T04:47:51.447148+0000 mon.b (mon.2) 281 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:47:52.721 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:52.721 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: in thread 7f7930db4700 thread_name:tp_osd_tp 2020-06-27T04:47:52.721 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:52.721 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 1: (()+0x12dd0) [0x7f79563badd0] 2020-06-27T04:47:52.721 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5602da444707] 2020-06-27T04:47:52.722 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5602da444aa0] 2020-06-27T04:47:52.722 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5602da47667a] 2020-06-27T04:47:52.723 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5602da477a57] 2020-06-27T04:47:52.724 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5602da102938] 2020-06-27T04:47:52.724 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5602da2b303d] 2020-06-27T04:47:52.724 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5602da0705b0] 2020-06-27T04:47:52.724 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5602da0c989d] 2020-06-27T04:47:52.724 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5602da0d2380] 2020-06-27T04:47:52.725 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5602da0d9590] 2020-06-27T04:47:52.725 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5602d9f594e9] 2020-06-27T04:47:52.725 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5602da1bdf78] 2020-06-27T04:47:52.725 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5602d9f7870f] 2020-06-27T04:47:52.726 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5602da5b6b94] 2020-06-27T04:47:52.726 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5602da5b97f4] 2020-06-27T04:47:52.726 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 17: (()+0x82de) [0x7f79563b02de] 2020-06-27T04:47:52.726 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 18: (clone()+0x43) [0x7f79550e7e83] 2020-06-27T04:47:52.726 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: debug 2020-06-27T04:47:52.448+0000 7f7930db4700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:52.727 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: in thread 7f7930db4700 thread_name:tp_osd_tp 2020-06-27T04:47:52.727 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:52.727 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 1: (()+0x12dd0) [0x7f79563badd0] 2020-06-27T04:47:52.727 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5602da444707] 2020-06-27T04:47:52.727 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5602da444aa0] 2020-06-27T04:47:52.728 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5602da47667a] 2020-06-27T04:47:52.728 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5602da477a57] 2020-06-27T04:47:52.728 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5602da102938] 2020-06-27T04:47:52.728 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5602da2b303d] 2020-06-27T04:47:52.728 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5602da0705b0] 2020-06-27T04:47:52.729 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5602da0c989d] 2020-06-27T04:47:52.729 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5602da0d2380] 2020-06-27T04:47:52.729 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5602da0d9590] 2020-06-27T04:47:52.729 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5602d9f594e9] 2020-06-27T04:47:52.729 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5602da1bdf78] 2020-06-27T04:47:52.732 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5602d9f7870f] 2020-06-27T04:47:52.735 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5602da5b6b94] 2020-06-27T04:47:52.735 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5602da5b97f4] 2020-06-27T04:47:52.735 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 17: (()+0x82de) [0x7f79563b02de] 2020-06-27T04:47:52.735 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 18: (clone()+0x43) [0x7f79550e7e83] 2020-06-27T04:47:52.735 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:52.736 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: debug -9999> 2020-06-27T04:47:52.448+0000 7f7930db4700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:52.736 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: in thread 7f7930db4700 thread_name:tp_osd_tp 2020-06-27T04:47:52.736 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:52.736 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 1: (()+0x12dd0) [0x7f79563badd0] 2020-06-27T04:47:52.736 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5602da444707] 2020-06-27T04:47:52.737 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5602da444aa0] 2020-06-27T04:47:52.737 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5602da47667a] 2020-06-27T04:47:52.737 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5602da477a57] 2020-06-27T04:47:52.737 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5602da102938] 2020-06-27T04:47:52.738 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5602da2b303d] 2020-06-27T04:47:52.738 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5602da0705b0] 2020-06-27T04:47:52.738 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5602da0c989d] 2020-06-27T04:47:52.738 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5602da0d2380] 2020-06-27T04:47:52.738 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5602da0d9590] 2020-06-27T04:47:52.739 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5602d9f594e9] 2020-06-27T04:47:52.739 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5602da1bdf78] 2020-06-27T04:47:52.739 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5602d9f7870f] 2020-06-27T04:47:52.739 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5602da5b6b94] 2020-06-27T04:47:52.739 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5602da5b97f4] 2020-06-27T04:47:52.740 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 17: (()+0x82de) [0x7f79563b02de] 2020-06-27T04:47:52.740 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 18: (clone()+0x43) [0x7f79550e7e83] 2020-06-27T04:47:52.740 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:52.740 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: debug -9999> 2020-06-27T04:47:52.448+0000 7f7930db4700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:52.740 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: in thread 7f7930db4700 thread_name:tp_osd_tp 2020-06-27T04:47:52.741 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:52.741 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 1: (()+0x12dd0) [0x7f79563badd0] 2020-06-27T04:47:52.741 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5602da444707] 2020-06-27T04:47:52.741 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5602da444aa0] 2020-06-27T04:47:52.741 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5602da47667a] 2020-06-27T04:47:52.742 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5602da477a57] 2020-06-27T04:47:52.742 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5602da102938] 2020-06-27T04:47:52.742 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5602da2b303d] 2020-06-27T04:47:52.742 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5602da0705b0] 2020-06-27T04:47:52.742 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5602da0c989d] 2020-06-27T04:47:52.743 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5602da0d2380] 2020-06-27T04:47:52.743 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5602da0d9590] 2020-06-27T04:47:52.743 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5602d9f594e9] 2020-06-27T04:47:52.743 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5602da1bdf78] 2020-06-27T04:47:52.743 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5602d9f7870f] 2020-06-27T04:47:52.744 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5602da5b6b94] 2020-06-27T04:47:52.744 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5602da5b97f4] 2020-06-27T04:47:52.744 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 17: (()+0x82de) [0x7f79563b02de] 2020-06-27T04:47:52.744 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: 18: (clone()+0x43) [0x7f79550e7e83] 2020-06-27T04:47:52.744 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:52.745 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[34816]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:47:52.745 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:52 smithi051 podman[34994]: 2020-06-27 04:47:52.561654213 +0000 UTC m=+4.669947951 container died 61d9ddfedd14172af27a722f24c07716c763b9eaf8f684df45bb9ae74fee3ae1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:47:52.810 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:52 smithi031 podman[44821]: 2020-06-27 04:47:52.698238892 +0000 UTC m=+0.982081809 container init b4210996aeb9b12cdfa8086ad62b4867f372286249b870705dc142eee8045cc9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:47:52.811 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:52 smithi031 podman[44821]: 2020-06-27 04:47:52.765040366 +0000 UTC m=+1.048883275 container start b4210996aeb9b12cdfa8086ad62b4867f372286249b870705dc142eee8045cc9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:47:52.811 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:52 smithi031 podman[44821]: 2020-06-27 04:47:52.765110725 +0000 UTC m=+1.048953664 container attach b4210996aeb9b12cdfa8086ad62b4867f372286249b870705dc142eee8045cc9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:47:52.811 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:52 smithi031 podman[44705]: 2020-06-27 04:47:52.554808781 +0000 UTC m=+1.918841824 container remove 833d2173223687b3a360e2b282274d281f31327c57508e7c9e778c5a41fd6451 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:47:52.811 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[44647]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0 2020-06-27T04:47:52.812 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[44647]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0" found: no such container 2020-06-27T04:47:53.063 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:52 smithi031 podman[44890]: 2020-06-27 04:47:52.873850352 +0000 UTC m=+0.555084938 container create 4edf572c00f350c09134cec08a7027a246eca03041009d0a5007937893947d73 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:47:53.064 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[44699]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3 found: no such container 2020-06-27T04:47:53.064 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[44819]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-06-27T04:47:53.064 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[44819]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2020-06-27T04:47:53.064 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[44819]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2020-06-27T04:47:53.065 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[44819]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2020-06-27T04:47:53.065 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[44819]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2020-06-27T04:47:53.065 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[44819]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-06-27T04:47:53.065 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:52 smithi031 bash[44819]: --> ceph-volume lvm activate successful for osd ID: 1 2020-06-27T04:47:53.065 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:53 smithi031 podman[44821]: 2020-06-27 04:47:53.061349207 +0000 UTC m=+1.345192140 container died b4210996aeb9b12cdfa8086ad62b4867f372286249b870705dc142eee8045cc9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:47:53.106 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:52 smithi051 bash[35168]: debug 2020-06-27T04:47:52.776+0000 7fd11cc26f40 -1 osd.4 88 log_to_monitors {default=true} 2020-06-27T04:47:53.375 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:53 smithi051 podman[34994]: 2020-06-27 04:47:53.102883724 +0000 UTC m=+5.211177445 container remove 61d9ddfedd14172af27a722f24c07716c763b9eaf8f684df45bb9ae74fee3ae1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:47:53.376 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:53 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:47:53.416 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44699]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3 2020-06-27T04:47:53.737 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44699]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3" found: no such container 2020-06-27T04:47:53.739 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:53 smithi051 bash[18409]: cluster 2020-06-27T04:47:52.396382+0000 mon.a (mon.0) 851 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:47:53.739 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:53 smithi051 bash[18409]: cluster 2020-06-27T04:47:52.400087+0000 mon.a (mon.0) 852 : cluster [DBG] osdmap e96: 8 total, 2 up, 8 in 2020-06-27T04:47:53.739 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:53 smithi051 bash[18409]: audit 2020-06-27T04:47:52.645634+0000 mon.b (mon.2) 282 : audit [INF] from='osd.6 v2:172.21.15.51:6809/2876026578' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:47:53.740 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:53 smithi051 bash[18409]: audit 2020-06-27T04:47:52.646215+0000 mon.a (mon.0) 853 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:47:53.740 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:53 smithi051 bash[18409]: audit 2020-06-27T04:47:52.646780+0000 mon.b (mon.2) 283 : audit [INF] from='osd.6 v2:172.21.15.51:6809/2876026578' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:53.740 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:53 smithi051 bash[18409]: audit 2020-06-27T04:47:52.647029+0000 mon.a (mon.0) 854 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:53.740 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:53 smithi051 bash[18409]: audit 2020-06-27T04:47:52.781095+0000 mon.c (mon.1) 63 : audit [INF] from='osd.4 v2:172.21.15.51:6813/3629554987' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:47:53.740 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:53 smithi051 bash[18409]: audit 2020-06-27T04:47:52.781373+0000 mon.a (mon.0) 855 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:47:53.741 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:53 smithi051 bash[18409]: audit 2020-06-27T04:47:52.781977+0000 mon.c (mon.1) 64 : audit [INF] from='osd.4 v2:172.21.15.51:6813/3629554987' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:53.741 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:53 smithi051 bash[18409]: audit 2020-06-27T04:47:52.782225+0000 mon.a (mon.0) 856 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:53.741 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:53 smithi051 podman[36845]: 2020-06-27 04:47:53.368359715 +0000 UTC m=+0.248082103 container create 614f5b98585f6667627b48c5ac07d0a338976e5f8047733f2df507f4b8b477df (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:47:53.741 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:53 smithi051 podman[36845]: 2020-06-27 04:47:53.560011169 +0000 UTC m=+0.439733576 container init 614f5b98585f6667627b48c5ac07d0a338976e5f8047733f2df507f4b8b477df (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:47:53.742 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:53 smithi051 podman[36845]: 2020-06-27 04:47:53.64155239 +0000 UTC m=+0.521274806 container start 614f5b98585f6667627b48c5ac07d0a338976e5f8047733f2df507f4b8b477df (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:47:53.742 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:53 smithi051 podman[36845]: 2020-06-27 04:47:53.641644007 +0000 UTC m=+0.521366415 container attach 614f5b98585f6667627b48c5ac07d0a338976e5f8047733f2df507f4b8b477df (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:47:53.742 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:53 smithi031 podman[44890]: 2020-06-27 04:47:53.52979471 +0000 UTC m=+1.211029298 container init 4edf572c00f350c09134cec08a7027a246eca03041009d0a5007937893947d73 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:47:53.742 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:53 smithi031 podman[44890]: 2020-06-27 04:47:53.620230267 +0000 UTC m=+1.301464882 container start 4edf572c00f350c09134cec08a7027a246eca03041009d0a5007937893947d73 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:47:53.742 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:53 smithi031 podman[44890]: 2020-06-27 04:47:53.620320281 +0000 UTC m=+1.301554902 container attach 4edf572c00f350c09134cec08a7027a246eca03041009d0a5007937893947d73 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:47:53.743 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[18426]: cluster 2020-06-27T04:47:52.396382+0000 mon.a (mon.0) 851 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:47:53.743 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[18426]: cluster 2020-06-27T04:47:52.400087+0000 mon.a (mon.0) 852 : cluster [DBG] osdmap e96: 8 total, 2 up, 8 in 2020-06-27T04:47:53.743 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[18426]: audit 2020-06-27T04:47:52.645634+0000 mon.b (mon.2) 282 : audit [INF] from='osd.6 v2:172.21.15.51:6809/2876026578' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:47:53.743 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[18426]: audit 2020-06-27T04:47:52.646215+0000 mon.a (mon.0) 853 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:47:53.744 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[18426]: audit 2020-06-27T04:47:52.646780+0000 mon.b (mon.2) 283 : audit [INF] from='osd.6 v2:172.21.15.51:6809/2876026578' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:53.744 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[18426]: audit 2020-06-27T04:47:52.647029+0000 mon.a (mon.0) 854 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:53.744 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[18426]: audit 2020-06-27T04:47:52.781095+0000 mon.c (mon.1) 63 : audit [INF] from='osd.4 v2:172.21.15.51:6813/3629554987' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:47:53.744 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[18426]: audit 2020-06-27T04:47:52.781373+0000 mon.a (mon.0) 855 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:47:53.744 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[18426]: audit 2020-06-27T04:47:52.781977+0000 mon.c (mon.1) 64 : audit [INF] from='osd.4 v2:172.21.15.51:6813/3629554987' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:53.745 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[18426]: audit 2020-06-27T04:47:52.782225+0000 mon.a (mon.0) 856 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:53.745 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[22603]: cluster 2020-06-27T04:47:52.396382+0000 mon.a (mon.0) 851 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:47:53.745 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[22603]: cluster 2020-06-27T04:47:52.400087+0000 mon.a (mon.0) 852 : cluster [DBG] osdmap e96: 8 total, 2 up, 8 in 2020-06-27T04:47:53.745 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[22603]: audit 2020-06-27T04:47:52.645634+0000 mon.b (mon.2) 282 : audit [INF] from='osd.6 v2:172.21.15.51:6809/2876026578' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:47:53.746 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[22603]: audit 2020-06-27T04:47:52.646215+0000 mon.a (mon.0) 853 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:47:53.746 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[22603]: audit 2020-06-27T04:47:52.646780+0000 mon.b (mon.2) 283 : audit [INF] from='osd.6 v2:172.21.15.51:6809/2876026578' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:53.746 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[22603]: audit 2020-06-27T04:47:52.647029+0000 mon.a (mon.0) 854 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:53.746 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[22603]: audit 2020-06-27T04:47:52.781095+0000 mon.c (mon.1) 63 : audit [INF] from='osd.4 v2:172.21.15.51:6813/3629554987' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:47:53.746 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[22603]: audit 2020-06-27T04:47:52.781373+0000 mon.a (mon.0) 855 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:47:53.747 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[22603]: audit 2020-06-27T04:47:52.781977+0000 mon.c (mon.1) 64 : audit [INF] from='osd.4 v2:172.21.15.51:6813/3629554987' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:53.747 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[22603]: audit 2020-06-27T04:47:52.782225+0000 mon.a (mon.0) 856 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:47:53.959 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:53 smithi031 podman[44821]: 2020-06-27 04:47:53.696212407 +0000 UTC m=+1.980055340 container remove b4210996aeb9b12cdfa8086ad62b4867f372286249b870705dc142eee8045cc9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:47:53.960 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44885]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-06-27T04:47:53.960 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44885]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2020-06-27T04:47:53.960 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44885]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2020-06-27T04:47:53.961 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44885]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2020-06-27T04:47:53.961 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44885]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2020-06-27T04:47:53.961 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44885]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-06-27T04:47:53.961 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44885]: --> ceph-volume lvm activate successful for osd ID: 2 2020-06-27T04:47:53.961 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 podman[44920]: 2020-06-27 04:47:53.69577999 +0000 UTC m=+1.120300848 container create c46c6ee631fa3abe70e91c27cd2ba1dc34ba3c8f8dbf616482bc24f02bec798f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:47:53.962 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 podman[44920]: 2020-06-27 04:47:53.885037332 +0000 UTC m=+1.309558265 container init c46c6ee631fa3abe70e91c27cd2ba1dc34ba3c8f8dbf616482bc24f02bec798f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:47:53.962 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 podman[44920]: 2020-06-27 04:47:53.956954717 +0000 UTC m=+1.381475590 container start c46c6ee631fa3abe70e91c27cd2ba1dc34ba3c8f8dbf616482bc24f02bec798f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:47:53.962 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 10 -- 172.21.15.31:0/2472555673 shutdown 172.21.15.31:0/2472555673 2020-06-27T04:47:53.962 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 10 Processor -- stop 2020-06-27T04:47:53.962 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 20 Event(0x555cd17e4e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:54.218 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:53 smithi051 podman[36845]: 2020-06-27 04:47:53.900598942 +0000 UTC m=+0.780321349 container died 614f5b98585f6667627b48c5ac07d0a338976e5f8047733f2df507f4b8b477df (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:47:54.223 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44819]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1 found: no such container 2020-06-27T04:47:54.223 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:53 smithi031 podman[44890]: 2020-06-27 04:47:53.962591476 +0000 UTC m=+1.643826247 container died 4edf572c00f350c09134cec08a7027a246eca03041009d0a5007937893947d73 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:47:54.224 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 1 -- 172.21.15.31:0/2472555673 shutdown_connections 2020-06-27T04:47:54.224 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 5 -- 172.21.15.31:0/2472555673 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x555cd1850c00 2020-06-27T04:47:54.224 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 1 --2- 172.21.15.31:0/2472555673 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x555cd1850c00 0x555cd17c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:54.224 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 5 -- 172.21.15.31:0/2472555673 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x555cd1851400 2020-06-27T04:47:54.224 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 1 --2- 172.21.15.31:0/2472555673 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x555cd1851400 0x555cd17c2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:54.225 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 5 -- 172.21.15.31:0/2472555673 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x555cd1851000 2020-06-27T04:47:54.225 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 1 --2- 172.21.15.31:0/2472555673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555cd1851000 0x555cd17c1e00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:54.225 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 5 -- 172.21.15.31:0/2472555673 shutdown_connections delete 0x555cd1850c00 2020-06-27T04:47:54.225 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 5 -- 172.21.15.31:0/2472555673 shutdown_connections delete 0x555cd1851000 2020-06-27T04:47:54.226 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 5 -- 172.21.15.31:0/2472555673 shutdown_connections delete 0x555cd1851400 2020-06-27T04:47:54.226 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 podman[44920]: 2020-06-27 04:47:53.957023144 +0000 UTC m=+1.381544011 container attach c46c6ee631fa3abe70e91c27cd2ba1dc34ba3c8f8dbf616482bc24f02bec798f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:47:54.226 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 1 -- 172.21.15.31:0/2472555673 >> 172.21.15.31:0/2472555673 conn(0x555cd1850800 msgr2=0x555cd18b9000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:47:54.226 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 20 --1- 172.21.15.31:0/2472555673 >> 172.21.15.31:0/2472555673 conn(0x555cd1850800 0x555cd18b9000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:54.226 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 2 --1- 172.21.15.31:0/2472555673 >> 172.21.15.31:0/2472555673 conn(0x555cd1850800 0x555cd18b9000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:54.227 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 5 --1- 172.21.15.31:0/2472555673 >> 172.21.15.31:0/2472555673 conn(0x555cd1850800 0x555cd18b9000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:47:54.227 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 20 Event(0x555cd17e4e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:54.227 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 10 --1- 172.21.15.31:0/2472555673 >> 172.21.15.31:0/2472555673 conn(0x555cd1850800 0x555cd18b9000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:47:54.227 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 20 Event(0x555cd17e4e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:54.228 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 20 Event(0x555cd17e5040 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:54.228 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f165c2fa700 5 --1- 172.21.15.31:0/2472555673 >> 172.21.15.31:0/2472555673 conn(0x555cd1850800 0x555cd18b9000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:47:54.228 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 20 Event(0x555cd17e5280 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:54.228 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f165c2fa700 5 --1- 172.21.15.31:0/2472555673 >> 172.21.15.31:0/2472555673 conn(0x555cd1850800 0x555cd18b9000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:47:54.228 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 10 -- 172.21.15.31:0/2472555673 wait: waiting for dispatch queue 2020-06-27T04:47:54.229 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 10 -- 172.21.15.31:0/2472555673 wait: dispatch queue is stopped 2020-06-27T04:47:54.229 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 1 -- 172.21.15.31:0/2472555673 shutdown_connections 2020-06-27T04:47:54.229 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 5 -- 172.21.15.31:0/2472555673 shutdown_connections delete 0x555cd1850800 2020-06-27T04:47:54.229 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 20 Event(0x555cd17e4e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:54.230 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 20 Event(0x555cd17e5040 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:54.230 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 20 Event(0x555cd17e5280 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:54.230 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 10 -- 172.21.15.31:0/2472555673 wait: done. 2020-06-27T04:47:54.231 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:53 smithi031 bash[44647]: debug 2020-06-27T04:47:53.912+0000 7f1662577f40 1 -- 172.21.15.31:0/2472555673 wait complete. 2020-06-27T04:47:54.642 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44819]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1 2020-06-27T04:47:54.642 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44819]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1" found: no such container 2020-06-27T04:47:54.643 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 podman[45048]: 2020-06-27 04:47:54.364666997 +0000 UTC m=+1.255633087 container create 87c2eaa1c2c48fd70e8248ea3ad144badb3967b24883a72e149dd498659fbf74 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:47:54.643 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:53.203898+0000 mgr.x (mgr.34109) 242 : cluster [DBG] pgmap v252: 865 pgs: 3 creating+down, 28 down, 284 peering, 2 stale+creating+incomplete, 1 stale+down, 12 stale+undersized+degraded+peered, 4 activating+undersized, 40 stale+active+clean, 121 unknown, 7 stale+creating+peering, 5 creating+incomplete, 43 stale+peering, 27 stale+active+undersized+degraded, 11 undersized+degraded+peered, 86 stale+undersized+peered, 62 undersized+peered, 129 stale+active+undersized; 18 KiB data, 10 MiB used, 707 GiB / 715 GiB avail; 341 B/s wr, 0 op/s; 213/1014 objects degraded (21.006%); 7 B/s, 0 objects/s recovering 2020-06-27T04:47:54.643 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:53.415082+0000 mon.a (mon.0) 857 : cluster [INF] osd.6 v2:172.21.15.51:6809/2876026578 boot 2020-06-27T04:47:54.643 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:53.415112+0000 mon.a (mon.0) 858 : cluster [INF] osd.4 v2:172.21.15.51:6813/3629554987 boot 2020-06-27T04:47:54.644 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:53.415137+0000 mon.a (mon.0) 859 : cluster [DBG] osdmap e97: 8 total, 4 up, 8 in 2020-06-27T04:47:54.644 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: audit 2020-06-27T04:47:53.460860+0000 mon.b (mon.2) 284 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:47:54.644 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: audit 2020-06-27T04:47:53.461188+0000 mon.b (mon.2) 285 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:47:54.644 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:53.478400+0000 mon.a (mon.0) 860 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:54.644 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:53.478429+0000 mon.a (mon.0) 861 : cluster [INF] osd.5 failed (root=default,host=smithi051) (connection refused reported by osd.6) 2020-06-27T04:47:54.645 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:53.478751+0000 mon.a (mon.0) 862 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:54.645 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:53.503975+0000 mon.a (mon.0) 863 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:54.645 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:53.505721+0000 mon.a (mon.0) 864 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:54.645 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:53.667073+0000 mon.a (mon.0) 865 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:54.645 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:53.678893+0000 mon.a (mon.0) 866 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:54.646 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:53.704186+0000 mon.a (mon.0) 867 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:54.646 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:53.706035+0000 mon.a (mon.0) 868 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:54.646 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:53.891406+0000 mon.a (mon.0) 869 : cluster [DBG] osd.5 reported immediately failed by osd.7 2020-06-27T04:47:54.646 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:53.891566+0000 mon.a (mon.0) 870 : cluster [DBG] osd.5 reported immediately failed by osd.7 2020-06-27T04:47:54.646 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:53.891720+0000 mon.a (mon.0) 871 : cluster [DBG] osd.5 reported immediately failed by osd.7 2020-06-27T04:47:54.646 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:54.068185+0000 mon.a (mon.0) 872 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:54.647 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:54.080230+0000 mon.a (mon.0) 873 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:54.647 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:54.105344+0000 mon.a (mon.0) 874 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:54.647 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[22603]: cluster 2020-06-27T04:47:54.106888+0000 mon.a (mon.0) 875 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:54.647 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44647]: debug 2020-06-27T04:47:54.454+0000 7f1662577f40 -1 Falling back to public interface 2020-06-27T04:47:54.648 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:53.203898+0000 mgr.x (mgr.34109) 242 : cluster [DBG] pgmap v252: 865 pgs: 3 creating+down, 28 down, 284 peering, 2 stale+creating+incomplete, 1 stale+down, 12 stale+undersized+degraded+peered, 4 activating+undersized, 40 stale+active+clean, 121 unknown, 7 stale+creating+peering, 5 creating+incomplete, 43 stale+peering, 27 stale+active+undersized+degraded, 11 undersized+degraded+peered, 86 stale+undersized+peered, 62 undersized+peered, 129 stale+active+undersized; 18 KiB data, 10 MiB used, 707 GiB / 715 GiB avail; 341 B/s wr, 0 op/s; 213/1014 objects degraded (21.006%); 7 B/s, 0 objects/s recovering 2020-06-27T04:47:54.648 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:53.415082+0000 mon.a (mon.0) 857 : cluster [INF] osd.6 v2:172.21.15.51:6809/2876026578 boot 2020-06-27T04:47:54.648 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:53.415112+0000 mon.a (mon.0) 858 : cluster [INF] osd.4 v2:172.21.15.51:6813/3629554987 boot 2020-06-27T04:47:54.648 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:53.415137+0000 mon.a (mon.0) 859 : cluster [DBG] osdmap e97: 8 total, 4 up, 8 in 2020-06-27T04:47:54.648 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: audit 2020-06-27T04:47:53.460860+0000 mon.b (mon.2) 284 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:47:54.649 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: audit 2020-06-27T04:47:53.461188+0000 mon.b (mon.2) 285 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:47:54.649 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:53.478400+0000 mon.a (mon.0) 860 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:54.649 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:53.478429+0000 mon.a (mon.0) 861 : cluster [INF] osd.5 failed (root=default,host=smithi051) (connection refused reported by osd.6) 2020-06-27T04:47:54.649 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:53.478751+0000 mon.a (mon.0) 862 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:54.649 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:53.503975+0000 mon.a (mon.0) 863 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:54.650 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:53.505721+0000 mon.a (mon.0) 864 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:54.650 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:53.667073+0000 mon.a (mon.0) 865 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:54.650 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:53.678893+0000 mon.a (mon.0) 866 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:54.650 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:53.704186+0000 mon.a (mon.0) 867 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:54.650 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:53.706035+0000 mon.a (mon.0) 868 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:54.651 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:53.891406+0000 mon.a (mon.0) 869 : cluster [DBG] osd.5 reported immediately failed by osd.7 2020-06-27T04:47:54.651 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:53.891566+0000 mon.a (mon.0) 870 : cluster [DBG] osd.5 reported immediately failed by osd.7 2020-06-27T04:47:54.651 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:53.891720+0000 mon.a (mon.0) 871 : cluster [DBG] osd.5 reported immediately failed by osd.7 2020-06-27T04:47:54.651 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:54.068185+0000 mon.a (mon.0) 872 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:54.651 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:54.080230+0000 mon.a (mon.0) 873 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:54.652 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:54.105344+0000 mon.a (mon.0) 874 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:54.652 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[18426]: cluster 2020-06-27T04:47:54.106888+0000 mon.a (mon.0) 875 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:54.718 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:54 smithi051 podman[36845]: 2020-06-27 04:47:54.43308124 +0000 UTC m=+1.312803643 container remove 614f5b98585f6667627b48c5ac07d0a338976e5f8047733f2df507f4b8b477df (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:47:54.718 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:47:54 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Failed with result 'exit-code'. 2020-06-27T04:47:54.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:53.203898+0000 mgr.x (mgr.34109) 242 : cluster [DBG] pgmap v252: 865 pgs: 3 creating+down, 28 down, 284 peering, 2 stale+creating+incomplete, 1 stale+down, 12 stale+undersized+degraded+peered, 4 activating+undersized, 40 stale+active+clean, 121 unknown, 7 stale+creating+peering, 5 creating+incomplete, 43 stale+peering, 27 stale+active+undersized+degraded, 11 undersized+degraded+peered, 86 stale+undersized+peered, 62 undersized+peered, 129 stale+active+undersized; 18 KiB data, 10 MiB used, 707 GiB / 715 GiB avail; 341 B/s wr, 0 op/s; 213/1014 objects degraded (21.006%); 7 B/s, 0 objects/s recovering 2020-06-27T04:47:54.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:53.415082+0000 mon.a (mon.0) 857 : cluster [INF] osd.6 v2:172.21.15.51:6809/2876026578 boot 2020-06-27T04:47:54.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:53.415112+0000 mon.a (mon.0) 858 : cluster [INF] osd.4 v2:172.21.15.51:6813/3629554987 boot 2020-06-27T04:47:54.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:53.415137+0000 mon.a (mon.0) 859 : cluster [DBG] osdmap e97: 8 total, 4 up, 8 in 2020-06-27T04:47:54.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: audit 2020-06-27T04:47:53.460860+0000 mon.b (mon.2) 284 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:47:54.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: audit 2020-06-27T04:47:53.461188+0000 mon.b (mon.2) 285 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:47:54.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:53.478400+0000 mon.a (mon.0) 860 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:54.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:53.478429+0000 mon.a (mon.0) 861 : cluster [INF] osd.5 failed (root=default,host=smithi051) (connection refused reported by osd.6) 2020-06-27T04:47:54.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:53.478751+0000 mon.a (mon.0) 862 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:54.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:53.503975+0000 mon.a (mon.0) 863 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:54.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:53.505721+0000 mon.a (mon.0) 864 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:54.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:53.667073+0000 mon.a (mon.0) 865 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:54.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:53.678893+0000 mon.a (mon.0) 866 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:54.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:53.704186+0000 mon.a (mon.0) 867 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:54.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:53.706035+0000 mon.a (mon.0) 868 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:54.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:53.891406+0000 mon.a (mon.0) 869 : cluster [DBG] osd.5 reported immediately failed by osd.7 2020-06-27T04:47:54.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:53.891566+0000 mon.a (mon.0) 870 : cluster [DBG] osd.5 reported immediately failed by osd.7 2020-06-27T04:47:54.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:53.891720+0000 mon.a (mon.0) 871 : cluster [DBG] osd.5 reported immediately failed by osd.7 2020-06-27T04:47:54.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:54.068185+0000 mon.a (mon.0) 872 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:54.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:54.080230+0000 mon.a (mon.0) 873 : cluster [DBG] osd.5 reported immediately failed by osd.6 2020-06-27T04:47:54.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:54.105344+0000 mon.a (mon.0) 874 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:54.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:54 smithi051 bash[18409]: cluster 2020-06-27T04:47:54.106888+0000 mon.a (mon.0) 875 : cluster [DBG] osd.5 reported immediately failed by osd.4 2020-06-27T04:47:54.908 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:54 smithi031 podman[44890]: 2020-06-27 04:47:54.644422396 +0000 UTC m=+2.325657014 container remove 4edf572c00f350c09134cec08a7027a246eca03041009d0a5007937893947d73 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:47:54.909 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44885]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2 found: no such container 2020-06-27T04:47:54.909 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 podman[45048]: 2020-06-27 04:47:54.639586929 +0000 UTC m=+1.530552875 container init 87c2eaa1c2c48fd70e8248ea3ad144badb3967b24883a72e149dd498659fbf74 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:47:54.909 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 podman[45048]: 2020-06-27 04:47:54.694948761 +0000 UTC m=+1.585914712 container start 87c2eaa1c2c48fd70e8248ea3ad144badb3967b24883a72e149dd498659fbf74 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:47:54.910 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 podman[45048]: 2020-06-27 04:47:54.695021265 +0000 UTC m=+1.585987220 container attach 87c2eaa1c2c48fd70e8248ea3ad144badb3967b24883a72e149dd498659fbf74 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:47:54.910 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f46c1f700 20 EpollDriver.del_event del event fd=16 cur_mask=1 delmask=3 to 5 2020-06-27T04:47:54.910 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 10 -- 172.21.15.31:0/292080431 shutdown 172.21.15.31:0/292080431 2020-06-27T04:47:54.910 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 10 Processor -- stop 2020-06-27T04:47:54.910 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 20 Event(0x55ffbc006e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:54.911 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 1 -- 172.21.15.31:0/292080431 shutdown_connections 2020-06-27T04:47:54.911 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 5 -- 172.21.15.31:0/292080431 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55ffbc072c00 2020-06-27T04:47:54.911 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 1 --2- 172.21.15.31:0/292080431 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55ffbc072c00 0x55ffbbfe3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:54.911 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 5 -- 172.21.15.31:0/292080431 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55ffbc073400 2020-06-27T04:47:54.911 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 1 --2- 172.21.15.31:0/292080431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ffbc073400 0x55ffbbfe4300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:54.912 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 5 -- 172.21.15.31:0/292080431 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55ffbc073000 2020-06-27T04:47:54.912 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 1 --2- 172.21.15.31:0/292080431 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55ffbc073000 0x55ffbbfe3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:54.912 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 5 -- 172.21.15.31:0/292080431 shutdown_connections delete 0x55ffbc072c00 2020-06-27T04:47:54.912 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 5 -- 172.21.15.31:0/292080431 shutdown_connections delete 0x55ffbc073000 2020-06-27T04:47:54.912 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 5 -- 172.21.15.31:0/292080431 shutdown_connections delete 0x55ffbc073400 2020-06-27T04:47:54.912 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 1 -- 172.21.15.31:0/292080431 >> 172.21.15.31:0/292080431 conn(0x55ffbc072800 msgr2=0x55ffbc0db000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:47:54.913 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 20 --1- 172.21.15.31:0/292080431 >> 172.21.15.31:0/292080431 conn(0x55ffbc072800 0x55ffbc0db000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:54.913 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 2 --1- 172.21.15.31:0/292080431 >> 172.21.15.31:0/292080431 conn(0x55ffbc072800 0x55ffbc0db000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:54.913 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 5 --1- 172.21.15.31:0/292080431 >> 172.21.15.31:0/292080431 conn(0x55ffbc072800 0x55ffbc0db000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:47:54.913 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 20 Event(0x55ffbc006e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:54.913 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 10 --1- 172.21.15.31:0/292080431 >> 172.21.15.31:0/292080431 conn(0x55ffbc072800 0x55ffbc0db000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:47:54.914 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 20 Event(0x55ffbc006e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:54.914 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 20 Event(0x55ffbc007040 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:54.914 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f46c1f700 5 --1- 172.21.15.31:0/292080431 >> 172.21.15.31:0/292080431 conn(0x55ffbc072800 0x55ffbc0db000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:47:54.914 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f4ce9cf40 20 Event(0x55ffbc007280 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:54.914 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:54 smithi031 bash[44699]: debug 2020-06-27T04:47:54.664+0000 7f6f46c1f700 5 --1- 172.21.15.31:0/292080431 >> 172.21.15.31:0/292080431 conn(0x55ffbc072800 0x55ffbc0db000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:47:55.190 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2 2020-06-27T04:47:55.191 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2" found: no such container 2020-06-27T04:47:55.191 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:54 smithi031 podman[45183]: 2020-06-27 04:47:54.906165882 +0000 UTC m=+0.506261879 container create c19f5a50f90454f1364b80895ba41ede5f3a94782e0e75eb95375a79f9fdb73e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:47:55.191 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 podman[45183]: 2020-06-27 04:47:55.056106403 +0000 UTC m=+0.656202247 container init c19f5a50f90454f1364b80895ba41ede5f3a94782e0e75eb95375a79f9fdb73e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:47:55.191 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 podman[45183]: 2020-06-27 04:47:55.106094574 +0000 UTC m=+0.706190415 container start c19f5a50f90454f1364b80895ba41ede5f3a94782e0e75eb95375a79f9fdb73e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:47:55.192 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 podman[45183]: 2020-06-27 04:47:55.106181856 +0000 UTC m=+0.706277723 container attach c19f5a50f90454f1364b80895ba41ede5f3a94782e0e75eb95375a79f9fdb73e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:47:55.192 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 10 -- 172.21.15.31:0/4184588809 shutdown 172.21.15.31:0/4184588809 2020-06-27T04:47:55.192 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 10 Processor -- stop 2020-06-27T04:47:55.192 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 20 Event(0x5614fbe58e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:55.192 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 1 -- 172.21.15.31:0/4184588809 shutdown_connections 2020-06-27T04:47:55.193 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 5 -- 172.21.15.31:0/4184588809 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x5614fbec5400 2020-06-27T04:47:55.193 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 1 --2- 172.21.15.31:0/4184588809 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5614fbec5400 0x5614fbe36300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:55.193 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 5 -- 172.21.15.31:0/4184588809 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x5614fbec4c00 2020-06-27T04:47:55.193 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 1 --2- 172.21.15.31:0/4184588809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5614fbec4c00 0x5614fbe35400 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:55.193 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 5 -- 172.21.15.31:0/4184588809 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x5614fbec5000 2020-06-27T04:47:55.194 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 1 --2- 172.21.15.31:0/4184588809 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x5614fbec5000 0x5614fbe35e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:55.194 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 5 -- 172.21.15.31:0/4184588809 shutdown_connections delete 0x5614fbec4c00 2020-06-27T04:47:55.194 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 5 -- 172.21.15.31:0/4184588809 shutdown_connections delete 0x5614fbec5000 2020-06-27T04:47:55.194 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 5 -- 172.21.15.31:0/4184588809 shutdown_connections delete 0x5614fbec5400 2020-06-27T04:47:55.194 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 1 -- 172.21.15.31:0/4184588809 >> 172.21.15.31:0/4184588809 conn(0x5614fbec4800 msgr2=0x5614fbf2d000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:47:55.194 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 20 --1- 172.21.15.31:0/4184588809 >> 172.21.15.31:0/4184588809 conn(0x5614fbec4800 0x5614fbf2d000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:55.202 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 2 --1- 172.21.15.31:0/4184588809 >> 172.21.15.31:0/4184588809 conn(0x5614fbec4800 0x5614fbf2d000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:55.202 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 5 --1- 172.21.15.31:0/4184588809 >> 172.21.15.31:0/4184588809 conn(0x5614fbec4800 0x5614fbf2d000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:47:55.202 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 20 Event(0x5614fbe58e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:55.202 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf87959700 5 --1- 172.21.15.31:0/4184588809 >> 172.21.15.31:0/4184588809 conn(0x5614fbec4800 0x5614fbf2d000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:47:55.203 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 10 --1- 172.21.15.31:0/4184588809 >> 172.21.15.31:0/4184588809 conn(0x5614fbec4800 0x5614fbf2d000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:47:55.203 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 20 Event(0x5614fbe58e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:55.203 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 20 Event(0x5614fbe59040 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:55.203 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf87959700 5 --1- 172.21.15.31:0/4184588809 >> 172.21.15.31:0/4184588809 conn(0x5614fbec4800 0x5614fbf2d000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:47:55.203 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.078+0000 7fdf8dbd6f40 20 Event(0x5614fbe59280 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:55.465 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[18426]: cluster 2020-06-27T04:47:54.421308+0000 mon.a (mon.0) 876 : cluster [DBG] osdmap e98: 8 total, 3 up, 8 in 2020-06-27T04:47:55.466 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[18426]: audit 2020-06-27T04:47:55.199815+0000 mon.c (mon.1) 65 : audit [INF] from='osd.0 v2:172.21.15.31:6800/1402489281' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:47:55.466 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[18426]: audit 2020-06-27T04:47:55.200093+0000 mon.a (mon.0) 877 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:47:55.466 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[18426]: audit 2020-06-27T04:47:55.200631+0000 mon.c (mon.1) 66 : audit [INF] from='osd.0 v2:172.21.15.31:6800/1402489281' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:55.466 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[18426]: audit 2020-06-27T04:47:55.200869+0000 mon.a (mon.0) 878 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:55.467 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[18426]: cluster 2020-06-27T04:47:55.415253+0000 mon.a (mon.0) 879 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:47:55.467 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[18426]: cluster 2020-06-27T04:47:55.415284+0000 mon.a (mon.0) 880 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:47:55.467 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[18426]: cluster 2020-06-27T04:47:55.419256+0000 mon.a (mon.0) 881 : cluster [INF] osd.0 v2:172.21.15.31:6800/1402489281 boot 2020-06-27T04:47:55.467 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[18426]: cluster 2020-06-27T04:47:55.419308+0000 mon.a (mon.0) 882 : cluster [DBG] osdmap e99: 8 total, 4 up, 8 in 2020-06-27T04:47:55.467 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[18426]: audit 2020-06-27T04:47:55.421837+0000 mon.b (mon.2) 286 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:47:55.468 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44647]: debug 2020-06-27T04:47:55.195+0000 7f1662577f40 -1 osd.0 88 log_to_monitors {default=true} 2020-06-27T04:47:55.468 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44819]: debug 2020-06-27T04:47:55.345+0000 7fdf8dbd6f40 -1 Falling back to public interface 2020-06-27T04:47:55.468 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 podman[45451]: 2020-06-27 04:47:55.381081468 +0000 UTC m=+0.365379620 container create fd55e23de6f2d0cade051ca4312397a21914e26b7d0bdd43b6e752893aeb9412 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:47:55.468 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44699]: debug 2020-06-27T04:47:55.187+0000 7f6f4ce9cf40 -1 Falling back to public interface 2020-06-27T04:47:55.469 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[22603]: cluster 2020-06-27T04:47:54.421308+0000 mon.a (mon.0) 876 : cluster [DBG] osdmap e98: 8 total, 3 up, 8 in 2020-06-27T04:47:55.469 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[22603]: audit 2020-06-27T04:47:55.199815+0000 mon.c (mon.1) 65 : audit [INF] from='osd.0 v2:172.21.15.31:6800/1402489281' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:47:55.469 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[22603]: audit 2020-06-27T04:47:55.200093+0000 mon.a (mon.0) 877 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:47:55.470 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[22603]: audit 2020-06-27T04:47:55.200631+0000 mon.c (mon.1) 66 : audit [INF] from='osd.0 v2:172.21.15.31:6800/1402489281' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:55.470 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[22603]: audit 2020-06-27T04:47:55.200869+0000 mon.a (mon.0) 878 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:55.470 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[22603]: cluster 2020-06-27T04:47:55.415253+0000 mon.a (mon.0) 879 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:47:55.471 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[22603]: cluster 2020-06-27T04:47:55.415284+0000 mon.a (mon.0) 880 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:47:55.471 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[22603]: cluster 2020-06-27T04:47:55.419256+0000 mon.a (mon.0) 881 : cluster [INF] osd.0 v2:172.21.15.31:6800/1402489281 boot 2020-06-27T04:47:55.471 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[22603]: cluster 2020-06-27T04:47:55.419308+0000 mon.a (mon.0) 882 : cluster [DBG] osdmap e99: 8 total, 4 up, 8 in 2020-06-27T04:47:55.471 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[22603]: audit 2020-06-27T04:47:55.421837+0000 mon.b (mon.2) 286 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:47:55.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:55 smithi051 bash[18409]: cluster 2020-06-27T04:47:54.421308+0000 mon.a (mon.0) 876 : cluster [DBG] osdmap e98: 8 total, 3 up, 8 in 2020-06-27T04:47:55.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:55 smithi051 bash[18409]: audit 2020-06-27T04:47:55.199815+0000 mon.c (mon.1) 65 : audit [INF] from='osd.0 v2:172.21.15.31:6800/1402489281' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:47:55.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:55 smithi051 bash[18409]: audit 2020-06-27T04:47:55.200093+0000 mon.a (mon.0) 877 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:47:55.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:55 smithi051 bash[18409]: audit 2020-06-27T04:47:55.200631+0000 mon.c (mon.1) 66 : audit [INF] from='osd.0 v2:172.21.15.31:6800/1402489281' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:55.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:55 smithi051 bash[18409]: audit 2020-06-27T04:47:55.200869+0000 mon.a (mon.0) 878 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:55.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:55 smithi051 bash[18409]: cluster 2020-06-27T04:47:55.415253+0000 mon.a (mon.0) 879 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:47:55.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:55 smithi051 bash[18409]: cluster 2020-06-27T04:47:55.415284+0000 mon.a (mon.0) 880 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:47:55.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:55 smithi051 bash[18409]: cluster 2020-06-27T04:47:55.419256+0000 mon.a (mon.0) 881 : cluster [INF] osd.0 v2:172.21.15.31:6800/1402489281 boot 2020-06-27T04:47:55.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:55 smithi051 bash[18409]: cluster 2020-06-27T04:47:55.419308+0000 mon.a (mon.0) 882 : cluster [DBG] osdmap e99: 8 total, 4 up, 8 in 2020-06-27T04:47:55.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:55 smithi051 bash[18409]: audit 2020-06-27T04:47:55.421837+0000 mon.b (mon.2) 286 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:47:55.827 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 podman[45451]: 2020-06-27 04:47:55.522692017 +0000 UTC m=+0.506990165 container init fd55e23de6f2d0cade051ca4312397a21914e26b7d0bdd43b6e752893aeb9412 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:47:55.828 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 podman[45451]: 2020-06-27 04:47:55.556039184 +0000 UTC m=+0.540337323 container start fd55e23de6f2d0cade051ca4312397a21914e26b7d0bdd43b6e752893aeb9412 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:47:55.828 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 podman[45451]: 2020-06-27 04:47:55.556113525 +0000 UTC m=+0.540411683 container attach fd55e23de6f2d0cade051ca4312397a21914e26b7d0bdd43b6e752893aeb9412 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:47:55.828 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.555+0000 7f6122f72f40 10 -- 172.21.15.31:0/62324652 shutdown 172.21.15.31:0/62324652 2020-06-27T04:47:55.828 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.555+0000 7f6122f72f40 10 Processor -- stop 2020-06-27T04:47:55.829 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.555+0000 7f611c4f4700 5 --2- 172.21.15.31:0/62324652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aace772c00 0x55aace6e3400 secure :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0x55aace6f5a70 tx=0x55aace6c2c00).reset_recv_state (warped) reseting crypto handlers 2020-06-27T04:47:55.829 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.555+0000 7f611c4f4700 5 --2- 172.21.15.31:0/62324652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aace772c00 0x55aace6e3400 secure :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0x55aace6f5a70 tx=0x55aace6c2c00).reset_security 2020-06-27T04:47:55.829 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.555+0000 7f611c4f4700 20 EpollDriver.del_event del event fd=16 cur_mask=1 delmask=3 to 8 2020-06-27T04:47:55.829 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f611ccf5700 20 -- 172.21.15.31:0/62324652 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55aace773400 msgr2=0x55aace6e4300 unknown :-1 s=STATE_CLOSED l=0).process 2020-06-27T04:47:55.829 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f611ccf5700 20 -- 172.21.15.31:0/62324652 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55aace773400 msgr2=0x55aace6e4300 unknown :-1 s=STATE_CLOSED l=0).process socket closed 2020-06-27T04:47:55.830 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f611ccf5700 5 --2- 172.21.15.31:0/62324652 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55aace773400 0x55aace6e4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).reset_recv_state (warped) reseting crypto handlers 2020-06-27T04:47:55.830 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f611ccf5700 5 --2- 172.21.15.31:0/62324652 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55aace773400 0x55aace6e4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).reset_security 2020-06-27T04:47:55.830 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f611ccf5700 20 EpollDriver.del_event del event fd=15 cur_mask=1 delmask=3 to 5 2020-06-27T04:47:55.830 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f6122f72f40 1 -- 172.21.15.31:0/62324652 shutdown_connections 2020-06-27T04:47:55.831 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f6122f72f40 5 -- 172.21.15.31:0/62324652 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55aace773400 2020-06-27T04:47:55.831 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f6122f72f40 1 --2- 172.21.15.31:0/62324652 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55aace773400 0x55aace6e4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:55.831 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f6122f72f40 5 -- 172.21.15.31:0/62324652 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55aace772c00 2020-06-27T04:47:55.831 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f6122f72f40 1 --2- 172.21.15.31:0/62324652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aace772c00 0x55aace6e3400 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:55.831 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f6122f72f40 5 -- 172.21.15.31:0/62324652 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55aace773000 2020-06-27T04:47:55.831 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f6122f72f40 1 --2- 172.21.15.31:0/62324652 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55aace773000 0x55aace6e3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:47:55.832 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f6122f72f40 5 -- 172.21.15.31:0/62324652 shutdown_connections delete 0x55aace772c00 2020-06-27T04:47:55.832 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f6122f72f40 5 -- 172.21.15.31:0/62324652 shutdown_connections delete 0x55aace773000 2020-06-27T04:47:55.832 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f6122f72f40 5 -- 172.21.15.31:0/62324652 shutdown_connections delete 0x55aace773400 2020-06-27T04:47:55.832 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f6122f72f40 1 -- 172.21.15.31:0/62324652 >> 172.21.15.31:0/62324652 conn(0x55aace772800 msgr2=0x55aace7db000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:47:55.832 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f6122f72f40 20 --1- 172.21.15.31:0/62324652 >> 172.21.15.31:0/62324652 conn(0x55aace772800 0x55aace7db000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:55.833 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f6122f72f40 2 --1- 172.21.15.31:0/62324652 >> 172.21.15.31:0/62324652 conn(0x55aace772800 0x55aace7db000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:47:55.833 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f6122f72f40 5 --1- 172.21.15.31:0/62324652 >> 172.21.15.31:0/62324652 conn(0x55aace772800 0x55aace7db000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:47:55.833 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f6122f72f40 20 Event(0x55aace706e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:55.833 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f6122f72f40 10 --1- 172.21.15.31:0/62324652 >> 172.21.15.31:0/62324652 conn(0x55aace772800 0x55aace7db000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:47:55.833 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f6122f72f40 20 Event(0x55aace707040 nevent=5000 time_id=3).wakeup 2020-06-27T04:47:55.834 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f6122f72f40 20 Event(0x55aace707280 nevent=5000 time_id=2).wakeup 2020-06-27T04:47:55.834 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f611ccf5700 5 --1- 172.21.15.31:0/62324652 >> 172.21.15.31:0/62324652 conn(0x55aace772800 0x55aace7db000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:47:55.834 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.556+0000 7f611ccf5700 5 --1- 172.21.15.31:0/62324652 >> 172.21.15.31:0/62324652 conn(0x55aace772800 0x55aace7db000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:47:55.834 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44885]: debug 2020-06-27T04:47:55.824+0000 7f6122f72f40 -1 Falling back to public interface 2020-06-27T04:47:56.223 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[44819]: debug 2020-06-27T04:47:56.051+0000 7fdf8dbd6f40 -1 osd.1 88 log_to_monitors {default=true} 2020-06-27T04:47:56.223 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:47:55 smithi031 bash[44699]: debug 2020-06-27T04:47:55.890+0000 7f6f4ce9cf40 -1 osd.3 88 log_to_monitors {default=true} 2020-06-27T04:47:56.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:56 smithi051 bash[18409]: cluster 2020-06-27T04:47:55.205111+0000 mgr.x (mgr.34109) 243 : cluster [DBG] pgmap v255: 865 pgs: 3 stale+activating+undersized, 3 creating+down, 16 down, 212 peering, 4 stale+creating+incomplete, 13 stale+down, 15 stale+undersized+degraded+peered, 1 activating+undersized, 40 stale+active+clean, 121 unknown, 7 stale+creating+peering, 3 creating+incomplete, 115 stale+peering, 27 stale+active+undersized+degraded, 8 undersized+degraded+peered, 105 stale+undersized+peered, 43 undersized+peered, 129 stale+active+undersized; 18 KiB data, 10 MiB used, 707 GiB / 715 GiB avail; 213/1014 objects degraded (21.006%) 2020-06-27T04:47:56.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:56 smithi051 bash[18409]: audit 2020-06-27T04:47:55.895120+0000 mon.c (mon.1) 67 : audit [INF] from='osd.3 v2:172.21.15.31:6804/4009962697' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:47:56.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:56 smithi051 bash[18409]: audit 2020-06-27T04:47:55.895372+0000 mon.a (mon.0) 883 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:47:56.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:56 smithi051 bash[18409]: audit 2020-06-27T04:47:55.895892+0000 mon.c (mon.1) 68 : audit [INF] from='osd.3 v2:172.21.15.31:6804/4009962697' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:56.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:56 smithi051 bash[18409]: audit 2020-06-27T04:47:55.896093+0000 mon.a (mon.0) 884 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:56.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:56 smithi051 bash[18409]: audit 2020-06-27T04:47:56.055187+0000 mon.a (mon.0) 885 : audit [INF] from='osd.1 v2:172.21.15.31:6808/4223062703' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:47:56.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:56 smithi051 bash[18409]: audit 2020-06-27T04:47:56.055568+0000 mon.a (mon.0) 886 : audit [INF] from='osd.1 v2:172.21.15.31:6808/4223062703' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:56.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:56 smithi051 bash[18409]: cluster 2020-06-27T04:47:56.421824+0000 mon.a (mon.0) 887 : cluster [INF] osd.3 v2:172.21.15.31:6804/4009962697 boot 2020-06-27T04:47:56.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:56 smithi051 bash[18409]: cluster 2020-06-27T04:47:56.421876+0000 mon.a (mon.0) 888 : cluster [INF] osd.1 v2:172.21.15.31:6808/4223062703 boot 2020-06-27T04:47:56.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:56 smithi051 bash[18409]: cluster 2020-06-27T04:47:56.421942+0000 mon.a (mon.0) 889 : cluster [DBG] osdmap e100: 8 total, 6 up, 8 in 2020-06-27T04:47:56.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:56 smithi051 bash[18409]: audit 2020-06-27T04:47:56.425723+0000 mon.b (mon.2) 287 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:47:56.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:56 smithi051 bash[18409]: audit 2020-06-27T04:47:56.425961+0000 mon.b (mon.2) 288 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:47:56.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[18426]: cluster 2020-06-27T04:47:55.205111+0000 mgr.x (mgr.34109) 243 : cluster [DBG] pgmap v255: 865 pgs: 3 stale+activating+undersized, 3 creating+down, 16 down, 212 peering, 4 stale+creating+incomplete, 13 stale+down, 15 stale+undersized+degraded+peered, 1 activating+undersized, 40 stale+active+clean, 121 unknown, 7 stale+creating+peering, 3 creating+incomplete, 115 stale+peering, 27 stale+active+undersized+degraded, 8 undersized+degraded+peered, 105 stale+undersized+peered, 43 undersized+peered, 129 stale+active+undersized; 18 KiB data, 10 MiB used, 707 GiB / 715 GiB avail; 213/1014 objects degraded (21.006%) 2020-06-27T04:47:56.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[18426]: audit 2020-06-27T04:47:55.895120+0000 mon.c (mon.1) 67 : audit [INF] from='osd.3 v2:172.21.15.31:6804/4009962697' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:47:56.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[18426]: audit 2020-06-27T04:47:55.895372+0000 mon.a (mon.0) 883 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:47:56.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[18426]: audit 2020-06-27T04:47:55.895892+0000 mon.c (mon.1) 68 : audit [INF] from='osd.3 v2:172.21.15.31:6804/4009962697' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:56.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[18426]: audit 2020-06-27T04:47:55.896093+0000 mon.a (mon.0) 884 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:56.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[18426]: audit 2020-06-27T04:47:56.055187+0000 mon.a (mon.0) 885 : audit [INF] from='osd.1 v2:172.21.15.31:6808/4223062703' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:47:56.732 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[18426]: audit 2020-06-27T04:47:56.055568+0000 mon.a (mon.0) 886 : audit [INF] from='osd.1 v2:172.21.15.31:6808/4223062703' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:56.732 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[18426]: cluster 2020-06-27T04:47:56.421824+0000 mon.a (mon.0) 887 : cluster [INF] osd.3 v2:172.21.15.31:6804/4009962697 boot 2020-06-27T04:47:56.732 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[18426]: cluster 2020-06-27T04:47:56.421876+0000 mon.a (mon.0) 888 : cluster [INF] osd.1 v2:172.21.15.31:6808/4223062703 boot 2020-06-27T04:47:56.732 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[18426]: cluster 2020-06-27T04:47:56.421942+0000 mon.a (mon.0) 889 : cluster [DBG] osdmap e100: 8 total, 6 up, 8 in 2020-06-27T04:47:56.732 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[18426]: audit 2020-06-27T04:47:56.425723+0000 mon.b (mon.2) 287 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:47:56.733 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[18426]: audit 2020-06-27T04:47:56.425961+0000 mon.b (mon.2) 288 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:47:56.733 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[22603]: cluster 2020-06-27T04:47:55.205111+0000 mgr.x (mgr.34109) 243 : cluster [DBG] pgmap v255: 865 pgs: 3 stale+activating+undersized, 3 creating+down, 16 down, 212 peering, 4 stale+creating+incomplete, 13 stale+down, 15 stale+undersized+degraded+peered, 1 activating+undersized, 40 stale+active+clean, 121 unknown, 7 stale+creating+peering, 3 creating+incomplete, 115 stale+peering, 27 stale+active+undersized+degraded, 8 undersized+degraded+peered, 105 stale+undersized+peered, 43 undersized+peered, 129 stale+active+undersized; 18 KiB data, 10 MiB used, 707 GiB / 715 GiB avail; 213/1014 objects degraded (21.006%) 2020-06-27T04:47:56.733 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[22603]: audit 2020-06-27T04:47:55.895120+0000 mon.c (mon.1) 67 : audit [INF] from='osd.3 v2:172.21.15.31:6804/4009962697' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:47:56.733 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[22603]: audit 2020-06-27T04:47:55.895372+0000 mon.a (mon.0) 883 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:47:56.733 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[22603]: audit 2020-06-27T04:47:55.895892+0000 mon.c (mon.1) 68 : audit [INF] from='osd.3 v2:172.21.15.31:6804/4009962697' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:56.734 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[22603]: audit 2020-06-27T04:47:55.896093+0000 mon.a (mon.0) 884 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:56.734 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[22603]: audit 2020-06-27T04:47:56.055187+0000 mon.a (mon.0) 885 : audit [INF] from='osd.1 v2:172.21.15.31:6808/4223062703' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:47:56.734 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[22603]: audit 2020-06-27T04:47:56.055568+0000 mon.a (mon.0) 886 : audit [INF] from='osd.1 v2:172.21.15.31:6808/4223062703' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:56.734 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[22603]: cluster 2020-06-27T04:47:56.421824+0000 mon.a (mon.0) 887 : cluster [INF] osd.3 v2:172.21.15.31:6804/4009962697 boot 2020-06-27T04:47:56.734 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[22603]: cluster 2020-06-27T04:47:56.421876+0000 mon.a (mon.0) 888 : cluster [INF] osd.1 v2:172.21.15.31:6808/4223062703 boot 2020-06-27T04:47:56.735 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[22603]: cluster 2020-06-27T04:47:56.421942+0000 mon.a (mon.0) 889 : cluster [DBG] osdmap e100: 8 total, 6 up, 8 in 2020-06-27T04:47:56.735 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[22603]: audit 2020-06-27T04:47:56.425723+0000 mon.b (mon.2) 287 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:47:56.735 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[22603]: audit 2020-06-27T04:47:56.425961+0000 mon.b (mon.2) 288 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:47:56.735 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:47:56 smithi031 bash[44885]: debug 2020-06-27T04:47:56.645+0000 7f6122f72f40 -1 osd.2 88 log_to_monitors {default=true} 2020-06-27T04:47:57.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[18409]: audit 2020-06-27T04:47:56.655445+0000 mon.c (mon.1) 69 : audit [INF] from='osd.2 v2:172.21.15.31:6812/4293996646' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:47:57.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[18409]: audit 2020-06-27T04:47:56.655802+0000 mon.a (mon.0) 890 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:47:57.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[18409]: audit 2020-06-27T04:47:56.658952+0000 mon.c (mon.1) 70 : audit [INF] from='osd.2 v2:172.21.15.31:6812/4293996646' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:57.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[18409]: audit 2020-06-27T04:47:56.659274+0000 mon.a (mon.0) 891 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:57.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.427103+0000 mon.a (mon.0) 892 : cluster [INF] osd.2 v2:172.21.15.31:6812/4293996646 boot 2020-06-27T04:47:57.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.427147+0000 mon.a (mon.0) 893 : cluster [DBG] osdmap e101: 8 total, 7 up, 8 in 2020-06-27T04:47:57.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[18409]: audit 2020-06-27T04:47:57.428652+0000 mon.b (mon.2) 289 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:47:57.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[18426]: audit 2020-06-27T04:47:56.655445+0000 mon.c (mon.1) 69 : audit [INF] from='osd.2 v2:172.21.15.31:6812/4293996646' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:47:57.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[18426]: audit 2020-06-27T04:47:56.655802+0000 mon.a (mon.0) 890 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:47:57.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[18426]: audit 2020-06-27T04:47:56.658952+0000 mon.c (mon.1) 70 : audit [INF] from='osd.2 v2:172.21.15.31:6812/4293996646' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:57.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[18426]: audit 2020-06-27T04:47:56.659274+0000 mon.a (mon.0) 891 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:57.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.427103+0000 mon.a (mon.0) 892 : cluster [INF] osd.2 v2:172.21.15.31:6812/4293996646 boot 2020-06-27T04:47:57.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.427147+0000 mon.a (mon.0) 893 : cluster [DBG] osdmap e101: 8 total, 7 up, 8 in 2020-06-27T04:47:57.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[18426]: audit 2020-06-27T04:47:57.428652+0000 mon.b (mon.2) 289 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:47:57.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[22603]: audit 2020-06-27T04:47:56.655445+0000 mon.c (mon.1) 69 : audit [INF] from='osd.2 v2:172.21.15.31:6812/4293996646' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:47:57.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[22603]: audit 2020-06-27T04:47:56.655802+0000 mon.a (mon.0) 890 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:47:57.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[22603]: audit 2020-06-27T04:47:56.658952+0000 mon.c (mon.1) 70 : audit [INF] from='osd.2 v2:172.21.15.31:6812/4293996646' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:57.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[22603]: audit 2020-06-27T04:47:56.659274+0000 mon.a (mon.0) 891 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:47:57.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.427103+0000 mon.a (mon.0) 892 : cluster [INF] osd.2 v2:172.21.15.31:6812/4293996646 boot 2020-06-27T04:47:57.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.427147+0000 mon.a (mon.0) 893 : cluster [DBG] osdmap e101: 8 total, 7 up, 8 in 2020-06-27T04:47:57.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[22603]: audit 2020-06-27T04:47:57.428652+0000 mon.b (mon.2) 289 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:47:58.219 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:58.219 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: in thread 7fd0f7b98700 thread_name:tp_osd_tp 2020-06-27T04:47:58.219 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:58.220 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 1: (()+0x12dd0) [0x7fd11a999dd0] 2020-06-27T04:47:58.220 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55d508b73707] 2020-06-27T04:47:58.220 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55d508b73aa0] 2020-06-27T04:47:58.220 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55d508ba567a] 2020-06-27T04:47:58.220 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55d508ba6a57] 2020-06-27T04:47:58.221 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55d508831938] 2020-06-27T04:47:58.221 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55d5089e5a70] 2020-06-27T04:47:58.221 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55d5089f5dd7] 2020-06-27T04:47:58.221 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55d508864252] 2020-06-27T04:47:58.222 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55d508807e2e] 2020-06-27T04:47:58.222 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55d5086884e9] 2020-06-27T04:47:58.222 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55d5088ecf78] 2020-06-27T04:47:58.222 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55d5086a770f] 2020-06-27T04:47:58.222 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55d508ce5b94] 2020-06-27T04:47:58.222 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55d508ce87f4] 2020-06-27T04:47:58.223 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 16: (()+0x82de) [0x7fd11a98f2de] 2020-06-27T04:47:58.223 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 17: (clone()+0x43) [0x7fd1196c6e83] 2020-06-27T04:47:58.223 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: debug 2020-06-27T04:47:57.869+0000 7fd0f7b98700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:58.223 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: in thread 7fd0f7b98700 thread_name:tp_osd_tp 2020-06-27T04:47:58.223 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:58.224 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 1: (()+0x12dd0) [0x7fd11a999dd0] 2020-06-27T04:47:58.224 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55d508b73707] 2020-06-27T04:47:58.224 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55d508b73aa0] 2020-06-27T04:47:58.224 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55d508ba567a] 2020-06-27T04:47:58.224 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55d508ba6a57] 2020-06-27T04:47:58.225 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55d508831938] 2020-06-27T04:47:58.225 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55d5089e5a70] 2020-06-27T04:47:58.225 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55d5089f5dd7] 2020-06-27T04:47:58.225 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55d508864252] 2020-06-27T04:47:58.225 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55d508807e2e] 2020-06-27T04:47:58.226 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55d5086884e9] 2020-06-27T04:47:58.226 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55d5088ecf78] 2020-06-27T04:47:58.227 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55d5086a770f] 2020-06-27T04:47:58.227 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55d508ce5b94] 2020-06-27T04:47:58.227 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55d508ce87f4] 2020-06-27T04:47:58.227 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 16: (()+0x82de) [0x7fd11a98f2de] 2020-06-27T04:47:58.227 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 17: (clone()+0x43) [0x7fd1196c6e83] 2020-06-27T04:47:58.228 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:58.228 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: debug -9999> 2020-06-27T04:47:57.869+0000 7fd0f7b98700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:58.228 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: in thread 7fd0f7b98700 thread_name:tp_osd_tp 2020-06-27T04:47:58.228 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:58.228 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 1: (()+0x12dd0) [0x7fd11a999dd0] 2020-06-27T04:47:58.228 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55d508b73707] 2020-06-27T04:47:58.229 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55d508b73aa0] 2020-06-27T04:47:58.229 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55d508ba567a] 2020-06-27T04:47:58.229 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55d508ba6a57] 2020-06-27T04:47:58.229 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55d508831938] 2020-06-27T04:47:58.229 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55d5089e5a70] 2020-06-27T04:47:58.230 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55d5089f5dd7] 2020-06-27T04:47:58.230 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55d508864252] 2020-06-27T04:47:58.230 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55d508807e2e] 2020-06-27T04:47:58.230 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55d5086884e9] 2020-06-27T04:47:58.230 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55d5088ecf78] 2020-06-27T04:47:58.231 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55d5086a770f] 2020-06-27T04:47:58.231 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55d508ce5b94] 2020-06-27T04:47:58.231 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55d508ce87f4] 2020-06-27T04:47:58.232 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 16: (()+0x82de) [0x7fd11a98f2de] 2020-06-27T04:47:58.233 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 17: (clone()+0x43) [0x7fd1196c6e83] 2020-06-27T04:47:58.233 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:58.233 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: debug -9999> 2020-06-27T04:47:57.869+0000 7fd0f7b98700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:58.233 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: in thread 7fd0f7b98700 thread_name:tp_osd_tp 2020-06-27T04:47:58.233 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:58.234 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 1: (()+0x12dd0) [0x7fd11a999dd0] 2020-06-27T04:47:58.234 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55d508b73707] 2020-06-27T04:47:58.234 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55d508b73aa0] 2020-06-27T04:47:58.234 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55d508ba567a] 2020-06-27T04:47:58.234 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55d508ba6a57] 2020-06-27T04:47:58.235 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55d508831938] 2020-06-27T04:47:58.235 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55d5089e5a70] 2020-06-27T04:47:58.235 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55d5089f5dd7] 2020-06-27T04:47:58.235 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55d508864252] 2020-06-27T04:47:58.235 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55d508807e2e] 2020-06-27T04:47:58.236 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55d5086884e9] 2020-06-27T04:47:58.236 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55d5088ecf78] 2020-06-27T04:47:58.236 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55d5086a770f] 2020-06-27T04:47:58.236 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55d508ce5b94] 2020-06-27T04:47:58.236 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55d508ce87f4] 2020-06-27T04:47:58.236 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 16: (()+0x82de) [0x7fd11a98f2de] 2020-06-27T04:47:58.237 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: 17: (clone()+0x43) [0x7fd1196c6e83] 2020-06-27T04:47:58.237 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:58.237 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35168]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:47:58.237 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:57 smithi051 podman[35902]: 2020-06-27 04:47:57.95271743 +0000 UTC m=+7.079893552 container died 2481344bbee9ccf7d174e1163f8c67a0bebc9e36bc548e70d2f7f87948a7bb24 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:47:58.237 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:58.238 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: in thread 7f81feedc700 thread_name:tp_osd_tp 2020-06-27T04:47:58.238 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:58.238 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 1: (()+0x12dd0) [0x7f8225ce5dd0] 2020-06-27T04:47:58.238 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55a42cbf2707] 2020-06-27T04:47:58.238 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55a42cbf2aa0] 2020-06-27T04:47:58.239 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55a42cc2467a] 2020-06-27T04:47:58.239 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55a42cc25a57] 2020-06-27T04:47:58.239 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55a42c8b0938] 2020-06-27T04:47:58.239 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55a42ca6103d] 2020-06-27T04:47:58.239 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55a42c81e5b0] 2020-06-27T04:47:58.240 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55a42c87789d] 2020-06-27T04:47:58.240 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55a42c880380] 2020-06-27T04:47:58.240 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55a42c887590] 2020-06-27T04:47:58.240 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55a42c7074e9] 2020-06-27T04:47:58.240 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55a42c96bf78] 2020-06-27T04:47:58.241 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55a42c72670f] 2020-06-27T04:47:58.241 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55a42cd64b94] 2020-06-27T04:47:58.241 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55a42cd677f4] 2020-06-27T04:47:58.241 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 17: (()+0x82de) [0x7f8225cdb2de] 2020-06-27T04:47:58.241 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 18: (clone()+0x43) [0x7f8224a12e83] 2020-06-27T04:47:58.241 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: debug 2020-06-27T04:47:57.869+0000 7f81feedc700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:58.242 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: in thread 7f81feedc700 thread_name:tp_osd_tp 2020-06-27T04:47:58.242 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:58.242 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 1: (()+0x12dd0) [0x7f8225ce5dd0] 2020-06-27T04:47:58.242 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55a42cbf2707] 2020-06-27T04:47:58.242 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55a42cbf2aa0] 2020-06-27T04:47:58.243 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55a42cc2467a] 2020-06-27T04:47:58.243 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55a42cc25a57] 2020-06-27T04:47:58.243 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55a42c8b0938] 2020-06-27T04:47:58.243 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55a42ca6103d] 2020-06-27T04:47:58.243 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55a42c81e5b0] 2020-06-27T04:47:58.243 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55a42c87789d] 2020-06-27T04:47:58.244 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55a42c880380] 2020-06-27T04:47:58.244 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55a42c887590] 2020-06-27T04:47:58.244 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55a42c7074e9] 2020-06-27T04:47:58.244 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55a42c96bf78] 2020-06-27T04:47:58.244 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55a42c72670f] 2020-06-27T04:47:58.245 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55a42cd64b94] 2020-06-27T04:47:58.245 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55a42cd677f4] 2020-06-27T04:47:58.245 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 17: (()+0x82de) [0x7f8225cdb2de] 2020-06-27T04:47:58.245 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 18: (clone()+0x43) [0x7f8224a12e83] 2020-06-27T04:47:58.245 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:58.246 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: debug -9999> 2020-06-27T04:47:57.869+0000 7f81feedc700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:58.247 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: in thread 7f81feedc700 thread_name:tp_osd_tp 2020-06-27T04:47:58.247 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:58.247 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 1: (()+0x12dd0) [0x7f8225ce5dd0] 2020-06-27T04:47:58.247 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55a42cbf2707] 2020-06-27T04:47:58.247 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55a42cbf2aa0] 2020-06-27T04:47:58.248 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55a42cc2467a] 2020-06-27T04:47:58.248 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55a42cc25a57] 2020-06-27T04:47:58.248 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55a42c8b0938] 2020-06-27T04:47:58.248 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55a42ca6103d] 2020-06-27T04:47:58.248 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55a42c81e5b0] 2020-06-27T04:47:58.248 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55a42c87789d] 2020-06-27T04:47:58.249 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55a42c880380] 2020-06-27T04:47:58.249 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55a42c887590] 2020-06-27T04:47:58.249 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55a42c7074e9] 2020-06-27T04:47:58.249 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55a42c96bf78] 2020-06-27T04:47:58.249 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55a42c72670f] 2020-06-27T04:47:58.250 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55a42cd64b94] 2020-06-27T04:47:58.250 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55a42cd677f4] 2020-06-27T04:47:58.250 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 17: (()+0x82de) [0x7f8225cdb2de] 2020-06-27T04:47:58.250 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 18: (clone()+0x43) [0x7f8224a12e83] 2020-06-27T04:47:58.250 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:58.251 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: debug -9999> 2020-06-27T04:47:57.869+0000 7f81feedc700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:58.251 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: in thread 7f81feedc700 thread_name:tp_osd_tp 2020-06-27T04:47:58.251 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:58.251 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 1: (()+0x12dd0) [0x7f8225ce5dd0] 2020-06-27T04:47:58.251 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55a42cbf2707] 2020-06-27T04:47:58.251 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55a42cbf2aa0] 2020-06-27T04:47:58.252 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55a42cc2467a] 2020-06-27T04:47:58.252 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55a42cc25a57] 2020-06-27T04:47:58.252 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55a42c8b0938] 2020-06-27T04:47:58.252 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55a42ca6103d] 2020-06-27T04:47:58.252 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55a42c81e5b0] 2020-06-27T04:47:58.253 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55a42c87789d] 2020-06-27T04:47:58.253 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55a42c880380] 2020-06-27T04:47:58.253 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55a42c887590] 2020-06-27T04:47:58.253 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55a42c7074e9] 2020-06-27T04:47:58.253 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55a42c96bf78] 2020-06-27T04:47:58.254 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55a42c72670f] 2020-06-27T04:47:58.254 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55a42cd64b94] 2020-06-27T04:47:58.254 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55a42cd677f4] 2020-06-27T04:47:58.254 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 17: (()+0x82de) [0x7f8225cdb2de] 2020-06-27T04:47:58.254 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: 18: (clone()+0x43) [0x7f8224a12e83] 2020-06-27T04:47:58.254 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:58.255 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:57 smithi051 bash[35135]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:47:58.255 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:58 smithi051 podman[35867]: 2020-06-27 04:47:58.053749324 +0000 UTC m=+7.259132670 container died cddc408f62d92e1e9e7a9e9134448e5004b3dc787b2313b4c4a079aae3bfe175 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:47:58.256 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:58.257 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: in thread 7f16394e1700 thread_name:tp_osd_tp 2020-06-27T04:47:58.257 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:58.257 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 1: (()+0x12dd0) [0x7f16602eadd0] 2020-06-27T04:47:58.258 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x555cc7430707] 2020-06-27T04:47:58.258 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x555cc7430aa0] 2020-06-27T04:47:58.258 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x555cc746267a] 2020-06-27T04:47:58.258 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x555cc7463a57] 2020-06-27T04:47:58.258 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x555cc70ee938] 2020-06-27T04:47:58.259 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x555cc72a2a70] 2020-06-27T04:47:58.259 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x555cc72b2dd7] 2020-06-27T04:47:58.259 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x555cc7121252] 2020-06-27T04:47:58.259 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x555cc70c4e2e] 2020-06-27T04:47:58.262 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x555cc6f454e9] 2020-06-27T04:47:58.263 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x555cc71a9f78] 2020-06-27T04:47:58.263 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x555cc6f6470f] 2020-06-27T04:47:58.263 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x555cc75a2b94] 2020-06-27T04:47:58.263 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x555cc75a57f4] 2020-06-27T04:47:58.263 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 16: (()+0x82de) [0x7f16602e02de] 2020-06-27T04:47:58.264 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 17: (clone()+0x43) [0x7f165f017e83] 2020-06-27T04:47:58.264 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: debug 2020-06-27T04:47:57.868+0000 7f16394e1700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:58.264 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: in thread 7f16394e1700 thread_name:tp_osd_tp 2020-06-27T04:47:58.264 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:58.264 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 1: (()+0x12dd0) [0x7f16602eadd0] 2020-06-27T04:47:58.265 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x555cc7430707] 2020-06-27T04:47:58.265 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x555cc7430aa0] 2020-06-27T04:47:58.265 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x555cc746267a] 2020-06-27T04:47:58.265 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x555cc7463a57] 2020-06-27T04:47:58.265 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x555cc70ee938] 2020-06-27T04:47:58.265 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x555cc72a2a70] 2020-06-27T04:47:58.266 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x555cc72b2dd7] 2020-06-27T04:47:58.266 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x555cc7121252] 2020-06-27T04:47:58.266 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x555cc70c4e2e] 2020-06-27T04:47:58.266 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x555cc6f454e9] 2020-06-27T04:47:58.266 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x555cc71a9f78] 2020-06-27T04:47:58.267 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x555cc6f6470f] 2020-06-27T04:47:58.267 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x555cc75a2b94] 2020-06-27T04:47:58.267 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x555cc75a57f4] 2020-06-27T04:47:58.267 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 16: (()+0x82de) [0x7f16602e02de] 2020-06-27T04:47:58.267 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 17: (clone()+0x43) [0x7f165f017e83] 2020-06-27T04:47:58.268 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:58.268 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: debug 0> 2020-06-27T04:47:57.868+0000 7f16394e1700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:58.268 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: in thread 7f16394e1700 thread_name:tp_osd_tp 2020-06-27T04:47:58.268 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:58.268 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 1: (()+0x12dd0) [0x7f16602eadd0] 2020-06-27T04:47:58.268 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x555cc7430707] 2020-06-27T04:47:58.269 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x555cc7430aa0] 2020-06-27T04:47:58.270 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x555cc746267a] 2020-06-27T04:47:58.270 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x555cc7463a57] 2020-06-27T04:47:58.270 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x555cc70ee938] 2020-06-27T04:47:58.270 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x555cc72a2a70] 2020-06-27T04:47:58.270 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x555cc72b2dd7] 2020-06-27T04:47:58.271 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x555cc7121252] 2020-06-27T04:47:58.271 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x555cc70c4e2e] 2020-06-27T04:47:58.271 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x555cc6f454e9] 2020-06-27T04:47:58.272 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x555cc71a9f78] 2020-06-27T04:47:58.272 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x555cc6f6470f] 2020-06-27T04:47:58.272 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x555cc75a2b94] 2020-06-27T04:47:58.272 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x555cc75a57f4] 2020-06-27T04:47:58.272 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 16: (()+0x82de) [0x7f16602e02de] 2020-06-27T04:47:58.272 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 17: (clone()+0x43) [0x7f165f017e83] 2020-06-27T04:47:58.273 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:58.273 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: debug -9999> 2020-06-27T04:47:57.868+0000 7f16394e1700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:47:58.273 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: in thread 7f16394e1700 thread_name:tp_osd_tp 2020-06-27T04:47:58.273 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:47:58.273 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 1: (()+0x12dd0) [0x7f16602eadd0] 2020-06-27T04:47:58.274 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x555cc7430707] 2020-06-27T04:47:58.274 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x555cc7430aa0] 2020-06-27T04:47:58.274 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x555cc746267a] 2020-06-27T04:47:58.274 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x555cc7463a57] 2020-06-27T04:47:58.274 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x555cc70ee938] 2020-06-27T04:47:58.275 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x555cc72a2a70] 2020-06-27T04:47:58.275 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x555cc72b2dd7] 2020-06-27T04:47:58.275 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x555cc7121252] 2020-06-27T04:47:58.275 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x555cc70c4e2e] 2020-06-27T04:47:58.275 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x555cc6f454e9] 2020-06-27T04:47:58.275 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x555cc71a9f78] 2020-06-27T04:47:58.276 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x555cc6f6470f] 2020-06-27T04:47:58.276 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x555cc75a2b94] 2020-06-27T04:47:58.276 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x555cc75a57f4] 2020-06-27T04:47:58.276 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 16: (()+0x82de) [0x7f16602e02de] 2020-06-27T04:47:58.276 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: 17: (clone()+0x43) [0x7f165f017e83] 2020-06-27T04:47:58.277 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:47:58.277 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 bash[44647]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:47:58.277 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:47:57 smithi031 podman[44920]: 2020-06-27 04:47:57.987346562 +0000 UTC m=+5.411867442 container died c46c6ee631fa3abe70e91c27cd2ba1dc34ba3c8f8dbf616482bc24f02bec798f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:47:58.718 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:58 smithi051 podman[35902]: 2020-06-27 04:47:58.49370099 +0000 UTC m=+7.620877107 container remove 2481344bbee9ccf7d174e1163f8c67a0bebc9e36bc548e70d2f7f87948a7bb24 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:47:58.718 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:58 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:47:58.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.206442+0000 mgr.x (mgr.34109) 244 : cluster [DBG] pgmap v258: 865 pgs: 1 creating+peering, 10 active+undersized+degraded, 2 stale+activating+undersized, 15 creating+down, 53 down, 356 peering, 3 stale+creating+incomplete, 11 stale+down, 9 stale+undersized+degraded+peered, 2 activating+undersized, 9 stale+active+clean, 89 unknown, 2 stale+creating+peering, 48 active+undersized, 41 stale+peering, 14 stale+active+undersized+degraded, 14 undersized+degraded+peered, 8 active+clean, 66 stale+undersized+peered, 48 undersized+peered, 64 stale+active+undersized; 18 KiB data, 13 MiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 1.2 KiB/s wr, 1 op/s; 158/1032 objects degraded (15.310%); 11 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:47:58.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.440402+0000 mon.a (mon.0) 894 : cluster [WRN] Health check update: Reduced data availability: 14 pgs inactive, 79 pgs down, 1 pg peering, 3 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:47:58.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.440445+0000 mon.a (mon.0) 895 : cluster [WRN] Health check update: Degraded data redundancy: 158/1032 objects degraded (15.310%), 47 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:58.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.440470+0000 mon.a (mon.0) 896 : cluster [WRN] Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:47:58.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: audit 2020-06-27T04:47:57.790202+0000 mon.a (mon.0) 897 : audit [DBG] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2020-06-27T04:47:58.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: audit 2020-06-27T04:47:57.790784+0000 mon.a (mon.0) 898 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:58.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.914267+0000 mon.a (mon.0) 899 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-06-27T04:47:58.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.914308+0000 mon.a (mon.0) 900 : cluster [INF] osd.4 failed (root=default,host=smithi051) (connection refused reported by osd.1) 2020-06-27T04:47:58.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.914422+0000 mon.a (mon.0) 901 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:58.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.914694+0000 mon.a (mon.0) 902 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-06-27T04:47:58.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.914891+0000 mon.a (mon.0) 903 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:47:58.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.914976+0000 mon.a (mon.0) 904 : cluster [DBG] osd.6 reported immediately failed by osd.1 2020-06-27T04:47:58.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.914995+0000 mon.a (mon.0) 905 : cluster [INF] osd.6 failed (root=default,host=smithi051) (connection refused reported by osd.1) 2020-06-27T04:47:58.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.915114+0000 mon.a (mon.0) 906 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:47:58.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.915221+0000 mon.a (mon.0) 907 : cluster [DBG] osd.6 reported immediately failed by osd.1 2020-06-27T04:47:58.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.915322+0000 mon.a (mon.0) 908 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:58.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.915427+0000 mon.a (mon.0) 909 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:47:58.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.915530+0000 mon.a (mon.0) 910 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:58.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.915622+0000 mon.a (mon.0) 911 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:58.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.206442+0000 mgr.x (mgr.34109) 244 : cluster [DBG] pgmap v258: 865 pgs: 1 creating+peering, 10 active+undersized+degraded, 2 stale+activating+undersized, 15 creating+down, 53 down, 356 peering, 3 stale+creating+incomplete, 11 stale+down, 9 stale+undersized+degraded+peered, 2 activating+undersized, 9 stale+active+clean, 89 unknown, 2 stale+creating+peering, 48 active+undersized, 41 stale+peering, 14 stale+active+undersized+degraded, 14 undersized+degraded+peered, 8 active+clean, 66 stale+undersized+peered, 48 undersized+peered, 64 stale+active+undersized; 18 KiB data, 13 MiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 1.2 KiB/s wr, 1 op/s; 158/1032 objects degraded (15.310%); 11 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:47:58.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.440402+0000 mon.a (mon.0) 894 : cluster [WRN] Health check update: Reduced data availability: 14 pgs inactive, 79 pgs down, 1 pg peering, 3 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:47:58.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.440445+0000 mon.a (mon.0) 895 : cluster [WRN] Health check update: Degraded data redundancy: 158/1032 objects degraded (15.310%), 47 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:58.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.440470+0000 mon.a (mon.0) 896 : cluster [WRN] Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:47:58.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: audit 2020-06-27T04:47:57.790202+0000 mon.a (mon.0) 897 : audit [DBG] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2020-06-27T04:47:58.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: audit 2020-06-27T04:47:57.790784+0000 mon.a (mon.0) 898 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:58.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.914267+0000 mon.a (mon.0) 899 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-06-27T04:47:58.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.914308+0000 mon.a (mon.0) 900 : cluster [INF] osd.4 failed (root=default,host=smithi051) (connection refused reported by osd.1) 2020-06-27T04:47:58.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.914422+0000 mon.a (mon.0) 901 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:58.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.914694+0000 mon.a (mon.0) 902 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-06-27T04:47:58.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.914891+0000 mon.a (mon.0) 903 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:47:58.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.914976+0000 mon.a (mon.0) 904 : cluster [DBG] osd.6 reported immediately failed by osd.1 2020-06-27T04:47:58.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.914995+0000 mon.a (mon.0) 905 : cluster [INF] osd.6 failed (root=default,host=smithi051) (connection refused reported by osd.1) 2020-06-27T04:47:58.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.915114+0000 mon.a (mon.0) 906 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:47:58.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.915221+0000 mon.a (mon.0) 907 : cluster [DBG] osd.6 reported immediately failed by osd.1 2020-06-27T04:47:58.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.915322+0000 mon.a (mon.0) 908 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:58.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.915427+0000 mon.a (mon.0) 909 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:47:58.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.915530+0000 mon.a (mon.0) 910 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:58.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.915622+0000 mon.a (mon.0) 911 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:58.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.915711+0000 mon.a (mon.0) 912 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:58.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.915800+0000 mon.a (mon.0) 913 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:58.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.915888+0000 mon.a (mon.0) 914 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:58.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.915980+0000 mon.a (mon.0) 915 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:58.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.920726+0000 mon.a (mon.0) 916 : cluster [DBG] osd.0 reported immediately failed by osd.7 2020-06-27T04:47:58.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.920762+0000 mon.a (mon.0) 917 : cluster [INF] osd.0 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:47:58.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:57.920980+0000 mon.a (mon.0) 918 : cluster [DBG] osd.0 reported immediately failed by osd.7 2020-06-27T04:47:58.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.114601+0000 mon.a (mon.0) 919 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:47:58.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.114925+0000 mon.a (mon.0) 920 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:47:58.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.115165+0000 mon.a (mon.0) 921 : cluster [DBG] osd.6 reported immediately failed by osd.1 2020-06-27T04:47:58.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.115515+0000 mon.a (mon.0) 922 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-06-27T04:47:58.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.115882+0000 mon.a (mon.0) 923 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-06-27T04:47:58.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.115997+0000 mon.a (mon.0) 924 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:58.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.116208+0000 mon.a (mon.0) 925 : cluster [DBG] osd.6 reported immediately failed by osd.1 2020-06-27T04:47:58.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.116387+0000 mon.a (mon.0) 926 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:47:58.732 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.116557+0000 mon.a (mon.0) 927 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:58.732 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.116729+0000 mon.a (mon.0) 928 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:47:58.732 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.116894+0000 mon.a (mon.0) 929 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:58.732 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.117067+0000 mon.a (mon.0) 930 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:58.732 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.117252+0000 mon.a (mon.0) 931 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:58.733 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.117423+0000 mon.a (mon.0) 932 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:58.733 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.117590+0000 mon.a (mon.0) 933 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:58.733 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.117756+0000 mon.a (mon.0) 934 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:58.733 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.121682+0000 mon.a (mon.0) 935 : cluster [DBG] osd.0 reported immediately failed by osd.7 2020-06-27T04:47:58.733 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.121859+0000 mon.a (mon.0) 936 : cluster [DBG] osd.0 reported immediately failed by osd.7 2020-06-27T04:47:58.733 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.121988+0000 mon.a (mon.0) 937 : cluster [DBG] osd.0 reported immediately failed by osd.1 2020-06-27T04:47:58.734 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.122155+0000 mon.a (mon.0) 938 : cluster [DBG] osd.0 reported immediately failed by osd.2 2020-06-27T04:47:58.734 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.122294+0000 mon.a (mon.0) 939 : cluster [DBG] osd.0 reported immediately failed by osd.1 2020-06-27T04:47:58.734 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.122473+0000 mon.a (mon.0) 940 : cluster [DBG] osd.0 reported immediately failed by osd.2 2020-06-27T04:47:58.734 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.122642+0000 mon.a (mon.0) 941 : cluster [DBG] osd.0 reported immediately failed by osd.3 2020-06-27T04:47:58.734 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.122810+0000 mon.a (mon.0) 942 : cluster [DBG] osd.0 reported immediately failed by osd.3 2020-06-27T04:47:58.735 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: audit 2020-06-27T04:47:58.429326+0000 mon.a (mon.0) 943 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "app1","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:58.735 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: cluster 2020-06-27T04:47:58.429383+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e102: 8 total, 4 up, 8 in 2020-06-27T04:47:58.735 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: audit 2020-06-27T04:47:58.432864+0000 mon.a (mon.0) 945 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "app2"}]: dispatch 2020-06-27T04:47:58.735 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[18426]: audit 2020-06-27T04:47:58.433362+0000 mon.a (mon.0) 946 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:58.735 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.206442+0000 mgr.x (mgr.34109) 244 : cluster [DBG] pgmap v258: 865 pgs: 1 creating+peering, 10 active+undersized+degraded, 2 stale+activating+undersized, 15 creating+down, 53 down, 356 peering, 3 stale+creating+incomplete, 11 stale+down, 9 stale+undersized+degraded+peered, 2 activating+undersized, 9 stale+active+clean, 89 unknown, 2 stale+creating+peering, 48 active+undersized, 41 stale+peering, 14 stale+active+undersized+degraded, 14 undersized+degraded+peered, 8 active+clean, 66 stale+undersized+peered, 48 undersized+peered, 64 stale+active+undersized; 18 KiB data, 13 MiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 1.2 KiB/s wr, 1 op/s; 158/1032 objects degraded (15.310%); 11 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:47:58.736 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.440402+0000 mon.a (mon.0) 894 : cluster [WRN] Health check update: Reduced data availability: 14 pgs inactive, 79 pgs down, 1 pg peering, 3 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:47:58.736 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.440445+0000 mon.a (mon.0) 895 : cluster [WRN] Health check update: Degraded data redundancy: 158/1032 objects degraded (15.310%), 47 pgs degraded (PG_DEGRADED) 2020-06-27T04:47:58.736 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.440470+0000 mon.a (mon.0) 896 : cluster [WRN] Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:47:58.736 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: audit 2020-06-27T04:47:57.790202+0000 mon.a (mon.0) 897 : audit [DBG] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2020-06-27T04:47:58.736 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: audit 2020-06-27T04:47:57.790784+0000 mon.a (mon.0) 898 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:58.737 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.914267+0000 mon.a (mon.0) 899 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-06-27T04:47:58.737 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.914308+0000 mon.a (mon.0) 900 : cluster [INF] osd.4 failed (root=default,host=smithi051) (connection refused reported by osd.1) 2020-06-27T04:47:58.737 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.914422+0000 mon.a (mon.0) 901 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:58.737 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.914694+0000 mon.a (mon.0) 902 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-06-27T04:47:58.737 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.914891+0000 mon.a (mon.0) 903 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:47:58.738 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.914976+0000 mon.a (mon.0) 904 : cluster [DBG] osd.6 reported immediately failed by osd.1 2020-06-27T04:47:58.738 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.914995+0000 mon.a (mon.0) 905 : cluster [INF] osd.6 failed (root=default,host=smithi051) (connection refused reported by osd.1) 2020-06-27T04:47:58.738 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.915114+0000 mon.a (mon.0) 906 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:47:58.738 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.915221+0000 mon.a (mon.0) 907 : cluster [DBG] osd.6 reported immediately failed by osd.1 2020-06-27T04:47:58.738 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.915322+0000 mon.a (mon.0) 908 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:58.738 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.915427+0000 mon.a (mon.0) 909 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:47:58.739 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.915530+0000 mon.a (mon.0) 910 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:58.739 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.915622+0000 mon.a (mon.0) 911 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:58.739 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.915711+0000 mon.a (mon.0) 912 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:58.739 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.915800+0000 mon.a (mon.0) 913 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:58.739 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.915888+0000 mon.a (mon.0) 914 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:58.740 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.915980+0000 mon.a (mon.0) 915 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:58.740 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.920726+0000 mon.a (mon.0) 916 : cluster [DBG] osd.0 reported immediately failed by osd.7 2020-06-27T04:47:58.740 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.920762+0000 mon.a (mon.0) 917 : cluster [INF] osd.0 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:47:58.740 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:57.920980+0000 mon.a (mon.0) 918 : cluster [DBG] osd.0 reported immediately failed by osd.7 2020-06-27T04:47:58.740 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.114601+0000 mon.a (mon.0) 919 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:47:58.741 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.114925+0000 mon.a (mon.0) 920 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:47:58.741 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.115165+0000 mon.a (mon.0) 921 : cluster [DBG] osd.6 reported immediately failed by osd.1 2020-06-27T04:47:58.741 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.115515+0000 mon.a (mon.0) 922 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-06-27T04:47:58.741 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.115882+0000 mon.a (mon.0) 923 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-06-27T04:47:58.741 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.115997+0000 mon.a (mon.0) 924 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:58.741 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.116208+0000 mon.a (mon.0) 925 : cluster [DBG] osd.6 reported immediately failed by osd.1 2020-06-27T04:47:58.742 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.116387+0000 mon.a (mon.0) 926 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:47:58.742 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.116557+0000 mon.a (mon.0) 927 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:58.742 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.116729+0000 mon.a (mon.0) 928 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:47:58.742 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.116894+0000 mon.a (mon.0) 929 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:58.742 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.117067+0000 mon.a (mon.0) 930 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:58.743 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.117252+0000 mon.a (mon.0) 931 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:58.743 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.117423+0000 mon.a (mon.0) 932 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:58.743 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.117590+0000 mon.a (mon.0) 933 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:58.743 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.117756+0000 mon.a (mon.0) 934 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:58.743 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.121682+0000 mon.a (mon.0) 935 : cluster [DBG] osd.0 reported immediately failed by osd.7 2020-06-27T04:47:58.743 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.121859+0000 mon.a (mon.0) 936 : cluster [DBG] osd.0 reported immediately failed by osd.7 2020-06-27T04:47:58.746 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.121988+0000 mon.a (mon.0) 937 : cluster [DBG] osd.0 reported immediately failed by osd.1 2020-06-27T04:47:58.746 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.122155+0000 mon.a (mon.0) 938 : cluster [DBG] osd.0 reported immediately failed by osd.2 2020-06-27T04:47:58.747 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.122294+0000 mon.a (mon.0) 939 : cluster [DBG] osd.0 reported immediately failed by osd.1 2020-06-27T04:47:58.747 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.122473+0000 mon.a (mon.0) 940 : cluster [DBG] osd.0 reported immediately failed by osd.2 2020-06-27T04:47:58.747 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.122642+0000 mon.a (mon.0) 941 : cluster [DBG] osd.0 reported immediately failed by osd.3 2020-06-27T04:47:58.747 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.122810+0000 mon.a (mon.0) 942 : cluster [DBG] osd.0 reported immediately failed by osd.3 2020-06-27T04:47:58.747 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: audit 2020-06-27T04:47:58.429326+0000 mon.a (mon.0) 943 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "app1","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:58.749 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: cluster 2020-06-27T04:47:58.429383+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e102: 8 total, 4 up, 8 in 2020-06-27T04:47:58.749 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: audit 2020-06-27T04:47:58.432864+0000 mon.a (mon.0) 945 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "app2"}]: dispatch 2020-06-27T04:47:58.749 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:47:58 smithi031 bash[22603]: audit 2020-06-27T04:47:58.433362+0000 mon.a (mon.0) 946 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:58.749 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.915711+0000 mon.a (mon.0) 912 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:58.750 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.915800+0000 mon.a (mon.0) 913 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:58.750 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.915888+0000 mon.a (mon.0) 914 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:58.750 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.915980+0000 mon.a (mon.0) 915 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:58.750 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.920726+0000 mon.a (mon.0) 916 : cluster [DBG] osd.0 reported immediately failed by osd.7 2020-06-27T04:47:58.750 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.920762+0000 mon.a (mon.0) 917 : cluster [INF] osd.0 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:47:58.751 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:57.920980+0000 mon.a (mon.0) 918 : cluster [DBG] osd.0 reported immediately failed by osd.7 2020-06-27T04:47:58.751 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.114601+0000 mon.a (mon.0) 919 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:47:58.751 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.114925+0000 mon.a (mon.0) 920 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:47:58.751 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.115165+0000 mon.a (mon.0) 921 : cluster [DBG] osd.6 reported immediately failed by osd.1 2020-06-27T04:47:58.751 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.115515+0000 mon.a (mon.0) 922 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-06-27T04:47:58.752 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.115882+0000 mon.a (mon.0) 923 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-06-27T04:47:58.752 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.115997+0000 mon.a (mon.0) 924 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:58.752 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.116208+0000 mon.a (mon.0) 925 : cluster [DBG] osd.6 reported immediately failed by osd.1 2020-06-27T04:47:58.752 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.116387+0000 mon.a (mon.0) 926 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:47:58.752 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.116557+0000 mon.a (mon.0) 927 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-06-27T04:47:58.752 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.116729+0000 mon.a (mon.0) 928 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:47:58.753 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.116894+0000 mon.a (mon.0) 929 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:58.753 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.117067+0000 mon.a (mon.0) 930 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:58.753 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.117252+0000 mon.a (mon.0) 931 : cluster [DBG] osd.6 reported immediately failed by osd.3 2020-06-27T04:47:58.753 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.117423+0000 mon.a (mon.0) 932 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:58.753 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.117590+0000 mon.a (mon.0) 933 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:47:58.754 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.117756+0000 mon.a (mon.0) 934 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:47:58.754 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.121682+0000 mon.a (mon.0) 935 : cluster [DBG] osd.0 reported immediately failed by osd.7 2020-06-27T04:47:58.754 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.121859+0000 mon.a (mon.0) 936 : cluster [DBG] osd.0 reported immediately failed by osd.7 2020-06-27T04:47:58.754 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.121988+0000 mon.a (mon.0) 937 : cluster [DBG] osd.0 reported immediately failed by osd.1 2020-06-27T04:47:58.754 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.122155+0000 mon.a (mon.0) 938 : cluster [DBG] osd.0 reported immediately failed by osd.2 2020-06-27T04:47:58.755 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.122294+0000 mon.a (mon.0) 939 : cluster [DBG] osd.0 reported immediately failed by osd.1 2020-06-27T04:47:58.755 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.122473+0000 mon.a (mon.0) 940 : cluster [DBG] osd.0 reported immediately failed by osd.2 2020-06-27T04:47:58.755 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.122642+0000 mon.a (mon.0) 941 : cluster [DBG] osd.0 reported immediately failed by osd.3 2020-06-27T04:47:58.755 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.122810+0000 mon.a (mon.0) 942 : cluster [DBG] osd.0 reported immediately failed by osd.3 2020-06-27T04:47:58.755 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: audit 2020-06-27T04:47:58.429326+0000 mon.a (mon.0) 943 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "app1","yes_i_really_mean_it": true}]': finished 2020-06-27T04:47:58.756 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: cluster 2020-06-27T04:47:58.429383+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e102: 8 total, 4 up, 8 in 2020-06-27T04:47:58.756 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: audit 2020-06-27T04:47:58.432864+0000 mon.a (mon.0) 945 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "app2"}]: dispatch 2020-06-27T04:47:58.756 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:47:58 smithi051 bash[18409]: audit 2020-06-27T04:47:58.433362+0000 mon.a (mon.0) 946 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:47:59.194 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:59 smithi051 podman[36974]: 2020-06-27 04:47:59.054222674 +0000 UTC m=+0.537280502 container create 7a78b54e74b4c1379c68d7ddb5a2b757bf1a8d092b10638bb4b4afda0e000f91 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:47:59.194 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:58 smithi051 podman[35867]: 2020-06-27 04:47:58.854318228 +0000 UTC m=+8.059701596 container remove cddc408f62d92e1e9e7a9e9134448e5004b3dc787b2313b4c4a079aae3bfe175 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:47:59.194 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:58 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:47:59.445 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:59 smithi051 podman[36998]: 2020-06-27 04:47:59.250833932 +0000 UTC m=+0.380093624 container create 81d1955909682211c021d536b3797fa6daa26b9cc223aaaee2bb48c4ea7115c3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:47:59.445 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:59 smithi051 podman[36998]: 2020-06-27 04:47:59.442397093 +0000 UTC m=+0.571656697 container init 81d1955909682211c021d536b3797fa6daa26b9cc223aaaee2bb48c4ea7115c3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:47:59.446 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:59 smithi051 podman[36974]: 2020-06-27 04:47:59.35223514 +0000 UTC m=+0.835292969 container init 7a78b54e74b4c1379c68d7ddb5a2b757bf1a8d092b10638bb4b4afda0e000f91 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:47:59.446 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:59 smithi051 podman[36974]: 2020-06-27 04:47:59.400781606 +0000 UTC m=+0.883839448 container start 7a78b54e74b4c1379c68d7ddb5a2b757bf1a8d092b10638bb4b4afda0e000f91 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:47:59.446 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:59 smithi051 podman[36974]: 2020-06-27 04:47:59.400851177 +0000 UTC m=+0.883909035 container attach 7a78b54e74b4c1379c68d7ddb5a2b757bf1a8d092b10638bb4b4afda0e000f91 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:47:59.718 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:47:59 smithi051 podman[36974]: 2020-06-27 04:47:59.685591698 +0000 UTC m=+1.168649550 container died 7a78b54e74b4c1379c68d7ddb5a2b757bf1a8d092b10638bb4b4afda0e000f91 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:47:59.718 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:59 smithi051 podman[36998]: 2020-06-27 04:47:59.484096764 +0000 UTC m=+0.613356343 container start 81d1955909682211c021d536b3797fa6daa26b9cc223aaaee2bb48c4ea7115c3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:47:59.718 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:59 smithi051 podman[36998]: 2020-06-27 04:47:59.484172517 +0000 UTC m=+0.613432113 container attach 81d1955909682211c021d536b3797fa6daa26b9cc223aaaee2bb48c4ea7115c3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:00.217 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:47:59 smithi051 podman[36998]: 2020-06-27 04:47:59.778384612 +0000 UTC m=+0.907644212 container died 81d1955909682211c021d536b3797fa6daa26b9cc223aaaee2bb48c4ea7115c3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:00.533 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:00 smithi031 bash[18426]: cluster 2020-06-27T04:47:59.207413+0000 mgr.x (mgr.34109) 245 : cluster [DBG] pgmap v261: 833 pgs: 12 active+undersized+degraded, 4 stale+activating+undersized, 14 creating+down, 50 down, 156 peering, 3 stale+creating+incomplete, 13 stale+down, 11 stale+undersized+degraded+peered, 52 stale+active+clean, 45 unknown, 2 stale+creating+peering, 63 active+undersized, 142 stale+peering, 22 stale+active+undersized+degraded, 11 undersized+degraded+peered, 48 active+clean, 67 stale+undersized+peered, 32 undersized+peered, 86 stale+active+undersized; 18 KiB data, 13 MiB used, 707 GiB / 715 GiB avail; 511 B/s rd, 2.0 KiB/s wr, 2 op/s; 177/1035 objects degraded (17.101%); 68 B/s, 0 keys/s, 1 objects/s recovering 2020-06-27T04:48:00.533 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:00 smithi031 bash[18426]: audit 2020-06-27T04:47:59.430889+0000 mon.a (mon.0) 947 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "app2","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:00.533 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:00 smithi031 bash[18426]: cluster 2020-06-27T04:47:59.431102+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e103: 8 total, 4 up, 8 in 2020-06-27T04:48:00.533 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:00 smithi031 bash[18426]: audit 2020-06-27T04:47:59.432653+0000 mon.a (mon.0) 949 : audit [INF] from='client.? 172.21.15.31:0/4082763070' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:00.534 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:00 smithi031 bash[18426]: audit 2020-06-27T04:47:59.436314+0000 mon.a (mon.0) 950 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi031-41256-1","app":"dne","key":"key","value":"value"}]: dispatch 2020-06-27T04:48:00.534 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:00 smithi031 bash[18426]: audit 2020-06-27T04:47:59.437735+0000 mon.a (mon.0) 951 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi031-41256-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2020-06-27T04:48:00.534 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:00 smithi031 bash[18426]: audit 2020-06-27T04:47:59.641238+0000 mon.c (mon.1) 71 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi031-41319-4"}]: dispatch 2020-06-27T04:48:00.535 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:00 smithi031 bash[18426]: audit 2020-06-27T04:47:59.958649+0000 mon.a (mon.0) 952 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi031-41319-4"}]: dispatch 2020-06-27T04:48:00.535 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:00 smithi031 podman[44920]: 2020-06-27 04:48:00.22924144 +0000 UTC m=+7.653762322 container remove c46c6ee631fa3abe70e91c27cd2ba1dc34ba3c8f8dbf616482bc24f02bec798f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:48:00.535 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:00 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:00.535 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:00 smithi031 bash[22603]: cluster 2020-06-27T04:47:59.207413+0000 mgr.x (mgr.34109) 245 : cluster [DBG] pgmap v261: 833 pgs: 12 active+undersized+degraded, 4 stale+activating+undersized, 14 creating+down, 50 down, 156 peering, 3 stale+creating+incomplete, 13 stale+down, 11 stale+undersized+degraded+peered, 52 stale+active+clean, 45 unknown, 2 stale+creating+peering, 63 active+undersized, 142 stale+peering, 22 stale+active+undersized+degraded, 11 undersized+degraded+peered, 48 active+clean, 67 stale+undersized+peered, 32 undersized+peered, 86 stale+active+undersized; 18 KiB data, 13 MiB used, 707 GiB / 715 GiB avail; 511 B/s rd, 2.0 KiB/s wr, 2 op/s; 177/1035 objects degraded (17.101%); 68 B/s, 0 keys/s, 1 objects/s recovering 2020-06-27T04:48:00.536 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:00 smithi031 bash[22603]: audit 2020-06-27T04:47:59.430889+0000 mon.a (mon.0) 947 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "app2","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:00.536 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:00 smithi031 bash[22603]: cluster 2020-06-27T04:47:59.431102+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e103: 8 total, 4 up, 8 in 2020-06-27T04:48:00.536 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:00 smithi031 bash[22603]: audit 2020-06-27T04:47:59.432653+0000 mon.a (mon.0) 949 : audit [INF] from='client.? 172.21.15.31:0/4082763070' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:00.536 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:00 smithi031 bash[22603]: audit 2020-06-27T04:47:59.436314+0000 mon.a (mon.0) 950 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi031-41256-1","app":"dne","key":"key","value":"value"}]: dispatch 2020-06-27T04:48:00.536 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:00 smithi031 bash[22603]: audit 2020-06-27T04:47:59.437735+0000 mon.a (mon.0) 951 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi031-41256-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2020-06-27T04:48:00.537 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:00 smithi031 bash[22603]: audit 2020-06-27T04:47:59.641238+0000 mon.c (mon.1) 71 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi031-41319-4"}]: dispatch 2020-06-27T04:48:00.537 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:00 smithi031 bash[22603]: audit 2020-06-27T04:47:59.958649+0000 mon.a (mon.0) 952 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi031-41319-4"}]: dispatch 2020-06-27T04:48:00.723 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:00 smithi051 podman[36974]: 2020-06-27 04:48:00.32881589 +0000 UTC m=+1.811873732 container remove 7a78b54e74b4c1379c68d7ddb5a2b757bf1a8d092b10638bb4b4afda0e000f91 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:00.723 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:00 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Failed with result 'exit-code'. 2020-06-27T04:48:00.725 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:00 smithi051 podman[36998]: 2020-06-27 04:48:00.413525534 +0000 UTC m=+1.542785159 container remove 81d1955909682211c021d536b3797fa6daa26b9cc223aaaee2bb48c4ea7115c3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:00.725 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:00 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2020-06-27T04:48:00.725 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:00 smithi051 bash[18409]: cluster 2020-06-27T04:47:59.207413+0000 mgr.x (mgr.34109) 245 : cluster [DBG] pgmap v261: 833 pgs: 12 active+undersized+degraded, 4 stale+activating+undersized, 14 creating+down, 50 down, 156 peering, 3 stale+creating+incomplete, 13 stale+down, 11 stale+undersized+degraded+peered, 52 stale+active+clean, 45 unknown, 2 stale+creating+peering, 63 active+undersized, 142 stale+peering, 22 stale+active+undersized+degraded, 11 undersized+degraded+peered, 48 active+clean, 67 stale+undersized+peered, 32 undersized+peered, 86 stale+active+undersized; 18 KiB data, 13 MiB used, 707 GiB / 715 GiB avail; 511 B/s rd, 2.0 KiB/s wr, 2 op/s; 177/1035 objects degraded (17.101%); 68 B/s, 0 keys/s, 1 objects/s recovering 2020-06-27T04:48:00.725 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:00 smithi051 bash[18409]: audit 2020-06-27T04:47:59.430889+0000 mon.a (mon.0) 947 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41256-1","app": "app2","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:00.726 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:00 smithi051 bash[18409]: cluster 2020-06-27T04:47:59.431102+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e103: 8 total, 4 up, 8 in 2020-06-27T04:48:00.726 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:00 smithi051 bash[18409]: audit 2020-06-27T04:47:59.432653+0000 mon.a (mon.0) 949 : audit [INF] from='client.? 172.21.15.31:0/4082763070' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:00.726 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:00 smithi051 bash[18409]: audit 2020-06-27T04:47:59.436314+0000 mon.a (mon.0) 950 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi031-41256-1","app":"dne","key":"key","value":"value"}]: dispatch 2020-06-27T04:48:00.726 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:00 smithi051 bash[18409]: audit 2020-06-27T04:47:59.437735+0000 mon.a (mon.0) 951 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi031-41256-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2020-06-27T04:48:00.726 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:00 smithi051 bash[18409]: audit 2020-06-27T04:47:59.641238+0000 mon.c (mon.1) 71 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi031-41319-4"}]: dispatch 2020-06-27T04:48:00.727 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:00 smithi051 bash[18409]: audit 2020-06-27T04:47:59.958649+0000 mon.a (mon.0) 952 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi031-41319-4"}]: dispatch 2020-06-27T04:48:00.931 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:00 smithi031 podman[46724]: 2020-06-27 04:48:00.53027327 +0000 UTC m=+0.283390084 container create 1831de4ec0f2ee09ec966574f73f41ab9e53a422e3264ff517270c58d757c4d2 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:48:00.932 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:00 smithi031 podman[46724]: 2020-06-27 04:48:00.67760859 +0000 UTC m=+0.430725308 container init 1831de4ec0f2ee09ec966574f73f41ab9e53a422e3264ff517270c58d757c4d2 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:48:00.932 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:00 smithi031 podman[46724]: 2020-06-27 04:48:00.721845559 +0000 UTC m=+0.474962275 container start 1831de4ec0f2ee09ec966574f73f41ab9e53a422e3264ff517270c58d757c4d2 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:48:00.932 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:00 smithi031 podman[46724]: 2020-06-27 04:48:00.721923544 +0000 UTC m=+0.475040272 container attach 1831de4ec0f2ee09ec966574f73f41ab9e53a422e3264ff517270c58d757c4d2 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:48:01.223 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:00 smithi031 podman[46724]: 2020-06-27 04:48:00.949729293 +0000 UTC m=+0.702846047 container died 1831de4ec0f2ee09ec966574f73f41ab9e53a422e3264ff517270c58d757c4d2 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:48:01.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:00.432818+0000 mon.a (mon.0) 953 : audit [INF] from='client.? 172.21.15.31:0/4082763070' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-5","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:01.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:00.432926+0000 mon.a (mon.0) 954 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi031-41256-1","app":"app1","key":"key1","value":"value1"}]': finished 2020-06-27T04:48:01.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:00.433066+0000 mon.a (mon.0) 955 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi031-41319-4"}]': finished 2020-06-27T04:48:01.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: cluster 2020-06-27T04:48:00.433117+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e104: 8 total, 4 up, 8 in 2020-06-27T04:48:01.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:00.434382+0000 mon.b (mon.2) 290 : audit [INF] from='client.? 172.21.15.31:0/1711700144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41349-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:01.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:00.434387+0000 mon.c (mon.1) 72 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi031-41319-4", "tierpool": "test-rados-api-smithi031-41319-4-cache"}]: dispatch 2020-06-27T04:48:01.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:00.448386+0000 mon.a (mon.0) 957 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi031-41319-4", "tierpool": "test-rados-api-smithi031-41319-4-cache"}]: dispatch 2020-06-27T04:48:01.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:00.449329+0000 mon.a (mon.0) 958 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41349-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:01.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:00.455281+0000 mon.a (mon.0) 959 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi031-41256-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2020-06-27T04:48:01.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:00.471289+0000 mon.c (mon.1) 73 : audit [INF] from='client.? 172.21.15.31:0/852318711' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41166-10"}]: dispatch 2020-06-27T04:48:01.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:00.472337+0000 mon.a (mon.0) 960 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41166-10"}]: dispatch 2020-06-27T04:48:01.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:00.476322+0000 mon.c (mon.1) 74 : audit [INF] from='client.? 172.21.15.31:0/852318711' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41166-10"}]: dispatch 2020-06-27T04:48:01.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:00.477015+0000 mon.a (mon.0) 961 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41166-10"}]: dispatch 2020-06-27T04:48:01.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:00.477632+0000 mon.c (mon.1) 75 : audit [INF] from='client.? 172.21.15.31:0/852318711' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41166-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:48:01.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:00.477929+0000 mon.a (mon.0) 962 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41166-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:48:01.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: cluster 2020-06-27T04:48:01.430676+0000 mon.a (mon.0) 963 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2020-06-27T04:48:01.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:01.441339+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi031-41319-4", "tierpool": "test-rados-api-smithi031-41319-4-cache"}]': finished 2020-06-27T04:48:01.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:01.441445+0000 mon.a (mon.0) 965 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41349-7","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:01.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:01.441595+0000 mon.a (mon.0) 966 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi031-41256-1","app":"app1","key":"key2","value":"value2"}]': finished 2020-06-27T04:48:01.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:01.441650+0000 mon.a (mon.0) 967 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41166-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2020-06-27T04:48:01.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: cluster 2020-06-27T04:48:01.441689+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e105: 8 total, 4 up, 8 in 2020-06-27T04:48:01.724 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:01.442981+0000 mon.c (mon.1) 76 : audit [INF] from='client.? 172.21.15.31:0/852318711' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41166-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41166-10"}]: dispatch 2020-06-27T04:48:01.724 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:01.446825+0000 mon.a (mon.0) 969 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41166-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41166-10"}]: dispatch 2020-06-27T04:48:01.724 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:01 smithi051 bash[18409]: audit 2020-06-27T04:48:01.449514+0000 mon.a (mon.0) 970 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi031-41256-1","app":"app1","key":"key1"}]: dispatch 2020-06-27T04:48:01.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:00.432818+0000 mon.a (mon.0) 953 : audit [INF] from='client.? 172.21.15.31:0/4082763070' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-5","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:01.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:00.432926+0000 mon.a (mon.0) 954 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi031-41256-1","app":"app1","key":"key1","value":"value1"}]': finished 2020-06-27T04:48:01.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:00.433066+0000 mon.a (mon.0) 955 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi031-41319-4"}]': finished 2020-06-27T04:48:01.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: cluster 2020-06-27T04:48:00.433117+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e104: 8 total, 4 up, 8 in 2020-06-27T04:48:01.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:00.434382+0000 mon.b (mon.2) 290 : audit [INF] from='client.? 172.21.15.31:0/1711700144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41349-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:01.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:00.434387+0000 mon.c (mon.1) 72 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi031-41319-4", "tierpool": "test-rados-api-smithi031-41319-4-cache"}]: dispatch 2020-06-27T04:48:01.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:00.448386+0000 mon.a (mon.0) 957 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi031-41319-4", "tierpool": "test-rados-api-smithi031-41319-4-cache"}]: dispatch 2020-06-27T04:48:01.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:00.449329+0000 mon.a (mon.0) 958 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41349-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:01.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:00.455281+0000 mon.a (mon.0) 959 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi031-41256-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2020-06-27T04:48:01.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:00.471289+0000 mon.c (mon.1) 73 : audit [INF] from='client.? 172.21.15.31:0/852318711' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41166-10"}]: dispatch 2020-06-27T04:48:01.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:00.472337+0000 mon.a (mon.0) 960 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41166-10"}]: dispatch 2020-06-27T04:48:01.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:00.476322+0000 mon.c (mon.1) 74 : audit [INF] from='client.? 172.21.15.31:0/852318711' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41166-10"}]: dispatch 2020-06-27T04:48:01.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:00.477015+0000 mon.a (mon.0) 961 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41166-10"}]: dispatch 2020-06-27T04:48:01.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:00.477632+0000 mon.c (mon.1) 75 : audit [INF] from='client.? 172.21.15.31:0/852318711' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41166-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:48:01.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:00.477929+0000 mon.a (mon.0) 962 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41166-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:48:01.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: cluster 2020-06-27T04:48:01.430676+0000 mon.a (mon.0) 963 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2020-06-27T04:48:01.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:01.441339+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi031-41319-4", "tierpool": "test-rados-api-smithi031-41319-4-cache"}]': finished 2020-06-27T04:48:01.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:01.441445+0000 mon.a (mon.0) 965 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41349-7","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:01.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:01.441595+0000 mon.a (mon.0) 966 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi031-41256-1","app":"app1","key":"key2","value":"value2"}]': finished 2020-06-27T04:48:01.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:01.441650+0000 mon.a (mon.0) 967 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41166-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2020-06-27T04:48:01.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: cluster 2020-06-27T04:48:01.441689+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e105: 8 total, 4 up, 8 in 2020-06-27T04:48:01.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:01.442981+0000 mon.c (mon.1) 76 : audit [INF] from='client.? 172.21.15.31:0/852318711' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41166-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41166-10"}]: dispatch 2020-06-27T04:48:01.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:01.446825+0000 mon.a (mon.0) 969 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41166-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41166-10"}]: dispatch 2020-06-27T04:48:01.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[18426]: audit 2020-06-27T04:48:01.449514+0000 mon.a (mon.0) 970 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi031-41256-1","app":"app1","key":"key1"}]: dispatch 2020-06-27T04:48:01.730 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:00.432818+0000 mon.a (mon.0) 953 : audit [INF] from='client.? 172.21.15.31:0/4082763070' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-5","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:01.730 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:00.432926+0000 mon.a (mon.0) 954 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi031-41256-1","app":"app1","key":"key1","value":"value1"}]': finished 2020-06-27T04:48:01.731 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:00.433066+0000 mon.a (mon.0) 955 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi031-41319-4"}]': finished 2020-06-27T04:48:01.731 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: cluster 2020-06-27T04:48:00.433117+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e104: 8 total, 4 up, 8 in 2020-06-27T04:48:01.731 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:00.434382+0000 mon.b (mon.2) 290 : audit [INF] from='client.? 172.21.15.31:0/1711700144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41349-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:01.731 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:00.434387+0000 mon.c (mon.1) 72 : audit [INF] from='client.? 172.21.15.31:0/1168265225' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi031-41319-4", "tierpool": "test-rados-api-smithi031-41319-4-cache"}]: dispatch 2020-06-27T04:48:01.731 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:00.448386+0000 mon.a (mon.0) 957 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi031-41319-4", "tierpool": "test-rados-api-smithi031-41319-4-cache"}]: dispatch 2020-06-27T04:48:01.732 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:00.449329+0000 mon.a (mon.0) 958 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41349-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:01.732 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:00.455281+0000 mon.a (mon.0) 959 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi031-41256-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2020-06-27T04:48:01.732 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:00.471289+0000 mon.c (mon.1) 73 : audit [INF] from='client.? 172.21.15.31:0/852318711' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41166-10"}]: dispatch 2020-06-27T04:48:01.732 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:00.472337+0000 mon.a (mon.0) 960 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi031-41166-10"}]: dispatch 2020-06-27T04:48:01.732 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:00.476322+0000 mon.c (mon.1) 74 : audit [INF] from='client.? 172.21.15.31:0/852318711' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41166-10"}]: dispatch 2020-06-27T04:48:01.733 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:00.477015+0000 mon.a (mon.0) 961 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi031-41166-10"}]: dispatch 2020-06-27T04:48:01.733 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:00.477632+0000 mon.c (mon.1) 75 : audit [INF] from='client.? 172.21.15.31:0/852318711' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41166-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:48:01.733 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:00.477929+0000 mon.a (mon.0) 962 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41166-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2020-06-27T04:48:01.733 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: cluster 2020-06-27T04:48:01.430676+0000 mon.a (mon.0) 963 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2020-06-27T04:48:01.733 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:01.441339+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi031-41319-4", "tierpool": "test-rados-api-smithi031-41319-4-cache"}]': finished 2020-06-27T04:48:01.734 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:01.441445+0000 mon.a (mon.0) 965 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41349-7","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:01.734 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:01.441595+0000 mon.a (mon.0) 966 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi031-41256-1","app":"app1","key":"key2","value":"value2"}]': finished 2020-06-27T04:48:01.735 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:01.441650+0000 mon.a (mon.0) 967 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi031-41166-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2020-06-27T04:48:01.735 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: cluster 2020-06-27T04:48:01.441689+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e105: 8 total, 4 up, 8 in 2020-06-27T04:48:01.735 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:01.442981+0000 mon.c (mon.1) 76 : audit [INF] from='client.? 172.21.15.31:0/852318711' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41166-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41166-10"}]: dispatch 2020-06-27T04:48:01.735 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:01.446825+0000 mon.a (mon.0) 969 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41166-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41166-10"}]: dispatch 2020-06-27T04:48:01.735 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:01 smithi031 bash[22603]: audit 2020-06-27T04:48:01.449514+0000 mon.a (mon.0) 970 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi031-41256-1","app":"app1","key":"key1"}]: dispatch 2020-06-27T04:48:02.223 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:01 smithi031 podman[46724]: 2020-06-27 04:48:01.825213167 +0000 UTC m=+1.578329905 container remove 1831de4ec0f2ee09ec966574f73f41ab9e53a422e3264ff517270c58d757c4d2 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:48:02.223 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:01 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2020-06-27T04:48:02.724 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:02.724 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: in thread 7fdf6b34d700 thread_name:tp_osd_tp 2020-06-27T04:48:02.725 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:02.725 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 1: (()+0x12dd0) [0x7fdf8b949dd0] 2020-06-27T04:48:02.725 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5614f149d707] 2020-06-27T04:48:02.725 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5614f149daa0] 2020-06-27T04:48:02.725 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5614f14cf67a] 2020-06-27T04:48:02.726 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5614f14d0a57] 2020-06-27T04:48:02.726 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5614f115b938] 2020-06-27T04:48:02.726 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5614f130fa70] 2020-06-27T04:48:02.726 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5614f131fdd7] 2020-06-27T04:48:02.726 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5614f118e252] 2020-06-27T04:48:02.727 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5614f1131e2e] 2020-06-27T04:48:02.727 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5614f0fb24e9] 2020-06-27T04:48:02.727 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5614f1216f78] 2020-06-27T04:48:02.727 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5614f0fd170f] 2020-06-27T04:48:02.727 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5614f160fb94] 2020-06-27T04:48:02.728 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5614f16127f4] 2020-06-27T04:48:02.728 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 16: (()+0x82de) [0x7fdf8b93f2de] 2020-06-27T04:48:02.728 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 17: (clone()+0x43) [0x7fdf8a676e83] 2020-06-27T04:48:02.728 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: debug 2020-06-27T04:48:02.263+0000 7fdf6b34d700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:02.728 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: in thread 7fdf6b34d700 thread_name:tp_osd_tp 2020-06-27T04:48:02.728 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:02.729 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 1: (()+0x12dd0) [0x7fdf8b949dd0] 2020-06-27T04:48:02.729 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5614f149d707] 2020-06-27T04:48:02.729 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5614f149daa0] 2020-06-27T04:48:02.729 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5614f14cf67a] 2020-06-27T04:48:02.729 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5614f14d0a57] 2020-06-27T04:48:02.730 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5614f115b938] 2020-06-27T04:48:02.730 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5614f130fa70] 2020-06-27T04:48:02.730 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5614f131fdd7] 2020-06-27T04:48:02.730 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5614f118e252] 2020-06-27T04:48:02.730 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5614f1131e2e] 2020-06-27T04:48:02.731 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5614f0fb24e9] 2020-06-27T04:48:02.731 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5614f1216f78] 2020-06-27T04:48:02.731 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5614f0fd170f] 2020-06-27T04:48:02.731 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5614f160fb94] 2020-06-27T04:48:02.731 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5614f16127f4] 2020-06-27T04:48:02.731 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 16: (()+0x82de) [0x7fdf8b93f2de] 2020-06-27T04:48:02.732 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 17: (clone()+0x43) [0x7fdf8a676e83] 2020-06-27T04:48:02.732 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:02.732 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: debug 0> 2020-06-27T04:48:02.263+0000 7fdf6b34d700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:02.732 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: in thread 7fdf6b34d700 thread_name:tp_osd_tp 2020-06-27T04:48:02.732 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:02.733 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 1: (()+0x12dd0) [0x7fdf8b949dd0] 2020-06-27T04:48:02.733 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5614f149d707] 2020-06-27T04:48:02.733 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5614f149daa0] 2020-06-27T04:48:02.733 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5614f14cf67a] 2020-06-27T04:48:02.733 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5614f14d0a57] 2020-06-27T04:48:02.734 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5614f115b938] 2020-06-27T04:48:02.734 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5614f130fa70] 2020-06-27T04:48:02.734 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5614f131fdd7] 2020-06-27T04:48:02.734 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5614f118e252] 2020-06-27T04:48:02.734 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5614f1131e2e] 2020-06-27T04:48:02.735 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5614f0fb24e9] 2020-06-27T04:48:02.735 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5614f1216f78] 2020-06-27T04:48:02.735 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5614f0fd170f] 2020-06-27T04:48:02.735 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5614f160fb94] 2020-06-27T04:48:02.735 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5614f16127f4] 2020-06-27T04:48:02.736 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 16: (()+0x82de) [0x7fdf8b93f2de] 2020-06-27T04:48:02.736 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 17: (clone()+0x43) [0x7fdf8a676e83] 2020-06-27T04:48:02.736 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:02.736 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: debug -9999> 2020-06-27T04:48:02.263+0000 7fdf6b34d700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:02.736 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: in thread 7fdf6b34d700 thread_name:tp_osd_tp 2020-06-27T04:48:02.736 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:02.737 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 1: (()+0x12dd0) [0x7fdf8b949dd0] 2020-06-27T04:48:02.737 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5614f149d707] 2020-06-27T04:48:02.737 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5614f149daa0] 2020-06-27T04:48:02.737 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5614f14cf67a] 2020-06-27T04:48:02.737 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5614f14d0a57] 2020-06-27T04:48:02.738 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5614f115b938] 2020-06-27T04:48:02.738 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5614f130fa70] 2020-06-27T04:48:02.738 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5614f131fdd7] 2020-06-27T04:48:02.739 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5614f118e252] 2020-06-27T04:48:02.739 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5614f1131e2e] 2020-06-27T04:48:02.739 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5614f0fb24e9] 2020-06-27T04:48:02.739 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5614f1216f78] 2020-06-27T04:48:02.739 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5614f0fd170f] 2020-06-27T04:48:02.739 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5614f160fb94] 2020-06-27T04:48:02.740 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5614f16127f4] 2020-06-27T04:48:02.740 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 16: (()+0x82de) [0x7fdf8b93f2de] 2020-06-27T04:48:02.740 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: 17: (clone()+0x43) [0x7fdf8a676e83] 2020-06-27T04:48:02.740 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:02.740 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44819]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:02.741 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:02 smithi031 podman[45183]: 2020-06-27 04:48:02.50253061 +0000 UTC m=+8.102626461 container died c19f5a50f90454f1364b80895ba41ede5f3a94782e0e75eb95375a79f9fdb73e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:48:02.741 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:02.741 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: in thread 7f6f2a613700 thread_name:tp_osd_tp 2020-06-27T04:48:02.741 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:02.741 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 1: (()+0x12dd0) [0x7f6f4ac0fdd0] 2020-06-27T04:48:02.742 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55ffb120d707] 2020-06-27T04:48:02.742 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55ffb120daa0] 2020-06-27T04:48:02.742 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55ffb123f67a] 2020-06-27T04:48:02.742 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55ffb1240a57] 2020-06-27T04:48:02.743 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55ffb0ecb938] 2020-06-27T04:48:02.743 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55ffb107c03d] 2020-06-27T04:48:02.743 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55ffb0e395b0] 2020-06-27T04:48:02.743 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55ffb0e9289d] 2020-06-27T04:48:02.743 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55ffb0e9b380] 2020-06-27T04:48:02.744 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55ffb0ea2590] 2020-06-27T04:48:02.744 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55ffb0d224e9] 2020-06-27T04:48:02.744 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55ffb0f86f78] 2020-06-27T04:48:02.744 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55ffb0d4170f] 2020-06-27T04:48:02.744 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55ffb137fb94] 2020-06-27T04:48:02.744 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55ffb13827f4] 2020-06-27T04:48:02.745 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 17: (()+0x82de) [0x7f6f4ac052de] 2020-06-27T04:48:02.745 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 18: (clone()+0x43) [0x7f6f4993ce83] 2020-06-27T04:48:02.745 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: debug 2020-06-27T04:48:02.263+0000 7f6f2a613700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:02.745 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: in thread 7f6f2a613700 thread_name:tp_osd_tp 2020-06-27T04:48:02.745 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:02.746 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 1: (()+0x12dd0) [0x7f6f4ac0fdd0] 2020-06-27T04:48:02.746 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55ffb120d707] 2020-06-27T04:48:02.746 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55ffb120daa0] 2020-06-27T04:48:02.746 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55ffb123f67a] 2020-06-27T04:48:02.746 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55ffb1240a57] 2020-06-27T04:48:02.746 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55ffb0ecb938] 2020-06-27T04:48:02.747 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55ffb107c03d] 2020-06-27T04:48:02.747 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55ffb0e395b0] 2020-06-27T04:48:02.747 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55ffb0e9289d] 2020-06-27T04:48:02.747 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55ffb0e9b380] 2020-06-27T04:48:02.747 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55ffb0ea2590] 2020-06-27T04:48:02.748 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55ffb0d224e9] 2020-06-27T04:48:02.748 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55ffb0f86f78] 2020-06-27T04:48:02.748 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55ffb0d4170f] 2020-06-27T04:48:02.748 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55ffb137fb94] 2020-06-27T04:48:02.748 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55ffb13827f4] 2020-06-27T04:48:02.749 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 17: (()+0x82de) [0x7f6f4ac052de] 2020-06-27T04:48:02.749 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 18: (clone()+0x43) [0x7f6f4993ce83] 2020-06-27T04:48:02.749 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:02.749 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: debug 0> 2020-06-27T04:48:02.263+0000 7f6f2a613700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:02.749 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: in thread 7f6f2a613700 thread_name:tp_osd_tp 2020-06-27T04:48:02.749 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:02.750 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 1: (()+0x12dd0) [0x7f6f4ac0fdd0] 2020-06-27T04:48:02.750 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55ffb120d707] 2020-06-27T04:48:02.750 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55ffb120daa0] 2020-06-27T04:48:02.750 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55ffb123f67a] 2020-06-27T04:48:02.750 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55ffb1240a57] 2020-06-27T04:48:02.751 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55ffb0ecb938] 2020-06-27T04:48:02.751 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55ffb107c03d] 2020-06-27T04:48:02.751 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55ffb0e395b0] 2020-06-27T04:48:02.751 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55ffb0e9289d] 2020-06-27T04:48:02.751 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55ffb0e9b380] 2020-06-27T04:48:02.752 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55ffb0ea2590] 2020-06-27T04:48:02.752 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55ffb0d224e9] 2020-06-27T04:48:02.752 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55ffb0f86f78] 2020-06-27T04:48:02.752 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55ffb0d4170f] 2020-06-27T04:48:02.752 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55ffb137fb94] 2020-06-27T04:48:02.752 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55ffb13827f4] 2020-06-27T04:48:02.753 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 17: (()+0x82de) [0x7f6f4ac052de] 2020-06-27T04:48:02.753 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 18: (clone()+0x43) [0x7f6f4993ce83] 2020-06-27T04:48:02.753 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:02.753 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: debug -9999> 2020-06-27T04:48:02.263+0000 7f6f2a613700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:02.753 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: in thread 7f6f2a613700 thread_name:tp_osd_tp 2020-06-27T04:48:02.754 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:02.754 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 1: (()+0x12dd0) [0x7f6f4ac0fdd0] 2020-06-27T04:48:02.754 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55ffb120d707] 2020-06-27T04:48:02.754 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55ffb120daa0] 2020-06-27T04:48:02.754 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55ffb123f67a] 2020-06-27T04:48:02.754 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55ffb1240a57] 2020-06-27T04:48:02.755 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55ffb0ecb938] 2020-06-27T04:48:02.755 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55ffb107c03d] 2020-06-27T04:48:02.755 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55ffb0e395b0] 2020-06-27T04:48:02.755 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55ffb0e9289d] 2020-06-27T04:48:02.755 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55ffb0e9b380] 2020-06-27T04:48:02.756 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55ffb0ea2590] 2020-06-27T04:48:02.756 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55ffb0d224e9] 2020-06-27T04:48:02.756 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55ffb0f86f78] 2020-06-27T04:48:02.756 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55ffb0d4170f] 2020-06-27T04:48:02.756 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55ffb137fb94] 2020-06-27T04:48:02.757 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55ffb13827f4] 2020-06-27T04:48:02.757 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 17: (()+0x82de) [0x7f6f4ac052de] 2020-06-27T04:48:02.757 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: 18: (clone()+0x43) [0x7f6f4993ce83] 2020-06-27T04:48:02.757 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:02.757 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44699]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:02.757 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:02 smithi031 podman[45048]: 2020-06-27 04:48:02.411409829 +0000 UTC m=+9.302375813 container died 87c2eaa1c2c48fd70e8248ea3ad144badb3967b24883a72e149dd498659fbf74 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:48:02.758 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:02.758 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: in thread 7f60fc6e1700 thread_name:tp_osd_tp 2020-06-27T04:48:02.758 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:02.759 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 1: (()+0x12dd0) [0x7f6120ce5dd0] 2020-06-27T04:48:02.759 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55aac3a81707] 2020-06-27T04:48:02.759 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55aac3a81aa0] 2020-06-27T04:48:02.759 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55aac3ab367a] 2020-06-27T04:48:02.760 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55aac3ab4a57] 2020-06-27T04:48:02.760 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55aac373f938] 2020-06-27T04:48:02.760 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55aac38f3a70] 2020-06-27T04:48:02.760 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55aac3903dd7] 2020-06-27T04:48:02.760 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55aac3772252] 2020-06-27T04:48:02.760 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55aac3715e2e] 2020-06-27T04:48:02.761 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55aac35964e9] 2020-06-27T04:48:02.761 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55aac37faf78] 2020-06-27T04:48:02.761 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55aac35b570f] 2020-06-27T04:48:02.761 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55aac3bf3b94] 2020-06-27T04:48:02.761 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55aac3bf67f4] 2020-06-27T04:48:02.762 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 16: (()+0x82de) [0x7f6120cdb2de] 2020-06-27T04:48:02.762 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 17: (clone()+0x43) [0x7f611fa12e83] 2020-06-27T04:48:02.762 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: debug 2020-06-27T04:48:02.263+0000 7f60fc6e1700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:02.762 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: in thread 7f60fc6e1700 thread_name:tp_osd_tp 2020-06-27T04:48:02.762 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:02.763 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 1: (()+0x12dd0) [0x7f6120ce5dd0] 2020-06-27T04:48:02.763 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55aac3a81707] 2020-06-27T04:48:02.763 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55aac3a81aa0] 2020-06-27T04:48:02.763 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55aac3ab367a] 2020-06-27T04:48:02.763 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55aac3ab4a57] 2020-06-27T04:48:02.765 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55aac373f938] 2020-06-27T04:48:02.765 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55aac38f3a70] 2020-06-27T04:48:02.765 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55aac3903dd7] 2020-06-27T04:48:02.765 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55aac3772252] 2020-06-27T04:48:02.766 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55aac3715e2e] 2020-06-27T04:48:02.766 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55aac35964e9] 2020-06-27T04:48:02.766 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55aac37faf78] 2020-06-27T04:48:02.766 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55aac35b570f] 2020-06-27T04:48:02.766 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55aac3bf3b94] 2020-06-27T04:48:02.767 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55aac3bf67f4] 2020-06-27T04:48:02.767 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 16: (()+0x82de) [0x7f6120cdb2de] 2020-06-27T04:48:02.767 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 17: (clone()+0x43) [0x7f611fa12e83] 2020-06-27T04:48:02.767 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:02.767 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: debug 0> 2020-06-27T04:48:02.263+0000 7f60fc6e1700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:02.767 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: in thread 7f60fc6e1700 thread_name:tp_osd_tp 2020-06-27T04:48:02.768 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:02.768 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 1: (()+0x12dd0) [0x7f6120ce5dd0] 2020-06-27T04:48:02.768 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55aac3a81707] 2020-06-27T04:48:02.768 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55aac3a81aa0] 2020-06-27T04:48:02.768 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55aac3ab367a] 2020-06-27T04:48:02.769 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55aac3ab4a57] 2020-06-27T04:48:02.769 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55aac373f938] 2020-06-27T04:48:02.769 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55aac38f3a70] 2020-06-27T04:48:02.769 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55aac3903dd7] 2020-06-27T04:48:02.769 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55aac3772252] 2020-06-27T04:48:02.770 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55aac3715e2e] 2020-06-27T04:48:02.770 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55aac35964e9] 2020-06-27T04:48:02.770 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55aac37faf78] 2020-06-27T04:48:02.770 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55aac35b570f] 2020-06-27T04:48:02.770 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55aac3bf3b94] 2020-06-27T04:48:02.770 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55aac3bf67f4] 2020-06-27T04:48:02.771 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 16: (()+0x82de) [0x7f6120cdb2de] 2020-06-27T04:48:02.771 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 17: (clone()+0x43) [0x7f611fa12e83] 2020-06-27T04:48:02.771 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:02.771 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: debug -9999> 2020-06-27T04:48:02.263+0000 7f60fc6e1700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:02.771 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: in thread 7f60fc6e1700 thread_name:tp_osd_tp 2020-06-27T04:48:02.772 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:02.772 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 1: (()+0x12dd0) [0x7f6120ce5dd0] 2020-06-27T04:48:02.772 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55aac3a81707] 2020-06-27T04:48:02.772 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55aac3a81aa0] 2020-06-27T04:48:02.772 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55aac3ab367a] 2020-06-27T04:48:02.773 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55aac3ab4a57] 2020-06-27T04:48:02.773 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55aac373f938] 2020-06-27T04:48:02.773 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55aac38f3a70] 2020-06-27T04:48:02.773 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55aac3903dd7] 2020-06-27T04:48:02.773 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55aac3772252] 2020-06-27T04:48:02.774 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55aac3715e2e] 2020-06-27T04:48:02.774 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55aac35964e9] 2020-06-27T04:48:02.774 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55aac37faf78] 2020-06-27T04:48:02.774 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55aac35b570f] 2020-06-27T04:48:02.774 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55aac3bf3b94] 2020-06-27T04:48:02.775 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55aac3bf67f4] 2020-06-27T04:48:02.775 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 16: (()+0x82de) [0x7f6120cdb2de] 2020-06-27T04:48:02.775 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: 17: (clone()+0x43) [0x7f611fa12e83] 2020-06-27T04:48:02.775 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:02.775 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[44885]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:02.891 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [==========] Running 11 tests from 4 test suites. 2020-06-27T04:48:02.891 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [----------] Global test environment set-up. 2020-06-27T04:48:02.891 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2020-06-27T04:48:02.892 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2020-06-27T04:48:02.892 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2020-06-27T04:48:02.892 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2020-06-27T04:48:02.892 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: 2020-06-27T04:48:02.892 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [----------] 1 test from LibRadosMiscConnectFailure 2020-06-27T04:48:02.892 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2020-06-27T04:48:02.893 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: 0 2020-06-27T04:48:02.893 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (41 ms) 2020-06-27T04:48:02.893 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [----------] 1 test from LibRadosMiscConnectFailure (41 ms total) 2020-06-27T04:48:02.893 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: 2020-06-27T04:48:02.893 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2020-06-27T04:48:02.894 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2020-06-27T04:48:02.894 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a4775c8040 2020-06-27T04:48:02.894 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a47765d860 2020-06-27T04:48:02.894 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a4775cc420 2020-06-27T04:48:02.894 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a478cd46a0 2020-06-27T04:48:02.895 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a478cd5220 2020-06-27T04:48:02.895 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a478cd5da0 2020-06-27T04:48:02.895 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a478cd6920 2020-06-27T04:48:02.895 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a478cd74a0 2020-06-27T04:48:02.895 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a478cd8020 2020-06-27T04:48:02.895 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a478cd8ba0 2020-06-27T04:48:02.896 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a478cd9720 2020-06-27T04:48:02.896 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a478cda2a0 2020-06-27T04:48:02.896 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a478cdae20 2020-06-27T04:48:02.896 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a478cdb9a0 2020-06-27T04:48:02.897 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a478cdc520 2020-06-27T04:48:02.897 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a478cd7c40 2020-06-27T04:48:02.897 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a478cd7d50 2020-06-27T04:48:02.897 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a478cd7e60 2020-06-27T04:48:02.897 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a478cd2ef0 2020-06-27T04:48:02.898 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a478cd3000 2020-06-27T04:48:02.898 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 0x55a478cd3130 2020-06-27T04:48:02.898 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: started 21 aios 2020-06-27T04:48:02.898 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a4775c8040 2020-06-27T04:48:02.898 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a47765d860 2020-06-27T04:48:02.898 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a4775cc420 2020-06-27T04:48:02.899 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a478cd46a0 2020-06-27T04:48:02.899 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a478cd5220 2020-06-27T04:48:02.899 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a478cd5da0 2020-06-27T04:48:02.899 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a478cd6920 2020-06-27T04:48:02.899 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a478cd74a0 2020-06-27T04:48:02.900 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a478cd8020 2020-06-27T04:48:02.900 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a478cd8ba0 2020-06-27T04:48:02.900 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a478cd9720 2020-06-27T04:48:02.900 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a478cda2a0 2020-06-27T04:48:02.900 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a478cdae20 2020-06-27T04:48:02.900 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a478cdb9a0 2020-06-27T04:48:02.901 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a478cdc520 2020-06-27T04:48:02.901 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a478cd7c40 2020-06-27T04:48:02.901 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a478cd7d50 2020-06-27T04:48:02.901 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a478cd7e60 2020-06-27T04:48:02.901 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a478cd2ef0 2020-06-27T04:48:02.901 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a478cd3000 2020-06-27T04:48:02.902 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: waiting 0x55a478cd3130 2020-06-27T04:48:02.902 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: done. 2020-06-27T04:48:02.902 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (34481 ms) 2020-06-27T04:48:02.902 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (34481 ms total) 2020-06-27T04:48:02.903 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: 2020-06-27T04:48:02.903 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2020-06-27T04:48:02.903 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2020-06-27T04:48:02.904 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (1 ms) 2020-06-27T04:48:02.904 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2020-06-27T04:48:02.904 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ OK ] LibRadosMisc.Exec (20211 ms) 2020-06-27T04:48:02.904 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2020-06-27T04:48:02.904 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (3199 ms) 2020-06-27T04:48:02.904 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2020-06-27T04:48:02.905 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (4 ms) 2020-06-27T04:48:02.905 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2020-06-27T04:48:03.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:02 smithi051 bash[18409]: cluster 2020-06-27T04:48:01.209520+0000 mgr.x (mgr.34109) 246 : cluster [DBG] pgmap v264: 833 pgs: 25 creating+peering, 50 active+undersized+degraded, 2 creating+down, 19 down, 46 peering, 1 stale+creating+incomplete, 5 stale+down, 2 stale+undersized+degraded+peered, 10 stale+active+clean, 28 unknown, 1 stale+creating+peering, 214 active+undersized, 67 stale+peering, 8 stale+active+undersized+degraded, 50 undersized+degraded+peered, 57 active+clean, 11 stale+undersized+peered, 202 undersized+peered, 35 stale+active+undersized; 19 KiB data, 14 MiB used, 707 GiB / 715 GiB avail; 4.0 KiB/s wr, 1 op/s; 402/1035 objects degraded (38.841%) 2020-06-27T04:48:03.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:02 smithi051 bash[18409]: cluster 2020-06-27T04:48:02.321707+0000 mon.a (mon.0) 971 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:03.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:02 smithi051 bash[18409]: cluster 2020-06-27T04:48:02.321744+0000 mon.a (mon.0) 972 : cluster [INF] osd.3 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:48:03.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:02 smithi051 bash[18409]: cluster 2020-06-27T04:48:02.321920+0000 mon.a (mon.0) 973 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:03.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:02 smithi051 bash[18409]: cluster 2020-06-27T04:48:02.327674+0000 mon.a (mon.0) 974 : cluster [DBG] osd.2 reported immediately failed by osd.7 2020-06-27T04:48:03.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:02 smithi051 bash[18409]: cluster 2020-06-27T04:48:02.327718+0000 mon.a (mon.0) 975 : cluster [INF] osd.2 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:48:03.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:02 smithi051 bash[18409]: cluster 2020-06-27T04:48:02.436506+0000 mon.a (mon.0) 976 : cluster [WRN] Health check update: 6 osds down (OSD_DOWN) 2020-06-27T04:48:03.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[18426]: cluster 2020-06-27T04:48:01.209520+0000 mgr.x (mgr.34109) 246 : cluster [DBG] pgmap v264: 833 pgs: 25 creating+peering, 50 active+undersized+degraded, 2 creating+down, 19 down, 46 peering, 1 stale+creating+incomplete, 5 stale+down, 2 stale+undersized+degraded+peered, 10 stale+active+clean, 28 unknown, 1 stale+creating+peering, 214 active+undersized, 67 stale+peering, 8 stale+active+undersized+degraded, 50 undersized+degraded+peered, 57 active+clean, 11 stale+undersized+peered, 202 undersized+peered, 35 stale+active+undersized; 19 KiB data, 14 MiB used, 707 GiB / 715 GiB avail; 4.0 KiB/s wr, 1 op/s; 402/1035 objects degraded (38.841%) 2020-06-27T04:48:03.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[18426]: cluster 2020-06-27T04:48:02.321707+0000 mon.a (mon.0) 971 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:03.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[18426]: cluster 2020-06-27T04:48:02.321744+0000 mon.a (mon.0) 972 : cluster [INF] osd.3 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:48:03.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[18426]: cluster 2020-06-27T04:48:02.321920+0000 mon.a (mon.0) 973 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:03.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[18426]: cluster 2020-06-27T04:48:02.327674+0000 mon.a (mon.0) 974 : cluster [DBG] osd.2 reported immediately failed by osd.7 2020-06-27T04:48:03.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[18426]: cluster 2020-06-27T04:48:02.327718+0000 mon.a (mon.0) 975 : cluster [INF] osd.2 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:48:03.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[18426]: cluster 2020-06-27T04:48:02.436506+0000 mon.a (mon.0) 976 : cluster [WRN] Health check update: 6 osds down (OSD_DOWN) 2020-06-27T04:48:03.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[22603]: cluster 2020-06-27T04:48:01.209520+0000 mgr.x (mgr.34109) 246 : cluster [DBG] pgmap v264: 833 pgs: 25 creating+peering, 50 active+undersized+degraded, 2 creating+down, 19 down, 46 peering, 1 stale+creating+incomplete, 5 stale+down, 2 stale+undersized+degraded+peered, 10 stale+active+clean, 28 unknown, 1 stale+creating+peering, 214 active+undersized, 67 stale+peering, 8 stale+active+undersized+degraded, 50 undersized+degraded+peered, 57 active+clean, 11 stale+undersized+peered, 202 undersized+peered, 35 stale+active+undersized; 19 KiB data, 14 MiB used, 707 GiB / 715 GiB avail; 4.0 KiB/s wr, 1 op/s; 402/1035 objects degraded (38.841%) 2020-06-27T04:48:03.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[22603]: cluster 2020-06-27T04:48:02.321707+0000 mon.a (mon.0) 971 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:03.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[22603]: cluster 2020-06-27T04:48:02.321744+0000 mon.a (mon.0) 972 : cluster [INF] osd.3 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:48:03.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[22603]: cluster 2020-06-27T04:48:02.321920+0000 mon.a (mon.0) 973 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:03.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[22603]: cluster 2020-06-27T04:48:02.327674+0000 mon.a (mon.0) 974 : cluster [DBG] osd.2 reported immediately failed by osd.7 2020-06-27T04:48:03.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[22603]: cluster 2020-06-27T04:48:02.327718+0000 mon.a (mon.0) 975 : cluster [INF] osd.2 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:48:03.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:02 smithi031 bash[22603]: cluster 2020-06-27T04:48:02.436506+0000 mon.a (mon.0) 976 : cluster [WRN] Health check update: 6 osds down (OSD_DOWN) 2020-06-27T04:48:03.226 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:03 smithi031 podman[45451]: 2020-06-27 04:48:03.007428296 +0000 UTC m=+7.991726449 container died fd55e23de6f2d0cade051ca4312397a21914e26b7d0bdd43b6e752893aeb9412 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:48:03.899 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:03 smithi031 podman[45048]: 2020-06-27 04:48:03.513250275 +0000 UTC m=+10.404216288 container remove 87c2eaa1c2c48fd70e8248ea3ad144badb3967b24883a72e149dd498659fbf74 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:48:04.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:03 smithi051 bash[18409]: audit 2020-06-27T04:48:02.887683+0000 mon.a (mon.0) 977 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi031-41256-1","app":"app1","key":"key1"}]': finished 2020-06-27T04:48:04.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:03 smithi051 bash[18409]: cluster 2020-06-27T04:48:02.887765+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e106: 8 total, 2 up, 8 in 2020-06-27T04:48:04.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:03 smithi051 bash[18409]: cluster 2020-06-27T04:48:03.210571+0000 mgr.x (mgr.34109) 247 : cluster [DBG] pgmap v267: 801 pgs: 8 stale+creating+peering, 17 creating+peering, 49 active+undersized+degraded, 1 creating+down, 27 down, 17 stale+down, 16 stale+undersized+degraded+peered, 32 stale+active+clean, 7 unknown, 169 active+undersized, 14 stale+peering, 22 stale+active+undersized+degraded, 37 undersized+degraded+peered, 45 active+clean, 71 stale+undersized+peered, 146 undersized+peered, 123 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 3.5 KiB/s wr, 0 op/s; 434/1044 objects degraded (41.571%) 2020-06-27T04:48:04.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:03 smithi051 bash[18409]: audit 2020-06-27T04:48:03.445590+0000 mon.a (mon.0) 979 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41166-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41166-10"}]': finished 2020-06-27T04:48:04.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:03 smithi051 bash[18409]: cluster 2020-06-27T04:48:03.445687+0000 mon.a (mon.0) 980 : cluster [DBG] osdmap e107: 8 total, 2 up, 8 in 2020-06-27T04:48:04.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:03 smithi031 bash[18426]: audit 2020-06-27T04:48:02.887683+0000 mon.a (mon.0) 977 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi031-41256-1","app":"app1","key":"key1"}]': finished 2020-06-27T04:48:04.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:03 smithi031 bash[18426]: cluster 2020-06-27T04:48:02.887765+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e106: 8 total, 2 up, 8 in 2020-06-27T04:48:04.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:03 smithi031 bash[18426]: cluster 2020-06-27T04:48:03.210571+0000 mgr.x (mgr.34109) 247 : cluster [DBG] pgmap v267: 801 pgs: 8 stale+creating+peering, 17 creating+peering, 49 active+undersized+degraded, 1 creating+down, 27 down, 17 stale+down, 16 stale+undersized+degraded+peered, 32 stale+active+clean, 7 unknown, 169 active+undersized, 14 stale+peering, 22 stale+active+undersized+degraded, 37 undersized+degraded+peered, 45 active+clean, 71 stale+undersized+peered, 146 undersized+peered, 123 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 3.5 KiB/s wr, 0 op/s; 434/1044 objects degraded (41.571%) 2020-06-27T04:48:04.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:03 smithi031 bash[18426]: audit 2020-06-27T04:48:03.445590+0000 mon.a (mon.0) 979 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41166-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41166-10"}]': finished 2020-06-27T04:48:04.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:03 smithi031 bash[18426]: cluster 2020-06-27T04:48:03.445687+0000 mon.a (mon.0) 980 : cluster [DBG] osdmap e107: 8 total, 2 up, 8 in 2020-06-27T04:48:04.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:03 smithi031 bash[22603]: audit 2020-06-27T04:48:02.887683+0000 mon.a (mon.0) 977 : audit [INF] from='client.? 172.21.15.31:0/2044165808' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi031-41256-1","app":"app1","key":"key1"}]': finished 2020-06-27T04:48:04.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:03 smithi031 bash[22603]: cluster 2020-06-27T04:48:02.887765+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e106: 8 total, 2 up, 8 in 2020-06-27T04:48:04.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:03 smithi031 bash[22603]: cluster 2020-06-27T04:48:03.210571+0000 mgr.x (mgr.34109) 247 : cluster [DBG] pgmap v267: 801 pgs: 8 stale+creating+peering, 17 creating+peering, 49 active+undersized+degraded, 1 creating+down, 27 down, 17 stale+down, 16 stale+undersized+degraded+peered, 32 stale+active+clean, 7 unknown, 169 active+undersized, 14 stale+peering, 22 stale+active+undersized+degraded, 37 undersized+degraded+peered, 45 active+clean, 71 stale+undersized+peered, 146 undersized+peered, 123 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 3.5 KiB/s wr, 0 op/s; 434/1044 objects degraded (41.571%) 2020-06-27T04:48:04.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:03 smithi031 bash[22603]: audit 2020-06-27T04:48:03.445590+0000 mon.a (mon.0) 979 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi031-41166-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi031-41166-10"}]': finished 2020-06-27T04:48:04.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:03 smithi031 bash[22603]: cluster 2020-06-27T04:48:03.445687+0000 mon.a (mon.0) 980 : cluster [DBG] osdmap e107: 8 total, 2 up, 8 in 2020-06-27T04:48:04.226 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:04 smithi031 podman[45183]: 2020-06-27 04:48:04.03252536 +0000 UTC m=+9.632621244 container remove c19f5a50f90454f1364b80895ba41ede5f3a94782e0e75eb95375a79f9fdb73e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:48:04.227 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:04 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:04.227 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:04 smithi031 podman[45451]: 2020-06-27 04:48:04.125600841 +0000 UTC m=+9.109899014 container remove fd55e23de6f2d0cade051ca4312397a21914e26b7d0bdd43b6e752893aeb9412 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:48:04.227 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:04 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:04.227 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:04 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:04.642 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:04 smithi031 podman[49741]: 2020-06-27 04:48:04.379954962 +0000 UTC m=+0.315179602 container create 9202a48b157e5b37c1dac909aa67062c35e797e7d64877531a1ffa9deb604cea (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:48:04.643 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:04 smithi031 podman[49870]: 2020-06-27 04:48:04.638230841 +0000 UTC m=+0.482337355 container create 5c70915a8d8c6e809441fa57f33c4418084777838f1c77fc2558ec7b5ec33a61 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:48:04.760 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:04 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:04.761 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:04 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Scheduled restart job, restart counter is at 3. 2020-06-27T04:48:04.761 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:04 smithi051 systemd[1]: Stopped Ceph osd.5 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:04.761 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:04 smithi051 systemd[1]: Starting Ceph osd.5 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:48:04.761 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:04 smithi051 podman[37135]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5 found: no such container 2020-06-27T04:48:04.762 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:04 smithi051 systemd[1]: Started Ceph osd.5 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:04.897 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:04 smithi031 podman[49741]: 2020-06-27 04:48:04.737849268 +0000 UTC m=+0.673073909 container init 9202a48b157e5b37c1dac909aa67062c35e797e7d64877531a1ffa9deb604cea (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:48:04.898 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:04 smithi031 podman[49741]: 2020-06-27 04:48:04.82947591 +0000 UTC m=+0.764700558 container start 9202a48b157e5b37c1dac909aa67062c35e797e7d64877531a1ffa9deb604cea (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:48:04.898 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:04 smithi031 podman[49741]: 2020-06-27 04:48:04.829577073 +0000 UTC m=+0.764801738 container attach 9202a48b157e5b37c1dac909aa67062c35e797e7d64877531a1ffa9deb604cea (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:48:05.142 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:04 smithi051 bash[18409]: cluster 2020-06-27T04:48:03.893029+0000 mon.a (mon.0) 981 : cluster [WRN] Health check update: Reduced data availability: 3 pgs inactive, 45 pgs down (PG_AVAILABILITY) 2020-06-27T04:48:05.143 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:04 smithi051 bash[18409]: cluster 2020-06-27T04:48:03.893067+0000 mon.a (mon.0) 982 : cluster [WRN] Health check update: Degraded data redundancy: 434/1044 objects degraded (41.571%), 124 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:05.143 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:04 smithi051 bash[18409]: cluster 2020-06-27T04:48:04.375501+0000 mon.a (mon.0) 983 : cluster [WRN] pool 'test-rados-api-smithi031-41123-3' is full (reached quota's max_bytes: 4 KiB) 2020-06-27T04:48:05.143 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:04 smithi051 bash[18409]: cluster 2020-06-27T04:48:04.375971+0000 mon.a (mon.0) 984 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2020-06-27T04:48:05.143 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:04 smithi051 bash[18409]: cluster 2020-06-27T04:48:04.388304+0000 mon.a (mon.0) 985 : cluster [DBG] osdmap e108: 8 total, 2 up, 8 in 2020-06-27T04:48:05.144 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:04 smithi051 podman[37151]: 2020-06-27 04:48:04.758296825 +0000 UTC m=+0.232705537 container create ac89a2d820402fac73f7052d9ed6902f98041a46e4f8a814e879fb003181b57a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:48:05.144 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:04 smithi051 podman[37151]: 2020-06-27 04:48:04.874839937 +0000 UTC m=+0.349248552 container init ac89a2d820402fac73f7052d9ed6902f98041a46e4f8a814e879fb003181b57a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:48:05.144 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:04 smithi051 podman[37151]: 2020-06-27 04:48:04.916543049 +0000 UTC m=+0.390951667 container start ac89a2d820402fac73f7052d9ed6902f98041a46e4f8a814e879fb003181b57a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:48:05.144 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:04 smithi051 podman[37151]: 2020-06-27 04:48:04.916616578 +0000 UTC m=+0.391025198 container attach ac89a2d820402fac73f7052d9ed6902f98041a46e4f8a814e879fb003181b57a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:48:05.157 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:04 smithi031 bash[18426]: cluster 2020-06-27T04:48:03.893029+0000 mon.a (mon.0) 981 : cluster [WRN] Health check update: Reduced data availability: 3 pgs inactive, 45 pgs down (PG_AVAILABILITY) 2020-06-27T04:48:05.157 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:04 smithi031 bash[18426]: cluster 2020-06-27T04:48:03.893067+0000 mon.a (mon.0) 982 : cluster [WRN] Health check update: Degraded data redundancy: 434/1044 objects degraded (41.571%), 124 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:05.157 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:04 smithi031 bash[18426]: cluster 2020-06-27T04:48:04.375501+0000 mon.a (mon.0) 983 : cluster [WRN] pool 'test-rados-api-smithi031-41123-3' is full (reached quota's max_bytes: 4 KiB) 2020-06-27T04:48:05.157 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:04 smithi031 bash[18426]: cluster 2020-06-27T04:48:04.375971+0000 mon.a (mon.0) 984 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2020-06-27T04:48:05.158 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:04 smithi031 bash[18426]: cluster 2020-06-27T04:48:04.388304+0000 mon.a (mon.0) 985 : cluster [DBG] osdmap e108: 8 total, 2 up, 8 in 2020-06-27T04:48:05.158 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:04 smithi031 podman[49872]: 2020-06-27 04:48:04.929552747 +0000 UTC m=+0.764726368 container create 5e3d4363330f3b138d4a723b318e655fd2eab507c2167c72fab934a5ee5659e2 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:48:05.158 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:05 smithi031 podman[49872]: 2020-06-27 04:48:05.15445046 +0000 UTC m=+0.989624089 container init 5e3d4363330f3b138d4a723b318e655fd2eab507c2167c72fab934a5ee5659e2 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:48:05.159 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:04 smithi031 bash[22603]: cluster 2020-06-27T04:48:03.893029+0000 mon.a (mon.0) 981 : cluster [WRN] Health check update: Reduced data availability: 3 pgs inactive, 45 pgs down (PG_AVAILABILITY) 2020-06-27T04:48:05.159 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:04 smithi031 bash[22603]: cluster 2020-06-27T04:48:03.893067+0000 mon.a (mon.0) 982 : cluster [WRN] Health check update: Degraded data redundancy: 434/1044 objects degraded (41.571%), 124 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:05.159 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:04 smithi031 bash[22603]: cluster 2020-06-27T04:48:04.375501+0000 mon.a (mon.0) 983 : cluster [WRN] pool 'test-rados-api-smithi031-41123-3' is full (reached quota's max_bytes: 4 KiB) 2020-06-27T04:48:05.159 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:04 smithi031 bash[22603]: cluster 2020-06-27T04:48:04.375971+0000 mon.a (mon.0) 984 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2020-06-27T04:48:05.159 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:04 smithi031 bash[22603]: cluster 2020-06-27T04:48:04.388304+0000 mon.a (mon.0) 985 : cluster [DBG] osdmap e108: 8 total, 2 up, 8 in 2020-06-27T04:48:05.160 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:05 smithi031 podman[49870]: 2020-06-27 04:48:05.046109372 +0000 UTC m=+0.890215889 container init 5c70915a8d8c6e809441fa57f33c4418084777838f1c77fc2558ec7b5ec33a61 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:48:05.467 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:05 smithi051 bash[37149]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-06-27T04:48:05.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:05 smithi051 bash[37149]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2020-06-27T04:48:05.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:05 smithi051 bash[37149]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2020-06-27T04:48:05.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:05 smithi051 bash[37149]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2020-06-27T04:48:05.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:05 smithi051 bash[37149]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2020-06-27T04:48:05.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:05 smithi051 bash[37149]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-06-27T04:48:05.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:05 smithi051 bash[37149]: --> ceph-volume lvm activate successful for osd ID: 5 2020-06-27T04:48:05.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:05 smithi051 podman[37151]: 2020-06-27 04:48:05.218632741 +0000 UTC m=+0.693041374 container died ac89a2d820402fac73f7052d9ed6902f98041a46e4f8a814e879fb003181b57a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:48:05.474 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:05 smithi031 podman[49872]: 2020-06-27 04:48:05.28776719 +0000 UTC m=+1.122940799 container start 5e3d4363330f3b138d4a723b318e655fd2eab507c2167c72fab934a5ee5659e2 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:48:05.474 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:05 smithi031 podman[49872]: 2020-06-27 04:48:05.288023196 +0000 UTC m=+1.123196816 container attach 5e3d4363330f3b138d4a723b318e655fd2eab507c2167c72fab934a5ee5659e2 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:48:05.474 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:05 smithi031 podman[49870]: 2020-06-27 04:48:05.231625333 +0000 UTC m=+1.075731843 container start 5c70915a8d8c6e809441fa57f33c4418084777838f1c77fc2558ec7b5ec33a61 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:48:05.475 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:05 smithi031 podman[49870]: 2020-06-27 04:48:05.231720248 +0000 UTC m=+1.075826764 container attach 5c70915a8d8c6e809441fa57f33c4418084777838f1c77fc2558ec7b5ec33a61 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:48:05.475 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:05 smithi031 podman[49741]: 2020-06-27 04:48:05.31049546 +0000 UTC m=+1.245720124 container died 9202a48b157e5b37c1dac909aa67062c35e797e7d64877531a1ffa9deb604cea (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:48:05.933 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:05 smithi031 bash[18426]: cluster 2020-06-27T04:48:05.211928+0000 mgr.x (mgr.34109) 248 : cluster [DBG] pgmap v270: 777 pgs: 1 stale+creating+down, 8 stale+creating+peering, 17 creating+peering, 34 active+undersized+degraded, 7 down, 36 stale+down, 18 stale+undersized+degraded+peered, 43 stale+active+clean, 15 unknown, 120 active+undersized, 12 stale+peering, 36 stale+active+undersized+degraded, 35 undersized+degraded+peered, 32 active+clean, 90 stale+undersized+peered, 115 undersized+peered, 158 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 433/1041 objects degraded (41.595%) 2020-06-27T04:48:05.933 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:05 smithi031 podman[49870]: 2020-06-27 04:48:05.81440319 +0000 UTC m=+1.658509709 container died 5c70915a8d8c6e809441fa57f33c4418084777838f1c77fc2558ec7b5ec33a61 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:48:06.068 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:05 smithi051 bash[18409]: cluster 2020-06-27T04:48:05.211928+0000 mgr.x (mgr.34109) 248 : cluster [DBG] pgmap v270: 777 pgs: 1 stale+creating+down, 8 stale+creating+peering, 17 creating+peering, 34 active+undersized+degraded, 7 down, 36 stale+down, 18 stale+undersized+degraded+peered, 43 stale+active+clean, 15 unknown, 120 active+undersized, 12 stale+peering, 36 stale+active+undersized+degraded, 35 undersized+degraded+peered, 32 active+clean, 90 stale+undersized+peered, 115 undersized+peered, 158 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 433/1041 objects degraded (41.595%) 2020-06-27T04:48:06.069 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:05 smithi051 podman[37151]: 2020-06-27 04:48:05.759854876 +0000 UTC m=+1.234263501 container remove ac89a2d820402fac73f7052d9ed6902f98041a46e4f8a814e879fb003181b57a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:48:06.069 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:05 smithi051 bash[37149]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5 found: no such container 2020-06-27T04:48:06.069 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:05 smithi051 bash[37149]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5 2020-06-27T04:48:06.069 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:05 smithi051 bash[37149]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5" found: no such container 2020-06-27T04:48:06.214 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:05 smithi031 bash[22603]: cluster 2020-06-27T04:48:05.211928+0000 mgr.x (mgr.34109) 248 : cluster [DBG] pgmap v270: 777 pgs: 1 stale+creating+down, 8 stale+creating+peering, 17 creating+peering, 34 active+undersized+degraded, 7 down, 36 stale+down, 18 stale+undersized+degraded+peered, 43 stale+active+clean, 15 unknown, 120 active+undersized, 12 stale+peering, 36 stale+active+undersized+degraded, 35 undersized+degraded+peered, 32 active+clean, 90 stale+undersized+peered, 115 undersized+peered, 158 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 433/1041 objects degraded (41.595%) 2020-06-27T04:48:06.215 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:05 smithi031 podman[49872]: 2020-06-27 04:48:05.977696676 +0000 UTC m=+1.812870305 container died 5e3d4363330f3b138d4a723b318e655fd2eab507c2167c72fab934a5ee5659e2 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:48:06.215 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:05 smithi031 podman[49741]: 2020-06-27 04:48:05.977565232 +0000 UTC m=+1.912789913 container remove 9202a48b157e5b37c1dac909aa67062c35e797e7d64877531a1ffa9deb604cea (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:48:06.215 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:06 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2020-06-27T04:48:06.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 podman[37263]: 2020-06-27 04:48:06.066315996 +0000 UTC m=+0.208041509 container create 24544aba1c2267080ee6f70546316b9b8e9e958be63f07a527f3aecfed1e7acc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:48:06.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 podman[37263]: 2020-06-27 04:48:06.174642967 +0000 UTC m=+0.316368502 container init 24544aba1c2267080ee6f70546316b9b8e9e958be63f07a527f3aecfed1e7acc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:48:06.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 podman[37263]: 2020-06-27 04:48:06.246641751 +0000 UTC m=+0.388367387 container start 24544aba1c2267080ee6f70546316b9b8e9e958be63f07a527f3aecfed1e7acc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:48:06.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 podman[37263]: 2020-06-27 04:48:06.246801149 +0000 UTC m=+0.388526818 container attach 24544aba1c2267080ee6f70546316b9b8e9e958be63f07a527f3aecfed1e7acc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:48:06.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f4123c3e700 20 EpollDriver.del_event del event fd=14 cur_mask=1 delmask=3 to 8 2020-06-27T04:48:06.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 10 -- 172.21.15.51:0/3796062981 shutdown 172.21.15.51:0/3796062981 2020-06-27T04:48:06.470 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 10 Processor -- stop 2020-06-27T04:48:06.470 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 20 Event(0x55e18520ee00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:06.470 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 1 -- 172.21.15.51:0/3796062981 shutdown_connections 2020-06-27T04:48:06.470 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 5 -- 172.21.15.51:0/3796062981 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55e18527ac00 2020-06-27T04:48:06.470 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 1 --2- 172.21.15.51:0/3796062981 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55e18527ac00 0x55e1851eb400 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:06.471 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 5 -- 172.21.15.51:0/3796062981 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55e18527b400 2020-06-27T04:48:06.471 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 1 --2- 172.21.15.51:0/3796062981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e18527b400 0x55e1851ec300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:06.471 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 5 -- 172.21.15.51:0/3796062981 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55e18527b000 2020-06-27T04:48:06.471 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 1 --2- 172.21.15.51:0/3796062981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e18527b000 0x55e1851ebe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:06.471 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 5 -- 172.21.15.51:0/3796062981 shutdown_connections delete 0x55e18527ac00 2020-06-27T04:48:06.471 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 5 -- 172.21.15.51:0/3796062981 shutdown_connections delete 0x55e18527b000 2020-06-27T04:48:06.472 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 5 -- 172.21.15.51:0/3796062981 shutdown_connections delete 0x55e18527b400 2020-06-27T04:48:06.472 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 1 -- 172.21.15.51:0/3796062981 >> 172.21.15.51:0/3796062981 conn(0x55e18527a800 msgr2=0x55e1852e3000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:48:06.472 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 20 --1- 172.21.15.51:0/3796062981 >> 172.21.15.51:0/3796062981 conn(0x55e18527a800 0x55e1852e3000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:06.472 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 2 --1- 172.21.15.51:0/3796062981 >> 172.21.15.51:0/3796062981 conn(0x55e18527a800 0x55e1852e3000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:06.472 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 5 --1- 172.21.15.51:0/3796062981 >> 172.21.15.51:0/3796062981 conn(0x55e18527a800 0x55e1852e3000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:48:06.473 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 20 Event(0x55e18520ee00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:06.473 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 10 --1- 172.21.15.51:0/3796062981 >> 172.21.15.51:0/3796062981 conn(0x55e18527a800 0x55e1852e3000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:48:06.473 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 20 Event(0x55e18520ee00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:06.473 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 20 Event(0x55e18520f040 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:06.473 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 20 Event(0x55e18520f280 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:06.474 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412443f700 5 --1- 172.21.15.51:0/3796062981 >> 172.21.15.51:0/3796062981 conn(0x55e18527a800 0x55e1852e3000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:48:06.474 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412443f700 5 --1- 172.21.15.51:0/3796062981 >> 172.21.15.51:0/3796062981 conn(0x55e18527a800 0x55e1852e3000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:48:06.474 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 10 -- 172.21.15.51:0/3796062981 wait: waiting for dispatch queue 2020-06-27T04:48:06.474 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 10 -- 172.21.15.51:0/3796062981 wait: dispatch queue is stopped 2020-06-27T04:48:06.474 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 1 -- 172.21.15.51:0/3796062981 shutdown_connections 2020-06-27T04:48:06.474 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 5 -- 172.21.15.51:0/3796062981 shutdown_connections delete 0x55e18527a800 2020-06-27T04:48:06.475 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 20 Event(0x55e18520ee00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:06.475 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 20 Event(0x55e18520f040 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:06.475 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 20 Event(0x55e18520f280 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:06.475 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 10 -- 172.21.15.51:0/3796062981 wait: done. 2020-06-27T04:48:06.475 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.196+0000 7f412a6bcf40 1 -- 172.21.15.51:0/3796062981 wait complete. 2020-06-27T04:48:06.973 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:06 smithi031 podman[49872]: 2020-06-27 04:48:06.657147783 +0000 UTC m=+2.492321420 container remove 5e3d4363330f3b138d4a723b318e655fd2eab507c2167c72fab934a5ee5659e2 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:48:06.974 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:06 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Failed with result 'exit-code'. 2020-06-27T04:48:06.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:06 smithi031 podman[49870]: 2020-06-27 04:48:06.530488139 +0000 UTC m=+2.374594669 container remove 5c70915a8d8c6e809441fa57f33c4418084777838f1c77fc2558ec7b5ec33a61 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:48:06.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:06 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Failed with result 'exit-code'. 2020-06-27T04:48:07.217 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:06 smithi051 bash[37149]: debug 2020-06-27T04:48:06.718+0000 7f412a6bcf40 -1 Falling back to public interface 2020-06-27T04:48:07.717 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:07 smithi051 bash[37149]: debug 2020-06-27T04:48:07.432+0000 7f412a6bcf40 -1 osd.5 96 log_to_monitors {default=true} 2020-06-27T04:48:08.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:08 smithi051 bash[18409]: cluster 2020-06-27T04:48:07.213506+0000 mgr.x (mgr.34109) 249 : cluster [DBG] pgmap v271: 777 pgs: 1 creating+incomplete, 1 creating+down, 16 peering, 8 stale+creating+peering, 11 creating+peering, 22 active+undersized+degraded, 14 down, 33 stale+down, 18 stale+undersized+degraded+peered, 25 stale+active+clean, 14 unknown, 76 active+undersized, 12 stale+peering, 24 stale+active+undersized+degraded, 62 undersized+degraded+peered, 19 active+clean, 90 stale+undersized+peered, 222 undersized+peered, 109 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:08.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:08 smithi051 bash[18409]: audit 2020-06-27T04:48:07.437549+0000 mon.b (mon.2) 291 : audit [INF] from='osd.5 v2:172.21.15.51:6801/1067435667' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:48:08.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:08 smithi051 bash[18409]: audit 2020-06-27T04:48:07.438106+0000 mon.a (mon.0) 986 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:48:08.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:08 smithi051 bash[18409]: audit 2020-06-27T04:48:07.438778+0000 mon.b (mon.2) 292 : audit [INF] from='osd.5 v2:172.21.15.51:6801/1067435667' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:08.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:08 smithi051 bash[18409]: audit 2020-06-27T04:48:07.439205+0000 mon.a (mon.0) 987 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:08.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:08 smithi031 bash[18426]: cluster 2020-06-27T04:48:07.213506+0000 mgr.x (mgr.34109) 249 : cluster [DBG] pgmap v271: 777 pgs: 1 creating+incomplete, 1 creating+down, 16 peering, 8 stale+creating+peering, 11 creating+peering, 22 active+undersized+degraded, 14 down, 33 stale+down, 18 stale+undersized+degraded+peered, 25 stale+active+clean, 14 unknown, 76 active+undersized, 12 stale+peering, 24 stale+active+undersized+degraded, 62 undersized+degraded+peered, 19 active+clean, 90 stale+undersized+peered, 222 undersized+peered, 109 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:08.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:08 smithi031 bash[18426]: audit 2020-06-27T04:48:07.437549+0000 mon.b (mon.2) 291 : audit [INF] from='osd.5 v2:172.21.15.51:6801/1067435667' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:48:08.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:08 smithi031 bash[18426]: audit 2020-06-27T04:48:07.438106+0000 mon.a (mon.0) 986 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:48:08.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:08 smithi031 bash[18426]: audit 2020-06-27T04:48:07.438778+0000 mon.b (mon.2) 292 : audit [INF] from='osd.5 v2:172.21.15.51:6801/1067435667' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:08.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:08 smithi031 bash[18426]: audit 2020-06-27T04:48:07.439205+0000 mon.a (mon.0) 987 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:08.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:08 smithi031 bash[22603]: cluster 2020-06-27T04:48:07.213506+0000 mgr.x (mgr.34109) 249 : cluster [DBG] pgmap v271: 777 pgs: 1 creating+incomplete, 1 creating+down, 16 peering, 8 stale+creating+peering, 11 creating+peering, 22 active+undersized+degraded, 14 down, 33 stale+down, 18 stale+undersized+degraded+peered, 25 stale+active+clean, 14 unknown, 76 active+undersized, 12 stale+peering, 24 stale+active+undersized+degraded, 62 undersized+degraded+peered, 19 active+clean, 90 stale+undersized+peered, 222 undersized+peered, 109 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:08.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:08 smithi031 bash[22603]: audit 2020-06-27T04:48:07.437549+0000 mon.b (mon.2) 291 : audit [INF] from='osd.5 v2:172.21.15.51:6801/1067435667' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:48:08.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:08 smithi031 bash[22603]: audit 2020-06-27T04:48:07.438106+0000 mon.a (mon.0) 986 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:48:08.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:08 smithi031 bash[22603]: audit 2020-06-27T04:48:07.438778+0000 mon.b (mon.2) 292 : audit [INF] from='osd.5 v2:172.21.15.51:6801/1067435667' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:08.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:08 smithi031 bash[22603]: audit 2020-06-27T04:48:07.439205+0000 mon.a (mon.0) 987 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:09 smithi051 bash[18409]: cluster 2020-06-27T04:48:08.270157+0000 mon.a (mon.0) 988 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:48:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:09 smithi051 bash[18409]: audit 2020-06-27T04:48:08.275620+0000 mon.b (mon.2) 293 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:48:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:09 smithi051 bash[18409]: cluster 2020-06-27T04:48:08.276622+0000 mon.a (mon.0) 989 : cluster [INF] osd.5 v2:172.21.15.51:6801/1067435667 boot 2020-06-27T04:48:09.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:09 smithi051 bash[18409]: cluster 2020-06-27T04:48:08.276670+0000 mon.a (mon.0) 990 : cluster [DBG] osdmap e109: 8 total, 3 up, 8 in 2020-06-27T04:48:09.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:09 smithi051 bash[18409]: cluster 2020-06-27T04:48:08.298156+0000 mon.a (mon.0) 991 : cluster [DBG] osd.1 reported immediately failed by osd.5 2020-06-27T04:48:09.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:09 smithi051 bash[18409]: cluster 2020-06-27T04:48:08.298243+0000 mon.a (mon.0) 992 : cluster [INF] osd.1 failed (root=default,host=smithi031) (connection refused reported by osd.5) 2020-06-27T04:48:09.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:09 smithi031 bash[22603]: cluster 2020-06-27T04:48:08.270157+0000 mon.a (mon.0) 988 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:48:09.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:09 smithi031 bash[22603]: audit 2020-06-27T04:48:08.275620+0000 mon.b (mon.2) 293 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:48:09.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:09 smithi031 bash[22603]: cluster 2020-06-27T04:48:08.276622+0000 mon.a (mon.0) 989 : cluster [INF] osd.5 v2:172.21.15.51:6801/1067435667 boot 2020-06-27T04:48:09.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:09 smithi031 bash[22603]: cluster 2020-06-27T04:48:08.276670+0000 mon.a (mon.0) 990 : cluster [DBG] osdmap e109: 8 total, 3 up, 8 in 2020-06-27T04:48:09.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:09 smithi031 bash[22603]: cluster 2020-06-27T04:48:08.298156+0000 mon.a (mon.0) 991 : cluster [DBG] osd.1 reported immediately failed by osd.5 2020-06-27T04:48:09.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:09 smithi031 bash[22603]: cluster 2020-06-27T04:48:08.298243+0000 mon.a (mon.0) 992 : cluster [INF] osd.1 failed (root=default,host=smithi031) (connection refused reported by osd.5) 2020-06-27T04:48:09.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:09 smithi031 bash[18426]: cluster 2020-06-27T04:48:08.270157+0000 mon.a (mon.0) 988 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:48:09.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:09 smithi031 bash[18426]: audit 2020-06-27T04:48:08.275620+0000 mon.b (mon.2) 293 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:48:09.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:09 smithi031 bash[18426]: cluster 2020-06-27T04:48:08.276622+0000 mon.a (mon.0) 989 : cluster [INF] osd.5 v2:172.21.15.51:6801/1067435667 boot 2020-06-27T04:48:09.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:09 smithi031 bash[18426]: cluster 2020-06-27T04:48:08.276670+0000 mon.a (mon.0) 990 : cluster [DBG] osdmap e109: 8 total, 3 up, 8 in 2020-06-27T04:48:09.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:09 smithi031 bash[18426]: cluster 2020-06-27T04:48:08.298156+0000 mon.a (mon.0) 991 : cluster [DBG] osd.1 reported immediately failed by osd.5 2020-06-27T04:48:09.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:09 smithi031 bash[18426]: cluster 2020-06-27T04:48:08.298243+0000 mon.a (mon.0) 992 : cluster [INF] osd.1 failed (root=default,host=smithi031) (connection refused reported by osd.5) 2020-06-27T04:48:10.559 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[18409]: cluster 2020-06-27T04:48:09.214403+0000 mgr.x (mgr.34109) 250 : cluster [DBG] pgmap v273: 777 pgs: 1 creating+incomplete, 2 creating+down, 16 peering, 8 stale+creating+peering, 11 creating+peering, 22 active+undersized+degraded, 26 down, 32 stale+down, 18 stale+undersized+degraded+peered, 25 stale+active+clean, 13 unknown, 76 active+undersized, 1 stale+peering, 24 stale+active+undersized+degraded, 62 undersized+degraded+peered, 19 active+clean, 89 stale+undersized+peered, 223 undersized+peered, 109 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:10.559 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[18409]: cluster 2020-06-27T04:48:09.281843+0000 mon.a (mon.0) 993 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:48:10.559 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[18409]: cluster 2020-06-27T04:48:09.291002+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e110: 8 total, 2 up, 8 in 2020-06-27T04:48:10.560 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[18409]: cluster 2020-06-27T04:48:09.371368+0000 mon.a (mon.0) 995 : cluster [WRN] Health check update: Reduced data availability: 8 pgs inactive, 60 pgs down, 1 pg peering, 1 pg incomplete (PG_AVAILABILITY) 2020-06-27T04:48:10.560 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[18409]: cluster 2020-06-27T04:48:09.378071+0000 mon.a (mon.0) 996 : cluster [WRN] Health check update: Degraded data redundancy: 487/1041 objects degraded (46.782%), 126 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:10.560 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:10 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:10.560 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:10 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Scheduled restart job, restart counter is at 2. 2020-06-27T04:48:10.561 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:10 smithi051 systemd[1]: Stopped Ceph osd.4 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:10.561 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:10 smithi051 systemd[1]: Starting Ceph osd.4 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:48:10.561 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:10 smithi051 podman[37643]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4 found: no such container 2020-06-27T04:48:10.561 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:10 smithi051 systemd[1]: Started Ceph osd.4 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:10.561 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:10 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:10.562 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:10 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Scheduled restart job, restart counter is at 2. 2020-06-27T04:48:10.562 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:10 smithi051 systemd[1]: Stopped Ceph osd.6 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:10.562 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:10 smithi051 systemd[1]: Starting Ceph osd.6 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:48:10.562 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:10.562 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: in thread 7f4106e31700 thread_name:tp_osd_tp 2020-06-27T04:48:10.563 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:10.563 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 1: (()+0x12dd0) [0x7f412842fdd0] 2020-06-27T04:48:10.563 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55e17aa03707] 2020-06-27T04:48:10.563 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55e17aa03aa0] 2020-06-27T04:48:10.563 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55e17aa3567a] 2020-06-27T04:48:10.564 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55e17aa36a57] 2020-06-27T04:48:10.564 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55e17a6c1938] 2020-06-27T04:48:10.564 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55e17a87203d] 2020-06-27T04:48:10.564 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55e17a62f5b0] 2020-06-27T04:48:10.564 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55e17a68889d] 2020-06-27T04:48:10.565 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55e17a691380] 2020-06-27T04:48:10.565 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55e17a698590] 2020-06-27T04:48:10.565 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55e17a5184e9] 2020-06-27T04:48:10.565 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55e17a77cf78] 2020-06-27T04:48:10.565 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55e17a53770f] 2020-06-27T04:48:10.565 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55e17ab75b94] 2020-06-27T04:48:10.566 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55e17ab787f4] 2020-06-27T04:48:10.566 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 17: (()+0x82de) [0x7f41284252de] 2020-06-27T04:48:10.566 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 18: (clone()+0x43) [0x7f412715ce83] 2020-06-27T04:48:10.566 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: debug 2020-06-27T04:48:10.326+0000 7f4106e31700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:10.566 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: in thread 7f4106e31700 thread_name:tp_osd_tp 2020-06-27T04:48:10.567 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:10.567 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 1: (()+0x12dd0) [0x7f412842fdd0] 2020-06-27T04:48:10.567 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55e17aa03707] 2020-06-27T04:48:10.567 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55e17aa03aa0] 2020-06-27T04:48:10.567 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55e17aa3567a] 2020-06-27T04:48:10.568 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55e17aa36a57] 2020-06-27T04:48:10.568 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55e17a6c1938] 2020-06-27T04:48:10.568 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55e17a87203d] 2020-06-27T04:48:10.568 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55e17a62f5b0] 2020-06-27T04:48:10.568 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55e17a68889d] 2020-06-27T04:48:10.568 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55e17a691380] 2020-06-27T04:48:10.569 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55e17a698590] 2020-06-27T04:48:10.569 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55e17a5184e9] 2020-06-27T04:48:10.569 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55e17a77cf78] 2020-06-27T04:48:10.569 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55e17a53770f] 2020-06-27T04:48:10.569 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55e17ab75b94] 2020-06-27T04:48:10.573 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55e17ab787f4] 2020-06-27T04:48:10.573 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 17: (()+0x82de) [0x7f41284252de] 2020-06-27T04:48:10.574 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 18: (clone()+0x43) [0x7f412715ce83] 2020-06-27T04:48:10.574 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:10.575 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: debug -9999> 2020-06-27T04:48:10.326+0000 7f4106e31700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:10.575 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: in thread 7f4106e31700 thread_name:tp_osd_tp 2020-06-27T04:48:10.575 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:10.575 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 1: (()+0x12dd0) [0x7f412842fdd0] 2020-06-27T04:48:10.575 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55e17aa03707] 2020-06-27T04:48:10.576 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55e17aa03aa0] 2020-06-27T04:48:10.576 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55e17aa3567a] 2020-06-27T04:48:10.576 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55e17aa36a57] 2020-06-27T04:48:10.576 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55e17a6c1938] 2020-06-27T04:48:10.576 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55e17a87203d] 2020-06-27T04:48:10.577 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55e17a62f5b0] 2020-06-27T04:48:10.577 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55e17a68889d] 2020-06-27T04:48:10.577 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55e17a691380] 2020-06-27T04:48:10.577 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55e17a698590] 2020-06-27T04:48:10.577 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55e17a5184e9] 2020-06-27T04:48:10.578 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55e17a77cf78] 2020-06-27T04:48:10.578 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55e17a53770f] 2020-06-27T04:48:10.578 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55e17ab75b94] 2020-06-27T04:48:10.578 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55e17ab787f4] 2020-06-27T04:48:10.578 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 17: (()+0x82de) [0x7f41284252de] 2020-06-27T04:48:10.579 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 18: (clone()+0x43) [0x7f412715ce83] 2020-06-27T04:48:10.579 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:10.579 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: debug -9999> 2020-06-27T04:48:10.326+0000 7f4106e31700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:10.579 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: in thread 7f4106e31700 thread_name:tp_osd_tp 2020-06-27T04:48:10.580 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:10.580 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 1: (()+0x12dd0) [0x7f412842fdd0] 2020-06-27T04:48:10.580 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55e17aa03707] 2020-06-27T04:48:10.580 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55e17aa03aa0] 2020-06-27T04:48:10.580 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55e17aa3567a] 2020-06-27T04:48:10.580 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55e17aa36a57] 2020-06-27T04:48:10.581 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55e17a6c1938] 2020-06-27T04:48:10.581 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55e17a87203d] 2020-06-27T04:48:10.581 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55e17a62f5b0] 2020-06-27T04:48:10.581 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55e17a68889d] 2020-06-27T04:48:10.581 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55e17a691380] 2020-06-27T04:48:10.582 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55e17a698590] 2020-06-27T04:48:10.582 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55e17a5184e9] 2020-06-27T04:48:10.582 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55e17a77cf78] 2020-06-27T04:48:10.582 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55e17a53770f] 2020-06-27T04:48:10.582 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55e17ab75b94] 2020-06-27T04:48:10.583 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55e17ab787f4] 2020-06-27T04:48:10.583 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 17: (()+0x82de) [0x7f41284252de] 2020-06-27T04:48:10.583 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: 18: (clone()+0x43) [0x7f412715ce83] 2020-06-27T04:48:10.583 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:10.583 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[37149]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:10.583 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:10 smithi051 podman[37263]: 2020-06-27 04:48:10.418345026 +0000 UTC m=+4.560070612 container died 24544aba1c2267080ee6f70546316b9b8e9e958be63f07a527f3aecfed1e7acc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:48:10.584 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:10.584 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: in thread 7f8e6712e700 thread_name:tp_osd_tp 2020-06-27T04:48:10.584 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:10.584 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 1: (()+0x12dd0) [0x7f8e9073cdd0] 2020-06-27T04:48:10.585 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x559244367707] 2020-06-27T04:48:10.585 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x559244367aa0] 2020-06-27T04:48:10.585 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55924439967a] 2020-06-27T04:48:10.585 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55924439aa57] 2020-06-27T04:48:10.586 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x559244025938] 2020-06-27T04:48:10.586 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5592441d9a70] 2020-06-27T04:48:10.586 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5592441e9dd7] 2020-06-27T04:48:10.586 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x559244058252] 2020-06-27T04:48:10.586 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x559243ffbe2e] 2020-06-27T04:48:10.587 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x559243e7c4e9] 2020-06-27T04:48:10.587 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5592440e0f78] 2020-06-27T04:48:10.587 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x559243e9b70f] 2020-06-27T04:48:10.587 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5592444d9b94] 2020-06-27T04:48:10.587 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5592444dc7f4] 2020-06-27T04:48:10.587 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 16: (()+0x82de) [0x7f8e907322de] 2020-06-27T04:48:10.588 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 17: (clone()+0x43) [0x7f8e8f469e83] 2020-06-27T04:48:10.588 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: debug 2020-06-27T04:48:10.329+0000 7f8e6712e700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:10.588 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: in thread 7f8e6712e700 thread_name:tp_osd_tp 2020-06-27T04:48:10.588 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:10.590 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 1: (()+0x12dd0) [0x7f8e9073cdd0] 2020-06-27T04:48:10.591 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x559244367707] 2020-06-27T04:48:10.591 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x559244367aa0] 2020-06-27T04:48:10.591 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55924439967a] 2020-06-27T04:48:10.591 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55924439aa57] 2020-06-27T04:48:10.592 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x559244025938] 2020-06-27T04:48:10.592 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5592441d9a70] 2020-06-27T04:48:10.592 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5592441e9dd7] 2020-06-27T04:48:10.592 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x559244058252] 2020-06-27T04:48:10.592 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x559243ffbe2e] 2020-06-27T04:48:10.592 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x559243e7c4e9] 2020-06-27T04:48:10.593 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5592440e0f78] 2020-06-27T04:48:10.593 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x559243e9b70f] 2020-06-27T04:48:10.593 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5592444d9b94] 2020-06-27T04:48:10.593 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5592444dc7f4] 2020-06-27T04:48:10.593 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 16: (()+0x82de) [0x7f8e907322de] 2020-06-27T04:48:10.594 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 17: (clone()+0x43) [0x7f8e8f469e83] 2020-06-27T04:48:10.594 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:10.594 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: debug -9999> 2020-06-27T04:48:10.329+0000 7f8e6712e700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:10.594 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: in thread 7f8e6712e700 thread_name:tp_osd_tp 2020-06-27T04:48:10.594 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:10.595 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 1: (()+0x12dd0) [0x7f8e9073cdd0] 2020-06-27T04:48:10.595 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x559244367707] 2020-06-27T04:48:10.595 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x559244367aa0] 2020-06-27T04:48:10.595 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55924439967a] 2020-06-27T04:48:10.596 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55924439aa57] 2020-06-27T04:48:10.596 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x559244025938] 2020-06-27T04:48:10.596 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5592441d9a70] 2020-06-27T04:48:10.596 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5592441e9dd7] 2020-06-27T04:48:10.596 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x559244058252] 2020-06-27T04:48:10.597 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x559243ffbe2e] 2020-06-27T04:48:10.597 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x559243e7c4e9] 2020-06-27T04:48:10.597 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5592440e0f78] 2020-06-27T04:48:10.597 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x559243e9b70f] 2020-06-27T04:48:10.597 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5592444d9b94] 2020-06-27T04:48:10.598 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5592444dc7f4] 2020-06-27T04:48:10.598 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 16: (()+0x82de) [0x7f8e907322de] 2020-06-27T04:48:10.598 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 17: (clone()+0x43) [0x7f8e8f469e83] 2020-06-27T04:48:10.598 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:10.598 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: debug -9999> 2020-06-27T04:48:10.329+0000 7f8e6712e700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:10.598 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: in thread 7f8e6712e700 thread_name:tp_osd_tp 2020-06-27T04:48:10.599 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:10.599 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 1: (()+0x12dd0) [0x7f8e9073cdd0] 2020-06-27T04:48:10.599 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x559244367707] 2020-06-27T04:48:10.599 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x559244367aa0] 2020-06-27T04:48:10.599 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55924439967a] 2020-06-27T04:48:10.600 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55924439aa57] 2020-06-27T04:48:10.600 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x559244025938] 2020-06-27T04:48:10.600 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5592441d9a70] 2020-06-27T04:48:10.600 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5592441e9dd7] 2020-06-27T04:48:10.600 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x559244058252] 2020-06-27T04:48:10.601 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x559243ffbe2e] 2020-06-27T04:48:10.601 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x559243e7c4e9] 2020-06-27T04:48:10.601 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5592440e0f78] 2020-06-27T04:48:10.601 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x559243e9b70f] 2020-06-27T04:48:10.601 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5592444d9b94] 2020-06-27T04:48:10.602 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5592444dc7f4] 2020-06-27T04:48:10.602 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 16: (()+0x82de) [0x7f8e907322de] 2020-06-27T04:48:10.602 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: 17: (clone()+0x43) [0x7f8e8f469e83] 2020-06-27T04:48:10.602 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:10.602 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 bash[34869]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:10.603 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:10 smithi051 podman[35150]: 2020-06-27 04:48:10.555774223 +0000 UTC m=+21.711956497 container died c9b1db8315dbc48329f44d17f7a59baf754467fc35577bcfdb05d1d31966f2cb (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:48:10.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:10 smithi031 bash[18426]: cluster 2020-06-27T04:48:09.214403+0000 mgr.x (mgr.34109) 250 : cluster [DBG] pgmap v273: 777 pgs: 1 creating+incomplete, 2 creating+down, 16 peering, 8 stale+creating+peering, 11 creating+peering, 22 active+undersized+degraded, 26 down, 32 stale+down, 18 stale+undersized+degraded+peered, 25 stale+active+clean, 13 unknown, 76 active+undersized, 1 stale+peering, 24 stale+active+undersized+degraded, 62 undersized+degraded+peered, 19 active+clean, 89 stale+undersized+peered, 223 undersized+peered, 109 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:10.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:10 smithi031 bash[18426]: cluster 2020-06-27T04:48:09.281843+0000 mon.a (mon.0) 993 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:48:10.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:10 smithi031 bash[18426]: cluster 2020-06-27T04:48:09.291002+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e110: 8 total, 2 up, 8 in 2020-06-27T04:48:10.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:10 smithi031 bash[18426]: cluster 2020-06-27T04:48:09.371368+0000 mon.a (mon.0) 995 : cluster [WRN] Health check update: Reduced data availability: 8 pgs inactive, 60 pgs down, 1 pg peering, 1 pg incomplete (PG_AVAILABILITY) 2020-06-27T04:48:10.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:10 smithi031 bash[18426]: cluster 2020-06-27T04:48:09.378071+0000 mon.a (mon.0) 996 : cluster [WRN] Health check update: Degraded data redundancy: 487/1041 objects degraded (46.782%), 126 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:10.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:10 smithi031 bash[22603]: cluster 2020-06-27T04:48:09.214403+0000 mgr.x (mgr.34109) 250 : cluster [DBG] pgmap v273: 777 pgs: 1 creating+incomplete, 2 creating+down, 16 peering, 8 stale+creating+peering, 11 creating+peering, 22 active+undersized+degraded, 26 down, 32 stale+down, 18 stale+undersized+degraded+peered, 25 stale+active+clean, 13 unknown, 76 active+undersized, 1 stale+peering, 24 stale+active+undersized+degraded, 62 undersized+degraded+peered, 19 active+clean, 89 stale+undersized+peered, 223 undersized+peered, 109 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:10.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:10 smithi031 bash[22603]: cluster 2020-06-27T04:48:09.281843+0000 mon.a (mon.0) 993 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:48:10.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:10 smithi031 bash[22603]: cluster 2020-06-27T04:48:09.291002+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e110: 8 total, 2 up, 8 in 2020-06-27T04:48:10.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:10 smithi031 bash[22603]: cluster 2020-06-27T04:48:09.371368+0000 mon.a (mon.0) 995 : cluster [WRN] Health check update: Reduced data availability: 8 pgs inactive, 60 pgs down, 1 pg peering, 1 pg incomplete (PG_AVAILABILITY) 2020-06-27T04:48:10.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:10 smithi031 bash[22603]: cluster 2020-06-27T04:48:09.378071+0000 mon.a (mon.0) 996 : cluster [WRN] Health check update: Degraded data redundancy: 487/1041 objects degraded (46.782%), 126 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:11.551 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:11 smithi051 bash[18409]: cluster 2020-06-27T04:48:10.296921+0000 mon.a (mon.0) 997 : cluster [DBG] osdmap e111: 8 total, 2 up, 8 in 2020-06-27T04:48:11.552 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:11 smithi051 podman[37263]: 2020-06-27 04:48:11.257726514 +0000 UTC m=+5.399452058 container remove 24544aba1c2267080ee6f70546316b9b8e9e958be63f07a527f3aecfed1e7acc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:48:11.552 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:11 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:11.552 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:11 smithi051 podman[35150]: 2020-06-27 04:48:11.342344683 +0000 UTC m=+22.498526961 container remove c9b1db8315dbc48329f44d17f7a59baf754467fc35577bcfdb05d1d31966f2cb (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:48:11.552 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:11 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:11.553 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:11 smithi051 podman[37665]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6 found: no such container 2020-06-27T04:48:11.553 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:11 smithi051 systemd[1]: Started Ceph osd.6 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:11.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:11 smithi031 bash[18426]: cluster 2020-06-27T04:48:10.296921+0000 mon.a (mon.0) 997 : cluster [DBG] osdmap e111: 8 total, 2 up, 8 in 2020-06-27T04:48:11.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:11 smithi031 bash[22603]: cluster 2020-06-27T04:48:10.296921+0000 mon.a (mon.0) 997 : cluster [DBG] osdmap e111: 8 total, 2 up, 8 in 2020-06-27T04:48:11.876 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:11 smithi051 podman[37727]: 2020-06-27 04:48:11.548902319 +0000 UTC m=+0.272415654 container create f010bb153ef98899a3bdb14966d84ef5139a65593602133e1648f0e124c3ce23 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:48:11.877 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:11 smithi051 podman[37664]: 2020-06-27 04:48:11.782083853 +0000 UTC m=+1.347761129 container create d43c7174e69fa3238db119473f552c1c259c16a9c7abe379e12c477ad9960034 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:48:12.141 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:11 smithi051 podman[37727]: 2020-06-27 04:48:11.873810872 +0000 UTC m=+0.597324339 container init f010bb153ef98899a3bdb14966d84ef5139a65593602133e1648f0e124c3ce23 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:48:12.142 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:11 smithi051 podman[37727]: 2020-06-27 04:48:11.974293213 +0000 UTC m=+0.697806536 container start f010bb153ef98899a3bdb14966d84ef5139a65593602133e1648f0e124c3ce23 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:48:12.142 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:11 smithi051 podman[37727]: 2020-06-27 04:48:11.974368366 +0000 UTC m=+0.697881719 container attach f010bb153ef98899a3bdb14966d84ef5139a65593602133e1648f0e124c3ce23 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:48:12.308 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:11 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:12.309 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:11 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 2. 2020-06-27T04:48:12.309 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:11 smithi031 systemd[1]: Stopped Ceph osd.0 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:12.309 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:11 smithi031 systemd[1]: Starting Ceph osd.0 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:48:12.309 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:12 smithi031 podman[72925]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0 found: no such container 2020-06-27T04:48:12.309 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:12 smithi031 systemd[1]: Started Ceph osd.0 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:12.310 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:12 smithi031 bash[18426]: cluster 2020-06-27T04:48:11.215382+0000 mgr.x (mgr.34109) 251 : cluster [DBG] pgmap v276: 777 pgs: 1 creating+incomplete, 2 creating+down, 16 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 25 down, 33 stale+down, 34 stale+undersized+degraded+peered, 44 stale+active+clean, 13 unknown, 17 active+undersized, 1 stale+peering, 38 stale+active+undersized+degraded, 46 undersized+degraded+peered, 146 stale+undersized+peered, 166 undersized+peered, 168 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 170 B/s wr, 0 op/s; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:12.310 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:12 smithi031 bash[18426]: cluster 2020-06-27T04:48:11.309113+0000 mon.a (mon.0) 998 : cluster [DBG] osdmap e112: 8 total, 2 up, 8 in 2020-06-27T04:48:12.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:12 smithi051 bash[18409]: cluster 2020-06-27T04:48:11.215382+0000 mgr.x (mgr.34109) 251 : cluster [DBG] pgmap v276: 777 pgs: 1 creating+incomplete, 2 creating+down, 16 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 25 down, 33 stale+down, 34 stale+undersized+degraded+peered, 44 stale+active+clean, 13 unknown, 17 active+undersized, 1 stale+peering, 38 stale+active+undersized+degraded, 46 undersized+degraded+peered, 146 stale+undersized+peered, 166 undersized+peered, 168 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 170 B/s wr, 0 op/s; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:12.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:12 smithi051 bash[18409]: cluster 2020-06-27T04:48:11.309113+0000 mon.a (mon.0) 998 : cluster [DBG] osdmap e112: 8 total, 2 up, 8 in 2020-06-27T04:48:12.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:12 smithi051 podman[37727]: 2020-06-27 04:48:12.259761549 +0000 UTC m=+0.983274897 container died f010bb153ef98899a3bdb14966d84ef5139a65593602133e1648f0e124c3ce23 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:48:12.469 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:12 smithi051 podman[37750]: 2020-06-27 04:48:12.173722439 +0000 UTC m=+0.803823595 container create 494ec903b9cf9b1701f7e787689557e35b658dba9c98c8c0f8cc6f9d81eae680 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:48:12.469 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:12 smithi051 podman[37664]: 2020-06-27 04:48:12.257025575 +0000 UTC m=+1.822702872 container init d43c7174e69fa3238db119473f552c1c259c16a9c7abe379e12c477ad9960034 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:48:12.617 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:12 smithi031 bash[22603]: cluster 2020-06-27T04:48:11.215382+0000 mgr.x (mgr.34109) 251 : cluster [DBG] pgmap v276: 777 pgs: 1 creating+incomplete, 2 creating+down, 16 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 25 down, 33 stale+down, 34 stale+undersized+degraded+peered, 44 stale+active+clean, 13 unknown, 17 active+undersized, 1 stale+peering, 38 stale+active+undersized+degraded, 46 undersized+degraded+peered, 146 stale+undersized+peered, 166 undersized+peered, 168 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 170 B/s wr, 0 op/s; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:12.617 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:12 smithi031 bash[22603]: cluster 2020-06-27T04:48:11.309113+0000 mon.a (mon.0) 998 : cluster [DBG] osdmap e112: 8 total, 2 up, 8 in 2020-06-27T04:48:12.618 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:12 smithi031 podman[73389]: 2020-06-27 04:48:12.503190232 +0000 UTC m=+0.381797532 container create 5552b1e7af9a83cc3531f2ef513756f032b0f0aa1e37f17a77d71c52f3e1fee8 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:48:12.809 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:12 smithi051 podman[37746]: 2020-06-27 04:48:12.620139009 +0000 UTC m=+1.255021302 container create df41de8ab8c0b4fc0e8a2aff845b03cb8af98bf08ff6e7bd6d2cebf4d160e87d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:48:12.810 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:12 smithi051 podman[37664]: 2020-06-27 04:48:12.53534629 +0000 UTC m=+2.101023685 container start d43c7174e69fa3238db119473f552c1c259c16a9c7abe379e12c477ad9960034 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:48:12.810 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:12 smithi051 podman[37664]: 2020-06-27 04:48:12.535480092 +0000 UTC m=+2.101157539 container attach d43c7174e69fa3238db119473f552c1c259c16a9c7abe379e12c477ad9960034 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:48:12.810 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:12 smithi051 bash[37661]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-06-27T04:48:12.811 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:12 smithi051 bash[37661]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2020-06-27T04:48:12.811 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:12 smithi051 bash[37661]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2020-06-27T04:48:12.811 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:12 smithi051 bash[37661]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2020-06-27T04:48:12.811 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:12 smithi051 bash[37661]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2020-06-27T04:48:12.811 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:12 smithi051 bash[37661]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-06-27T04:48:12.812 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:12 smithi051 bash[37661]: --> ceph-volume lvm activate successful for osd ID: 4 2020-06-27T04:48:12.973 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:12 smithi031 podman[73389]: 2020-06-27 04:48:12.703180616 +0000 UTC m=+0.581787954 container init 5552b1e7af9a83cc3531f2ef513756f032b0f0aa1e37f17a77d71c52f3e1fee8 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:48:12.973 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:12 smithi031 podman[73389]: 2020-06-27 04:48:12.803177686 +0000 UTC m=+0.681785007 container start 5552b1e7af9a83cc3531f2ef513756f032b0f0aa1e37f17a77d71c52f3e1fee8 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:48:12.973 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:12 smithi031 podman[73389]: 2020-06-27 04:48:12.803435397 +0000 UTC m=+0.682042743 container attach 5552b1e7af9a83cc3531f2ef513756f032b0f0aa1e37f17a77d71c52f3e1fee8 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:48:13.218 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:12 smithi051 podman[37727]: 2020-06-27 04:48:12.956313589 +0000 UTC m=+1.679826943 container remove f010bb153ef98899a3bdb14966d84ef5139a65593602133e1648f0e124c3ce23 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:48:13.219 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:12 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Failed with result 'exit-code'. 2020-06-27T04:48:13.219 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:13 smithi051 podman[37664]: 2020-06-27 04:48:13.031980537 +0000 UTC m=+2.597657850 container died d43c7174e69fa3238db119473f552c1c259c16a9c7abe379e12c477ad9960034 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:48:13.219 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:12 smithi051 podman[37750]: 2020-06-27 04:48:12.889581357 +0000 UTC m=+1.519682581 container init 494ec903b9cf9b1701f7e787689557e35b658dba9c98c8c0f8cc6f9d81eae680 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:48:13.219 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:12 smithi051 podman[37750]: 2020-06-27 04:48:12.94860623 +0000 UTC m=+1.578707390 container start 494ec903b9cf9b1701f7e787689557e35b658dba9c98c8c0f8cc6f9d81eae680 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:48:13.220 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:12 smithi051 podman[37750]: 2020-06-27 04:48:12.948690463 +0000 UTC m=+1.578791651 container attach 494ec903b9cf9b1701f7e787689557e35b658dba9c98c8c0f8cc6f9d81eae680 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:48:13.220 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:12 smithi051 podman[37746]: 2020-06-27 04:48:12.981914793 +0000 UTC m=+1.616797080 container init df41de8ab8c0b4fc0e8a2aff845b03cb8af98bf08ff6e7bd6d2cebf4d160e87d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:48:13.220 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:13 smithi051 podman[37746]: 2020-06-27 04:48:13.015281452 +0000 UTC m=+1.650163743 container start df41de8ab8c0b4fc0e8a2aff845b03cb8af98bf08ff6e7bd6d2cebf4d160e87d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:48:13.221 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:13 smithi051 podman[37746]: 2020-06-27 04:48:13.015355644 +0000 UTC m=+1.650237950 container attach df41de8ab8c0b4fc0e8a2aff845b03cb8af98bf08ff6e7bd6d2cebf4d160e87d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:48:13.473 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:13 smithi031 bash[73386]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-06-27T04:48:13.473 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:13 smithi031 bash[73386]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2020-06-27T04:48:13.473 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:13 smithi031 bash[73386]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2020-06-27T04:48:13.474 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:13 smithi031 bash[73386]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2020-06-27T04:48:13.474 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:13 smithi031 bash[73386]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2020-06-27T04:48:13.474 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:13 smithi031 bash[73386]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-06-27T04:48:13.474 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:13 smithi031 bash[73386]: --> ceph-volume lvm activate successful for osd ID: 0 2020-06-27T04:48:13.474 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:13 smithi031 podman[73389]: 2020-06-27 04:48:13.320480887 +0000 UTC m=+1.199088224 container died 5552b1e7af9a83cc3531f2ef513756f032b0f0aa1e37f17a77d71c52f3e1fee8 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:48:13.575 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:13 smithi051 podman[37746]: 2020-06-27 04:48:13.29158066 +0000 UTC m=+1.926462959 container died df41de8ab8c0b4fc0e8a2aff845b03cb8af98bf08ff6e7bd6d2cebf4d160e87d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:48:13.576 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:13 smithi051 bash[37743]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-06-27T04:48:13.576 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:13 smithi051 bash[37743]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2020-06-27T04:48:13.576 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:13 smithi051 bash[37743]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2020-06-27T04:48:13.577 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:13 smithi051 bash[37743]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2020-06-27T04:48:13.577 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:13 smithi051 bash[37743]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2020-06-27T04:48:13.577 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:13 smithi051 bash[37743]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-06-27T04:48:13.577 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:13 smithi051 bash[37743]: --> ceph-volume lvm activate successful for osd ID: 6 2020-06-27T04:48:13.967 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:13 smithi051 podman[37750]: 2020-06-27 04:48:13.573695236 +0000 UTC m=+2.203796391 container died 494ec903b9cf9b1701f7e787689557e35b658dba9c98c8c0f8cc6f9d81eae680 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:48:14.317 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:14 smithi031 bash[22603]: cluster 2020-06-27T04:48:13.216393+0000 mgr.x (mgr.34109) 252 : cluster [DBG] pgmap v278: 777 pgs: 1 creating+incomplete, 2 creating+down, 16 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 25 down, 33 stale+down, 34 stale+undersized+degraded+peered, 44 stale+active+clean, 13 unknown, 17 active+undersized, 1 stale+peering, 38 stale+active+undersized+degraded, 46 undersized+degraded+peered, 146 stale+undersized+peered, 166 undersized+peered, 168 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:14.317 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:14 smithi031 podman[73389]: 2020-06-27 04:48:14.062166905 +0000 UTC m=+1.940774226 container remove 5552b1e7af9a83cc3531f2ef513756f032b0f0aa1e37f17a77d71c52f3e1fee8 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:48:14.317 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:14 smithi031 bash[73386]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0 found: no such container 2020-06-27T04:48:14.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[18409]: cluster 2020-06-27T04:48:13.216393+0000 mgr.x (mgr.34109) 252 : cluster [DBG] pgmap v278: 777 pgs: 1 creating+incomplete, 2 creating+down, 16 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 25 down, 33 stale+down, 34 stale+undersized+degraded+peered, 44 stale+active+clean, 13 unknown, 17 active+undersized, 1 stale+peering, 38 stale+active+undersized+degraded, 46 undersized+degraded+peered, 146 stale+undersized+peered, 166 undersized+peered, 168 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:14.468 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4 found: no such container 2020-06-27T04:48:14.468 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4 2020-06-27T04:48:14.469 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4" found: no such container 2020-06-27T04:48:14.469 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 podman[37750]: 2020-06-27 04:48:14.196597737 +0000 UTC m=+2.826698889 container remove 494ec903b9cf9b1701f7e787689557e35b658dba9c98c8c0f8cc6f9d81eae680 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:48:14.469 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6 found: no such container 2020-06-27T04:48:14.469 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6 2020-06-27T04:48:14.470 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6" found: no such container 2020-06-27T04:48:14.470 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:14 smithi051 podman[37746]: 2020-06-27 04:48:14.112037122 +0000 UTC m=+2.746919426 container remove df41de8ab8c0b4fc0e8a2aff845b03cb8af98bf08ff6e7bd6d2cebf4d160e87d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:48:14.470 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:14 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Failed with result 'exit-code'. 2020-06-27T04:48:14.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:14 smithi031 bash[18426]: cluster 2020-06-27T04:48:13.216393+0000 mgr.x (mgr.34109) 252 : cluster [DBG] pgmap v278: 777 pgs: 1 creating+incomplete, 2 creating+down, 16 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 25 down, 33 stale+down, 34 stale+undersized+degraded+peered, 44 stale+active+clean, 13 unknown, 17 active+undersized, 1 stale+peering, 38 stale+active+undersized+degraded, 46 undersized+degraded+peered, 146 stale+undersized+peered, 166 undersized+peered, 168 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:14.725 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:14 smithi031 bash[73386]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0 2020-06-27T04:48:14.725 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:14 smithi031 bash[73386]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0" found: no such container 2020-06-27T04:48:14.800 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 podman[38079]: 2020-06-27 04:48:14.510523751 +0000 UTC m=+0.257666633 container create c2fc550e7fff5a3e62d637c3329a60bd6b38d9a794168e94b2080b683bd48fc9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:48:14.801 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 podman[38079]: 2020-06-27 04:48:14.72340031 +0000 UTC m=+0.470543305 container init c2fc550e7fff5a3e62d637c3329a60bd6b38d9a794168e94b2080b683bd48fc9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:48:14.801 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 podman[38079]: 2020-06-27 04:48:14.75665001 +0000 UTC m=+0.503792900 container start c2fc550e7fff5a3e62d637c3329a60bd6b38d9a794168e94b2080b683bd48fc9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:48:14.801 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 podman[38079]: 2020-06-27 04:48:14.756713098 +0000 UTC m=+0.503856027 container attach c2fc550e7fff5a3e62d637c3329a60bd6b38d9a794168e94b2080b683bd48fc9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:48:14.801 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.745+0000 7f6df97f8f40 10 -- 172.21.15.51:0/2169095425 shutdown 172.21.15.51:0/2169095425 2020-06-27T04:48:14.802 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.745+0000 7f6df97f8f40 10 Processor -- stop 2020-06-27T04:48:14.802 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.745+0000 7f6df97f8f40 20 Event(0x556f4ab38e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:14.802 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 1 -- 172.21.15.51:0/2169095425 shutdown_connections 2020-06-27T04:48:14.802 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 5 -- 172.21.15.51:0/2169095425 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x556f4aba5400 2020-06-27T04:48:14.802 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 1 --2- 172.21.15.51:0/2169095425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556f4aba5400 0x556f4ab16300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:14.803 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 5 -- 172.21.15.51:0/2169095425 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x556f4aba4c00 2020-06-27T04:48:14.803 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 1 --2- 172.21.15.51:0/2169095425 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556f4aba4c00 0x556f4ab15400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:14.803 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 5 -- 172.21.15.51:0/2169095425 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x556f4aba5000 2020-06-27T04:48:14.803 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 1 --2- 172.21.15.51:0/2169095425 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x556f4aba5000 0x556f4ab15e00 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:14.803 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 5 -- 172.21.15.51:0/2169095425 shutdown_connections delete 0x556f4aba4c00 2020-06-27T04:48:14.804 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 5 -- 172.21.15.51:0/2169095425 shutdown_connections delete 0x556f4aba5000 2020-06-27T04:48:14.804 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 5 -- 172.21.15.51:0/2169095425 shutdown_connections delete 0x556f4aba5400 2020-06-27T04:48:14.804 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 1 -- 172.21.15.51:0/2169095425 >> 172.21.15.51:0/2169095425 conn(0x556f4aba4800 msgr2=0x556f4ac0d000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:48:14.804 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 20 --1- 172.21.15.51:0/2169095425 >> 172.21.15.51:0/2169095425 conn(0x556f4aba4800 0x556f4ac0d000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:14.804 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 2 --1- 172.21.15.51:0/2169095425 >> 172.21.15.51:0/2169095425 conn(0x556f4aba4800 0x556f4ac0d000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:14.804 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 5 --1- 172.21.15.51:0/2169095425 >> 172.21.15.51:0/2169095425 conn(0x556f4aba4800 0x556f4ac0d000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:48:14.805 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 20 Event(0x556f4ab38e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:14.805 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 10 --1- 172.21.15.51:0/2169095425 >> 172.21.15.51:0/2169095425 conn(0x556f4aba4800 0x556f4ac0d000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:48:14.805 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 20 Event(0x556f4ab38e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:14.805 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 20 Event(0x556f4ab39040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:14.805 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 20 Event(0x556f4ab39280 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:14.809 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df357b700 5 --1- 172.21.15.51:0/2169095425 >> 172.21.15.51:0/2169095425 conn(0x556f4aba4800 0x556f4ac0d000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:48:14.810 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df357b700 5 --1- 172.21.15.51:0/2169095425 >> 172.21.15.51:0/2169095425 conn(0x556f4aba4800 0x556f4ac0d000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:48:14.810 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 10 -- 172.21.15.51:0/2169095425 wait: waiting for dispatch queue 2020-06-27T04:48:14.810 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 10 -- 172.21.15.51:0/2169095425 wait: dispatch queue is stopped 2020-06-27T04:48:14.810 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 1 -- 172.21.15.51:0/2169095425 shutdown_connections 2020-06-27T04:48:14.811 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 5 -- 172.21.15.51:0/2169095425 shutdown_connections delete 0x556f4aba4800 2020-06-27T04:48:14.811 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 20 Event(0x556f4ab38e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:14.811 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 20 Event(0x556f4ab39040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:14.811 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 20 Event(0x556f4ab39280 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:14.811 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 10 -- 172.21.15.51:0/2169095425 wait: done. 2020-06-27T04:48:14.811 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37661]: debug 2020-06-27T04:48:14.746+0000 7f6df97f8f40 1 -- 172.21.15.51:0/2169095425 wait complete. 2020-06-27T04:48:15.197 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:14 smithi031 podman[80237]: 2020-06-27 04:48:14.870613575 +0000 UTC m=+0.304931297 container create 3cdf8ddfac7d106baf26ec22e8edc0cce118614f71d874f32bdf5131fb022450 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:48:15.198 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:15 smithi031 podman[80237]: 2020-06-27 04:48:15.10279612 +0000 UTC m=+0.537113833 container init 3cdf8ddfac7d106baf26ec22e8edc0cce118614f71d874f32bdf5131fb022450 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:48:15.198 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:15 smithi031 podman[80237]: 2020-06-27 04:48:15.194446553 +0000 UTC m=+0.628764262 container start 3cdf8ddfac7d106baf26ec22e8edc0cce118614f71d874f32bdf5131fb022450 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:48:15.198 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:15 smithi031 podman[80237]: 2020-06-27 04:48:15.194789868 +0000 UTC m=+0.629107583 container attach 3cdf8ddfac7d106baf26ec22e8edc0cce118614f71d874f32bdf5131fb022450 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:48:15.218 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 podman[38102]: 2020-06-27 04:48:14.798278129 +0000 UTC m=+0.498442126 container create 2adc91fa33a364bb20aacbe2eb988e2ff3fad5075d5a63631d9662ee1489792f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:48:15.218 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 podman[38102]: 2020-06-27 04:48:14.914990526 +0000 UTC m=+0.615154656 container init 2adc91fa33a364bb20aacbe2eb988e2ff3fad5075d5a63631d9662ee1489792f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:48:15.219 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 podman[38102]: 2020-06-27 04:48:14.94833756 +0000 UTC m=+0.648501624 container start 2adc91fa33a364bb20aacbe2eb988e2ff3fad5075d5a63631d9662ee1489792f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:48:15.219 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 podman[38102]: 2020-06-27 04:48:14.948507517 +0000 UTC m=+0.648671518 container attach 2adc91fa33a364bb20aacbe2eb988e2ff3fad5075d5a63631d9662ee1489792f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:48:15.219 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f1675a37700 20 EpollDriver.del_event del event fd=15 cur_mask=1 delmask=3 to 11 2020-06-27T04:48:15.219 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 10 -- 172.21.15.51:0/1201401482 shutdown 172.21.15.51:0/1201401482 2020-06-27T04:48:15.220 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 10 Processor -- stop 2020-06-27T04:48:15.220 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 20 Event(0x563aa857ae00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:15.220 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 1 -- 172.21.15.51:0/1201401482 shutdown_connections 2020-06-27T04:48:15.220 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 5 -- 172.21.15.51:0/1201401482 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x563aa85e7400 2020-06-27T04:48:15.220 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 1 --2- 172.21.15.51:0/1201401482 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563aa85e7400 0x563aa8558300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-06-27T04:48:15.221 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 5 -- 172.21.15.51:0/1201401482 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x563aa85e6c00 2020-06-27T04:48:15.221 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 1 --2- 172.21.15.51:0/1201401482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563aa85e6c00 0x563aa8557400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-06-27T04:48:15.221 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 5 -- 172.21.15.51:0/1201401482 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x563aa85e7000 2020-06-27T04:48:15.221 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 1 --2- 172.21.15.51:0/1201401482 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x563aa85e7000 0x563aa8557e00 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:15.221 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 5 -- 172.21.15.51:0/1201401482 shutdown_connections delete 0x563aa85e6c00 2020-06-27T04:48:15.222 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 5 -- 172.21.15.51:0/1201401482 shutdown_connections delete 0x563aa85e7000 2020-06-27T04:48:15.222 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 5 -- 172.21.15.51:0/1201401482 shutdown_connections delete 0x563aa85e7400 2020-06-27T04:48:15.222 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 1 -- 172.21.15.51:0/1201401482 >> 172.21.15.51:0/1201401482 conn(0x563aa85e6800 msgr2=0x563aa864f000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:48:15.222 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 20 --1- 172.21.15.51:0/1201401482 >> 172.21.15.51:0/1201401482 conn(0x563aa85e6800 0x563aa864f000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:15.222 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 2 --1- 172.21.15.51:0/1201401482 >> 172.21.15.51:0/1201401482 conn(0x563aa85e6800 0x563aa864f000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:15.223 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 5 --1- 172.21.15.51:0/1201401482 >> 172.21.15.51:0/1201401482 conn(0x563aa85e6800 0x563aa864f000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:48:15.223 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 20 Event(0x563aa857ae00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:15.223 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 10 --1- 172.21.15.51:0/1201401482 >> 172.21.15.51:0/1201401482 conn(0x563aa85e6800 0x563aa864f000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:48:15.223 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 20 Event(0x563aa857b040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:15.223 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 20 Event(0x563aa857b280 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:15.224 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f1676a39700 5 --1- 172.21.15.51:0/1201401482 >> 172.21.15.51:0/1201401482 conn(0x563aa85e6800 0x563aa864f000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:48:15.224 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f1676a39700 5 --1- 172.21.15.51:0/1201401482 >> 172.21.15.51:0/1201401482 conn(0x563aa85e6800 0x563aa864f000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:48:15.224 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 10 -- 172.21.15.51:0/1201401482 wait: waiting for dispatch queue 2020-06-27T04:48:15.224 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 10 -- 172.21.15.51:0/1201401482 wait: dispatch queue is stopped 2020-06-27T04:48:15.224 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 1 -- 172.21.15.51:0/1201401482 shutdown_connections 2020-06-27T04:48:15.225 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 5 -- 172.21.15.51:0/1201401482 shutdown_connections delete 0x563aa85e6800 2020-06-27T04:48:15.225 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 20 Event(0x563aa857ae00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:15.225 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 20 Event(0x563aa857b040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:15.225 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 20 Event(0x563aa857b280 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:15.226 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 10 -- 172.21.15.51:0/1201401482 wait: done. 2020-06-27T04:48:15.226 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:14 smithi051 bash[37743]: debug 2020-06-27T04:48:14.936+0000 7f167ccb6f40 1 -- 172.21.15.51:0/1201401482 wait complete. 2020-06-27T04:48:15.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:15 smithi031 bash[22603]: cluster 2020-06-27T04:48:14.378945+0000 mon.a (mon.0) 999 : cluster [WRN] Health check update: 6 osds down (OSD_DOWN) 2020-06-27T04:48:15.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:15 smithi031 bash[22603]: cluster 2020-06-27T04:48:14.379020+0000 mon.a (mon.0) 1000 : cluster [WRN] Health check update: Reduced data availability: 16 pgs inactive, 60 pgs down, 2 pgs peering, 1 pg incomplete (PG_AVAILABILITY) 2020-06-27T04:48:15.475 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:15 smithi031 bash[73386]: debug 2020-06-27T04:48:15.195+0000 7f8e1e28df40 10 -- 172.21.15.31:0/770632309 shutdown 172.21.15.31:0/770632309 2020-06-27T04:48:15.475 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:15 smithi031 bash[73386]: debug 2020-06-27T04:48:15.195+0000 7f8e1e28df40 10 Processor -- stop 2020-06-27T04:48:15.475 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:15 smithi031 bash[73386]: debug 2020-06-27T04:48:15.195+0000 7f8e1e28df40 20 Event(0x55d472adae00 nevent=5000 time_id=1).wakeup 2020-06-27T04:48:15.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:15 smithi031 bash[18426]: cluster 2020-06-27T04:48:14.378945+0000 mon.a (mon.0) 999 : cluster [WRN] Health check update: 6 osds down (OSD_DOWN) 2020-06-27T04:48:15.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:15 smithi031 bash[18426]: cluster 2020-06-27T04:48:14.379020+0000 mon.a (mon.0) 1000 : cluster [WRN] Health check update: Reduced data availability: 16 pgs inactive, 60 pgs down, 2 pgs peering, 1 pg incomplete (PG_AVAILABILITY) 2020-06-27T04:48:15.718 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:15 smithi051 bash[37661]: debug 2020-06-27T04:48:15.266+0000 7f6df97f8f40 -1 Falling back to public interface 2020-06-27T04:48:15.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:15 smithi051 bash[18409]: cluster 2020-06-27T04:48:14.378945+0000 mon.a (mon.0) 999 : cluster [WRN] Health check update: 6 osds down (OSD_DOWN) 2020-06-27T04:48:15.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:15 smithi051 bash[18409]: cluster 2020-06-27T04:48:14.379020+0000 mon.a (mon.0) 1000 : cluster [WRN] Health check update: Reduced data availability: 16 pgs inactive, 60 pgs down, 2 pgs peering, 1 pg incomplete (PG_AVAILABILITY) 2020-06-27T04:48:15.719 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:15 smithi051 bash[37743]: debug 2020-06-27T04:48:15.465+0000 7f167ccb6f40 -1 Falling back to public interface 2020-06-27T04:48:15.973 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:15 smithi031 bash[73386]: debug 2020-06-27T04:48:15.486+0000 7f8e1e28df40 -1 Falling back to public interface 2020-06-27T04:48:16.218 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:15 smithi051 bash[37661]: debug 2020-06-27T04:48:15.958+0000 7f6df97f8f40 -1 osd.4 101 log_to_monitors {default=true} 2020-06-27T04:48:16.218 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:16 smithi051 bash[37743]: debug 2020-06-27T04:48:16.145+0000 7f167ccb6f40 -1 osd.6 101 log_to_monitors {default=true} 2020-06-27T04:48:16.700 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[18426]: cluster 2020-06-27T04:48:15.217527+0000 mgr.x (mgr.34109) 253 : cluster [DBG] pgmap v279: 777 pgs: 1 creating+incomplete, 2 creating+down, 16 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 25 down, 33 stale+down, 34 stale+undersized+degraded+peered, 44 stale+active+clean, 13 unknown, 17 active+undersized, 1 stale+peering, 38 stale+active+undersized+degraded, 46 undersized+degraded+peered, 146 stale+undersized+peered, 166 undersized+peered, 168 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:16.700 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[18426]: audit 2020-06-27T04:48:15.963555+0000 mon.b (mon.2) 294 : audit [INF] from='osd.4 v2:172.21.15.51:6801/2078091771' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:48:16.700 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[18426]: audit 2020-06-27T04:48:15.963908+0000 mon.a (mon.0) 1001 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:48:16.701 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[18426]: audit 2020-06-27T04:48:15.964864+0000 mon.b (mon.2) 295 : audit [INF] from='osd.4 v2:172.21.15.51:6801/2078091771' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:16.701 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[18426]: audit 2020-06-27T04:48:15.965303+0000 mon.a (mon.0) 1002 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:16.701 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[18426]: audit 2020-06-27T04:48:16.150117+0000 mon.b (mon.2) 296 : audit [INF] from='osd.6 v2:172.21.15.51:6805/1343002872' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:48:16.701 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[18426]: audit 2020-06-27T04:48:16.150428+0000 mon.a (mon.0) 1003 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:48:16.701 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[18426]: audit 2020-06-27T04:48:16.151007+0000 mon.b (mon.2) 297 : audit [INF] from='osd.6 v2:172.21.15.51:6805/1343002872' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:16.702 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[18426]: audit 2020-06-27T04:48:16.151263+0000 mon.a (mon.0) 1004 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:16.702 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[18426]: audit 2020-06-27T04:48:16.378722+0000 mon.a (mon.0) 1005 : audit [INF] from='osd.0 v2:172.21.15.31:6800/1341397229' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:48:16.702 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[18426]: audit 2020-06-27T04:48:16.381268+0000 mon.a (mon.0) 1006 : audit [INF] from='osd.0 v2:172.21.15.31:6800/1341397229' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:16.702 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[22603]: cluster 2020-06-27T04:48:15.217527+0000 mgr.x (mgr.34109) 253 : cluster [DBG] pgmap v279: 777 pgs: 1 creating+incomplete, 2 creating+down, 16 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 25 down, 33 stale+down, 34 stale+undersized+degraded+peered, 44 stale+active+clean, 13 unknown, 17 active+undersized, 1 stale+peering, 38 stale+active+undersized+degraded, 46 undersized+degraded+peered, 146 stale+undersized+peered, 166 undersized+peered, 168 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:16.702 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[22603]: audit 2020-06-27T04:48:15.963555+0000 mon.b (mon.2) 294 : audit [INF] from='osd.4 v2:172.21.15.51:6801/2078091771' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:48:16.703 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[22603]: audit 2020-06-27T04:48:15.963908+0000 mon.a (mon.0) 1001 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:48:16.703 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[22603]: audit 2020-06-27T04:48:15.964864+0000 mon.b (mon.2) 295 : audit [INF] from='osd.4 v2:172.21.15.51:6801/2078091771' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:16.703 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[22603]: audit 2020-06-27T04:48:15.965303+0000 mon.a (mon.0) 1002 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:16.703 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[22603]: audit 2020-06-27T04:48:16.150117+0000 mon.b (mon.2) 296 : audit [INF] from='osd.6 v2:172.21.15.51:6805/1343002872' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:48:16.703 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[22603]: audit 2020-06-27T04:48:16.150428+0000 mon.a (mon.0) 1003 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:48:16.704 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[22603]: audit 2020-06-27T04:48:16.151007+0000 mon.b (mon.2) 297 : audit [INF] from='osd.6 v2:172.21.15.51:6805/1343002872' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:16.704 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[22603]: audit 2020-06-27T04:48:16.151263+0000 mon.a (mon.0) 1004 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:16.704 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[22603]: audit 2020-06-27T04:48:16.378722+0000 mon.a (mon.0) 1005 : audit [INF] from='osd.0 v2:172.21.15.31:6800/1341397229' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:48:16.704 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[22603]: audit 2020-06-27T04:48:16.381268+0000 mon.a (mon.0) 1006 : audit [INF] from='osd.0 v2:172.21.15.31:6800/1341397229' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:16.704 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:16 smithi031 bash[73386]: debug 2020-06-27T04:48:16.364+0000 7f8e1e28df40 -1 osd.0 101 log_to_monitors {default=true} 2020-06-27T04:48:16.705 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:16 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:16.705 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:16 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 3. 2020-06-27T04:48:16.705 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:16 smithi031 systemd[1]: Stopped Ceph osd.3 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:16.705 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:16 smithi031 systemd[1]: Starting Ceph osd.3 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:48:16.706 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:16 smithi031 podman[85677]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3 found: no such container 2020-06-27T04:48:16.706 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:16 smithi031 systemd[1]: Started Ceph osd.3 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:16.706 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:16 smithi031 podman[86050]: 2020-06-27 04:48:16.694176223 +0000 UTC m=+0.363409438 container create c2d65628b5fd2adedf158dbf2dff42ba071e778f69a18a0fde24aef441611a83 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:48:16.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:16 smithi051 bash[18409]: cluster 2020-06-27T04:48:15.217527+0000 mgr.x (mgr.34109) 253 : cluster [DBG] pgmap v279: 777 pgs: 1 creating+incomplete, 2 creating+down, 16 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 25 down, 33 stale+down, 34 stale+undersized+degraded+peered, 44 stale+active+clean, 13 unknown, 17 active+undersized, 1 stale+peering, 38 stale+active+undersized+degraded, 46 undersized+degraded+peered, 146 stale+undersized+peered, 166 undersized+peered, 168 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:16.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:16 smithi051 bash[18409]: audit 2020-06-27T04:48:15.963555+0000 mon.b (mon.2) 294 : audit [INF] from='osd.4 v2:172.21.15.51:6801/2078091771' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:48:16.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:16 smithi051 bash[18409]: audit 2020-06-27T04:48:15.963908+0000 mon.a (mon.0) 1001 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:48:16.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:16 smithi051 bash[18409]: audit 2020-06-27T04:48:15.964864+0000 mon.b (mon.2) 295 : audit [INF] from='osd.4 v2:172.21.15.51:6801/2078091771' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:16.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:16 smithi051 bash[18409]: audit 2020-06-27T04:48:15.965303+0000 mon.a (mon.0) 1002 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:16.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:16 smithi051 bash[18409]: audit 2020-06-27T04:48:16.150117+0000 mon.b (mon.2) 296 : audit [INF] from='osd.6 v2:172.21.15.51:6805/1343002872' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:48:16.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:16 smithi051 bash[18409]: audit 2020-06-27T04:48:16.150428+0000 mon.a (mon.0) 1003 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:48:16.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:16 smithi051 bash[18409]: audit 2020-06-27T04:48:16.151007+0000 mon.b (mon.2) 297 : audit [INF] from='osd.6 v2:172.21.15.51:6805/1343002872' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:16.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:16 smithi051 bash[18409]: audit 2020-06-27T04:48:16.151263+0000 mon.a (mon.0) 1004 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:16.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:16 smithi051 bash[18409]: audit 2020-06-27T04:48:16.378722+0000 mon.a (mon.0) 1005 : audit [INF] from='osd.0 v2:172.21.15.31:6800/1341397229' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:48:16.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:16 smithi051 bash[18409]: audit 2020-06-27T04:48:16.381268+0000 mon.a (mon.0) 1006 : audit [INF] from='osd.0 v2:172.21.15.31:6800/1341397229' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:16.949 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:16 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:16.949 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:16 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Scheduled restart job, restart counter is at 3. 2020-06-27T04:48:16.950 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:16 smithi031 systemd[1]: Stopped Ceph osd.1 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:16.950 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:16 smithi031 systemd[1]: Starting Ceph osd.1 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:48:16.950 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:16 smithi031 podman[86880]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1 found: no such container 2020-06-27T04:48:16.950 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:16 smithi031 systemd[1]: Started Ceph osd.1 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:16.951 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:16 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:16.951 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:16 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Scheduled restart job, restart counter is at 3. 2020-06-27T04:48:16.951 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:16 smithi031 systemd[1]: Stopped Ceph osd.2 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:16.951 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:16 smithi031 systemd[1]: Starting Ceph osd.2 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:48:16.951 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:16 smithi031 podman[86879]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2 found: no such container 2020-06-27T04:48:16.951 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:16 smithi031 systemd[1]: Started Ceph osd.2 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:17.225 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:16 smithi031 podman[86050]: 2020-06-27 04:48:16.944127326 +0000 UTC m=+0.613360534 container init c2d65628b5fd2adedf158dbf2dff42ba071e778f69a18a0fde24aef441611a83 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:48:17.225 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:17 smithi031 podman[86050]: 2020-06-27 04:48:17.035805561 +0000 UTC m=+0.705038777 container start c2d65628b5fd2adedf158dbf2dff42ba071e778f69a18a0fde24aef441611a83 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:48:17.226 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:17 smithi031 podman[86050]: 2020-06-27 04:48:17.035899885 +0000 UTC m=+0.705133096 container attach c2d65628b5fd2adedf158dbf2dff42ba071e778f69a18a0fde24aef441611a83 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:48:17.640 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:17 smithi031 bash[86047]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-06-27T04:48:17.641 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:17 smithi031 bash[86047]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2020-06-27T04:48:17.641 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:17 smithi031 bash[86047]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2020-06-27T04:48:17.641 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:17 smithi031 bash[86047]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2020-06-27T04:48:17.642 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:17 smithi031 bash[86047]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2020-06-27T04:48:17.642 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:17 smithi031 bash[86047]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-06-27T04:48:17.642 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:17 smithi031 bash[86047]: --> ceph-volume lvm activate successful for osd ID: 3 2020-06-27T04:48:17.642 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:17 smithi031 bash[18426]: cluster 2020-06-27T04:48:16.391769+0000 mon.a (mon.0) 1007 : cluster [INF] osd.4 v2:172.21.15.51:6801/2078091771 boot 2020-06-27T04:48:17.643 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:17 smithi031 bash[18426]: cluster 2020-06-27T04:48:16.391824+0000 mon.a (mon.0) 1008 : cluster [INF] osd.6 v2:172.21.15.51:6805/1343002872 boot 2020-06-27T04:48:17.643 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:17 smithi031 bash[18426]: cluster 2020-06-27T04:48:16.391856+0000 mon.a (mon.0) 1009 : cluster [DBG] osdmap e113: 8 total, 4 up, 8 in 2020-06-27T04:48:17.643 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:17 smithi031 bash[18426]: audit 2020-06-27T04:48:16.398995+0000 mon.b (mon.2) 298 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:48:17.643 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:17 smithi031 bash[18426]: audit 2020-06-27T04:48:16.399301+0000 mon.b (mon.2) 299 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:48:17.646 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:17 smithi031 bash[22603]: cluster 2020-06-27T04:48:16.391769+0000 mon.a (mon.0) 1007 : cluster [INF] osd.4 v2:172.21.15.51:6801/2078091771 boot 2020-06-27T04:48:17.646 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:17 smithi031 bash[22603]: cluster 2020-06-27T04:48:16.391824+0000 mon.a (mon.0) 1008 : cluster [INF] osd.6 v2:172.21.15.51:6805/1343002872 boot 2020-06-27T04:48:17.646 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:17 smithi031 bash[22603]: cluster 2020-06-27T04:48:16.391856+0000 mon.a (mon.0) 1009 : cluster [DBG] osdmap e113: 8 total, 4 up, 8 in 2020-06-27T04:48:17.647 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:17 smithi031 bash[22603]: audit 2020-06-27T04:48:16.398995+0000 mon.b (mon.2) 298 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:48:17.647 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:17 smithi031 bash[22603]: audit 2020-06-27T04:48:16.399301+0000 mon.b (mon.2) 299 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:48:17.647 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:17 smithi031 podman[87184]: 2020-06-27 04:48:17.335726856 +0000 UTC m=+0.430697904 container create 6003438c7171a3819842fe8d7456d9367e2bc410dc5bcc5f28eca5fa0018c479 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:48:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:17 smithi051 bash[18409]: cluster 2020-06-27T04:48:16.391769+0000 mon.a (mon.0) 1007 : cluster [INF] osd.4 v2:172.21.15.51:6801/2078091771 boot 2020-06-27T04:48:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:17 smithi051 bash[18409]: cluster 2020-06-27T04:48:16.391824+0000 mon.a (mon.0) 1008 : cluster [INF] osd.6 v2:172.21.15.51:6805/1343002872 boot 2020-06-27T04:48:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:17 smithi051 bash[18409]: cluster 2020-06-27T04:48:16.391856+0000 mon.a (mon.0) 1009 : cluster [DBG] osdmap e113: 8 total, 4 up, 8 in 2020-06-27T04:48:17.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:17 smithi051 bash[18409]: audit 2020-06-27T04:48:16.398995+0000 mon.b (mon.2) 298 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:48:17.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:17 smithi051 bash[18409]: audit 2020-06-27T04:48:16.399301+0000 mon.b (mon.2) 299 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:48:17.974 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:17 smithi031 podman[87122]: 2020-06-27 04:48:17.644014331 +0000 UTC m=+0.783643899 container create ea609747ab3e4201c15eeef8d13258b8c89ff2e66e7c4dca6a8aced640a27072 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:48:17.975 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:17 smithi031 podman[86050]: 2020-06-27 04:48:17.699715715 +0000 UTC m=+1.368948943 container died c2d65628b5fd2adedf158dbf2dff42ba071e778f69a18a0fde24aef441611a83 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:48:18.418 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:18 smithi031 podman[87184]: 2020-06-27 04:48:18.084588233 +0000 UTC m=+1.179559287 container init 6003438c7171a3819842fe8d7456d9367e2bc410dc5bcc5f28eca5fa0018c479 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:48:18.419 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[18426]: cluster 2020-06-27T04:48:17.218530+0000 mgr.x (mgr.34109) 254 : cluster [DBG] pgmap v281: 777 pgs: 1 creating+incomplete, 2 creating+down, 38 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 14 down, 33 stale+down, 34 stale+undersized+degraded+peered, 40 stale+active+clean, 8 unknown, 17 active+undersized, 38 stale+active+undersized+degraded, 46 undersized+degraded+peered, 146 stale+undersized+peered, 165 undersized+peered, 168 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:18.419 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[18426]: cluster 2020-06-27T04:48:17.405512+0000 mon.a (mon.0) 1010 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:48:18.419 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[18426]: cluster 2020-06-27T04:48:17.437706+0000 mon.a (mon.0) 1011 : cluster [INF] osd.0 v2:172.21.15.31:6800/1341397229 boot 2020-06-27T04:48:18.420 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[22603]: cluster 2020-06-27T04:48:17.218530+0000 mgr.x (mgr.34109) 254 : cluster [DBG] pgmap v281: 777 pgs: 1 creating+incomplete, 2 creating+down, 38 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 14 down, 33 stale+down, 34 stale+undersized+degraded+peered, 40 stale+active+clean, 8 unknown, 17 active+undersized, 38 stale+active+undersized+degraded, 46 undersized+degraded+peered, 146 stale+undersized+peered, 165 undersized+peered, 168 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:18.420 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[22603]: cluster 2020-06-27T04:48:17.405512+0000 mon.a (mon.0) 1010 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:48:18.420 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[22603]: cluster 2020-06-27T04:48:17.437706+0000 mon.a (mon.0) 1011 : cluster [INF] osd.0 v2:172.21.15.31:6800/1341397229 boot 2020-06-27T04:48:18.421 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[22603]: cluster 2020-06-27T04:48:17.437760+0000 mon.a (mon.0) 1012 : cluster [DBG] osdmap e114: 8 total, 5 up, 8 in 2020-06-27T04:48:18.421 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[22603]: audit 2020-06-27T04:48:17.441330+0000 mon.b (mon.2) 300 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:48:18.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[18409]: cluster 2020-06-27T04:48:17.218530+0000 mgr.x (mgr.34109) 254 : cluster [DBG] pgmap v281: 777 pgs: 1 creating+incomplete, 2 creating+down, 38 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 14 down, 33 stale+down, 34 stale+undersized+degraded+peered, 40 stale+active+clean, 8 unknown, 17 active+undersized, 38 stale+active+undersized+degraded, 46 undersized+degraded+peered, 146 stale+undersized+peered, 165 undersized+peered, 168 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:18.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[18409]: cluster 2020-06-27T04:48:17.405512+0000 mon.a (mon.0) 1010 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:48:18.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[18409]: cluster 2020-06-27T04:48:17.437706+0000 mon.a (mon.0) 1011 : cluster [INF] osd.0 v2:172.21.15.31:6800/1341397229 boot 2020-06-27T04:48:18.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[18409]: cluster 2020-06-27T04:48:17.437760+0000 mon.a (mon.0) 1012 : cluster [DBG] osdmap e114: 8 total, 5 up, 8 in 2020-06-27T04:48:18.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[18409]: audit 2020-06-27T04:48:17.441330+0000 mon.b (mon.2) 300 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:48:18.720 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:18.720 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: in thread 7f6dd0762700 thread_name:tp_osd_tp 2020-06-27T04:48:18.720 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:18.720 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 1: (()+0x12dd0) [0x7f6df756bdd0] 2020-06-27T04:48:18.720 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x556f3f273707] 2020-06-27T04:48:18.721 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x556f3f273aa0] 2020-06-27T04:48:18.721 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x556f3f2a567a] 2020-06-27T04:48:18.721 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x556f3f2a6a57] 2020-06-27T04:48:18.721 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x556f3ef31938] 2020-06-27T04:48:18.721 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x556f3f0e5a70] 2020-06-27T04:48:18.722 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x556f3f0f5dd7] 2020-06-27T04:48:18.722 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x556f3ef64252] 2020-06-27T04:48:18.722 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x556f3ef07e2e] 2020-06-27T04:48:18.722 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x556f3ed884e9] 2020-06-27T04:48:18.722 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x556f3efecf78] 2020-06-27T04:48:18.723 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x556f3eda770f] 2020-06-27T04:48:18.723 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x556f3f3e5b94] 2020-06-27T04:48:18.723 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x556f3f3e87f4] 2020-06-27T04:48:18.723 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 16: (()+0x82de) [0x7f6df75612de] 2020-06-27T04:48:18.723 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 17: (clone()+0x43) [0x7f6df6298e83] 2020-06-27T04:48:18.724 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: debug 2020-06-27T04:48:18.533+0000 7f6dd0762700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:18.724 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: in thread 7f6dd0762700 thread_name:tp_osd_tp 2020-06-27T04:48:18.724 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:18.724 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 1: (()+0x12dd0) [0x7f6df756bdd0] 2020-06-27T04:48:18.724 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x556f3f273707] 2020-06-27T04:48:18.724 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x556f3f273aa0] 2020-06-27T04:48:18.725 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x556f3f2a567a] 2020-06-27T04:48:18.725 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x556f3f2a6a57] 2020-06-27T04:48:18.725 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x556f3ef31938] 2020-06-27T04:48:18.725 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x556f3f0e5a70] 2020-06-27T04:48:18.725 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x556f3f0f5dd7] 2020-06-27T04:48:18.726 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x556f3ef64252] 2020-06-27T04:48:18.726 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x556f3ef07e2e] 2020-06-27T04:48:18.726 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x556f3ed884e9] 2020-06-27T04:48:18.726 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x556f3efecf78] 2020-06-27T04:48:18.726 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x556f3eda770f] 2020-06-27T04:48:18.727 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x556f3f3e5b94] 2020-06-27T04:48:18.727 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x556f3f3e87f4] 2020-06-27T04:48:18.727 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 16: (()+0x82de) [0x7f6df75612de] 2020-06-27T04:48:18.727 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 17: (clone()+0x43) [0x7f6df6298e83] 2020-06-27T04:48:18.727 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:18.727 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: debug -9999> 2020-06-27T04:48:18.533+0000 7f6dd0762700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:18.728 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: in thread 7f6dd0762700 thread_name:tp_osd_tp 2020-06-27T04:48:18.728 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:18.728 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 1: (()+0x12dd0) [0x7f6df756bdd0] 2020-06-27T04:48:18.728 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x556f3f273707] 2020-06-27T04:48:18.728 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x556f3f273aa0] 2020-06-27T04:48:18.729 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x556f3f2a567a] 2020-06-27T04:48:18.729 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x556f3f2a6a57] 2020-06-27T04:48:18.729 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x556f3ef31938] 2020-06-27T04:48:18.729 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x556f3f0e5a70] 2020-06-27T04:48:18.729 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x556f3f0f5dd7] 2020-06-27T04:48:18.730 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x556f3ef64252] 2020-06-27T04:48:18.730 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x556f3ef07e2e] 2020-06-27T04:48:18.730 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x556f3ed884e9] 2020-06-27T04:48:18.730 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x556f3efecf78] 2020-06-27T04:48:18.730 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x556f3eda770f] 2020-06-27T04:48:18.731 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x556f3f3e5b94] 2020-06-27T04:48:18.731 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x556f3f3e87f4] 2020-06-27T04:48:18.731 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 16: (()+0x82de) [0x7f6df75612de] 2020-06-27T04:48:18.731 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 17: (clone()+0x43) [0x7f6df6298e83] 2020-06-27T04:48:18.731 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:18.732 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: debug -9999> 2020-06-27T04:48:18.533+0000 7f6dd0762700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:18.732 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: in thread 7f6dd0762700 thread_name:tp_osd_tp 2020-06-27T04:48:18.732 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:18.732 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 1: (()+0x12dd0) [0x7f6df756bdd0] 2020-06-27T04:48:18.732 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x556f3f273707] 2020-06-27T04:48:18.732 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x556f3f273aa0] 2020-06-27T04:48:18.733 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x556f3f2a567a] 2020-06-27T04:48:18.733 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x556f3f2a6a57] 2020-06-27T04:48:18.733 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x556f3ef31938] 2020-06-27T04:48:18.733 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x556f3f0e5a70] 2020-06-27T04:48:18.733 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x556f3f0f5dd7] 2020-06-27T04:48:18.734 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x556f3ef64252] 2020-06-27T04:48:18.734 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x556f3ef07e2e] 2020-06-27T04:48:18.734 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x556f3ed884e9] 2020-06-27T04:48:18.734 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x556f3efecf78] 2020-06-27T04:48:18.735 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x556f3eda770f] 2020-06-27T04:48:18.735 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x556f3f3e5b94] 2020-06-27T04:48:18.735 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x556f3f3e87f4] 2020-06-27T04:48:18.735 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 16: (()+0x82de) [0x7f6df75612de] 2020-06-27T04:48:18.735 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: 17: (clone()+0x43) [0x7f6df6298e83] 2020-06-27T04:48:18.736 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:18.736 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37661]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:18.736 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:18 smithi051 podman[38079]: 2020-06-27 04:48:18.622727522 +0000 UTC m=+4.369870446 container died c2fc550e7fff5a3e62d637c3329a60bd6b38d9a794168e94b2080b683bd48fc9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:48:18.736 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:18.736 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: in thread 7f1653c20700 thread_name:tp_osd_tp 2020-06-27T04:48:18.737 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:18.737 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 1: (()+0x12dd0) [0x7f167aa29dd0] 2020-06-27T04:48:18.737 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x563a9dfcf707] 2020-06-27T04:48:18.737 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x563a9dfcfaa0] 2020-06-27T04:48:18.737 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x563a9e00167a] 2020-06-27T04:48:18.738 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x563a9e002a57] 2020-06-27T04:48:18.738 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x563a9dc8d938] 2020-06-27T04:48:18.738 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x563a9de3e03d] 2020-06-27T04:48:18.738 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x563a9dbfb5b0] 2020-06-27T04:48:18.738 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x563a9dc5489d] 2020-06-27T04:48:18.738 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x563a9dc5d380] 2020-06-27T04:48:18.739 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x563a9dc64590] 2020-06-27T04:48:18.739 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x563a9dae44e9] 2020-06-27T04:48:18.739 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x563a9dd48f78] 2020-06-27T04:48:18.739 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x563a9db0370f] 2020-06-27T04:48:18.739 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x563a9e141b94] 2020-06-27T04:48:18.740 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x563a9e1447f4] 2020-06-27T04:48:18.740 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 17: (()+0x82de) [0x7f167aa1f2de] 2020-06-27T04:48:18.740 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 18: (clone()+0x43) [0x7f1679756e83] 2020-06-27T04:48:18.740 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: debug 2020-06-27T04:48:18.533+0000 7f1653c20700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:18.741 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: in thread 7f1653c20700 thread_name:tp_osd_tp 2020-06-27T04:48:18.741 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:18.741 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 1: (()+0x12dd0) [0x7f167aa29dd0] 2020-06-27T04:48:18.741 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x563a9dfcf707] 2020-06-27T04:48:18.741 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x563a9dfcfaa0] 2020-06-27T04:48:18.742 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x563a9e00167a] 2020-06-27T04:48:18.742 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x563a9e002a57] 2020-06-27T04:48:18.742 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x563a9dc8d938] 2020-06-27T04:48:18.742 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x563a9de3e03d] 2020-06-27T04:48:18.742 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x563a9dbfb5b0] 2020-06-27T04:48:18.743 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x563a9dc5489d] 2020-06-27T04:48:18.743 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x563a9dc5d380] 2020-06-27T04:48:18.743 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x563a9dc64590] 2020-06-27T04:48:18.743 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x563a9dae44e9] 2020-06-27T04:48:18.743 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x563a9dd48f78] 2020-06-27T04:48:18.743 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x563a9db0370f] 2020-06-27T04:48:18.744 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x563a9e141b94] 2020-06-27T04:48:18.744 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x563a9e1447f4] 2020-06-27T04:48:18.744 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 17: (()+0x82de) [0x7f167aa1f2de] 2020-06-27T04:48:18.744 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 18: (clone()+0x43) [0x7f1679756e83] 2020-06-27T04:48:18.744 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:18.745 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: debug -9999> 2020-06-27T04:48:18.533+0000 7f1653c20700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:18.745 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: in thread 7f1653c20700 thread_name:tp_osd_tp 2020-06-27T04:48:18.745 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:18.745 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 1: (()+0x12dd0) [0x7f167aa29dd0] 2020-06-27T04:48:18.746 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x563a9dfcf707] 2020-06-27T04:48:18.746 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x563a9dfcfaa0] 2020-06-27T04:48:18.747 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x563a9e00167a] 2020-06-27T04:48:18.747 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x563a9e002a57] 2020-06-27T04:48:18.748 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x563a9dc8d938] 2020-06-27T04:48:18.748 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x563a9de3e03d] 2020-06-27T04:48:18.748 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x563a9dbfb5b0] 2020-06-27T04:48:18.749 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x563a9dc5489d] 2020-06-27T04:48:18.749 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x563a9dc5d380] 2020-06-27T04:48:18.749 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x563a9dc64590] 2020-06-27T04:48:18.749 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x563a9dae44e9] 2020-06-27T04:48:18.749 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x563a9dd48f78] 2020-06-27T04:48:18.750 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x563a9db0370f] 2020-06-27T04:48:18.750 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x563a9e141b94] 2020-06-27T04:48:18.750 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x563a9e1447f4] 2020-06-27T04:48:18.750 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 17: (()+0x82de) [0x7f167aa1f2de] 2020-06-27T04:48:18.750 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 18: (clone()+0x43) [0x7f1679756e83] 2020-06-27T04:48:18.750 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:18.751 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: debug -9999> 2020-06-27T04:48:18.533+0000 7f1653c20700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:18.751 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: in thread 7f1653c20700 thread_name:tp_osd_tp 2020-06-27T04:48:18.751 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:18.751 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 1: (()+0x12dd0) [0x7f167aa29dd0] 2020-06-27T04:48:18.751 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x563a9dfcf707] 2020-06-27T04:48:18.752 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x563a9dfcfaa0] 2020-06-27T04:48:18.752 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x563a9e00167a] 2020-06-27T04:48:18.752 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x563a9e002a57] 2020-06-27T04:48:18.752 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x563a9dc8d938] 2020-06-27T04:48:18.752 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x563a9de3e03d] 2020-06-27T04:48:18.753 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x563a9dbfb5b0] 2020-06-27T04:48:18.753 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x563a9dc5489d] 2020-06-27T04:48:18.753 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x563a9dc5d380] 2020-06-27T04:48:18.753 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x563a9dc64590] 2020-06-27T04:48:18.753 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x563a9dae44e9] 2020-06-27T04:48:18.753 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x563a9dd48f78] 2020-06-27T04:48:18.754 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x563a9db0370f] 2020-06-27T04:48:18.754 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x563a9e141b94] 2020-06-27T04:48:18.754 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x563a9e1447f4] 2020-06-27T04:48:18.754 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 17: (()+0x82de) [0x7f167aa1f2de] 2020-06-27T04:48:18.754 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: 18: (clone()+0x43) [0x7f1679756e83] 2020-06-27T04:48:18.755 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:18.755 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 bash[37743]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:18.756 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[18426]: cluster 2020-06-27T04:48:17.437760+0000 mon.a (mon.0) 1012 : cluster [DBG] osdmap e114: 8 total, 5 up, 8 in 2020-06-27T04:48:18.756 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[18426]: audit 2020-06-27T04:48:17.441330+0000 mon.b (mon.2) 300 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:48:18.756 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:18.756 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: in thread 7f8df51f7700 thread_name:tp_osd_tp 2020-06-27T04:48:18.757 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:18.757 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 1: (()+0x12dd0) [0x7f8e1c000dd0] 2020-06-27T04:48:18.757 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55d467d49707] 2020-06-27T04:48:18.757 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55d467d49aa0] 2020-06-27T04:48:18.757 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55d467d7b67a] 2020-06-27T04:48:18.758 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55d467d7ca57] 2020-06-27T04:48:18.758 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55d467a07938] 2020-06-27T04:48:18.758 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55d467bbba70] 2020-06-27T04:48:18.758 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55d467bcbdd7] 2020-06-27T04:48:18.758 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55d467a3a252] 2020-06-27T04:48:18.759 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55d4679dde2e] 2020-06-27T04:48:18.759 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55d46785e4e9] 2020-06-27T04:48:18.759 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55d467ac2f78] 2020-06-27T04:48:18.759 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55d46787d70f] 2020-06-27T04:48:18.759 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55d467ebbb94] 2020-06-27T04:48:18.759 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55d467ebe7f4] 2020-06-27T04:48:18.760 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 16: (()+0x82de) [0x7f8e1bff62de] 2020-06-27T04:48:18.760 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 17: (clone()+0x43) [0x7f8e1ad2de83] 2020-06-27T04:48:18.760 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: debug 2020-06-27T04:48:18.582+0000 7f8df51f7700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:18.760 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: in thread 7f8df51f7700 thread_name:tp_osd_tp 2020-06-27T04:48:18.760 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:18.761 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 1: (()+0x12dd0) [0x7f8e1c000dd0] 2020-06-27T04:48:18.761 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55d467d49707] 2020-06-27T04:48:18.761 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55d467d49aa0] 2020-06-27T04:48:18.761 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55d467d7b67a] 2020-06-27T04:48:18.761 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55d467d7ca57] 2020-06-27T04:48:18.761 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55d467a07938] 2020-06-27T04:48:18.762 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55d467bbba70] 2020-06-27T04:48:18.762 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55d467bcbdd7] 2020-06-27T04:48:18.762 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55d467a3a252] 2020-06-27T04:48:18.762 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55d4679dde2e] 2020-06-27T04:48:18.762 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55d46785e4e9] 2020-06-27T04:48:18.763 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55d467ac2f78] 2020-06-27T04:48:18.763 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55d46787d70f] 2020-06-27T04:48:18.763 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55d467ebbb94] 2020-06-27T04:48:18.763 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55d467ebe7f4] 2020-06-27T04:48:18.763 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 16: (()+0x82de) [0x7f8e1bff62de] 2020-06-27T04:48:18.764 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 17: (clone()+0x43) [0x7f8e1ad2de83] 2020-06-27T04:48:18.764 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:18.764 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: debug 0> 2020-06-27T04:48:18.582+0000 7f8df51f7700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:18.764 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: in thread 7f8df51f7700 thread_name:tp_osd_tp 2020-06-27T04:48:18.764 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:18.764 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 1: (()+0x12dd0) [0x7f8e1c000dd0] 2020-06-27T04:48:18.765 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55d467d49707] 2020-06-27T04:48:18.765 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55d467d49aa0] 2020-06-27T04:48:18.765 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55d467d7b67a] 2020-06-27T04:48:18.765 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55d467d7ca57] 2020-06-27T04:48:18.765 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55d467a07938] 2020-06-27T04:48:18.766 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55d467bbba70] 2020-06-27T04:48:18.766 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55d467bcbdd7] 2020-06-27T04:48:18.766 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55d467a3a252] 2020-06-27T04:48:18.766 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55d4679dde2e] 2020-06-27T04:48:18.766 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55d46785e4e9] 2020-06-27T04:48:18.767 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55d467ac2f78] 2020-06-27T04:48:18.767 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55d46787d70f] 2020-06-27T04:48:18.767 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55d467ebbb94] 2020-06-27T04:48:18.767 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55d467ebe7f4] 2020-06-27T04:48:18.767 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 16: (()+0x82de) [0x7f8e1bff62de] 2020-06-27T04:48:18.767 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 17: (clone()+0x43) [0x7f8e1ad2de83] 2020-06-27T04:48:18.768 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:18.768 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: debug -9999> 2020-06-27T04:48:18.582+0000 7f8df51f7700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:18.768 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: in thread 7f8df51f7700 thread_name:tp_osd_tp 2020-06-27T04:48:18.768 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:18.768 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 1: (()+0x12dd0) [0x7f8e1c000dd0] 2020-06-27T04:48:18.769 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55d467d49707] 2020-06-27T04:48:18.769 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55d467d49aa0] 2020-06-27T04:48:18.769 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55d467d7b67a] 2020-06-27T04:48:18.769 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55d467d7ca57] 2020-06-27T04:48:18.769 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55d467a07938] 2020-06-27T04:48:18.769 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55d467bbba70] 2020-06-27T04:48:18.770 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55d467bcbdd7] 2020-06-27T04:48:18.770 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55d467a3a252] 2020-06-27T04:48:18.770 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55d4679dde2e] 2020-06-27T04:48:18.770 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55d46785e4e9] 2020-06-27T04:48:18.770 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55d467ac2f78] 2020-06-27T04:48:18.771 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55d46787d70f] 2020-06-27T04:48:18.771 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55d467ebbb94] 2020-06-27T04:48:18.771 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55d467ebe7f4] 2020-06-27T04:48:18.772 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 16: (()+0x82de) [0x7f8e1bff62de] 2020-06-27T04:48:18.772 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: 17: (clone()+0x43) [0x7f8e1ad2de83] 2020-06-27T04:48:18.772 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:18.772 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[73386]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:18.773 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:18 smithi031 podman[87122]: 2020-06-27 04:48:18.556611214 +0000 UTC m=+1.696240773 container init ea609747ab3e4201c15eeef8d13258b8c89ff2e66e7c4dca6a8aced640a27072 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:48:19.042 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:19 smithi031 podman[80237]: 2020-06-27 04:48:19.03793807 +0000 UTC m=+4.472255787 container died 3cdf8ddfac7d106baf26ec22e8edc0cce118614f71d874f32bdf5131fb022450 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:48:19.042 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:18 smithi031 podman[87122]: 2020-06-27 04:48:18.849516466 +0000 UTC m=+1.989146054 container start ea609747ab3e4201c15eeef8d13258b8c89ff2e66e7c4dca6a8aced640a27072 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:48:19.042 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:18 smithi031 podman[87122]: 2020-06-27 04:48:18.849607463 +0000 UTC m=+1.989237049 container attach ea609747ab3e4201c15eeef8d13258b8c89ff2e66e7c4dca6a8aced640a27072 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:48:19.043 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:18 smithi031 podman[87184]: 2020-06-27 04:48:18.735484927 +0000 UTC m=+1.830455980 container start 6003438c7171a3819842fe8d7456d9367e2bc410dc5bcc5f28eca5fa0018c479 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:48:19.043 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[87159]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-06-27T04:48:19.043 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[87159]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2020-06-27T04:48:19.043 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[87159]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2020-06-27T04:48:19.043 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[87159]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2020-06-27T04:48:19.044 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[87159]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2020-06-27T04:48:19.044 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[87159]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-06-27T04:48:19.044 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:18 smithi031 bash[87159]: --> ceph-volume lvm activate successful for osd ID: 2 2020-06-27T04:48:19.044 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:18 smithi031 podman[87184]: 2020-06-27 04:48:18.735666738 +0000 UTC m=+1.830637810 container attach 6003438c7171a3819842fe8d7456d9367e2bc410dc5bcc5f28eca5fa0018c479 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:48:19.044 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:18 smithi031 podman[87184]: 2020-06-27 04:48:18.861497436 +0000 UTC m=+1.956468487 container died 6003438c7171a3819842fe8d7456d9367e2bc410dc5bcc5f28eca5fa0018c479 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:48:19.045 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:18 smithi031 podman[86050]: 2020-06-27 04:48:18.950909978 +0000 UTC m=+2.620143210 container remove c2d65628b5fd2adedf158dbf2dff42ba071e778f69a18a0fde24aef441611a83 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:48:19.217 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:18 smithi051 podman[38102]: 2020-06-27 04:48:18.721749445 +0000 UTC m=+4.421913445 container died 2adc91fa33a364bb20aacbe2eb988e2ff3fad5075d5a63631d9662ee1489792f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:48:19.457 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[18426]: cluster 2020-06-27T04:48:18.439266+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e115: 8 total, 5 up, 8 in 2020-06-27T04:48:19.457 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[18426]: cluster 2020-06-27T04:48:18.587224+0000 mon.a (mon.0) 1014 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:19.458 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[18426]: cluster 2020-06-27T04:48:18.587283+0000 mon.a (mon.0) 1015 : cluster [INF] osd.6 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:48:19.458 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[18426]: cluster 2020-06-27T04:48:18.587823+0000 mon.a (mon.0) 1016 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-06-27T04:48:19.458 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[18426]: cluster 2020-06-27T04:48:18.587875+0000 mon.a (mon.0) 1017 : cluster [INF] osd.4 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:48:19.458 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[18426]: cluster 2020-06-27T04:48:18.588073+0000 mon.a (mon.0) 1018 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-06-27T04:48:19.458 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[18426]: cluster 2020-06-27T04:48:18.588211+0000 mon.a (mon.0) 1019 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:19.459 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[18426]: cluster 2020-06-27T04:48:18.589398+0000 mon.a (mon.0) 1020 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:19.459 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[18426]: cluster 2020-06-27T04:48:18.589566+0000 mon.a (mon.0) 1021 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-06-27T04:48:19.459 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[18426]: cluster 2020-06-27T04:48:19.380150+0000 mon.a (mon.0) 1022 : cluster [WRN] Health check update: 3 osds down (OSD_DOWN) 2020-06-27T04:48:19.459 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[18426]: cluster 2020-06-27T04:48:19.380224+0000 mon.a (mon.0) 1023 : cluster [WRN] Health check update: Reduced data availability: 29 pgs inactive, 49 pgs down, 2 pgs peering, 1 pg incomplete (PG_AVAILABILITY) 2020-06-27T04:48:19.460 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[87076]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-06-27T04:48:19.460 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[87076]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2020-06-27T04:48:19.460 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[87076]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2020-06-27T04:48:19.460 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[87076]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2020-06-27T04:48:19.460 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[87076]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2020-06-27T04:48:19.461 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[87076]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-06-27T04:48:19.461 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[87076]: --> ceph-volume lvm activate successful for osd ID: 1 2020-06-27T04:48:19.617 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:19 smithi051 podman[38102]: 2020-06-27 04:48:19.614854312 +0000 UTC m=+5.315018316 container remove 2adc91fa33a364bb20aacbe2eb988e2ff3fad5075d5a63631d9662ee1489792f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:48:19.617 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:19 smithi051 bash[18409]: cluster 2020-06-27T04:48:18.439266+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e115: 8 total, 5 up, 8 in 2020-06-27T04:48:19.618 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:19 smithi051 bash[18409]: cluster 2020-06-27T04:48:18.587224+0000 mon.a (mon.0) 1014 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:19.618 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:19 smithi051 bash[18409]: cluster 2020-06-27T04:48:18.587283+0000 mon.a (mon.0) 1015 : cluster [INF] osd.6 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:48:19.618 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:19 smithi051 bash[18409]: cluster 2020-06-27T04:48:18.587823+0000 mon.a (mon.0) 1016 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-06-27T04:48:19.618 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:19 smithi051 bash[18409]: cluster 2020-06-27T04:48:18.587875+0000 mon.a (mon.0) 1017 : cluster [INF] osd.4 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:48:19.619 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:19 smithi051 bash[18409]: cluster 2020-06-27T04:48:18.588073+0000 mon.a (mon.0) 1018 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-06-27T04:48:19.619 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:19 smithi051 bash[18409]: cluster 2020-06-27T04:48:18.588211+0000 mon.a (mon.0) 1019 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:19.619 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:19 smithi051 bash[18409]: cluster 2020-06-27T04:48:18.589398+0000 mon.a (mon.0) 1020 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:19.619 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:19 smithi051 bash[18409]: cluster 2020-06-27T04:48:18.589566+0000 mon.a (mon.0) 1021 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-06-27T04:48:19.619 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:19 smithi051 bash[18409]: cluster 2020-06-27T04:48:19.380150+0000 mon.a (mon.0) 1022 : cluster [WRN] Health check update: 3 osds down (OSD_DOWN) 2020-06-27T04:48:19.619 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:19 smithi051 bash[18409]: cluster 2020-06-27T04:48:19.380224+0000 mon.a (mon.0) 1023 : cluster [WRN] Health check update: Reduced data availability: 29 pgs inactive, 49 pgs down, 2 pgs peering, 1 pg incomplete (PG_AVAILABILITY) 2020-06-27T04:48:19.620 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:19 smithi051 podman[38079]: 2020-06-27 04:48:19.279546713 +0000 UTC m=+5.026689610 container remove c2fc550e7fff5a3e62d637c3329a60bd6b38d9a794168e94b2080b683bd48fc9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:48:19.620 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:19 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:19.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[22603]: cluster 2020-06-27T04:48:18.439266+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e115: 8 total, 5 up, 8 in 2020-06-27T04:48:19.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[22603]: cluster 2020-06-27T04:48:18.587224+0000 mon.a (mon.0) 1014 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:19.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[22603]: cluster 2020-06-27T04:48:18.587283+0000 mon.a (mon.0) 1015 : cluster [INF] osd.6 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:48:19.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[22603]: cluster 2020-06-27T04:48:18.587823+0000 mon.a (mon.0) 1016 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-06-27T04:48:19.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[22603]: cluster 2020-06-27T04:48:18.587875+0000 mon.a (mon.0) 1017 : cluster [INF] osd.4 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:48:19.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[22603]: cluster 2020-06-27T04:48:18.588073+0000 mon.a (mon.0) 1018 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-06-27T04:48:19.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[22603]: cluster 2020-06-27T04:48:18.588211+0000 mon.a (mon.0) 1019 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:19.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[22603]: cluster 2020-06-27T04:48:18.589398+0000 mon.a (mon.0) 1020 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:19.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[22603]: cluster 2020-06-27T04:48:18.589566+0000 mon.a (mon.0) 1021 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-06-27T04:48:19.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[22603]: cluster 2020-06-27T04:48:19.380150+0000 mon.a (mon.0) 1022 : cluster [WRN] Health check update: 3 osds down (OSD_DOWN) 2020-06-27T04:48:19.729 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[22603]: cluster 2020-06-27T04:48:19.380224+0000 mon.a (mon.0) 1023 : cluster [WRN] Health check update: Reduced data availability: 29 pgs inactive, 49 pgs down, 2 pgs peering, 1 pg incomplete (PG_AVAILABILITY) 2020-06-27T04:48:19.729 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:19 smithi031 podman[87122]: 2020-06-27 04:48:19.460958198 +0000 UTC m=+2.600587789 container died ea609747ab3e4201c15eeef8d13258b8c89ff2e66e7c4dca6a8aced640a27072 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:48:19.729 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:19 smithi031 podman[87184]: 2020-06-27 04:48:19.603406551 +0000 UTC m=+2.698377618 container remove 6003438c7171a3819842fe8d7456d9367e2bc410dc5bcc5f28eca5fa0018c479 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:48:19.967 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:19 smithi051 podman[38887]: 2020-06-27 04:48:19.847075191 +0000 UTC m=+0.546006890 container create 37f54059904b53ab6cd501b336e169e9f1c19a8b57702fe94bb3cdc9379d506b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:19.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:19 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:20.158 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[86047]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3 found: no such container 2020-06-27T04:48:20.159 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:19 smithi031 bash[87159]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2 found: no such container 2020-06-27T04:48:20.241 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:20 smithi051 podman[38887]: 2020-06-27 04:48:20.10578005 +0000 UTC m=+0.804711608 container init 37f54059904b53ab6cd501b336e169e9f1c19a8b57702fe94bb3cdc9379d506b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:20.241 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:20 smithi051 podman[38887]: 2020-06-27 04:48:20.172468144 +0000 UTC m=+0.871399702 container start 37f54059904b53ab6cd501b336e169e9f1c19a8b57702fe94bb3cdc9379d506b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:20.242 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:20 smithi051 podman[38887]: 2020-06-27 04:48:20.172596416 +0000 UTC m=+0.871527976 container attach 37f54059904b53ab6cd501b336e169e9f1c19a8b57702fe94bb3cdc9379d506b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:20.242 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:20 smithi051 podman[38911]: 2020-06-27 04:48:20.030789333 +0000 UTC m=+0.398961363 container create f42e6d1bc326f62620ab5f8370d40e395c2080b84d31c215a6d3c29ef2f83022 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:20.242 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:20 smithi051 podman[38911]: 2020-06-27 04:48:20.239081576 +0000 UTC m=+0.607253623 container init f42e6d1bc326f62620ab5f8370d40e395c2080b84d31c215a6d3c29ef2f83022 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:20.456 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:20 smithi031 podman[87122]: 2020-06-27 04:48:20.249312512 +0000 UTC m=+3.388942083 container remove ea609747ab3e4201c15eeef8d13258b8c89ff2e66e7c4dca6a8aced640a27072 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:48:20.457 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:20 smithi031 bash[87159]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2 2020-06-27T04:48:20.457 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:20 smithi031 bash[87159]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2" found: no such container 2020-06-27T04:48:20.457 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:20 smithi031 bash[86047]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3 2020-06-27T04:48:20.457 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:20 smithi031 bash[86047]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3" found: no such container 2020-06-27T04:48:20.458 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:20 smithi031 podman[80237]: 2020-06-27 04:48:20.156392021 +0000 UTC m=+5.590709766 container remove 3cdf8ddfac7d106baf26ec22e8edc0cce118614f71d874f32bdf5131fb022450 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:48:20.458 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:20 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:20.519 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:20 smithi051 podman[38887]: 2020-06-27 04:48:20.396692763 +0000 UTC m=+1.095624345 container died 37f54059904b53ab6cd501b336e169e9f1c19a8b57702fe94bb3cdc9379d506b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:20.519 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:20 smithi051 bash[18409]: cluster 2020-06-27T04:48:19.219415+0000 mgr.x (mgr.34109) 255 : cluster [DBG] pgmap v284: 777 pgs: 1 creating+incomplete, 2 creating+down, 38 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 14 down, 33 stale+down, 34 stale+undersized+degraded+peered, 40 stale+active+clean, 8 unknown, 17 active+undersized, 38 stale+active+undersized+degraded, 46 undersized+degraded+peered, 146 stale+undersized+peered, 165 undersized+peered, 168 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:20.519 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:20 smithi051 bash[18409]: cluster 2020-06-27T04:48:19.454830+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e116: 8 total, 3 up, 8 in 2020-06-27T04:48:20.520 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:20 smithi051 podman[38911]: 2020-06-27 04:48:20.27246086 +0000 UTC m=+0.640632908 container start f42e6d1bc326f62620ab5f8370d40e395c2080b84d31c215a6d3c29ef2f83022 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:20.520 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:20 smithi051 podman[38911]: 2020-06-27 04:48:20.272531466 +0000 UTC m=+0.640703505 container attach f42e6d1bc326f62620ab5f8370d40e395c2080b84d31c215a6d3c29ef2f83022 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:20.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:20 smithi031 bash[22603]: cluster 2020-06-27T04:48:19.219415+0000 mgr.x (mgr.34109) 255 : cluster [DBG] pgmap v284: 777 pgs: 1 creating+incomplete, 2 creating+down, 38 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 14 down, 33 stale+down, 34 stale+undersized+degraded+peered, 40 stale+active+clean, 8 unknown, 17 active+undersized, 38 stale+active+undersized+degraded, 46 undersized+degraded+peered, 146 stale+undersized+peered, 165 undersized+peered, 168 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:20.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:20 smithi031 bash[22603]: cluster 2020-06-27T04:48:19.454830+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e116: 8 total, 3 up, 8 in 2020-06-27T04:48:20.725 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:20 smithi031 podman[96646]: 2020-06-27 04:48:20.526868678 +0000 UTC m=+0.339763433 container create 4ad8a72e8d0125fe54962a613c6a6bb1d4572f668d312dbfa46a7339d7331f56 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:48:20.725 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:20 smithi031 bash[87076]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1 found: no such container 2020-06-27T04:48:20.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:20 smithi031 bash[18426]: cluster 2020-06-27T04:48:19.219415+0000 mgr.x (mgr.34109) 255 : cluster [DBG] pgmap v284: 777 pgs: 1 creating+incomplete, 2 creating+down, 38 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 14 down, 33 stale+down, 34 stale+undersized+degraded+peered, 40 stale+active+clean, 8 unknown, 17 active+undersized, 38 stale+active+undersized+degraded, 46 undersized+degraded+peered, 146 stale+undersized+peered, 165 undersized+peered, 168 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:20.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:20 smithi031 bash[18426]: cluster 2020-06-27T04:48:19.454830+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e116: 8 total, 3 up, 8 in 2020-06-27T04:48:20.950 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:20 smithi051 podman[38911]: 2020-06-27 04:48:20.667624901 +0000 UTC m=+1.035796957 container died f42e6d1bc326f62620ab5f8370d40e395c2080b84d31c215a6d3c29ef2f83022 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:20.951 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:20 smithi051 podman[38887]: 2020-06-27 04:48:20.947979289 +0000 UTC m=+1.646910880 container remove 37f54059904b53ab6cd501b336e169e9f1c19a8b57702fe94bb3cdc9379d506b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:21.004 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:20 smithi031 bash[87076]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1 2020-06-27T04:48:21.004 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:20 smithi031 bash[87076]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1" found: no such container 2020-06-27T04:48:21.005 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:20 smithi031 podman[96646]: 2020-06-27 04:48:20.849063168 +0000 UTC m=+0.661957954 container init 4ad8a72e8d0125fe54962a613c6a6bb1d4572f668d312dbfa46a7339d7331f56 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:48:21.005 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:20 smithi031 podman[97101]: 2020-06-27 04:48:20.918492936 +0000 UTC m=+0.634119531 container create dbf36f62014aa7cf4f789de4897cfdf8da5d7a0348429f97c4227e9dba2b042d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:48:21.217 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:21 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Failed with result 'exit-code'. 2020-06-27T04:48:21.276 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:21 smithi031 podman[96646]: 2020-06-27 04:48:21.001779996 +0000 UTC m=+0.814674778 container start 4ad8a72e8d0125fe54962a613c6a6bb1d4572f668d312dbfa46a7339d7331f56 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:48:21.277 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:21 smithi031 podman[96646]: 2020-06-27 04:48:21.001858867 +0000 UTC m=+0.814753687 container attach 4ad8a72e8d0125fe54962a613c6a6bb1d4572f668d312dbfa46a7339d7331f56 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:48:21.277 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:21 smithi031 podman[97096]: 2020-06-27 04:48:21.093463845 +0000 UTC m=+0.798811843 container create 38ccb48d50be10fe9c1b32d3031b440977f3b702320d38d7e3d0441f904380a9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:48:21.717 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:21 smithi051 podman[38911]: 2020-06-27 04:48:21.283040697 +0000 UTC m=+1.651212737 container remove f42e6d1bc326f62620ab5f8370d40e395c2080b84d31c215a6d3c29ef2f83022 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:21.718 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:21 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2020-06-27T04:48:21.721 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:21 smithi031 podman[96646]: 2020-06-27 04:48:21.415376125 +0000 UTC m=+1.228270933 container died 4ad8a72e8d0125fe54962a613c6a6bb1d4572f668d312dbfa46a7339d7331f56 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:48:21.722 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:21 smithi031 podman[97101]: 2020-06-27 04:48:21.393705324 +0000 UTC m=+1.109331919 container init dbf36f62014aa7cf4f789de4897cfdf8da5d7a0348429f97c4227e9dba2b042d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:48:21.722 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:21 smithi031 podman[97101]: 2020-06-27 04:48:21.718347908 +0000 UTC m=+1.433974497 container start dbf36f62014aa7cf4f789de4897cfdf8da5d7a0348429f97c4227e9dba2b042d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:48:21.722 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:21 smithi031 podman[97101]: 2020-06-27 04:48:21.718450523 +0000 UTC m=+1.434077114 container attach dbf36f62014aa7cf4f789de4897cfdf8da5d7a0348429f97c4227e9dba2b042d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:48:21.973 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:21 smithi031 bash[86047]: debug 2020-06-27T04:48:21.795+0000 7fa9fe3bdf40 -1 Falling back to public interface 2020-06-27T04:48:21.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:21 smithi031 podman[97096]: 2020-06-27 04:48:21.918912148 +0000 UTC m=+1.624260137 container init 38ccb48d50be10fe9c1b32d3031b440977f3b702320d38d7e3d0441f904380a9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:48:22.370 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:22 smithi031 podman[96646]: 2020-06-27 04:48:22.213087423 +0000 UTC m=+2.025982213 container remove 4ad8a72e8d0125fe54962a613c6a6bb1d4572f668d312dbfa46a7339d7331f56 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:48:22.370 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:22 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2020-06-27T04:48:22.370 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:22 smithi031 podman[99184]: 2020-06-27 04:48:22.107819694 +0000 UTC m=+1.082470409 container create b51fb71cab17e8dab19bf4a92577bc1b08a5e7c4f314e689dea14556725ac910 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:48:22.371 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:22 smithi031 podman[97096]: 2020-06-27 04:48:22.211987653 +0000 UTC m=+1.917335644 container start 38ccb48d50be10fe9c1b32d3031b440977f3b702320d38d7e3d0441f904380a9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:48:22.371 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:22 smithi031 podman[97096]: 2020-06-27 04:48:22.212070139 +0000 UTC m=+1.917418107 container attach 38ccb48d50be10fe9c1b32d3031b440977f3b702320d38d7e3d0441f904380a9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:48:22.371 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:22 smithi031 bash[87159]: debug 2020-06-27T04:48:22.316+0000 7f1977cfcf40 -1 Falling back to public interface 2020-06-27T04:48:22.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:22 smithi031 bash[18426]: cluster 2020-06-27T04:48:21.220459+0000 mgr.x (mgr.34109) 256 : cluster [DBG] pgmap v286: 777 pgs: 1 creating+incomplete, 2 creating+down, 38 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 14 down, 33 stale+down, 34 stale+undersized+degraded+peered, 40 stale+active+clean, 8 unknown, 17 active+undersized, 38 stale+active+undersized+degraded, 46 undersized+degraded+peered, 146 stale+undersized+peered, 165 undersized+peered, 168 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:22.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:22 smithi031 bash[22603]: cluster 2020-06-27T04:48:21.220459+0000 mgr.x (mgr.34109) 256 : cluster [DBG] pgmap v286: 777 pgs: 1 creating+incomplete, 2 creating+down, 38 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 14 down, 33 stale+down, 34 stale+undersized+degraded+peered, 40 stale+active+clean, 8 unknown, 17 active+undersized, 38 stale+active+undersized+degraded, 46 undersized+degraded+peered, 146 stale+undersized+peered, 165 undersized+peered, 168 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:22.725 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:22 smithi031 podman[99184]: 2020-06-27 04:48:22.401538391 +0000 UTC m=+1.376189113 container init b51fb71cab17e8dab19bf4a92577bc1b08a5e7c4f314e689dea14556725ac910 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:48:22.726 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:22 smithi031 podman[99184]: 2020-06-27 04:48:22.468675147 +0000 UTC m=+1.443325871 container start b51fb71cab17e8dab19bf4a92577bc1b08a5e7c4f314e689dea14556725ac910 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:48:22.726 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:22 smithi031 podman[99184]: 2020-06-27 04:48:22.468782387 +0000 UTC m=+1.443433219 container attach b51fb71cab17e8dab19bf4a92577bc1b08a5e7c4f314e689dea14556725ac910 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:48:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:22 smithi051 bash[18409]: cluster 2020-06-27T04:48:21.220459+0000 mgr.x (mgr.34109) 256 : cluster [DBG] pgmap v286: 777 pgs: 1 creating+incomplete, 2 creating+down, 38 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 14 down, 33 stale+down, 34 stale+undersized+degraded+peered, 40 stale+active+clean, 8 unknown, 17 active+undersized, 38 stale+active+undersized+degraded, 46 undersized+degraded+peered, 146 stale+undersized+peered, 165 undersized+peered, 168 stale+active+undersized; 23 KiB data, 15 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:23.223 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:22 smithi031 bash[87076]: debug 2020-06-27T04:48:22.994+0000 7f80ee537f40 -1 Falling back to public interface 2020-06-27T04:48:23.223 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:22 smithi031 bash[86047]: debug 2020-06-27T04:48:22.869+0000 7fa9fe3bdf40 -1 osd.3 105 log_to_monitors {default=true} 2020-06-27T04:48:23.249 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:22 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:23.250 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:22 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Scheduled restart job, restart counter is at 4. 2020-06-27T04:48:23.250 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:22 smithi051 systemd[1]: Stopped Ceph osd.5 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:23.250 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:22 smithi051 systemd[1]: Starting Ceph osd.5 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:48:23.250 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:23 smithi051 podman[39041]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5 found: no such container 2020-06-27T04:48:23.250 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:23 smithi051 systemd[1]: Started Ceph osd.5 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:23.638 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:23 smithi051 bash[18409]: audit 2020-06-27T04:48:22.901309+0000 mon.a (mon.0) 1025 : audit [INF] from='osd.3 v2:172.21.15.31:6800/416313240' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:48:23.639 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:23 smithi051 bash[18409]: audit 2020-06-27T04:48:22.905277+0000 mon.a (mon.0) 1026 : audit [INF] from='osd.3 v2:172.21.15.31:6800/416313240' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:23.639 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:23 smithi051 bash[18409]: audit 2020-06-27T04:48:23.393083+0000 mon.a (mon.0) 1027 : audit [INF] from='osd.2 v2:172.21.15.31:6804/3596790524' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:48:23.640 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:23 smithi051 bash[18409]: audit 2020-06-27T04:48:23.393759+0000 mon.a (mon.0) 1028 : audit [INF] from='osd.2 v2:172.21.15.31:6804/3596790524' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:23.645 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:23 smithi051 podman[39057]: 2020-06-27 04:48:23.246938635 +0000 UTC m=+0.222103271 container create f1259ed2ff5a36a575cc7aa3138726d008090e007c5c5433aa21b7f10c44e468 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:48:23.645 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:23 smithi051 podman[39057]: 2020-06-27 04:48:23.371922634 +0000 UTC m=+0.347087275 container init f1259ed2ff5a36a575cc7aa3138726d008090e007c5c5433aa21b7f10c44e468 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:48:23.645 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:23 smithi051 podman[39057]: 2020-06-27 04:48:23.405284275 +0000 UTC m=+0.380448933 container start f1259ed2ff5a36a575cc7aa3138726d008090e007c5c5433aa21b7f10c44e468 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:48:23.645 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:23 smithi051 podman[39057]: 2020-06-27 04:48:23.405355644 +0000 UTC m=+0.380520328 container attach f1259ed2ff5a36a575cc7aa3138726d008090e007c5c5433aa21b7f10c44e468 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:48:23.724 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:23 smithi031 bash[87159]: debug 2020-06-27T04:48:23.363+0000 7f1977cfcf40 -1 osd.2 105 log_to_monitors {default=true} 2020-06-27T04:48:23.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:23 smithi031 bash[18426]: audit 2020-06-27T04:48:22.901309+0000 mon.a (mon.0) 1025 : audit [INF] from='osd.3 v2:172.21.15.31:6800/416313240' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:48:23.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:23 smithi031 bash[18426]: audit 2020-06-27T04:48:22.905277+0000 mon.a (mon.0) 1026 : audit [INF] from='osd.3 v2:172.21.15.31:6800/416313240' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:23.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:23 smithi031 bash[18426]: audit 2020-06-27T04:48:23.393083+0000 mon.a (mon.0) 1027 : audit [INF] from='osd.2 v2:172.21.15.31:6804/3596790524' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:48:23.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:23 smithi031 bash[18426]: audit 2020-06-27T04:48:23.393759+0000 mon.a (mon.0) 1028 : audit [INF] from='osd.2 v2:172.21.15.31:6804/3596790524' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:23.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:23 smithi031 bash[22603]: audit 2020-06-27T04:48:22.901309+0000 mon.a (mon.0) 1025 : audit [INF] from='osd.3 v2:172.21.15.31:6800/416313240' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:48:23.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:23 smithi031 bash[22603]: audit 2020-06-27T04:48:22.905277+0000 mon.a (mon.0) 1026 : audit [INF] from='osd.3 v2:172.21.15.31:6800/416313240' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:23.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:23 smithi031 bash[22603]: audit 2020-06-27T04:48:23.393083+0000 mon.a (mon.0) 1027 : audit [INF] from='osd.2 v2:172.21.15.31:6804/3596790524' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:48:23.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:23 smithi031 bash[22603]: audit 2020-06-27T04:48:23.393759+0000 mon.a (mon.0) 1028 : audit [INF] from='osd.2 v2:172.21.15.31:6804/3596790524' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:23.967 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:23 smithi051 bash[39055]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-06-27T04:48:23.968 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:23 smithi051 bash[39055]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2020-06-27T04:48:23.968 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:23 smithi051 bash[39055]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2020-06-27T04:48:23.968 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:23 smithi051 bash[39055]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2020-06-27T04:48:23.968 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:23 smithi051 bash[39055]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2020-06-27T04:48:23.969 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:23 smithi051 bash[39055]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-06-27T04:48:23.969 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:23 smithi051 bash[39055]: --> ceph-volume lvm activate successful for osd ID: 5 2020-06-27T04:48:23.969 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:23 smithi051 podman[39057]: 2020-06-27 04:48:23.720585601 +0000 UTC m=+0.695750247 container died f1259ed2ff5a36a575cc7aa3138726d008090e007c5c5433aa21b7f10c44e468 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:48:24.477 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[87076]: debug 2020-06-27T04:48:24.166+0000 7f80ee537f40 -1 osd.1 105 log_to_monitors {default=true} 2020-06-27T04:48:24.502 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:24 smithi051 podman[39057]: 2020-06-27 04:48:24.221389853 +0000 UTC m=+1.196554514 container remove f1259ed2ff5a36a575cc7aa3138726d008090e007c5c5433aa21b7f10c44e468 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:48:24.503 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[39055]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5 found: no such container 2020-06-27T04:48:24.503 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[39055]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5 2020-06-27T04:48:24.503 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[39055]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5" found: no such container 2020-06-27T04:48:24.504 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:24 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:24.504 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:24 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Scheduled restart job, restart counter is at 3. 2020-06-27T04:48:24.504 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:24 smithi051 systemd[1]: Stopped Ceph osd.7 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:24.504 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:24 smithi051 systemd[1]: Starting Ceph osd.7 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:48:24.504 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:24 smithi051 podman[39137]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7 found: no such container 2020-06-27T04:48:24.505 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:24 smithi051 systemd[1]: Started Ceph osd.7 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:24.760 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:24 smithi051 podman[39168]: 2020-06-27 04:48:24.581940874 +0000 UTC m=+0.301699954 container create e870fa5a86c934fa6d6e98692151f00acd38446a66fac45955489f0b7c6fe334 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:48:24.763 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: cluster 2020-06-27T04:48:23.221533+0000 mgr.x (mgr.34109) 257 : cluster [DBG] pgmap v287: 777 pgs: 8 activating+undersized, 1 creating+incomplete, 2 creating+down, 43 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 1 creating+activating+undersized, 16 down, 31 stale+down, 21 stale+undersized+degraded+peered, 39 stale+active+clean, 8 unknown, 17 active+undersized, 38 stale+active+undersized+degraded, 57 undersized+degraded+peered, 92 stale+undersized+peered, 212 undersized+peered, 164 stale+active+undersized; 23 KiB data, 16 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:24.763 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: cluster 2020-06-27T04:48:23.467263+0000 mon.a (mon.0) 1029 : cluster [WRN] Health check update: Degraded data redundancy: 487/1041 objects degraded (46.782%), 124 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:24.764 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: cluster 2020-06-27T04:48:23.475133+0000 mon.a (mon.0) 1030 : cluster [INF] osd.3 v2:172.21.15.31:6800/416313240 boot 2020-06-27T04:48:24.764 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: cluster 2020-06-27T04:48:23.475211+0000 mon.a (mon.0) 1031 : cluster [DBG] osdmap e117: 8 total, 4 up, 8 in 2020-06-27T04:48:24.765 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: audit 2020-06-27T04:48:23.475282+0000 mon.b (mon.2) 301 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:48:24.765 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: cluster 2020-06-27T04:48:23.510883+0000 mon.a (mon.0) 1032 : cluster [DBG] osd.5 reported immediately failed by osd.3 2020-06-27T04:48:24.765 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: cluster 2020-06-27T04:48:23.510932+0000 mon.a (mon.0) 1033 : cluster [INF] osd.5 failed (root=default,host=smithi051) (connection refused reported by osd.3) 2020-06-27T04:48:24.765 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: cluster 2020-06-27T04:48:23.512424+0000 mon.a (mon.0) 1034 : cluster [DBG] osd.7 reported immediately failed by osd.3 2020-06-27T04:48:24.765 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: cluster 2020-06-27T04:48:23.512454+0000 mon.a (mon.0) 1035 : cluster [INF] osd.7 failed (root=default,host=smithi051) (connection refused reported by osd.3) 2020-06-27T04:48:24.766 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: audit 2020-06-27T04:48:24.183405+0000 mon.b (mon.2) 302 : audit [INF] from='osd.1 v2:172.21.15.31:6808/1799996534' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:48:24.766 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: audit 2020-06-27T04:48:24.186405+0000 mon.a (mon.0) 1036 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:48:24.766 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: audit 2020-06-27T04:48:24.194362+0000 mon.b (mon.2) 303 : audit [INF] from='osd.1 v2:172.21.15.31:6808/1799996534' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:24.766 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: audit 2020-06-27T04:48:24.195437+0000 mon.a (mon.0) 1037 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:24.766 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: cluster 2020-06-27T04:48:24.381834+0000 mon.a (mon.0) 1038 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:48:24.767 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: cluster 2020-06-27T04:48:24.474599+0000 mon.a (mon.0) 1039 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:48:24.767 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: cluster 2020-06-27T04:48:24.481793+0000 mon.a (mon.0) 1040 : cluster [INF] osd.2 v2:172.21.15.31:6804/3596790524 boot 2020-06-27T04:48:24.768 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: cluster 2020-06-27T04:48:24.481993+0000 mon.a (mon.0) 1041 : cluster [INF] osd.1 v2:172.21.15.31:6808/1799996534 boot 2020-06-27T04:48:24.768 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: cluster 2020-06-27T04:48:24.482043+0000 mon.a (mon.0) 1042 : cluster [DBG] osdmap e118: 8 total, 4 up, 8 in 2020-06-27T04:48:24.768 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: audit 2020-06-27T04:48:24.482436+0000 mon.b (mon.2) 304 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:48:24.768 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:24 smithi051 bash[18409]: audit 2020-06-27T04:48:24.482606+0000 mon.b (mon.2) 305 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:48:24.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: cluster 2020-06-27T04:48:23.221533+0000 mgr.x (mgr.34109) 257 : cluster [DBG] pgmap v287: 777 pgs: 8 activating+undersized, 1 creating+incomplete, 2 creating+down, 43 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 1 creating+activating+undersized, 16 down, 31 stale+down, 21 stale+undersized+degraded+peered, 39 stale+active+clean, 8 unknown, 17 active+undersized, 38 stale+active+undersized+degraded, 57 undersized+degraded+peered, 92 stale+undersized+peered, 212 undersized+peered, 164 stale+active+undersized; 23 KiB data, 16 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:24.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: cluster 2020-06-27T04:48:23.467263+0000 mon.a (mon.0) 1029 : cluster [WRN] Health check update: Degraded data redundancy: 487/1041 objects degraded (46.782%), 124 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:24.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: cluster 2020-06-27T04:48:23.475133+0000 mon.a (mon.0) 1030 : cluster [INF] osd.3 v2:172.21.15.31:6800/416313240 boot 2020-06-27T04:48:24.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: cluster 2020-06-27T04:48:23.475211+0000 mon.a (mon.0) 1031 : cluster [DBG] osdmap e117: 8 total, 4 up, 8 in 2020-06-27T04:48:24.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: audit 2020-06-27T04:48:23.475282+0000 mon.b (mon.2) 301 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:48:24.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: cluster 2020-06-27T04:48:23.510883+0000 mon.a (mon.0) 1032 : cluster [DBG] osd.5 reported immediately failed by osd.3 2020-06-27T04:48:24.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: cluster 2020-06-27T04:48:23.510932+0000 mon.a (mon.0) 1033 : cluster [INF] osd.5 failed (root=default,host=smithi051) (connection refused reported by osd.3) 2020-06-27T04:48:24.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: cluster 2020-06-27T04:48:23.512424+0000 mon.a (mon.0) 1034 : cluster [DBG] osd.7 reported immediately failed by osd.3 2020-06-27T04:48:24.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: cluster 2020-06-27T04:48:23.512454+0000 mon.a (mon.0) 1035 : cluster [INF] osd.7 failed (root=default,host=smithi051) (connection refused reported by osd.3) 2020-06-27T04:48:24.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: audit 2020-06-27T04:48:24.183405+0000 mon.b (mon.2) 302 : audit [INF] from='osd.1 v2:172.21.15.31:6808/1799996534' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:48:24.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: audit 2020-06-27T04:48:24.186405+0000 mon.a (mon.0) 1036 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:48:24.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: audit 2020-06-27T04:48:24.194362+0000 mon.b (mon.2) 303 : audit [INF] from='osd.1 v2:172.21.15.31:6808/1799996534' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:24.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: audit 2020-06-27T04:48:24.195437+0000 mon.a (mon.0) 1037 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:24.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: cluster 2020-06-27T04:48:24.381834+0000 mon.a (mon.0) 1038 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:48:24.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: cluster 2020-06-27T04:48:24.474599+0000 mon.a (mon.0) 1039 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:48:24.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: cluster 2020-06-27T04:48:24.481793+0000 mon.a (mon.0) 1040 : cluster [INF] osd.2 v2:172.21.15.31:6804/3596790524 boot 2020-06-27T04:48:24.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: cluster 2020-06-27T04:48:24.481993+0000 mon.a (mon.0) 1041 : cluster [INF] osd.1 v2:172.21.15.31:6808/1799996534 boot 2020-06-27T04:48:24.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: cluster 2020-06-27T04:48:24.482043+0000 mon.a (mon.0) 1042 : cluster [DBG] osdmap e118: 8 total, 4 up, 8 in 2020-06-27T04:48:24.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: audit 2020-06-27T04:48:24.482436+0000 mon.b (mon.2) 304 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:48:24.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[18426]: audit 2020-06-27T04:48:24.482606+0000 mon.b (mon.2) 305 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:48:24.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: cluster 2020-06-27T04:48:23.221533+0000 mgr.x (mgr.34109) 257 : cluster [DBG] pgmap v287: 777 pgs: 8 activating+undersized, 1 creating+incomplete, 2 creating+down, 43 peering, 19 stale+creating+peering, 8 active+undersized+degraded, 1 creating+activating+undersized, 16 down, 31 stale+down, 21 stale+undersized+degraded+peered, 39 stale+active+clean, 8 unknown, 17 active+undersized, 38 stale+active+undersized+degraded, 57 undersized+degraded+peered, 92 stale+undersized+peered, 212 undersized+peered, 164 stale+active+undersized; 23 KiB data, 16 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:24.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: cluster 2020-06-27T04:48:23.467263+0000 mon.a (mon.0) 1029 : cluster [WRN] Health check update: Degraded data redundancy: 487/1041 objects degraded (46.782%), 124 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:24.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: cluster 2020-06-27T04:48:23.475133+0000 mon.a (mon.0) 1030 : cluster [INF] osd.3 v2:172.21.15.31:6800/416313240 boot 2020-06-27T04:48:24.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: cluster 2020-06-27T04:48:23.475211+0000 mon.a (mon.0) 1031 : cluster [DBG] osdmap e117: 8 total, 4 up, 8 in 2020-06-27T04:48:24.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: audit 2020-06-27T04:48:23.475282+0000 mon.b (mon.2) 301 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:48:24.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: cluster 2020-06-27T04:48:23.510883+0000 mon.a (mon.0) 1032 : cluster [DBG] osd.5 reported immediately failed by osd.3 2020-06-27T04:48:24.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: cluster 2020-06-27T04:48:23.510932+0000 mon.a (mon.0) 1033 : cluster [INF] osd.5 failed (root=default,host=smithi051) (connection refused reported by osd.3) 2020-06-27T04:48:24.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: cluster 2020-06-27T04:48:23.512424+0000 mon.a (mon.0) 1034 : cluster [DBG] osd.7 reported immediately failed by osd.3 2020-06-27T04:48:24.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: cluster 2020-06-27T04:48:23.512454+0000 mon.a (mon.0) 1035 : cluster [INF] osd.7 failed (root=default,host=smithi051) (connection refused reported by osd.3) 2020-06-27T04:48:24.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: audit 2020-06-27T04:48:24.183405+0000 mon.b (mon.2) 302 : audit [INF] from='osd.1 v2:172.21.15.31:6808/1799996534' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:48:24.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: audit 2020-06-27T04:48:24.186405+0000 mon.a (mon.0) 1036 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:48:24.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: audit 2020-06-27T04:48:24.194362+0000 mon.b (mon.2) 303 : audit [INF] from='osd.1 v2:172.21.15.31:6808/1799996534' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:24.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: audit 2020-06-27T04:48:24.195437+0000 mon.a (mon.0) 1037 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:24.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: cluster 2020-06-27T04:48:24.381834+0000 mon.a (mon.0) 1038 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:48:24.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: cluster 2020-06-27T04:48:24.474599+0000 mon.a (mon.0) 1039 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:48:24.981 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: cluster 2020-06-27T04:48:24.481793+0000 mon.a (mon.0) 1040 : cluster [INF] osd.2 v2:172.21.15.31:6804/3596790524 boot 2020-06-27T04:48:24.981 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: cluster 2020-06-27T04:48:24.481993+0000 mon.a (mon.0) 1041 : cluster [INF] osd.1 v2:172.21.15.31:6808/1799996534 boot 2020-06-27T04:48:24.981 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: cluster 2020-06-27T04:48:24.482043+0000 mon.a (mon.0) 1042 : cluster [DBG] osdmap e118: 8 total, 4 up, 8 in 2020-06-27T04:48:24.981 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: audit 2020-06-27T04:48:24.482436+0000 mon.b (mon.2) 304 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:48:24.981 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:24 smithi031 bash[22603]: audit 2020-06-27T04:48:24.482606+0000 mon.b (mon.2) 305 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:48:25.040 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:24 smithi051 podman[39168]: 2020-06-27 04:48:24.888357653 +0000 UTC m=+0.608116737 container init e870fa5a86c934fa6d6e98692151f00acd38446a66fac45955489f0b7c6fe334 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:48:25.041 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:24 smithi051 podman[39168]: 2020-06-27 04:48:24.921726975 +0000 UTC m=+0.641486048 container start e870fa5a86c934fa6d6e98692151f00acd38446a66fac45955489f0b7c6fe334 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:48:25.041 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:24 smithi051 podman[39168]: 2020-06-27 04:48:24.921796918 +0000 UTC m=+0.641556007 container attach e870fa5a86c934fa6d6e98692151f00acd38446a66fac45955489f0b7c6fe334 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:48:25.041 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:24 smithi051 podman[39195]: 2020-06-27 04:48:24.788409256 +0000 UTC m=+0.455036523 container create 53f8b0366f3f79cea5e864f836f679790138d611f6729c4e4d85d0517cf391e3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:48:25.041 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:25 smithi051 podman[39195]: 2020-06-27 04:48:25.005037671 +0000 UTC m=+0.671664920 container init 53f8b0366f3f79cea5e864f836f679790138d611f6729c4e4d85d0517cf391e3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:48:25.042 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:25 smithi051 podman[39195]: 2020-06-27 04:48:25.038357777 +0000 UTC m=+0.704985049 container start 53f8b0366f3f79cea5e864f836f679790138d611f6729c4e4d85d0517cf391e3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:48:25.042 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:25 smithi051 podman[39195]: 2020-06-27 04:48:25.038427164 +0000 UTC m=+0.705054460 container attach 53f8b0366f3f79cea5e864f836f679790138d611f6729c4e4d85d0517cf391e3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:48:25.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39055]: debug 2020-06-27T04:48:25.036+0000 7f86772d5f40 1 -- 172.21.15.51:0/1689637553 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55ae6a4e7400 msgr2=0x55ae6a458300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:48:25.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39055]: debug 2020-06-27T04:48:25.036+0000 7f86772d5f40 1 --2- 172.21.15.51:0/1689637553 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55ae6a4e7400 0x55ae6a458300 secure :-1 s=READY pgs=3523 cs=0 l=1 rev1=1 rx=0x55ae6a469a70 tx=0x55ae6a436c00).stop 2020-06-27T04:48:25.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39055]: debug 2020-06-27T04:48:25.036+0000 7f86772d5f40 5 --2- 172.21.15.51:0/1689637553 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55ae6a4e7400 0x55ae6a458300 secure :-1 s=READY pgs=3523 cs=0 l=1 rev1=1 rx=0x55ae6a469a70 tx=0x55ae6a436c00).reset_recv_state 2020-06-27T04:48:25.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39055]: debug 2020-06-27T04:48:25.036+0000 7f86772d5f40 20 Event(0x55ae6a47ae00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:25.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39055]: debug 2020-06-27T04:48:25.036+0000 7f86772d5f40 10 --2- 172.21.15.51:0/1689637553 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55ae6a4e7400 0x55ae6a458300 secure :-1 s=READY pgs=3523 cs=0 l=1 rev1=1 rx=0x55ae6a469a70 tx=0x55ae6a436c00).discard_out_queue started 2020-06-27T04:48:25.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39055]: debug 2020-06-27T04:48:25.036+0000 7f86772d5f40 20 Event(0x55ae6a47ae00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:25.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39055]: debug 2020-06-27T04:48:25.036+0000 7f8671058700 5 --2- 172.21.15.51:0/1689637553 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55ae6a4e7400 0x55ae6a458300 secure :-1 s=CLOSED pgs=3523 cs=0 l=1 rev1=1 rx=0x55ae6a469a70 tx=0x55ae6a436c00).reset_recv_state (warped) reseting crypto handlers 2020-06-27T04:48:25.470 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39055]: debug 2020-06-27T04:48:25.036+0000 7f8671058700 5 --2- 172.21.15.51:0/1689637553 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55ae6a4e7400 0x55ae6a458300 secure :-1 s=CLOSED pgs=3523 cs=0 l=1 rev1=1 rx=0x55ae6a469a70 tx=0x55ae6a436c00).reset_security 2020-06-27T04:48:25.470 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39055]: debug 2020-06-27T04:48:25.036+0000 7f8671058700 20 EpollDriver.del_event del event fd=16 cur_mask=1 delmask=3 to 5 2020-06-27T04:48:25.470 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39162]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-06-27T04:48:25.470 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39162]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2020-06-27T04:48:25.470 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39162]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2020-06-27T04:48:25.471 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39162]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2020-06-27T04:48:25.471 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39162]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2020-06-27T04:48:25.471 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39162]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-06-27T04:48:25.471 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39162]: --> ceph-volume lvm activate successful for osd ID: 7 2020-06-27T04:48:25.471 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:25 smithi051 podman[39168]: 2020-06-27 04:48:25.211579007 +0000 UTC m=+0.931338092 container died e870fa5a86c934fa6d6e98692151f00acd38446a66fac45955489f0b7c6fe334 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:48:25.505 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ OK ] LibRadosMisc.Applications (5100 ms) 2020-06-27T04:48:25.505 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2020-06-27T04:48:25.505 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2020-06-27T04:48:25.505 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2020-06-27T04:48:25.506 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2020-06-27T04:48:25.506 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2020-06-27T04:48:25.506 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (21806 ms) 2020-06-27T04:48:25.506 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [----------] 8 tests from LibRadosMisc (50321 ms total) 2020-06-27T04:48:25.506 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: 2020-06-27T04:48:25.506 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [----------] Global test environment tear-down 2020-06-27T04:48:25.507 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [==========] 11 tests from 4 test suites ran. (88204 ms total) 2020-06-27T04:48:25.507 INFO:tasks.workunit.client.0.smithi031.stdout: api_misc: [ PASSED ] 11 tests. 2020-06-27T04:48:25.967 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39055]: debug 2020-06-27T04:48:25.554+0000 7f86772d5f40 -1 Falling back to public interface 2020-06-27T04:48:25.968 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:25 smithi051 podman[39168]: 2020-06-27 04:48:25.703860621 +0000 UTC m=+1.423619709 container remove e870fa5a86c934fa6d6e98692151f00acd38446a66fac45955489f0b7c6fe334 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:48:25.968 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39162]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7 found: no such container 2020-06-27T04:48:25.968 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39162]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7 2020-06-27T04:48:25.969 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:25 smithi051 bash[39162]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7" found: no such container 2020-06-27T04:48:25.973 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:25.973 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: in thread 7fa9d7b2c700 thread_name:tp_osd_tp 2020-06-27T04:48:25.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:25.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 1: (()+0x12dd0) [0x7fa9fc130dd0] 2020-06-27T04:48:25.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5625b5c0c707] 2020-06-27T04:48:25.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5625b5c0caa0] 2020-06-27T04:48:25.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5625b5c3e67a] 2020-06-27T04:48:25.975 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5625b5c3fa57] 2020-06-27T04:48:25.975 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5625b58ca938] 2020-06-27T04:48:25.975 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5625b5a7b03d] 2020-06-27T04:48:25.975 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5625b58385b0] 2020-06-27T04:48:25.975 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5625b589189d] 2020-06-27T04:48:25.976 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5625b589a380] 2020-06-27T04:48:25.976 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5625b58a1590] 2020-06-27T04:48:25.976 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5625b57214e9] 2020-06-27T04:48:25.976 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5625b5985f78] 2020-06-27T04:48:25.976 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5625b574070f] 2020-06-27T04:48:25.977 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5625b5d7eb94] 2020-06-27T04:48:25.977 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5625b5d817f4] 2020-06-27T04:48:25.977 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 17: (()+0x82de) [0x7fa9fc1262de] 2020-06-27T04:48:25.977 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 18: (clone()+0x43) [0x7fa9fae5de83] 2020-06-27T04:48:25.977 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: debug 2020-06-27T04:48:25.588+0000 7fa9d7b2c700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:25.977 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: in thread 7fa9d7b2c700 thread_name:tp_osd_tp 2020-06-27T04:48:25.978 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:25.978 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 1: (()+0x12dd0) [0x7fa9fc130dd0] 2020-06-27T04:48:25.978 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5625b5c0c707] 2020-06-27T04:48:25.978 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5625b5c0caa0] 2020-06-27T04:48:25.978 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5625b5c3e67a] 2020-06-27T04:48:25.979 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5625b5c3fa57] 2020-06-27T04:48:25.979 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5625b58ca938] 2020-06-27T04:48:25.979 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5625b5a7b03d] 2020-06-27T04:48:25.979 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5625b58385b0] 2020-06-27T04:48:25.979 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5625b589189d] 2020-06-27T04:48:25.980 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5625b589a380] 2020-06-27T04:48:25.980 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5625b58a1590] 2020-06-27T04:48:25.980 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5625b57214e9] 2020-06-27T04:48:25.980 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5625b5985f78] 2020-06-27T04:48:25.980 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5625b574070f] 2020-06-27T04:48:25.981 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5625b5d7eb94] 2020-06-27T04:48:25.981 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5625b5d817f4] 2020-06-27T04:48:25.981 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 17: (()+0x82de) [0x7fa9fc1262de] 2020-06-27T04:48:25.981 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 18: (clone()+0x43) [0x7fa9fae5de83] 2020-06-27T04:48:25.982 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:25.982 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: debug -153> 2020-06-27T04:48:25.588+0000 7fa9d7b2c700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:25.982 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: in thread 7fa9d7b2c700 thread_name:tp_osd_tp 2020-06-27T04:48:25.982 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:25.982 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 1: (()+0x12dd0) [0x7fa9fc130dd0] 2020-06-27T04:48:25.983 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5625b5c0c707] 2020-06-27T04:48:25.983 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5625b5c0caa0] 2020-06-27T04:48:25.983 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:25.983 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: in thread 7f194d463700 thread_name:tp_osd_tp 2020-06-27T04:48:25.984 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:25.984 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 1: (()+0x12dd0) [0x7f1975a6fdd0] 2020-06-27T04:48:25.984 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55dafd98e707] 2020-06-27T04:48:25.984 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55dafd98eaa0] 2020-06-27T04:48:25.984 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55dafd9c067a] 2020-06-27T04:48:25.985 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55dafd9c1a57] 2020-06-27T04:48:25.985 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55dafd64c938] 2020-06-27T04:48:25.985 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55dafd800a70] 2020-06-27T04:48:25.985 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55dafd810dd7] 2020-06-27T04:48:25.985 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55dafd67f252] 2020-06-27T04:48:25.986 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55dafd622e2e] 2020-06-27T04:48:25.986 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55dafd4a34e9] 2020-06-27T04:48:25.986 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55dafd707f78] 2020-06-27T04:48:25.986 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55dafd4c270f] 2020-06-27T04:48:25.986 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55dafdb00b94] 2020-06-27T04:48:25.987 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55dafdb037f4] 2020-06-27T04:48:25.987 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 16: (()+0x82de) [0x7f1975a652de] 2020-06-27T04:48:25.987 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 17: (clone()+0x43) [0x7f197479ce83] 2020-06-27T04:48:25.987 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: debug 2020-06-27T04:48:25.598+0000 7f194d463700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:25.987 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: in thread 7f194d463700 thread_name:tp_osd_tp 2020-06-27T04:48:25.988 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:25.988 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 1: (()+0x12dd0) [0x7f1975a6fdd0] 2020-06-27T04:48:25.988 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55dafd98e707] 2020-06-27T04:48:25.988 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55dafd98eaa0] 2020-06-27T04:48:25.988 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55dafd9c067a] 2020-06-27T04:48:25.989 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55dafd9c1a57] 2020-06-27T04:48:25.989 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55dafd64c938] 2020-06-27T04:48:25.989 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55dafd800a70] 2020-06-27T04:48:25.989 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55dafd810dd7] 2020-06-27T04:48:25.990 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55dafd67f252] 2020-06-27T04:48:25.990 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55dafd622e2e] 2020-06-27T04:48:25.990 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55dafd4a34e9] 2020-06-27T04:48:25.990 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55dafd707f78] 2020-06-27T04:48:25.990 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55dafd4c270f] 2020-06-27T04:48:25.991 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55dafdb00b94] 2020-06-27T04:48:25.991 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55dafdb037f4] 2020-06-27T04:48:25.997 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 16: (()+0x82de) [0x7f1975a652de] 2020-06-27T04:48:25.997 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 17: (clone()+0x43) [0x7f197479ce83] 2020-06-27T04:48:25.997 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:25.998 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: debug 0> 2020-06-27T04:48:25.598+0000 7f194d463700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:25.998 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: in thread 7f194d463700 thread_name:tp_osd_tp 2020-06-27T04:48:26.002 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:26.002 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 1: (()+0x12dd0) [0x7f1975a6fdd0] 2020-06-27T04:48:26.002 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55dafd98e707] 2020-06-27T04:48:26.002 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55dafd98eaa0] 2020-06-27T04:48:26.003 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55dafd9c067a] 2020-06-27T04:48:26.003 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55dafd9c1a57] 2020-06-27T04:48:26.003 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55dafd64c938] 2020-06-27T04:48:26.003 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55dafd800a70] 2020-06-27T04:48:26.003 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55dafd810dd7] 2020-06-27T04:48:26.004 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5625b5c3e67a] 2020-06-27T04:48:26.004 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5625b5c3fa57] 2020-06-27T04:48:26.005 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5625b58ca938] 2020-06-27T04:48:26.005 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5625b5a7b03d] 2020-06-27T04:48:26.005 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5625b58385b0] 2020-06-27T04:48:26.005 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5625b589189d] 2020-06-27T04:48:26.006 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5625b589a380] 2020-06-27T04:48:26.006 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5625b58a1590] 2020-06-27T04:48:26.006 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5625b57214e9] 2020-06-27T04:48:26.006 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5625b5985f78] 2020-06-27T04:48:26.006 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5625b574070f] 2020-06-27T04:48:26.006 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5625b5d7eb94] 2020-06-27T04:48:26.007 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5625b5d817f4] 2020-06-27T04:48:26.007 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 17: (()+0x82de) [0x7fa9fc1262de] 2020-06-27T04:48:26.007 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 18: (clone()+0x43) [0x7fa9fae5de83] 2020-06-27T04:48:26.009 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:26.009 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: debug -9999> 2020-06-27T04:48:25.588+0000 7fa9d7b2c700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:26.009 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: in thread 7fa9d7b2c700 thread_name:tp_osd_tp 2020-06-27T04:48:26.009 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:26.009 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 1: (()+0x12dd0) [0x7fa9fc130dd0] 2020-06-27T04:48:26.010 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5625b5c0c707] 2020-06-27T04:48:26.010 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5625b5c0caa0] 2020-06-27T04:48:26.010 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5625b5c3e67a] 2020-06-27T04:48:26.010 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5625b5c3fa57] 2020-06-27T04:48:26.010 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5625b58ca938] 2020-06-27T04:48:26.011 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5625b5a7b03d] 2020-06-27T04:48:26.011 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5625b58385b0] 2020-06-27T04:48:26.011 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5625b589189d] 2020-06-27T04:48:26.011 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5625b589a380] 2020-06-27T04:48:26.011 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5625b58a1590] 2020-06-27T04:48:26.013 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5625b57214e9] 2020-06-27T04:48:26.014 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5625b5985f78] 2020-06-27T04:48:26.014 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5625b574070f] 2020-06-27T04:48:26.014 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5625b5d7eb94] 2020-06-27T04:48:26.014 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5625b5d817f4] 2020-06-27T04:48:26.014 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 17: (()+0x82de) [0x7fa9fc1262de] 2020-06-27T04:48:26.015 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: 18: (clone()+0x43) [0x7fa9fae5de83] 2020-06-27T04:48:26.015 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:26.015 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[86047]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:26.015 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:25 smithi031 podman[97101]: 2020-06-27 04:48:25.678433847 +0000 UTC m=+5.394060423 container died dbf36f62014aa7cf4f789de4897cfdf8da5d7a0348429f97c4227e9dba2b042d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:48:26.015 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55dafd67f252] 2020-06-27T04:48:26.016 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55dafd622e2e] 2020-06-27T04:48:26.016 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55dafd4a34e9] 2020-06-27T04:48:26.016 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55dafd707f78] 2020-06-27T04:48:26.016 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55dafd4c270f] 2020-06-27T04:48:26.016 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55dafdb00b94] 2020-06-27T04:48:26.017 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55dafdb037f4] 2020-06-27T04:48:26.017 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 16: (()+0x82de) [0x7f1975a652de] 2020-06-27T04:48:26.017 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 17: (clone()+0x43) [0x7f197479ce83] 2020-06-27T04:48:26.017 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:26.017 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: debug -9999> 2020-06-27T04:48:25.598+0000 7f194d463700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:26.017 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: in thread 7f194d463700 thread_name:tp_osd_tp 2020-06-27T04:48:26.018 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:26.018 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 1: (()+0x12dd0) [0x7f1975a6fdd0] 2020-06-27T04:48:26.019 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55dafd98e707] 2020-06-27T04:48:26.019 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55dafd98eaa0] 2020-06-27T04:48:26.019 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55dafd9c067a] 2020-06-27T04:48:26.019 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55dafd9c1a57] 2020-06-27T04:48:26.019 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55dafd64c938] 2020-06-27T04:48:26.019 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55dafd800a70] 2020-06-27T04:48:26.020 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55dafd810dd7] 2020-06-27T04:48:26.020 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55dafd67f252] 2020-06-27T04:48:26.020 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55dafd622e2e] 2020-06-27T04:48:26.020 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55dafd4a34e9] 2020-06-27T04:48:26.020 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55dafd707f78] 2020-06-27T04:48:26.021 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55dafd4c270f] 2020-06-27T04:48:26.021 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55dafdb00b94] 2020-06-27T04:48:26.021 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55dafdb037f4] 2020-06-27T04:48:26.021 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 16: (()+0x82de) [0x7f1975a652de] 2020-06-27T04:48:26.021 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: 17: (clone()+0x43) [0x7f197479ce83] 2020-06-27T04:48:26.022 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:26.024 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 bash[87159]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:26.024 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:25 smithi031 podman[97096]: 2020-06-27 04:48:25.754501815 +0000 UTC m=+5.459849787 container died 38ccb48d50be10fe9c1b32d3031b440977f3b702320d38d7e3d0441f904380a9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:48:26.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39055]: debug 2020-06-27T04:48:26.251+0000 7f86772d5f40 -1 osd.5 111 log_to_monitors {default=true} 2020-06-27T04:48:26.468 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 podman[39360]: 2020-06-27 04:48:26.046579583 +0000 UTC m=+0.249088824 container create becacd7f393ce444b0c33f96290f93204005f72d1b03a0b2755a8201ebfcf05b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:48:26.469 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 podman[39360]: 2020-06-27 04:48:26.171473713 +0000 UTC m=+0.373982974 container init becacd7f393ce444b0c33f96290f93204005f72d1b03a0b2755a8201ebfcf05b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:48:26.469 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 podman[39360]: 2020-06-27 04:48:26.204829767 +0000 UTC m=+0.407339024 container start becacd7f393ce444b0c33f96290f93204005f72d1b03a0b2755a8201ebfcf05b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:48:26.469 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 podman[39360]: 2020-06-27 04:48:26.204898781 +0000 UTC m=+0.407408007 container attach becacd7f393ce444b0c33f96290f93204005f72d1b03a0b2755a8201ebfcf05b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:48:26.469 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 1 -- 172.21.15.51:0/2518102100 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55da29bab000 msgr2=0x55da29b1be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:48:26.469 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 1 --2- 172.21.15.51:0/2518102100 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55da29bab000 0x55da29b1be00 secure :-1 s=READY pgs=3524 cs=0 l=1 rev1=1 rx=0x55da29b2da70 tx=0x55da29afad80).stop 2020-06-27T04:48:26.470 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 5 --2- 172.21.15.51:0/2518102100 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55da29bab000 0x55da29b1be00 secure :-1 s=READY pgs=3524 cs=0 l=1 rev1=1 rx=0x55da29b2da70 tx=0x55da29afad80).reset_recv_state 2020-06-27T04:48:26.470 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 20 Event(0x55da29b3f280 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:26.470 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 10 --2- 172.21.15.51:0/2518102100 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55da29bab000 0x55da29b1be00 secure :-1 s=READY pgs=3524 cs=0 l=1 rev1=1 rx=0x55da29b2da70 tx=0x55da29afad80).discard_out_queue started 2020-06-27T04:48:26.470 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9090004700 20 -- 172.21.15.51:0/2518102100 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55da29bab000 msgr2=0x55da29b1be00 secure :-1 s=STATE_CLOSED l=1).process 2020-06-27T04:48:26.470 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9090004700 20 -- 172.21.15.51:0/2518102100 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55da29bab000 msgr2=0x55da29b1be00 secure :-1 s=STATE_CLOSED l=1).process socket closed 2020-06-27T04:48:26.471 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9090004700 5 --2- 172.21.15.51:0/2518102100 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55da29bab000 0x55da29b1be00 secure :-1 s=CLOSED pgs=3524 cs=0 l=1 rev1=1 rx=0x55da29b2da70 tx=0x55da29afad80).reset_recv_state (warped) reseting crypto handlers 2020-06-27T04:48:26.471 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9090004700 5 --2- 172.21.15.51:0/2518102100 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55da29bab000 0x55da29b1be00 secure :-1 s=CLOSED pgs=3524 cs=0 l=1 rev1=1 rx=0x55da29b2da70 tx=0x55da29afad80).reset_security 2020-06-27T04:48:26.471 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9090004700 20 EpollDriver.del_event del event fd=15 cur_mask=1 delmask=3 to 11 2020-06-27T04:48:26.471 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 10 -- 172.21.15.51:0/2518102100 shutdown 172.21.15.51:0/2518102100 2020-06-27T04:48:26.471 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 10 Processor -- stop 2020-06-27T04:48:26.472 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 20 Event(0x55da29b3ee00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:26.472 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 1 -- 172.21.15.51:0/2518102100 shutdown_connections 2020-06-27T04:48:26.472 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 5 -- 172.21.15.51:0/2518102100 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55da29bab400 2020-06-27T04:48:26.472 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 1 --2- 172.21.15.51:0/2518102100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da29bab400 0x55da29b1c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:26.472 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 5 -- 172.21.15.51:0/2518102100 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55da29baac00 2020-06-27T04:48:26.473 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 1 --2- 172.21.15.51:0/2518102100 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55da29baac00 0x55da29b1b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:26.473 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 5 -- 172.21.15.51:0/2518102100 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55da29bab000 2020-06-27T04:48:26.473 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 1 --2- 172.21.15.51:0/2518102100 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55da29bab000 0x55da29b1be00 unknown :-1 s=CLOSED pgs=3524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:26.473 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 5 -- 172.21.15.51:0/2518102100 shutdown_connections delete 0x55da29baac00 2020-06-27T04:48:26.473 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 5 -- 172.21.15.51:0/2518102100 shutdown_connections delete 0x55da29bab000 2020-06-27T04:48:26.474 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 5 -- 172.21.15.51:0/2518102100 shutdown_connections delete 0x55da29bab400 2020-06-27T04:48:26.474 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 1 -- 172.21.15.51:0/2518102100 >> 172.21.15.51:0/2518102100 conn(0x55da29baa800 msgr2=0x55da29c13000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:48:26.474 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 20 --1- 172.21.15.51:0/2518102100 >> 172.21.15.51:0/2518102100 conn(0x55da29baa800 0x55da29c13000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:26.474 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 2 --1- 172.21.15.51:0/2518102100 >> 172.21.15.51:0/2518102100 conn(0x55da29baa800 0x55da29c13000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:26.474 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 5 --1- 172.21.15.51:0/2518102100 >> 172.21.15.51:0/2518102100 conn(0x55da29baa800 0x55da29c13000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:48:26.475 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 20 Event(0x55da29b3ee00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:26.475 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 10 --1- 172.21.15.51:0/2518102100 >> 172.21.15.51:0/2518102100 conn(0x55da29baa800 0x55da29c13000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:48:26.475 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 20 Event(0x55da29b3f040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:26.475 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 20 Event(0x55da29b3f280 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:26.475 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9091006700 5 --1- 172.21.15.51:0/2518102100 >> 172.21.15.51:0/2518102100 conn(0x55da29baa800 0x55da29c13000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:48:26.476 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9091006700 5 --1- 172.21.15.51:0/2518102100 >> 172.21.15.51:0/2518102100 conn(0x55da29baa800 0x55da29c13000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:48:26.476 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 10 -- 172.21.15.51:0/2518102100 wait: waiting for dispatch queue 2020-06-27T04:48:26.476 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 10 -- 172.21.15.51:0/2518102100 wait: dispatch queue is stopped 2020-06-27T04:48:26.476 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 1 -- 172.21.15.51:0/2518102100 shutdown_connections 2020-06-27T04:48:26.476 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 5 -- 172.21.15.51:0/2518102100 shutdown_connections delete 0x55da29baa800 2020-06-27T04:48:26.477 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 20 Event(0x55da29b3ee00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:26.477 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 20 Event(0x55da29b3f040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:26.477 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 20 Event(0x55da29b3f280 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:26.477 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 10 -- 172.21.15.51:0/2518102100 wait: done. 2020-06-27T04:48:26.477 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.198+0000 7f9097283f40 1 -- 172.21.15.51:0/2518102100 wait complete. 2020-06-27T04:48:26.968 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[39162]: debug 2020-06-27T04:48:26.465+0000 7f9097283f40 -1 Falling back to public interface 2020-06-27T04:48:26.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[18409]: cluster 2020-06-27T04:48:25.222536+0000 mgr.x (mgr.34109) 258 : cluster [DBG] pgmap v290: 777 pgs: 1 stale+creating+incomplete, 2 stale+creating+down, 12 activating+undersized, 31 peering, 19 stale+creating+peering, 1 creating+activating+undersized, 33 down, 14 stale+down, 46 stale+undersized+degraded+peered, 39 stale+active+clean, 8 unknown, 16 stale+peering, 46 stale+active+undersized+degraded, 30 undersized+degraded+peered, 166 stale+undersized+peered, 136 undersized+peered, 177 stale+active+undersized; 23 KiB data, 16 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:26.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[18409]: cluster 2020-06-27T04:48:25.487319+0000 mon.a (mon.0) 1043 : cluster [DBG] osdmap e119: 8 total, 4 up, 8 in 2020-06-27T04:48:26.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[18409]: cluster 2020-06-27T04:48:25.644189+0000 mon.a (mon.0) 1044 : cluster [DBG] osd.3 reported immediately failed by osd.1 2020-06-27T04:48:26.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[18409]: cluster 2020-06-27T04:48:25.644232+0000 mon.a (mon.0) 1045 : cluster [INF] osd.3 failed (root=default,host=smithi031) (connection refused reported by osd.1) 2020-06-27T04:48:26.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[18409]: cluster 2020-06-27T04:48:25.651648+0000 mon.a (mon.0) 1046 : cluster [DBG] osd.2 reported immediately failed by osd.1 2020-06-27T04:48:26.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[18409]: cluster 2020-06-27T04:48:25.651692+0000 mon.a (mon.0) 1047 : cluster [INF] osd.2 failed (root=default,host=smithi031) (connection refused reported by osd.1) 2020-06-27T04:48:26.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[18409]: audit 2020-06-27T04:48:26.256264+0000 mon.b (mon.2) 306 : audit [INF] from='osd.5 v2:172.21.15.51:6801/629884237' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:48:26.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[18409]: audit 2020-06-27T04:48:26.256566+0000 mon.a (mon.0) 1048 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:48:26.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[18409]: audit 2020-06-27T04:48:26.257097+0000 mon.b (mon.2) 307 : audit [INF] from='osd.5 v2:172.21.15.51:6801/629884237' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:26.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:26 smithi051 bash[18409]: audit 2020-06-27T04:48:26.257340+0000 mon.a (mon.0) 1049 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[18426]: cluster 2020-06-27T04:48:25.222536+0000 mgr.x (mgr.34109) 258 : cluster [DBG] pgmap v290: 777 pgs: 1 stale+creating+incomplete, 2 stale+creating+down, 12 activating+undersized, 31 peering, 19 stale+creating+peering, 1 creating+activating+undersized, 33 down, 14 stale+down, 46 stale+undersized+degraded+peered, 39 stale+active+clean, 8 unknown, 16 stale+peering, 46 stale+active+undersized+degraded, 30 undersized+degraded+peered, 166 stale+undersized+peered, 136 undersized+peered, 177 stale+active+undersized; 23 KiB data, 16 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[18426]: cluster 2020-06-27T04:48:25.487319+0000 mon.a (mon.0) 1043 : cluster [DBG] osdmap e119: 8 total, 4 up, 8 in 2020-06-27T04:48:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[18426]: cluster 2020-06-27T04:48:25.644189+0000 mon.a (mon.0) 1044 : cluster [DBG] osd.3 reported immediately failed by osd.1 2020-06-27T04:48:26.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[18426]: cluster 2020-06-27T04:48:25.644232+0000 mon.a (mon.0) 1045 : cluster [INF] osd.3 failed (root=default,host=smithi031) (connection refused reported by osd.1) 2020-06-27T04:48:26.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[18426]: cluster 2020-06-27T04:48:25.651648+0000 mon.a (mon.0) 1046 : cluster [DBG] osd.2 reported immediately failed by osd.1 2020-06-27T04:48:26.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[18426]: cluster 2020-06-27T04:48:25.651692+0000 mon.a (mon.0) 1047 : cluster [INF] osd.2 failed (root=default,host=smithi031) (connection refused reported by osd.1) 2020-06-27T04:48:26.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[18426]: audit 2020-06-27T04:48:26.256264+0000 mon.b (mon.2) 306 : audit [INF] from='osd.5 v2:172.21.15.51:6801/629884237' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:48:26.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[18426]: audit 2020-06-27T04:48:26.256566+0000 mon.a (mon.0) 1048 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:48:26.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[18426]: audit 2020-06-27T04:48:26.257097+0000 mon.b (mon.2) 307 : audit [INF] from='osd.5 v2:172.21.15.51:6801/629884237' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:26.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[18426]: audit 2020-06-27T04:48:26.257340+0000 mon.a (mon.0) 1049 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:26.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[22603]: cluster 2020-06-27T04:48:25.222536+0000 mgr.x (mgr.34109) 258 : cluster [DBG] pgmap v290: 777 pgs: 1 stale+creating+incomplete, 2 stale+creating+down, 12 activating+undersized, 31 peering, 19 stale+creating+peering, 1 creating+activating+undersized, 33 down, 14 stale+down, 46 stale+undersized+degraded+peered, 39 stale+active+clean, 8 unknown, 16 stale+peering, 46 stale+active+undersized+degraded, 30 undersized+degraded+peered, 166 stale+undersized+peered, 136 undersized+peered, 177 stale+active+undersized; 23 KiB data, 16 MiB used, 707 GiB / 715 GiB avail; 487/1041 objects degraded (46.782%) 2020-06-27T04:48:26.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[22603]: cluster 2020-06-27T04:48:25.487319+0000 mon.a (mon.0) 1043 : cluster [DBG] osdmap e119: 8 total, 4 up, 8 in 2020-06-27T04:48:26.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[22603]: cluster 2020-06-27T04:48:25.644189+0000 mon.a (mon.0) 1044 : cluster [DBG] osd.3 reported immediately failed by osd.1 2020-06-27T04:48:26.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[22603]: cluster 2020-06-27T04:48:25.644232+0000 mon.a (mon.0) 1045 : cluster [INF] osd.3 failed (root=default,host=smithi031) (connection refused reported by osd.1) 2020-06-27T04:48:26.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[22603]: cluster 2020-06-27T04:48:25.651648+0000 mon.a (mon.0) 1046 : cluster [DBG] osd.2 reported immediately failed by osd.1 2020-06-27T04:48:26.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[22603]: cluster 2020-06-27T04:48:25.651692+0000 mon.a (mon.0) 1047 : cluster [INF] osd.2 failed (root=default,host=smithi031) (connection refused reported by osd.1) 2020-06-27T04:48:26.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[22603]: audit 2020-06-27T04:48:26.256264+0000 mon.b (mon.2) 306 : audit [INF] from='osd.5 v2:172.21.15.51:6801/629884237' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:48:26.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[22603]: audit 2020-06-27T04:48:26.256566+0000 mon.a (mon.0) 1048 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:48:26.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[22603]: audit 2020-06-27T04:48:26.257097+0000 mon.b (mon.2) 307 : audit [INF] from='osd.5 v2:172.21.15.51:6801/629884237' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:26.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:26 smithi031 bash[22603]: audit 2020-06-27T04:48:26.257340+0000 mon.a (mon.0) 1049 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:27.468 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:48:27 smithi051 bash[39162]: debug 2020-06-27T04:48:27.187+0000 7f9097283f40 -1 osd.7 111 log_to_monitors {default=true} 2020-06-27T04:48:27.746 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[18426]: cluster 2020-06-27T04:48:26.504472+0000 mon.a (mon.0) 1050 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:48:27.747 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[18426]: audit 2020-06-27T04:48:26.509415+0000 mon.b (mon.2) 308 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:48:27.747 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[18426]: cluster 2020-06-27T04:48:26.510770+0000 mon.a (mon.0) 1051 : cluster [INF] osd.5 v2:172.21.15.51:6801/629884237 boot 2020-06-27T04:48:27.747 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[18426]: cluster 2020-06-27T04:48:26.510813+0000 mon.a (mon.0) 1052 : cluster [DBG] osdmap e120: 8 total, 3 up, 8 in 2020-06-27T04:48:27.747 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[18426]: cluster 2020-06-27T04:48:26.520837+0000 mon.a (mon.0) 1053 : cluster [DBG] osd.0 reported immediately failed by osd.5 2020-06-27T04:48:27.747 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[18426]: cluster 2020-06-27T04:48:26.520893+0000 mon.a (mon.0) 1054 : cluster [INF] osd.0 failed (root=default,host=smithi031) (connection refused reported by osd.5) 2020-06-27T04:48:27.748 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[18426]: audit 2020-06-27T04:48:27.192703+0000 mon.b (mon.2) 309 : audit [INF] from='osd.7 v2:172.21.15.51:6805/1590169058' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:48:27.748 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[18426]: audit 2020-06-27T04:48:27.193215+0000 mon.a (mon.0) 1055 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:48:27.748 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[18426]: audit 2020-06-27T04:48:27.193757+0000 mon.b (mon.2) 310 : audit [INF] from='osd.7 v2:172.21.15.51:6805/1590169058' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:27.748 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[18426]: audit 2020-06-27T04:48:27.193995+0000 mon.a (mon.0) 1056 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:27.749 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[22603]: cluster 2020-06-27T04:48:26.504472+0000 mon.a (mon.0) 1050 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:48:27.749 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[22603]: audit 2020-06-27T04:48:26.509415+0000 mon.b (mon.2) 308 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:48:27.749 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[22603]: cluster 2020-06-27T04:48:26.510770+0000 mon.a (mon.0) 1051 : cluster [INF] osd.5 v2:172.21.15.51:6801/629884237 boot 2020-06-27T04:48:27.749 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[22603]: cluster 2020-06-27T04:48:26.510813+0000 mon.a (mon.0) 1052 : cluster [DBG] osdmap e120: 8 total, 3 up, 8 in 2020-06-27T04:48:27.749 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[22603]: cluster 2020-06-27T04:48:26.520837+0000 mon.a (mon.0) 1053 : cluster [DBG] osd.0 reported immediately failed by osd.5 2020-06-27T04:48:27.750 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[22603]: cluster 2020-06-27T04:48:26.520893+0000 mon.a (mon.0) 1054 : cluster [INF] osd.0 failed (root=default,host=smithi031) (connection refused reported by osd.5) 2020-06-27T04:48:27.750 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[22603]: audit 2020-06-27T04:48:27.192703+0000 mon.b (mon.2) 309 : audit [INF] from='osd.7 v2:172.21.15.51:6805/1590169058' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:48:27.750 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[22603]: audit 2020-06-27T04:48:27.193215+0000 mon.a (mon.0) 1055 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:48:27.750 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[22603]: audit 2020-06-27T04:48:27.193757+0000 mon.b (mon.2) 310 : audit [INF] from='osd.7 v2:172.21.15.51:6805/1590169058' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:27.750 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:27 smithi031 bash[22603]: audit 2020-06-27T04:48:27.193995+0000 mon.a (mon.0) 1056 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:27.751 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:27 smithi031 podman[97101]: 2020-06-27 04:48:27.617107448 +0000 UTC m=+7.332734030 container remove dbf36f62014aa7cf4f789de4897cfdf8da5d7a0348429f97c4227e9dba2b042d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:48:27.751 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:27 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:27.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:27 smithi051 bash[18409]: cluster 2020-06-27T04:48:26.504472+0000 mon.a (mon.0) 1050 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:48:27.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:27 smithi051 bash[18409]: audit 2020-06-27T04:48:26.509415+0000 mon.b (mon.2) 308 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:48:27.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:27 smithi051 bash[18409]: cluster 2020-06-27T04:48:26.510770+0000 mon.a (mon.0) 1051 : cluster [INF] osd.5 v2:172.21.15.51:6801/629884237 boot 2020-06-27T04:48:27.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:27 smithi051 bash[18409]: cluster 2020-06-27T04:48:26.510813+0000 mon.a (mon.0) 1052 : cluster [DBG] osdmap e120: 8 total, 3 up, 8 in 2020-06-27T04:48:27.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:27 smithi051 bash[18409]: cluster 2020-06-27T04:48:26.520837+0000 mon.a (mon.0) 1053 : cluster [DBG] osd.0 reported immediately failed by osd.5 2020-06-27T04:48:27.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:27 smithi051 bash[18409]: cluster 2020-06-27T04:48:26.520893+0000 mon.a (mon.0) 1054 : cluster [INF] osd.0 failed (root=default,host=smithi031) (connection refused reported by osd.5) 2020-06-27T04:48:27.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:27 smithi051 bash[18409]: audit 2020-06-27T04:48:27.192703+0000 mon.b (mon.2) 309 : audit [INF] from='osd.7 v2:172.21.15.51:6805/1590169058' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:48:27.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:27 smithi051 bash[18409]: audit 2020-06-27T04:48:27.193215+0000 mon.a (mon.0) 1055 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:48:27.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:27 smithi051 bash[18409]: audit 2020-06-27T04:48:27.193757+0000 mon.b (mon.2) 310 : audit [INF] from='osd.7 v2:172.21.15.51:6805/1590169058' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:27.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:27 smithi051 bash[18409]: audit 2020-06-27T04:48:27.193995+0000 mon.a (mon.0) 1056 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:28.084 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:27 smithi031 podman[97096]: 2020-06-27 04:48:27.744028262 +0000 UTC m=+7.449376247 container remove 38ccb48d50be10fe9c1b32d3031b440977f3b702320d38d7e3d0441f904380a9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:48:28.084 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:27 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:28.085 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:27 smithi031 podman[110808]: 2020-06-27 04:48:27.934875518 +0000 UTC m=+0.294862091 container create 61d115bcdd9796058712e17e1f35893125daf0f5f719847e59eae03e8a9ebcde (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:48:28.366 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:28 smithi031 podman[110824]: 2020-06-27 04:48:28.175563681 +0000 UTC m=+0.413133845 container create 2cb4b30b40b0433d925cc87ad1a030072c0cb7d872e44166353eaaf74bbeb2b6 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:48:28.367 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:28 smithi031 podman[110824]: 2020-06-27 04:48:28.360282075 +0000 UTC m=+0.597852252 container init 2cb4b30b40b0433d925cc87ad1a030072c0cb7d872e44166353eaaf74bbeb2b6 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:48:28.367 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:28 smithi031 podman[110808]: 2020-06-27 04:48:28.250572111 +0000 UTC m=+0.610558687 container init 61d115bcdd9796058712e17e1f35893125daf0f5f719847e59eae03e8a9ebcde (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:48:28.367 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:28 smithi031 podman[110808]: 2020-06-27 04:48:28.292276413 +0000 UTC m=+0.652262873 container start 61d115bcdd9796058712e17e1f35893125daf0f5f719847e59eae03e8a9ebcde (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:48:28.367 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:28 smithi031 podman[110808]: 2020-06-27 04:48:28.292345563 +0000 UTC m=+0.652332062 container attach 61d115bcdd9796058712e17e1f35893125daf0f5f719847e59eae03e8a9ebcde (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:48:28.618 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:28 smithi031 podman[110824]: 2020-06-27 04:48:28.425573769 +0000 UTC m=+0.663143933 container start 2cb4b30b40b0433d925cc87ad1a030072c0cb7d872e44166353eaaf74bbeb2b6 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:48:28.618 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:28 smithi031 podman[110824]: 2020-06-27 04:48:28.425647017 +0000 UTC m=+0.663217210 container attach 2cb4b30b40b0433d925cc87ad1a030072c0cb7d872e44166353eaaf74bbeb2b6 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:48:28.619 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[22603]: cluster 2020-06-27T04:48:27.223993+0000 mgr.x (mgr.34109) 259 : cluster [DBG] pgmap v293: 745 pgs: 3 creating+incomplete, 13 creating+down, 5 stale+activating+undersized, 1 stale+creating+incomplete, 1 stale+creating+down, 52 peering, 19 stale+creating+peering, 153 down, 1 stale+creating+activating+undersized, 39 stale+down, 41 stale+undersized+degraded+peered, 38 stale+active+clean, 5 unknown, 21 stale+peering, 31 stale+active+undersized+degraded, 9 undersized+degraded+peered, 160 stale+undersized+peered, 37 undersized+peered, 116 stale+active+undersized; 22 KiB data, 16 MiB used, 707 GiB / 715 GiB avail; 344/1026 objects degraded (33.528%) 2020-06-27T04:48:28.619 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[22603]: cluster 2020-06-27T04:48:27.506131+0000 mon.a (mon.0) 1057 : cluster [WRN] Health check update: Reduced data availability: 70 pgs inactive, 206 pgs down, 2 pgs peering, 4 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:48:28.619 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[22603]: cluster 2020-06-27T04:48:27.506160+0000 mon.a (mon.0) 1058 : cluster [WRN] Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:48:28.619 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[22603]: cluster 2020-06-27T04:48:27.516922+0000 mon.a (mon.0) 1059 : cluster [INF] osd.7 v2:172.21.15.51:6805/1590169058 boot 2020-06-27T04:48:28.619 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[22603]: cluster 2020-06-27T04:48:27.516968+0000 mon.a (mon.0) 1060 : cluster [DBG] osdmap e121: 8 total, 3 up, 8 in 2020-06-27T04:48:28.620 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[22603]: audit 2020-06-27T04:48:27.556464+0000 mon.b (mon.2) 311 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:48:28.620 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[18426]: cluster 2020-06-27T04:48:27.223993+0000 mgr.x (mgr.34109) 259 : cluster [DBG] pgmap v293: 745 pgs: 3 creating+incomplete, 13 creating+down, 5 stale+activating+undersized, 1 stale+creating+incomplete, 1 stale+creating+down, 52 peering, 19 stale+creating+peering, 153 down, 1 stale+creating+activating+undersized, 39 stale+down, 41 stale+undersized+degraded+peered, 38 stale+active+clean, 5 unknown, 21 stale+peering, 31 stale+active+undersized+degraded, 9 undersized+degraded+peered, 160 stale+undersized+peered, 37 undersized+peered, 116 stale+active+undersized; 22 KiB data, 16 MiB used, 707 GiB / 715 GiB avail; 344/1026 objects degraded (33.528%) 2020-06-27T04:48:28.620 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[18426]: cluster 2020-06-27T04:48:27.506131+0000 mon.a (mon.0) 1057 : cluster [WRN] Health check update: Reduced data availability: 70 pgs inactive, 206 pgs down, 2 pgs peering, 4 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:48:28.620 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[18426]: cluster 2020-06-27T04:48:27.506160+0000 mon.a (mon.0) 1058 : cluster [WRN] Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:48:28.620 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[18426]: cluster 2020-06-27T04:48:27.516922+0000 mon.a (mon.0) 1059 : cluster [INF] osd.7 v2:172.21.15.51:6805/1590169058 boot 2020-06-27T04:48:28.621 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[18426]: cluster 2020-06-27T04:48:27.516968+0000 mon.a (mon.0) 1060 : cluster [DBG] osdmap e121: 8 total, 3 up, 8 in 2020-06-27T04:48:28.621 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[18426]: audit 2020-06-27T04:48:27.556464+0000 mon.b (mon.2) 311 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:48:28.621 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:28 smithi031 podman[110808]: 2020-06-27 04:48:28.57544575 +0000 UTC m=+0.935432244 container died 61d115bcdd9796058712e17e1f35893125daf0f5f719847e59eae03e8a9ebcde (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:48:28.621 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:28.622 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: in thread 7f80c6ca4700 thread_name:tp_osd_tp 2020-06-27T04:48:28.622 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:28.622 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 1: (()+0x12dd0) [0x7f80ec2aadd0] 2020-06-27T04:48:28.622 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5572fb835707] 2020-06-27T04:48:28.622 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5572fb835aa0] 2020-06-27T04:48:28.623 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5572fb86767a] 2020-06-27T04:48:28.623 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5572fb868a57] 2020-06-27T04:48:28.623 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5572fb4f3938] 2020-06-27T04:48:28.623 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5572fb6a7a70] 2020-06-27T04:48:28.623 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5572fb6b7dd7] 2020-06-27T04:48:28.623 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5572fb526252] 2020-06-27T04:48:28.624 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5572fb4c9e2e] 2020-06-27T04:48:28.624 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5572fb34a4e9] 2020-06-27T04:48:28.624 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5572fb5aef78] 2020-06-27T04:48:28.624 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5572fb36970f] 2020-06-27T04:48:28.624 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5572fb9a7b94] 2020-06-27T04:48:28.625 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5572fb9aa7f4] 2020-06-27T04:48:28.625 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 16: (()+0x82de) [0x7f80ec2a02de] 2020-06-27T04:48:28.625 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 17: (clone()+0x43) [0x7f80eafd7e83] 2020-06-27T04:48:28.625 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: debug 2020-06-27T04:48:28.596+0000 7f80c6ca4700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:28.625 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: in thread 7f80c6ca4700 thread_name:tp_osd_tp 2020-06-27T04:48:28.626 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:28.627 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 1: (()+0x12dd0) [0x7f80ec2aadd0] 2020-06-27T04:48:28.627 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5572fb835707] 2020-06-27T04:48:28.627 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5572fb835aa0] 2020-06-27T04:48:28.627 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5572fb86767a] 2020-06-27T04:48:28.628 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5572fb868a57] 2020-06-27T04:48:28.628 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5572fb4f3938] 2020-06-27T04:48:28.628 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5572fb6a7a70] 2020-06-27T04:48:28.628 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5572fb6b7dd7] 2020-06-27T04:48:28.628 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5572fb526252] 2020-06-27T04:48:28.629 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5572fb4c9e2e] 2020-06-27T04:48:28.629 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5572fb34a4e9] 2020-06-27T04:48:28.629 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5572fb5aef78] 2020-06-27T04:48:28.629 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5572fb36970f] 2020-06-27T04:48:28.629 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5572fb9a7b94] 2020-06-27T04:48:28.630 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5572fb9aa7f4] 2020-06-27T04:48:28.630 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 16: (()+0x82de) [0x7f80ec2a02de] 2020-06-27T04:48:28.630 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 17: (clone()+0x43) [0x7f80eafd7e83] 2020-06-27T04:48:28.630 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:28.630 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: debug 0> 2020-06-27T04:48:28.596+0000 7f80c6ca4700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:28.631 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: in thread 7f80c6ca4700 thread_name:tp_osd_tp 2020-06-27T04:48:28.631 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:28.631 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 1: (()+0x12dd0) [0x7f80ec2aadd0] 2020-06-27T04:48:28.631 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5572fb835707] 2020-06-27T04:48:28.631 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5572fb835aa0] 2020-06-27T04:48:28.631 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5572fb86767a] 2020-06-27T04:48:28.632 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5572fb868a57] 2020-06-27T04:48:28.632 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5572fb4f3938] 2020-06-27T04:48:28.632 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5572fb6a7a70] 2020-06-27T04:48:28.632 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5572fb6b7dd7] 2020-06-27T04:48:28.632 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5572fb526252] 2020-06-27T04:48:28.633 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5572fb4c9e2e] 2020-06-27T04:48:28.633 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5572fb34a4e9] 2020-06-27T04:48:28.633 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5572fb5aef78] 2020-06-27T04:48:28.633 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5572fb36970f] 2020-06-27T04:48:28.633 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5572fb9a7b94] 2020-06-27T04:48:28.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[18409]: cluster 2020-06-27T04:48:27.223993+0000 mgr.x (mgr.34109) 259 : cluster [DBG] pgmap v293: 745 pgs: 3 creating+incomplete, 13 creating+down, 5 stale+activating+undersized, 1 stale+creating+incomplete, 1 stale+creating+down, 52 peering, 19 stale+creating+peering, 153 down, 1 stale+creating+activating+undersized, 39 stale+down, 41 stale+undersized+degraded+peered, 38 stale+active+clean, 5 unknown, 21 stale+peering, 31 stale+active+undersized+degraded, 9 undersized+degraded+peered, 160 stale+undersized+peered, 37 undersized+peered, 116 stale+active+undersized; 22 KiB data, 16 MiB used, 707 GiB / 715 GiB avail; 344/1026 objects degraded (33.528%) 2020-06-27T04:48:28.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[18409]: cluster 2020-06-27T04:48:27.506131+0000 mon.a (mon.0) 1057 : cluster [WRN] Health check update: Reduced data availability: 70 pgs inactive, 206 pgs down, 2 pgs peering, 4 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:48:28.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[18409]: cluster 2020-06-27T04:48:27.506160+0000 mon.a (mon.0) 1058 : cluster [WRN] Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:48:28.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[18409]: cluster 2020-06-27T04:48:27.516922+0000 mon.a (mon.0) 1059 : cluster [INF] osd.7 v2:172.21.15.51:6805/1590169058 boot 2020-06-27T04:48:28.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[18409]: cluster 2020-06-27T04:48:27.516968+0000 mon.a (mon.0) 1060 : cluster [DBG] osdmap e121: 8 total, 3 up, 8 in 2020-06-27T04:48:28.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[18409]: audit 2020-06-27T04:48:27.556464+0000 mon.b (mon.2) 311 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:48:28.970 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:28.970 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: in thread 7f864ba3a700 thread_name:tp_osd_tp 2020-06-27T04:48:28.970 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:28.970 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 1: (()+0x12dd0) [0x7f8675048dd0] 2020-06-27T04:48:28.971 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55ae5ed26707] 2020-06-27T04:48:28.971 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55ae5ed26aa0] 2020-06-27T04:48:28.971 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55ae5ed5867a] 2020-06-27T04:48:28.971 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55ae5ed59a57] 2020-06-27T04:48:28.971 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55ae5e9e4938] 2020-06-27T04:48:28.972 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55ae5eb9503d] 2020-06-27T04:48:28.972 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55ae5e9525b0] 2020-06-27T04:48:28.972 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55ae5e9ab89d] 2020-06-27T04:48:28.972 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55ae5e9b4380] 2020-06-27T04:48:28.972 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55ae5e9bb590] 2020-06-27T04:48:28.973 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55ae5e83b4e9] 2020-06-27T04:48:28.973 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55ae5ea9ff78] 2020-06-27T04:48:28.973 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55ae5e85a70f] 2020-06-27T04:48:28.973 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55ae5ee98b94] 2020-06-27T04:48:28.973 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55ae5ee9b7f4] 2020-06-27T04:48:28.974 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 17: (()+0x82de) [0x7f867503e2de] 2020-06-27T04:48:28.974 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 18: (clone()+0x43) [0x7f8673d75e83] 2020-06-27T04:48:28.974 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: debug 2020-06-27T04:48:28.593+0000 7f864ba3a700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:28.974 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: in thread 7f864ba3a700 thread_name:tp_osd_tp 2020-06-27T04:48:28.974 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:28.974 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 1: (()+0x12dd0) [0x7f8675048dd0] 2020-06-27T04:48:28.975 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55ae5ed26707] 2020-06-27T04:48:28.975 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55ae5ed26aa0] 2020-06-27T04:48:28.975 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55ae5ed5867a] 2020-06-27T04:48:28.975 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55ae5ed59a57] 2020-06-27T04:48:28.975 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55ae5e9e4938] 2020-06-27T04:48:28.976 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55ae5eb9503d] 2020-06-27T04:48:28.976 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55ae5e9525b0] 2020-06-27T04:48:28.976 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55ae5e9ab89d] 2020-06-27T04:48:28.976 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55ae5e9b4380] 2020-06-27T04:48:28.976 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55ae5e9bb590] 2020-06-27T04:48:28.977 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55ae5e83b4e9] 2020-06-27T04:48:28.977 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55ae5ea9ff78] 2020-06-27T04:48:28.977 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55ae5e85a70f] 2020-06-27T04:48:28.977 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55ae5ee98b94] 2020-06-27T04:48:28.977 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55ae5ee9b7f4] 2020-06-27T04:48:28.981 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 17: (()+0x82de) [0x7f867503e2de] 2020-06-27T04:48:28.982 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 18: (clone()+0x43) [0x7f8673d75e83] 2020-06-27T04:48:28.982 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:28.982 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: debug -9999> 2020-06-27T04:48:28.593+0000 7f864ba3a700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:28.982 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: in thread 7f864ba3a700 thread_name:tp_osd_tp 2020-06-27T04:48:28.983 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:28.983 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 1: (()+0x12dd0) [0x7f8675048dd0] 2020-06-27T04:48:28.983 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55ae5ed26707] 2020-06-27T04:48:28.983 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55ae5ed26aa0] 2020-06-27T04:48:28.983 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55ae5ed5867a] 2020-06-27T04:48:28.984 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55ae5ed59a57] 2020-06-27T04:48:28.984 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55ae5e9e4938] 2020-06-27T04:48:28.984 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55ae5eb9503d] 2020-06-27T04:48:28.984 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55ae5e9525b0] 2020-06-27T04:48:28.984 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55ae5e9ab89d] 2020-06-27T04:48:28.985 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55ae5e9b4380] 2020-06-27T04:48:28.985 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55ae5e9bb590] 2020-06-27T04:48:28.985 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55ae5e83b4e9] 2020-06-27T04:48:28.985 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55ae5ea9ff78] 2020-06-27T04:48:28.985 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55ae5e85a70f] 2020-06-27T04:48:28.986 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55ae5ee98b94] 2020-06-27T04:48:28.986 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55ae5ee9b7f4] 2020-06-27T04:48:28.986 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 17: (()+0x82de) [0x7f867503e2de] 2020-06-27T04:48:28.986 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 18: (clone()+0x43) [0x7f8673d75e83] 2020-06-27T04:48:28.986 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:28.986 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: debug -9999> 2020-06-27T04:48:28.593+0000 7f864ba3a700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:28.987 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: in thread 7f864ba3a700 thread_name:tp_osd_tp 2020-06-27T04:48:28.987 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:28.987 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 1: (()+0x12dd0) [0x7f8675048dd0] 2020-06-27T04:48:28.987 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55ae5ed26707] 2020-06-27T04:48:28.987 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55ae5ed26aa0] 2020-06-27T04:48:28.988 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55ae5ed5867a] 2020-06-27T04:48:28.988 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55ae5ed59a57] 2020-06-27T04:48:28.988 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55ae5e9e4938] 2020-06-27T04:48:28.988 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55ae5eb9503d] 2020-06-27T04:48:28.988 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55ae5e9525b0] 2020-06-27T04:48:28.989 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55ae5e9ab89d] 2020-06-27T04:48:28.989 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55ae5e9b4380] 2020-06-27T04:48:28.989 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55ae5e9bb590] 2020-06-27T04:48:28.989 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55ae5e83b4e9] 2020-06-27T04:48:28.989 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55ae5ea9ff78] 2020-06-27T04:48:28.991 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55ae5e85a70f] 2020-06-27T04:48:28.991 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55ae5ee98b94] 2020-06-27T04:48:28.991 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55ae5ee9b7f4] 2020-06-27T04:48:28.991 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 17: (()+0x82de) [0x7f867503e2de] 2020-06-27T04:48:28.991 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: 18: (clone()+0x43) [0x7f8673d75e83] 2020-06-27T04:48:28.992 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:28.992 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 bash[39055]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:28.992 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:28 smithi051 podman[39195]: 2020-06-27 04:48:28.700613503 +0000 UTC m=+4.367240785 container died 53f8b0366f3f79cea5e864f836f679790138d611f6729c4e4d85d0517cf391e3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:48:28.993 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:28 smithi031 podman[110824]: 2020-06-27 04:48:28.657334907 +0000 UTC m=+0.894905092 container died 2cb4b30b40b0433d925cc87ad1a030072c0cb7d872e44166353eaaf74bbeb2b6 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:48:28.993 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5572fb9aa7f4] 2020-06-27T04:48:28.993 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 16: (()+0x82de) [0x7f80ec2a02de] 2020-06-27T04:48:28.994 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 17: (clone()+0x43) [0x7f80eafd7e83] 2020-06-27T04:48:28.994 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:28.994 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: debug -9999> 2020-06-27T04:48:28.596+0000 7f80c6ca4700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:28.994 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: in thread 7f80c6ca4700 thread_name:tp_osd_tp 2020-06-27T04:48:28.994 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:28.995 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 1: (()+0x12dd0) [0x7f80ec2aadd0] 2020-06-27T04:48:28.995 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5572fb835707] 2020-06-27T04:48:28.995 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5572fb835aa0] 2020-06-27T04:48:28.995 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5572fb86767a] 2020-06-27T04:48:28.995 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5572fb868a57] 2020-06-27T04:48:28.996 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5572fb4f3938] 2020-06-27T04:48:28.996 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5572fb6a7a70] 2020-06-27T04:48:28.996 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5572fb6b7dd7] 2020-06-27T04:48:28.996 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5572fb526252] 2020-06-27T04:48:28.996 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5572fb4c9e2e] 2020-06-27T04:48:28.997 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5572fb34a4e9] 2020-06-27T04:48:28.997 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5572fb5aef78] 2020-06-27T04:48:28.997 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5572fb36970f] 2020-06-27T04:48:28.997 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5572fb9a7b94] 2020-06-27T04:48:28.997 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5572fb9aa7f4] 2020-06-27T04:48:28.997 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 16: (()+0x82de) [0x7f80ec2a02de] 2020-06-27T04:48:28.998 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: 17: (clone()+0x43) [0x7f80eafd7e83] 2020-06-27T04:48:28.998 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:28.998 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:28 smithi031 bash[87076]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:29.439 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:29 smithi051 podman[39195]: 2020-06-27 04:48:29.141942137 +0000 UTC m=+4.808569421 container remove 53f8b0366f3f79cea5e864f836f679790138d611f6729c4e4d85d0517cf391e3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:48:29.439 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:29 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:29.440 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:29 smithi051 podman[40089]: 2020-06-27 04:48:29.379413132 +0000 UTC m=+0.218345389 container create 063038279a673eee1b0d4da1e1898f0feed5e889e9c593385c5ff94ad2094b16 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:48:29.473 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:29 smithi031 podman[99184]: 2020-06-27 04:48:29.102299058 +0000 UTC m=+8.076949798 container died b51fb71cab17e8dab19bf4a92577bc1b08a5e7c4f314e689dea14556725ac910 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:48:29.718 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:29 smithi051 podman[40089]: 2020-06-27 04:48:29.520946248 +0000 UTC m=+0.359878393 container init 063038279a673eee1b0d4da1e1898f0feed5e889e9c593385c5ff94ad2094b16 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:48:29.718 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:29 smithi051 podman[40089]: 2020-06-27 04:48:29.554312974 +0000 UTC m=+0.393245111 container start 063038279a673eee1b0d4da1e1898f0feed5e889e9c593385c5ff94ad2094b16 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:48:29.718 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:29 smithi051 podman[40089]: 2020-06-27 04:48:29.554389793 +0000 UTC m=+0.393321945 container attach 063038279a673eee1b0d4da1e1898f0feed5e889e9c593385c5ff94ad2094b16 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:48:29.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:29 smithi051 bash[18409]: cluster 2020-06-27T04:48:28.520436+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e122: 8 total, 3 up, 8 in 2020-06-27T04:48:29.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:29 smithi051 bash[18409]: cluster 2020-06-27T04:48:28.635739+0000 mon.a (mon.0) 1062 : cluster [DBG] osd.5 reported immediately failed by osd.7 2020-06-27T04:48:29.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:29 smithi051 bash[18409]: cluster 2020-06-27T04:48:28.635781+0000 mon.a (mon.0) 1063 : cluster [INF] osd.5 failed (root=default,host=smithi051) (connection refused reported by osd.7) 2020-06-27T04:48:29.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:29 smithi051 bash[18409]: cluster 2020-06-27T04:48:29.382655+0000 mon.a (mon.0) 1064 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:48:29.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:29 smithi051 bash[18409]: cluster 2020-06-27T04:48:29.382719+0000 mon.a (mon.0) 1065 : cluster [WRN] Health check update: Degraded data redundancy: 344/1026 objects degraded (33.528%), 81 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:29.890 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:29 smithi031 podman[110808]: 2020-06-27 04:48:29.519372042 +0000 UTC m=+1.879358523 container remove 61d115bcdd9796058712e17e1f35893125daf0f5f719847e59eae03e8a9ebcde (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:48:29.891 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:29 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2020-06-27T04:48:29.891 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:29 smithi031 bash[18426]: cluster 2020-06-27T04:48:28.520436+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e122: 8 total, 3 up, 8 in 2020-06-27T04:48:29.891 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:29 smithi031 bash[18426]: cluster 2020-06-27T04:48:28.635739+0000 mon.a (mon.0) 1062 : cluster [DBG] osd.5 reported immediately failed by osd.7 2020-06-27T04:48:29.891 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:29 smithi031 bash[18426]: cluster 2020-06-27T04:48:28.635781+0000 mon.a (mon.0) 1063 : cluster [INF] osd.5 failed (root=default,host=smithi051) (connection refused reported by osd.7) 2020-06-27T04:48:29.892 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:29 smithi031 bash[18426]: cluster 2020-06-27T04:48:29.382655+0000 mon.a (mon.0) 1064 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:48:29.892 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:29 smithi031 bash[18426]: cluster 2020-06-27T04:48:29.382719+0000 mon.a (mon.0) 1065 : cluster [WRN] Health check update: Degraded data redundancy: 344/1026 objects degraded (33.528%), 81 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:29.892 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:29 smithi031 bash[22603]: cluster 2020-06-27T04:48:28.520436+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e122: 8 total, 3 up, 8 in 2020-06-27T04:48:29.892 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:29 smithi031 bash[22603]: cluster 2020-06-27T04:48:28.635739+0000 mon.a (mon.0) 1062 : cluster [DBG] osd.5 reported immediately failed by osd.7 2020-06-27T04:48:29.893 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:29 smithi031 bash[22603]: cluster 2020-06-27T04:48:28.635781+0000 mon.a (mon.0) 1063 : cluster [INF] osd.5 failed (root=default,host=smithi051) (connection refused reported by osd.7) 2020-06-27T04:48:29.893 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:29 smithi031 bash[22603]: cluster 2020-06-27T04:48:29.382655+0000 mon.a (mon.0) 1064 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:48:29.893 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:29 smithi031 bash[22603]: cluster 2020-06-27T04:48:29.382719+0000 mon.a (mon.0) 1065 : cluster [WRN] Health check update: Degraded data redundancy: 344/1026 objects degraded (33.528%), 81 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:30.218 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:29 smithi051 podman[40089]: 2020-06-27 04:48:29.812597284 +0000 UTC m=+0.651529433 container died 063038279a673eee1b0d4da1e1898f0feed5e889e9c593385c5ff94ad2094b16 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:48:30.223 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:30 smithi031 podman[99184]: 2020-06-27 04:48:30.022876942 +0000 UTC m=+8.997527662 container remove b51fb71cab17e8dab19bf4a92577bc1b08a5e7c4f314e689dea14556725ac910 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:48:30.223 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:30 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:30.223 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:29 smithi031 podman[110824]: 2020-06-27 04:48:29.888416155 +0000 UTC m=+2.125986351 container remove 2cb4b30b40b0433d925cc87ad1a030072c0cb7d872e44166353eaaf74bbeb2b6 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:48:30.223 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:29 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Failed with result 'exit-code'. 2020-06-27T04:48:30.529 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:30 smithi051 podman[40089]: 2020-06-27 04:48:30.231960324 +0000 UTC m=+1.070892479 container remove 063038279a673eee1b0d4da1e1898f0feed5e889e9c593385c5ff94ad2094b16 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:48:30.529 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:30 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Failed with result 'exit-code'. 2020-06-27T04:48:30.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:30 smithi031 bash[22603]: cluster 2020-06-27T04:48:29.225067+0000 mgr.x (mgr.34109) 260 : cluster [DBG] pgmap v296: 745 pgs: 15 activating+undersized, 4 creating+incomplete, 14 creating+down, 5 stale+activating+undersized, 72 peering, 19 stale+creating+peering, 166 down, 1 stale+creating+activating+undersized, 28 stale+down, 6 stale+undersized+degraded+peered, 37 stale+active+clean, 5 unknown, 29 stale+peering, 31 stale+active+undersized+degraded, 34 undersized+degraded+peered, 31 stale+undersized+peered, 132 undersized+peered, 116 stale+active+undersized; 22 KiB data, 16 MiB used, 707 GiB / 715 GiB avail; 318/1029 objects degraded (30.904%) 2020-06-27T04:48:30.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:30 smithi031 bash[22603]: cluster 2020-06-27T04:48:29.529936+0000 mon.a (mon.0) 1066 : cluster [DBG] osdmap e123: 8 total, 2 up, 8 in 2020-06-27T04:48:30.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:30 smithi031 bash[18426]: cluster 2020-06-27T04:48:29.225067+0000 mgr.x (mgr.34109) 260 : cluster [DBG] pgmap v296: 745 pgs: 15 activating+undersized, 4 creating+incomplete, 14 creating+down, 5 stale+activating+undersized, 72 peering, 19 stale+creating+peering, 166 down, 1 stale+creating+activating+undersized, 28 stale+down, 6 stale+undersized+degraded+peered, 37 stale+active+clean, 5 unknown, 29 stale+peering, 31 stale+active+undersized+degraded, 34 undersized+degraded+peered, 31 stale+undersized+peered, 132 undersized+peered, 116 stale+active+undersized; 22 KiB data, 16 MiB used, 707 GiB / 715 GiB avail; 318/1029 objects degraded (30.904%) 2020-06-27T04:48:30.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:30 smithi031 bash[18426]: cluster 2020-06-27T04:48:29.529936+0000 mon.a (mon.0) 1066 : cluster [DBG] osdmap e123: 8 total, 2 up, 8 in 2020-06-27T04:48:30.724 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:30 smithi031 podman[110998]: 2020-06-27 04:48:30.408635247 +0000 UTC m=+0.367192288 container create ceec9fbe87a063b3c71e3596740ec7913ed39821b5266f387af568baf35c883b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:48:30.724 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:30 smithi031 podman[110998]: 2020-06-27 04:48:30.558600883 +0000 UTC m=+0.517157937 container init ceec9fbe87a063b3c71e3596740ec7913ed39821b5266f387af568baf35c883b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:48:30.724 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:30 smithi031 podman[110998]: 2020-06-27 04:48:30.600216474 +0000 UTC m=+0.558773437 container start ceec9fbe87a063b3c71e3596740ec7913ed39821b5266f387af568baf35c883b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:48:30.725 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:30 smithi031 podman[110998]: 2020-06-27 04:48:30.600291684 +0000 UTC m=+0.558848663 container attach ceec9fbe87a063b3c71e3596740ec7913ed39821b5266f387af568baf35c883b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:48:30.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:30 smithi051 bash[18409]: cluster 2020-06-27T04:48:29.225067+0000 mgr.x (mgr.34109) 260 : cluster [DBG] pgmap v296: 745 pgs: 15 activating+undersized, 4 creating+incomplete, 14 creating+down, 5 stale+activating+undersized, 72 peering, 19 stale+creating+peering, 166 down, 1 stale+creating+activating+undersized, 28 stale+down, 6 stale+undersized+degraded+peered, 37 stale+active+clean, 5 unknown, 29 stale+peering, 31 stale+active+undersized+degraded, 34 undersized+degraded+peered, 31 stale+undersized+peered, 132 undersized+peered, 116 stale+active+undersized; 22 KiB data, 16 MiB used, 707 GiB / 715 GiB avail; 318/1029 objects degraded (30.904%) 2020-06-27T04:48:30.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:30 smithi051 bash[18409]: cluster 2020-06-27T04:48:29.529936+0000 mon.a (mon.0) 1066 : cluster [DBG] osdmap e123: 8 total, 2 up, 8 in 2020-06-27T04:48:31.223 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:30 smithi031 podman[110998]: 2020-06-27 04:48:30.944361241 +0000 UTC m=+0.902918208 container died ceec9fbe87a063b3c71e3596740ec7913ed39821b5266f387af568baf35c883b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:48:31.469 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:31 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:31.469 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:31 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Scheduled restart job, restart counter is at 3. 2020-06-27T04:48:31.470 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:31 smithi051 systemd[1]: Stopped Ceph osd.4 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:31.470 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:31 smithi051 systemd[1]: Starting Ceph osd.4 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:48:31.470 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:31 smithi051 podman[40167]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4 found: no such container 2020-06-27T04:48:31.470 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:31 smithi051 systemd[1]: Started Ceph osd.4 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:31.470 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:31 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:31.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:31 smithi031 bash[18426]: cluster 2020-06-27T04:48:30.535478+0000 mon.a (mon.0) 1067 : cluster [DBG] osdmap e124: 8 total, 2 up, 8 in 2020-06-27T04:48:31.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:31 smithi031 bash[18426]: audit 2020-06-27T04:48:30.535968+0000 mon.a (mon.0) 1068 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:31.723 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:31 smithi031 podman[110998]: 2020-06-27 04:48:31.436724632 +0000 UTC m=+1.395281616 container remove ceec9fbe87a063b3c71e3596740ec7913ed39821b5266f387af568baf35c883b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:48:31.724 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:31 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Failed with result 'exit-code'. 2020-06-27T04:48:31.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:31 smithi031 bash[22603]: cluster 2020-06-27T04:48:30.535478+0000 mon.a (mon.0) 1067 : cluster [DBG] osdmap e124: 8 total, 2 up, 8 in 2020-06-27T04:48:31.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:31 smithi031 bash[22603]: audit 2020-06-27T04:48:30.535968+0000 mon.a (mon.0) 1068 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:31.913 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:31 smithi051 bash[18409]: cluster 2020-06-27T04:48:30.535478+0000 mon.a (mon.0) 1067 : cluster [DBG] osdmap e124: 8 total, 2 up, 8 in 2020-06-27T04:48:31.913 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:31 smithi051 bash[18409]: audit 2020-06-27T04:48:30.535968+0000 mon.a (mon.0) 1068 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:31.914 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:31 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Scheduled restart job, restart counter is at 3. 2020-06-27T04:48:31.914 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:31 smithi051 systemd[1]: Stopped Ceph osd.6 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:31.914 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:31 smithi051 systemd[1]: Starting Ceph osd.6 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:48:31.914 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:31 smithi051 podman[40199]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6 found: no such container 2020-06-27T04:48:31.915 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:31 smithi051 systemd[1]: Started Ceph osd.6 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:31.915 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:31 smithi051 podman[40183]: 2020-06-27 04:48:31.512350832 +0000 UTC m=+0.228509596 container create 7ffb61bfe505dc9de102c7b1bbf15b352e53c689e3524dfd83560e423059d819 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:48:31.915 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:31 smithi051 podman[40183]: 2020-06-27 04:48:31.662329257 +0000 UTC m=+0.378487903 container init 7ffb61bfe505dc9de102c7b1bbf15b352e53c689e3524dfd83560e423059d819 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:48:31.915 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:31 smithi051 podman[40183]: 2020-06-27 04:48:31.695656674 +0000 UTC m=+0.411815331 container start 7ffb61bfe505dc9de102c7b1bbf15b352e53c689e3524dfd83560e423059d819 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:48:31.916 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:31 smithi051 podman[40183]: 2020-06-27 04:48:31.695732515 +0000 UTC m=+0.411891190 container attach 7ffb61bfe505dc9de102c7b1bbf15b352e53c689e3524dfd83560e423059d819 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:48:32.218 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:31 smithi051 podman[40236]: 2020-06-27 04:48:31.920281325 +0000 UTC m=+0.291592543 container create e888237fdc46e6773b4fc19b8e4179b21e9c724e46a2183d321b8b9dc9cb1f7c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:48:32.218 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:31 smithi051 bash[40181]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-06-27T04:48:32.218 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:31 smithi051 bash[40181]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2020-06-27T04:48:32.219 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:31 smithi051 bash[40181]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2020-06-27T04:48:32.219 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:31 smithi051 bash[40181]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2020-06-27T04:48:32.219 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:31 smithi051 bash[40181]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2020-06-27T04:48:32.219 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:31 smithi051 bash[40181]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-06-27T04:48:32.219 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:31 smithi051 bash[40181]: --> ceph-volume lvm activate successful for osd ID: 4 2020-06-27T04:48:32.220 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:31 smithi051 podman[40183]: 2020-06-27 04:48:31.996613287 +0000 UTC m=+0.712771947 container died 7ffb61bfe505dc9de102c7b1bbf15b352e53c689e3524dfd83560e423059d819 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:48:32.596 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:32 smithi051 bash[18409]: cluster 2020-06-27T04:48:31.226238+0000 mgr.x (mgr.34109) 261 : cluster [DBG] pgmap v299: 745 pgs: 3 stale+creating+incomplete, 13 stale+creating+down, 14 activating+undersized, 1 creating+incomplete, 1 creating+down, 4 stale+activating+undersized, 31 peering, 19 stale+creating+peering, 13 down, 1 stale+creating+activating+undersized, 169 stale+down, 6 stale+undersized+degraded+peered, 35 stale+active+clean, 37 unknown, 66 stale+peering, 31 stale+active+undersized+degraded, 34 undersized+degraded+peered, 29 stale+undersized+peered, 127 undersized+peered, 111 stale+active+undersized; 22 KiB data, 16 MiB used, 707 GiB / 715 GiB avail; 318/1026 objects degraded (30.994%) 2020-06-27T04:48:32.597 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:32 smithi051 bash[18409]: audit 2020-06-27T04:48:31.545180+0000 mon.a (mon.0) 1069 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-6","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:32.597 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:32 smithi051 bash[18409]: cluster 2020-06-27T04:48:31.545251+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e125: 8 total, 2 up, 8 in 2020-06-27T04:48:32.598 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:32 smithi051 podman[40183]: 2020-06-27 04:48:32.514007553 +0000 UTC m=+1.230166236 container remove 7ffb61bfe505dc9de102c7b1bbf15b352e53c689e3524dfd83560e423059d819 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:48:32.598 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:32 smithi051 bash[40181]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4 found: no such container 2020-06-27T04:48:32.598 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:32 smithi051 podman[40236]: 2020-06-27 04:48:32.330507631 +0000 UTC m=+0.701818858 container init e888237fdc46e6773b4fc19b8e4179b21e9c724e46a2183d321b8b9dc9cb1f7c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:48:32.599 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:32 smithi051 podman[40236]: 2020-06-27 04:48:32.462942442 +0000 UTC m=+0.834253657 container start e888237fdc46e6773b4fc19b8e4179b21e9c724e46a2183d321b8b9dc9cb1f7c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:48:32.599 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:32 smithi051 podman[40236]: 2020-06-27 04:48:32.463031357 +0000 UTC m=+0.834342589 container attach e888237fdc46e6773b4fc19b8e4179b21e9c724e46a2183d321b8b9dc9cb1f7c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:48:32.902 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:32 smithi031 bash[18426]: cluster 2020-06-27T04:48:31.226238+0000 mgr.x (mgr.34109) 261 : cluster [DBG] pgmap v299: 745 pgs: 3 stale+creating+incomplete, 13 stale+creating+down, 14 activating+undersized, 1 creating+incomplete, 1 creating+down, 4 stale+activating+undersized, 31 peering, 19 stale+creating+peering, 13 down, 1 stale+creating+activating+undersized, 169 stale+down, 6 stale+undersized+degraded+peered, 35 stale+active+clean, 37 unknown, 66 stale+peering, 31 stale+active+undersized+degraded, 34 undersized+degraded+peered, 29 stale+undersized+peered, 127 undersized+peered, 111 stale+active+undersized; 22 KiB data, 16 MiB used, 707 GiB / 715 GiB avail; 318/1026 objects degraded (30.994%) 2020-06-27T04:48:32.902 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:32 smithi031 bash[18426]: audit 2020-06-27T04:48:31.545180+0000 mon.a (mon.0) 1069 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-6","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:32.903 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:32 smithi031 bash[18426]: cluster 2020-06-27T04:48:31.545251+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e125: 8 total, 2 up, 8 in 2020-06-27T04:48:32.903 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:32 smithi031 bash[22603]: cluster 2020-06-27T04:48:31.226238+0000 mgr.x (mgr.34109) 261 : cluster [DBG] pgmap v299: 745 pgs: 3 stale+creating+incomplete, 13 stale+creating+down, 14 activating+undersized, 1 creating+incomplete, 1 creating+down, 4 stale+activating+undersized, 31 peering, 19 stale+creating+peering, 13 down, 1 stale+creating+activating+undersized, 169 stale+down, 6 stale+undersized+degraded+peered, 35 stale+active+clean, 37 unknown, 66 stale+peering, 31 stale+active+undersized+degraded, 34 undersized+degraded+peered, 29 stale+undersized+peered, 127 undersized+peered, 111 stale+active+undersized; 22 KiB data, 16 MiB used, 707 GiB / 715 GiB avail; 318/1026 objects degraded (30.994%) 2020-06-27T04:48:32.903 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:32 smithi031 bash[22603]: audit 2020-06-27T04:48:31.545180+0000 mon.a (mon.0) 1069 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-6","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:32.903 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:32 smithi031 bash[22603]: cluster 2020-06-27T04:48:31.545251+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e125: 8 total, 2 up, 8 in 2020-06-27T04:48:32.904 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:32 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:32.904 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:32 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 3. 2020-06-27T04:48:32.904 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:32 smithi031 systemd[1]: Stopped Ceph osd.0 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:32.904 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:32 smithi031 systemd[1]: Starting Ceph osd.0 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:48:32.904 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:32 smithi031 podman[111074]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0 found: no such container 2020-06-27T04:48:32.905 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:32 smithi031 systemd[1]: Started Ceph osd.0 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:32.968 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:32 smithi051 bash[40181]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4 2020-06-27T04:48:32.968 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:32 smithi051 bash[40181]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4" found: no such container 2020-06-27T04:48:32.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:32 smithi051 bash[40234]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-06-27T04:48:32.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:32 smithi051 bash[40234]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2020-06-27T04:48:32.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:32 smithi051 bash[40234]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2020-06-27T04:48:32.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:32 smithi051 bash[40234]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2020-06-27T04:48:32.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:32 smithi051 bash[40234]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2020-06-27T04:48:32.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:32 smithi051 bash[40234]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-06-27T04:48:32.970 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:32 smithi051 bash[40234]: --> ceph-volume lvm activate successful for osd ID: 6 2020-06-27T04:48:32.970 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:32 smithi051 podman[40236]: 2020-06-27 04:48:32.649624674 +0000 UTC m=+1.020935904 container died e888237fdc46e6773b4fc19b8e4179b21e9c724e46a2183d321b8b9dc9cb1f7c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:48:33.223 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:32 smithi031 podman[111092]: 2020-06-27 04:48:32.899924283 +0000 UTC m=+0.363258556 container create 50aa5da948f95522e24f6d0c5f941ae89162ba2a68a3f00b3e850772dc753c8c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:48:33.223 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:33 smithi031 podman[111092]: 2020-06-27 04:48:33.074823668 +0000 UTC m=+0.538157855 container init 50aa5da948f95522e24f6d0c5f941ae89162ba2a68a3f00b3e850772dc753c8c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:48:33.223 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:33 smithi031 podman[111092]: 2020-06-27 04:48:33.116469749 +0000 UTC m=+0.579803938 container start 50aa5da948f95522e24f6d0c5f941ae89162ba2a68a3f00b3e850772dc753c8c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:48:33.223 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:33 smithi031 podman[111092]: 2020-06-27 04:48:33.116553054 +0000 UTC m=+0.579887324 container attach 50aa5da948f95522e24f6d0c5f941ae89162ba2a68a3f00b3e850772dc753c8c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:48:33.320 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 podman[40363]: 2020-06-27 04:48:33.043768523 +0000 UTC m=+0.426296977 container create dd0d560c7764c363ef4065047f73c81f28cae97c3056164b8cd0058b2979223b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:48:33.623 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[18409]: cluster 2020-06-27T04:48:32.558456+0000 mon.a (mon.0) 1071 : cluster [DBG] osdmap e126: 8 total, 2 up, 8 in 2020-06-27T04:48:33.623 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[18409]: audit 2020-06-27T04:48:32.559588+0000 mon.a (mon.0) 1072 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:33.623 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 podman[40363]: 2020-06-27 04:48:33.318266269 +0000 UTC m=+0.700794690 container init dd0d560c7764c363ef4065047f73c81f28cae97c3056164b8cd0058b2979223b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:48:33.624 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 podman[40363]: 2020-06-27 04:48:33.353699398 +0000 UTC m=+0.736227749 container start dd0d560c7764c363ef4065047f73c81f28cae97c3056164b8cd0058b2979223b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:48:33.624 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 podman[40363]: 2020-06-27 04:48:33.3537699 +0000 UTC m=+0.736298261 container attach dd0d560c7764c363ef4065047f73c81f28cae97c3056164b8cd0058b2979223b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:48:33.624 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 1 -- 172.21.15.51:0/1395953044 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x562b271b3400 msgr2=0x562b27124300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:48:33.624 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 1 --2- 172.21.15.51:0/1395953044 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x562b271b3400 0x562b27124300 secure :-1 s=READY pgs=3527 cs=0 l=1 rev1=1 rx=0x562b27135a70 tx=0x562b27102c00).stop 2020-06-27T04:48:33.624 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 5 --2- 172.21.15.51:0/1395953044 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x562b271b3400 0x562b27124300 secure :-1 s=READY pgs=3527 cs=0 l=1 rev1=1 rx=0x562b27135a70 tx=0x562b27102c00).reset_recv_state 2020-06-27T04:48:33.625 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 20 Event(0x562b27146e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:33.625 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 10 --2- 172.21.15.51:0/1395953044 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x562b271b3400 0x562b27124300 secure :-1 s=READY pgs=3527 cs=0 l=1 rev1=1 rx=0x562b27135a70 tx=0x562b27102c00).discard_out_queue started 2020-06-27T04:48:33.625 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb72f1f5700 5 --2- 172.21.15.51:0/1395953044 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x562b271b3400 0x562b27124300 secure :-1 s=CLOSED pgs=3527 cs=0 l=1 rev1=1 rx=0x562b27135a70 tx=0x562b27102c00).reset_recv_state (warped) reseting crypto handlers 2020-06-27T04:48:33.625 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb72f1f5700 5 --2- 172.21.15.51:0/1395953044 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x562b271b3400 0x562b27124300 secure :-1 s=CLOSED pgs=3527 cs=0 l=1 rev1=1 rx=0x562b27135a70 tx=0x562b27102c00).reset_security 2020-06-27T04:48:33.625 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb72f1f5700 20 EpollDriver.del_event del event fd=16 cur_mask=1 delmask=3 to 5 2020-06-27T04:48:33.626 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 10 -- 172.21.15.51:0/1395953044 shutdown 172.21.15.51:0/1395953044 2020-06-27T04:48:33.626 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 10 Processor -- stop 2020-06-27T04:48:33.626 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 20 Event(0x562b27146e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:33.627 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 1 -- 172.21.15.51:0/1395953044 shutdown_connections 2020-06-27T04:48:33.627 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 5 -- 172.21.15.51:0/1395953044 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x562b271b3400 2020-06-27T04:48:33.627 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 1 --2- 172.21.15.51:0/1395953044 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x562b271b3400 0x562b27124300 unknown :-1 s=CLOSED pgs=3527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:33.628 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 5 -- 172.21.15.51:0/1395953044 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x562b271b2c00 2020-06-27T04:48:33.628 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 1 --2- 172.21.15.51:0/1395953044 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x562b271b2c00 0x562b27123400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:33.628 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 5 -- 172.21.15.51:0/1395953044 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x562b271b3000 2020-06-27T04:48:33.628 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 1 --2- 172.21.15.51:0/1395953044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b271b3000 0x562b27123e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:33.628 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 5 -- 172.21.15.51:0/1395953044 shutdown_connections delete 0x562b271b2c00 2020-06-27T04:48:33.628 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 5 -- 172.21.15.51:0/1395953044 shutdown_connections delete 0x562b271b3000 2020-06-27T04:48:33.629 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 5 -- 172.21.15.51:0/1395953044 shutdown_connections delete 0x562b271b3400 2020-06-27T04:48:33.629 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 1 -- 172.21.15.51:0/1395953044 >> 172.21.15.51:0/1395953044 conn(0x562b271b2800 msgr2=0x562b2721b000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:48:33.629 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 20 --1- 172.21.15.51:0/1395953044 >> 172.21.15.51:0/1395953044 conn(0x562b271b2800 0x562b2721b000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:33.629 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 2 --1- 172.21.15.51:0/1395953044 >> 172.21.15.51:0/1395953044 conn(0x562b271b2800 0x562b2721b000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:33.629 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 5 --1- 172.21.15.51:0/1395953044 >> 172.21.15.51:0/1395953044 conn(0x562b271b2800 0x562b2721b000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:48:33.630 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 20 Event(0x562b27146e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:33.630 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 10 --1- 172.21.15.51:0/1395953044 >> 172.21.15.51:0/1395953044 conn(0x562b271b2800 0x562b2721b000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:48:33.630 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb72f1f5700 5 --1- 172.21.15.51:0/1395953044 >> 172.21.15.51:0/1395953044 conn(0x562b271b2800 0x562b2721b000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:48:33.630 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 20 Event(0x562b27146e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:33.630 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 20 Event(0x562b27147040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:33.631 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 20 Event(0x562b27147280 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:33.631 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb72f1f5700 5 --1- 172.21.15.51:0/1395953044 >> 172.21.15.51:0/1395953044 conn(0x562b271b2800 0x562b2721b000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:48:33.631 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 10 -- 172.21.15.51:0/1395953044 wait: waiting for dispatch queue 2020-06-27T04:48:33.631 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 10 -- 172.21.15.51:0/1395953044 wait: dispatch queue is stopped 2020-06-27T04:48:33.631 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 1 -- 172.21.15.51:0/1395953044 shutdown_connections 2020-06-27T04:48:33.632 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 5 -- 172.21.15.51:0/1395953044 shutdown_connections delete 0x562b271b2800 2020-06-27T04:48:33.632 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 20 Event(0x562b27146e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:33.632 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 20 Event(0x562b27147040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:33.632 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 20 Event(0x562b27147280 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:33.632 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 10 -- 172.21.15.51:0/1395953044 wait: done. 2020-06-27T04:48:33.632 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.343+0000 7fb735472f40 1 -- 172.21.15.51:0/1395953044 wait complete. 2020-06-27T04:48:33.633 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 podman[40236]: 2020-06-27 04:48:33.318810149 +0000 UTC m=+1.690121397 container remove e888237fdc46e6773b4fc19b8e4179b21e9c724e46a2183d321b8b9dc9cb1f7c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:48:33.633 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6 found: no such container 2020-06-27T04:48:33.633 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6 2020-06-27T04:48:33.633 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6" found: no such container 2020-06-27T04:48:33.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:33 smithi031 bash[18426]: cluster 2020-06-27T04:48:32.558456+0000 mon.a (mon.0) 1071 : cluster [DBG] osdmap e126: 8 total, 2 up, 8 in 2020-06-27T04:48:33.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:33 smithi031 bash[18426]: audit 2020-06-27T04:48:32.559588+0000 mon.a (mon.0) 1072 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:33.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:33 smithi031 bash[22603]: cluster 2020-06-27T04:48:32.558456+0000 mon.a (mon.0) 1071 : cluster [DBG] osdmap e126: 8 total, 2 up, 8 in 2020-06-27T04:48:33.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:33 smithi031 bash[22603]: audit 2020-06-27T04:48:32.559588+0000 mon.a (mon.0) 1072 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:33.724 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:33 smithi031 bash[111090]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-06-27T04:48:33.724 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:33 smithi031 bash[111090]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2020-06-27T04:48:33.725 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:33 smithi031 bash[111090]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2020-06-27T04:48:33.725 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:33 smithi031 bash[111090]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2020-06-27T04:48:33.725 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:33 smithi031 bash[111090]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2020-06-27T04:48:33.725 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:33 smithi031 bash[111090]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-06-27T04:48:33.726 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:33 smithi031 bash[111090]: --> ceph-volume lvm activate successful for osd ID: 0 2020-06-27T04:48:33.726 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:33 smithi031 podman[111092]: 2020-06-27 04:48:33.39133534 +0000 UTC m=+0.854669531 container died 50aa5da948f95522e24f6d0c5f941ae89162ba2a68a3f00b3e850772dc753c8c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:48:33.968 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40181]: debug 2020-06-27T04:48:33.860+0000 7fb735472f40 -1 Falling back to public interface 2020-06-27T04:48:33.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 podman[40475]: 2020-06-27 04:48:33.620339684 +0000 UTC m=+0.207522649 container create 23810730c18b02f05af66454e7f1c19b47671ba064fb506d71a6935fdca605d9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:48:33.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 podman[40475]: 2020-06-27 04:48:33.737020913 +0000 UTC m=+0.324203889 container init 23810730c18b02f05af66454e7f1c19b47671ba064fb506d71a6935fdca605d9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:48:33.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 podman[40475]: 2020-06-27 04:48:33.770406003 +0000 UTC m=+0.357589097 container start 23810730c18b02f05af66454e7f1c19b47671ba064fb506d71a6935fdca605d9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:48:33.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 podman[40475]: 2020-06-27 04:48:33.770507037 +0000 UTC m=+0.357690011 container attach 23810730c18b02f05af66454e7f1c19b47671ba064fb506d71a6935fdca605d9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:48:33.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 10 -- 172.21.15.51:0/1592005273 shutdown 172.21.15.51:0/1592005273 2020-06-27T04:48:33.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 10 Processor -- stop 2020-06-27T04:48:33.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 20 Event(0x559336b90e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:33.970 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 1 -- 172.21.15.51:0/1592005273 shutdown_connections 2020-06-27T04:48:33.970 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 5 -- 172.21.15.51:0/1592005273 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x559336bfcc00 2020-06-27T04:48:33.970 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 1 --2- 172.21.15.51:0/1592005273 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x559336bfcc00 0x559336b6d400 unknown :-1 s=CLOSED pgs=3528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:33.970 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 5 -- 172.21.15.51:0/1592005273 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x559336bfd400 2020-06-27T04:48:33.970 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 1 --2- 172.21.15.51:0/1592005273 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x559336bfd400 0x559336b6e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:33.971 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 5 -- 172.21.15.51:0/1592005273 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x559336bfd000 2020-06-27T04:48:33.971 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 1 --2- 172.21.15.51:0/1592005273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559336bfd000 0x559336b6de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:33.971 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 5 -- 172.21.15.51:0/1592005273 shutdown_connections delete 0x559336bfcc00 2020-06-27T04:48:33.971 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 5 -- 172.21.15.51:0/1592005273 shutdown_connections delete 0x559336bfd000 2020-06-27T04:48:33.971 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 5 -- 172.21.15.51:0/1592005273 shutdown_connections delete 0x559336bfd400 2020-06-27T04:48:33.972 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 1 -- 172.21.15.51:0/1592005273 >> 172.21.15.51:0/1592005273 conn(0x559336bfc800 msgr2=0x559336c65000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:48:33.972 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 20 --1- 172.21.15.51:0/1592005273 >> 172.21.15.51:0/1592005273 conn(0x559336bfc800 0x559336c65000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:33.972 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 2 --1- 172.21.15.51:0/1592005273 >> 172.21.15.51:0/1592005273 conn(0x559336bfc800 0x559336c65000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:33.972 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 5 --1- 172.21.15.51:0/1592005273 >> 172.21.15.51:0/1592005273 conn(0x559336bfc800 0x559336c65000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:48:33.972 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 20 Event(0x559336b90e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:33.973 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 10 --1- 172.21.15.51:0/1592005273 >> 172.21.15.51:0/1592005273 conn(0x559336bfc800 0x559336c65000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:48:33.973 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 20 Event(0x559336b91040 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:33.973 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 20 Event(0x559336b91280 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:33.973 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8ef6870700 5 --1- 172.21.15.51:0/1592005273 >> 172.21.15.51:0/1592005273 conn(0x559336bfc800 0x559336c65000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:48:33.973 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8ef6870700 5 --1- 172.21.15.51:0/1592005273 >> 172.21.15.51:0/1592005273 conn(0x559336bfc800 0x559336c65000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:48:33.973 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 10 -- 172.21.15.51:0/1592005273 wait: waiting for dispatch queue 2020-06-27T04:48:33.974 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 10 -- 172.21.15.51:0/1592005273 wait: dispatch queue is stopped 2020-06-27T04:48:33.974 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 1 -- 172.21.15.51:0/1592005273 shutdown_connections 2020-06-27T04:48:33.974 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 5 -- 172.21.15.51:0/1592005273 shutdown_connections delete 0x559336bfc800 2020-06-27T04:48:33.974 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 20 Event(0x559336b90e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:33.974 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 20 Event(0x559336b91040 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:33.975 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 20 Event(0x559336b91280 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:33.975 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 10 -- 172.21.15.51:0/1592005273 wait: done. 2020-06-27T04:48:33.975 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:33 smithi051 bash[40234]: debug 2020-06-27T04:48:33.759+0000 7f8efcaedf40 1 -- 172.21.15.51:0/1592005273 wait complete. 2020-06-27T04:48:34.393 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 podman[111092]: 2020-06-27 04:48:34.092018827 +0000 UTC m=+1.555353017 container remove 50aa5da948f95522e24f6d0c5f941ae89162ba2a68a3f00b3e850772dc753c8c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:48:34.394 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0 found: no such container 2020-06-27T04:48:34.394 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0 2020-06-27T04:48:34.394 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0" found: no such container 2020-06-27T04:48:34.574 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:34 smithi051 bash[40234]: debug 2020-06-27T04:48:34.276+0000 7f8efcaedf40 -1 Falling back to public interface 2020-06-27T04:48:34.574 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:34 smithi051 bash[18409]: cluster 2020-06-27T04:48:33.228054+0000 mgr.x (mgr.34109) 262 : cluster [DBG] pgmap v302: 777 pgs: 2 creating+down, 12 active+undersized+degraded, 3 stale+creating+incomplete, 13 stale+creating+down, 4 stale+activating+undersized, 9 peering, 19 stale+creating+peering, 1 active+recovery_wait+undersized+degraded, 35 down, 1 stale+creating+activating+undersized, 167 stale+down, 6 stale+undersized+degraded+peered, 35 stale+active+clean, 61 unknown, 18 active+undersized, 14 stale+peering, 23 stale+active+undersized+degraded, 50 undersized+degraded+peered, 29 stale+undersized+peered, 177 undersized+peered, 98 stale+active+undersized; 22 KiB data, 16 MiB used, 707 GiB / 715 GiB avail; 352/1026 objects degraded (34.308%) 2020-06-27T04:48:34.575 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:34 smithi051 bash[18409]: cluster 2020-06-27T04:48:33.552229+0000 mon.a (mon.0) 1073 : cluster [WRN] Health check update: Reduced data availability: 123 pgs inactive, 217 pgs down, 3 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:48:34.575 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:34 smithi051 bash[18409]: audit 2020-06-27T04:48:33.558097+0000 mon.a (mon.0) 1074 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-7","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:34.575 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:34 smithi051 bash[18409]: cluster 2020-06-27T04:48:33.558139+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e127: 8 total, 2 up, 8 in 2020-06-27T04:48:34.575 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:34 smithi051 bash[18409]: cluster 2020-06-27T04:48:34.383651+0000 mon.a (mon.0) 1076 : cluster [WRN] Health check update: 6 osds down (OSD_DOWN) 2020-06-27T04:48:34.576 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:34 smithi051 bash[18409]: cluster 2020-06-27T04:48:34.383796+0000 mon.a (mon.0) 1077 : cluster [WRN] Health check update: Degraded data redundancy: 352/1026 objects degraded (34.308%), 92 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:34.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[18426]: cluster 2020-06-27T04:48:33.228054+0000 mgr.x (mgr.34109) 262 : cluster [DBG] pgmap v302: 777 pgs: 2 creating+down, 12 active+undersized+degraded, 3 stale+creating+incomplete, 13 stale+creating+down, 4 stale+activating+undersized, 9 peering, 19 stale+creating+peering, 1 active+recovery_wait+undersized+degraded, 35 down, 1 stale+creating+activating+undersized, 167 stale+down, 6 stale+undersized+degraded+peered, 35 stale+active+clean, 61 unknown, 18 active+undersized, 14 stale+peering, 23 stale+active+undersized+degraded, 50 undersized+degraded+peered, 29 stale+undersized+peered, 177 undersized+peered, 98 stale+active+undersized; 22 KiB data, 16 MiB used, 707 GiB / 715 GiB avail; 352/1026 objects degraded (34.308%) 2020-06-27T04:48:34.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[18426]: cluster 2020-06-27T04:48:33.552229+0000 mon.a (mon.0) 1073 : cluster [WRN] Health check update: Reduced data availability: 123 pgs inactive, 217 pgs down, 3 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:48:34.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[18426]: audit 2020-06-27T04:48:33.558097+0000 mon.a (mon.0) 1074 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-7","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:34.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[18426]: cluster 2020-06-27T04:48:33.558139+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e127: 8 total, 2 up, 8 in 2020-06-27T04:48:34.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[18426]: cluster 2020-06-27T04:48:34.383651+0000 mon.a (mon.0) 1076 : cluster [WRN] Health check update: 6 osds down (OSD_DOWN) 2020-06-27T04:48:34.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[18426]: cluster 2020-06-27T04:48:34.383796+0000 mon.a (mon.0) 1077 : cluster [WRN] Health check update: Degraded data redundancy: 352/1026 objects degraded (34.308%), 92 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:34.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[22603]: cluster 2020-06-27T04:48:33.228054+0000 mgr.x (mgr.34109) 262 : cluster [DBG] pgmap v302: 777 pgs: 2 creating+down, 12 active+undersized+degraded, 3 stale+creating+incomplete, 13 stale+creating+down, 4 stale+activating+undersized, 9 peering, 19 stale+creating+peering, 1 active+recovery_wait+undersized+degraded, 35 down, 1 stale+creating+activating+undersized, 167 stale+down, 6 stale+undersized+degraded+peered, 35 stale+active+clean, 61 unknown, 18 active+undersized, 14 stale+peering, 23 stale+active+undersized+degraded, 50 undersized+degraded+peered, 29 stale+undersized+peered, 177 undersized+peered, 98 stale+active+undersized; 22 KiB data, 16 MiB used, 707 GiB / 715 GiB avail; 352/1026 objects degraded (34.308%) 2020-06-27T04:48:34.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[22603]: cluster 2020-06-27T04:48:33.552229+0000 mon.a (mon.0) 1073 : cluster [WRN] Health check update: Reduced data availability: 123 pgs inactive, 217 pgs down, 3 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:48:34.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[22603]: audit 2020-06-27T04:48:33.558097+0000 mon.a (mon.0) 1074 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41319-7","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:34.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[22603]: cluster 2020-06-27T04:48:33.558139+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e127: 8 total, 2 up, 8 in 2020-06-27T04:48:34.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[22603]: cluster 2020-06-27T04:48:34.383651+0000 mon.a (mon.0) 1076 : cluster [WRN] Health check update: 6 osds down (OSD_DOWN) 2020-06-27T04:48:34.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[22603]: cluster 2020-06-27T04:48:34.383796+0000 mon.a (mon.0) 1077 : cluster [WRN] Health check update: Degraded data redundancy: 352/1026 objects degraded (34.308%), 92 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:34.728 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 podman[111201]: 2020-06-27 04:48:34.391294946 +0000 UTC m=+0.195222909 container create 2b1f1e2570cf4fb6c4d195aded1a05de12ddfef96d1501bfb9930bb54f47d1e1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:48:34.729 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 podman[111201]: 2020-06-27 04:48:34.53300524 +0000 UTC m=+0.336933093 container init 2b1f1e2570cf4fb6c4d195aded1a05de12ddfef96d1501bfb9930bb54f47d1e1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:48:34.729 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 podman[111201]: 2020-06-27 04:48:34.574624353 +0000 UTC m=+0.378552303 container start 2b1f1e2570cf4fb6c4d195aded1a05de12ddfef96d1501bfb9930bb54f47d1e1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:48:34.730 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 podman[111201]: 2020-06-27 04:48:34.574743758 +0000 UTC m=+0.378671798 container attach 2b1f1e2570cf4fb6c4d195aded1a05de12ddfef96d1501bfb9930bb54f47d1e1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:48:34.730 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 10 --2- 172.21.15.31:0/172629046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x557182291400 0x557182202300 secure :-1 s=READY pgs=2495 cs=0 l=1 rev1=1 rx=0x557182213a70 tx=0x5571821e0c00).discard_out_queue started 2020-06-27T04:48:34.730 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f745178e700 5 --2- 172.21.15.31:0/172629046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x557182291400 0x557182202300 secure :-1 s=READY pgs=2495 cs=0 l=1 rev1=1 rx=0x557182213a70 tx=0x5571821e0c00).reset_recv_state (warped) reseting crypto handlers 2020-06-27T04:48:34.731 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 20 Event(0x557182224e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:34.731 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f745178e700 5 --2- 172.21.15.31:0/172629046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x557182291400 0x557182202300 secure :-1 s=CLOSED pgs=2495 cs=0 l=1 rev1=1 rx=0x557182213a70 tx=0x5571821e0c00).reset_security 2020-06-27T04:48:34.731 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 10 -- 172.21.15.31:0/172629046 shutdown 172.21.15.31:0/172629046 2020-06-27T04:48:34.732 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 10 Processor -- stop 2020-06-27T04:48:34.732 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 20 Event(0x557182224e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:34.732 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f745178e700 20 EpollDriver.del_event del event fd=15 cur_mask=1 delmask=3 to 5 2020-06-27T04:48:34.733 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 1 -- 172.21.15.31:0/172629046 shutdown_connections 2020-06-27T04:48:34.733 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 5 -- 172.21.15.31:0/172629046 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x557182290c00 2020-06-27T04:48:34.733 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 1 --2- 172.21.15.31:0/172629046 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x557182290c00 0x557182201400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:34.734 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 5 -- 172.21.15.31:0/172629046 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x557182291400 2020-06-27T04:48:34.734 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 1 --2- 172.21.15.31:0/172629046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x557182291400 0x557182202300 unknown :-1 s=CLOSED pgs=2495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:34.735 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 5 -- 172.21.15.31:0/172629046 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x557182291000 2020-06-27T04:48:34.735 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 1 --2- 172.21.15.31:0/172629046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557182291000 0x557182201e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:34.735 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 5 -- 172.21.15.31:0/172629046 shutdown_connections delete 0x557182290c00 2020-06-27T04:48:34.736 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 5 -- 172.21.15.31:0/172629046 shutdown_connections delete 0x557182291000 2020-06-27T04:48:34.739 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 5 -- 172.21.15.31:0/172629046 shutdown_connections delete 0x557182291400 2020-06-27T04:48:34.739 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 1 -- 172.21.15.31:0/172629046 >> 172.21.15.31:0/172629046 conn(0x557182290800 msgr2=0x5571822f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:48:34.740 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 20 --1- 172.21.15.31:0/172629046 >> 172.21.15.31:0/172629046 conn(0x557182290800 0x5571822f9000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:34.740 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 2 --1- 172.21.15.31:0/172629046 >> 172.21.15.31:0/172629046 conn(0x557182290800 0x5571822f9000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:34.740 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 5 --1- 172.21.15.31:0/172629046 >> 172.21.15.31:0/172629046 conn(0x557182290800 0x5571822f9000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:48:34.740 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 20 Event(0x557182224e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:34.740 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 10 --1- 172.21.15.31:0/172629046 >> 172.21.15.31:0/172629046 conn(0x557182290800 0x5571822f9000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:48:34.741 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 20 Event(0x557182225040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:34.741 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 20 Event(0x557182225280 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:34.741 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f745178e700 5 --1- 172.21.15.31:0/172629046 >> 172.21.15.31:0/172629046 conn(0x557182290800 0x5571822f9000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:48:34.741 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f745178e700 5 --1- 172.21.15.31:0/172629046 >> 172.21.15.31:0/172629046 conn(0x557182290800 0x5571822f9000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:48:34.741 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 10 -- 172.21.15.31:0/172629046 wait: waiting for dispatch queue 2020-06-27T04:48:34.742 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 10 -- 172.21.15.31:0/172629046 wait: dispatch queue is stopped 2020-06-27T04:48:34.742 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 1 -- 172.21.15.31:0/172629046 shutdown_connections 2020-06-27T04:48:34.742 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 5 -- 172.21.15.31:0/172629046 shutdown_connections delete 0x557182290800 2020-06-27T04:48:34.742 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 20 Event(0x557182224e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:34.742 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 20 Event(0x557182225040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:34.743 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 20 Event(0x557182225280 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:34.743 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 10 -- 172.21.15.31:0/172629046 wait: done. 2020-06-27T04:48:34.743 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:34 smithi031 bash[111090]: debug 2020-06-27T04:48:34.555+0000 7f7457a0bf40 1 -- 172.21.15.31:0/172629046 wait complete. 2020-06-27T04:48:34.957 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:34 smithi051 bash[40181]: debug 2020-06-27T04:48:34.581+0000 7fb735472f40 -1 osd.4 115 log_to_monitors {default=true} 2020-06-27T04:48:35.218 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:34 smithi051 bash[40234]: debug 2020-06-27T04:48:34.955+0000 7f8efcaedf40 -1 osd.6 115 log_to_monitors {default=true} 2020-06-27T04:48:35.473 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[111090]: debug 2020-06-27T04:48:35.073+0000 7f7457a0bf40 -1 Falling back to public interface 2020-06-27T04:48:35.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:35 smithi051 bash[18409]: cluster 2020-06-27T04:48:34.565177+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e128: 8 total, 2 up, 8 in 2020-06-27T04:48:35.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:35 smithi051 bash[18409]: audit 2020-06-27T04:48:34.586693+0000 mon.b (mon.2) 312 : audit [INF] from='osd.4 v2:172.21.15.51:6801/1315086533' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:48:35.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:35 smithi051 bash[18409]: audit 2020-06-27T04:48:34.587090+0000 mon.a (mon.0) 1079 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:48:35.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:35 smithi051 bash[18409]: audit 2020-06-27T04:48:34.587603+0000 mon.b (mon.2) 313 : audit [INF] from='osd.4 v2:172.21.15.51:6801/1315086533' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:35.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:35 smithi051 bash[18409]: audit 2020-06-27T04:48:34.587861+0000 mon.a (mon.0) 1080 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:35.973 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:35 smithi051 bash[18409]: audit 2020-06-27T04:48:34.959525+0000 mon.b (mon.2) 314 : audit [INF] from='osd.6 v2:172.21.15.51:6809/3094328372' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:48:35.973 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:35 smithi051 bash[18409]: audit 2020-06-27T04:48:34.960100+0000 mon.a (mon.0) 1081 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:48:35.973 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:35 smithi051 bash[18409]: audit 2020-06-27T04:48:34.960664+0000 mon.b (mon.2) 315 : audit [INF] from='osd.6 v2:172.21.15.51:6809/3094328372' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:35.973 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:35 smithi051 bash[18409]: audit 2020-06-27T04:48:34.960957+0000 mon.a (mon.0) 1082 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:35.975 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[111090]: debug 2020-06-27T04:48:35.761+0000 7f7457a0bf40 -1 osd.0 115 log_to_monitors {default=true} 2020-06-27T04:48:35.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[18426]: cluster 2020-06-27T04:48:34.565177+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e128: 8 total, 2 up, 8 in 2020-06-27T04:48:35.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[18426]: audit 2020-06-27T04:48:34.586693+0000 mon.b (mon.2) 312 : audit [INF] from='osd.4 v2:172.21.15.51:6801/1315086533' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:48:35.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[18426]: audit 2020-06-27T04:48:34.587090+0000 mon.a (mon.0) 1079 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:48:35.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[18426]: audit 2020-06-27T04:48:34.587603+0000 mon.b (mon.2) 313 : audit [INF] from='osd.4 v2:172.21.15.51:6801/1315086533' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:35.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[18426]: audit 2020-06-27T04:48:34.587861+0000 mon.a (mon.0) 1080 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:35.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[18426]: audit 2020-06-27T04:48:34.959525+0000 mon.b (mon.2) 314 : audit [INF] from='osd.6 v2:172.21.15.51:6809/3094328372' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:48:35.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[18426]: audit 2020-06-27T04:48:34.960100+0000 mon.a (mon.0) 1081 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:48:35.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[18426]: audit 2020-06-27T04:48:34.960664+0000 mon.b (mon.2) 315 : audit [INF] from='osd.6 v2:172.21.15.51:6809/3094328372' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:35.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[18426]: audit 2020-06-27T04:48:34.960957+0000 mon.a (mon.0) 1082 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:35.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[22603]: cluster 2020-06-27T04:48:34.565177+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e128: 8 total, 2 up, 8 in 2020-06-27T04:48:35.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[22603]: audit 2020-06-27T04:48:34.586693+0000 mon.b (mon.2) 312 : audit [INF] from='osd.4 v2:172.21.15.51:6801/1315086533' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:48:35.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[22603]: audit 2020-06-27T04:48:34.587090+0000 mon.a (mon.0) 1079 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:48:35.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[22603]: audit 2020-06-27T04:48:34.587603+0000 mon.b (mon.2) 313 : audit [INF] from='osd.4 v2:172.21.15.51:6801/1315086533' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:35.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[22603]: audit 2020-06-27T04:48:34.587861+0000 mon.a (mon.0) 1080 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:35.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[22603]: audit 2020-06-27T04:48:34.959525+0000 mon.b (mon.2) 314 : audit [INF] from='osd.6 v2:172.21.15.51:6809/3094328372' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:48:35.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[22603]: audit 2020-06-27T04:48:34.960100+0000 mon.a (mon.0) 1081 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:48:35.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[22603]: audit 2020-06-27T04:48:34.960664+0000 mon.b (mon.2) 315 : audit [INF] from='osd.6 v2:172.21.15.51:6809/3094328372' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:35.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:35 smithi031 bash[22603]: audit 2020-06-27T04:48:34.960957+0000 mon.a (mon.0) 1082 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: cluster 2020-06-27T04:48:35.229519+0000 mgr.x (mgr.34109) 263 : cluster [DBG] pgmap v305: 777 pgs: 2 creating+incomplete, 6 creating+down, 12 active+undersized+degraded, 3 stale+creating+incomplete, 12 stale+creating+down, 3 stale+activating+undersized, 105 peering, 19 stale+creating+peering, 1 active+recovery_wait+undersized+degraded, 95 down, 1 stale+creating+activating+undersized, 111 stale+down, 3 stale+undersized+degraded+peered, 35 stale+active+clean, 58 unknown, 18 active+undersized, 14 stale+peering, 9 stale+active+undersized+degraded, 45 undersized+degraded+peered, 19 stale+undersized+peered, 165 undersized+peered, 41 stale+active+undersized; 22 KiB data, 17 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 267/1026 objects degraded (26.023%); 0 B/s, 0 objects/s recovering 2020-06-27T04:48:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: cluster 2020-06-27T04:48:35.569243+0000 mon.a (mon.0) 1083 : cluster [WRN] Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:48:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: cluster 2020-06-27T04:48:35.574924+0000 mon.a (mon.0) 1084 : cluster [INF] osd.4 v2:172.21.15.51:6801/1315086533 boot 2020-06-27T04:48:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: cluster 2020-06-27T04:48:35.574980+0000 mon.a (mon.0) 1085 : cluster [INF] osd.6 v2:172.21.15.51:6809/3094328372 boot 2020-06-27T04:48:36.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: cluster 2020-06-27T04:48:35.575013+0000 mon.a (mon.0) 1086 : cluster [DBG] osdmap e129: 8 total, 4 up, 8 in 2020-06-27T04:48:36.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: audit 2020-06-27T04:48:35.579182+0000 mon.b (mon.2) 316 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:48:36.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: audit 2020-06-27T04:48:35.579352+0000 mon.b (mon.2) 317 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:48:36.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: cluster 2020-06-27T04:48:35.610020+0000 mon.a (mon.0) 1087 : cluster [DBG] osd.1 reported immediately failed by osd.4 2020-06-27T04:48:36.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: cluster 2020-06-27T04:48:35.610059+0000 mon.a (mon.0) 1088 : cluster [INF] osd.1 failed (root=default,host=smithi031) (connection refused reported by osd.4) 2020-06-27T04:48:36.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: cluster 2020-06-27T04:48:35.611096+0000 mon.a (mon.0) 1089 : cluster [DBG] osd.1 reported immediately failed by osd.4 2020-06-27T04:48:36.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: cluster 2020-06-27T04:48:35.637854+0000 mon.a (mon.0) 1090 : cluster [DBG] osd.1 reported immediately failed by osd.6 2020-06-27T04:48:36.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: cluster 2020-06-27T04:48:35.701821+0000 mon.a (mon.0) 1091 : cluster [DBG] osd.1 reported immediately failed by osd.6 2020-06-27T04:48:36.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: audit 2020-06-27T04:48:35.765311+0000 mon.a (mon.0) 1092 : audit [INF] from='osd.0 v2:172.21.15.31:6800/2107368217' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:48:36.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: audit 2020-06-27T04:48:35.765739+0000 mon.a (mon.0) 1093 : audit [INF] from='osd.0 v2:172.21.15.31:6800/2107368217' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:36.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: cluster 2020-06-27T04:48:35.811422+0000 mon.a (mon.0) 1094 : cluster [DBG] osd.1 reported immediately failed by osd.4 2020-06-27T04:48:36.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: cluster 2020-06-27T04:48:35.811497+0000 mon.a (mon.0) 1095 : cluster [DBG] osd.1 reported immediately failed by osd.4 2020-06-27T04:48:36.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: cluster 2020-06-27T04:48:35.838221+0000 mon.a (mon.0) 1096 : cluster [DBG] osd.1 reported immediately failed by osd.6 2020-06-27T04:48:36.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: cluster 2020-06-27T04:48:35.901964+0000 mon.a (mon.0) 1097 : cluster [DBG] osd.1 reported immediately failed by osd.6 2020-06-27T04:48:36.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: cluster 2020-06-27T04:48:36.212334+0000 mon.a (mon.0) 1098 : cluster [DBG] osd.1 reported immediately failed by osd.4 2020-06-27T04:48:36.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: cluster 2020-06-27T04:48:36.212415+0000 mon.a (mon.0) 1099 : cluster [DBG] osd.1 reported immediately failed by osd.4 2020-06-27T04:48:36.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: cluster 2020-06-27T04:48:36.239104+0000 mon.a (mon.0) 1100 : cluster [DBG] osd.1 reported immediately failed by osd.6 2020-06-27T04:48:36.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:36 smithi051 bash[18409]: cluster 2020-06-27T04:48:36.303103+0000 mon.a (mon.0) 1101 : cluster [DBG] osd.1 reported immediately failed by osd.6 2020-06-27T04:48:36.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: cluster 2020-06-27T04:48:35.229519+0000 mgr.x (mgr.34109) 263 : cluster [DBG] pgmap v305: 777 pgs: 2 creating+incomplete, 6 creating+down, 12 active+undersized+degraded, 3 stale+creating+incomplete, 12 stale+creating+down, 3 stale+activating+undersized, 105 peering, 19 stale+creating+peering, 1 active+recovery_wait+undersized+degraded, 95 down, 1 stale+creating+activating+undersized, 111 stale+down, 3 stale+undersized+degraded+peered, 35 stale+active+clean, 58 unknown, 18 active+undersized, 14 stale+peering, 9 stale+active+undersized+degraded, 45 undersized+degraded+peered, 19 stale+undersized+peered, 165 undersized+peered, 41 stale+active+undersized; 22 KiB data, 17 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 267/1026 objects degraded (26.023%); 0 B/s, 0 objects/s recovering 2020-06-27T04:48:36.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: cluster 2020-06-27T04:48:35.569243+0000 mon.a (mon.0) 1083 : cluster [WRN] Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:48:36.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: cluster 2020-06-27T04:48:35.574924+0000 mon.a (mon.0) 1084 : cluster [INF] osd.4 v2:172.21.15.51:6801/1315086533 boot 2020-06-27T04:48:36.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: cluster 2020-06-27T04:48:35.574980+0000 mon.a (mon.0) 1085 : cluster [INF] osd.6 v2:172.21.15.51:6809/3094328372 boot 2020-06-27T04:48:36.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: cluster 2020-06-27T04:48:35.575013+0000 mon.a (mon.0) 1086 : cluster [DBG] osdmap e129: 8 total, 4 up, 8 in 2020-06-27T04:48:36.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: audit 2020-06-27T04:48:35.579182+0000 mon.b (mon.2) 316 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:48:36.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: audit 2020-06-27T04:48:35.579352+0000 mon.b (mon.2) 317 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:48:36.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: cluster 2020-06-27T04:48:35.610020+0000 mon.a (mon.0) 1087 : cluster [DBG] osd.1 reported immediately failed by osd.4 2020-06-27T04:48:36.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: cluster 2020-06-27T04:48:35.610059+0000 mon.a (mon.0) 1088 : cluster [INF] osd.1 failed (root=default,host=smithi031) (connection refused reported by osd.4) 2020-06-27T04:48:36.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: cluster 2020-06-27T04:48:35.611096+0000 mon.a (mon.0) 1089 : cluster [DBG] osd.1 reported immediately failed by osd.4 2020-06-27T04:48:36.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: cluster 2020-06-27T04:48:35.637854+0000 mon.a (mon.0) 1090 : cluster [DBG] osd.1 reported immediately failed by osd.6 2020-06-27T04:48:36.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: cluster 2020-06-27T04:48:35.701821+0000 mon.a (mon.0) 1091 : cluster [DBG] osd.1 reported immediately failed by osd.6 2020-06-27T04:48:36.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: audit 2020-06-27T04:48:35.765311+0000 mon.a (mon.0) 1092 : audit [INF] from='osd.0 v2:172.21.15.31:6800/2107368217' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:48:36.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: audit 2020-06-27T04:48:35.765739+0000 mon.a (mon.0) 1093 : audit [INF] from='osd.0 v2:172.21.15.31:6800/2107368217' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:36.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: cluster 2020-06-27T04:48:35.811422+0000 mon.a (mon.0) 1094 : cluster [DBG] osd.1 reported immediately failed by osd.4 2020-06-27T04:48:36.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: cluster 2020-06-27T04:48:35.811497+0000 mon.a (mon.0) 1095 : cluster [DBG] osd.1 reported immediately failed by osd.4 2020-06-27T04:48:36.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: cluster 2020-06-27T04:48:35.838221+0000 mon.a (mon.0) 1096 : cluster [DBG] osd.1 reported immediately failed by osd.6 2020-06-27T04:48:36.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: cluster 2020-06-27T04:48:35.901964+0000 mon.a (mon.0) 1097 : cluster [DBG] osd.1 reported immediately failed by osd.6 2020-06-27T04:48:36.978 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: cluster 2020-06-27T04:48:36.212334+0000 mon.a (mon.0) 1098 : cluster [DBG] osd.1 reported immediately failed by osd.4 2020-06-27T04:48:36.978 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: cluster 2020-06-27T04:48:36.212415+0000 mon.a (mon.0) 1099 : cluster [DBG] osd.1 reported immediately failed by osd.4 2020-06-27T04:48:36.978 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: cluster 2020-06-27T04:48:36.239104+0000 mon.a (mon.0) 1100 : cluster [DBG] osd.1 reported immediately failed by osd.6 2020-06-27T04:48:36.978 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[18426]: cluster 2020-06-27T04:48:36.303103+0000 mon.a (mon.0) 1101 : cluster [DBG] osd.1 reported immediately failed by osd.6 2020-06-27T04:48:36.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: cluster 2020-06-27T04:48:35.229519+0000 mgr.x (mgr.34109) 263 : cluster [DBG] pgmap v305: 777 pgs: 2 creating+incomplete, 6 creating+down, 12 active+undersized+degraded, 3 stale+creating+incomplete, 12 stale+creating+down, 3 stale+activating+undersized, 105 peering, 19 stale+creating+peering, 1 active+recovery_wait+undersized+degraded, 95 down, 1 stale+creating+activating+undersized, 111 stale+down, 3 stale+undersized+degraded+peered, 35 stale+active+clean, 58 unknown, 18 active+undersized, 14 stale+peering, 9 stale+active+undersized+degraded, 45 undersized+degraded+peered, 19 stale+undersized+peered, 165 undersized+peered, 41 stale+active+undersized; 22 KiB data, 17 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 267/1026 objects degraded (26.023%); 0 B/s, 0 objects/s recovering 2020-06-27T04:48:36.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: cluster 2020-06-27T04:48:35.569243+0000 mon.a (mon.0) 1083 : cluster [WRN] Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:48:36.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: cluster 2020-06-27T04:48:35.574924+0000 mon.a (mon.0) 1084 : cluster [INF] osd.4 v2:172.21.15.51:6801/1315086533 boot 2020-06-27T04:48:36.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: cluster 2020-06-27T04:48:35.574980+0000 mon.a (mon.0) 1085 : cluster [INF] osd.6 v2:172.21.15.51:6809/3094328372 boot 2020-06-27T04:48:36.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: cluster 2020-06-27T04:48:35.575013+0000 mon.a (mon.0) 1086 : cluster [DBG] osdmap e129: 8 total, 4 up, 8 in 2020-06-27T04:48:36.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: audit 2020-06-27T04:48:35.579182+0000 mon.b (mon.2) 316 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:48:36.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: audit 2020-06-27T04:48:35.579352+0000 mon.b (mon.2) 317 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:48:36.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: cluster 2020-06-27T04:48:35.610020+0000 mon.a (mon.0) 1087 : cluster [DBG] osd.1 reported immediately failed by osd.4 2020-06-27T04:48:36.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: cluster 2020-06-27T04:48:35.610059+0000 mon.a (mon.0) 1088 : cluster [INF] osd.1 failed (root=default,host=smithi031) (connection refused reported by osd.4) 2020-06-27T04:48:36.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: cluster 2020-06-27T04:48:35.611096+0000 mon.a (mon.0) 1089 : cluster [DBG] osd.1 reported immediately failed by osd.4 2020-06-27T04:48:36.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: cluster 2020-06-27T04:48:35.637854+0000 mon.a (mon.0) 1090 : cluster [DBG] osd.1 reported immediately failed by osd.6 2020-06-27T04:48:36.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: cluster 2020-06-27T04:48:35.701821+0000 mon.a (mon.0) 1091 : cluster [DBG] osd.1 reported immediately failed by osd.6 2020-06-27T04:48:36.981 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: audit 2020-06-27T04:48:35.765311+0000 mon.a (mon.0) 1092 : audit [INF] from='osd.0 v2:172.21.15.31:6800/2107368217' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:48:36.981 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: audit 2020-06-27T04:48:35.765739+0000 mon.a (mon.0) 1093 : audit [INF] from='osd.0 v2:172.21.15.31:6800/2107368217' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:36.981 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: cluster 2020-06-27T04:48:35.811422+0000 mon.a (mon.0) 1094 : cluster [DBG] osd.1 reported immediately failed by osd.4 2020-06-27T04:48:36.981 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: cluster 2020-06-27T04:48:35.811497+0000 mon.a (mon.0) 1095 : cluster [DBG] osd.1 reported immediately failed by osd.4 2020-06-27T04:48:36.981 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: cluster 2020-06-27T04:48:35.838221+0000 mon.a (mon.0) 1096 : cluster [DBG] osd.1 reported immediately failed by osd.6 2020-06-27T04:48:36.982 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: cluster 2020-06-27T04:48:35.901964+0000 mon.a (mon.0) 1097 : cluster [DBG] osd.1 reported immediately failed by osd.6 2020-06-27T04:48:36.982 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: cluster 2020-06-27T04:48:36.212334+0000 mon.a (mon.0) 1098 : cluster [DBG] osd.1 reported immediately failed by osd.4 2020-06-27T04:48:36.982 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: cluster 2020-06-27T04:48:36.212415+0000 mon.a (mon.0) 1099 : cluster [DBG] osd.1 reported immediately failed by osd.4 2020-06-27T04:48:36.982 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: cluster 2020-06-27T04:48:36.239104+0000 mon.a (mon.0) 1100 : cluster [DBG] osd.1 reported immediately failed by osd.6 2020-06-27T04:48:36.982 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:36 smithi031 bash[22603]: cluster 2020-06-27T04:48:36.303103+0000 mon.a (mon.0) 1101 : cluster [DBG] osd.1 reported immediately failed by osd.6 2020-06-27T04:48:37.917 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[18409]: cluster 2020-06-27T04:48:36.586920+0000 mon.a (mon.0) 1102 : cluster [INF] osd.0 v2:172.21.15.31:6800/2107368217 boot 2020-06-27T04:48:37.918 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[18409]: cluster 2020-06-27T04:48:36.587196+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e130: 8 total, 4 up, 8 in 2020-06-27T04:48:37.918 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[18409]: audit 2020-06-27T04:48:36.587652+0000 mon.b (mon.2) 318 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:48:37.918 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:37.919 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: in thread 7fb70c3dc700 thread_name:tp_osd_tp 2020-06-27T04:48:37.919 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:37.919 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 1: (()+0x12dd0) [0x7fb7331e5dd0] 2020-06-27T04:48:37.919 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x562b1c515707] 2020-06-27T04:48:37.919 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x562b1c515aa0] 2020-06-27T04:48:37.920 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x562b1c54767a] 2020-06-27T04:48:37.920 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x562b1c548a57] 2020-06-27T04:48:37.920 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x562b1c1d3938] 2020-06-27T04:48:37.920 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x562b1c387a70] 2020-06-27T04:48:37.920 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x562b1c397dd7] 2020-06-27T04:48:37.921 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x562b1c206252] 2020-06-27T04:48:37.921 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x562b1c1a9e2e] 2020-06-27T04:48:37.921 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x562b1c02a4e9] 2020-06-27T04:48:37.921 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x562b1c28ef78] 2020-06-27T04:48:37.921 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x562b1c04970f] 2020-06-27T04:48:37.921 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x562b1c687b94] 2020-06-27T04:48:37.922 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x562b1c68a7f4] 2020-06-27T04:48:37.922 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 16: (()+0x82de) [0x7fb7331db2de] 2020-06-27T04:48:37.922 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 17: (clone()+0x43) [0x7fb731f12e83] 2020-06-27T04:48:37.922 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: debug 2020-06-27T04:48:37.700+0000 7fb70c3dc700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:37.922 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: in thread 7fb70c3dc700 thread_name:tp_osd_tp 2020-06-27T04:48:37.923 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:37.923 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 1: (()+0x12dd0) [0x7fb7331e5dd0] 2020-06-27T04:48:37.923 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x562b1c515707] 2020-06-27T04:48:37.923 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x562b1c515aa0] 2020-06-27T04:48:37.923 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x562b1c54767a] 2020-06-27T04:48:37.924 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x562b1c548a57] 2020-06-27T04:48:37.924 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x562b1c1d3938] 2020-06-27T04:48:37.924 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x562b1c387a70] 2020-06-27T04:48:37.924 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x562b1c397dd7] 2020-06-27T04:48:37.924 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x562b1c206252] 2020-06-27T04:48:37.924 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x562b1c1a9e2e] 2020-06-27T04:48:37.925 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x562b1c02a4e9] 2020-06-27T04:48:37.925 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x562b1c28ef78] 2020-06-27T04:48:37.925 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x562b1c04970f] 2020-06-27T04:48:37.925 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x562b1c687b94] 2020-06-27T04:48:37.926 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x562b1c68a7f4] 2020-06-27T04:48:37.926 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 16: (()+0x82de) [0x7fb7331db2de] 2020-06-27T04:48:37.926 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 17: (clone()+0x43) [0x7fb731f12e83] 2020-06-27T04:48:37.926 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:37.926 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: debug -9999> 2020-06-27T04:48:37.700+0000 7fb70c3dc700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:37.927 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: in thread 7fb70c3dc700 thread_name:tp_osd_tp 2020-06-27T04:48:37.927 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:37.927 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 1: (()+0x12dd0) [0x7fb7331e5dd0] 2020-06-27T04:48:37.927 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x562b1c515707] 2020-06-27T04:48:37.927 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x562b1c515aa0] 2020-06-27T04:48:37.928 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x562b1c54767a] 2020-06-27T04:48:37.928 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x562b1c548a57] 2020-06-27T04:48:37.928 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x562b1c1d3938] 2020-06-27T04:48:37.928 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x562b1c387a70] 2020-06-27T04:48:37.929 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x562b1c397dd7] 2020-06-27T04:48:37.929 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x562b1c206252] 2020-06-27T04:48:37.929 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x562b1c1a9e2e] 2020-06-27T04:48:37.929 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x562b1c02a4e9] 2020-06-27T04:48:37.929 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x562b1c28ef78] 2020-06-27T04:48:37.929 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x562b1c04970f] 2020-06-27T04:48:37.930 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x562b1c687b94] 2020-06-27T04:48:37.930 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x562b1c68a7f4] 2020-06-27T04:48:37.930 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 16: (()+0x82de) [0x7fb7331db2de] 2020-06-27T04:48:37.930 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 17: (clone()+0x43) [0x7fb731f12e83] 2020-06-27T04:48:37.930 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:37.931 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: debug -9999> 2020-06-27T04:48:37.700+0000 7fb70c3dc700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:37.931 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: in thread 7fb70c3dc700 thread_name:tp_osd_tp 2020-06-27T04:48:37.931 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:37.931 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 1: (()+0x12dd0) [0x7fb7331e5dd0] 2020-06-27T04:48:37.931 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x562b1c515707] 2020-06-27T04:48:37.932 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x562b1c515aa0] 2020-06-27T04:48:37.932 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x562b1c54767a] 2020-06-27T04:48:37.932 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x562b1c548a57] 2020-06-27T04:48:37.932 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x562b1c1d3938] 2020-06-27T04:48:37.932 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x562b1c387a70] 2020-06-27T04:48:37.932 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x562b1c397dd7] 2020-06-27T04:48:37.933 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x562b1c206252] 2020-06-27T04:48:37.933 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x562b1c1a9e2e] 2020-06-27T04:48:37.933 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x562b1c02a4e9] 2020-06-27T04:48:37.933 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x562b1c28ef78] 2020-06-27T04:48:37.933 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x562b1c04970f] 2020-06-27T04:48:37.934 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x562b1c687b94] 2020-06-27T04:48:37.934 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x562b1c68a7f4] 2020-06-27T04:48:37.934 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 16: (()+0x82de) [0x7fb7331db2de] 2020-06-27T04:48:37.934 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: 17: (clone()+0x43) [0x7fb731f12e83] 2020-06-27T04:48:37.935 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:37.935 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40181]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:37.935 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:37 smithi051 podman[40363]: 2020-06-27 04:48:37.781617245 +0000 UTC m=+5.164145608 container died dd0d560c7764c363ef4065047f73c81f28cae97c3056164b8cd0058b2979223b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:48:37.935 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:37.936 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: in thread 7f8ecfa4f700 thread_name:tp_osd_tp 2020-06-27T04:48:37.936 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:37.943 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 1: (()+0x12dd0) [0x7f8efa860dd0] 2020-06-27T04:48:37.943 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55932c92d707] 2020-06-27T04:48:37.944 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55932c92daa0] 2020-06-27T04:48:37.951 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55932c95f67a] 2020-06-27T04:48:37.952 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55932c960a57] 2020-06-27T04:48:37.952 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55932c5eb938] 2020-06-27T04:48:37.952 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55932c79c03d] 2020-06-27T04:48:37.952 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55932c5595b0] 2020-06-27T04:48:37.953 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55932c5b289d] 2020-06-27T04:48:37.953 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55932c5bb380] 2020-06-27T04:48:37.953 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55932c5c2590] 2020-06-27T04:48:37.953 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55932c4424e9] 2020-06-27T04:48:37.953 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55932c6a6f78] 2020-06-27T04:48:37.954 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55932c46170f] 2020-06-27T04:48:37.954 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55932ca9fb94] 2020-06-27T04:48:37.954 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55932caa27f4] 2020-06-27T04:48:37.954 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 17: (()+0x82de) [0x7f8efa8562de] 2020-06-27T04:48:37.954 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 18: (clone()+0x43) [0x7f8ef958de83] 2020-06-27T04:48:37.955 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: debug 2020-06-27T04:48:37.699+0000 7f8ecfa4f700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:37.955 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: in thread 7f8ecfa4f700 thread_name:tp_osd_tp 2020-06-27T04:48:37.955 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:37.956 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 1: (()+0x12dd0) [0x7f8efa860dd0] 2020-06-27T04:48:37.956 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55932c92d707] 2020-06-27T04:48:37.956 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55932c92daa0] 2020-06-27T04:48:37.956 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55932c95f67a] 2020-06-27T04:48:37.956 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55932c960a57] 2020-06-27T04:48:37.957 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55932c5eb938] 2020-06-27T04:48:37.957 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55932c79c03d] 2020-06-27T04:48:37.957 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55932c5595b0] 2020-06-27T04:48:37.957 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55932c5b289d] 2020-06-27T04:48:37.958 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55932c5bb380] 2020-06-27T04:48:37.958 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55932c5c2590] 2020-06-27T04:48:37.958 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55932c4424e9] 2020-06-27T04:48:37.958 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55932c6a6f78] 2020-06-27T04:48:37.958 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55932c46170f] 2020-06-27T04:48:37.959 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55932ca9fb94] 2020-06-27T04:48:37.959 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55932caa27f4] 2020-06-27T04:48:37.959 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 17: (()+0x82de) [0x7f8efa8562de] 2020-06-27T04:48:37.959 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 18: (clone()+0x43) [0x7f8ef958de83] 2020-06-27T04:48:37.959 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:37.959 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: debug -9999> 2020-06-27T04:48:37.699+0000 7f8ecfa4f700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:37.961 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: in thread 7f8ecfa4f700 thread_name:tp_osd_tp 2020-06-27T04:48:37.961 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:37.961 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 1: (()+0x12dd0) [0x7f8efa860dd0] 2020-06-27T04:48:37.961 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55932c92d707] 2020-06-27T04:48:37.962 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55932c92daa0] 2020-06-27T04:48:37.962 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55932c95f67a] 2020-06-27T04:48:37.962 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55932c960a57] 2020-06-27T04:48:37.962 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55932c5eb938] 2020-06-27T04:48:37.962 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55932c79c03d] 2020-06-27T04:48:37.963 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55932c5595b0] 2020-06-27T04:48:37.963 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55932c5b289d] 2020-06-27T04:48:37.963 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55932c5bb380] 2020-06-27T04:48:37.963 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55932c5c2590] 2020-06-27T04:48:37.963 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55932c4424e9] 2020-06-27T04:48:37.964 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55932c6a6f78] 2020-06-27T04:48:37.964 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55932c46170f] 2020-06-27T04:48:37.964 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55932ca9fb94] 2020-06-27T04:48:37.964 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55932caa27f4] 2020-06-27T04:48:37.964 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 17: (()+0x82de) [0x7f8efa8562de] 2020-06-27T04:48:37.965 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 18: (clone()+0x43) [0x7f8ef958de83] 2020-06-27T04:48:37.965 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:37.965 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: debug -9999> 2020-06-27T04:48:37.699+0000 7f8ecfa4f700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:37.965 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: in thread 7f8ecfa4f700 thread_name:tp_osd_tp 2020-06-27T04:48:37.965 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:37.965 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 1: (()+0x12dd0) [0x7f8efa860dd0] 2020-06-27T04:48:37.966 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55932c92d707] 2020-06-27T04:48:37.966 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55932c92daa0] 2020-06-27T04:48:37.966 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55932c95f67a] 2020-06-27T04:48:37.966 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55932c960a57] 2020-06-27T04:48:37.966 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55932c5eb938] 2020-06-27T04:48:37.967 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55932c79c03d] 2020-06-27T04:48:37.967 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55932c5595b0] 2020-06-27T04:48:37.967 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55932c5b289d] 2020-06-27T04:48:37.967 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55932c5bb380] 2020-06-27T04:48:37.967 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55932c5c2590] 2020-06-27T04:48:37.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55932c4424e9] 2020-06-27T04:48:37.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55932c6a6f78] 2020-06-27T04:48:37.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55932c46170f] 2020-06-27T04:48:37.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55932ca9fb94] 2020-06-27T04:48:37.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55932caa27f4] 2020-06-27T04:48:37.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 17: (()+0x82de) [0x7f8efa8562de] 2020-06-27T04:48:37.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: 18: (clone()+0x43) [0x7f8ef958de83] 2020-06-27T04:48:37.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:37.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 bash[40234]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:37.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:37 smithi051 podman[40475]: 2020-06-27 04:48:37.914814836 +0000 UTC m=+4.501997827 container died 23810730c18b02f05af66454e7f1c19b47671ba064fb506d71a6935fdca605d9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:48:37.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:37 smithi031 bash[18426]: cluster 2020-06-27T04:48:36.586920+0000 mon.a (mon.0) 1102 : cluster [INF] osd.0 v2:172.21.15.31:6800/2107368217 boot 2020-06-27T04:48:37.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:37 smithi031 bash[18426]: cluster 2020-06-27T04:48:36.587196+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e130: 8 total, 4 up, 8 in 2020-06-27T04:48:37.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:37 smithi031 bash[18426]: audit 2020-06-27T04:48:36.587652+0000 mon.b (mon.2) 318 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:48:37.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:37 smithi031 bash[22603]: cluster 2020-06-27T04:48:36.586920+0000 mon.a (mon.0) 1102 : cluster [INF] osd.0 v2:172.21.15.31:6800/2107368217 boot 2020-06-27T04:48:37.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:37 smithi031 bash[22603]: cluster 2020-06-27T04:48:36.587196+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e130: 8 total, 4 up, 8 in 2020-06-27T04:48:37.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:37 smithi031 bash[22603]: audit 2020-06-27T04:48:36.587652+0000 mon.b (mon.2) 318 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:48:38.611 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:38 smithi051 podman[40363]: 2020-06-27 04:48:38.356689766 +0000 UTC m=+5.739218126 container remove dd0d560c7764c363ef4065047f73c81f28cae97c3056164b8cd0058b2979223b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:48:38.612 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:38 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:38.886 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:38 smithi051 podman[40475]: 2020-06-27 04:48:38.683549268 +0000 UTC m=+5.270732248 container remove 23810730c18b02f05af66454e7f1c19b47671ba064fb506d71a6935fdca605d9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:48:38.886 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:38 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:38.886 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:38 smithi051 bash[18409]: cluster 2020-06-27T04:48:37.230859+0000 mgr.x (mgr.34109) 264 : cluster [DBG] pgmap v308: 777 pgs: 2 creating+incomplete, 7 creating+down, 12 active+undersized+degraded, 3 stale+creating+incomplete, 9 stale+creating+down, 3 stale+activating+undersized, 131 peering, 19 stale+creating+peering, 1 active+recovery_wait+undersized+degraded, 129 down, 1 stale+creating+activating+undersized, 89 stale+down, 7 stale+undersized+degraded+peered, 35 stale+active+clean, 58 unknown, 18 active+undersized, 15 stale+peering, 1 stale+active+undersized+degraded, 41 undersized+degraded+peered, 43 stale+undersized+peered, 141 undersized+peered, 12 stale+active+undersized; 18 KiB data, 17 MiB used, 707 GiB / 715 GiB avail; 2.0 KiB/s rd, 2 op/s; 252/1023 objects degraded (24.633%); 0 B/s, 0 objects/s recovering 2020-06-27T04:48:38.887 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:38 smithi051 bash[18409]: cluster 2020-06-27T04:48:37.600833+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e131: 8 total, 4 up, 8 in 2020-06-27T04:48:38.887 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:38 smithi051 bash[18409]: cluster 2020-06-27T04:48:37.751276+0000 mon.a (mon.0) 1105 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:38.887 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:38 smithi051 bash[18409]: cluster 2020-06-27T04:48:37.751332+0000 mon.a (mon.0) 1106 : cluster [INF] osd.6 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:48:38.887 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:38 smithi051 bash[18409]: cluster 2020-06-27T04:48:37.751565+0000 mon.a (mon.0) 1107 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-06-27T04:48:38.887 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:38 smithi051 bash[18409]: cluster 2020-06-27T04:48:37.751585+0000 mon.a (mon.0) 1108 : cluster [INF] osd.4 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:48:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:38 smithi031 bash[18426]: cluster 2020-06-27T04:48:37.230859+0000 mgr.x (mgr.34109) 264 : cluster [DBG] pgmap v308: 777 pgs: 2 creating+incomplete, 7 creating+down, 12 active+undersized+degraded, 3 stale+creating+incomplete, 9 stale+creating+down, 3 stale+activating+undersized, 131 peering, 19 stale+creating+peering, 1 active+recovery_wait+undersized+degraded, 129 down, 1 stale+creating+activating+undersized, 89 stale+down, 7 stale+undersized+degraded+peered, 35 stale+active+clean, 58 unknown, 18 active+undersized, 15 stale+peering, 1 stale+active+undersized+degraded, 41 undersized+degraded+peered, 43 stale+undersized+peered, 141 undersized+peered, 12 stale+active+undersized; 18 KiB data, 17 MiB used, 707 GiB / 715 GiB avail; 2.0 KiB/s rd, 2 op/s; 252/1023 objects degraded (24.633%); 0 B/s, 0 objects/s recovering 2020-06-27T04:48:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:38 smithi031 bash[18426]: cluster 2020-06-27T04:48:37.600833+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e131: 8 total, 4 up, 8 in 2020-06-27T04:48:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:38 smithi031 bash[18426]: cluster 2020-06-27T04:48:37.751276+0000 mon.a (mon.0) 1105 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:38.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:38 smithi031 bash[18426]: cluster 2020-06-27T04:48:37.751332+0000 mon.a (mon.0) 1106 : cluster [INF] osd.6 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:48:38.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:38 smithi031 bash[18426]: cluster 2020-06-27T04:48:37.751565+0000 mon.a (mon.0) 1107 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-06-27T04:48:38.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:38 smithi031 bash[18426]: cluster 2020-06-27T04:48:37.751585+0000 mon.a (mon.0) 1108 : cluster [INF] osd.4 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:48:38.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:38 smithi031 bash[22603]: cluster 2020-06-27T04:48:37.230859+0000 mgr.x (mgr.34109) 264 : cluster [DBG] pgmap v308: 777 pgs: 2 creating+incomplete, 7 creating+down, 12 active+undersized+degraded, 3 stale+creating+incomplete, 9 stale+creating+down, 3 stale+activating+undersized, 131 peering, 19 stale+creating+peering, 1 active+recovery_wait+undersized+degraded, 129 down, 1 stale+creating+activating+undersized, 89 stale+down, 7 stale+undersized+degraded+peered, 35 stale+active+clean, 58 unknown, 18 active+undersized, 15 stale+peering, 1 stale+active+undersized+degraded, 41 undersized+degraded+peered, 43 stale+undersized+peered, 141 undersized+peered, 12 stale+active+undersized; 18 KiB data, 17 MiB used, 707 GiB / 715 GiB avail; 2.0 KiB/s rd, 2 op/s; 252/1023 objects degraded (24.633%); 0 B/s, 0 objects/s recovering 2020-06-27T04:48:38.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:38 smithi031 bash[22603]: cluster 2020-06-27T04:48:37.600833+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e131: 8 total, 4 up, 8 in 2020-06-27T04:48:38.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:38 smithi031 bash[22603]: cluster 2020-06-27T04:48:37.751276+0000 mon.a (mon.0) 1105 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:38.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:38 smithi031 bash[22603]: cluster 2020-06-27T04:48:37.751332+0000 mon.a (mon.0) 1106 : cluster [INF] osd.6 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:48:38.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:38 smithi031 bash[22603]: cluster 2020-06-27T04:48:37.751565+0000 mon.a (mon.0) 1107 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-06-27T04:48:38.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:38 smithi031 bash[22603]: cluster 2020-06-27T04:48:37.751585+0000 mon.a (mon.0) 1108 : cluster [INF] osd.4 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:48:39.138 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:39 smithi051 podman[41262]: 2020-06-27 04:48:39.077767723 +0000 UTC m=+0.377533508 container create 667488cff37d96a73668c6774304e5da4187bb1a77e285e313460be8682cc89a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:39.138 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:38 smithi051 podman[41238]: 2020-06-27 04:48:38.8835106 +0000 UTC m=+0.506676863 container create aa95e658445776a36ba54a00e64318293b73538bc586281bb4985ef9aa582095 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:39.139 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:39 smithi051 podman[41238]: 2020-06-27 04:48:39.102824242 +0000 UTC m=+0.725990421 container init aa95e658445776a36ba54a00e64318293b73538bc586281bb4985ef9aa582095 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:39.139 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:39 smithi051 podman[41238]: 2020-06-27 04:48:39.136115464 +0000 UTC m=+0.759281627 container start aa95e658445776a36ba54a00e64318293b73538bc586281bb4985ef9aa582095 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:39.139 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:39 smithi051 podman[41238]: 2020-06-27 04:48:39.136185145 +0000 UTC m=+0.759351346 container attach aa95e658445776a36ba54a00e64318293b73538bc586281bb4985ef9aa582095 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:39.468 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:39 smithi051 podman[41262]: 2020-06-27 04:48:39.286079484 +0000 UTC m=+0.585845273 container init 667488cff37d96a73668c6774304e5da4187bb1a77e285e313460be8682cc89a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:39.469 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:39 smithi051 podman[41262]: 2020-06-27 04:48:39.319422489 +0000 UTC m=+0.619188263 container start 667488cff37d96a73668c6774304e5da4187bb1a77e285e313460be8682cc89a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:39.469 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:39 smithi051 podman[41262]: 2020-06-27 04:48:39.319547392 +0000 UTC m=+0.619313187 container attach 667488cff37d96a73668c6774304e5da4187bb1a77e285e313460be8682cc89a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:39.469 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:39 smithi051 podman[41238]: 2020-06-27 04:48:39.381708785 +0000 UTC m=+1.004874983 container died aa95e658445776a36ba54a00e64318293b73538bc586281bb4985ef9aa582095 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:39.968 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:39 smithi051 podman[41238]: 2020-06-27 04:48:39.840855811 +0000 UTC m=+1.464021996 container remove aa95e658445776a36ba54a00e64318293b73538bc586281bb4985ef9aa582095 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:39.968 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:39 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Failed with result 'exit-code'. 2020-06-27T04:48:39.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:39 smithi051 bash[18409]: cluster 2020-06-27T04:48:38.606196+0000 mon.a (mon.0) 1109 : cluster [DBG] osdmap e132: 8 total, 2 up, 8 in 2020-06-27T04:48:39.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:39 smithi051 bash[18409]: cluster 2020-06-27T04:48:39.384800+0000 mon.a (mon.0) 1110 : cluster [WRN] Health check update: Reduced data availability: 147 pgs inactive, 234 pgs down, 19 pgs peering, 5 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:48:39.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:39 smithi051 bash[18409]: cluster 2020-06-27T04:48:39.384864+0000 mon.a (mon.0) 1111 : cluster [WRN] Health check update: Degraded data redundancy: 252/1023 objects degraded (24.633%), 62 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:39.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:39 smithi051 bash[18409]: cluster 2020-06-27T04:48:39.385262+0000 mon.a (mon.0) 1112 : cluster [INF] pool 'test-rados-api-smithi031-41123-3' no longer out of quota; removing NO_QUOTA flag 2020-06-27T04:48:39.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:39 smithi051 bash[18409]: cluster 2020-06-27T04:48:39.385657+0000 mon.a (mon.0) 1113 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2020-06-27T04:48:39.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:39 smithi051 bash[18409]: cluster 2020-06-27T04:48:39.390360+0000 mon.a (mon.0) 1114 : cluster [DBG] osdmap e133: 8 total, 2 up, 8 in 2020-06-27T04:48:39.970 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:39 smithi051 podman[41262]: 2020-06-27 04:48:39.72873774 +0000 UTC m=+1.028503541 container died 667488cff37d96a73668c6774304e5da4187bb1a77e285e313460be8682cc89a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:39.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:39 smithi031 bash[18426]: cluster 2020-06-27T04:48:38.606196+0000 mon.a (mon.0) 1109 : cluster [DBG] osdmap e132: 8 total, 2 up, 8 in 2020-06-27T04:48:39.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:39 smithi031 bash[18426]: cluster 2020-06-27T04:48:39.384800+0000 mon.a (mon.0) 1110 : cluster [WRN] Health check update: Reduced data availability: 147 pgs inactive, 234 pgs down, 19 pgs peering, 5 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:48:39.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:39 smithi031 bash[18426]: cluster 2020-06-27T04:48:39.384864+0000 mon.a (mon.0) 1111 : cluster [WRN] Health check update: Degraded data redundancy: 252/1023 objects degraded (24.633%), 62 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:39.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:39 smithi031 bash[18426]: cluster 2020-06-27T04:48:39.385262+0000 mon.a (mon.0) 1112 : cluster [INF] pool 'test-rados-api-smithi031-41123-3' no longer out of quota; removing NO_QUOTA flag 2020-06-27T04:48:39.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:39 smithi031 bash[18426]: cluster 2020-06-27T04:48:39.385657+0000 mon.a (mon.0) 1113 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2020-06-27T04:48:39.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:39 smithi031 bash[18426]: cluster 2020-06-27T04:48:39.390360+0000 mon.a (mon.0) 1114 : cluster [DBG] osdmap e133: 8 total, 2 up, 8 in 2020-06-27T04:48:39.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:39 smithi031 bash[22603]: cluster 2020-06-27T04:48:38.606196+0000 mon.a (mon.0) 1109 : cluster [DBG] osdmap e132: 8 total, 2 up, 8 in 2020-06-27T04:48:39.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:39 smithi031 bash[22603]: cluster 2020-06-27T04:48:39.384800+0000 mon.a (mon.0) 1110 : cluster [WRN] Health check update: Reduced data availability: 147 pgs inactive, 234 pgs down, 19 pgs peering, 5 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:48:39.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:39 smithi031 bash[22603]: cluster 2020-06-27T04:48:39.384864+0000 mon.a (mon.0) 1111 : cluster [WRN] Health check update: Degraded data redundancy: 252/1023 objects degraded (24.633%), 62 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:39.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:39 smithi031 bash[22603]: cluster 2020-06-27T04:48:39.385262+0000 mon.a (mon.0) 1112 : cluster [INF] pool 'test-rados-api-smithi031-41123-3' no longer out of quota; removing NO_QUOTA flag 2020-06-27T04:48:39.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:39 smithi031 bash[22603]: cluster 2020-06-27T04:48:39.385657+0000 mon.a (mon.0) 1113 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2020-06-27T04:48:39.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:39 smithi031 bash[22603]: cluster 2020-06-27T04:48:39.390360+0000 mon.a (mon.0) 1114 : cluster [DBG] osdmap e133: 8 total, 2 up, 8 in 2020-06-27T04:48:39.975 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:39 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:39.976 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:39 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 4. 2020-06-27T04:48:39.976 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:39 smithi031 systemd[1]: Stopped Ceph osd.3 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:39.976 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:39 smithi031 systemd[1]: Starting Ceph osd.3 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:48:39.976 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:39 smithi031 podman[111578]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3 found: no such container 2020-06-27T04:48:39.976 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:39 smithi031 systemd[1]: Started Ceph osd.3 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:40.292 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:40 smithi031 podman[111593]: 2020-06-27 04:48:40.048592906 +0000 UTC m=+0.260637274 container create 948d0cbc819158da9b1653829ce187340e5b24e41521ef43c15c8f6dd16fb0e3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:48:40.293 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:40 smithi031 podman[111593]: 2020-06-27 04:48:40.215488668 +0000 UTC m=+0.427533017 container init 948d0cbc819158da9b1653829ce187340e5b24e41521ef43c15c8f6dd16fb0e3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:48:40.293 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:39 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:40.293 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:39 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Scheduled restart job, restart counter is at 4. 2020-06-27T04:48:40.294 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:39 smithi031 systemd[1]: Stopped Ceph osd.2 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:40.294 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:39 smithi031 systemd[1]: Starting Ceph osd.2 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:48:40.294 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:40 smithi031 podman[111609]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2 found: no such container 2020-06-27T04:48:40.294 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:40 smithi031 systemd[1]: Started Ceph osd.2 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:40.468 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:40 smithi051 podman[41262]: 2020-06-27 04:48:40.150812176 +0000 UTC m=+1.450577976 container remove 667488cff37d96a73668c6774304e5da4187bb1a77e285e313460be8682cc89a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:40.468 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:40 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2020-06-27T04:48:40.622 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:40 smithi031 podman[111626]: 2020-06-27 04:48:40.440210059 +0000 UTC m=+0.399745147 container create 9c01c60750aa0b218ad256eef40dca67b9cb7b3d4bb2bc782052d7a63f5c54f6 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:48:40.623 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:40 smithi031 podman[111593]: 2020-06-27 04:48:40.290300295 +0000 UTC m=+0.502344642 container start 948d0cbc819158da9b1653829ce187340e5b24e41521ef43c15c8f6dd16fb0e3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:48:40.623 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:40 smithi031 podman[111593]: 2020-06-27 04:48:40.290376059 +0000 UTC m=+0.502420424 container attach 948d0cbc819158da9b1653829ce187340e5b24e41521ef43c15c8f6dd16fb0e3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:48:40.623 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:40 smithi031 bash[111591]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-06-27T04:48:40.623 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:40 smithi031 bash[111591]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2020-06-27T04:48:40.624 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:40 smithi031 bash[111591]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2020-06-27T04:48:40.624 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:40 smithi031 bash[111591]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2020-06-27T04:48:40.624 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:40 smithi031 bash[111591]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2020-06-27T04:48:40.624 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:40 smithi031 bash[111591]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-06-27T04:48:40.624 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:40 smithi031 bash[111591]: --> ceph-volume lvm activate successful for osd ID: 3 2020-06-27T04:48:40.624 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:40 smithi031 podman[111593]: 2020-06-27 04:48:40.533348376 +0000 UTC m=+0.745392728 container died 948d0cbc819158da9b1653829ce187340e5b24e41521ef43c15c8f6dd16fb0e3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:48:40.796 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:40 smithi051 bash[18409]: cluster 2020-06-27T04:48:39.231946+0000 mgr.x (mgr.34109) 265 : cluster [DBG] pgmap v311: 777 pgs: 7 creating+peering, 3 creating+down, 6 active+undersized+degraded, 5 stale+creating+incomplete, 13 stale+creating+down, 3 stale+activating+undersized, 110 peering, 19 stale+creating+peering, 62 down, 1 stale+creating+activating+undersized, 149 stale+down, 7 stale+undersized+degraded+peered, 18 stale+active+clean, 47 unknown, 41 active+undersized, 110 stale+peering, 31 undersized+degraded+peered, 7 active+clean, 43 stale+undersized+peered, 90 undersized+peered, 5 stale+active+undersized; 18 KiB data, 18 MiB used, 707 GiB / 715 GiB avail; 173/1023 objects degraded (16.911%) 2020-06-27T04:48:40.796 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:40 smithi051 bash[18409]: cluster 2020-06-27T04:48:40.400363+0000 mon.a (mon.0) 1115 : cluster [DBG] osdmap e134: 8 total, 2 up, 8 in 2020-06-27T04:48:40.797 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:40 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:40.797 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:40 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Scheduled restart job, restart counter is at 5. 2020-06-27T04:48:40.797 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:40 smithi051 systemd[1]: Stopped Ceph osd.5 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:40.797 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:40 smithi051 systemd[1]: Starting Ceph osd.5 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:48:40.798 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:40 smithi051 podman[41392]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5 found: no such container 2020-06-27T04:48:40.798 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:40 smithi051 systemd[1]: Started Ceph osd.5 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:40.973 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:40 smithi031 podman[111626]: 2020-06-27 04:48:40.723506429 +0000 UTC m=+0.683041515 container init 9c01c60750aa0b218ad256eef40dca67b9cb7b3d4bb2bc782052d7a63f5c54f6 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:48:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:40 smithi031 bash[18426]: cluster 2020-06-27T04:48:39.231946+0000 mgr.x (mgr.34109) 265 : cluster [DBG] pgmap v311: 777 pgs: 7 creating+peering, 3 creating+down, 6 active+undersized+degraded, 5 stale+creating+incomplete, 13 stale+creating+down, 3 stale+activating+undersized, 110 peering, 19 stale+creating+peering, 62 down, 1 stale+creating+activating+undersized, 149 stale+down, 7 stale+undersized+degraded+peered, 18 stale+active+clean, 47 unknown, 41 active+undersized, 110 stale+peering, 31 undersized+degraded+peered, 7 active+clean, 43 stale+undersized+peered, 90 undersized+peered, 5 stale+active+undersized; 18 KiB data, 18 MiB used, 707 GiB / 715 GiB avail; 173/1023 objects degraded (16.911%) 2020-06-27T04:48:40.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:40 smithi031 bash[18426]: cluster 2020-06-27T04:48:40.400363+0000 mon.a (mon.0) 1115 : cluster [DBG] osdmap e134: 8 total, 2 up, 8 in 2020-06-27T04:48:40.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:40 smithi031 bash[22603]: cluster 2020-06-27T04:48:39.231946+0000 mgr.x (mgr.34109) 265 : cluster [DBG] pgmap v311: 777 pgs: 7 creating+peering, 3 creating+down, 6 active+undersized+degraded, 5 stale+creating+incomplete, 13 stale+creating+down, 3 stale+activating+undersized, 110 peering, 19 stale+creating+peering, 62 down, 1 stale+creating+activating+undersized, 149 stale+down, 7 stale+undersized+degraded+peered, 18 stale+active+clean, 47 unknown, 41 active+undersized, 110 stale+peering, 31 undersized+degraded+peered, 7 active+clean, 43 stale+undersized+peered, 90 undersized+peered, 5 stale+active+undersized; 18 KiB data, 18 MiB used, 707 GiB / 715 GiB avail; 173/1023 objects degraded (16.911%) 2020-06-27T04:48:40.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:40 smithi031 bash[22603]: cluster 2020-06-27T04:48:40.400363+0000 mon.a (mon.0) 1115 : cluster [DBG] osdmap e134: 8 total, 2 up, 8 in 2020-06-27T04:48:41.153 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:40 smithi051 podman[41409]: 2020-06-27 04:48:40.794237747 +0000 UTC m=+0.265345812 container create e385244c39e5814ef67f01c9137303c6e71899a617ce002a0415826990235ba8 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:48:41.154 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:40 smithi051 podman[41409]: 2020-06-27 04:48:40.90259991 +0000 UTC m=+0.373708081 container init e385244c39e5814ef67f01c9137303c6e71899a617ce002a0415826990235ba8 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:48:41.154 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:40 smithi051 podman[41409]: 2020-06-27 04:48:40.935844346 +0000 UTC m=+0.406952420 container start e385244c39e5814ef67f01c9137303c6e71899a617ce002a0415826990235ba8 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:48:41.154 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:40 smithi051 podman[41409]: 2020-06-27 04:48:40.935928211 +0000 UTC m=+0.407036304 container attach e385244c39e5814ef67f01c9137303c6e71899a617ce002a0415826990235ba8 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:48:41.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:41 smithi051 bash[41407]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-06-27T04:48:41.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:41 smithi051 bash[41407]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2020-06-27T04:48:41.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:41 smithi051 bash[41407]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2020-06-27T04:48:41.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:41 smithi051 bash[41407]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2020-06-27T04:48:41.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:41 smithi051 bash[41407]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2020-06-27T04:48:41.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:41 smithi051 bash[41407]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-06-27T04:48:41.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:41 smithi051 bash[41407]: --> ceph-volume lvm activate successful for osd ID: 5 2020-06-27T04:48:41.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:41 smithi051 podman[41409]: 2020-06-27 04:48:41.20457116 +0000 UTC m=+0.675679240 container died e385244c39e5814ef67f01c9137303c6e71899a617ce002a0415826990235ba8 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:48:41.473 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:41 smithi031 podman[111626]: 2020-06-27 04:48:41.023434345 +0000 UTC m=+0.982969430 container start 9c01c60750aa0b218ad256eef40dca67b9cb7b3d4bb2bc782052d7a63f5c54f6 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:48:41.473 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:41 smithi031 podman[111626]: 2020-06-27 04:48:41.023510182 +0000 UTC m=+0.983045272 container attach 9c01c60750aa0b218ad256eef40dca67b9cb7b3d4bb2bc782052d7a63f5c54f6 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:48:41.473 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:41 smithi031 bash[111624]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-06-27T04:48:41.474 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:41 smithi031 bash[111624]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2020-06-27T04:48:41.474 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:41 smithi031 bash[111624]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2020-06-27T04:48:41.474 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:41 smithi031 bash[111624]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2020-06-27T04:48:41.474 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:41 smithi031 bash[111624]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2020-06-27T04:48:41.474 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:41 smithi031 bash[111624]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-06-27T04:48:41.475 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:41 smithi031 bash[111624]: --> ceph-volume lvm activate successful for osd ID: 2 2020-06-27T04:48:41.475 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:41 smithi031 podman[111626]: 2020-06-27 04:48:41.202352477 +0000 UTC m=+1.161887571 container died 9c01c60750aa0b218ad256eef40dca67b9cb7b3d4bb2bc782052d7a63f5c54f6 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:48:41.857 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:41 smithi031 bash[18426]: cluster 2020-06-27T04:48:41.620210+0000 mon.a (mon.0) 1116 : cluster [WRN] Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:48:41.857 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:41 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:41.857 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:41 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Scheduled restart job, restart counter is at 4. 2020-06-27T04:48:41.858 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:41 smithi031 systemd[1]: Stopped Ceph osd.1 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:41.858 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:41 smithi031 systemd[1]: Starting Ceph osd.1 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:48:41.858 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:41 smithi031 bash[22603]: cluster 2020-06-27T04:48:41.620210+0000 mon.a (mon.0) 1116 : cluster [WRN] Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:48:41.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:41 smithi051 bash[18409]: cluster 2020-06-27T04:48:41.620210+0000 mon.a (mon.0) 1116 : cluster [WRN] Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:48:41.968 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:41 smithi051 podman[41409]: 2020-06-27 04:48:41.672345298 +0000 UTC m=+1.143453384 container remove e385244c39e5814ef67f01c9137303c6e71899a617ce002a0415826990235ba8 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-activate) 2020-06-27T04:48:41.968 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:41 smithi051 bash[41407]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5 found: no such container 2020-06-27T04:48:41.968 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:41 smithi051 bash[41407]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5 2020-06-27T04:48:41.969 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:41 smithi051 bash[41407]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5" found: no such container 2020-06-27T04:48:42.223 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:42 smithi031 podman[111757]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1 found: no such container 2020-06-27T04:48:42.223 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:42 smithi031 systemd[1]: Started Ceph osd.1 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:42.223 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:41 smithi031 podman[111593]: 2020-06-27 04:48:41.854652512 +0000 UTC m=+2.066696893 container remove 948d0cbc819158da9b1653829ce187340e5b24e41521ef43c15c8f6dd16fb0e3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:48:42.224 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:42 smithi031 bash[111591]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3 found: no such container 2020-06-27T04:48:42.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 podman[41520]: 2020-06-27 04:48:42.01076472 +0000 UTC m=+0.242207072 container create 4398c3d77b96361a176d89a98470371034a81ec0eb4a4f1faac0ce46113e4021 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:48:42.468 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 podman[41520]: 2020-06-27 04:48:42.127437247 +0000 UTC m=+0.358879490 container init 4398c3d77b96361a176d89a98470371034a81ec0eb4a4f1faac0ce46113e4021 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:48:42.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 podman[41520]: 2020-06-27 04:48:42.190325753 +0000 UTC m=+0.421768000 container start 4398c3d77b96361a176d89a98470371034a81ec0eb4a4f1faac0ce46113e4021 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:48:42.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 podman[41520]: 2020-06-27 04:48:42.19040207 +0000 UTC m=+0.421844318 container attach 4398c3d77b96361a176d89a98470371034a81ec0eb4a4f1faac0ce46113e4021 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:48:42.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 10 -- 172.21.15.51:0/367594036 shutdown 172.21.15.51:0/367594036 2020-06-27T04:48:42.469 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 10 Processor -- stop 2020-06-27T04:48:42.470 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 20 Event(0x55c1cdccce00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:42.470 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 1 -- 172.21.15.51:0/367594036 shutdown_connections 2020-06-27T04:48:42.470 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 5 -- 172.21.15.51:0/367594036 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55c1cdd38c00 2020-06-27T04:48:42.470 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 1 --2- 172.21.15.51:0/367594036 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55c1cdd38c00 0x55c1cdca9400 unknown :-1 s=CLOSED pgs=3531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:42.470 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 5 -- 172.21.15.51:0/367594036 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55c1cdd39400 2020-06-27T04:48:42.471 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 1 --2- 172.21.15.51:0/367594036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55c1cdd39400 0x55c1cdcaa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:42.471 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 5 -- 172.21.15.51:0/367594036 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55c1cdd39000 2020-06-27T04:48:42.471 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 1 --2- 172.21.15.51:0/367594036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c1cdd39000 0x55c1cdca9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:42.471 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 5 -- 172.21.15.51:0/367594036 shutdown_connections delete 0x55c1cdd38c00 2020-06-27T04:48:42.471 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 5 -- 172.21.15.51:0/367594036 shutdown_connections delete 0x55c1cdd39000 2020-06-27T04:48:42.471 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 5 -- 172.21.15.51:0/367594036 shutdown_connections delete 0x55c1cdd39400 2020-06-27T04:48:42.472 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 1 -- 172.21.15.51:0/367594036 >> 172.21.15.51:0/367594036 conn(0x55c1cdd38800 msgr2=0x55c1cdda1000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:48:42.472 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 20 --1- 172.21.15.51:0/367594036 >> 172.21.15.51:0/367594036 conn(0x55c1cdd38800 0x55c1cdda1000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:42.472 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 2 --1- 172.21.15.51:0/367594036 >> 172.21.15.51:0/367594036 conn(0x55c1cdd38800 0x55c1cdda1000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:42.472 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 5 --1- 172.21.15.51:0/367594036 >> 172.21.15.51:0/367594036 conn(0x55c1cdd38800 0x55c1cdda1000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:48:42.472 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 20 Event(0x55c1cdccce00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:42.473 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 10 --1- 172.21.15.51:0/367594036 >> 172.21.15.51:0/367594036 conn(0x55c1cdd38800 0x55c1cdda1000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:48:42.473 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 20 Event(0x55c1cdccce00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:42.473 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 20 Event(0x55c1cdccd040 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:42.473 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 20 Event(0x55c1cdccd280 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:42.473 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c4e148700 5 --1- 172.21.15.51:0/367594036 >> 172.21.15.51:0/367594036 conn(0x55c1cdd38800 0x55c1cdda1000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:48:42.474 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c4e148700 5 --1- 172.21.15.51:0/367594036 >> 172.21.15.51:0/367594036 conn(0x55c1cdd38800 0x55c1cdda1000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:48:42.474 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.149+0000 7f4c543c5f40 10 -- 172.21.15.51:0/367594036 wait: waiting for dispatch queue 2020-06-27T04:48:42.474 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.150+0000 7f4c543c5f40 10 -- 172.21.15.51:0/367594036 wait: dispatch queue is stopped 2020-06-27T04:48:42.474 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.150+0000 7f4c543c5f40 1 -- 172.21.15.51:0/367594036 shutdown_connections 2020-06-27T04:48:42.474 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.150+0000 7f4c543c5f40 5 -- 172.21.15.51:0/367594036 shutdown_connections delete 0x55c1cdd38800 2020-06-27T04:48:42.475 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.150+0000 7f4c543c5f40 20 Event(0x55c1cdccce00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:42.475 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.150+0000 7f4c543c5f40 20 Event(0x55c1cdccd040 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:42.475 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.150+0000 7f4c543c5f40 20 Event(0x55c1cdccd280 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:42.475 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.150+0000 7f4c543c5f40 10 -- 172.21.15.51:0/367594036 wait: done. 2020-06-27T04:48:42.475 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.150+0000 7f4c543c5f40 1 -- 172.21.15.51:0/367594036 wait complete. 2020-06-27T04:48:42.607 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:42 smithi031 podman[111803]: 2020-06-27 04:48:42.473209783 +0000 UTC m=+0.406919235 container create 96062b75782b223c920e2441f17da15e93406a1d1e4bc5acdd895739d062d5c7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:48:42.608 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:42 smithi031 podman[111626]: 2020-06-27 04:48:42.256682031 +0000 UTC m=+2.216217134 container remove 9c01c60750aa0b218ad256eef40dca67b9cb7b3d4bb2bc782052d7a63f5c54f6 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:48:42.608 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:42 smithi031 bash[111624]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2 found: no such container 2020-06-27T04:48:42.608 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:42 smithi031 bash[111591]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3 2020-06-27T04:48:42.608 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:42 smithi031 bash[111591]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3" found: no such container 2020-06-27T04:48:42.892 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:42 smithi031 bash[22603]: cluster 2020-06-27T04:48:41.233469+0000 mgr.x (mgr.34109) 266 : cluster [DBG] pgmap v314: 777 pgs: 7 creating+peering, 5 creating+down, 21 active+undersized+degraded, 3 stale+creating+incomplete, 12 stale+creating+down, 80 peering, 19 stale+creating+peering, 82 down, 1 stale+creating+activating+undersized, 113 stale+down, 13 stale+active+clean, 25 unknown, 74 active+undersized, 89 stale+peering, 40 undersized+degraded+peered, 7 active+clean, 11 stale+undersized+peered, 171 undersized+peered, 4 stale+active+undersized; 19 KiB data, 18 MiB used, 707 GiB / 715 GiB avail; 1.5 KiB/s wr, 1 op/s; 222/1041 objects degraded (21.326%) 2020-06-27T04:48:42.892 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:42 smithi031 bash[111624]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2 2020-06-27T04:48:42.893 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:42 smithi031 bash[111624]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2" found: no such container 2020-06-27T04:48:42.893 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:42 smithi031 bash[18426]: cluster 2020-06-27T04:48:41.233469+0000 mgr.x (mgr.34109) 266 : cluster [DBG] pgmap v314: 777 pgs: 7 creating+peering, 5 creating+down, 21 active+undersized+degraded, 3 stale+creating+incomplete, 12 stale+creating+down, 80 peering, 19 stale+creating+peering, 82 down, 1 stale+creating+activating+undersized, 113 stale+down, 13 stale+active+clean, 25 unknown, 74 active+undersized, 89 stale+peering, 40 undersized+degraded+peered, 7 active+clean, 11 stale+undersized+peered, 171 undersized+peered, 4 stale+active+undersized; 19 KiB data, 18 MiB used, 707 GiB / 715 GiB avail; 1.5 KiB/s wr, 1 op/s; 222/1041 objects degraded (21.326%) 2020-06-27T04:48:42.893 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:42 smithi031 podman[111803]: 2020-06-27 04:48:42.69821107 +0000 UTC m=+0.631920519 container init 96062b75782b223c920e2441f17da15e93406a1d1e4bc5acdd895739d062d5c7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:48:42.893 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:42 smithi031 podman[111803]: 2020-06-27 04:48:42.748189932 +0000 UTC m=+0.681899372 container start 96062b75782b223c920e2441f17da15e93406a1d1e4bc5acdd895739d062d5c7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:48:42.894 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:42 smithi031 podman[111803]: 2020-06-27 04:48:42.74827122 +0000 UTC m=+0.681980697 container attach 96062b75782b223c920e2441f17da15e93406a1d1e4bc5acdd895739d062d5c7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:48:42.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[18409]: cluster 2020-06-27T04:48:41.233469+0000 mgr.x (mgr.34109) 266 : cluster [DBG] pgmap v314: 777 pgs: 7 creating+peering, 5 creating+down, 21 active+undersized+degraded, 3 stale+creating+incomplete, 12 stale+creating+down, 80 peering, 19 stale+creating+peering, 82 down, 1 stale+creating+activating+undersized, 113 stale+down, 13 stale+active+clean, 25 unknown, 74 active+undersized, 89 stale+peering, 40 undersized+degraded+peered, 7 active+clean, 11 stale+undersized+peered, 171 undersized+peered, 4 stale+active+undersized; 19 KiB data, 18 MiB used, 707 GiB / 715 GiB avail; 1.5 KiB/s wr, 1 op/s; 222/1041 objects degraded (21.326%) 2020-06-27T04:48:42.968 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:42 smithi051 bash[41407]: debug 2020-06-27T04:48:42.667+0000 7f4c543c5f40 -1 Falling back to public interface 2020-06-27T04:48:43.152 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 podman[111898]: 2020-06-27 04:48:43.123120062 +0000 UTC m=+0.420878790 container create 34a49be92896c51eb50324d79d4b48ea69a72bd4361b07572ea076accb8517cd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:48:43.153 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:42 smithi031 bash[111794]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-06-27T04:48:43.153 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:42 smithi031 bash[111794]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2020-06-27T04:48:43.153 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:42 smithi031 bash[111794]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2020-06-27T04:48:43.153 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:42 smithi031 bash[111794]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2020-06-27T04:48:43.154 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:42 smithi031 bash[111794]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2020-06-27T04:48:43.154 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:42 smithi031 bash[111794]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-06-27T04:48:43.154 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:42 smithi031 bash[111794]: --> ceph-volume lvm activate successful for osd ID: 1 2020-06-27T04:48:43.154 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:43 smithi031 podman[111803]: 2020-06-27 04:48:43.150429659 +0000 UTC m=+1.084139118 container died 96062b75782b223c920e2441f17da15e93406a1d1e4bc5acdd895739d062d5c7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:48:43.154 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:42 smithi031 podman[111829]: 2020-06-27 04:48:42.889805837 +0000 UTC m=+0.615265207 container create 7dc11472cc84a493bba182205fb9913b5dee92d87cbf01bbb035b72e8f5a2a15 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:48:43.692 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:43 smithi051 bash[41407]: debug 2020-06-27T04:48:43.353+0000 7f4c543c5f40 -1 osd.5 122 log_to_monitors {default=true} 2020-06-27T04:48:43.693 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:43 smithi051 bash[18409]: audit 2020-06-27T04:48:43.357860+0000 mon.b (mon.2) 319 : audit [INF] from='osd.5 v2:172.21.15.51:6801/399181689' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:48:43.693 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:43 smithi051 bash[18409]: audit 2020-06-27T04:48:43.358448+0000 mon.a (mon.0) 1117 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:48:43.818 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[18426]: audit 2020-06-27T04:48:43.357860+0000 mon.b (mon.2) 319 : audit [INF] from='osd.5 v2:172.21.15.51:6801/399181689' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:48:43.818 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[18426]: audit 2020-06-27T04:48:43.358448+0000 mon.a (mon.0) 1117 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:48:43.819 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[18426]: audit 2020-06-27T04:48:43.359014+0000 mon.b (mon.2) 320 : audit [INF] from='osd.5 v2:172.21.15.51:6801/399181689' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:43.819 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[18426]: audit 2020-06-27T04:48:43.359284+0000 mon.a (mon.0) 1118 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:43.819 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 podman[111898]: 2020-06-27 04:48:43.519667135 +0000 UTC m=+0.817425964 container init 34a49be92896c51eb50324d79d4b48ea69a72bd4361b07572ea076accb8517cd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:48:43.819 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 podman[111898]: 2020-06-27 04:48:43.657089369 +0000 UTC m=+0.954848079 container start 34a49be92896c51eb50324d79d4b48ea69a72bd4361b07572ea076accb8517cd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:48:43.820 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 podman[111898]: 2020-06-27 04:48:43.657181163 +0000 UTC m=+0.954939902 container attach 34a49be92896c51eb50324d79d4b48ea69a72bd4361b07572ea076accb8517cd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:48:43.820 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe066b44700 5 --2- 172.21.15.31:0/2280139515 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e08cc21000 0x55e08cb91e00 secure :-1 s=CLOSED pgs=2496 cs=0 l=1 rev1=1 rx=0x55e08cba3a70 tx=0x55e08cb70c00).reset_recv_state (warped) reseting crypto handlers 2020-06-27T04:48:43.820 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe066b44700 5 --2- 172.21.15.31:0/2280139515 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e08cc21000 0x55e08cb91e00 secure :-1 s=CLOSED pgs=2496 cs=0 l=1 rev1=1 rx=0x55e08cba3a70 tx=0x55e08cb70c00).reset_security 2020-06-27T04:48:43.820 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe066b44700 20 EpollDriver.del_event del event fd=15 cur_mask=1 delmask=3 to 11 2020-06-27T04:48:43.820 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 10 -- 172.21.15.31:0/2280139515 shutdown 172.21.15.31:0/2280139515 2020-06-27T04:48:43.821 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 10 Processor -- stop 2020-06-27T04:48:43.821 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 20 Event(0x55e08cbb4e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:43.821 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 1 -- 172.21.15.31:0/2280139515 shutdown_connections 2020-06-27T04:48:43.821 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 5 -- 172.21.15.31:0/2280139515 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55e08cc21400 2020-06-27T04:48:43.821 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 1 --2- 172.21.15.31:0/2280139515 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55e08cc21400 0x55e08cb92300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:43.822 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 5 -- 172.21.15.31:0/2280139515 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55e08cc20c00 2020-06-27T04:48:43.822 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 1 --2- 172.21.15.31:0/2280139515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e08cc20c00 0x55e08cb91400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:43.822 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 5 -- 172.21.15.31:0/2280139515 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55e08cc21000 2020-06-27T04:48:43.822 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 1 --2- 172.21.15.31:0/2280139515 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e08cc21000 0x55e08cb91e00 unknown :-1 s=CLOSED pgs=2496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:43.822 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 5 -- 172.21.15.31:0/2280139515 shutdown_connections delete 0x55e08cc20c00 2020-06-27T04:48:43.823 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 5 -- 172.21.15.31:0/2280139515 shutdown_connections delete 0x55e08cc21000 2020-06-27T04:48:43.823 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 5 -- 172.21.15.31:0/2280139515 shutdown_connections delete 0x55e08cc21400 2020-06-27T04:48:43.823 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 1 -- 172.21.15.31:0/2280139515 >> 172.21.15.31:0/2280139515 conn(0x55e08cc20800 msgr2=0x55e08cc89000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:48:43.823 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 20 --1- 172.21.15.31:0/2280139515 >> 172.21.15.31:0/2280139515 conn(0x55e08cc20800 0x55e08cc89000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:43.823 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 2 --1- 172.21.15.31:0/2280139515 >> 172.21.15.31:0/2280139515 conn(0x55e08cc20800 0x55e08cc89000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:43.824 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 5 --1- 172.21.15.31:0/2280139515 >> 172.21.15.31:0/2280139515 conn(0x55e08cc20800 0x55e08cc89000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:48:43.824 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 20 Event(0x55e08cbb4e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:43.824 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 10 --1- 172.21.15.31:0/2280139515 >> 172.21.15.31:0/2280139515 conn(0x55e08cc20800 0x55e08cc89000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:48:43.824 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 20 Event(0x55e08cbb5040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:43.824 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 20 Event(0x55e08cbb5280 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:43.825 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe067b46700 5 --1- 172.21.15.31:0/2280139515 >> 172.21.15.31:0/2280139515 conn(0x55e08cc20800 0x55e08cc89000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:48:43.825 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe067b46700 5 --1- 172.21.15.31:0/2280139515 >> 172.21.15.31:0/2280139515 conn(0x55e08cc20800 0x55e08cc89000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:48:43.825 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 10 -- 172.21.15.31:0/2280139515 wait: waiting for dispatch queue 2020-06-27T04:48:43.825 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 10 -- 172.21.15.31:0/2280139515 wait: dispatch queue is stopped 2020-06-27T04:48:43.825 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 1 -- 172.21.15.31:0/2280139515 shutdown_connections 2020-06-27T04:48:43.825 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 5 -- 172.21.15.31:0/2280139515 shutdown_connections delete 0x55e08cc20800 2020-06-27T04:48:43.826 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 20 Event(0x55e08cbb4e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:43.826 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 20 Event(0x55e08cbb5040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:43.826 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 20 Event(0x55e08cbb5280 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:43.826 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 10 -- 172.21.15.31:0/2280139515 wait: done. 2020-06-27T04:48:43.826 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111624]: debug 2020-06-27T04:48:43.545+0000 7fe06ddc3f40 1 -- 172.21.15.31:0/2280139515 wait complete. 2020-06-27T04:48:43.827 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 podman[111829]: 2020-06-27 04:48:43.756913787 +0000 UTC m=+1.482373114 container init 7dc11472cc84a493bba182205fb9913b5dee92d87cbf01bbb035b72e8f5a2a15 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:48:43.827 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[22603]: audit 2020-06-27T04:48:43.357860+0000 mon.b (mon.2) 319 : audit [INF] from='osd.5 v2:172.21.15.51:6801/399181689' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:48:43.827 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[22603]: audit 2020-06-27T04:48:43.358448+0000 mon.a (mon.0) 1117 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-06-27T04:48:43.827 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[22603]: audit 2020-06-27T04:48:43.359014+0000 mon.b (mon.2) 320 : audit [INF] from='osd.5 v2:172.21.15.51:6801/399181689' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:43.828 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[22603]: audit 2020-06-27T04:48:43.359284+0000 mon.a (mon.0) 1118 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:43.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:43 smithi051 bash[18409]: audit 2020-06-27T04:48:43.359014+0000 mon.b (mon.2) 320 : audit [INF] from='osd.5 v2:172.21.15.51:6801/399181689' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:43.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:43 smithi051 bash[18409]: audit 2020-06-27T04:48:43.359284+0000 mon.a (mon.0) 1118 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:44.070 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:43 smithi031 podman[111803]: 2020-06-27 04:48:43.815612648 +0000 UTC m=+1.749322126 container remove 96062b75782b223c920e2441f17da15e93406a1d1e4bc5acdd895739d062d5c7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:48:44.070 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111794]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1 found: no such container 2020-06-27T04:48:44.070 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111794]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1 2020-06-27T04:48:44.070 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111794]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1" found: no such container 2020-06-27T04:48:44.071 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 podman[111829]: 2020-06-27 04:48:43.823009522 +0000 UTC m=+1.548468854 container start 7dc11472cc84a493bba182205fb9913b5dee92d87cbf01bbb035b72e8f5a2a15 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:48:44.071 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 podman[111829]: 2020-06-27 04:48:43.823093479 +0000 UTC m=+1.548552801 container attach 7dc11472cc84a493bba182205fb9913b5dee92d87cbf01bbb035b72e8f5a2a15 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:48:44.071 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd12dd3e700 5 --2- 172.21.15.31:0/1351951629 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55b58fd11000 0x55b58fc81e00 secure :-1 s=CLOSED pgs=2497 cs=0 l=1 rev1=1 rx=0x55b58fc93a70 tx=0x55b58fc60c00).reset_recv_state (warped) reseting crypto handlers 2020-06-27T04:48:44.071 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd12dd3e700 5 --2- 172.21.15.31:0/1351951629 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55b58fd11000 0x55b58fc81e00 secure :-1 s=CLOSED pgs=2497 cs=0 l=1 rev1=1 rx=0x55b58fc93a70 tx=0x55b58fc60c00).reset_security 2020-06-27T04:48:44.071 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd12dd3e700 20 EpollDriver.del_event del event fd=15 cur_mask=1 delmask=3 to 11 2020-06-27T04:48:44.072 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 10 -- 172.21.15.31:0/1351951629 shutdown 172.21.15.31:0/1351951629 2020-06-27T04:48:44.072 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 10 Processor -- stop 2020-06-27T04:48:44.072 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 20 Event(0x55b58fca4e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:44.072 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 1 -- 172.21.15.31:0/1351951629 shutdown_connections 2020-06-27T04:48:44.072 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 5 -- 172.21.15.31:0/1351951629 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55b58fd11400 2020-06-27T04:48:44.073 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 1 --2- 172.21.15.31:0/1351951629 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55b58fd11400 0x55b58fc82300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:44.073 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 5 -- 172.21.15.31:0/1351951629 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55b58fd10c00 2020-06-27T04:48:44.073 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 1 --2- 172.21.15.31:0/1351951629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b58fd10c00 0x55b58fc81400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:44.073 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 5 -- 172.21.15.31:0/1351951629 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55b58fd11000 2020-06-27T04:48:44.073 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 1 --2- 172.21.15.31:0/1351951629 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55b58fd11000 0x55b58fc81e00 unknown :-1 s=CLOSED pgs=2497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:44.074 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 5 -- 172.21.15.31:0/1351951629 shutdown_connections delete 0x55b58fd10c00 2020-06-27T04:48:44.074 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 5 -- 172.21.15.31:0/1351951629 shutdown_connections delete 0x55b58fd11000 2020-06-27T04:48:44.074 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 5 -- 172.21.15.31:0/1351951629 shutdown_connections delete 0x55b58fd11400 2020-06-27T04:48:44.074 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 1 -- 172.21.15.31:0/1351951629 >> 172.21.15.31:0/1351951629 conn(0x55b58fd10800 msgr2=0x55b58fd79000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:48:44.074 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 20 --1- 172.21.15.31:0/1351951629 >> 172.21.15.31:0/1351951629 conn(0x55b58fd10800 0x55b58fd79000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:44.075 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 2 --1- 172.21.15.31:0/1351951629 >> 172.21.15.31:0/1351951629 conn(0x55b58fd10800 0x55b58fd79000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:44.075 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 5 --1- 172.21.15.31:0/1351951629 >> 172.21.15.31:0/1351951629 conn(0x55b58fd10800 0x55b58fd79000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:48:44.076 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 20 Event(0x55b58fca4e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:44.077 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 10 --1- 172.21.15.31:0/1351951629 >> 172.21.15.31:0/1351951629 conn(0x55b58fd10800 0x55b58fd79000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:48:44.077 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 20 Event(0x55b58fca5040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:44.077 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 20 Event(0x55b58fca5280 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:44.077 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd12ed40700 5 --1- 172.21.15.31:0/1351951629 >> 172.21.15.31:0/1351951629 conn(0x55b58fd10800 0x55b58fd79000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:48:44.078 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd12ed40700 5 --1- 172.21.15.31:0/1351951629 >> 172.21.15.31:0/1351951629 conn(0x55b58fd10800 0x55b58fd79000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:48:44.078 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 10 -- 172.21.15.31:0/1351951629 wait: waiting for dispatch queue 2020-06-27T04:48:44.078 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 10 -- 172.21.15.31:0/1351951629 wait: dispatch queue is stopped 2020-06-27T04:48:44.078 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 1 -- 172.21.15.31:0/1351951629 shutdown_connections 2020-06-27T04:48:44.078 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 5 -- 172.21.15.31:0/1351951629 shutdown_connections delete 0x55b58fd10800 2020-06-27T04:48:44.079 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 20 Event(0x55b58fca4e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:44.079 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 20 Event(0x55b58fca5040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:44.079 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 20 Event(0x55b58fca5280 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:44.079 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 10 -- 172.21.15.31:0/1351951629 wait: done. 2020-06-27T04:48:44.079 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:43 smithi031 bash[111591]: debug 2020-06-27T04:48:43.781+0000 7fd134fbdf40 1 -- 172.21.15.31:0/1351951629 wait complete. 2020-06-27T04:48:44.350 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111624]: debug 2020-06-27T04:48:44.067+0000 7fe06ddc3f40 -1 Falling back to public interface 2020-06-27T04:48:44.350 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 podman[112073]: 2020-06-27 04:48:44.173030402 +0000 UTC m=+0.260700867 container create bfeb3b4c595f9beeedeb3be7eb249947dff832562b5a6f14d462d4c6f7c26d50 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:48:44.351 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 podman[112073]: 2020-06-27 04:48:44.31469507 +0000 UTC m=+0.402365559 container init bfeb3b4c595f9beeedeb3be7eb249947dff832562b5a6f14d462d4c6f7c26d50 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:48:44.351 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 podman[112073]: 2020-06-27 04:48:44.347901358 +0000 UTC m=+0.435571735 container start bfeb3b4c595f9beeedeb3be7eb249947dff832562b5a6f14d462d4c6f7c26d50 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:48:44.351 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 10 -- 172.21.15.31:0/33599357 shutdown 172.21.15.31:0/33599357 2020-06-27T04:48:44.351 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111591]: debug 2020-06-27T04:48:44.298+0000 7fd134fbdf40 -1 Falling back to public interface 2020-06-27T04:48:44.693 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[18426]: cluster 2020-06-27T04:48:43.235811+0000 mgr.x (mgr.34109) 267 : cluster [DBG] pgmap v315: 777 pgs: 5 creating+down, 23 active+undersized+degraded, 3 stale+creating+incomplete, 12 stale+creating+down, 18 stale+creating+peering, 81 down, 1 stale+creating+activating+undersized, 113 stale+down, 13 stale+active+clean, 23 unknown, 61 active+undersized, 82 stale+peering, 64 undersized+degraded+peered, 11 stale+undersized+peered, 263 undersized+peered, 4 stale+active+undersized; 19 KiB data, 18 MiB used, 707 GiB / 715 GiB avail; 1.1 KiB/s wr, 1 op/s; 356/1041 objects degraded (34.198%) 2020-06-27T04:48:44.694 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[18426]: cluster 2020-06-27T04:48:43.674773+0000 mon.a (mon.0) 1119 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:48:44.694 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[18426]: cluster 2020-06-27T04:48:43.678980+0000 mon.a (mon.0) 1120 : cluster [INF] osd.5 v2:172.21.15.51:6801/399181689 boot 2020-06-27T04:48:44.694 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 10 Processor -- stop 2020-06-27T04:48:44.694 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 20 Event(0x558f4ebe0e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:44.695 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 1 -- 172.21.15.31:0/33599357 shutdown_connections 2020-06-27T04:48:44.695 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 5 -- 172.21.15.31:0/33599357 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x558f4ec4cc00 2020-06-27T04:48:44.695 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 1 --2- 172.21.15.31:0/33599357 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x558f4ec4cc00 0x558f4ebbd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:44.695 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 5 -- 172.21.15.31:0/33599357 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x558f4ec4d400 2020-06-27T04:48:44.695 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 1 --2- 172.21.15.31:0/33599357 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x558f4ec4d400 0x558f4ebbe300 unknown :-1 s=CLOSED pgs=2498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:44.696 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 5 -- 172.21.15.31:0/33599357 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x558f4ec4d000 2020-06-27T04:48:44.696 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 1 --2- 172.21.15.31:0/33599357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f4ec4d000 0x558f4ebbde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:44.696 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 5 -- 172.21.15.31:0/33599357 shutdown_connections delete 0x558f4ec4cc00 2020-06-27T04:48:44.696 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 5 -- 172.21.15.31:0/33599357 shutdown_connections delete 0x558f4ec4d000 2020-06-27T04:48:44.696 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 5 -- 172.21.15.31:0/33599357 shutdown_connections delete 0x558f4ec4d400 2020-06-27T04:48:44.696 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 podman[112073]: 2020-06-27 04:48:44.347976292 +0000 UTC m=+0.435646719 container attach bfeb3b4c595f9beeedeb3be7eb249947dff832562b5a6f14d462d4c6f7c26d50 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:48:44.697 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 1 -- 172.21.15.31:0/33599357 >> 172.21.15.31:0/33599357 conn(0x558f4ec4c800 msgr2=0x558f4ecb5000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:48:44.697 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 20 --1- 172.21.15.31:0/33599357 >> 172.21.15.31:0/33599357 conn(0x558f4ec4c800 0x558f4ecb5000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:44.697 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 2 --1- 172.21.15.31:0/33599357 >> 172.21.15.31:0/33599357 conn(0x558f4ec4c800 0x558f4ecb5000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:44.697 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 5 --1- 172.21.15.31:0/33599357 >> 172.21.15.31:0/33599357 conn(0x558f4ec4c800 0x558f4ecb5000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:48:44.697 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 20 Event(0x558f4ebe0e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:44.698 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f2adf700 5 --1- 172.21.15.31:0/33599357 >> 172.21.15.31:0/33599357 conn(0x558f4ec4c800 0x558f4ecb5000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:48:44.698 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 10 --1- 172.21.15.31:0/33599357 >> 172.21.15.31:0/33599357 conn(0x558f4ec4c800 0x558f4ecb5000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:48:44.698 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 20 Event(0x558f4ebe0e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:44.698 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 20 Event(0x558f4ebe1040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:44.698 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f2adf700 5 --1- 172.21.15.31:0/33599357 >> 172.21.15.31:0/33599357 conn(0x558f4ec4c800 0x558f4ecb5000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:48:44.699 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 20 Event(0x558f4ebe1280 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:44.699 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 10 -- 172.21.15.31:0/33599357 wait: waiting for dispatch queue 2020-06-27T04:48:44.699 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 10 -- 172.21.15.31:0/33599357 wait: dispatch queue is stopped 2020-06-27T04:48:44.699 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 1 -- 172.21.15.31:0/33599357 shutdown_connections 2020-06-27T04:48:44.699 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 5 -- 172.21.15.31:0/33599357 shutdown_connections delete 0x558f4ec4c800 2020-06-27T04:48:44.700 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 20 Event(0x558f4ebe0e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:44.700 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 20 Event(0x558f4ebe1040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:44.700 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 20 Event(0x558f4ebe1280 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:44.700 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 10 -- 172.21.15.31:0/33599357 wait: done. 2020-06-27T04:48:44.700 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.337+0000 7f55f8d5cf40 1 -- 172.21.15.31:0/33599357 wait complete. 2020-06-27T04:48:44.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[18409]: cluster 2020-06-27T04:48:43.235811+0000 mgr.x (mgr.34109) 267 : cluster [DBG] pgmap v315: 777 pgs: 5 creating+down, 23 active+undersized+degraded, 3 stale+creating+incomplete, 12 stale+creating+down, 18 stale+creating+peering, 81 down, 1 stale+creating+activating+undersized, 113 stale+down, 13 stale+active+clean, 23 unknown, 61 active+undersized, 82 stale+peering, 64 undersized+degraded+peered, 11 stale+undersized+peered, 263 undersized+peered, 4 stale+active+undersized; 19 KiB data, 18 MiB used, 707 GiB / 715 GiB avail; 1.1 KiB/s wr, 1 op/s; 356/1041 objects degraded (34.198%) 2020-06-27T04:48:44.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[18409]: cluster 2020-06-27T04:48:43.674773+0000 mon.a (mon.0) 1119 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:48:44.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[18409]: cluster 2020-06-27T04:48:43.678980+0000 mon.a (mon.0) 1120 : cluster [INF] osd.5 v2:172.21.15.51:6801/399181689 boot 2020-06-27T04:48:44.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[18409]: cluster 2020-06-27T04:48:43.679033+0000 mon.a (mon.0) 1121 : cluster [DBG] osdmap e135: 8 total, 3 up, 8 in 2020-06-27T04:48:44.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[18409]: audit 2020-06-27T04:48:43.680471+0000 mon.b (mon.2) 321 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:48:44.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[18409]: cluster 2020-06-27T04:48:44.386310+0000 mon.a (mon.0) 1122 : cluster [WRN] Health check update: Reduced data availability: 128 pgs inactive, 211 pgs down, 11 pgs peering, 3 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:48:44.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[18409]: cluster 2020-06-27T04:48:44.386339+0000 mon.a (mon.0) 1123 : cluster [WRN] Health check update: Degraded data redundancy: 356/1041 objects degraded (34.198%), 87 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:44.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[18409]: cluster 2020-06-27T04:48:44.679578+0000 mon.a (mon.0) 1124 : cluster [DBG] osdmap e136: 8 total, 3 up, 8 in 2020-06-27T04:48:44.970 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:44.970 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: in thread 7f4c28b2a700 thread_name:tp_osd_tp 2020-06-27T04:48:44.970 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:44.971 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 1: (()+0x12dd0) [0x7f4c52138dd0] 2020-06-27T04:48:44.971 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55c1c3cd6707] 2020-06-27T04:48:44.971 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55c1c3cd6aa0] 2020-06-27T04:48:44.971 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55c1c3d0867a] 2020-06-27T04:48:44.971 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55c1c3d09a57] 2020-06-27T04:48:44.971 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55c1c3994938] 2020-06-27T04:48:44.972 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55c1c3b4503d] 2020-06-27T04:48:44.972 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55c1c39025b0] 2020-06-27T04:48:44.972 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55c1c395b89d] 2020-06-27T04:48:44.972 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55c1c3964380] 2020-06-27T04:48:44.972 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55c1c396b590] 2020-06-27T04:48:44.973 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55c1c37eb4e9] 2020-06-27T04:48:44.973 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55c1c3a4ff78] 2020-06-27T04:48:44.973 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55c1c380a70f] 2020-06-27T04:48:44.973 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55c1c3e48b94] 2020-06-27T04:48:44.973 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55c1c3e4b7f4] 2020-06-27T04:48:44.974 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 17: (()+0x82de) [0x7f4c5212e2de] 2020-06-27T04:48:44.974 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 18: (clone()+0x43) [0x7f4c50e65e83] 2020-06-27T04:48:44.974 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: debug 2020-06-27T04:48:44.749+0000 7f4c28b2a700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:44.974 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: in thread 7f4c28b2a700 thread_name:tp_osd_tp 2020-06-27T04:48:44.974 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:44.975 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 1: (()+0x12dd0) [0x7f4c52138dd0] 2020-06-27T04:48:44.975 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55c1c3cd6707] 2020-06-27T04:48:44.975 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55c1c3cd6aa0] 2020-06-27T04:48:44.975 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55c1c3d0867a] 2020-06-27T04:48:44.975 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55c1c3d09a57] 2020-06-27T04:48:44.976 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55c1c3994938] 2020-06-27T04:48:44.976 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55c1c3b4503d] 2020-06-27T04:48:44.977 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55c1c39025b0] 2020-06-27T04:48:44.977 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55c1c395b89d] 2020-06-27T04:48:44.977 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55c1c3964380] 2020-06-27T04:48:44.977 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55c1c396b590] 2020-06-27T04:48:44.977 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55c1c37eb4e9] 2020-06-27T04:48:44.978 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55c1c3a4ff78] 2020-06-27T04:48:44.978 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55c1c380a70f] 2020-06-27T04:48:44.978 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55c1c3e48b94] 2020-06-27T04:48:44.978 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55c1c3e4b7f4] 2020-06-27T04:48:44.978 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 17: (()+0x82de) [0x7f4c5212e2de] 2020-06-27T04:48:44.978 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 18: (clone()+0x43) [0x7f4c50e65e83] 2020-06-27T04:48:44.979 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:44.979 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: debug -9999> 2020-06-27T04:48:44.749+0000 7f4c28b2a700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:44.979 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: in thread 7f4c28b2a700 thread_name:tp_osd_tp 2020-06-27T04:48:44.979 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:44.980 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 1: (()+0x12dd0) [0x7f4c52138dd0] 2020-06-27T04:48:44.980 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55c1c3cd6707] 2020-06-27T04:48:44.980 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55c1c3cd6aa0] 2020-06-27T04:48:44.980 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55c1c3d0867a] 2020-06-27T04:48:44.980 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55c1c3d09a57] 2020-06-27T04:48:44.981 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55c1c3994938] 2020-06-27T04:48:44.981 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55c1c3b4503d] 2020-06-27T04:48:44.981 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55c1c39025b0] 2020-06-27T04:48:44.981 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55c1c395b89d] 2020-06-27T04:48:44.981 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55c1c3964380] 2020-06-27T04:48:44.982 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55c1c396b590] 2020-06-27T04:48:44.982 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55c1c37eb4e9] 2020-06-27T04:48:44.982 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55c1c3a4ff78] 2020-06-27T04:48:44.982 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55c1c380a70f] 2020-06-27T04:48:44.982 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55c1c3e48b94] 2020-06-27T04:48:44.983 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55c1c3e4b7f4] 2020-06-27T04:48:44.983 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 17: (()+0x82de) [0x7f4c5212e2de] 2020-06-27T04:48:44.983 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 18: (clone()+0x43) [0x7f4c50e65e83] 2020-06-27T04:48:44.983 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:44.983 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: debug -9999> 2020-06-27T04:48:44.749+0000 7f4c28b2a700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:44.983 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: in thread 7f4c28b2a700 thread_name:tp_osd_tp 2020-06-27T04:48:44.984 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:44.984 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 1: (()+0x12dd0) [0x7f4c52138dd0] 2020-06-27T04:48:44.984 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55c1c3cd6707] 2020-06-27T04:48:44.985 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55c1c3cd6aa0] 2020-06-27T04:48:44.985 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55c1c3d0867a] 2020-06-27T04:48:44.985 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55c1c3d09a57] 2020-06-27T04:48:44.985 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55c1c3994938] 2020-06-27T04:48:44.985 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55c1c3b4503d] 2020-06-27T04:48:44.986 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55c1c39025b0] 2020-06-27T04:48:44.986 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55c1c395b89d] 2020-06-27T04:48:44.986 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55c1c3964380] 2020-06-27T04:48:44.986 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55c1c396b590] 2020-06-27T04:48:44.987 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55c1c37eb4e9] 2020-06-27T04:48:44.987 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55c1c3a4ff78] 2020-06-27T04:48:44.987 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55c1c380a70f] 2020-06-27T04:48:44.987 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55c1c3e48b94] 2020-06-27T04:48:44.987 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55c1c3e4b7f4] 2020-06-27T04:48:44.987 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 17: (()+0x82de) [0x7f4c5212e2de] 2020-06-27T04:48:44.989 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: 18: (clone()+0x43) [0x7f4c50e65e83] 2020-06-27T04:48:44.989 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:44.989 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 bash[41407]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:44.989 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:44 smithi051 podman[41520]: 2020-06-27 04:48:44.836737292 +0000 UTC m=+3.068179574 container died 4398c3d77b96361a176d89a98470371034a81ec0eb4a4f1faac0ce46113e4021 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:48:44.990 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111794]: debug 2020-06-27T04:48:44.859+0000 7f55f8d5cf40 -1 Falling back to public interface 2020-06-27T04:48:44.990 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111624]: debug 2020-06-27T04:48:44.783+0000 7fe06ddc3f40 -1 osd.2 119 log_to_monitors {default=true} 2020-06-27T04:48:44.991 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[18426]: cluster 2020-06-27T04:48:43.679033+0000 mon.a (mon.0) 1121 : cluster [DBG] osdmap e135: 8 total, 3 up, 8 in 2020-06-27T04:48:44.991 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[18426]: audit 2020-06-27T04:48:43.680471+0000 mon.b (mon.2) 321 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:48:44.991 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[18426]: cluster 2020-06-27T04:48:44.386310+0000 mon.a (mon.0) 1122 : cluster [WRN] Health check update: Reduced data availability: 128 pgs inactive, 211 pgs down, 11 pgs peering, 3 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:48:44.991 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[18426]: cluster 2020-06-27T04:48:44.386339+0000 mon.a (mon.0) 1123 : cluster [WRN] Health check update: Degraded data redundancy: 356/1041 objects degraded (34.198%), 87 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:44.991 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[18426]: cluster 2020-06-27T04:48:44.679578+0000 mon.a (mon.0) 1124 : cluster [DBG] osdmap e136: 8 total, 3 up, 8 in 2020-06-27T04:48:44.992 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[22603]: cluster 2020-06-27T04:48:43.235811+0000 mgr.x (mgr.34109) 267 : cluster [DBG] pgmap v315: 777 pgs: 5 creating+down, 23 active+undersized+degraded, 3 stale+creating+incomplete, 12 stale+creating+down, 18 stale+creating+peering, 81 down, 1 stale+creating+activating+undersized, 113 stale+down, 13 stale+active+clean, 23 unknown, 61 active+undersized, 82 stale+peering, 64 undersized+degraded+peered, 11 stale+undersized+peered, 263 undersized+peered, 4 stale+active+undersized; 19 KiB data, 18 MiB used, 707 GiB / 715 GiB avail; 1.1 KiB/s wr, 1 op/s; 356/1041 objects degraded (34.198%) 2020-06-27T04:48:44.992 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[22603]: cluster 2020-06-27T04:48:43.674773+0000 mon.a (mon.0) 1119 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:48:44.992 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[22603]: cluster 2020-06-27T04:48:43.678980+0000 mon.a (mon.0) 1120 : cluster [INF] osd.5 v2:172.21.15.51:6801/399181689 boot 2020-06-27T04:48:44.992 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[22603]: cluster 2020-06-27T04:48:43.679033+0000 mon.a (mon.0) 1121 : cluster [DBG] osdmap e135: 8 total, 3 up, 8 in 2020-06-27T04:48:44.992 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[22603]: audit 2020-06-27T04:48:43.680471+0000 mon.b (mon.2) 321 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-06-27T04:48:44.993 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[22603]: cluster 2020-06-27T04:48:44.386310+0000 mon.a (mon.0) 1122 : cluster [WRN] Health check update: Reduced data availability: 128 pgs inactive, 211 pgs down, 11 pgs peering, 3 pgs incomplete (PG_AVAILABILITY) 2020-06-27T04:48:44.993 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[22603]: cluster 2020-06-27T04:48:44.386339+0000 mon.a (mon.0) 1123 : cluster [WRN] Health check update: Degraded data redundancy: 356/1041 objects degraded (34.198%), 87 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:44.993 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[22603]: cluster 2020-06-27T04:48:44.679578+0000 mon.a (mon.0) 1124 : cluster [DBG] osdmap e136: 8 total, 3 up, 8 in 2020-06-27T04:48:45.472 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:44 smithi031 bash[111591]: debug 2020-06-27T04:48:44.995+0000 7fd134fbdf40 -1 osd.3 119 log_to_monitors {default=true} 2020-06-27T04:48:45.529 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:45 smithi051 podman[41520]: 2020-06-27 04:48:45.243296806 +0000 UTC m=+3.474739097 container remove 4398c3d77b96361a176d89a98470371034a81ec0eb4a4f1faac0ce46113e4021 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5) 2020-06-27T04:48:45.529 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:45 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:45.942 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:45 smithi051 podman[41930]: 2020-06-27 04:48:45.526874723 +0000 UTC m=+0.264638256 container create 4c832810ba01c901b25b8cfb950dc66825720d0a35933bc7bdacce8493480f62 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:48:45.942 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:45 smithi051 podman[41930]: 2020-06-27 04:48:45.643403646 +0000 UTC m=+0.381167078 container init 4c832810ba01c901b25b8cfb950dc66825720d0a35933bc7bdacce8493480f62 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:48:45.943 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:45 smithi051 podman[41930]: 2020-06-27 04:48:45.676764009 +0000 UTC m=+0.414527452 container start 4c832810ba01c901b25b8cfb950dc66825720d0a35933bc7bdacce8493480f62 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:48:45.943 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:45 smithi051 podman[41930]: 2020-06-27 04:48:45.67688386 +0000 UTC m=+0.414647318 container attach 4c832810ba01c901b25b8cfb950dc66825720d0a35933bc7bdacce8493480f62 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:48:45.943 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:45 smithi051 bash[18409]: audit 2020-06-27T04:48:44.788499+0000 mon.a (mon.0) 1125 : audit [INF] from='osd.2 v2:172.21.15.31:6804/2797585562' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:48:45.943 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:45 smithi051 bash[18409]: audit 2020-06-27T04:48:44.788869+0000 mon.a (mon.0) 1126 : audit [INF] from='osd.2 v2:172.21.15.31:6804/2797585562' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:45.944 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:45 smithi051 bash[18409]: cluster 2020-06-27T04:48:44.799033+0000 mon.a (mon.0) 1127 : cluster [DBG] osd.5 reported immediately failed by osd.7 2020-06-27T04:48:45.944 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:45 smithi051 bash[18409]: cluster 2020-06-27T04:48:44.799100+0000 mon.a (mon.0) 1128 : cluster [INF] osd.5 failed (root=default,host=smithi051) (connection refused reported by osd.7) 2020-06-27T04:48:45.944 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:45 smithi051 bash[18409]: audit 2020-06-27T04:48:45.001104+0000 mon.a (mon.0) 1129 : audit [INF] from='osd.3 v2:172.21.15.31:6808/1956328585' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:48:45.944 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:45 smithi051 bash[18409]: audit 2020-06-27T04:48:45.001495+0000 mon.a (mon.0) 1130 : audit [INF] from='osd.3 v2:172.21.15.31:6808/1956328585' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:45.944 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:45 smithi051 bash[18409]: audit 2020-06-27T04:48:45.570922+0000 mon.c (mon.1) 77 : audit [INF] from='osd.1 v2:172.21.15.31:6812/2611180398' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:48:45.945 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:45 smithi051 bash[18409]: audit 2020-06-27T04:48:45.571203+0000 mon.a (mon.0) 1131 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:48:45.945 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:45 smithi051 bash[18409]: audit 2020-06-27T04:48:45.571710+0000 mon.c (mon.1) 78 : audit [INF] from='osd.1 v2:172.21.15.31:6812/2611180398' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:45.945 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:45 smithi051 bash[18409]: audit 2020-06-27T04:48:45.571944+0000 mon.a (mon.0) 1132 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:45.945 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:45 smithi051 bash[18409]: cluster 2020-06-27T04:48:45.683617+0000 mon.a (mon.0) 1133 : cluster [INF] osd.2 v2:172.21.15.31:6804/2797585562 boot 2020-06-27T04:48:45.945 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:45 smithi051 bash[18409]: cluster 2020-06-27T04:48:45.683700+0000 mon.a (mon.0) 1134 : cluster [INF] osd.3 v2:172.21.15.31:6808/1956328585 boot 2020-06-27T04:48:45.946 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:45 smithi051 bash[18409]: cluster 2020-06-27T04:48:45.683746+0000 mon.a (mon.0) 1135 : cluster [INF] osd.1 v2:172.21.15.31:6812/2611180398 boot 2020-06-27T04:48:45.946 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:45 smithi051 bash[18409]: cluster 2020-06-27T04:48:45.683768+0000 mon.a (mon.0) 1136 : cluster [DBG] osdmap e137: 8 total, 5 up, 8 in 2020-06-27T04:48:45.946 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:45 smithi051 bash[18409]: audit 2020-06-27T04:48:45.683789+0000 mon.b (mon.2) 322 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:48:45.946 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:45 smithi051 bash[18409]: audit 2020-06-27T04:48:45.684159+0000 mon.b (mon.2) 323 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:48:45.946 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:45 smithi051 bash[18409]: audit 2020-06-27T04:48:45.684435+0000 mon.b (mon.2) 324 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:48:45.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[18426]: audit 2020-06-27T04:48:44.788499+0000 mon.a (mon.0) 1125 : audit [INF] from='osd.2 v2:172.21.15.31:6804/2797585562' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:48:45.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[18426]: audit 2020-06-27T04:48:44.788869+0000 mon.a (mon.0) 1126 : audit [INF] from='osd.2 v2:172.21.15.31:6804/2797585562' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:45.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[18426]: cluster 2020-06-27T04:48:44.799033+0000 mon.a (mon.0) 1127 : cluster [DBG] osd.5 reported immediately failed by osd.7 2020-06-27T04:48:45.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[18426]: cluster 2020-06-27T04:48:44.799100+0000 mon.a (mon.0) 1128 : cluster [INF] osd.5 failed (root=default,host=smithi051) (connection refused reported by osd.7) 2020-06-27T04:48:45.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[18426]: audit 2020-06-27T04:48:45.001104+0000 mon.a (mon.0) 1129 : audit [INF] from='osd.3 v2:172.21.15.31:6808/1956328585' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:48:45.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[18426]: audit 2020-06-27T04:48:45.001495+0000 mon.a (mon.0) 1130 : audit [INF] from='osd.3 v2:172.21.15.31:6808/1956328585' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:45.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[18426]: audit 2020-06-27T04:48:45.570922+0000 mon.c (mon.1) 77 : audit [INF] from='osd.1 v2:172.21.15.31:6812/2611180398' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:48:45.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[18426]: audit 2020-06-27T04:48:45.571203+0000 mon.a (mon.0) 1131 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:48:45.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[18426]: audit 2020-06-27T04:48:45.571710+0000 mon.c (mon.1) 78 : audit [INF] from='osd.1 v2:172.21.15.31:6812/2611180398' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:45.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[18426]: audit 2020-06-27T04:48:45.571944+0000 mon.a (mon.0) 1132 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:45.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[18426]: cluster 2020-06-27T04:48:45.683617+0000 mon.a (mon.0) 1133 : cluster [INF] osd.2 v2:172.21.15.31:6804/2797585562 boot 2020-06-27T04:48:45.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[18426]: cluster 2020-06-27T04:48:45.683700+0000 mon.a (mon.0) 1134 : cluster [INF] osd.3 v2:172.21.15.31:6808/1956328585 boot 2020-06-27T04:48:45.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[18426]: cluster 2020-06-27T04:48:45.683746+0000 mon.a (mon.0) 1135 : cluster [INF] osd.1 v2:172.21.15.31:6812/2611180398 boot 2020-06-27T04:48:45.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[18426]: cluster 2020-06-27T04:48:45.683768+0000 mon.a (mon.0) 1136 : cluster [DBG] osdmap e137: 8 total, 5 up, 8 in 2020-06-27T04:48:45.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[18426]: audit 2020-06-27T04:48:45.683789+0000 mon.b (mon.2) 322 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:48:45.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[18426]: audit 2020-06-27T04:48:45.684159+0000 mon.b (mon.2) 323 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:48:45.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[18426]: audit 2020-06-27T04:48:45.684435+0000 mon.b (mon.2) 324 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:48:45.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[22603]: audit 2020-06-27T04:48:44.788499+0000 mon.a (mon.0) 1125 : audit [INF] from='osd.2 v2:172.21.15.31:6804/2797585562' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:48:45.977 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[22603]: audit 2020-06-27T04:48:44.788869+0000 mon.a (mon.0) 1126 : audit [INF] from='osd.2 v2:172.21.15.31:6804/2797585562' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:45.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[22603]: cluster 2020-06-27T04:48:44.799033+0000 mon.a (mon.0) 1127 : cluster [DBG] osd.5 reported immediately failed by osd.7 2020-06-27T04:48:45.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[22603]: cluster 2020-06-27T04:48:44.799100+0000 mon.a (mon.0) 1128 : cluster [INF] osd.5 failed (root=default,host=smithi051) (connection refused reported by osd.7) 2020-06-27T04:48:45.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[22603]: audit 2020-06-27T04:48:45.001104+0000 mon.a (mon.0) 1129 : audit [INF] from='osd.3 v2:172.21.15.31:6808/1956328585' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:48:45.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[22603]: audit 2020-06-27T04:48:45.001495+0000 mon.a (mon.0) 1130 : audit [INF] from='osd.3 v2:172.21.15.31:6808/1956328585' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:45.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[22603]: audit 2020-06-27T04:48:45.570922+0000 mon.c (mon.1) 77 : audit [INF] from='osd.1 v2:172.21.15.31:6812/2611180398' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:48:45.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[22603]: audit 2020-06-27T04:48:45.571203+0000 mon.a (mon.0) 1131 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:48:45.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[22603]: audit 2020-06-27T04:48:45.571710+0000 mon.c (mon.1) 78 : audit [INF] from='osd.1 v2:172.21.15.31:6812/2611180398' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:45.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[22603]: audit 2020-06-27T04:48:45.571944+0000 mon.a (mon.0) 1132 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:48:45.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[22603]: cluster 2020-06-27T04:48:45.683617+0000 mon.a (mon.0) 1133 : cluster [INF] osd.2 v2:172.21.15.31:6804/2797585562 boot 2020-06-27T04:48:45.979 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[22603]: cluster 2020-06-27T04:48:45.683700+0000 mon.a (mon.0) 1134 : cluster [INF] osd.3 v2:172.21.15.31:6808/1956328585 boot 2020-06-27T04:48:45.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[22603]: cluster 2020-06-27T04:48:45.683746+0000 mon.a (mon.0) 1135 : cluster [INF] osd.1 v2:172.21.15.31:6812/2611180398 boot 2020-06-27T04:48:45.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[22603]: cluster 2020-06-27T04:48:45.683768+0000 mon.a (mon.0) 1136 : cluster [DBG] osdmap e137: 8 total, 5 up, 8 in 2020-06-27T04:48:45.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[22603]: audit 2020-06-27T04:48:45.683789+0000 mon.b (mon.2) 322 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:48:45.980 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[22603]: audit 2020-06-27T04:48:45.684159+0000 mon.b (mon.2) 323 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:48:45.981 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[22603]: audit 2020-06-27T04:48:45.684435+0000 mon.b (mon.2) 324 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:48:45.981 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:45 smithi031 bash[111794]: debug 2020-06-27T04:48:45.566+0000 7f55f8d5cf40 -1 osd.1 122 log_to_monitors {default=true} 2020-06-27T04:48:46.218 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:45 smithi051 podman[41930]: 2020-06-27 04:48:45.973682147 +0000 UTC m=+0.711445609 container died 4c832810ba01c901b25b8cfb950dc66825720d0a35933bc7bdacce8493480f62 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:48:46.708 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:46 smithi051 bash[18409]: cluster 2020-06-27T04:48:45.237088+0000 mgr.x (mgr.34109) 268 : cluster [DBG] pgmap v318: 777 pgs: 2 creating+peering, 23 peering, 13 creating+down, 23 active+undersized+degraded, 2 stale+creating+incomplete, 7 stale+creating+down, 13 stale+creating+peering, 159 down, 1 stale+creating+activating+undersized, 73 stale+down, 13 stale+active+clean, 23 unknown, 61 active+undersized, 27 stale+peering, 64 undersized+degraded+peered, 6 stale+undersized+peered, 263 undersized+peered, 4 stale+active+undersized; 19 KiB data, 19 MiB used, 707 GiB / 715 GiB avail; 1.0 KiB/s wr, 1 op/s; 356/1041 objects degraded (34.198%) 2020-06-27T04:48:46.709 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:46 smithi051 bash[18409]: cluster 2020-06-27T04:48:46.685259+0000 mon.a (mon.0) 1137 : cluster [DBG] osdmap e138: 8 total, 5 up, 8 in 2020-06-27T04:48:46.709 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:46 smithi051 podman[41930]: 2020-06-27 04:48:46.406037775 +0000 UTC m=+1.143801228 container remove 4c832810ba01c901b25b8cfb950dc66825720d0a35933bc7bdacce8493480f62 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.5-deactivate) 2020-06-27T04:48:46.710 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:46 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Failed with result 'exit-code'. 2020-06-27T04:48:46.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[18426]: cluster 2020-06-27T04:48:45.237088+0000 mgr.x (mgr.34109) 268 : cluster [DBG] pgmap v318: 777 pgs: 2 creating+peering, 23 peering, 13 creating+down, 23 active+undersized+degraded, 2 stale+creating+incomplete, 7 stale+creating+down, 13 stale+creating+peering, 159 down, 1 stale+creating+activating+undersized, 73 stale+down, 13 stale+active+clean, 23 unknown, 61 active+undersized, 27 stale+peering, 64 undersized+degraded+peered, 6 stale+undersized+peered, 263 undersized+peered, 4 stale+active+undersized; 19 KiB data, 19 MiB used, 707 GiB / 715 GiB avail; 1.0 KiB/s wr, 1 op/s; 356/1041 objects degraded (34.198%) 2020-06-27T04:48:46.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[18426]: cluster 2020-06-27T04:48:46.685259+0000 mon.a (mon.0) 1137 : cluster [DBG] osdmap e138: 8 total, 5 up, 8 in 2020-06-27T04:48:46.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[22603]: cluster 2020-06-27T04:48:45.237088+0000 mgr.x (mgr.34109) 268 : cluster [DBG] pgmap v318: 777 pgs: 2 creating+peering, 23 peering, 13 creating+down, 23 active+undersized+degraded, 2 stale+creating+incomplete, 7 stale+creating+down, 13 stale+creating+peering, 159 down, 1 stale+creating+activating+undersized, 73 stale+down, 13 stale+active+clean, 23 unknown, 61 active+undersized, 27 stale+peering, 64 undersized+degraded+peered, 6 stale+undersized+peered, 263 undersized+peered, 4 stale+active+undersized; 19 KiB data, 19 MiB used, 707 GiB / 715 GiB avail; 1.0 KiB/s wr, 1 op/s; 356/1041 objects degraded (34.198%) 2020-06-27T04:48:46.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[22603]: cluster 2020-06-27T04:48:46.685259+0000 mon.a (mon.0) 1137 : cluster [DBG] osdmap e138: 8 total, 5 up, 8 in 2020-06-27T04:48:46.978 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:46.978 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: in thread 7f55d54d1700 thread_name:tp_osd_tp 2020-06-27T04:48:46.979 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:46.979 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 1: (()+0x12dd0) [0x7f55f6acfdd0] 2020-06-27T04:48:46.979 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x558f45299707] 2020-06-27T04:48:46.979 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x558f45299aa0] 2020-06-27T04:48:46.979 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x558f452cb67a] 2020-06-27T04:48:46.980 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x558f452cca57] 2020-06-27T04:48:46.980 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x558f44f57938] 2020-06-27T04:48:46.980 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x558f4510803d] 2020-06-27T04:48:46.980 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x558f44ec55b0] 2020-06-27T04:48:46.981 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x558f44f1e89d] 2020-06-27T04:48:46.981 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x558f44f27380] 2020-06-27T04:48:46.981 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x558f44f2e590] 2020-06-27T04:48:46.981 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x558f44dae4e9] 2020-06-27T04:48:46.982 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x558f45012f78] 2020-06-27T04:48:46.982 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x558f44dcd70f] 2020-06-27T04:48:46.982 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x558f4540bb94] 2020-06-27T04:48:46.982 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x558f4540e7f4] 2020-06-27T04:48:46.982 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 17: (()+0x82de) [0x7f55f6ac52de] 2020-06-27T04:48:46.983 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 18: (clone()+0x43) [0x7f55f57fce83] 2020-06-27T04:48:46.983 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: debug 2020-06-27T04:48:46.799+0000 7f55d54d1700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:46.983 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: in thread 7f55d54d1700 thread_name:tp_osd_tp 2020-06-27T04:48:46.983 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:46.983 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 1: (()+0x12dd0) [0x7f55f6acfdd0] 2020-06-27T04:48:46.983 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x558f45299707] 2020-06-27T04:48:46.984 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x558f45299aa0] 2020-06-27T04:48:46.984 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x558f452cb67a] 2020-06-27T04:48:46.984 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x558f452cca57] 2020-06-27T04:48:46.984 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x558f44f57938] 2020-06-27T04:48:46.984 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x558f4510803d] 2020-06-27T04:48:46.985 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x558f44ec55b0] 2020-06-27T04:48:46.985 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x558f44f1e89d] 2020-06-27T04:48:46.985 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x558f44f27380] 2020-06-27T04:48:46.985 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x558f44f2e590] 2020-06-27T04:48:46.985 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x558f44dae4e9] 2020-06-27T04:48:46.986 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x558f45012f78] 2020-06-27T04:48:46.986 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x558f44dcd70f] 2020-06-27T04:48:46.986 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x558f4540bb94] 2020-06-27T04:48:46.986 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x558f4540e7f4] 2020-06-27T04:48:46.986 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 17: (()+0x82de) [0x7f55f6ac52de] 2020-06-27T04:48:46.986 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 18: (clone()+0x43) [0x7f55f57fce83] 2020-06-27T04:48:46.987 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:46.987 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: debug -5266> 2020-06-27T04:48:46.799+0000 7f55d54d1700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:46.987 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: in thread 7f55d54d1700 thread_name:tp_osd_tp 2020-06-27T04:48:46.987 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:46.987 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 1: (()+0x12dd0) [0x7f55f6acfdd0] 2020-06-27T04:48:46.988 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x558f45299707] 2020-06-27T04:48:46.988 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x558f45299aa0] 2020-06-27T04:48:46.988 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x558f452cb67a] 2020-06-27T04:48:46.988 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x558f452cca57] 2020-06-27T04:48:46.988 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x558f44f57938] 2020-06-27T04:48:46.989 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x558f4510803d] 2020-06-27T04:48:46.989 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x558f44ec55b0] 2020-06-27T04:48:46.989 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x558f44f1e89d] 2020-06-27T04:48:46.989 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x558f44f27380] 2020-06-27T04:48:46.989 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x558f44f2e590] 2020-06-27T04:48:46.989 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x558f44dae4e9] 2020-06-27T04:48:46.990 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x558f45012f78] 2020-06-27T04:48:46.990 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x558f44dcd70f] 2020-06-27T04:48:46.990 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x558f4540bb94] 2020-06-27T04:48:46.990 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x558f4540e7f4] 2020-06-27T04:48:46.990 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 17: (()+0x82de) [0x7f55f6ac52de] 2020-06-27T04:48:46.991 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 18: (clone()+0x43) [0x7f55f57fce83] 2020-06-27T04:48:46.991 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:46.991 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: debug -9999> 2020-06-27T04:48:46.799+0000 7f55d54d1700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:46.991 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: in thread 7f55d54d1700 thread_name:tp_osd_tp 2020-06-27T04:48:46.991 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:46.992 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 1: (()+0x12dd0) [0x7f55f6acfdd0] 2020-06-27T04:48:46.992 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x558f45299707] 2020-06-27T04:48:46.992 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x558f45299aa0] 2020-06-27T04:48:46.992 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x558f452cb67a] 2020-06-27T04:48:46.992 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x558f452cca57] 2020-06-27T04:48:46.992 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x558f44f57938] 2020-06-27T04:48:46.993 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x558f4510803d] 2020-06-27T04:48:46.993 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x558f44ec55b0] 2020-06-27T04:48:46.993 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x558f44f1e89d] 2020-06-27T04:48:46.993 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x558f44f27380] 2020-06-27T04:48:46.993 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x558f44f2e590] 2020-06-27T04:48:46.994 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x558f44dae4e9] 2020-06-27T04:48:46.994 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x558f45012f78] 2020-06-27T04:48:46.994 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x558f44dcd70f] 2020-06-27T04:48:46.994 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x558f4540bb94] 2020-06-27T04:48:46.994 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x558f4540e7f4] 2020-06-27T04:48:46.995 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 17: (()+0x82de) [0x7f55f6ac52de] 2020-06-27T04:48:46.995 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 18: (clone()+0x43) [0x7f55f57fce83] 2020-06-27T04:48:46.995 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:46.995 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:46.995 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: terminate called after throwing an instance of 'boost::wrapexcept' 2020-06-27T04:48:46.995 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: what(): boost::bad_get: failed value get using boost::get 2020-06-27T04:48:46.996 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: *** Caught signal (Aborted) ** 2020-06-27T04:48:46.996 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: in thread 7f55d44cf700 thread_name:tp_osd_tp 2020-06-27T04:48:46.996 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:46.996 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 1: (()+0x12dd0) [0x7f55f6acfdd0] 2020-06-27T04:48:46.996 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 2: (gsignal()+0x10f) [0x7f55f573870f] 2020-06-27T04:48:46.997 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 3: (abort()+0x127) [0x7f55f5722b25] 2020-06-27T04:48:46.997 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 4: (()+0x9006b) [0x7f55f60ed06b] 2020-06-27T04:48:46.997 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 5: (()+0x9650c) [0x7f55f60f350c] 2020-06-27T04:48:46.997 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 6: (()+0x96567) [0x7f55f60f3567] 2020-06-27T04:48:46.997 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 7: (()+0x967c8) [0x7f55f60f37c8] 2020-06-27T04:48:46.997 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 8: (()+0x8bd911) [0x558f4501d911] 2020-06-27T04:48:46.998 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 9: (PeeringState::purge_strays()+0x1d5) [0x558f45028845] 2020-06-27T04:48:46.998 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 10: (PG::_finish_recovery(Context*)+0x22f) [0x558f44e5042f] 2020-06-27T04:48:46.998 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 11: (Context::complete(int)+0xd) [0x558f44de703d] 2020-06-27T04:48:46.998 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 12: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x136c) [0x558f44dcd78c] 2020-06-27T04:48:46.998 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 13: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x558f4540bb94] 2020-06-27T04:48:46.999 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 14: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x558f4540e7f4] 2020-06-27T04:48:46.999 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 15: (()+0x82de) [0x7f55f6ac52de] 2020-06-27T04:48:46.999 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 16: (clone()+0x43) [0x7f55f57fce83] 2020-06-27T04:48:46.999 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: debug 2020-06-27T04:48:46.861+0000 7f55d44cf700 -1 *** Caught signal (Aborted) ** 2020-06-27T04:48:46.999 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: in thread 7f55d44cf700 thread_name:tp_osd_tp 2020-06-27T04:48:46.999 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:47.000 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 1: (()+0x12dd0) [0x7f55f6acfdd0] 2020-06-27T04:48:47.000 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 2: (gsignal()+0x10f) [0x7f55f573870f] 2020-06-27T04:48:47.000 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 3: (abort()+0x127) [0x7f55f5722b25] 2020-06-27T04:48:47.000 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 4: (()+0x9006b) [0x7f55f60ed06b] 2020-06-27T04:48:47.000 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 5: (()+0x9650c) [0x7f55f60f350c] 2020-06-27T04:48:47.001 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 6: (()+0x96567) [0x7f55f60f3567] 2020-06-27T04:48:47.001 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 7: (()+0x967c8) [0x7f55f60f37c8] 2020-06-27T04:48:47.001 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 8: (()+0x8bd911) [0x558f4501d911] 2020-06-27T04:48:47.001 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 9: (PeeringState::purge_strays()+0x1d5) [0x558f45028845] 2020-06-27T04:48:47.001 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 10: (PG::_finish_recovery(Context*)+0x22f) [0x558f44e5042f] 2020-06-27T04:48:47.002 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 11: (Context::complete(int)+0xd) [0x558f44de703d] 2020-06-27T04:48:47.002 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 12: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x136c) [0x558f44dcd78c] 2020-06-27T04:48:47.002 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 13: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x558f4540bb94] 2020-06-27T04:48:47.002 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 14: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x558f4540e7f4] 2020-06-27T04:48:47.002 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 15: (()+0x82de) [0x7f55f6ac52de] 2020-06-27T04:48:47.002 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: 16: (clone()+0x43) [0x7f55f57fce83] 2020-06-27T04:48:47.003 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 bash[111794]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:47.003 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:46 smithi031 podman[112073]: 2020-06-27 04:48:46.919384673 +0000 UTC m=+3.007055098 container died bfeb3b4c595f9beeedeb3be7eb249947dff832562b5a6f14d462d4c6f7c26d50 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:48:47.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:46.894153+0000 mon.a (mon.0) 1138 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:46.894218+0000 mon.a (mon.0) 1139 : cluster [INF] osd.1 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:48:47.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:46.894507+0000 mon.a (mon.0) 1140 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:46.895268+0000 mon.a (mon.0) 1141 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:46.895925+0000 mon.a (mon.0) 1142 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:46.896556+0000 mon.a (mon.0) 1143 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:46.896731+0000 mon.a (mon.0) 1144 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:46.896884+0000 mon.a (mon.0) 1145 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:46.897464+0000 mon.a (mon.0) 1146 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:46.898026+0000 mon.a (mon.0) 1147 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:46.898182+0000 mon.a (mon.0) 1148 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:46.910487+0000 mon.a (mon.0) 1149 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.094232+0000 mon.a (mon.0) 1150 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.094442+0000 mon.a (mon.0) 1151 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.094943+0000 mon.a (mon.0) 1152 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.095027+0000 mon.a (mon.0) 1153 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.096439+0000 mon.a (mon.0) 1154 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.096535+0000 mon.a (mon.0) 1155 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.097414+0000 mon.a (mon.0) 1156 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.097537+0000 mon.a (mon.0) 1157 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.097732+0000 mon.a (mon.0) 1158 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.097912+0000 mon.a (mon.0) 1159 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.098389+0000 mon.a (mon.0) 1160 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.110424+0000 mon.a (mon.0) 1161 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.973 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.495234+0000 mon.a (mon.0) 1162 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.973 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.495461+0000 mon.a (mon.0) 1163 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.973 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.496071+0000 mon.a (mon.0) 1164 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.973 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.496256+0000 mon.a (mon.0) 1165 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.973 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.497526+0000 mon.a (mon.0) 1166 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.974 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.497629+0000 mon.a (mon.0) 1167 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.974 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.498522+0000 mon.a (mon.0) 1168 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.974 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.498634+0000 mon.a (mon.0) 1169 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.974 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.498729+0000 mon.a (mon.0) 1170 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.974 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.498816+0000 mon.a (mon.0) 1171 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.974 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.499490+0000 mon.a (mon.0) 1172 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.975 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:47 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.511482+0000 mon.a (mon.0) 1173 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:46.894153+0000 mon.a (mon.0) 1138 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:46.894218+0000 mon.a (mon.0) 1139 : cluster [INF] osd.1 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:48:47.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:46.894507+0000 mon.a (mon.0) 1140 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:46.895268+0000 mon.a (mon.0) 1141 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:46.895925+0000 mon.a (mon.0) 1142 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:46.896556+0000 mon.a (mon.0) 1143 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:46.896731+0000 mon.a (mon.0) 1144 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:46.896884+0000 mon.a (mon.0) 1145 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:46.897464+0000 mon.a (mon.0) 1146 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:46.898026+0000 mon.a (mon.0) 1147 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.978 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:46.898182+0000 mon.a (mon.0) 1148 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.978 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:46.910487+0000 mon.a (mon.0) 1149 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.978 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.094232+0000 mon.a (mon.0) 1150 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.978 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.094442+0000 mon.a (mon.0) 1151 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.979 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.094943+0000 mon.a (mon.0) 1152 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.979 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.095027+0000 mon.a (mon.0) 1153 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.979 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.096439+0000 mon.a (mon.0) 1154 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.979 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.096535+0000 mon.a (mon.0) 1155 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.979 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.097414+0000 mon.a (mon.0) 1156 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.980 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.097537+0000 mon.a (mon.0) 1157 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.980 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.097732+0000 mon.a (mon.0) 1158 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.980 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.097912+0000 mon.a (mon.0) 1159 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.980 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.098389+0000 mon.a (mon.0) 1160 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.980 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.110424+0000 mon.a (mon.0) 1161 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.981 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.495234+0000 mon.a (mon.0) 1162 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.981 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.495461+0000 mon.a (mon.0) 1163 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.981 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.496071+0000 mon.a (mon.0) 1164 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.981 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.496256+0000 mon.a (mon.0) 1165 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.981 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.497526+0000 mon.a (mon.0) 1166 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.982 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.497629+0000 mon.a (mon.0) 1167 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.982 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.498522+0000 mon.a (mon.0) 1168 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.982 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.498634+0000 mon.a (mon.0) 1169 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.989 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.498729+0000 mon.a (mon.0) 1170 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.989 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.498816+0000 mon.a (mon.0) 1171 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.989 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.499490+0000 mon.a (mon.0) 1172 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.990 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.511482+0000 mon.a (mon.0) 1173 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.990 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:46.894153+0000 mon.a (mon.0) 1138 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.990 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:46.894218+0000 mon.a (mon.0) 1139 : cluster [INF] osd.1 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:48:47.991 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:46.894507+0000 mon.a (mon.0) 1140 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.991 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:46.895268+0000 mon.a (mon.0) 1141 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.991 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:46.895925+0000 mon.a (mon.0) 1142 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.991 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:46.896556+0000 mon.a (mon.0) 1143 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.991 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:46.896731+0000 mon.a (mon.0) 1144 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.992 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:46.896884+0000 mon.a (mon.0) 1145 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.992 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:46.897464+0000 mon.a (mon.0) 1146 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.992 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:46.898026+0000 mon.a (mon.0) 1147 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.992 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:46.898182+0000 mon.a (mon.0) 1148 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.992 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:46.910487+0000 mon.a (mon.0) 1149 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.992 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.094232+0000 mon.a (mon.0) 1150 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.993 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.094442+0000 mon.a (mon.0) 1151 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.993 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.094943+0000 mon.a (mon.0) 1152 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.993 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.095027+0000 mon.a (mon.0) 1153 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.993 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.096439+0000 mon.a (mon.0) 1154 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.993 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.096535+0000 mon.a (mon.0) 1155 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.994 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.097414+0000 mon.a (mon.0) 1156 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.998 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.097537+0000 mon.a (mon.0) 1157 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.998 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.097732+0000 mon.a (mon.0) 1158 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:47.998 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.097912+0000 mon.a (mon.0) 1159 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.999 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.098389+0000 mon.a (mon.0) 1160 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.999 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.110424+0000 mon.a (mon.0) 1161 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:47.999 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.495234+0000 mon.a (mon.0) 1162 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:47.999 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.495461+0000 mon.a (mon.0) 1163 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:47.999 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.496071+0000 mon.a (mon.0) 1164 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:48.000 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.496256+0000 mon.a (mon.0) 1165 : cluster [DBG] osd.1 reported immediately failed by osd.7 2020-06-27T04:48:48.000 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.497526+0000 mon.a (mon.0) 1166 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:48.000 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.497629+0000 mon.a (mon.0) 1167 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:48.000 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.498522+0000 mon.a (mon.0) 1168 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:48.000 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.498634+0000 mon.a (mon.0) 1169 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:48.001 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.498729+0000 mon.a (mon.0) 1170 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:48:48.001 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.498816+0000 mon.a (mon.0) 1171 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:48.001 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.499490+0000 mon.a (mon.0) 1172 : cluster [DBG] osd.1 reported immediately failed by osd.0 2020-06-27T04:48:48.001 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:47 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.511482+0000 mon.a (mon.0) 1173 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:48:48.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:48 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.238410+0000 mgr.x (mgr.34109) 269 : cluster [DBG] pgmap v321: 777 pgs: 1 activating+undersized, 5 creating+peering, 129 peering, 11 creating+down, 36 active+undersized+degraded, 1 stale+creating+incomplete, 7 stale+creating+down, 2 stale+creating+peering, 101 down, 1 stale+creating+activating+undersized, 73 stale+down, 23 unknown, 76 active+undersized, 26 stale+peering, 42 undersized+degraded+peered, 29 active+clean, 6 stale+undersized+peered, 205 undersized+peered, 3 stale+active+undersized; 20 KiB data, 20 MiB used, 707 GiB / 715 GiB avail; 511 B/s wr, 0 op/s; 322/1047 objects degraded (30.755%); 0 B/s, 0 objects/s recovering 2020-06-27T04:48:48.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:48 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.704752+0000 mon.a (mon.0) 1174 : cluster [WRN] Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:48:48.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:48 smithi051 bash[18409]: cluster 2020-06-27T04:48:47.716383+0000 mon.a (mon.0) 1175 : cluster [DBG] osdmap e139: 8 total, 4 up, 8 in 2020-06-27T04:48:48.973 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:48 smithi031 podman[112073]: 2020-06-27 04:48:48.737477781 +0000 UTC m=+4.825148190 container remove bfeb3b4c595f9beeedeb3be7eb249947dff832562b5a6f14d462d4c6f7c26d50 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:48:48.974 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:48 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:48.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.238410+0000 mgr.x (mgr.34109) 269 : cluster [DBG] pgmap v321: 777 pgs: 1 activating+undersized, 5 creating+peering, 129 peering, 11 creating+down, 36 active+undersized+degraded, 1 stale+creating+incomplete, 7 stale+creating+down, 2 stale+creating+peering, 101 down, 1 stale+creating+activating+undersized, 73 stale+down, 23 unknown, 76 active+undersized, 26 stale+peering, 42 undersized+degraded+peered, 29 active+clean, 6 stale+undersized+peered, 205 undersized+peered, 3 stale+active+undersized; 20 KiB data, 20 MiB used, 707 GiB / 715 GiB avail; 511 B/s wr, 0 op/s; 322/1047 objects degraded (30.755%); 0 B/s, 0 objects/s recovering 2020-06-27T04:48:48.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.704752+0000 mon.a (mon.0) 1174 : cluster [WRN] Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:48:48.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[18426]: cluster 2020-06-27T04:48:47.716383+0000 mon.a (mon.0) 1175 : cluster [DBG] osdmap e139: 8 total, 4 up, 8 in 2020-06-27T04:48:48.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.238410+0000 mgr.x (mgr.34109) 269 : cluster [DBG] pgmap v321: 777 pgs: 1 activating+undersized, 5 creating+peering, 129 peering, 11 creating+down, 36 active+undersized+degraded, 1 stale+creating+incomplete, 7 stale+creating+down, 2 stale+creating+peering, 101 down, 1 stale+creating+activating+undersized, 73 stale+down, 23 unknown, 76 active+undersized, 26 stale+peering, 42 undersized+degraded+peered, 29 active+clean, 6 stale+undersized+peered, 205 undersized+peered, 3 stale+active+undersized; 20 KiB data, 20 MiB used, 707 GiB / 715 GiB avail; 511 B/s wr, 0 op/s; 322/1047 objects degraded (30.755%); 0 B/s, 0 objects/s recovering 2020-06-27T04:48:48.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.704752+0000 mon.a (mon.0) 1174 : cluster [WRN] Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:48:48.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[22603]: cluster 2020-06-27T04:48:47.716383+0000 mon.a (mon.0) 1175 : cluster [DBG] osdmap e139: 8 total, 4 up, 8 in 2020-06-27T04:48:48.975 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:48.976 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: in thread 7fd10e72c700 thread_name:tp_osd_tp 2020-06-27T04:48:48.976 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:48.976 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 1: (()+0x12dd0) [0x7fd132d30dd0] 2020-06-27T04:48:48.976 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55b584cc1707] 2020-06-27T04:48:48.976 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55b584cc1aa0] 2020-06-27T04:48:48.979 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55b584cf367a] 2020-06-27T04:48:48.979 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55b584cf4a57] 2020-06-27T04:48:48.980 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55b58497f938] 2020-06-27T04:48:48.980 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55b584b3003d] 2020-06-27T04:48:48.980 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55b5848ed5b0] 2020-06-27T04:48:48.980 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55b58494689d] 2020-06-27T04:48:48.981 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55b58494f380] 2020-06-27T04:48:48.981 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55b584956590] 2020-06-27T04:48:48.981 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55b5847d64e9] 2020-06-27T04:48:48.981 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55b584a3af78] 2020-06-27T04:48:48.981 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55b5847f570f] 2020-06-27T04:48:48.982 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55b584e33b94] 2020-06-27T04:48:48.982 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55b584e367f4] 2020-06-27T04:48:48.982 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 17: (()+0x82de) [0x7fd132d262de] 2020-06-27T04:48:48.982 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 18: (clone()+0x43) [0x7fd131a5de83] 2020-06-27T04:48:48.982 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: debug 2020-06-27T04:48:48.780+0000 7fd10e72c700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:48.983 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: in thread 7fd10e72c700 thread_name:tp_osd_tp 2020-06-27T04:48:48.983 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:48.983 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 1: (()+0x12dd0) [0x7fd132d30dd0] 2020-06-27T04:48:48.984 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55b584cc1707] 2020-06-27T04:48:48.984 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55b584cc1aa0] 2020-06-27T04:48:48.985 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55b584cf367a] 2020-06-27T04:48:48.985 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55b584cf4a57] 2020-06-27T04:48:48.985 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55b58497f938] 2020-06-27T04:48:48.985 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55b584b3003d] 2020-06-27T04:48:48.985 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55b5848ed5b0] 2020-06-27T04:48:48.986 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55b58494689d] 2020-06-27T04:48:48.986 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55b58494f380] 2020-06-27T04:48:48.986 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55b584956590] 2020-06-27T04:48:48.986 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55b5847d64e9] 2020-06-27T04:48:48.987 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55b584a3af78] 2020-06-27T04:48:48.987 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55b5847f570f] 2020-06-27T04:48:48.987 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55b584e33b94] 2020-06-27T04:48:48.987 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55b584e367f4] 2020-06-27T04:48:48.987 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 17: (()+0x82de) [0x7fd132d262de] 2020-06-27T04:48:48.988 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 18: (clone()+0x43) [0x7fd131a5de83] 2020-06-27T04:48:48.988 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:48.988 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: debug -2> 2020-06-27T04:48:48.780+0000 7fd10e72c700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:48.988 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: in thread 7fd10e72c700 thread_name:tp_osd_tp 2020-06-27T04:48:48.988 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:48.988 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 1: (()+0x12dd0) [0x7fd132d30dd0] 2020-06-27T04:48:48.989 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55b584cc1707] 2020-06-27T04:48:48.989 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55b584cc1aa0] 2020-06-27T04:48:48.989 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55b584cf367a] 2020-06-27T04:48:48.989 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55b584cf4a57] 2020-06-27T04:48:48.990 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55b58497f938] 2020-06-27T04:48:48.990 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55b584b3003d] 2020-06-27T04:48:48.990 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55b5848ed5b0] 2020-06-27T04:48:48.990 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55b58494689d] 2020-06-27T04:48:48.990 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55b58494f380] 2020-06-27T04:48:48.991 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55b584956590] 2020-06-27T04:48:48.996 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55b5847d64e9] 2020-06-27T04:48:48.996 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55b584a3af78] 2020-06-27T04:48:48.996 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55b5847f570f] 2020-06-27T04:48:48.996 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55b584e33b94] 2020-06-27T04:48:48.997 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55b584e367f4] 2020-06-27T04:48:48.997 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 17: (()+0x82de) [0x7fd132d262de] 2020-06-27T04:48:48.997 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 18: (clone()+0x43) [0x7fd131a5de83] 2020-06-27T04:48:48.997 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:48.998 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: debug -9999> 2020-06-27T04:48:48.780+0000 7fd10e72c700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:48.998 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: in thread 7fd10e72c700 thread_name:tp_osd_tp 2020-06-27T04:48:48.998 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:48.998 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 1: (()+0x12dd0) [0x7fd132d30dd0] 2020-06-27T04:48:48.998 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55b584cc1707] 2020-06-27T04:48:48.999 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55b584cc1aa0] 2020-06-27T04:48:48.999 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55b584cf367a] 2020-06-27T04:48:48.999 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55b584cf4a57] 2020-06-27T04:48:48.999 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55b58497f938] 2020-06-27T04:48:48.999 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55b584b3003d] 2020-06-27T04:48:49.000 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55b5848ed5b0] 2020-06-27T04:48:49.000 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55b58494689d] 2020-06-27T04:48:49.000 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55b58494f380] 2020-06-27T04:48:49.000 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55b584956590] 2020-06-27T04:48:49.000 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55b5847d64e9] 2020-06-27T04:48:49.001 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55b584a3af78] 2020-06-27T04:48:49.001 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55b5847f570f] 2020-06-27T04:48:49.001 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55b584e33b94] 2020-06-27T04:48:49.001 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55b584e367f4] 2020-06-27T04:48:49.001 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 17: (()+0x82de) [0x7fd132d262de] 2020-06-27T04:48:49.002 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: 18: (clone()+0x43) [0x7fd131a5de83] 2020-06-27T04:48:49.002 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:49.002 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 bash[111591]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:49.002 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:48 smithi031 podman[111829]: 2020-06-27 04:48:48.896343441 +0000 UTC m=+6.621802776 container died 7dc11472cc84a493bba182205fb9913b5dee92d87cbf01bbb035b72e8f5a2a15 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:48:49.637 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:49 smithi031 podman[113148]: 2020-06-27 04:48:49.258964216 +0000 UTC m=+0.492385112 container create 9b7977d3aa5cf3e69023f2b01d12d4f7cc03c9eac76aeee52a349bb8afe6ddfa (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:48:49.809 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:49 smithi031 podman[113148]: 2020-06-27 04:48:49.73983235 +0000 UTC m=+0.973253113 container init 9b7977d3aa5cf3e69023f2b01d12d4f7cc03c9eac76aeee52a349bb8afe6ddfa (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:48:49.809 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:49 smithi031 podman[111829]: 2020-06-27 04:48:49.683665935 +0000 UTC m=+7.409125278 container remove 7dc11472cc84a493bba182205fb9913b5dee92d87cbf01bbb035b72e8f5a2a15 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:48:49.810 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:49 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:49.810 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:48.719611+0000 mon.a (mon.0) 1176 : cluster [DBG] osdmap e140: 8 total, 4 up, 8 in 2020-06-27T04:48:49.810 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: audit 2020-06-27T04:48:48.722615+0000 mon.c (mon.1) 79 : audit [INF] from='client.? 172.21.15.31:0/1059113991' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:49.810 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: audit 2020-06-27T04:48:48.724245+0000 mon.a (mon.0) 1177 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:49.811 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:48.839812+0000 mon.a (mon.0) 1178 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:49.811 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:48.839885+0000 mon.a (mon.0) 1179 : cluster [INF] osd.3 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:48:49.811 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:48.840123+0000 mon.a (mon.0) 1180 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:49.811 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:48.840299+0000 mon.a (mon.0) 1181 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:49.811 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:48.840457+0000 mon.a (mon.0) 1182 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:49.812 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.039624+0000 mon.a (mon.0) 1183 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:49.812 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.039717+0000 mon.a (mon.0) 1184 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:49.812 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.039812+0000 mon.a (mon.0) 1185 : cluster [DBG] osd.3 reported immediately failed by osd.2 2020-06-27T04:48:49.812 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.039891+0000 mon.a (mon.0) 1186 : cluster [DBG] osd.3 reported immediately failed by osd.2 2020-06-27T04:48:49.812 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.039965+0000 mon.a (mon.0) 1187 : cluster [DBG] osd.3 reported immediately failed by osd.2 2020-06-27T04:48:49.813 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.040075+0000 mon.a (mon.0) 1188 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:49.813 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.040221+0000 mon.a (mon.0) 1189 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:49.813 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.040348+0000 mon.a (mon.0) 1190 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:49.813 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.040469+0000 mon.a (mon.0) 1191 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:49.813 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.387133+0000 mon.a (mon.0) 1192 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:48:49.813 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.387223+0000 mon.a (mon.0) 1193 : cluster [WRN] Health check update: Reduced data availability: 111 pgs inactive, 192 pgs down, 7 pgs peering, 1 pg incomplete (PG_AVAILABILITY) 2020-06-27T04:48:49.814 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.387244+0000 mon.a (mon.0) 1194 : cluster [WRN] Health check update: Degraded data redundancy: 322/1047 objects degraded (30.755%), 78 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:49.814 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.440607+0000 mon.a (mon.0) 1195 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:49.814 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.440918+0000 mon.a (mon.0) 1196 : cluster [DBG] osd.3 reported immediately failed by osd.2 2020-06-27T04:48:49.814 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.441133+0000 mon.a (mon.0) 1197 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:49.814 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.441310+0000 mon.a (mon.0) 1198 : cluster [DBG] osd.3 reported immediately failed by osd.2 2020-06-27T04:48:49.815 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.441395+0000 mon.a (mon.0) 1199 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:49.815 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.441557+0000 mon.a (mon.0) 1200 : cluster [DBG] osd.3 reported immediately failed by osd.2 2020-06-27T04:48:49.815 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.441680+0000 mon.a (mon.0) 1201 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:49.815 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.441758+0000 mon.a (mon.0) 1202 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:49.815 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.441832+0000 mon.a (mon.0) 1203 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:49.816 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:48.719611+0000 mon.a (mon.0) 1176 : cluster [DBG] osdmap e140: 8 total, 4 up, 8 in 2020-06-27T04:48:49.816 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: audit 2020-06-27T04:48:48.722615+0000 mon.c (mon.1) 79 : audit [INF] from='client.? 172.21.15.31:0/1059113991' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:49.816 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: audit 2020-06-27T04:48:48.724245+0000 mon.a (mon.0) 1177 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:49.816 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:48.839812+0000 mon.a (mon.0) 1178 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:49.816 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:48.839885+0000 mon.a (mon.0) 1179 : cluster [INF] osd.3 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:48:49.817 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:48.840123+0000 mon.a (mon.0) 1180 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:49.817 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:48.840299+0000 mon.a (mon.0) 1181 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:49.817 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:48.840457+0000 mon.a (mon.0) 1182 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:49.817 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.039624+0000 mon.a (mon.0) 1183 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:49.817 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.039717+0000 mon.a (mon.0) 1184 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:49.818 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.039812+0000 mon.a (mon.0) 1185 : cluster [DBG] osd.3 reported immediately failed by osd.2 2020-06-27T04:48:49.818 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.039891+0000 mon.a (mon.0) 1186 : cluster [DBG] osd.3 reported immediately failed by osd.2 2020-06-27T04:48:49.818 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.039965+0000 mon.a (mon.0) 1187 : cluster [DBG] osd.3 reported immediately failed by osd.2 2020-06-27T04:48:49.818 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.040075+0000 mon.a (mon.0) 1188 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:49.818 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.040221+0000 mon.a (mon.0) 1189 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:49.818 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.040348+0000 mon.a (mon.0) 1190 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:49.819 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.040469+0000 mon.a (mon.0) 1191 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:49.819 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.387133+0000 mon.a (mon.0) 1192 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:48:49.819 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.387223+0000 mon.a (mon.0) 1193 : cluster [WRN] Health check update: Reduced data availability: 111 pgs inactive, 192 pgs down, 7 pgs peering, 1 pg incomplete (PG_AVAILABILITY) 2020-06-27T04:48:49.819 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.387244+0000 mon.a (mon.0) 1194 : cluster [WRN] Health check update: Degraded data redundancy: 322/1047 objects degraded (30.755%), 78 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:49.819 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.440607+0000 mon.a (mon.0) 1195 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:49.820 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.440918+0000 mon.a (mon.0) 1196 : cluster [DBG] osd.3 reported immediately failed by osd.2 2020-06-27T04:48:49.820 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.441133+0000 mon.a (mon.0) 1197 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:49.820 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.441310+0000 mon.a (mon.0) 1198 : cluster [DBG] osd.3 reported immediately failed by osd.2 2020-06-27T04:48:49.820 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.441395+0000 mon.a (mon.0) 1199 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:49.820 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.441557+0000 mon.a (mon.0) 1200 : cluster [DBG] osd.3 reported immediately failed by osd.2 2020-06-27T04:48:49.821 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.441680+0000 mon.a (mon.0) 1201 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:49.821 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.441758+0000 mon.a (mon.0) 1202 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:49.821 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:49 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.441832+0000 mon.a (mon.0) 1203 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:49.973 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:49 smithi031 podman[113148]: 2020-06-27 04:48:49.805313803 +0000 UTC m=+1.038734574 container start 9b7977d3aa5cf3e69023f2b01d12d4f7cc03c9eac76aeee52a349bb8afe6ddfa (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:48:49.973 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:49 smithi031 podman[113148]: 2020-06-27 04:48:49.80538846 +0000 UTC m=+1.038809260 container attach 9b7977d3aa5cf3e69023f2b01d12d4f7cc03c9eac76aeee52a349bb8afe6ddfa (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:48:50.011 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:49 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:50.012 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:49 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Scheduled restart job, restart counter is at 4. 2020-06-27T04:48:50.012 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:49 smithi051 systemd[1]: Stopped Ceph osd.4 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:50.012 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:49 smithi051 systemd[1]: Starting Ceph osd.4 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:48:50.012 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:48.719611+0000 mon.a (mon.0) 1176 : cluster [DBG] osdmap e140: 8 total, 4 up, 8 in 2020-06-27T04:48:50.013 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: audit 2020-06-27T04:48:48.722615+0000 mon.c (mon.1) 79 : audit [INF] from='client.? 172.21.15.31:0/1059113991' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:50.013 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: audit 2020-06-27T04:48:48.724245+0000 mon.a (mon.0) 1177 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:50.013 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:48.839812+0000 mon.a (mon.0) 1178 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:50.013 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:48.839885+0000 mon.a (mon.0) 1179 : cluster [INF] osd.3 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:48:50.013 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:48.840123+0000 mon.a (mon.0) 1180 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:50.014 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:48.840299+0000 mon.a (mon.0) 1181 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:50.014 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:48.840457+0000 mon.a (mon.0) 1182 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:50.014 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.039624+0000 mon.a (mon.0) 1183 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:50.014 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.039717+0000 mon.a (mon.0) 1184 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:50.014 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.039812+0000 mon.a (mon.0) 1185 : cluster [DBG] osd.3 reported immediately failed by osd.2 2020-06-27T04:48:50.014 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.039891+0000 mon.a (mon.0) 1186 : cluster [DBG] osd.3 reported immediately failed by osd.2 2020-06-27T04:48:50.015 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.039965+0000 mon.a (mon.0) 1187 : cluster [DBG] osd.3 reported immediately failed by osd.2 2020-06-27T04:48:50.015 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.040075+0000 mon.a (mon.0) 1188 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:50.015 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.040221+0000 mon.a (mon.0) 1189 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:50.015 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.040348+0000 mon.a (mon.0) 1190 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:50.015 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.040469+0000 mon.a (mon.0) 1191 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:50.016 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.387133+0000 mon.a (mon.0) 1192 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:48:50.016 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.387223+0000 mon.a (mon.0) 1193 : cluster [WRN] Health check update: Reduced data availability: 111 pgs inactive, 192 pgs down, 7 pgs peering, 1 pg incomplete (PG_AVAILABILITY) 2020-06-27T04:48:50.016 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.387244+0000 mon.a (mon.0) 1194 : cluster [WRN] Health check update: Degraded data redundancy: 322/1047 objects degraded (30.755%), 78 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:50.016 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.440607+0000 mon.a (mon.0) 1195 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:50.016 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.440918+0000 mon.a (mon.0) 1196 : cluster [DBG] osd.3 reported immediately failed by osd.2 2020-06-27T04:48:50.017 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.441133+0000 mon.a (mon.0) 1197 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:50.017 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.441310+0000 mon.a (mon.0) 1198 : cluster [DBG] osd.3 reported immediately failed by osd.2 2020-06-27T04:48:50.017 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.441395+0000 mon.a (mon.0) 1199 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:50.017 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.441557+0000 mon.a (mon.0) 1200 : cluster [DBG] osd.3 reported immediately failed by osd.2 2020-06-27T04:48:50.017 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.441680+0000 mon.a (mon.0) 1201 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:50.018 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.441758+0000 mon.a (mon.0) 1202 : cluster [DBG] osd.3 reported immediately failed by osd.0 2020-06-27T04:48:50.018 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:49 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.441832+0000 mon.a (mon.0) 1203 : cluster [DBG] osd.3 reported immediately failed by osd.7 2020-06-27T04:48:50.270 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:50 smithi051 podman[42006]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4 found: no such container 2020-06-27T04:48:50.271 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:50 smithi051 systemd[1]: Started Ceph osd.4 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:50.271 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:50 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:50.271 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:50 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Scheduled restart job, restart counter is at 4. 2020-06-27T04:48:50.271 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:50 smithi051 systemd[1]: Stopped Ceph osd.6 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:50.271 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:50 smithi051 systemd[1]: Starting Ceph osd.6 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:48:50.419 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:50 smithi031 podman[113148]: 2020-06-27 04:48:50.011405703 +0000 UTC m=+1.244826688 container died 9b7977d3aa5cf3e69023f2b01d12d4f7cc03c9eac76aeee52a349bb8afe6ddfa (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:48:50.653 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:50 smithi051 podman[42041]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6 found: no such container 2020-06-27T04:48:50.653 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:50 smithi051 systemd[1]: Started Ceph osd.6 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:50.654 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:50 smithi051 podman[42024]: 2020-06-27 04:48:50.267688357 +0000 UTC m=+0.238440069 container create e9363168e5b972b1eff56d5f4c04ec7409b1cf0f5f9e7515fedf423f16d7843b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:48:50.654 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:50 smithi051 podman[42024]: 2020-06-27 04:48:50.442705735 +0000 UTC m=+0.413457567 container init e9363168e5b972b1eff56d5f4c04ec7409b1cf0f5f9e7515fedf423f16d7843b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:48:50.654 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:50 smithi051 podman[42024]: 2020-06-27 04:48:50.509344611 +0000 UTC m=+0.480096310 container start e9363168e5b972b1eff56d5f4c04ec7409b1cf0f5f9e7515fedf423f16d7843b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:48:50.654 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:50 smithi051 podman[42024]: 2020-06-27 04:48:50.509412004 +0000 UTC m=+0.480163726 container attach e9363168e5b972b1eff56d5f4c04ec7409b1cf0f5f9e7515fedf423f16d7843b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:48:50.723 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:50 smithi031 podman[113216]: 2020-06-27 04:48:50.417384701 +0000 UTC m=+0.715807038 container create e849b192562586215353beb2aadab5c422e2c8b5ef26582a8892fbd62a3ded6f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:48:50.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:50 smithi051 podman[42067]: 2020-06-27 04:48:50.651022731 +0000 UTC m=+0.324007967 container create 29059b89e25ebd128384884d7777966d429c60e85def086fb952b320129c6d7b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:48:50.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:50 smithi051 podman[42067]: 2020-06-27 04:48:50.775923007 +0000 UTC m=+0.448908127 container init 29059b89e25ebd128384884d7777966d429c60e85def086fb952b320129c6d7b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:48:50.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:50 smithi051 podman[42067]: 2020-06-27 04:48:50.809282693 +0000 UTC m=+0.482267829 container start 29059b89e25ebd128384884d7777966d429c60e85def086fb952b320129c6d7b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:48:50.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:50 smithi051 podman[42067]: 2020-06-27 04:48:50.809364403 +0000 UTC m=+0.482349566 container attach 29059b89e25ebd128384884d7777966d429c60e85def086fb952b320129c6d7b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:48:50.969 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:50 smithi051 bash[42022]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-06-27T04:48:50.969 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:50 smithi051 bash[42022]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2020-06-27T04:48:50.969 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:50 smithi051 bash[42022]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2020-06-27T04:48:50.969 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:50 smithi051 bash[42022]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2020-06-27T04:48:50.970 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:50 smithi051 bash[42022]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2020-06-27T04:48:50.970 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:50 smithi051 bash[42022]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-06-27T04:48:50.970 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:50 smithi051 bash[42022]: --> ceph-volume lvm activate successful for osd ID: 4 2020-06-27T04:48:50.970 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:50 smithi051 podman[42024]: 2020-06-27 04:48:50.844783907 +0000 UTC m=+0.815535622 container died e9363168e5b972b1eff56d5f4c04ec7409b1cf0f5f9e7515fedf423f16d7843b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:48:50.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:50 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.239658+0000 mgr.x (mgr.34109) 270 : cluster [DBG] pgmap v324: 777 pgs: 1 stale+activating+undersized, 9 stale+undersized+degraded+peered, 4 creating+peering, 106 peering, 5 creating+down, 36 active+undersized+degraded, 1 stale+creating+incomplete, 10 stale+creating+down, 2 stale+creating+peering, 83 down, 91 stale+down, 55 unknown, 70 active+undersized, 42 stale+peering, 33 undersized+degraded+peered, 29 active+clean, 53 stale+undersized+peered, 145 undersized+peered, 2 stale+active+undersized; 20 KiB data, 20 MiB used, 707 GiB / 715 GiB avail; 511 B/s wr, 0 op/s; 322/1047 objects degraded (30.755%); 0 B/s, 0 objects/s recovering 2020-06-27T04:48:50.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:50 smithi051 bash[18409]: audit 2020-06-27T04:48:49.727644+0000 mon.a (mon.0) 1204 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-6","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:50.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:50 smithi051 bash[18409]: cluster 2020-06-27T04:48:49.727733+0000 mon.a (mon.0) 1205 : cluster [DBG] osdmap e141: 8 total, 3 up, 8 in 2020-06-27T04:48:51.122 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:50 smithi031 podman[113148]: 2020-06-27 04:48:50.863800377 +0000 UTC m=+2.097221164 container remove 9b7977d3aa5cf3e69023f2b01d12d4f7cc03c9eac76aeee52a349bb8afe6ddfa (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:48:51.123 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:48:50 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Failed with result 'exit-code'. 2020-06-27T04:48:51.123 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:50 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.239658+0000 mgr.x (mgr.34109) 270 : cluster [DBG] pgmap v324: 777 pgs: 1 stale+activating+undersized, 9 stale+undersized+degraded+peered, 4 creating+peering, 106 peering, 5 creating+down, 36 active+undersized+degraded, 1 stale+creating+incomplete, 10 stale+creating+down, 2 stale+creating+peering, 83 down, 91 stale+down, 55 unknown, 70 active+undersized, 42 stale+peering, 33 undersized+degraded+peered, 29 active+clean, 53 stale+undersized+peered, 145 undersized+peered, 2 stale+active+undersized; 20 KiB data, 20 MiB used, 707 GiB / 715 GiB avail; 511 B/s wr, 0 op/s; 322/1047 objects degraded (30.755%); 0 B/s, 0 objects/s recovering 2020-06-27T04:48:51.123 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:50 smithi031 bash[22603]: audit 2020-06-27T04:48:49.727644+0000 mon.a (mon.0) 1204 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-6","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:51.123 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:50 smithi031 bash[22603]: cluster 2020-06-27T04:48:49.727733+0000 mon.a (mon.0) 1205 : cluster [DBG] osdmap e141: 8 total, 3 up, 8 in 2020-06-27T04:48:51.124 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:50 smithi031 podman[113216]: 2020-06-27 04:48:50.871815646 +0000 UTC m=+1.170237984 container init e849b192562586215353beb2aadab5c422e2c8b5ef26582a8892fbd62a3ded6f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:48:51.124 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:50 smithi031 podman[113216]: 2020-06-27 04:48:50.952033771 +0000 UTC m=+1.250456108 container start e849b192562586215353beb2aadab5c422e2c8b5ef26582a8892fbd62a3ded6f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:48:51.124 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:50 smithi031 podman[113216]: 2020-06-27 04:48:50.952108718 +0000 UTC m=+1.250531052 container attach e849b192562586215353beb2aadab5c422e2c8b5ef26582a8892fbd62a3ded6f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:48:51.124 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:50 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.239658+0000 mgr.x (mgr.34109) 270 : cluster [DBG] pgmap v324: 777 pgs: 1 stale+activating+undersized, 9 stale+undersized+degraded+peered, 4 creating+peering, 106 peering, 5 creating+down, 36 active+undersized+degraded, 1 stale+creating+incomplete, 10 stale+creating+down, 2 stale+creating+peering, 83 down, 91 stale+down, 55 unknown, 70 active+undersized, 42 stale+peering, 33 undersized+degraded+peered, 29 active+clean, 53 stale+undersized+peered, 145 undersized+peered, 2 stale+active+undersized; 20 KiB data, 20 MiB used, 707 GiB / 715 GiB avail; 511 B/s wr, 0 op/s; 322/1047 objects degraded (30.755%); 0 B/s, 0 objects/s recovering 2020-06-27T04:48:51.125 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:50 smithi031 bash[18426]: audit 2020-06-27T04:48:49.727644+0000 mon.a (mon.0) 1204 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-6","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:51.125 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:50 smithi031 bash[18426]: cluster 2020-06-27T04:48:49.727733+0000 mon.a (mon.0) 1205 : cluster [DBG] osdmap e141: 8 total, 3 up, 8 in 2020-06-27T04:48:51.349 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:51 smithi051 bash[42065]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-06-27T04:48:51.349 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:51 smithi051 bash[42065]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2020-06-27T04:48:51.349 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:51 smithi051 bash[42065]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2020-06-27T04:48:51.350 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:51 smithi051 bash[42065]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2020-06-27T04:48:51.350 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:51 smithi051 bash[42065]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2020-06-27T04:48:51.350 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:51 smithi051 bash[42065]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-06-27T04:48:51.350 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:51 smithi051 bash[42065]: --> ceph-volume lvm activate successful for osd ID: 6 2020-06-27T04:48:51.350 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:51 smithi051 podman[42067]: 2020-06-27 04:48:51.263658304 +0000 UTC m=+0.936643445 container died 29059b89e25ebd128384884d7777966d429c60e85def086fb952b320129c6d7b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:48:51.473 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:51 smithi031 podman[113216]: 2020-06-27 04:48:51.120506924 +0000 UTC m=+1.418929305 container died e849b192562586215353beb2aadab5c422e2c8b5ef26582a8892fbd62a3ded6f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:48:51.666 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:51 smithi051 podman[42024]: 2020-06-27 04:48:51.346747057 +0000 UTC m=+1.317498785 container remove e9363168e5b972b1eff56d5f4c04ec7409b1cf0f5f9e7515fedf423f16d7843b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:48:51.667 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:51 smithi051 bash[42022]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4 found: no such container 2020-06-27T04:48:51.936 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:51 smithi051 bash[18409]: cluster 2020-06-27T04:48:50.728949+0000 mon.a (mon.0) 1206 : cluster [DBG] osdmap e142: 8 total, 3 up, 8 in 2020-06-27T04:48:51.937 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:51 smithi051 bash[42022]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4 2020-06-27T04:48:51.937 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:51 smithi051 bash[42022]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4" found: no such container 2020-06-27T04:48:51.937 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:51 smithi051 podman[42227]: 2020-06-27 04:48:51.900736146 +0000 UTC m=+0.220798653 container create 0fa2f14005c7dddc9a6522c79d3a228dae1ef9f112047e702fc1d645b34a20bc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:48:51.937 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:51 smithi051 podman[42067]: 2020-06-27 04:48:51.664744027 +0000 UTC m=+1.337729178 container remove 29059b89e25ebd128384884d7777966d429c60e85def086fb952b320129c6d7b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:48:51.938 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:51 smithi051 bash[42065]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6 found: no such container 2020-06-27T04:48:51.938 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:51 smithi051 bash[42065]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6 2020-06-27T04:48:51.938 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:51 smithi051 bash[42065]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6" found: no such container 2020-06-27T04:48:52.211 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 podman[42227]: 2020-06-27 04:48:52.042465837 +0000 UTC m=+0.362528356 container init 0fa2f14005c7dddc9a6522c79d3a228dae1ef9f112047e702fc1d645b34a20bc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:48:52.212 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 podman[42227]: 2020-06-27 04:48:52.101353301 +0000 UTC m=+0.421415836 container start 0fa2f14005c7dddc9a6522c79d3a228dae1ef9f112047e702fc1d645b34a20bc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:48:52.212 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 podman[42227]: 2020-06-27 04:48:52.101628154 +0000 UTC m=+0.421690710 container attach 0fa2f14005c7dddc9a6522c79d3a228dae1ef9f112047e702fc1d645b34a20bc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:48:52.212 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 10 -- 172.21.15.51:0/1907007855 shutdown 172.21.15.51:0/1907007855 2020-06-27T04:48:52.212 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 10 Processor -- stop 2020-06-27T04:48:52.212 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 20 Event(0x55e098cd4e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:52.213 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 1 -- 172.21.15.51:0/1907007855 shutdown_connections 2020-06-27T04:48:52.213 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 5 -- 172.21.15.51:0/1907007855 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55e098d41400 2020-06-27T04:48:52.213 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 1 --2- 172.21.15.51:0/1907007855 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55e098d41400 0x55e098cb2300 unknown :-1 s=CLOSED pgs=3533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:52.213 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 5 -- 172.21.15.51:0/1907007855 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55e098d40c00 2020-06-27T04:48:52.213 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 1 --2- 172.21.15.51:0/1907007855 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e098d40c00 0x55e098cb1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:52.214 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 5 -- 172.21.15.51:0/1907007855 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55e098d41000 2020-06-27T04:48:52.214 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 1 --2- 172.21.15.51:0/1907007855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e098d41000 0x55e098cb1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:52.214 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 5 -- 172.21.15.51:0/1907007855 shutdown_connections delete 0x55e098d40c00 2020-06-27T04:48:52.214 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 5 -- 172.21.15.51:0/1907007855 shutdown_connections delete 0x55e098d41000 2020-06-27T04:48:52.214 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 5 -- 172.21.15.51:0/1907007855 shutdown_connections delete 0x55e098d41400 2020-06-27T04:48:52.214 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 1 -- 172.21.15.51:0/1907007855 >> 172.21.15.51:0/1907007855 conn(0x55e098d40800 msgr2=0x55e098da9000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:48:52.215 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 20 --1- 172.21.15.51:0/1907007855 >> 172.21.15.51:0/1907007855 conn(0x55e098d40800 0x55e098da9000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:52.215 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 2 --1- 172.21.15.51:0/1907007855 >> 172.21.15.51:0/1907007855 conn(0x55e098d40800 0x55e098da9000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:52.215 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 5 --1- 172.21.15.51:0/1907007855 >> 172.21.15.51:0/1907007855 conn(0x55e098d40800 0x55e098da9000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:48:52.215 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 20 Event(0x55e098cd4e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:52.215 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 10 --1- 172.21.15.51:0/1907007855 >> 172.21.15.51:0/1907007855 conn(0x55e098d40800 0x55e098da9000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:48:52.216 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 20 Event(0x55e098cd4e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:52.216 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 20 Event(0x55e098cd5040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:52.216 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178664b700 5 --1- 172.21.15.51:0/1907007855 >> 172.21.15.51:0/1907007855 conn(0x55e098d40800 0x55e098da9000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:48:52.216 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 20 Event(0x55e098cd5280 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:52.216 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178664b700 5 --1- 172.21.15.51:0/1907007855 >> 172.21.15.51:0/1907007855 conn(0x55e098d40800 0x55e098da9000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:48:52.217 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 10 -- 172.21.15.51:0/1907007855 wait: waiting for dispatch queue 2020-06-27T04:48:52.217 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 10 -- 172.21.15.51:0/1907007855 wait: dispatch queue is stopped 2020-06-27T04:48:52.217 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 1 -- 172.21.15.51:0/1907007855 shutdown_connections 2020-06-27T04:48:52.217 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 5 -- 172.21.15.51:0/1907007855 shutdown_connections delete 0x55e098d40800 2020-06-27T04:48:52.217 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 20 Event(0x55e098cd4e00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:52.218 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 20 Event(0x55e098cd5040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:52.218 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 20 Event(0x55e098cd5280 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:52.218 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 10 -- 172.21.15.51:0/1907007855 wait: done. 2020-06-27T04:48:52.218 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.065+0000 7f178c8c8f40 1 -- 172.21.15.51:0/1907007855 wait complete. 2020-06-27T04:48:52.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:51 smithi031 bash[18426]: debug 2020-06-27T04:48:51.730+0000 7f8751183700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 2 pgs recovery_unfound (PG_DAMAGED) 2020-06-27T04:48:52.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:51 smithi031 bash[18426]: cluster 2020-06-27T04:48:50.728949+0000 mon.a (mon.0) 1206 : cluster [DBG] osdmap e142: 8 total, 3 up, 8 in 2020-06-27T04:48:52.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:51 smithi031 bash[22603]: cluster 2020-06-27T04:48:50.728949+0000 mon.a (mon.0) 1206 : cluster [DBG] osdmap e142: 8 total, 3 up, 8 in 2020-06-27T04:48:52.226 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:51 smithi031 podman[113216]: 2020-06-27 04:48:51.748911536 +0000 UTC m=+2.047333890 container remove e849b192562586215353beb2aadab5c422e2c8b5ef26582a8892fbd62a3ded6f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:48:52.226 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:48:51 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2020-06-27T04:48:52.468 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 podman[42270]: 2020-06-27 04:48:52.209118178 +0000 UTC m=+0.289470202 container create 2504616dd81b4d3d0e16fcb22ee134e5853202cf81b076cb78aa701b0cc54b0d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:48:52.468 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 podman[42270]: 2020-06-27 04:48:52.334052886 +0000 UTC m=+0.414404818 container init 2504616dd81b4d3d0e16fcb22ee134e5853202cf81b076cb78aa701b0cc54b0d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:48:52.468 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 podman[42270]: 2020-06-27 04:48:52.367497677 +0000 UTC m=+0.447849619 container start 2504616dd81b4d3d0e16fcb22ee134e5853202cf81b076cb78aa701b0cc54b0d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:48:52.469 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 podman[42270]: 2020-06-27 04:48:52.367570416 +0000 UTC m=+0.447922384 container attach 2504616dd81b4d3d0e16fcb22ee134e5853202cf81b076cb78aa701b0cc54b0d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:48:52.469 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4bf121700 5 --2- 172.21.15.51:0/1657405030 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x563886599400 0x56388650a300 secure :-1 s=CLOSED pgs=3534 cs=0 l=1 rev1=1 rx=0x56388651ba70 tx=0x5638864e8d80).reset_recv_state (warped) reseting crypto handlers 2020-06-27T04:48:52.469 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4bf121700 5 --2- 172.21.15.51:0/1657405030 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x563886599400 0x56388650a300 secure :-1 s=CLOSED pgs=3534 cs=0 l=1 rev1=1 rx=0x56388651ba70 tx=0x5638864e8d80).reset_security 2020-06-27T04:48:52.469 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4bf121700 20 EpollDriver.del_event del event fd=16 cur_mask=1 delmask=3 to 5 2020-06-27T04:48:52.469 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 10 -- 172.21.15.51:0/1657405030 shutdown 172.21.15.51:0/1657405030 2020-06-27T04:48:52.470 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 10 Processor -- stop 2020-06-27T04:48:52.470 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 20 Event(0x56388652ce00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:52.470 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 1 -- 172.21.15.51:0/1657405030 shutdown_connections 2020-06-27T04:48:52.470 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 5 -- 172.21.15.51:0/1657405030 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x563886599400 2020-06-27T04:48:52.470 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 1 --2- 172.21.15.51:0/1657405030 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x563886599400 0x56388650a300 unknown :-1 s=CLOSED pgs=3534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:52.471 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 5 -- 172.21.15.51:0/1657405030 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x563886598c00 2020-06-27T04:48:52.471 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 1 --2- 172.21.15.51:0/1657405030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563886598c00 0x563886509400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:52.471 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 5 -- 172.21.15.51:0/1657405030 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x563886599000 2020-06-27T04:48:52.471 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 1 --2- 172.21.15.51:0/1657405030 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563886599000 0x563886509e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:48:52.471 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 5 -- 172.21.15.51:0/1657405030 shutdown_connections delete 0x563886598c00 2020-06-27T04:48:52.472 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 5 -- 172.21.15.51:0/1657405030 shutdown_connections delete 0x563886599000 2020-06-27T04:48:52.472 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 5 -- 172.21.15.51:0/1657405030 shutdown_connections delete 0x563886599400 2020-06-27T04:48:52.472 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 1 -- 172.21.15.51:0/1657405030 >> 172.21.15.51:0/1657405030 conn(0x563886598800 msgr2=0x563886601000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:48:52.472 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 20 --1- 172.21.15.51:0/1657405030 >> 172.21.15.51:0/1657405030 conn(0x563886598800 0x563886601000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:52.472 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 2 --1- 172.21.15.51:0/1657405030 >> 172.21.15.51:0/1657405030 conn(0x563886598800 0x563886601000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:48:52.473 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 5 --1- 172.21.15.51:0/1657405030 >> 172.21.15.51:0/1657405030 conn(0x563886598800 0x563886601000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:48:52.473 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 20 Event(0x56388652ce00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:52.473 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 10 --1- 172.21.15.51:0/1657405030 >> 172.21.15.51:0/1657405030 conn(0x563886598800 0x563886601000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:48:52.474 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 20 Event(0x56388652ce00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:52.474 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 20 Event(0x56388652d040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:52.474 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4bf121700 5 --1- 172.21.15.51:0/1657405030 >> 172.21.15.51:0/1657405030 conn(0x563886598800 0x563886601000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:48:52.474 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4c539ef40 20 Event(0x56388652d280 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:52.475 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.356+0000 7fa4bf121700 5 --1- 172.21.15.51:0/1657405030 >> 172.21.15.51:0/1657405030 conn(0x563886598800 0x563886601000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:48:52.475 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.357+0000 7fa4c539ef40 10 -- 172.21.15.51:0/1657405030 wait: waiting for dispatch queue 2020-06-27T04:48:52.475 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.357+0000 7fa4c539ef40 10 -- 172.21.15.51:0/1657405030 wait: dispatch queue is stopped 2020-06-27T04:48:52.475 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.357+0000 7fa4c539ef40 1 -- 172.21.15.51:0/1657405030 shutdown_connections 2020-06-27T04:48:52.475 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.357+0000 7fa4c539ef40 5 -- 172.21.15.51:0/1657405030 shutdown_connections delete 0x563886598800 2020-06-27T04:48:52.476 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.357+0000 7fa4c539ef40 20 Event(0x56388652ce00 nevent=5000 time_id=3).wakeup 2020-06-27T04:48:52.476 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.357+0000 7fa4c539ef40 20 Event(0x56388652d040 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:52.476 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.357+0000 7fa4c539ef40 20 Event(0x56388652d280 nevent=5000 time_id=2).wakeup 2020-06-27T04:48:52.476 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.357+0000 7fa4c539ef40 10 -- 172.21.15.51:0/1657405030 wait: done. 2020-06-27T04:48:52.476 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.357+0000 7fa4c539ef40 1 -- 172.21.15.51:0/1657405030 wait complete. 2020-06-27T04:48:52.874 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42022]: debug 2020-06-27T04:48:52.582+0000 7f178c8c8f40 -1 Falling back to public interface 2020-06-27T04:48:52.875 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[42065]: debug 2020-06-27T04:48:52.871+0000 7fa4c539ef40 -1 Falling back to public interface 2020-06-27T04:48:52.875 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[18409]: cluster 2020-06-27T04:48:51.241113+0000 mgr.x (mgr.34109) 271 : cluster [DBG] pgmap v327: 745 pgs: 4 activating+undersized, 2 stale+undersized+degraded+peered, 1 active+recovery_unfound+undersized+degraded, 62 peering, 4 creating+down, 49 active+undersized+degraded, 4 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 68 down, 61 stale+down, 23 unknown, 143 active+undersized, 33 stale+peering, 38 undersized+degraded+peered, 35 active+clean, 21 stale+undersized+peered, 194 undersized+peered, 1 stale+active+undersized; 25 KiB data, 20 MiB used, 707 GiB / 715 GiB avail; 3.2 KiB/s wr, 3 op/s; 364/1074 objects degraded (33.892%); 3/358 objects unfound (0.838%); 1.1 KiB/s, 0 objects/s recovering 2020-06-27T04:48:52.875 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[18409]: cluster 2020-06-27T04:48:51.731373+0000 mon.a (mon.0) 1207 : cluster [WRN] Health check failed: 3/358 objects unfound (0.838%) (OBJECT_UNFOUND) 2020-06-27T04:48:52.875 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[18409]: cluster 2020-06-27T04:48:51.731416+0000 mon.a (mon.0) 1208 : cluster [ERR] Health check failed: Possible data damage: 2 pgs recovery_unfound (PG_DAMAGED) 2020-06-27T04:48:52.876 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[18409]: cluster 2020-06-27T04:48:51.740019+0000 mon.a (mon.0) 1209 : cluster [DBG] osdmap e143: 8 total, 3 up, 8 in 2020-06-27T04:48:52.876 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[18409]: audit 2020-06-27T04:48:51.742737+0000 mon.c (mon.1) 80 : audit [INF] from='client.? 172.21.15.31:0/2235914547' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:52.876 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:52 smithi051 bash[18409]: audit 2020-06-27T04:48:51.743894+0000 mon.a (mon.0) 1210 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:53.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:52 smithi031 bash[18426]: cluster 2020-06-27T04:48:51.241113+0000 mgr.x (mgr.34109) 271 : cluster [DBG] pgmap v327: 745 pgs: 4 activating+undersized, 2 stale+undersized+degraded+peered, 1 active+recovery_unfound+undersized+degraded, 62 peering, 4 creating+down, 49 active+undersized+degraded, 4 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 68 down, 61 stale+down, 23 unknown, 143 active+undersized, 33 stale+peering, 38 undersized+degraded+peered, 35 active+clean, 21 stale+undersized+peered, 194 undersized+peered, 1 stale+active+undersized; 25 KiB data, 20 MiB used, 707 GiB / 715 GiB avail; 3.2 KiB/s wr, 3 op/s; 364/1074 objects degraded (33.892%); 3/358 objects unfound (0.838%); 1.1 KiB/s, 0 objects/s recovering 2020-06-27T04:48:53.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:52 smithi031 bash[18426]: cluster 2020-06-27T04:48:51.731373+0000 mon.a (mon.0) 1207 : cluster [WRN] Health check failed: 3/358 objects unfound (0.838%) (OBJECT_UNFOUND) 2020-06-27T04:48:53.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:52 smithi031 bash[18426]: cluster 2020-06-27T04:48:51.731416+0000 mon.a (mon.0) 1208 : cluster [ERR] Health check failed: Possible data damage: 2 pgs recovery_unfound (PG_DAMAGED) 2020-06-27T04:48:53.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:52 smithi031 bash[18426]: cluster 2020-06-27T04:48:51.740019+0000 mon.a (mon.0) 1209 : cluster [DBG] osdmap e143: 8 total, 3 up, 8 in 2020-06-27T04:48:53.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:52 smithi031 bash[18426]: audit 2020-06-27T04:48:51.742737+0000 mon.c (mon.1) 80 : audit [INF] from='client.? 172.21.15.31:0/2235914547' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:53.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:52 smithi031 bash[18426]: audit 2020-06-27T04:48:51.743894+0000 mon.a (mon.0) 1210 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:53.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:52 smithi031 bash[22603]: cluster 2020-06-27T04:48:51.241113+0000 mgr.x (mgr.34109) 271 : cluster [DBG] pgmap v327: 745 pgs: 4 activating+undersized, 2 stale+undersized+degraded+peered, 1 active+recovery_unfound+undersized+degraded, 62 peering, 4 creating+down, 49 active+undersized+degraded, 4 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 68 down, 61 stale+down, 23 unknown, 143 active+undersized, 33 stale+peering, 38 undersized+degraded+peered, 35 active+clean, 21 stale+undersized+peered, 194 undersized+peered, 1 stale+active+undersized; 25 KiB data, 20 MiB used, 707 GiB / 715 GiB avail; 3.2 KiB/s wr, 3 op/s; 364/1074 objects degraded (33.892%); 3/358 objects unfound (0.838%); 1.1 KiB/s, 0 objects/s recovering 2020-06-27T04:48:53.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:52 smithi031 bash[22603]: cluster 2020-06-27T04:48:51.731373+0000 mon.a (mon.0) 1207 : cluster [WRN] Health check failed: 3/358 objects unfound (0.838%) (OBJECT_UNFOUND) 2020-06-27T04:48:53.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:52 smithi031 bash[22603]: cluster 2020-06-27T04:48:51.731416+0000 mon.a (mon.0) 1208 : cluster [ERR] Health check failed: Possible data damage: 2 pgs recovery_unfound (PG_DAMAGED) 2020-06-27T04:48:53.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:52 smithi031 bash[22603]: cluster 2020-06-27T04:48:51.740019+0000 mon.a (mon.0) 1209 : cluster [DBG] osdmap e143: 8 total, 3 up, 8 in 2020-06-27T04:48:53.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:52 smithi031 bash[22603]: audit 2020-06-27T04:48:51.742737+0000 mon.c (mon.1) 80 : audit [INF] from='client.? 172.21.15.31:0/2235914547' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:53.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:52 smithi031 bash[22603]: audit 2020-06-27T04:48:51.743894+0000 mon.a (mon.0) 1210 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:53.553 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:53 smithi051 bash[42022]: debug 2020-06-27T04:48:53.283+0000 7f178c8c8f40 -1 osd.4 131 log_to_monitors {default=true} 2020-06-27T04:48:53.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:53 smithi051 bash[42065]: debug 2020-06-27T04:48:53.550+0000 7fa4c539ef40 -1 osd.6 131 log_to_monitors {default=true} 2020-06-27T04:48:53.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:53 smithi051 bash[18409]: audit 2020-06-27T04:48:52.751700+0000 mon.a (mon.0) 1211 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-7","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:53.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:53 smithi051 bash[18409]: cluster 2020-06-27T04:48:52.751822+0000 mon.a (mon.0) 1212 : cluster [DBG] osdmap e144: 8 total, 3 up, 8 in 2020-06-27T04:48:53.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:53 smithi051 bash[18409]: audit 2020-06-27T04:48:53.287173+0000 mon.b (mon.2) 325 : audit [INF] from='osd.4 v2:172.21.15.51:6801/1796910048' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:48:53.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:53 smithi051 bash[18409]: audit 2020-06-27T04:48:53.287484+0000 mon.a (mon.0) 1213 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:48:53.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:53 smithi051 bash[18409]: audit 2020-06-27T04:48:53.288043+0000 mon.b (mon.2) 326 : audit [INF] from='osd.4 v2:172.21.15.51:6801/1796910048' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:53.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:53 smithi051 bash[18409]: audit 2020-06-27T04:48:53.288363+0000 mon.a (mon.0) 1214 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:53.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:53 smithi051 bash[18409]: audit 2020-06-27T04:48:53.554575+0000 mon.b (mon.2) 327 : audit [INF] from='osd.6 v2:172.21.15.51:6809/407180238' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:48:53.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:53 smithi051 bash[18409]: audit 2020-06-27T04:48:53.555076+0000 mon.a (mon.0) 1215 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:48:53.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:53 smithi051 bash[18409]: audit 2020-06-27T04:48:53.555600+0000 mon.b (mon.2) 328 : audit [INF] from='osd.6 v2:172.21.15.51:6809/407180238' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:53.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:53 smithi051 bash[18409]: audit 2020-06-27T04:48:53.555932+0000 mon.a (mon.0) 1216 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:54.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[18426]: audit 2020-06-27T04:48:52.751700+0000 mon.a (mon.0) 1211 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-7","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:54.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[18426]: cluster 2020-06-27T04:48:52.751822+0000 mon.a (mon.0) 1212 : cluster [DBG] osdmap e144: 8 total, 3 up, 8 in 2020-06-27T04:48:54.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[18426]: audit 2020-06-27T04:48:53.287173+0000 mon.b (mon.2) 325 : audit [INF] from='osd.4 v2:172.21.15.51:6801/1796910048' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:48:54.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[18426]: audit 2020-06-27T04:48:53.287484+0000 mon.a (mon.0) 1213 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:48:54.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[18426]: audit 2020-06-27T04:48:53.288043+0000 mon.b (mon.2) 326 : audit [INF] from='osd.4 v2:172.21.15.51:6801/1796910048' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:54.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[18426]: audit 2020-06-27T04:48:53.288363+0000 mon.a (mon.0) 1214 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:54.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[18426]: audit 2020-06-27T04:48:53.554575+0000 mon.b (mon.2) 327 : audit [INF] from='osd.6 v2:172.21.15.51:6809/407180238' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:48:54.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[18426]: audit 2020-06-27T04:48:53.555076+0000 mon.a (mon.0) 1215 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:48:54.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[18426]: audit 2020-06-27T04:48:53.555600+0000 mon.b (mon.2) 328 : audit [INF] from='osd.6 v2:172.21.15.51:6809/407180238' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:54.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[18426]: audit 2020-06-27T04:48:53.555932+0000 mon.a (mon.0) 1216 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:54.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[22603]: audit 2020-06-27T04:48:52.751700+0000 mon.a (mon.0) 1211 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-7","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:54.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[22603]: cluster 2020-06-27T04:48:52.751822+0000 mon.a (mon.0) 1212 : cluster [DBG] osdmap e144: 8 total, 3 up, 8 in 2020-06-27T04:48:54.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[22603]: audit 2020-06-27T04:48:53.287173+0000 mon.b (mon.2) 325 : audit [INF] from='osd.4 v2:172.21.15.51:6801/1796910048' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:48:54.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[22603]: audit 2020-06-27T04:48:53.287484+0000 mon.a (mon.0) 1213 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:48:54.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[22603]: audit 2020-06-27T04:48:53.288043+0000 mon.b (mon.2) 326 : audit [INF] from='osd.4 v2:172.21.15.51:6801/1796910048' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:54.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[22603]: audit 2020-06-27T04:48:53.288363+0000 mon.a (mon.0) 1214 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:54.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[22603]: audit 2020-06-27T04:48:53.554575+0000 mon.b (mon.2) 327 : audit [INF] from='osd.6 v2:172.21.15.51:6809/407180238' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:48:54.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[22603]: audit 2020-06-27T04:48:53.555076+0000 mon.a (mon.0) 1215 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:48:54.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[22603]: audit 2020-06-27T04:48:53.555600+0000 mon.b (mon.2) 328 : audit [INF] from='osd.6 v2:172.21.15.51:6809/407180238' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:54.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:53 smithi031 bash[22603]: audit 2020-06-27T04:48:53.555932+0000 mon.a (mon.0) 1216 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:48:54.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: cluster 2020-06-27T04:48:53.242123+0000 mgr.x (mgr.34109) 272 : cluster [DBG] pgmap v330: 777 pgs: 4 activating+undersized, 2 stale+undersized+degraded+peered, 7 creating+peering, 1 active+recovery_unfound+undersized+degraded, 62 peering, 4 creating+down, 43 active+undersized+degraded, 4 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 65 down, 61 stale+down, 48 unknown, 141 active+undersized, 33 stale+peering, 50 undersized+degraded+peered, 11 active+clean, 21 stale+undersized+peered, 217 undersized+peered, 1 stale+active+undersized; 25 KiB data, 21 MiB used, 707 GiB / 715 GiB avail; 3.2 KiB/s wr, 3 op/s; 398/1074 objects degraded (37.058%); 3/358 objects unfound (0.838%); 1.1 KiB/s, 0 objects/s recovering 2020-06-27T04:48:54.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: cluster 2020-06-27T04:48:53.755915+0000 mon.a (mon.0) 1217 : cluster [INF] osd.4 v2:172.21.15.51:6801/1796910048 boot 2020-06-27T04:48:54.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: cluster 2020-06-27T04:48:53.755980+0000 mon.a (mon.0) 1218 : cluster [INF] osd.6 v2:172.21.15.51:6809/407180238 boot 2020-06-27T04:48:54.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: cluster 2020-06-27T04:48:53.756015+0000 mon.a (mon.0) 1219 : cluster [DBG] osdmap e145: 8 total, 5 up, 8 in 2020-06-27T04:48:54.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: audit 2020-06-27T04:48:53.811763+0000 mon.b (mon.2) 329 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:48:54.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: audit 2020-06-27T04:48:53.812144+0000 mon.b (mon.2) 330 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:48:54.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.388031+0000 mon.a (mon.0) 1220 : cluster [WRN] Health check update: 3 osds down (OSD_DOWN) 2020-06-27T04:48:54.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.388299+0000 mon.a (mon.0) 1221 : cluster [WRN] Health check update: Reduced data availability: 79 pgs inactive, 134 pgs down, 8 pgs peering (PG_AVAILABILITY) 2020-06-27T04:48:54.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.388338+0000 mon.a (mon.0) 1222 : cluster [WRN] Health check update: Degraded data redundancy: 398/1074 objects degraded (37.058%), 97 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:54.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.388580+0000 mon.a (mon.0) 1223 : cluster [WRN] pool 'test-rados-api-smithi031-41123-3' is full (reached quota's max_bytes: 4 KiB) 2020-06-27T04:48:54.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.389339+0000 mon.a (mon.0) 1224 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2020-06-27T04:48:54.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.396413+0000 mon.a (mon.0) 1225 : cluster [DBG] osdmap e146: 8 total, 5 up, 8 in 2020-06-27T04:48:54.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: audit 2020-06-27T04:48:54.397502+0000 mon.c (mon.1) 81 : audit [INF] from='client.? 172.21.15.31:0/2691619859' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:54.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: audit 2020-06-27T04:48:54.403511+0000 mon.a (mon.0) 1226 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:54.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.622518+0000 mon.a (mon.0) 1227 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:54.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.622553+0000 mon.a (mon.0) 1228 : cluster [INF] osd.6 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:48:54.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.622918+0000 mon.a (mon.0) 1229 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:54.972 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.623947+0000 mon.a (mon.0) 1230 : cluster [DBG] osd.6 reported immediately failed by osd.4 2020-06-27T04:48:54.973 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.624054+0000 mon.a (mon.0) 1231 : cluster [DBG] osd.6 reported immediately failed by osd.4 2020-06-27T04:48:54.973 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:54.973 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: in thread 7fa49c308700 thread_name:tp_osd_tp 2020-06-27T04:48:54.973 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:54.974 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 1: (()+0x12dd0) [0x7fa4c3111dd0] 2020-06-27T04:48:54.974 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x56387c4a6707] 2020-06-27T04:48:54.974 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x56387c4a6aa0] 2020-06-27T04:48:54.974 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x56387c4d867a] 2020-06-27T04:48:54.974 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x56387c4d9a57] 2020-06-27T04:48:54.975 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x56387c164938] 2020-06-27T04:48:54.975 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x56387c31503d] 2020-06-27T04:48:54.975 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x56387c0d25b0] 2020-06-27T04:48:54.975 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x56387c12b89d] 2020-06-27T04:48:54.976 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x56387c134380] 2020-06-27T04:48:54.976 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x56387c13b590] 2020-06-27T04:48:54.976 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x56387bfbb4e9] 2020-06-27T04:48:54.976 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x56387c21ff78] 2020-06-27T04:48:54.977 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x56387bfda70f] 2020-06-27T04:48:54.977 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x56387c618b94] 2020-06-27T04:48:54.977 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x56387c61b7f4] 2020-06-27T04:48:54.977 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 17: (()+0x82de) [0x7fa4c31072de] 2020-06-27T04:48:54.977 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 18: (clone()+0x43) [0x7fa4c1e3ee83] 2020-06-27T04:48:54.978 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: debug 2020-06-27T04:48:54.584+0000 7fa49c308700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:54.978 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: in thread 7fa49c308700 thread_name:tp_osd_tp 2020-06-27T04:48:54.978 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:54.978 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 1: (()+0x12dd0) [0x7fa4c3111dd0] 2020-06-27T04:48:54.978 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x56387c4a6707] 2020-06-27T04:48:54.979 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x56387c4a6aa0] 2020-06-27T04:48:54.979 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x56387c4d867a] 2020-06-27T04:48:54.979 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x56387c4d9a57] 2020-06-27T04:48:54.979 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x56387c164938] 2020-06-27T04:48:54.979 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x56387c31503d] 2020-06-27T04:48:54.980 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x56387c0d25b0] 2020-06-27T04:48:54.980 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x56387c12b89d] 2020-06-27T04:48:54.980 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x56387c134380] 2020-06-27T04:48:54.980 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x56387c13b590] 2020-06-27T04:48:54.980 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x56387bfbb4e9] 2020-06-27T04:48:54.981 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x56387c21ff78] 2020-06-27T04:48:54.981 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x56387bfda70f] 2020-06-27T04:48:54.981 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x56387c618b94] 2020-06-27T04:48:54.983 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x56387c61b7f4] 2020-06-27T04:48:54.983 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 17: (()+0x82de) [0x7fa4c31072de] 2020-06-27T04:48:54.984 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 18: (clone()+0x43) [0x7fa4c1e3ee83] 2020-06-27T04:48:54.984 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:54.984 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: debug -9999> 2020-06-27T04:48:54.584+0000 7fa49c308700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:54.985 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: in thread 7fa49c308700 thread_name:tp_osd_tp 2020-06-27T04:48:54.985 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:54.985 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 1: (()+0x12dd0) [0x7fa4c3111dd0] 2020-06-27T04:48:54.986 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x56387c4a6707] 2020-06-27T04:48:54.986 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x56387c4a6aa0] 2020-06-27T04:48:54.986 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x56387c4d867a] 2020-06-27T04:48:54.986 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x56387c4d9a57] 2020-06-27T04:48:54.986 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x56387c164938] 2020-06-27T04:48:54.987 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x56387c31503d] 2020-06-27T04:48:54.987 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x56387c0d25b0] 2020-06-27T04:48:54.987 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x56387c12b89d] 2020-06-27T04:48:54.987 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x56387c134380] 2020-06-27T04:48:54.987 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x56387c13b590] 2020-06-27T04:48:54.988 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x56387bfbb4e9] 2020-06-27T04:48:54.988 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x56387c21ff78] 2020-06-27T04:48:54.988 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x56387bfda70f] 2020-06-27T04:48:54.988 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x56387c618b94] 2020-06-27T04:48:54.988 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x56387c61b7f4] 2020-06-27T04:48:54.989 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 17: (()+0x82de) [0x7fa4c31072de] 2020-06-27T04:48:54.989 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 18: (clone()+0x43) [0x7fa4c1e3ee83] 2020-06-27T04:48:54.989 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:54.989 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: debug -9999> 2020-06-27T04:48:54.584+0000 7fa49c308700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:54.989 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: in thread 7fa49c308700 thread_name:tp_osd_tp 2020-06-27T04:48:54.990 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:54.990 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 1: (()+0x12dd0) [0x7fa4c3111dd0] 2020-06-27T04:48:54.990 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x56387c4a6707] 2020-06-27T04:48:54.990 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x56387c4a6aa0] 2020-06-27T04:48:54.990 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x56387c4d867a] 2020-06-27T04:48:54.991 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x56387c4d9a57] 2020-06-27T04:48:54.991 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x56387c164938] 2020-06-27T04:48:54.991 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x56387c31503d] 2020-06-27T04:48:54.991 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x56387c0d25b0] 2020-06-27T04:48:54.992 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x56387c12b89d] 2020-06-27T04:48:54.992 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x56387c134380] 2020-06-27T04:48:54.992 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x56387c13b590] 2020-06-27T04:48:54.992 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x56387bfbb4e9] 2020-06-27T04:48:54.992 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x56387c21ff78] 2020-06-27T04:48:54.992 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x56387bfda70f] 2020-06-27T04:48:54.993 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x56387c618b94] 2020-06-27T04:48:54.993 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x56387c61b7f4] 2020-06-27T04:48:54.993 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 17: (()+0x82de) [0x7fa4c31072de] 2020-06-27T04:48:54.993 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: 18: (clone()+0x43) [0x7fa4c1e3ee83] 2020-06-27T04:48:54.993 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:54.994 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 bash[42065]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:54.994 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:54 smithi051 podman[42270]: 2020-06-27 04:48:54.655622919 +0000 UTC m=+2.735974868 container died 2504616dd81b4d3d0e16fcb22ee134e5853202cf81b076cb78aa701b0cc54b0d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:48:55.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: cluster 2020-06-27T04:48:53.242123+0000 mgr.x (mgr.34109) 272 : cluster [DBG] pgmap v330: 777 pgs: 4 activating+undersized, 2 stale+undersized+degraded+peered, 7 creating+peering, 1 active+recovery_unfound+undersized+degraded, 62 peering, 4 creating+down, 43 active+undersized+degraded, 4 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 65 down, 61 stale+down, 48 unknown, 141 active+undersized, 33 stale+peering, 50 undersized+degraded+peered, 11 active+clean, 21 stale+undersized+peered, 217 undersized+peered, 1 stale+active+undersized; 25 KiB data, 21 MiB used, 707 GiB / 715 GiB avail; 3.2 KiB/s wr, 3 op/s; 398/1074 objects degraded (37.058%); 3/358 objects unfound (0.838%); 1.1 KiB/s, 0 objects/s recovering 2020-06-27T04:48:55.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: cluster 2020-06-27T04:48:53.755915+0000 mon.a (mon.0) 1217 : cluster [INF] osd.4 v2:172.21.15.51:6801/1796910048 boot 2020-06-27T04:48:55.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: cluster 2020-06-27T04:48:53.755980+0000 mon.a (mon.0) 1218 : cluster [INF] osd.6 v2:172.21.15.51:6809/407180238 boot 2020-06-27T04:48:55.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: cluster 2020-06-27T04:48:53.756015+0000 mon.a (mon.0) 1219 : cluster [DBG] osdmap e145: 8 total, 5 up, 8 in 2020-06-27T04:48:55.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: audit 2020-06-27T04:48:53.811763+0000 mon.b (mon.2) 329 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:48:55.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: audit 2020-06-27T04:48:53.812144+0000 mon.b (mon.2) 330 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:48:55.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.388031+0000 mon.a (mon.0) 1220 : cluster [WRN] Health check update: 3 osds down (OSD_DOWN) 2020-06-27T04:48:55.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.388299+0000 mon.a (mon.0) 1221 : cluster [WRN] Health check update: Reduced data availability: 79 pgs inactive, 134 pgs down, 8 pgs peering (PG_AVAILABILITY) 2020-06-27T04:48:55.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.388338+0000 mon.a (mon.0) 1222 : cluster [WRN] Health check update: Degraded data redundancy: 398/1074 objects degraded (37.058%), 97 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:55.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.388580+0000 mon.a (mon.0) 1223 : cluster [WRN] pool 'test-rados-api-smithi031-41123-3' is full (reached quota's max_bytes: 4 KiB) 2020-06-27T04:48:55.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.389339+0000 mon.a (mon.0) 1224 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2020-06-27T04:48:55.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.396413+0000 mon.a (mon.0) 1225 : cluster [DBG] osdmap e146: 8 total, 5 up, 8 in 2020-06-27T04:48:55.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: audit 2020-06-27T04:48:54.397502+0000 mon.c (mon.1) 81 : audit [INF] from='client.? 172.21.15.31:0/2691619859' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:55.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: audit 2020-06-27T04:48:54.403511+0000 mon.a (mon.0) 1226 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:55.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.622518+0000 mon.a (mon.0) 1227 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:55.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.622553+0000 mon.a (mon.0) 1228 : cluster [INF] osd.6 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:48:55.228 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.622918+0000 mon.a (mon.0) 1229 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:55.228 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.623947+0000 mon.a (mon.0) 1230 : cluster [DBG] osd.6 reported immediately failed by osd.4 2020-06-27T04:48:55.228 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.624054+0000 mon.a (mon.0) 1231 : cluster [DBG] osd.6 reported immediately failed by osd.4 2020-06-27T04:48:55.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: cluster 2020-06-27T04:48:53.242123+0000 mgr.x (mgr.34109) 272 : cluster [DBG] pgmap v330: 777 pgs: 4 activating+undersized, 2 stale+undersized+degraded+peered, 7 creating+peering, 1 active+recovery_unfound+undersized+degraded, 62 peering, 4 creating+down, 43 active+undersized+degraded, 4 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 65 down, 61 stale+down, 48 unknown, 141 active+undersized, 33 stale+peering, 50 undersized+degraded+peered, 11 active+clean, 21 stale+undersized+peered, 217 undersized+peered, 1 stale+active+undersized; 25 KiB data, 21 MiB used, 707 GiB / 715 GiB avail; 3.2 KiB/s wr, 3 op/s; 398/1074 objects degraded (37.058%); 3/358 objects unfound (0.838%); 1.1 KiB/s, 0 objects/s recovering 2020-06-27T04:48:55.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: cluster 2020-06-27T04:48:53.755915+0000 mon.a (mon.0) 1217 : cluster [INF] osd.4 v2:172.21.15.51:6801/1796910048 boot 2020-06-27T04:48:55.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: cluster 2020-06-27T04:48:53.755980+0000 mon.a (mon.0) 1218 : cluster [INF] osd.6 v2:172.21.15.51:6809/407180238 boot 2020-06-27T04:48:55.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: cluster 2020-06-27T04:48:53.756015+0000 mon.a (mon.0) 1219 : cluster [DBG] osdmap e145: 8 total, 5 up, 8 in 2020-06-27T04:48:55.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: audit 2020-06-27T04:48:53.811763+0000 mon.b (mon.2) 329 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:48:55.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: audit 2020-06-27T04:48:53.812144+0000 mon.b (mon.2) 330 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:48:55.230 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.388031+0000 mon.a (mon.0) 1220 : cluster [WRN] Health check update: 3 osds down (OSD_DOWN) 2020-06-27T04:48:55.230 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.388299+0000 mon.a (mon.0) 1221 : cluster [WRN] Health check update: Reduced data availability: 79 pgs inactive, 134 pgs down, 8 pgs peering (PG_AVAILABILITY) 2020-06-27T04:48:55.230 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.388338+0000 mon.a (mon.0) 1222 : cluster [WRN] Health check update: Degraded data redundancy: 398/1074 objects degraded (37.058%), 97 pgs degraded (PG_DEGRADED) 2020-06-27T04:48:55.230 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.388580+0000 mon.a (mon.0) 1223 : cluster [WRN] pool 'test-rados-api-smithi031-41123-3' is full (reached quota's max_bytes: 4 KiB) 2020-06-27T04:48:55.230 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.389339+0000 mon.a (mon.0) 1224 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2020-06-27T04:48:55.231 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.396413+0000 mon.a (mon.0) 1225 : cluster [DBG] osdmap e146: 8 total, 5 up, 8 in 2020-06-27T04:48:55.231 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: audit 2020-06-27T04:48:54.397502+0000 mon.c (mon.1) 81 : audit [INF] from='client.? 172.21.15.31:0/2691619859' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:55.231 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: audit 2020-06-27T04:48:54.403511+0000 mon.a (mon.0) 1226 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:55.232 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.622518+0000 mon.a (mon.0) 1227 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:55.232 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.622553+0000 mon.a (mon.0) 1228 : cluster [INF] osd.6 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:48:55.232 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.622918+0000 mon.a (mon.0) 1229 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:55.232 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.623947+0000 mon.a (mon.0) 1230 : cluster [DBG] osd.6 reported immediately failed by osd.4 2020-06-27T04:48:55.232 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:54 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.624054+0000 mon.a (mon.0) 1231 : cluster [DBG] osd.6 reported immediately failed by osd.4 2020-06-27T04:48:55.369 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:55 smithi051 podman[42270]: 2020-06-27 04:48:55.113934327 +0000 UTC m=+3.194286272 container remove 2504616dd81b4d3d0e16fcb22ee134e5853202cf81b076cb78aa701b0cc54b0d (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:48:55.369 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:55 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:55.720 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:55 smithi051 podman[43052]: 2020-06-27 04:48:55.366949651 +0000 UTC m=+0.235882537 container create 20ac237a38e3cebc9fd4e2d38b3d3aa046164fbc0c0d447497281748e7c24ec5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:55.723 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:55 smithi051 podman[43052]: 2020-06-27 04:48:55.508557049 +0000 UTC m=+0.377490025 container init 20ac237a38e3cebc9fd4e2d38b3d3aa046164fbc0c0d447497281748e7c24ec5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:55.723 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:55 smithi051 podman[43052]: 2020-06-27 04:48:55.541882182 +0000 UTC m=+0.410815059 container start 20ac237a38e3cebc9fd4e2d38b3d3aa046164fbc0c0d447497281748e7c24ec5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:55.724 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:55 smithi051 podman[43052]: 2020-06-27 04:48:55.541972124 +0000 UTC m=+0.410905037 container attach 20ac237a38e3cebc9fd4e2d38b3d3aa046164fbc0c0d447497281748e7c24ec5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:56.218 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:55 smithi051 podman[43052]: 2020-06-27 04:48:55.776616683 +0000 UTC m=+0.645549655 container died 20ac237a38e3cebc9fd4e2d38b3d3aa046164fbc0c0d447497281748e7c24ec5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.823293+0000 mon.a (mon.0) 1232 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:48:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.823542+0000 mon.a (mon.0) 1233 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:48:56.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.823633+0000 mon.a (mon.0) 1234 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:48:56.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.823752+0000 mon.a (mon.0) 1235 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:48:56.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.823830+0000 mon.a (mon.0) 1236 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:56.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.823922+0000 mon.a (mon.0) 1237 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:48:56.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.824002+0000 mon.a (mon.0) 1238 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:56.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.824067+0000 mon.a (mon.0) 1239 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:56.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.824898+0000 mon.a (mon.0) 1240 : cluster [DBG] osd.6 reported immediately failed by osd.4 2020-06-27T04:48:56.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:54.825006+0000 mon.a (mon.0) 1241 : cluster [DBG] osd.6 reported immediately failed by osd.4 2020-06-27T04:48:56.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:55.224260+0000 mon.a (mon.0) 1242 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:48:56.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:55.224637+0000 mon.a (mon.0) 1243 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:48:56.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:55.224786+0000 mon.a (mon.0) 1244 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:48:56.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:55.224935+0000 mon.a (mon.0) 1245 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:56.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:55.225069+0000 mon.a (mon.0) 1246 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:48:56.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:55.225201+0000 mon.a (mon.0) 1247 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:56.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:55.225350+0000 mon.a (mon.0) 1248 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:48:56.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:55.225485+0000 mon.a (mon.0) 1249 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:56.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:55.226164+0000 mon.a (mon.0) 1250 : cluster [DBG] osd.6 reported immediately failed by osd.4 2020-06-27T04:48:56.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:55.226381+0000 mon.a (mon.0) 1251 : cluster [DBG] osd.6 reported immediately failed by osd.4 2020-06-27T04:48:56.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: audit 2020-06-27T04:48:55.398055+0000 mon.a (mon.0) 1252 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-8","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:56.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:55 smithi051 bash[18409]: cluster 2020-06-27T04:48:55.398211+0000 mon.a (mon.0) 1253 : cluster [DBG] osdmap e147: 8 total, 4 up, 8 in 2020-06-27T04:48:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.823293+0000 mon.a (mon.0) 1232 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:48:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.823542+0000 mon.a (mon.0) 1233 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:48:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.823633+0000 mon.a (mon.0) 1234 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:48:56.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.823752+0000 mon.a (mon.0) 1235 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:48:56.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.823830+0000 mon.a (mon.0) 1236 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:56.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.823922+0000 mon.a (mon.0) 1237 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:48:56.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.824002+0000 mon.a (mon.0) 1238 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:56.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.824067+0000 mon.a (mon.0) 1239 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:56.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.824898+0000 mon.a (mon.0) 1240 : cluster [DBG] osd.6 reported immediately failed by osd.4 2020-06-27T04:48:56.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:54.825006+0000 mon.a (mon.0) 1241 : cluster [DBG] osd.6 reported immediately failed by osd.4 2020-06-27T04:48:56.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:55.224260+0000 mon.a (mon.0) 1242 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:48:56.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:55.224637+0000 mon.a (mon.0) 1243 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:48:56.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:55.224786+0000 mon.a (mon.0) 1244 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:48:56.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:55.224935+0000 mon.a (mon.0) 1245 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:56.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:55.225069+0000 mon.a (mon.0) 1246 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:48:56.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:55.225201+0000 mon.a (mon.0) 1247 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:56.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:55.225350+0000 mon.a (mon.0) 1248 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:48:56.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:55.225485+0000 mon.a (mon.0) 1249 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:56.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:55.226164+0000 mon.a (mon.0) 1250 : cluster [DBG] osd.6 reported immediately failed by osd.4 2020-06-27T04:48:56.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:55.226381+0000 mon.a (mon.0) 1251 : cluster [DBG] osd.6 reported immediately failed by osd.4 2020-06-27T04:48:56.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: audit 2020-06-27T04:48:55.398055+0000 mon.a (mon.0) 1252 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-8","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:56.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[18426]: cluster 2020-06-27T04:48:55.398211+0000 mon.a (mon.0) 1253 : cluster [DBG] osdmap e147: 8 total, 4 up, 8 in 2020-06-27T04:48:56.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.823293+0000 mon.a (mon.0) 1232 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:48:56.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.823542+0000 mon.a (mon.0) 1233 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:48:56.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.823633+0000 mon.a (mon.0) 1234 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:48:56.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.823752+0000 mon.a (mon.0) 1235 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:48:56.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.823830+0000 mon.a (mon.0) 1236 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:56.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.823922+0000 mon.a (mon.0) 1237 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:48:56.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.824002+0000 mon.a (mon.0) 1238 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:56.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.824067+0000 mon.a (mon.0) 1239 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:56.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.824898+0000 mon.a (mon.0) 1240 : cluster [DBG] osd.6 reported immediately failed by osd.4 2020-06-27T04:48:56.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:54.825006+0000 mon.a (mon.0) 1241 : cluster [DBG] osd.6 reported immediately failed by osd.4 2020-06-27T04:48:56.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:55.224260+0000 mon.a (mon.0) 1242 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:48:56.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:55.224637+0000 mon.a (mon.0) 1243 : cluster [DBG] osd.6 reported immediately failed by osd.7 2020-06-27T04:48:56.231 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:55.224786+0000 mon.a (mon.0) 1244 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:48:56.231 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:55.224935+0000 mon.a (mon.0) 1245 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:56.232 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:55.225069+0000 mon.a (mon.0) 1246 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:48:56.232 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:55.225201+0000 mon.a (mon.0) 1247 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:56.232 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:55.225350+0000 mon.a (mon.0) 1248 : cluster [DBG] osd.6 reported immediately failed by osd.2 2020-06-27T04:48:56.232 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:55.225485+0000 mon.a (mon.0) 1249 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:48:56.233 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:55.226164+0000 mon.a (mon.0) 1250 : cluster [DBG] osd.6 reported immediately failed by osd.4 2020-06-27T04:48:56.233 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:55.226381+0000 mon.a (mon.0) 1251 : cluster [DBG] osd.6 reported immediately failed by osd.4 2020-06-27T04:48:56.233 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: audit 2020-06-27T04:48:55.398055+0000 mon.a (mon.0) 1252 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-8","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:56.233 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:55 smithi031 bash[22603]: cluster 2020-06-27T04:48:55.398211+0000 mon.a (mon.0) 1253 : cluster [DBG] osdmap e147: 8 total, 4 up, 8 in 2020-06-27T04:48:56.500 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:56.500 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: in thread 7f175f82a700 thread_name:tp_osd_tp 2020-06-27T04:48:56.500 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:56.501 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 1: (()+0x12dd0) [0x7f178a63bdd0] 2020-06-27T04:48:56.501 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55e08eb0a707] 2020-06-27T04:48:56.501 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55e08eb0aaa0] 2020-06-27T04:48:56.501 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55e08eb3c67a] 2020-06-27T04:48:56.502 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55e08eb3da57] 2020-06-27T04:48:56.502 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55e08e7c8938] 2020-06-27T04:48:56.502 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55e08e97ca70] 2020-06-27T04:48:56.502 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55e08e98cdd7] 2020-06-27T04:48:56.502 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55e08e7fb252] 2020-06-27T04:48:56.502 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55e08e79ee2e] 2020-06-27T04:48:56.503 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55e08e61f4e9] 2020-06-27T04:48:56.503 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55e08e883f78] 2020-06-27T04:48:56.503 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55e08e63e70f] 2020-06-27T04:48:56.503 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55e08ec7cb94] 2020-06-27T04:48:56.503 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55e08ec7f7f4] 2020-06-27T04:48:56.504 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 16: (()+0x82de) [0x7f178a6312de] 2020-06-27T04:48:56.504 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 17: (clone()+0x43) [0x7f1789368e83] 2020-06-27T04:48:56.504 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: debug 2020-06-27T04:48:56.454+0000 7f175f82a700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:56.504 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: in thread 7f175f82a700 thread_name:tp_osd_tp 2020-06-27T04:48:56.504 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:56.504 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 1: (()+0x12dd0) [0x7f178a63bdd0] 2020-06-27T04:48:56.505 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55e08eb0a707] 2020-06-27T04:48:56.505 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55e08eb0aaa0] 2020-06-27T04:48:56.505 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55e08eb3c67a] 2020-06-27T04:48:56.505 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55e08eb3da57] 2020-06-27T04:48:56.505 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55e08e7c8938] 2020-06-27T04:48:56.506 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55e08e97ca70] 2020-06-27T04:48:56.506 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55e08e98cdd7] 2020-06-27T04:48:56.506 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55e08e7fb252] 2020-06-27T04:48:56.506 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55e08e79ee2e] 2020-06-27T04:48:56.506 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55e08e61f4e9] 2020-06-27T04:48:56.507 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55e08e883f78] 2020-06-27T04:48:56.507 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55e08e63e70f] 2020-06-27T04:48:56.507 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55e08ec7cb94] 2020-06-27T04:48:56.507 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55e08ec7f7f4] 2020-06-27T04:48:56.507 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 16: (()+0x82de) [0x7f178a6312de] 2020-06-27T04:48:56.507 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 17: (clone()+0x43) [0x7f1789368e83] 2020-06-27T04:48:56.508 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:56.508 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: debug -9999> 2020-06-27T04:48:56.454+0000 7f175f82a700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:56.508 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: in thread 7f175f82a700 thread_name:tp_osd_tp 2020-06-27T04:48:56.508 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:56.508 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 1: (()+0x12dd0) [0x7f178a63bdd0] 2020-06-27T04:48:56.509 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55e08eb0a707] 2020-06-27T04:48:56.509 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55e08eb0aaa0] 2020-06-27T04:48:56.509 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55e08eb3c67a] 2020-06-27T04:48:56.509 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55e08eb3da57] 2020-06-27T04:48:56.509 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55e08e7c8938] 2020-06-27T04:48:56.510 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55e08e97ca70] 2020-06-27T04:48:56.510 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55e08e98cdd7] 2020-06-27T04:48:56.510 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55e08e7fb252] 2020-06-27T04:48:56.510 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55e08e79ee2e] 2020-06-27T04:48:56.510 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55e08e61f4e9] 2020-06-27T04:48:56.511 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55e08e883f78] 2020-06-27T04:48:56.511 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55e08e63e70f] 2020-06-27T04:48:56.511 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55e08ec7cb94] 2020-06-27T04:48:56.511 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55e08ec7f7f4] 2020-06-27T04:48:56.511 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 16: (()+0x82de) [0x7f178a6312de] 2020-06-27T04:48:56.511 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 17: (clone()+0x43) [0x7f1789368e83] 2020-06-27T04:48:56.512 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:56.512 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: debug -9999> 2020-06-27T04:48:56.454+0000 7f175f82a700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:56.512 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: in thread 7f175f82a700 thread_name:tp_osd_tp 2020-06-27T04:48:56.512 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:56.512 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 1: (()+0x12dd0) [0x7f178a63bdd0] 2020-06-27T04:48:56.513 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55e08eb0a707] 2020-06-27T04:48:56.513 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55e08eb0aaa0] 2020-06-27T04:48:56.513 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55e08eb3c67a] 2020-06-27T04:48:56.513 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55e08eb3da57] 2020-06-27T04:48:56.513 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55e08e7c8938] 2020-06-27T04:48:56.514 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55e08e97ca70] 2020-06-27T04:48:56.514 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55e08e98cdd7] 2020-06-27T04:48:56.514 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55e08e7fb252] 2020-06-27T04:48:56.515 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55e08e79ee2e] 2020-06-27T04:48:56.515 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55e08e61f4e9] 2020-06-27T04:48:56.515 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55e08e883f78] 2020-06-27T04:48:56.515 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55e08e63e70f] 2020-06-27T04:48:56.516 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55e08ec7cb94] 2020-06-27T04:48:56.516 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55e08ec7f7f4] 2020-06-27T04:48:56.516 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 16: (()+0x82de) [0x7f178a6312de] 2020-06-27T04:48:56.516 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: 17: (clone()+0x43) [0x7f1789368e83] 2020-06-27T04:48:56.516 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:56.517 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[42022]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:56.517 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:56 smithi051 podman[43052]: 2020-06-27 04:48:56.24336305 +0000 UTC m=+1.112295945 container remove 20ac237a38e3cebc9fd4e2d38b3d3aa046164fbc0c0d447497281748e7c24ec5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:48:56.517 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:48:56 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2020-06-27T04:48:56.517 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:56 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:48:56.517 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:56 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Scheduled restart job, restart counter is at 6. 2020-06-27T04:48:56.518 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:56 smithi051 systemd[1]: Stopped Ceph osd.5 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:56.518 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:56 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Start request repeated too quickly. 2020-06-27T04:48:56.518 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:56 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.5.service: Failed with result 'exit-code'. 2020-06-27T04:48:56.518 INFO:ceph.osd.5.smithi051.stdout:Jun 27 04:48:56 smithi051 systemd[1]: Failed to start Ceph osd.5 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:48:56.723 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:56.724 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: in thread 7f742e975700 thread_name:tp_osd_tp 2020-06-27T04:48:56.724 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:56.724 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 1: (()+0x12dd0) [0x7f745577edd0] 2020-06-27T04:48:56.724 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55717779d707] 2020-06-27T04:48:56.725 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55717779daa0] 2020-06-27T04:48:56.725 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5571777cf67a] 2020-06-27T04:48:56.725 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5571777d0a57] 2020-06-27T04:48:56.725 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55717745b938] 2020-06-27T04:48:56.725 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55717760c03d] 2020-06-27T04:48:56.726 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5571773c95b0] 2020-06-27T04:48:56.726 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55717742289d] 2020-06-27T04:48:56.726 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55717742b380] 2020-06-27T04:48:56.726 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x557177432590] 2020-06-27T04:48:56.726 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5571772b24e9] 2020-06-27T04:48:56.727 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x557177516f78] 2020-06-27T04:48:56.727 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5571772d170f] 2020-06-27T04:48:56.727 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55717790fb94] 2020-06-27T04:48:56.727 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5571779127f4] 2020-06-27T04:48:56.727 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 17: (()+0x82de) [0x7f74557742de] 2020-06-27T04:48:56.727 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 18: (clone()+0x43) [0x7f74544abe83] 2020-06-27T04:48:56.728 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: debug 2020-06-27T04:48:56.450+0000 7f742e975700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:56.728 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: in thread 7f742e975700 thread_name:tp_osd_tp 2020-06-27T04:48:56.728 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:56.728 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 1: (()+0x12dd0) [0x7f745577edd0] 2020-06-27T04:48:56.728 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55717779d707] 2020-06-27T04:48:56.729 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55717779daa0] 2020-06-27T04:48:56.729 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5571777cf67a] 2020-06-27T04:48:56.729 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5571777d0a57] 2020-06-27T04:48:56.729 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55717745b938] 2020-06-27T04:48:56.729 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55717760c03d] 2020-06-27T04:48:56.730 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5571773c95b0] 2020-06-27T04:48:56.730 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55717742289d] 2020-06-27T04:48:56.730 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55717742b380] 2020-06-27T04:48:56.730 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x557177432590] 2020-06-27T04:48:56.730 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5571772b24e9] 2020-06-27T04:48:56.731 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x557177516f78] 2020-06-27T04:48:56.731 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5571772d170f] 2020-06-27T04:48:56.731 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55717790fb94] 2020-06-27T04:48:56.731 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5571779127f4] 2020-06-27T04:48:56.731 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 17: (()+0x82de) [0x7f74557742de] 2020-06-27T04:48:56.731 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 18: (clone()+0x43) [0x7f74544abe83] 2020-06-27T04:48:56.732 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:56.732 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: debug 0> 2020-06-27T04:48:56.450+0000 7f742e975700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:56.732 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: in thread 7f742e975700 thread_name:tp_osd_tp 2020-06-27T04:48:56.732 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:56.732 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 1: (()+0x12dd0) [0x7f745577edd0] 2020-06-27T04:48:56.733 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55717779d707] 2020-06-27T04:48:56.733 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55717779daa0] 2020-06-27T04:48:56.733 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5571777cf67a] 2020-06-27T04:48:56.733 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5571777d0a57] 2020-06-27T04:48:56.733 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55717745b938] 2020-06-27T04:48:56.734 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55717760c03d] 2020-06-27T04:48:56.734 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5571773c95b0] 2020-06-27T04:48:56.734 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55717742289d] 2020-06-27T04:48:56.734 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55717742b380] 2020-06-27T04:48:56.735 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x557177432590] 2020-06-27T04:48:56.735 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5571772b24e9] 2020-06-27T04:48:56.735 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x557177516f78] 2020-06-27T04:48:56.736 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5571772d170f] 2020-06-27T04:48:56.736 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55717790fb94] 2020-06-27T04:48:56.736 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5571779127f4] 2020-06-27T04:48:56.736 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 17: (()+0x82de) [0x7f74557742de] 2020-06-27T04:48:56.736 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 18: (clone()+0x43) [0x7f74544abe83] 2020-06-27T04:48:56.736 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:56.737 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: debug -9999> 2020-06-27T04:48:56.450+0000 7f742e975700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:48:56.737 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: in thread 7f742e975700 thread_name:tp_osd_tp 2020-06-27T04:48:56.737 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:48:56.737 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 1: (()+0x12dd0) [0x7f745577edd0] 2020-06-27T04:48:56.737 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55717779d707] 2020-06-27T04:48:56.738 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55717779daa0] 2020-06-27T04:48:56.738 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5571777cf67a] 2020-06-27T04:48:56.738 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5571777d0a57] 2020-06-27T04:48:56.738 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55717745b938] 2020-06-27T04:48:56.738 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55717760c03d] 2020-06-27T04:48:56.739 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5571773c95b0] 2020-06-27T04:48:56.739 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55717742289d] 2020-06-27T04:48:56.739 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55717742b380] 2020-06-27T04:48:56.739 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x557177432590] 2020-06-27T04:48:56.740 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5571772b24e9] 2020-06-27T04:48:56.740 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x557177516f78] 2020-06-27T04:48:56.740 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5571772d170f] 2020-06-27T04:48:56.740 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55717790fb94] 2020-06-27T04:48:56.740 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5571779127f4] 2020-06-27T04:48:56.740 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 17: (()+0x82de) [0x7f74557742de] 2020-06-27T04:48:56.741 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: 18: (clone()+0x43) [0x7f74544abe83] 2020-06-27T04:48:56.741 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:48:56.741 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[111090]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:48:56.741 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:56 smithi031 podman[111201]: 2020-06-27 04:48:56.552374234 +0000 UTC m=+22.356302110 container died 2b1f1e2570cf4fb6c4d195aded1a05de12ddfef96d1501bfb9930bb54f47d1e1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:48:56.896 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 podman[42227]: 2020-06-27 04:48:56.561646213 +0000 UTC m=+4.881708749 container died 0fa2f14005c7dddc9a6522c79d3a228dae1ef9f112047e702fc1d645b34a20bc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:48:57.211 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[18409]: cluster 2020-06-27T04:48:55.243668+0000 mgr.x (mgr.34109) 273 : cluster [DBG] pgmap v333: 777 pgs: 1 active+recovering+degraded, 10 creating+peering, 1 active+recovery_unfound+undersized+degraded, 1 active+recovery_wait+degraded, 7 activating+undersized, 40 peering, 4 creating+down, 50 active+undersized+degraded, 1 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 96 down, 18 stale+down, 33 unknown, 169 active+undersized, 17 stale+peering, 57 undersized+degraded+peered, 30 active+clean, 2 stale+undersized+peered, 238 undersized+peered; 26 KiB data, 22 MiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 511 B/s wr, 0 op/s; 422/1080 objects degraded (39.074%); 3/360 objects unfound (0.833%) 2020-06-27T04:48:57.211 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:56 smithi051 bash[18409]: cluster 2020-06-27T04:48:56.401006+0000 mon.a (mon.0) 1254 : cluster [DBG] osdmap e148: 8 total, 4 up, 8 in 2020-06-27T04:48:57.211 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 podman[42227]: 2020-06-27 04:48:56.937235885 +0000 UTC m=+5.257298427 container remove 0fa2f14005c7dddc9a6522c79d3a228dae1ef9f112047e702fc1d645b34a20bc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:48:57.212 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:56 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:57.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[18426]: cluster 2020-06-27T04:48:55.243668+0000 mgr.x (mgr.34109) 273 : cluster [DBG] pgmap v333: 777 pgs: 1 active+recovering+degraded, 10 creating+peering, 1 active+recovery_unfound+undersized+degraded, 1 active+recovery_wait+degraded, 7 activating+undersized, 40 peering, 4 creating+down, 50 active+undersized+degraded, 1 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 96 down, 18 stale+down, 33 unknown, 169 active+undersized, 17 stale+peering, 57 undersized+degraded+peered, 30 active+clean, 2 stale+undersized+peered, 238 undersized+peered; 26 KiB data, 22 MiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 511 B/s wr, 0 op/s; 422/1080 objects degraded (39.074%); 3/360 objects unfound (0.833%) 2020-06-27T04:48:57.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[18426]: cluster 2020-06-27T04:48:56.401006+0000 mon.a (mon.0) 1254 : cluster [DBG] osdmap e148: 8 total, 4 up, 8 in 2020-06-27T04:48:57.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[22603]: cluster 2020-06-27T04:48:55.243668+0000 mgr.x (mgr.34109) 273 : cluster [DBG] pgmap v333: 777 pgs: 1 active+recovering+degraded, 10 creating+peering, 1 active+recovery_unfound+undersized+degraded, 1 active+recovery_wait+degraded, 7 activating+undersized, 40 peering, 4 creating+down, 50 active+undersized+degraded, 1 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 96 down, 18 stale+down, 33 unknown, 169 active+undersized, 17 stale+peering, 57 undersized+degraded+peered, 30 active+clean, 2 stale+undersized+peered, 238 undersized+peered; 26 KiB data, 22 MiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 511 B/s wr, 0 op/s; 422/1080 objects degraded (39.074%); 3/360 objects unfound (0.833%) 2020-06-27T04:48:57.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:56 smithi031 bash[22603]: cluster 2020-06-27T04:48:56.401006+0000 mon.a (mon.0) 1254 : cluster [DBG] osdmap e148: 8 total, 4 up, 8 in 2020-06-27T04:48:57.468 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:57 smithi051 podman[43156]: 2020-06-27 04:48:57.208335524 +0000 UTC m=+0.254259488 container create 11adc9dfc984ddd852379038b77002854504525570c79abfbbba0fadfc2d4ef5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:57.468 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:57 smithi051 podman[43156]: 2020-06-27 04:48:57.316552686 +0000 UTC m=+0.362476556 container init 11adc9dfc984ddd852379038b77002854504525570c79abfbbba0fadfc2d4ef5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:57.469 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:57 smithi051 podman[43156]: 2020-06-27 04:48:57.349932815 +0000 UTC m=+0.395856686 container start 11adc9dfc984ddd852379038b77002854504525570c79abfbbba0fadfc2d4ef5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:57.469 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:57 smithi051 podman[43156]: 2020-06-27 04:48:57.349997805 +0000 UTC m=+0.395921708 container attach 11adc9dfc984ddd852379038b77002854504525570c79abfbbba0fadfc2d4ef5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:57.781 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:57 smithi031 podman[111201]: 2020-06-27 04:48:57.508867701 +0000 UTC m=+23.312795576 container remove 2b1f1e2570cf4fb6c4d195aded1a05de12ddfef96d1501bfb9930bb54f47d1e1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:48:57.781 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:57 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:48:57.900 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:57 smithi051 podman[43156]: 2020-06-27 04:48:57.599601468 +0000 UTC m=+0.645525366 container died 11adc9dfc984ddd852379038b77002854504525570c79abfbbba0fadfc2d4ef5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:58.168 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:57 smithi031 podman[113400]: 2020-06-27 04:48:57.779084457 +0000 UTC m=+0.249389268 container create 90080be28072ab0a7a562fd76d128bb2ce84adb759b3b72fe90410d375d01ef9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:48:58.169 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:57 smithi031 podman[113400]: 2020-06-27 04:48:57.920717587 +0000 UTC m=+0.391022394 container init 90080be28072ab0a7a562fd76d128bb2ce84adb759b3b72fe90410d375d01ef9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:48:58.169 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:57 smithi031 podman[113400]: 2020-06-27 04:48:57.962322592 +0000 UTC m=+0.432627330 container start 90080be28072ab0a7a562fd76d128bb2ce84adb759b3b72fe90410d375d01ef9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:48:58.169 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:57 smithi031 podman[113400]: 2020-06-27 04:48:57.962410429 +0000 UTC m=+0.432715170 container attach 90080be28072ab0a7a562fd76d128bb2ce84adb759b3b72fe90410d375d01ef9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:48:58.170 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[22603]: cluster 2020-06-27T04:48:56.892329+0000 mon.a (mon.0) 1255 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:48:58.170 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[22603]: cluster 2020-06-27T04:48:56.892374+0000 mon.a (mon.0) 1256 : cluster [INF] osd.4 failed (root=default,host=smithi051) (connection refused reported by osd.7) 2020-06-27T04:48:58.170 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[22603]: cluster 2020-06-27T04:48:56.892593+0000 mon.a (mon.0) 1257 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:48:58.170 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[22603]: cluster 2020-06-27T04:48:56.892826+0000 mon.a (mon.0) 1258 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:48:58.170 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[22603]: cluster 2020-06-27T04:48:56.895882+0000 mon.a (mon.0) 1259 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:48:58.171 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[22603]: cluster 2020-06-27T04:48:56.896083+0000 mon.a (mon.0) 1260 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:48:58.171 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[22603]: cluster 2020-06-27T04:48:56.896236+0000 mon.a (mon.0) 1261 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:48:58.171 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[22603]: cluster 2020-06-27T04:48:56.896446+0000 mon.a (mon.0) 1262 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:48:58.171 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[22603]: cluster 2020-06-27T04:48:56.896597+0000 mon.a (mon.0) 1263 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:48:58.171 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[22603]: cluster 2020-06-27T04:48:56.896776+0000 mon.a (mon.0) 1264 : cluster [DBG] osd.0 reported immediately failed by osd.7 2020-06-27T04:48:58.172 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[22603]: cluster 2020-06-27T04:48:56.896818+0000 mon.a (mon.0) 1265 : cluster [INF] osd.0 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:48:58.172 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[22603]: cluster 2020-06-27T04:48:57.245445+0000 mgr.x (mgr.34109) 274 : cluster [DBG] pgmap v336: 745 pgs: 3 stale+activating+undersized, 3 stale+undersized+degraded+peered, 1 active+recovering+degraded, 1 active+recovery_unfound+undersized+degraded, 1 active+recovery_wait+degraded, 83 peering, 4 creating+down, 55 active+undersized+degraded, 1 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 75 down, 38 stale+down, 11 unknown, 194 active+undersized, 29 stale+peering, 36 undersized+degraded+peered, 48 active+clean, 6 stale+undersized+peered, 154 undersized+peered; 26 KiB data, 22 MiB used, 707 GiB / 715 GiB avail; 511 B/s rd, 1.2 KiB/s wr, 1 op/s; 344/1089 objects degraded (31.589%); 3/363 objects unfound (0.826%) 2020-06-27T04:48:58.172 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[22603]: cluster 2020-06-27T04:48:57.404326+0000 mon.a (mon.0) 1266 : cluster [DBG] osdmap e149: 8 total, 2 up, 8 in 2020-06-27T04:48:58.172 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[22603]: audit 2020-06-27T04:48:57.405075+0000 mon.b (mon.2) 331 : audit [INF] from='client.? 172.21.15.31:0/2193125021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:58.172 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[22603]: audit 2020-06-27T04:48:57.408890+0000 mon.a (mon.0) 1267 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:58.173 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[18426]: cluster 2020-06-27T04:48:56.892329+0000 mon.a (mon.0) 1255 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:48:58.173 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[18426]: cluster 2020-06-27T04:48:56.892374+0000 mon.a (mon.0) 1256 : cluster [INF] osd.4 failed (root=default,host=smithi051) (connection refused reported by osd.7) 2020-06-27T04:48:58.173 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[18426]: cluster 2020-06-27T04:48:56.892593+0000 mon.a (mon.0) 1257 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:48:58.173 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[18426]: cluster 2020-06-27T04:48:56.892826+0000 mon.a (mon.0) 1258 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:48:58.173 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[18426]: cluster 2020-06-27T04:48:56.895882+0000 mon.a (mon.0) 1259 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:48:58.174 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[18426]: cluster 2020-06-27T04:48:56.896083+0000 mon.a (mon.0) 1260 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:48:58.174 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[18426]: cluster 2020-06-27T04:48:56.896236+0000 mon.a (mon.0) 1261 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:48:58.174 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[18426]: cluster 2020-06-27T04:48:56.896446+0000 mon.a (mon.0) 1262 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:48:58.174 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[18426]: cluster 2020-06-27T04:48:56.896597+0000 mon.a (mon.0) 1263 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:48:58.174 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[18426]: cluster 2020-06-27T04:48:56.896776+0000 mon.a (mon.0) 1264 : cluster [DBG] osd.0 reported immediately failed by osd.7 2020-06-27T04:48:58.175 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[18426]: cluster 2020-06-27T04:48:56.896818+0000 mon.a (mon.0) 1265 : cluster [INF] osd.0 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:48:58.175 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[18426]: cluster 2020-06-27T04:48:57.245445+0000 mgr.x (mgr.34109) 274 : cluster [DBG] pgmap v336: 745 pgs: 3 stale+activating+undersized, 3 stale+undersized+degraded+peered, 1 active+recovering+degraded, 1 active+recovery_unfound+undersized+degraded, 1 active+recovery_wait+degraded, 83 peering, 4 creating+down, 55 active+undersized+degraded, 1 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 75 down, 38 stale+down, 11 unknown, 194 active+undersized, 29 stale+peering, 36 undersized+degraded+peered, 48 active+clean, 6 stale+undersized+peered, 154 undersized+peered; 26 KiB data, 22 MiB used, 707 GiB / 715 GiB avail; 511 B/s rd, 1.2 KiB/s wr, 1 op/s; 344/1089 objects degraded (31.589%); 3/363 objects unfound (0.826%) 2020-06-27T04:48:58.175 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[18426]: cluster 2020-06-27T04:48:57.404326+0000 mon.a (mon.0) 1266 : cluster [DBG] osdmap e149: 8 total, 2 up, 8 in 2020-06-27T04:48:58.175 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[18426]: audit 2020-06-27T04:48:57.405075+0000 mon.b (mon.2) 331 : audit [INF] from='client.? 172.21.15.31:0/2193125021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:58.175 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:57 smithi031 bash[18426]: audit 2020-06-27T04:48:57.408890+0000 mon.a (mon.0) 1267 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:58.218 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:58 smithi051 podman[43156]: 2020-06-27 04:48:58.017108321 +0000 UTC m=+1.063032199 container remove 11adc9dfc984ddd852379038b77002854504525570c79abfbbba0fadfc2d4ef5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:48:58.218 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:48:58 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Failed with result 'exit-code'. 2020-06-27T04:48:58.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:57 smithi051 bash[18409]: cluster 2020-06-27T04:48:56.892329+0000 mon.a (mon.0) 1255 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:48:58.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:57 smithi051 bash[18409]: cluster 2020-06-27T04:48:56.892374+0000 mon.a (mon.0) 1256 : cluster [INF] osd.4 failed (root=default,host=smithi051) (connection refused reported by osd.7) 2020-06-27T04:48:58.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:57 smithi051 bash[18409]: cluster 2020-06-27T04:48:56.892593+0000 mon.a (mon.0) 1257 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:48:58.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:57 smithi051 bash[18409]: cluster 2020-06-27T04:48:56.892826+0000 mon.a (mon.0) 1258 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:48:58.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:57 smithi051 bash[18409]: cluster 2020-06-27T04:48:56.895882+0000 mon.a (mon.0) 1259 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:48:58.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:57 smithi051 bash[18409]: cluster 2020-06-27T04:48:56.896083+0000 mon.a (mon.0) 1260 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:48:58.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:57 smithi051 bash[18409]: cluster 2020-06-27T04:48:56.896236+0000 mon.a (mon.0) 1261 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:48:58.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:57 smithi051 bash[18409]: cluster 2020-06-27T04:48:56.896446+0000 mon.a (mon.0) 1262 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:48:58.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:57 smithi051 bash[18409]: cluster 2020-06-27T04:48:56.896597+0000 mon.a (mon.0) 1263 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-06-27T04:48:58.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:57 smithi051 bash[18409]: cluster 2020-06-27T04:48:56.896776+0000 mon.a (mon.0) 1264 : cluster [DBG] osd.0 reported immediately failed by osd.7 2020-06-27T04:48:58.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:57 smithi051 bash[18409]: cluster 2020-06-27T04:48:56.896818+0000 mon.a (mon.0) 1265 : cluster [INF] osd.0 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:48:58.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:57 smithi051 bash[18409]: cluster 2020-06-27T04:48:57.245445+0000 mgr.x (mgr.34109) 274 : cluster [DBG] pgmap v336: 745 pgs: 3 stale+activating+undersized, 3 stale+undersized+degraded+peered, 1 active+recovering+degraded, 1 active+recovery_unfound+undersized+degraded, 1 active+recovery_wait+degraded, 83 peering, 4 creating+down, 55 active+undersized+degraded, 1 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 75 down, 38 stale+down, 11 unknown, 194 active+undersized, 29 stale+peering, 36 undersized+degraded+peered, 48 active+clean, 6 stale+undersized+peered, 154 undersized+peered; 26 KiB data, 22 MiB used, 707 GiB / 715 GiB avail; 511 B/s rd, 1.2 KiB/s wr, 1 op/s; 344/1089 objects degraded (31.589%); 3/363 objects unfound (0.826%) 2020-06-27T04:48:58.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:57 smithi051 bash[18409]: cluster 2020-06-27T04:48:57.404326+0000 mon.a (mon.0) 1266 : cluster [DBG] osdmap e149: 8 total, 2 up, 8 in 2020-06-27T04:48:58.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:57 smithi051 bash[18409]: audit 2020-06-27T04:48:57.405075+0000 mon.b (mon.2) 331 : audit [INF] from='client.? 172.21.15.31:0/2193125021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:58.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:57 smithi051 bash[18409]: audit 2020-06-27T04:48:57.408890+0000 mon.a (mon.0) 1267 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2020-06-27T04:48:58.472 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:58 smithi031 podman[113400]: 2020-06-27 04:48:58.188366381 +0000 UTC m=+0.658671106 container died 90080be28072ab0a7a562fd76d128bb2ce84adb759b3b72fe90410d375d01ef9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:48:58.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:58 smithi031 bash[18426]: cluster 2020-06-27T04:48:57.893126+0000 mon.a (mon.0) 1268 : cluster [WRN] Health check update: 3/363 objects unfound (0.826%) (OBJECT_UNFOUND) 2020-06-27T04:48:58.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:58 smithi031 bash[18426]: audit 2020-06-27T04:48:58.403864+0000 mon.a (mon.0) 1269 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-9","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:58.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:58 smithi031 bash[18426]: cluster 2020-06-27T04:48:58.403950+0000 mon.a (mon.0) 1270 : cluster [DBG] osdmap e150: 8 total, 2 up, 8 in 2020-06-27T04:48:58.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:58 smithi031 bash[22603]: cluster 2020-06-27T04:48:57.893126+0000 mon.a (mon.0) 1268 : cluster [WRN] Health check update: 3/363 objects unfound (0.826%) (OBJECT_UNFOUND) 2020-06-27T04:48:58.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:58 smithi031 bash[22603]: audit 2020-06-27T04:48:58.403864+0000 mon.a (mon.0) 1269 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-9","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:58.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:58 smithi031 bash[22603]: cluster 2020-06-27T04:48:58.403950+0000 mon.a (mon.0) 1270 : cluster [DBG] osdmap e150: 8 total, 2 up, 8 in 2020-06-27T04:48:58.975 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:58 smithi031 podman[113400]: 2020-06-27 04:48:58.705328306 +0000 UTC m=+1.175633042 container remove 90080be28072ab0a7a562fd76d128bb2ce84adb759b3b72fe90410d375d01ef9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:48:58.975 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:48:58 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2020-06-27T04:48:59.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:58 smithi051 bash[18409]: cluster 2020-06-27T04:48:57.893126+0000 mon.a (mon.0) 1268 : cluster [WRN] Health check update: 3/363 objects unfound (0.826%) (OBJECT_UNFOUND) 2020-06-27T04:48:59.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:58 smithi051 bash[18409]: audit 2020-06-27T04:48:58.403864+0000 mon.a (mon.0) 1269 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi031-41115-9","app": "rados","yes_i_really_mean_it": true}]': finished 2020-06-27T04:48:59.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:58 smithi051 bash[18409]: cluster 2020-06-27T04:48:58.403950+0000 mon.a (mon.0) 1270 : cluster [DBG] osdmap e150: 8 total, 2 up, 8 in 2020-06-27T04:49:00.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:59 smithi051 bash[18409]: cluster 2020-06-27T04:48:59.246713+0000 mgr.x (mgr.34109) 275 : cluster [DBG] pgmap v339: 777 pgs: 14 stale+active+clean, 3 stale+activating+undersized, 8 stale+undersized+degraded+peered, 1 active+recovering+degraded, 1 active+recovery_unfound+undersized+degraded, 1 active+recovery_wait+degraded, 12 peering, 1 creating+down, 38 active+undersized+degraded, 4 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 33 down, 80 stale+down, 43 unknown, 135 active+undersized, 100 stale+peering, 17 stale+active+undersized+degraded, 31 undersized+degraded+peered, 34 active+clean, 51 stale+undersized+peered, 59 stale+active+undersized, 109 undersized+peered; 26 KiB data, 22 MiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 767 B/s wr, 1 op/s; 344/1089 objects degraded (31.589%); 3/363 objects unfound (0.826%) 2020-06-27T04:49:00.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:59 smithi051 bash[18409]: cluster 2020-06-27T04:48:59.390040+0000 mon.a (mon.0) 1271 : cluster [WRN] Health check update: 6 osds down (OSD_DOWN) 2020-06-27T04:49:00.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:59 smithi051 bash[18409]: cluster 2020-06-27T04:48:59.390093+0000 mon.a (mon.0) 1272 : cluster [WRN] Health check update: Reduced data availability: 98 pgs inactive, 118 pgs down, 1 pg peering (PG_AVAILABILITY) 2020-06-27T04:49:00.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:59 smithi051 bash[18409]: cluster 2020-06-27T04:48:59.390123+0000 mon.a (mon.0) 1273 : cluster [WRN] Health check update: Degraded data redundancy: 344/1089 objects degraded (31.589%), 98 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:00.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:48:59 smithi051 bash[18409]: cluster 2020-06-27T04:48:59.406199+0000 mon.a (mon.0) 1274 : cluster [DBG] osdmap e151: 8 total, 2 up, 8 in 2020-06-27T04:49:00.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:59 smithi031 bash[18426]: cluster 2020-06-27T04:48:59.246713+0000 mgr.x (mgr.34109) 275 : cluster [DBG] pgmap v339: 777 pgs: 14 stale+active+clean, 3 stale+activating+undersized, 8 stale+undersized+degraded+peered, 1 active+recovering+degraded, 1 active+recovery_unfound+undersized+degraded, 1 active+recovery_wait+degraded, 12 peering, 1 creating+down, 38 active+undersized+degraded, 4 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 33 down, 80 stale+down, 43 unknown, 135 active+undersized, 100 stale+peering, 17 stale+active+undersized+degraded, 31 undersized+degraded+peered, 34 active+clean, 51 stale+undersized+peered, 59 stale+active+undersized, 109 undersized+peered; 26 KiB data, 22 MiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 767 B/s wr, 1 op/s; 344/1089 objects degraded (31.589%); 3/363 objects unfound (0.826%) 2020-06-27T04:49:00.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:59 smithi031 bash[18426]: cluster 2020-06-27T04:48:59.390040+0000 mon.a (mon.0) 1271 : cluster [WRN] Health check update: 6 osds down (OSD_DOWN) 2020-06-27T04:49:00.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:59 smithi031 bash[18426]: cluster 2020-06-27T04:48:59.390093+0000 mon.a (mon.0) 1272 : cluster [WRN] Health check update: Reduced data availability: 98 pgs inactive, 118 pgs down, 1 pg peering (PG_AVAILABILITY) 2020-06-27T04:49:00.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:59 smithi031 bash[18426]: cluster 2020-06-27T04:48:59.390123+0000 mon.a (mon.0) 1273 : cluster [WRN] Health check update: Degraded data redundancy: 344/1089 objects degraded (31.589%), 98 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:00.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:48:59 smithi031 bash[18426]: cluster 2020-06-27T04:48:59.406199+0000 mon.a (mon.0) 1274 : cluster [DBG] osdmap e151: 8 total, 2 up, 8 in 2020-06-27T04:49:00.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:59 smithi031 bash[22603]: cluster 2020-06-27T04:48:59.246713+0000 mgr.x (mgr.34109) 275 : cluster [DBG] pgmap v339: 777 pgs: 14 stale+active+clean, 3 stale+activating+undersized, 8 stale+undersized+degraded+peered, 1 active+recovering+degraded, 1 active+recovery_unfound+undersized+degraded, 1 active+recovery_wait+degraded, 12 peering, 1 creating+down, 38 active+undersized+degraded, 4 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 33 down, 80 stale+down, 43 unknown, 135 active+undersized, 100 stale+peering, 17 stale+active+undersized+degraded, 31 undersized+degraded+peered, 34 active+clean, 51 stale+undersized+peered, 59 stale+active+undersized, 109 undersized+peered; 26 KiB data, 22 MiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 767 B/s wr, 1 op/s; 344/1089 objects degraded (31.589%); 3/363 objects unfound (0.826%) 2020-06-27T04:49:00.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:59 smithi031 bash[22603]: cluster 2020-06-27T04:48:59.390040+0000 mon.a (mon.0) 1271 : cluster [WRN] Health check update: 6 osds down (OSD_DOWN) 2020-06-27T04:49:00.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:59 smithi031 bash[22603]: cluster 2020-06-27T04:48:59.390093+0000 mon.a (mon.0) 1272 : cluster [WRN] Health check update: Reduced data availability: 98 pgs inactive, 118 pgs down, 1 pg peering (PG_AVAILABILITY) 2020-06-27T04:49:00.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:59 smithi031 bash[22603]: cluster 2020-06-27T04:48:59.390123+0000 mon.a (mon.0) 1273 : cluster [WRN] Health check update: Degraded data redundancy: 344/1089 objects degraded (31.589%), 98 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:00.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:48:59 smithi031 bash[22603]: cluster 2020-06-27T04:48:59.406199+0000 mon.a (mon.0) 1274 : cluster [DBG] osdmap e151: 8 total, 2 up, 8 in 2020-06-27T04:49:01.289 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:00 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:49:01.289 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:00 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Scheduled restart job, restart counter is at 5. 2020-06-27T04:49:01.289 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:00 smithi031 systemd[1]: Stopped Ceph osd.1 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:01.290 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:00 smithi031 systemd[1]: Starting Ceph osd.1 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:49:01.290 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:01 smithi031 podman[113474]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1 found: no such container 2020-06-27T04:49:01.290 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:01 smithi031 systemd[1]: Started Ceph osd.1 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:01.689 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:01 smithi031 bash[18426]: debug 2020-06-27T04:49:01.300+0000 7f8751183700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2020-06-27T04:49:01.690 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:01 smithi031 bash[18426]: cluster 2020-06-27T04:49:01.301593+0000 mon.a (mon.0) 1275 : cluster [ERR] Health check update: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2020-06-27T04:49:01.690 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:01 smithi031 bash[18426]: cluster 2020-06-27T04:49:01.301631+0000 mon.a (mon.0) 1276 : cluster [WRN] Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:49:01.690 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:01 smithi031 bash[22603]: cluster 2020-06-27T04:49:01.301593+0000 mon.a (mon.0) 1275 : cluster [ERR] Health check update: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2020-06-27T04:49:01.691 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:01 smithi031 bash[22603]: cluster 2020-06-27T04:49:01.301631+0000 mon.a (mon.0) 1276 : cluster [WRN] Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:49:01.691 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:01 smithi031 podman[113491]: 2020-06-27 04:49:01.286850435 +0000 UTC m=+0.247408915 container create 7fc4d6384f0e84cdf206f9504b97f05db106114411bad41a27bd865643a7efee (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:49:01.691 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:01 smithi031 podman[113491]: 2020-06-27 04:49:01.43672265 +0000 UTC m=+0.397281020 container init 7fc4d6384f0e84cdf206f9504b97f05db106114411bad41a27bd865643a7efee (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:49:01.691 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:01 smithi031 podman[113491]: 2020-06-27 04:49:01.478409704 +0000 UTC m=+0.438968072 container start 7fc4d6384f0e84cdf206f9504b97f05db106114411bad41a27bd865643a7efee (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:49:01.692 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:01 smithi031 podman[113491]: 2020-06-27 04:49:01.478484508 +0000 UTC m=+0.439042922 container attach 7fc4d6384f0e84cdf206f9504b97f05db106114411bad41a27bd865643a7efee (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:49:01.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:01 smithi051 bash[18409]: cluster 2020-06-27T04:49:01.301593+0000 mon.a (mon.0) 1275 : cluster [ERR] Health check update: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2020-06-27T04:49:01.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:01 smithi051 bash[18409]: cluster 2020-06-27T04:49:01.301631+0000 mon.a (mon.0) 1276 : cluster [WRN] Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2020-06-27T04:49:01.973 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:01 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:49:01.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:01 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 5. 2020-06-27T04:49:01.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:01 smithi031 systemd[1]: Stopped Ceph osd.3 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:01.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:01 smithi031 systemd[1]: Starting Ceph osd.3 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:49:01.974 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:01 smithi031 bash[113489]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-06-27T04:49:01.974 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:01 smithi031 bash[113489]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2020-06-27T04:49:01.975 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:01 smithi031 bash[113489]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2020-06-27T04:49:01.975 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:01 smithi031 bash[113489]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2020-06-27T04:49:01.975 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:01 smithi031 bash[113489]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2020-06-27T04:49:01.975 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:01 smithi031 bash[113489]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-06-27T04:49:01.976 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:01 smithi031 bash[113489]: --> ceph-volume lvm activate successful for osd ID: 1 2020-06-27T04:49:01.976 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:01 smithi031 podman[113491]: 2020-06-27 04:49:01.735372754 +0000 UTC m=+0.695931134 container died 7fc4d6384f0e84cdf206f9504b97f05db106114411bad41a27bd865643a7efee (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:49:02.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:02 smithi051 bash[18409]: cluster 2020-06-27T04:49:01.248609+0000 mgr.x (mgr.34109) 276 : cluster [DBG] pgmap v341: 777 pgs: 10 stale+active+clean, 3 stale+activating+undersized, 8 stale+undersized+degraded+peered, 34 active+undersized+degraded, 4 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 23 down, 80 stale+down, 31 unknown, 101 active+undersized, 97 stale+peering, 13 stale+active+undersized+degraded, 51 undersized+degraded+peered, 14 active+clean, 50 stale+undersized+peered, 40 stale+active+undersized, 216 undersized+peered; 26 KiB data, 22 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s wr, 1 op/s; 408/1098 objects degraded (37.158%); 2/366 objects unfound (0.546%) 2020-06-27T04:49:02.722 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:02 smithi031 podman[113491]: 2020-06-27 04:49:02.501352287 +0000 UTC m=+1.461910669 container remove 7fc4d6384f0e84cdf206f9504b97f05db106114411bad41a27bd865643a7efee (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-activate) 2020-06-27T04:49:02.722 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:02 smithi031 podman[113564]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3 found: no such container 2020-06-27T04:49:02.722 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:02 smithi031 systemd[1]: Started Ceph osd.3 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:02.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:02 smithi031 bash[18426]: cluster 2020-06-27T04:49:01.248609+0000 mgr.x (mgr.34109) 276 : cluster [DBG] pgmap v341: 777 pgs: 10 stale+active+clean, 3 stale+activating+undersized, 8 stale+undersized+degraded+peered, 34 active+undersized+degraded, 4 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 23 down, 80 stale+down, 31 unknown, 101 active+undersized, 97 stale+peering, 13 stale+active+undersized+degraded, 51 undersized+degraded+peered, 14 active+clean, 50 stale+undersized+peered, 40 stale+active+undersized, 216 undersized+peered; 26 KiB data, 22 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s wr, 1 op/s; 408/1098 objects degraded (37.158%); 2/366 objects unfound (0.546%) 2020-06-27T04:49:02.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:02 smithi031 bash[22603]: cluster 2020-06-27T04:49:01.248609+0000 mgr.x (mgr.34109) 276 : cluster [DBG] pgmap v341: 777 pgs: 10 stale+active+clean, 3 stale+activating+undersized, 8 stale+undersized+degraded+peered, 34 active+undersized+degraded, 4 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 23 down, 80 stale+down, 31 unknown, 101 active+undersized, 97 stale+peering, 13 stale+active+undersized+degraded, 51 undersized+degraded+peered, 14 active+clean, 50 stale+undersized+peered, 40 stale+active+undersized, 216 undersized+peered; 26 KiB data, 22 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s wr, 1 op/s; 408/1098 objects degraded (37.158%); 2/366 objects unfound (0.546%) 2020-06-27T04:49:02.973 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:02 smithi031 bash[113489]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1 found: no such container 2020-06-27T04:49:02.973 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:02 smithi031 bash[113489]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1 2020-06-27T04:49:02.973 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:02 smithi031 bash[113489]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1" found: no such container 2020-06-27T04:49:02.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:02 smithi031 podman[113587]: 2020-06-27 04:49:02.753160416 +0000 UTC m=+0.452258685 container create 117ee6108b6335faa76f8c78941e00a7c92592605b18170d3dda109ae3ffd3b5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:49:02.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:02 smithi031 podman[113587]: 2020-06-27 04:49:02.894918887 +0000 UTC m=+0.594017155 container init 117ee6108b6335faa76f8c78941e00a7c92592605b18170d3dda109ae3ffd3b5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:49:02.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:02 smithi031 podman[113587]: 2020-06-27 04:49:02.936478398 +0000 UTC m=+0.635576676 container start 117ee6108b6335faa76f8c78941e00a7c92592605b18170d3dda109ae3ffd3b5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:49:02.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:02 smithi031 podman[113587]: 2020-06-27 04:49:02.936573326 +0000 UTC m=+0.635671608 container attach 117ee6108b6335faa76f8c78941e00a7c92592605b18170d3dda109ae3ffd3b5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:49:03.410 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 podman[113646]: 2020-06-27 04:49:03.153110154 +0000 UTC m=+0.324750353 container create 5c5b2dd9ffba72091c8a43f5b9b15f86e564c286ed2b577063f07d0d0c780e8e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:49:03.411 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113585]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-06-27T04:49:03.411 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113585]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2020-06-27T04:49:03.411 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113585]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2020-06-27T04:49:03.411 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113585]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2020-06-27T04:49:03.411 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113585]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2020-06-27T04:49:03.412 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113585]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-06-27T04:49:03.412 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113585]: --> ceph-volume lvm activate successful for osd ID: 3 2020-06-27T04:49:03.412 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:03 smithi031 podman[113587]: 2020-06-27 04:49:03.240378602 +0000 UTC m=+0.939476888 container died 117ee6108b6335faa76f8c78941e00a7c92592605b18170d3dda109ae3ffd3b5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:49:03.412 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[18426]: cluster 2020-06-27T04:49:03.355773+0000 mon.a (mon.0) 1277 : cluster [WRN] Health check update: 2/367 objects unfound (0.545%) (OBJECT_UNFOUND) 2020-06-27T04:49:03.705 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 podman[113646]: 2020-06-27 04:49:03.60806878 +0000 UTC m=+0.779708963 container init 5c5b2dd9ffba72091c8a43f5b9b15f86e564c286ed2b577063f07d0d0c780e8e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:49:03.705 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[22603]: cluster 2020-06-27T04:49:03.355773+0000 mon.a (mon.0) 1277 : cluster [WRN] Health check update: 2/367 objects unfound (0.545%) (OBJECT_UNFOUND) 2020-06-27T04:49:03.717 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:03 smithi051 bash[18409]: cluster 2020-06-27T04:49:03.355773+0000 mon.a (mon.0) 1277 : cluster [WRN] Health check update: 2/367 objects unfound (0.545%) (OBJECT_UNFOUND) 2020-06-27T04:49:03.973 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:03 smithi031 podman[113587]: 2020-06-27 04:49:03.807890937 +0000 UTC m=+1.506989208 container remove 117ee6108b6335faa76f8c78941e00a7c92592605b18170d3dda109ae3ffd3b5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-activate) 2020-06-27T04:49:03.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113585]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3 found: no such container 2020-06-27T04:49:03.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113585]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3 2020-06-27T04:49:03.974 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113585]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3" found: no such container 2020-06-27T04:49:03.974 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 podman[113646]: 2020-06-27 04:49:03.703098324 +0000 UTC m=+0.874738588 container start 5c5b2dd9ffba72091c8a43f5b9b15f86e564c286ed2b577063f07d0d0c780e8e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:49:03.975 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.631+0000 7f66d07e3f40 1 -- 172.21.15.31:0/2949013654 shutdown_connections 2020-06-27T04:49:03.975 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.631+0000 7f66d07e3f40 5 -- 172.21.15.31:0/2949013654 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55c4b6f6f400 2020-06-27T04:49:03.975 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.631+0000 7f66d07e3f40 1 --2- 172.21.15.31:0/2949013654 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55c4b6f6f400 0x55c4b6ee0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:49:03.976 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.631+0000 7f66d07e3f40 5 -- 172.21.15.31:0/2949013654 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55c4b6f6ec00 2020-06-27T04:49:03.976 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.631+0000 7f66d07e3f40 1 --2- 172.21.15.31:0/2949013654 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55c4b6f6ec00 0x55c4b6edf400 unknown :-1 s=CLOSED pgs=2506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:49:03.976 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.631+0000 7f66d07e3f40 5 -- 172.21.15.31:0/2949013654 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55c4b6f6f000 2020-06-27T04:49:03.976 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.631+0000 7f66d07e3f40 1 --2- 172.21.15.31:0/2949013654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c4b6f6f000 0x55c4b6edfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:49:03.977 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.631+0000 7f66d07e3f40 5 -- 172.21.15.31:0/2949013654 shutdown_connections delete 0x55c4b6f6ec00 2020-06-27T04:49:03.977 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.631+0000 7f66d07e3f40 5 -- 172.21.15.31:0/2949013654 shutdown_connections delete 0x55c4b6f6f000 2020-06-27T04:49:03.977 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.631+0000 7f66d07e3f40 5 -- 172.21.15.31:0/2949013654 shutdown_connections delete 0x55c4b6f6f400 2020-06-27T04:49:03.977 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.631+0000 7f66d07e3f40 1 -- 172.21.15.31:0/2949013654 >> 172.21.15.31:0/2949013654 conn(0x55c4b6f6e800 msgr2=0x55c4b6fd7000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:49:03.977 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.631+0000 7f66d07e3f40 20 --1- 172.21.15.31:0/2949013654 >> 172.21.15.31:0/2949013654 conn(0x55c4b6f6e800 0x55c4b6fd7000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:49:03.978 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 podman[113646]: 2020-06-27 04:49:03.703255665 +0000 UTC m=+0.874896056 container attach 5c5b2dd9ffba72091c8a43f5b9b15f86e564c286ed2b577063f07d0d0c780e8e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:49:03.978 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.631+0000 7f66d07e3f40 2 --1- 172.21.15.31:0/2949013654 >> 172.21.15.31:0/2949013654 conn(0x55c4b6f6e800 0x55c4b6fd7000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:49:03.978 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.632+0000 7f66d07e3f40 5 --1- 172.21.15.31:0/2949013654 >> 172.21.15.31:0/2949013654 conn(0x55c4b6f6e800 0x55c4b6fd7000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:49:03.978 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.632+0000 7f66d07e3f40 20 Event(0x55c4b6f02e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:03.978 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.632+0000 7f66d07e3f40 10 --1- 172.21.15.31:0/2949013654 >> 172.21.15.31:0/2949013654 conn(0x55c4b6f6e800 0x55c4b6fd7000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:49:03.979 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.632+0000 7f66d07e3f40 20 Event(0x55c4b6f03040 nevent=5000 time_id=3).wakeup 2020-06-27T04:49:03.979 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.632+0000 7f66d07e3f40 20 Event(0x55c4b6f03280 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:03.979 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.632+0000 7f66ca566700 5 --1- 172.21.15.31:0/2949013654 >> 172.21.15.31:0/2949013654 conn(0x55c4b6f6e800 0x55c4b6fd7000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:49:03.979 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.632+0000 7f66ca566700 5 --1- 172.21.15.31:0/2949013654 >> 172.21.15.31:0/2949013654 conn(0x55c4b6f6e800 0x55c4b6fd7000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:49:03.979 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.632+0000 7f66d07e3f40 10 -- 172.21.15.31:0/2949013654 wait: waiting for dispatch queue 2020-06-27T04:49:03.980 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.632+0000 7f66d07e3f40 10 -- 172.21.15.31:0/2949013654 wait: dispatch queue is stopped 2020-06-27T04:49:03.980 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.632+0000 7f66d07e3f40 1 -- 172.21.15.31:0/2949013654 shutdown_connections 2020-06-27T04:49:03.980 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.632+0000 7f66d07e3f40 5 -- 172.21.15.31:0/2949013654 shutdown_connections delete 0x55c4b6f6e800 2020-06-27T04:49:03.980 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.632+0000 7f66d07e3f40 20 Event(0x55c4b6f02e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:03.980 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.632+0000 7f66d07e3f40 20 Event(0x55c4b6f03040 nevent=5000 time_id=3).wakeup 2020-06-27T04:49:03.980 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.632+0000 7f66d07e3f40 20 Event(0x55c4b6f03280 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:03.981 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.632+0000 7f66d07e3f40 10 -- 172.21.15.31:0/2949013654 wait: done. 2020-06-27T04:49:03.981 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:03 smithi031 bash[113489]: debug 2020-06-27T04:49:03.632+0000 7f66d07e3f40 1 -- 172.21.15.31:0/2949013654 wait complete. 2020-06-27T04:49:04.411 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113489]: debug 2020-06-27T04:49:04.149+0000 7f66d07e3f40 -1 Falling back to public interface 2020-06-27T04:49:04.412 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 podman[113786]: 2020-06-27 04:49:04.225110539 +0000 UTC m=+0.324018208 container create 422dc2ec11dff45185ae1e78d987d3bcfae8bdf4011f9fcd1889acb5a6e071e3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:49:04.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:04 smithi051 bash[18409]: cluster 2020-06-27T04:49:03.250637+0000 mgr.x (mgr.34109) 277 : cluster [DBG] pgmap v342: 777 pgs: 3 stale+activating+undersized, 8 stale+undersized+degraded+peered, 22 active+undersized+degraded, 4 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 27 down, 80 stale+down, 22 unknown, 75 active+undersized, 92 stale+peering, 4 stale+active+undersized+degraded, 78 undersized+degraded+peered, 50 stale+undersized+peered, 20 stale+active+undersized, 290 undersized+peered; 26 KiB data, 22 MiB used, 707 GiB / 715 GiB avail; 682 B/s wr, 0 op/s; 492/1101 objects degraded (44.687%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:04.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:04 smithi051 bash[18409]: cluster 2020-06-27T04:49:04.391064+0000 mon.a (mon.0) 1278 : cluster [WRN] Health check update: Reduced data availability: 125 pgs inactive, 111 pgs down, 1 pg peering, 1 pg stale (PG_AVAILABILITY) 2020-06-27T04:49:04.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:04 smithi051 bash[18409]: cluster 2020-06-27T04:49:04.391093+0000 mon.a (mon.0) 1279 : cluster [WRN] Health check update: Degraded data redundancy: 492/1101 objects degraded (44.687%), 113 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:04.723 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113489]: debug 2020-06-27T04:49:04.612+0000 7f66d07e3f40 -1 osd.1 138 log_to_monitors {default=true} 2020-06-27T04:49:04.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[18426]: cluster 2020-06-27T04:49:03.250637+0000 mgr.x (mgr.34109) 277 : cluster [DBG] pgmap v342: 777 pgs: 3 stale+activating+undersized, 8 stale+undersized+degraded+peered, 22 active+undersized+degraded, 4 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 27 down, 80 stale+down, 22 unknown, 75 active+undersized, 92 stale+peering, 4 stale+active+undersized+degraded, 78 undersized+degraded+peered, 50 stale+undersized+peered, 20 stale+active+undersized, 290 undersized+peered; 26 KiB data, 22 MiB used, 707 GiB / 715 GiB avail; 682 B/s wr, 0 op/s; 492/1101 objects degraded (44.687%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:04.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[18426]: cluster 2020-06-27T04:49:04.391064+0000 mon.a (mon.0) 1278 : cluster [WRN] Health check update: Reduced data availability: 125 pgs inactive, 111 pgs down, 1 pg peering, 1 pg stale (PG_AVAILABILITY) 2020-06-27T04:49:04.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[18426]: cluster 2020-06-27T04:49:04.391093+0000 mon.a (mon.0) 1279 : cluster [WRN] Health check update: Degraded data redundancy: 492/1101 objects degraded (44.687%), 113 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:04.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[22603]: cluster 2020-06-27T04:49:03.250637+0000 mgr.x (mgr.34109) 277 : cluster [DBG] pgmap v342: 777 pgs: 3 stale+activating+undersized, 8 stale+undersized+degraded+peered, 22 active+undersized+degraded, 4 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 27 down, 80 stale+down, 22 unknown, 75 active+undersized, 92 stale+peering, 4 stale+active+undersized+degraded, 78 undersized+degraded+peered, 50 stale+undersized+peered, 20 stale+active+undersized, 290 undersized+peered; 26 KiB data, 22 MiB used, 707 GiB / 715 GiB avail; 682 B/s wr, 0 op/s; 492/1101 objects degraded (44.687%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:04.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[22603]: cluster 2020-06-27T04:49:04.391064+0000 mon.a (mon.0) 1278 : cluster [WRN] Health check update: Reduced data availability: 125 pgs inactive, 111 pgs down, 1 pg peering, 1 pg stale (PG_AVAILABILITY) 2020-06-27T04:49:04.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[22603]: cluster 2020-06-27T04:49:04.391093+0000 mon.a (mon.0) 1279 : cluster [WRN] Health check update: Degraded data redundancy: 492/1101 objects degraded (44.687%), 113 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:04.725 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 podman[113786]: 2020-06-27 04:49:04.517573521 +0000 UTC m=+0.616481186 container init 422dc2ec11dff45185ae1e78d987d3bcfae8bdf4011f9fcd1889acb5a6e071e3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:49:04.725 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 podman[113786]: 2020-06-27 04:49:04.569545549 +0000 UTC m=+0.668453216 container start 422dc2ec11dff45185ae1e78d987d3bcfae8bdf4011f9fcd1889acb5a6e071e3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:49:04.725 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 podman[113786]: 2020-06-27 04:49:04.569635384 +0000 UTC m=+0.668543080 container attach 422dc2ec11dff45185ae1e78d987d3bcfae8bdf4011f9fcd1889acb5a6e071e3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:49:04.725 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 10 -- 172.21.15.31:0/3016567535 shutdown 172.21.15.31:0/3016567535 2020-06-27T04:49:04.725 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 10 Processor -- stop 2020-06-27T04:49:04.726 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 20 Event(0x5616d77aae00 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:04.726 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 1 -- 172.21.15.31:0/3016567535 shutdown_connections 2020-06-27T04:49:04.726 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 5 -- 172.21.15.31:0/3016567535 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x5616d7817400 2020-06-27T04:49:04.726 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 1 --2- 172.21.15.31:0/3016567535 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x5616d7817400 0x5616d7788300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:49:04.726 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 5 -- 172.21.15.31:0/3016567535 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x5616d7816c00 2020-06-27T04:49:04.727 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 1 --2- 172.21.15.31:0/3016567535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5616d7816c00 0x5616d7787400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:49:04.727 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 5 -- 172.21.15.31:0/3016567535 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x5616d7817000 2020-06-27T04:49:04.727 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 1 --2- 172.21.15.31:0/3016567535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5616d7817000 0x5616d7787e00 unknown :-1 s=CLOSED pgs=2640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:49:04.727 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 5 -- 172.21.15.31:0/3016567535 shutdown_connections delete 0x5616d7816c00 2020-06-27T04:49:04.727 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 5 -- 172.21.15.31:0/3016567535 shutdown_connections delete 0x5616d7817000 2020-06-27T04:49:04.728 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 5 -- 172.21.15.31:0/3016567535 shutdown_connections delete 0x5616d7817400 2020-06-27T04:49:04.728 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 1 -- 172.21.15.31:0/3016567535 >> 172.21.15.31:0/3016567535 conn(0x5616d7816800 msgr2=0x5616d787f000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:49:04.728 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 20 --1- 172.21.15.31:0/3016567535 >> 172.21.15.31:0/3016567535 conn(0x5616d7816800 0x5616d787f000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:49:04.728 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 2 --1- 172.21.15.31:0/3016567535 >> 172.21.15.31:0/3016567535 conn(0x5616d7816800 0x5616d787f000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:49:04.735 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 5 --1- 172.21.15.31:0/3016567535 >> 172.21.15.31:0/3016567535 conn(0x5616d7816800 0x5616d787f000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:49:04.735 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 20 Event(0x5616d77aae00 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:04.735 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 10 --1- 172.21.15.31:0/3016567535 >> 172.21.15.31:0/3016567535 conn(0x5616d7816800 0x5616d787f000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:49:04.735 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 20 Event(0x5616d77ab040 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:04.736 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 20 Event(0x5616d77ab280 nevent=5000 time_id=3).wakeup 2020-06-27T04:49:04.736 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b67898700 5 --1- 172.21.15.31:0/3016567535 >> 172.21.15.31:0/3016567535 conn(0x5616d7816800 0x5616d787f000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:49:04.736 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b67898700 5 --1- 172.21.15.31:0/3016567535 >> 172.21.15.31:0/3016567535 conn(0x5616d7816800 0x5616d787f000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:49:04.736 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 10 -- 172.21.15.31:0/3016567535 wait: waiting for dispatch queue 2020-06-27T04:49:04.736 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 10 -- 172.21.15.31:0/3016567535 wait: dispatch queue is stopped 2020-06-27T04:49:04.737 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 1 -- 172.21.15.31:0/3016567535 shutdown_connections 2020-06-27T04:49:04.737 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 5 -- 172.21.15.31:0/3016567535 shutdown_connections delete 0x5616d7816800 2020-06-27T04:49:04.737 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 20 Event(0x5616d77aae00 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:04.737 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 20 Event(0x5616d77ab040 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:04.737 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 20 Event(0x5616d77ab280 nevent=5000 time_id=3).wakeup 2020-06-27T04:49:04.738 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 10 -- 172.21.15.31:0/3016567535 wait: done. 2020-06-27T04:49:04.738 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:04 smithi031 bash[113585]: debug 2020-06-27T04:49:04.544+0000 7f4b6db15f40 1 -- 172.21.15.31:0/3016567535 wait complete. 2020-06-27T04:49:05.427 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:05 smithi031 bash[113585]: debug 2020-06-27T04:49:05.061+0000 7f4b6db15f40 -1 Falling back to public interface 2020-06-27T04:49:05.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:05 smithi051 bash[18409]: audit 2020-06-27T04:49:04.616684+0000 mon.a (mon.0) 1280 : audit [INF] from='osd.1 v2:172.21.15.31:6800/1882406212' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:49:05.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:05 smithi051 bash[18409]: audit 2020-06-27T04:49:04.617165+0000 mon.a (mon.0) 1281 : audit [INF] from='osd.1 v2:172.21.15.31:6800/1882406212' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:49:05.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:05 smithi031 bash[18426]: audit 2020-06-27T04:49:04.616684+0000 mon.a (mon.0) 1280 : audit [INF] from='osd.1 v2:172.21.15.31:6800/1882406212' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:49:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:05 smithi031 bash[18426]: audit 2020-06-27T04:49:04.617165+0000 mon.a (mon.0) 1281 : audit [INF] from='osd.1 v2:172.21.15.31:6800/1882406212' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:49:05.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:05 smithi031 bash[22603]: audit 2020-06-27T04:49:04.616684+0000 mon.a (mon.0) 1280 : audit [INF] from='osd.1 v2:172.21.15.31:6800/1882406212' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-06-27T04:49:05.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:05 smithi031 bash[22603]: audit 2020-06-27T04:49:04.617165+0000 mon.a (mon.0) 1281 : audit [INF] from='osd.1 v2:172.21.15.31:6800/1882406212' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:49:06.223 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:05 smithi031 bash[113585]: debug 2020-06-27T04:49:05.774+0000 7f4b6db15f40 -1 osd.3 140 log_to_monitors {default=true} 2020-06-27T04:49:06.701 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:06 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:49:06.702 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:06 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Scheduled restart job, restart counter is at 5. 2020-06-27T04:49:06.702 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:06 smithi051 systemd[1]: Stopped Ceph osd.6 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:06.702 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:06 smithi051 systemd[1]: Starting Ceph osd.6 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:49:06.702 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:06 smithi051 podman[43229]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6 found: no such container 2020-06-27T04:49:06.703 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:06 smithi051 systemd[1]: Started Ceph osd.6 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:06.703 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:06.703 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: in thread 7f906f9f0700 thread_name:tp_osd_tp 2020-06-27T04:49:06.703 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:06.704 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 1: (()+0x12dd0) [0x7f9094ff6dd0] 2020-06-27T04:49:06.704 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55da1f45d707] 2020-06-27T04:49:06.704 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55da1f45daa0] 2020-06-27T04:49:06.704 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55da1f48f67a] 2020-06-27T04:49:06.704 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55da1f490a57] 2020-06-27T04:49:06.704 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55da1f11b938] 2020-06-27T04:49:06.705 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55da1f2cfa70] 2020-06-27T04:49:06.705 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55da1f2dfdd7] 2020-06-27T04:49:06.705 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55da1f14e252] 2020-06-27T04:49:06.705 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55da1f0f1e2e] 2020-06-27T04:49:06.705 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55da1ef724e9] 2020-06-27T04:49:06.706 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55da1f1d6f78] 2020-06-27T04:49:06.706 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55da1ef9170f] 2020-06-27T04:49:06.706 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55da1f5cfb94] 2020-06-27T04:49:06.706 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55da1f5d27f4] 2020-06-27T04:49:06.706 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 16: (()+0x82de) [0x7f9094fec2de] 2020-06-27T04:49:06.707 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 17: (clone()+0x43) [0x7f9093d23e83] 2020-06-27T04:49:06.707 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: debug 2020-06-27T04:49:06.542+0000 7f906f9f0700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:06.707 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: in thread 7f906f9f0700 thread_name:tp_osd_tp 2020-06-27T04:49:06.707 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:06.709 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 1: (()+0x12dd0) [0x7f9094ff6dd0] 2020-06-27T04:49:06.709 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55da1f45d707] 2020-06-27T04:49:06.709 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55da1f45daa0] 2020-06-27T04:49:06.710 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55da1f48f67a] 2020-06-27T04:49:06.710 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55da1f490a57] 2020-06-27T04:49:06.710 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55da1f11b938] 2020-06-27T04:49:06.713 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55da1f2cfa70] 2020-06-27T04:49:06.714 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55da1f2dfdd7] 2020-06-27T04:49:06.714 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55da1f14e252] 2020-06-27T04:49:06.714 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55da1f0f1e2e] 2020-06-27T04:49:06.715 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55da1ef724e9] 2020-06-27T04:49:06.716 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55da1f1d6f78] 2020-06-27T04:49:06.716 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55da1ef9170f] 2020-06-27T04:49:06.716 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55da1f5cfb94] 2020-06-27T04:49:06.716 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55da1f5d27f4] 2020-06-27T04:49:06.716 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 16: (()+0x82de) [0x7f9094fec2de] 2020-06-27T04:49:06.717 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 17: (clone()+0x43) [0x7f9093d23e83] 2020-06-27T04:49:06.717 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:49:06.717 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: debug -9999> 2020-06-27T04:49:06.542+0000 7f906f9f0700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:06.717 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: in thread 7f906f9f0700 thread_name:tp_osd_tp 2020-06-27T04:49:06.717 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:06.717 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 1: (()+0x12dd0) [0x7f9094ff6dd0] 2020-06-27T04:49:06.718 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55da1f45d707] 2020-06-27T04:49:06.718 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55da1f45daa0] 2020-06-27T04:49:06.718 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55da1f48f67a] 2020-06-27T04:49:06.718 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55da1f490a57] 2020-06-27T04:49:06.718 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55da1f11b938] 2020-06-27T04:49:06.719 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55da1f2cfa70] 2020-06-27T04:49:06.719 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55da1f2dfdd7] 2020-06-27T04:49:06.719 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55da1f14e252] 2020-06-27T04:49:06.719 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55da1f0f1e2e] 2020-06-27T04:49:06.719 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55da1ef724e9] 2020-06-27T04:49:06.720 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55da1f1d6f78] 2020-06-27T04:49:06.720 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55da1ef9170f] 2020-06-27T04:49:06.720 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55da1f5cfb94] 2020-06-27T04:49:06.720 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55da1f5d27f4] 2020-06-27T04:49:06.720 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 16: (()+0x82de) [0x7f9094fec2de] 2020-06-27T04:49:06.720 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 17: (clone()+0x43) [0x7f9093d23e83] 2020-06-27T04:49:06.721 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:49:06.721 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: debug -9999> 2020-06-27T04:49:06.542+0000 7f906f9f0700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:06.721 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: in thread 7f906f9f0700 thread_name:tp_osd_tp 2020-06-27T04:49:06.721 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:06.721 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 1: (()+0x12dd0) [0x7f9094ff6dd0] 2020-06-27T04:49:06.722 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55da1f45d707] 2020-06-27T04:49:06.722 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55da1f45daa0] 2020-06-27T04:49:06.722 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55da1f48f67a] 2020-06-27T04:49:06.722 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55da1f490a57] 2020-06-27T04:49:06.722 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55da1f11b938] 2020-06-27T04:49:06.723 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55da1f2cfa70] 2020-06-27T04:49:06.723 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55da1f2dfdd7] 2020-06-27T04:49:06.723 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55da1f14e252] 2020-06-27T04:49:06.723 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55da1f0f1e2e] 2020-06-27T04:49:06.724 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55da1ef724e9] 2020-06-27T04:49:06.724 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55da1f1d6f78] 2020-06-27T04:49:06.724 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55da1ef9170f] 2020-06-27T04:49:06.724 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55da1f5cfb94] 2020-06-27T04:49:06.724 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55da1f5d27f4] 2020-06-27T04:49:06.724 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 16: (()+0x82de) [0x7f9094fec2de] 2020-06-27T04:49:06.725 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: 17: (clone()+0x43) [0x7f9093d23e83] 2020-06-27T04:49:06.725 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:49:06.725 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:49:06.725 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: terminate called after throwing an instance of 'boost::wrapexcept' 2020-06-27T04:49:06.725 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[39162]: what(): boost::bad_get: failed value get using boost::get 2020-06-27T04:49:06.726 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[18409]: cluster 2020-06-27T04:49:05.252569+0000 mgr.x (mgr.34109) 278 : cluster [DBG] pgmap v343: 777 pgs: 3 stale+activating+undersized, 8 stale+undersized+degraded+peered, 22 active+undersized+degraded, 4 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 47 down, 61 stale+down, 22 unknown, 75 active+undersized, 91 stale+peering, 4 stale+active+undersized+degraded, 78 undersized+degraded+peered, 50 stale+undersized+peered, 20 stale+active+undersized, 290 undersized+peered; 26 KiB data, 22 MiB used, 707 GiB / 715 GiB avail; 652 B/s wr, 0 op/s; 492/1104 objects degraded (44.565%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:06.726 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[18409]: cluster 2020-06-27T04:49:05.410479+0000 mon.a (mon.0) 1282 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:49:06.726 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[18409]: cluster 2020-06-27T04:49:05.418328+0000 mon.a (mon.0) 1283 : cluster [INF] osd.1 v2:172.21.15.31:6800/1882406212 boot 2020-06-27T04:49:06.726 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[18409]: cluster 2020-06-27T04:49:05.418440+0000 mon.a (mon.0) 1284 : cluster [DBG] osdmap e152: 8 total, 3 up, 8 in 2020-06-27T04:49:06.728 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[18409]: audit 2020-06-27T04:49:05.418578+0000 mon.b (mon.2) 332 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:49:06.728 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[18409]: audit 2020-06-27T04:49:05.778632+0000 mon.c (mon.1) 82 : audit [INF] from='osd.3 v2:172.21.15.31:6808/395847559' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:49:06.728 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[18409]: audit 2020-06-27T04:49:05.778893+0000 mon.a (mon.0) 1285 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:49:06.728 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[18409]: audit 2020-06-27T04:49:05.779447+0000 mon.c (mon.1) 83 : audit [INF] from='osd.3 v2:172.21.15.31:6808/395847559' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:49:06.729 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:06 smithi051 bash[18409]: audit 2020-06-27T04:49:05.779702+0000 mon.a (mon.0) 1286 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:49:06.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[18426]: cluster 2020-06-27T04:49:05.252569+0000 mgr.x (mgr.34109) 278 : cluster [DBG] pgmap v343: 777 pgs: 3 stale+activating+undersized, 8 stale+undersized+degraded+peered, 22 active+undersized+degraded, 4 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 47 down, 61 stale+down, 22 unknown, 75 active+undersized, 91 stale+peering, 4 stale+active+undersized+degraded, 78 undersized+degraded+peered, 50 stale+undersized+peered, 20 stale+active+undersized, 290 undersized+peered; 26 KiB data, 22 MiB used, 707 GiB / 715 GiB avail; 652 B/s wr, 0 op/s; 492/1104 objects degraded (44.565%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:06.730 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[18426]: cluster 2020-06-27T04:49:05.410479+0000 mon.a (mon.0) 1282 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:49:06.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[18426]: cluster 2020-06-27T04:49:05.418328+0000 mon.a (mon.0) 1283 : cluster [INF] osd.1 v2:172.21.15.31:6800/1882406212 boot 2020-06-27T04:49:06.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[18426]: cluster 2020-06-27T04:49:05.418440+0000 mon.a (mon.0) 1284 : cluster [DBG] osdmap e152: 8 total, 3 up, 8 in 2020-06-27T04:49:06.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[18426]: audit 2020-06-27T04:49:05.418578+0000 mon.b (mon.2) 332 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:49:06.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[18426]: audit 2020-06-27T04:49:05.778632+0000 mon.c (mon.1) 82 : audit [INF] from='osd.3 v2:172.21.15.31:6808/395847559' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:49:06.731 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[18426]: audit 2020-06-27T04:49:05.778893+0000 mon.a (mon.0) 1285 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:49:06.732 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[18426]: audit 2020-06-27T04:49:05.779447+0000 mon.c (mon.1) 83 : audit [INF] from='osd.3 v2:172.21.15.31:6808/395847559' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:49:06.732 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[18426]: audit 2020-06-27T04:49:05.779702+0000 mon.a (mon.0) 1286 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:49:06.732 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:06.732 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: in thread 7f66a4f48700 thread_name:tp_osd_tp 2020-06-27T04:49:06.732 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:06.733 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 1: (()+0x12dd0) [0x7f66ce556dd0] 2020-06-27T04:49:06.733 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55c4acbfb707] 2020-06-27T04:49:06.733 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55c4acbfbaa0] 2020-06-27T04:49:06.733 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55c4acc2d67a] 2020-06-27T04:49:06.734 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55c4acc2ea57] 2020-06-27T04:49:06.734 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55c4ac8b9938] 2020-06-27T04:49:06.734 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55c4aca6a03d] 2020-06-27T04:49:06.734 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55c4ac8275b0] 2020-06-27T04:49:06.734 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55c4ac88089d] 2020-06-27T04:49:06.735 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55c4ac889380] 2020-06-27T04:49:06.735 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55c4ac890590] 2020-06-27T04:49:06.735 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55c4ac7104e9] 2020-06-27T04:49:06.735 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55c4ac974f78] 2020-06-27T04:49:06.735 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55c4ac72f70f] 2020-06-27T04:49:06.736 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55c4acd6db94] 2020-06-27T04:49:06.736 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55c4acd707f4] 2020-06-27T04:49:06.736 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 17: (()+0x82de) [0x7f66ce54c2de] 2020-06-27T04:49:06.736 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 18: (clone()+0x43) [0x7f66cd283e83] 2020-06-27T04:49:06.736 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: debug 2020-06-27T04:49:06.524+0000 7f66a4f48700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:06.736 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: in thread 7f66a4f48700 thread_name:tp_osd_tp 2020-06-27T04:49:06.737 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:06.737 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 1: (()+0x12dd0) [0x7f66ce556dd0] 2020-06-27T04:49:06.737 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55c4acbfb707] 2020-06-27T04:49:06.737 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55c4acbfbaa0] 2020-06-27T04:49:06.737 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55c4acc2d67a] 2020-06-27T04:49:06.738 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55c4acc2ea57] 2020-06-27T04:49:06.738 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55c4ac8b9938] 2020-06-27T04:49:06.738 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55c4aca6a03d] 2020-06-27T04:49:06.738 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55c4ac8275b0] 2020-06-27T04:49:06.738 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55c4ac88089d] 2020-06-27T04:49:06.739 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55c4ac889380] 2020-06-27T04:49:06.739 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55c4ac890590] 2020-06-27T04:49:06.739 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55c4ac7104e9] 2020-06-27T04:49:06.739 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55c4ac974f78] 2020-06-27T04:49:06.739 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55c4ac72f70f] 2020-06-27T04:49:06.739 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55c4acd6db94] 2020-06-27T04:49:06.740 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55c4acd707f4] 2020-06-27T04:49:06.740 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 17: (()+0x82de) [0x7f66ce54c2de] 2020-06-27T04:49:06.740 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 18: (clone()+0x43) [0x7f66cd283e83] 2020-06-27T04:49:06.740 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:49:06.740 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: debug -531> 2020-06-27T04:49:06.524+0000 7f66a4f48700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:06.741 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: in thread 7f66a4f48700 thread_name:tp_osd_tp 2020-06-27T04:49:06.741 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:06.741 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 1: (()+0x12dd0) [0x7f66ce556dd0] 2020-06-27T04:49:06.741 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55c4acbfb707] 2020-06-27T04:49:06.741 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55c4acbfbaa0] 2020-06-27T04:49:06.742 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55c4acc2d67a] 2020-06-27T04:49:06.742 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55c4acc2ea57] 2020-06-27T04:49:06.742 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55c4ac8b9938] 2020-06-27T04:49:06.742 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55c4aca6a03d] 2020-06-27T04:49:06.742 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55c4ac8275b0] 2020-06-27T04:49:06.742 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55c4ac88089d] 2020-06-27T04:49:06.743 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55c4ac889380] 2020-06-27T04:49:06.743 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55c4ac890590] 2020-06-27T04:49:06.743 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55c4ac7104e9] 2020-06-27T04:49:06.744 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55c4ac974f78] 2020-06-27T04:49:06.744 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55c4ac72f70f] 2020-06-27T04:49:06.744 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55c4acd6db94] 2020-06-27T04:49:06.744 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55c4acd707f4] 2020-06-27T04:49:06.744 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 17: (()+0x82de) [0x7f66ce54c2de] 2020-06-27T04:49:06.744 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 18: (clone()+0x43) [0x7f66cd283e83] 2020-06-27T04:49:06.745 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:49:06.745 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: debug -9999> 2020-06-27T04:49:06.524+0000 7f66a4f48700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:06.745 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: in thread 7f66a4f48700 thread_name:tp_osd_tp 2020-06-27T04:49:06.745 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:06.745 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 1: (()+0x12dd0) [0x7f66ce556dd0] 2020-06-27T04:49:06.746 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55c4acbfb707] 2020-06-27T04:49:06.746 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55c4acbfbaa0] 2020-06-27T04:49:06.746 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55c4acc2d67a] 2020-06-27T04:49:06.746 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55c4acc2ea57] 2020-06-27T04:49:06.748 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55c4ac8b9938] 2020-06-27T04:49:06.748 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55c4aca6a03d] 2020-06-27T04:49:06.748 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55c4ac8275b0] 2020-06-27T04:49:06.749 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55c4ac88089d] 2020-06-27T04:49:06.749 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55c4ac889380] 2020-06-27T04:49:06.749 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55c4ac890590] 2020-06-27T04:49:06.749 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55c4ac7104e9] 2020-06-27T04:49:06.749 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55c4ac974f78] 2020-06-27T04:49:06.750 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55c4ac72f70f] 2020-06-27T04:49:06.750 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55c4acd6db94] 2020-06-27T04:49:06.750 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55c4acd707f4] 2020-06-27T04:49:06.750 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 17: (()+0x82de) [0x7f66ce54c2de] 2020-06-27T04:49:06.750 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: 18: (clone()+0x43) [0x7f66cd283e83] 2020-06-27T04:49:06.751 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:49:06.751 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[113489]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:49:06.751 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:06 smithi031 podman[113646]: 2020-06-27 04:49:06.623439162 +0000 UTC m=+3.795079353 container died 5c5b2dd9ffba72091c8a43f5b9b15f86e564c286ed2b577063f07d0d0c780e8e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:49:06.751 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[22603]: cluster 2020-06-27T04:49:05.252569+0000 mgr.x (mgr.34109) 278 : cluster [DBG] pgmap v343: 777 pgs: 3 stale+activating+undersized, 8 stale+undersized+degraded+peered, 22 active+undersized+degraded, 4 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 1 stale+creating+peering, 47 down, 61 stale+down, 22 unknown, 75 active+undersized, 91 stale+peering, 4 stale+active+undersized+degraded, 78 undersized+degraded+peered, 50 stale+undersized+peered, 20 stale+active+undersized, 290 undersized+peered; 26 KiB data, 22 MiB used, 707 GiB / 715 GiB avail; 652 B/s wr, 0 op/s; 492/1104 objects degraded (44.565%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:06.751 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[22603]: cluster 2020-06-27T04:49:05.410479+0000 mon.a (mon.0) 1282 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:49:06.752 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[22603]: cluster 2020-06-27T04:49:05.418328+0000 mon.a (mon.0) 1283 : cluster [INF] osd.1 v2:172.21.15.31:6800/1882406212 boot 2020-06-27T04:49:06.752 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[22603]: cluster 2020-06-27T04:49:05.418440+0000 mon.a (mon.0) 1284 : cluster [DBG] osdmap e152: 8 total, 3 up, 8 in 2020-06-27T04:49:06.752 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[22603]: audit 2020-06-27T04:49:05.418578+0000 mon.b (mon.2) 332 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-06-27T04:49:06.752 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[22603]: audit 2020-06-27T04:49:05.778632+0000 mon.c (mon.1) 82 : audit [INF] from='osd.3 v2:172.21.15.31:6808/395847559' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:49:06.752 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[22603]: audit 2020-06-27T04:49:05.778893+0000 mon.a (mon.0) 1285 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-06-27T04:49:06.753 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[22603]: audit 2020-06-27T04:49:05.779447+0000 mon.c (mon.1) 83 : audit [INF] from='osd.3 v2:172.21.15.31:6808/395847559' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:49:06.753 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:06 smithi031 bash[22603]: audit 2020-06-27T04:49:05.779702+0000 mon.a (mon.0) 1286 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:49:06.968 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:06 smithi051 podman[39360]: 2020-06-27 04:49:06.698650933 +0000 UTC m=+40.901160203 container died becacd7f393ce444b0c33f96290f93204005f72d1b03a0b2755a8201ebfcf05b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:49:07.326 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:07 smithi051 podman[43246]: 2020-06-27 04:49:07.06720121 +0000 UTC m=+0.525187083 container create acd621b08ea151f28a072b39a355825c39b7cbc3feade0839dafc1ac0f09fab1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:49:07.596 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:07 smithi051 podman[39360]: 2020-06-27 04:49:07.324665031 +0000 UTC m=+41.527174280 container remove becacd7f393ce444b0c33f96290f93204005f72d1b03a0b2755a8201ebfcf05b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:49:07.596 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:07 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:49:07.597 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[18409]: audit 2020-06-27T04:49:06.431446+0000 mon.b (mon.2) 333 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:49:07.597 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[18409]: cluster 2020-06-27T04:49:06.435632+0000 mon.a (mon.0) 1287 : cluster [INF] osd.3 v2:172.21.15.31:6808/395847559 boot 2020-06-27T04:49:07.597 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[18409]: cluster 2020-06-27T04:49:06.435916+0000 mon.a (mon.0) 1288 : cluster [DBG] osdmap e153: 8 total, 4 up, 8 in 2020-06-27T04:49:07.597 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[18409]: cluster 2020-06-27T04:49:06.584303+0000 mon.a (mon.0) 1289 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:49:07.598 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[18409]: cluster 2020-06-27T04:49:06.584356+0000 mon.a (mon.0) 1290 : cluster [INF] osd.1 failed (root=default,host=smithi031) (connection refused reported by osd.3) 2020-06-27T04:49:07.598 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[18409]: cluster 2020-06-27T04:49:06.584535+0000 mon.a (mon.0) 1291 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:49:07.598 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[18409]: cluster 2020-06-27T04:49:06.584941+0000 mon.a (mon.0) 1292 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:49:07.598 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[18409]: cluster 2020-06-27T04:49:06.585777+0000 mon.a (mon.0) 1293 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:49:07.598 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[18409]: cluster 2020-06-27T04:49:06.585915+0000 mon.a (mon.0) 1294 : cluster [DBG] osd.7 reported immediately failed by osd.2 2020-06-27T04:49:07.598 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[18409]: cluster 2020-06-27T04:49:06.586092+0000 mon.a (mon.0) 1295 : cluster [INF] osd.7 failed (root=default,host=smithi051) (connection refused reported by osd.2) 2020-06-27T04:49:07.599 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[18409]: cluster 2020-06-27T04:49:07.428487+0000 mon.a (mon.0) 1296 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:49:07.599 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[18409]: cluster 2020-06-27T04:49:07.433955+0000 mon.a (mon.0) 1297 : cluster [DBG] osdmap e154: 8 total, 2 up, 8 in 2020-06-27T04:49:07.599 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:07 smithi051 podman[43246]: 2020-06-27 04:49:07.331629625 +0000 UTC m=+0.789615498 container init acd621b08ea151f28a072b39a355825c39b7cbc3feade0839dafc1ac0f09fab1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:49:07.599 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:07 smithi051 podman[43246]: 2020-06-27 04:49:07.3649779 +0000 UTC m=+0.822963759 container start acd621b08ea151f28a072b39a355825c39b7cbc3feade0839dafc1ac0f09fab1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:49:07.600 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:07 smithi051 podman[43246]: 2020-06-27 04:49:07.365051149 +0000 UTC m=+0.823037034 container attach acd621b08ea151f28a072b39a355825c39b7cbc3feade0839dafc1ac0f09fab1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:49:07.600 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[43244]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-06-27T04:49:07.600 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[43244]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2020-06-27T04:49:07.600 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[43244]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2020-06-27T04:49:07.722 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[22603]: audit 2020-06-27T04:49:06.431446+0000 mon.b (mon.2) 333 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:49:07.722 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[22603]: cluster 2020-06-27T04:49:06.435632+0000 mon.a (mon.0) 1287 : cluster [INF] osd.3 v2:172.21.15.31:6808/395847559 boot 2020-06-27T04:49:07.722 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[22603]: cluster 2020-06-27T04:49:06.435916+0000 mon.a (mon.0) 1288 : cluster [DBG] osdmap e153: 8 total, 4 up, 8 in 2020-06-27T04:49:07.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[22603]: cluster 2020-06-27T04:49:06.584303+0000 mon.a (mon.0) 1289 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:49:07.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[22603]: cluster 2020-06-27T04:49:06.584356+0000 mon.a (mon.0) 1290 : cluster [INF] osd.1 failed (root=default,host=smithi031) (connection refused reported by osd.3) 2020-06-27T04:49:07.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[22603]: cluster 2020-06-27T04:49:06.584535+0000 mon.a (mon.0) 1291 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:49:07.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[22603]: cluster 2020-06-27T04:49:06.584941+0000 mon.a (mon.0) 1292 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:49:07.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[22603]: cluster 2020-06-27T04:49:06.585777+0000 mon.a (mon.0) 1293 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:49:07.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[22603]: cluster 2020-06-27T04:49:06.585915+0000 mon.a (mon.0) 1294 : cluster [DBG] osd.7 reported immediately failed by osd.2 2020-06-27T04:49:07.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[22603]: cluster 2020-06-27T04:49:06.586092+0000 mon.a (mon.0) 1295 : cluster [INF] osd.7 failed (root=default,host=smithi051) (connection refused reported by osd.2) 2020-06-27T04:49:07.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[22603]: cluster 2020-06-27T04:49:07.428487+0000 mon.a (mon.0) 1296 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:49:07.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[22603]: cluster 2020-06-27T04:49:07.433955+0000 mon.a (mon.0) 1297 : cluster [DBG] osdmap e154: 8 total, 2 up, 8 in 2020-06-27T04:49:07.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[18426]: audit 2020-06-27T04:49:06.431446+0000 mon.b (mon.2) 333 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-06-27T04:49:07.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[18426]: cluster 2020-06-27T04:49:06.435632+0000 mon.a (mon.0) 1287 : cluster [INF] osd.3 v2:172.21.15.31:6808/395847559 boot 2020-06-27T04:49:07.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[18426]: cluster 2020-06-27T04:49:06.435916+0000 mon.a (mon.0) 1288 : cluster [DBG] osdmap e153: 8 total, 4 up, 8 in 2020-06-27T04:49:07.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[18426]: cluster 2020-06-27T04:49:06.584303+0000 mon.a (mon.0) 1289 : cluster [DBG] osd.1 reported immediately failed by osd.3 2020-06-27T04:49:07.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[18426]: cluster 2020-06-27T04:49:06.584356+0000 mon.a (mon.0) 1290 : cluster [INF] osd.1 failed (root=default,host=smithi031) (connection refused reported by osd.3) 2020-06-27T04:49:07.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[18426]: cluster 2020-06-27T04:49:06.584535+0000 mon.a (mon.0) 1291 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:49:07.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[18426]: cluster 2020-06-27T04:49:06.584941+0000 mon.a (mon.0) 1292 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:49:07.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[18426]: cluster 2020-06-27T04:49:06.585777+0000 mon.a (mon.0) 1293 : cluster [DBG] osd.1 reported immediately failed by osd.2 2020-06-27T04:49:07.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[18426]: cluster 2020-06-27T04:49:06.585915+0000 mon.a (mon.0) 1294 : cluster [DBG] osd.7 reported immediately failed by osd.2 2020-06-27T04:49:07.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[18426]: cluster 2020-06-27T04:49:06.586092+0000 mon.a (mon.0) 1295 : cluster [INF] osd.7 failed (root=default,host=smithi051) (connection refused reported by osd.2) 2020-06-27T04:49:07.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[18426]: cluster 2020-06-27T04:49:07.428487+0000 mon.a (mon.0) 1296 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:49:07.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:07 smithi031 bash[18426]: cluster 2020-06-27T04:49:07.433955+0000 mon.a (mon.0) 1297 : cluster [DBG] osdmap e154: 8 total, 2 up, 8 in 2020-06-27T04:49:07.968 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:07 smithi051 podman[43312]: 2020-06-27 04:49:07.606970531 +0000 UTC m=+0.264283219 container create d2fa85c1229289f18c9d0b0091d2e1a4553553aa75ccc3bd97e5f151fb7903e9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:49:07.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[43244]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2020-06-27T04:49:07.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[43244]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2020-06-27T04:49:07.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[43244]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-06-27T04:49:07.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:07 smithi051 bash[43244]: --> ceph-volume lvm activate successful for osd ID: 6 2020-06-27T04:49:07.969 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:07 smithi051 podman[43246]: 2020-06-27 04:49:07.64972999 +0000 UTC m=+1.107715901 container died acd621b08ea151f28a072b39a355825c39b7cbc3feade0839dafc1ac0f09fab1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:49:07.973 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:07 smithi031 podman[113646]: 2020-06-27 04:49:07.719781168 +0000 UTC m=+4.891421343 container remove 5c5b2dd9ffba72091c8a43f5b9b15f86e564c286ed2b577063f07d0d0c780e8e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1) 2020-06-27T04:49:07.973 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:07 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:49:08.255 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:08 smithi051 podman[43246]: 2020-06-27 04:49:08.166775985 +0000 UTC m=+1.624761878 container remove acd621b08ea151f28a072b39a355825c39b7cbc3feade0839dafc1ac0f09fab1 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-activate) 2020-06-27T04:49:08.256 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:08 smithi051 bash[43244]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6 found: no such container 2020-06-27T04:49:08.256 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:08 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:49:08.256 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:08 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Scheduled restart job, restart counter is at 5. 2020-06-27T04:49:08.256 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:08 smithi051 systemd[1]: Stopped Ceph osd.4 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:08.256 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:08 smithi051 systemd[1]: Starting Ceph osd.4 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:49:08.257 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:07 smithi051 podman[43312]: 2020-06-27 04:49:07.999803054 +0000 UTC m=+0.657115841 container init d2fa85c1229289f18c9d0b0091d2e1a4553553aa75ccc3bd97e5f151fb7903e9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:49:08.257 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:08 smithi051 podman[43312]: 2020-06-27 04:49:08.082219339 +0000 UTC m=+0.739532022 container start d2fa85c1229289f18c9d0b0091d2e1a4553553aa75ccc3bd97e5f151fb7903e9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:49:08.257 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:08 smithi051 podman[43312]: 2020-06-27 04:49:08.082293848 +0000 UTC m=+0.739606521 container attach d2fa85c1229289f18c9d0b0091d2e1a4553553aa75ccc3bd97e5f151fb7903e9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:49:08.375 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:07 smithi031 podman[114527]: 2020-06-27 04:49:07.985611384 +0000 UTC m=+0.247264310 container create 3cae4b16ea1bc093137764cf2a622190bffe4fd3e7ad3ac9f9a54cb9fd955ece (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:49:08.376 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:08 smithi031 podman[114527]: 2020-06-27 04:49:08.119036877 +0000 UTC m=+0.380689874 container init 3cae4b16ea1bc093137764cf2a622190bffe4fd3e7ad3ac9f9a54cb9fd955ece (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:49:08.376 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:08 smithi031 podman[114527]: 2020-06-27 04:49:08.202281745 +0000 UTC m=+0.463934653 container start 3cae4b16ea1bc093137764cf2a622190bffe4fd3e7ad3ac9f9a54cb9fd955ece (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:49:08.376 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:08 smithi031 podman[114527]: 2020-06-27 04:49:08.202358893 +0000 UTC m=+0.464011820 container attach 3cae4b16ea1bc093137764cf2a622190bffe4fd3e7ad3ac9f9a54cb9fd955ece (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:49:08.630 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:08 smithi051 bash[18409]: cluster 2020-06-27T04:49:07.253703+0000 mgr.x (mgr.34109) 279 : cluster [DBG] pgmap v346: 777 pgs: 1 creating+down, 5 stale+undersized+degraded+peered, 22 active+undersized+degraded, 2 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 86 down, 61 stale+down, 22 unknown, 75 active+undersized, 65 stale+peering, 4 stale+active+undersized+degraded, 81 undersized+degraded+peered, 37 stale+undersized+peered, 20 stale+active+undersized, 295 undersized+peered; 26 KiB data, 23 MiB used, 707 GiB / 715 GiB avail; 521 B/s wr, 0 op/s; 490/1101 objects degraded (44.505%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:08.630 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:08 smithi051 bash[18409]: cluster 2020-06-27T04:49:08.435092+0000 mon.a (mon.0) 1298 : cluster [DBG] osdmap e155: 8 total, 2 up, 8 in 2020-06-27T04:49:08.631 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:08 smithi051 bash[43244]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6 2020-06-27T04:49:08.631 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:08 smithi051 bash[43244]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6" found: no such container 2020-06-27T04:49:08.631 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:08 smithi051 podman[43418]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4 found: no such container 2020-06-27T04:49:08.631 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:08 smithi051 systemd[1]: Started Ceph osd.4 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:08.632 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:08 smithi051 podman[43312]: 2020-06-27 04:49:08.26665478 +0000 UTC m=+0.923967488 container died d2fa85c1229289f18c9d0b0091d2e1a4553553aa75ccc3bd97e5f151fb7903e9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:49:08.724 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:08 smithi031 podman[114527]: 2020-06-27 04:49:08.466411202 +0000 UTC m=+0.728064147 container died 3cae4b16ea1bc093137764cf2a622190bffe4fd3e7ad3ac9f9a54cb9fd955ece (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:49:08.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[18426]: cluster 2020-06-27T04:49:07.253703+0000 mgr.x (mgr.34109) 279 : cluster [DBG] pgmap v346: 777 pgs: 1 creating+down, 5 stale+undersized+degraded+peered, 22 active+undersized+degraded, 2 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 86 down, 61 stale+down, 22 unknown, 75 active+undersized, 65 stale+peering, 4 stale+active+undersized+degraded, 81 undersized+degraded+peered, 37 stale+undersized+peered, 20 stale+active+undersized, 295 undersized+peered; 26 KiB data, 23 MiB used, 707 GiB / 715 GiB avail; 521 B/s wr, 0 op/s; 490/1101 objects degraded (44.505%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:08.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[18426]: cluster 2020-06-27T04:49:08.435092+0000 mon.a (mon.0) 1298 : cluster [DBG] osdmap e155: 8 total, 2 up, 8 in 2020-06-27T04:49:08.725 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:08 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:49:08.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[22603]: cluster 2020-06-27T04:49:07.253703+0000 mgr.x (mgr.34109) 279 : cluster [DBG] pgmap v346: 777 pgs: 1 creating+down, 5 stale+undersized+degraded+peered, 22 active+undersized+degraded, 2 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 86 down, 61 stale+down, 22 unknown, 75 active+undersized, 65 stale+peering, 4 stale+active+undersized+degraded, 81 undersized+degraded+peered, 37 stale+undersized+peered, 20 stale+active+undersized, 295 undersized+peered; 26 KiB data, 23 MiB used, 707 GiB / 715 GiB avail; 521 B/s wr, 0 op/s; 490/1101 objects degraded (44.505%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:08.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[22603]: cluster 2020-06-27T04:49:08.435092+0000 mon.a (mon.0) 1298 : cluster [DBG] osdmap e155: 8 total, 2 up, 8 in 2020-06-27T04:49:08.726 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:08.726 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: in thread 7fe04352a700 thread_name:tp_osd_tp 2020-06-27T04:49:08.726 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:08.726 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 1: (()+0x12dd0) [0x7fe06bb36dd0] 2020-06-27T04:49:08.727 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55e082b4e707] 2020-06-27T04:49:08.727 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55e082b4eaa0] 2020-06-27T04:49:08.727 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55e082b8067a] 2020-06-27T04:49:08.727 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55e082b81a57] 2020-06-27T04:49:08.727 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55e08280c938] 2020-06-27T04:49:08.727 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55e0829c0a70] 2020-06-27T04:49:08.728 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55e0829d0dd7] 2020-06-27T04:49:08.728 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55e08283f252] 2020-06-27T04:49:08.728 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55e0827e2e2e] 2020-06-27T04:49:08.728 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55e0826634e9] 2020-06-27T04:49:08.728 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55e0828c7f78] 2020-06-27T04:49:08.729 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55e08268270f] 2020-06-27T04:49:08.729 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55e082cc0b94] 2020-06-27T04:49:08.729 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55e082cc37f4] 2020-06-27T04:49:08.729 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 16: (()+0x82de) [0x7fe06bb2c2de] 2020-06-27T04:49:08.729 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 17: (clone()+0x43) [0x7fe06a863e83] 2020-06-27T04:49:08.730 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: debug 2020-06-27T04:49:08.497+0000 7fe04352a700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:08.730 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: in thread 7fe04352a700 thread_name:tp_osd_tp 2020-06-27T04:49:08.730 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:08.730 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 1: (()+0x12dd0) [0x7fe06bb36dd0] 2020-06-27T04:49:08.730 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55e082b4e707] 2020-06-27T04:49:08.731 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55e082b4eaa0] 2020-06-27T04:49:08.731 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55e082b8067a] 2020-06-27T04:49:08.731 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55e082b81a57] 2020-06-27T04:49:08.731 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55e08280c938] 2020-06-27T04:49:08.731 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55e0829c0a70] 2020-06-27T04:49:08.731 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55e0829d0dd7] 2020-06-27T04:49:08.732 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55e08283f252] 2020-06-27T04:49:08.732 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55e0827e2e2e] 2020-06-27T04:49:08.732 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55e0826634e9] 2020-06-27T04:49:08.732 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55e0828c7f78] 2020-06-27T04:49:08.732 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55e08268270f] 2020-06-27T04:49:08.733 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55e082cc0b94] 2020-06-27T04:49:08.733 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55e082cc37f4] 2020-06-27T04:49:08.733 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 16: (()+0x82de) [0x7fe06bb2c2de] 2020-06-27T04:49:08.733 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 17: (clone()+0x43) [0x7fe06a863e83] 2020-06-27T04:49:08.733 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:49:08.734 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: debug 0> 2020-06-27T04:49:08.497+0000 7fe04352a700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:08.734 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: in thread 7fe04352a700 thread_name:tp_osd_tp 2020-06-27T04:49:08.734 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:08.734 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 1: (()+0x12dd0) [0x7fe06bb36dd0] 2020-06-27T04:49:08.734 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55e082b4e707] 2020-06-27T04:49:08.735 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55e082b4eaa0] 2020-06-27T04:49:08.735 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55e082b8067a] 2020-06-27T04:49:08.739 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55e082b81a57] 2020-06-27T04:49:08.739 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55e08280c938] 2020-06-27T04:49:08.739 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55e0829c0a70] 2020-06-27T04:49:08.739 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55e0829d0dd7] 2020-06-27T04:49:08.740 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55e08283f252] 2020-06-27T04:49:08.740 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55e0827e2e2e] 2020-06-27T04:49:08.740 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55e0826634e9] 2020-06-27T04:49:08.740 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55e0828c7f78] 2020-06-27T04:49:08.740 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55e08268270f] 2020-06-27T04:49:08.741 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55e082cc0b94] 2020-06-27T04:49:08.741 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55e082cc37f4] 2020-06-27T04:49:08.741 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 16: (()+0x82de) [0x7fe06bb2c2de] 2020-06-27T04:49:08.741 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 17: (clone()+0x43) [0x7fe06a863e83] 2020-06-27T04:49:08.741 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:49:08.742 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: debug -9999> 2020-06-27T04:49:08.497+0000 7fe04352a700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:08.742 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: in thread 7fe04352a700 thread_name:tp_osd_tp 2020-06-27T04:49:08.742 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:08.743 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 1: (()+0x12dd0) [0x7fe06bb36dd0] 2020-06-27T04:49:08.743 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55e082b4e707] 2020-06-27T04:49:08.743 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55e082b4eaa0] 2020-06-27T04:49:08.743 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55e082b8067a] 2020-06-27T04:49:08.743 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55e082b81a57] 2020-06-27T04:49:08.744 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55e08280c938] 2020-06-27T04:49:08.744 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55e0829c0a70] 2020-06-27T04:49:08.744 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55e0829d0dd7] 2020-06-27T04:49:08.744 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55e08283f252] 2020-06-27T04:49:08.744 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55e0827e2e2e] 2020-06-27T04:49:08.745 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55e0826634e9] 2020-06-27T04:49:08.745 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55e0828c7f78] 2020-06-27T04:49:08.745 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55e08268270f] 2020-06-27T04:49:08.745 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55e082cc0b94] 2020-06-27T04:49:08.745 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55e082cc37f4] 2020-06-27T04:49:08.745 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 16: (()+0x82de) [0x7fe06bb2c2de] 2020-06-27T04:49:08.746 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: 17: (clone()+0x43) [0x7fe06a863e83] 2020-06-27T04:49:08.746 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:49:08.746 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[111624]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:49:08.746 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:08.746 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: in thread 7f4b47284700 thread_name:tp_osd_tp 2020-06-27T04:49:08.747 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:08.747 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 1: (()+0x12dd0) [0x7f4b6b888dd0] 2020-06-27T04:49:08.748 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5616cc04c707] 2020-06-27T04:49:08.748 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5616cc04caa0] 2020-06-27T04:49:08.748 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5616cc07e67a] 2020-06-27T04:49:08.749 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5616cc07fa57] 2020-06-27T04:49:08.749 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5616cbd0a938] 2020-06-27T04:49:08.749 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5616cbebb03d] 2020-06-27T04:49:08.749 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5616cbc785b0] 2020-06-27T04:49:08.749 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5616cbcd189d] 2020-06-27T04:49:08.750 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5616cbcda380] 2020-06-27T04:49:08.750 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5616cbce1590] 2020-06-27T04:49:08.750 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5616cbb614e9] 2020-06-27T04:49:08.750 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5616cbdc5f78] 2020-06-27T04:49:08.750 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5616cbb8070f] 2020-06-27T04:49:08.751 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5616cc1beb94] 2020-06-27T04:49:08.751 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5616cc1c17f4] 2020-06-27T04:49:08.752 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 17: (()+0x82de) [0x7f4b6b87e2de] 2020-06-27T04:49:08.752 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 18: (clone()+0x43) [0x7f4b6a5b5e83] 2020-06-27T04:49:08.752 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: debug 2020-06-27T04:49:08.490+0000 7f4b47284700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:08.753 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: in thread 7f4b47284700 thread_name:tp_osd_tp 2020-06-27T04:49:08.753 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:08.753 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 1: (()+0x12dd0) [0x7f4b6b888dd0] 2020-06-27T04:49:08.754 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5616cc04c707] 2020-06-27T04:49:08.754 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5616cc04caa0] 2020-06-27T04:49:08.754 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5616cc07e67a] 2020-06-27T04:49:08.755 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5616cc07fa57] 2020-06-27T04:49:08.755 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5616cbd0a938] 2020-06-27T04:49:08.755 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5616cbebb03d] 2020-06-27T04:49:08.756 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5616cbc785b0] 2020-06-27T04:49:08.756 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5616cbcd189d] 2020-06-27T04:49:08.756 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5616cbcda380] 2020-06-27T04:49:08.757 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5616cbce1590] 2020-06-27T04:49:08.757 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5616cbb614e9] 2020-06-27T04:49:08.757 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5616cbdc5f78] 2020-06-27T04:49:08.757 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5616cbb8070f] 2020-06-27T04:49:08.758 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5616cc1beb94] 2020-06-27T04:49:08.758 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5616cc1c17f4] 2020-06-27T04:49:08.758 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 17: (()+0x82de) [0x7f4b6b87e2de] 2020-06-27T04:49:08.759 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 18: (clone()+0x43) [0x7f4b6a5b5e83] 2020-06-27T04:49:08.759 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:49:08.759 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: debug 0> 2020-06-27T04:49:08.490+0000 7f4b47284700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:08.760 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: in thread 7f4b47284700 thread_name:tp_osd_tp 2020-06-27T04:49:08.760 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:08.760 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 1: (()+0x12dd0) [0x7f4b6b888dd0] 2020-06-27T04:49:08.761 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5616cc04c707] 2020-06-27T04:49:08.761 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5616cc04caa0] 2020-06-27T04:49:08.761 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5616cc07e67a] 2020-06-27T04:49:08.762 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5616cc07fa57] 2020-06-27T04:49:08.762 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5616cbd0a938] 2020-06-27T04:49:08.762 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5616cbebb03d] 2020-06-27T04:49:08.763 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5616cbc785b0] 2020-06-27T04:49:08.763 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5616cbcd189d] 2020-06-27T04:49:08.763 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5616cbcda380] 2020-06-27T04:49:08.764 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5616cbce1590] 2020-06-27T04:49:08.764 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5616cbb614e9] 2020-06-27T04:49:08.764 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5616cbdc5f78] 2020-06-27T04:49:08.764 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5616cbb8070f] 2020-06-27T04:49:08.765 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5616cc1beb94] 2020-06-27T04:49:08.765 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5616cc1c17f4] 2020-06-27T04:49:08.765 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 17: (()+0x82de) [0x7f4b6b87e2de] 2020-06-27T04:49:08.766 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 18: (clone()+0x43) [0x7f4b6a5b5e83] 2020-06-27T04:49:08.766 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:49:08.766 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: debug -9999> 2020-06-27T04:49:08.490+0000 7f4b47284700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:08.766 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: in thread 7f4b47284700 thread_name:tp_osd_tp 2020-06-27T04:49:08.767 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:08.767 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 1: (()+0x12dd0) [0x7f4b6b888dd0] 2020-06-27T04:49:08.767 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5616cc04c707] 2020-06-27T04:49:08.768 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5616cc04caa0] 2020-06-27T04:49:08.768 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5616cc07e67a] 2020-06-27T04:49:08.768 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5616cc07fa57] 2020-06-27T04:49:08.768 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5616cbd0a938] 2020-06-27T04:49:08.769 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5616cbebb03d] 2020-06-27T04:49:08.769 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5616cbc785b0] 2020-06-27T04:49:08.769 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5616cbcd189d] 2020-06-27T04:49:08.770 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5616cbcda380] 2020-06-27T04:49:08.770 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5616cbce1590] 2020-06-27T04:49:08.770 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5616cbb614e9] 2020-06-27T04:49:08.770 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5616cbdc5f78] 2020-06-27T04:49:08.771 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5616cbb8070f] 2020-06-27T04:49:08.771 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5616cc1beb94] 2020-06-27T04:49:08.771 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5616cc1c17f4] 2020-06-27T04:49:08.772 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 17: (()+0x82de) [0x7f4b6b87e2de] 2020-06-27T04:49:08.772 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: 18: (clone()+0x43) [0x7f4b6a5b5e83] 2020-06-27T04:49:08.772 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:49:08.773 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:08 smithi031 bash[113585]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:49:08.967 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:08 smithi051 podman[43312]: 2020-06-27 04:49:08.627448852 +0000 UTC m=+1.284761549 container remove d2fa85c1229289f18c9d0b0091d2e1a4553553aa75ccc3bd97e5f151fb7903e9 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:49:08.968 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:08 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Failed with result 'exit-code'. 2020-06-27T04:49:09.223 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:08 smithi031 podman[111898]: 2020-06-27 04:49:08.800209678 +0000 UTC m=+26.097968420 container died 34a49be92896c51eb50324d79d4b48ea69a72bd4361b07572ea076accb8517cd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:49:09.223 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:08 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 4. 2020-06-27T04:49:09.223 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:08 smithi031 systemd[1]: Stopped Ceph osd.0 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:09.223 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:08 smithi031 systemd[1]: Starting Ceph osd.0 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:49:09.281 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:09 smithi051 podman[43449]: 2020-06-27 04:49:09.081351098 +0000 UTC m=+0.803125542 container create cad10a105e8f8a8f875f36cb39975fe4cd85ae5da61c586332d00a92cc61c540 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:49:09.281 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:09 smithi051 podman[43449]: 2020-06-27 04:49:09.279142735 +0000 UTC m=+1.000917192 container init cad10a105e8f8a8f875f36cb39975fe4cd85ae5da61c586332d00a92cc61c540 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:49:09.282 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:08 smithi051 podman[43443]: 2020-06-27 04:49:08.981362737 +0000 UTC m=+0.714285128 container create 8d2c202f6a753c7d5772b12881bff7a4bc3f6169923a3d76d69233a79d80a05e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:49:09.282 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 podman[43443]: 2020-06-27 04:49:09.156352131 +0000 UTC m=+0.889274538 container init 8d2c202f6a753c7d5772b12881bff7a4bc3f6169923a3d76d69233a79d80a05e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:49:09.282 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 podman[43443]: 2020-06-27 04:49:09.189679705 +0000 UTC m=+0.922602110 container start 8d2c202f6a753c7d5772b12881bff7a4bc3f6169923a3d76d69233a79d80a05e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:49:09.282 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 podman[43443]: 2020-06-27 04:49:09.189766949 +0000 UTC m=+0.922689371 container attach 8d2c202f6a753c7d5772b12881bff7a4bc3f6169923a3d76d69233a79d80a05e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:49:09.282 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 10 -- 172.21.15.51:0/1760026037 shutdown 172.21.15.51:0/1760026037 2020-06-27T04:49:09.283 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 10 Processor -- stop 2020-06-27T04:49:09.283 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 20 Event(0x5579ab918e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:09.283 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 1 -- 172.21.15.51:0/1760026037 shutdown_connections 2020-06-27T04:49:09.283 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 5 -- 172.21.15.51:0/1760026037 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x5579ab984c00 2020-06-27T04:49:09.283 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 1 --2- 172.21.15.51:0/1760026037 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x5579ab984c00 0x5579ab8f5400 unknown :-1 s=CLOSED pgs=3538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:49:09.283 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 5 -- 172.21.15.51:0/1760026037 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x5579ab985400 2020-06-27T04:49:09.284 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 1 --2- 172.21.15.51:0/1760026037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579ab985400 0x5579ab8f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:49:09.284 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 5 -- 172.21.15.51:0/1760026037 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x5579ab985000 2020-06-27T04:49:09.284 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 1 --2- 172.21.15.51:0/1760026037 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5579ab985000 0x5579ab8f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:49:09.284 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 5 -- 172.21.15.51:0/1760026037 shutdown_connections delete 0x5579ab984c00 2020-06-27T04:49:09.284 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 5 -- 172.21.15.51:0/1760026037 shutdown_connections delete 0x5579ab985000 2020-06-27T04:49:09.285 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 5 -- 172.21.15.51:0/1760026037 shutdown_connections delete 0x5579ab985400 2020-06-27T04:49:09.285 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 1 -- 172.21.15.51:0/1760026037 >> 172.21.15.51:0/1760026037 conn(0x5579ab984800 msgr2=0x5579ab9ed000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:49:09.285 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 20 --1- 172.21.15.51:0/1760026037 >> 172.21.15.51:0/1760026037 conn(0x5579ab984800 0x5579ab9ed000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:49:09.286 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 2 --1- 172.21.15.51:0/1760026037 >> 172.21.15.51:0/1760026037 conn(0x5579ab984800 0x5579ab9ed000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:49:09.286 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 5 --1- 172.21.15.51:0/1760026037 >> 172.21.15.51:0/1760026037 conn(0x5579ab984800 0x5579ab9ed000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:49:09.286 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 20 Event(0x5579ab918e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:09.286 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 10 --1- 172.21.15.51:0/1760026037 >> 172.21.15.51:0/1760026037 conn(0x5579ab984800 0x5579ab9ed000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:49:09.286 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 20 Event(0x5579ab918e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:09.287 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 20 Event(0x5579ab919040 nevent=5000 time_id=3).wakeup 2020-06-27T04:49:09.287 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24f91fe700 5 --1- 172.21.15.51:0/1760026037 >> 172.21.15.51:0/1760026037 conn(0x5579ab984800 0x5579ab9ed000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:49:09.287 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 20 Event(0x5579ab919280 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:09.287 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24f91fe700 5 --1- 172.21.15.51:0/1760026037 >> 172.21.15.51:0/1760026037 conn(0x5579ab984800 0x5579ab9ed000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:49:09.287 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 10 -- 172.21.15.51:0/1760026037 wait: waiting for dispatch queue 2020-06-27T04:49:09.287 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 10 -- 172.21.15.51:0/1760026037 wait: dispatch queue is stopped 2020-06-27T04:49:09.288 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 1 -- 172.21.15.51:0/1760026037 shutdown_connections 2020-06-27T04:49:09.288 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 5 -- 172.21.15.51:0/1760026037 shutdown_connections delete 0x5579ab984800 2020-06-27T04:49:09.288 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 20 Event(0x5579ab918e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:09.288 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 20 Event(0x5579ab919040 nevent=5000 time_id=3).wakeup 2020-06-27T04:49:09.288 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 20 Event(0x5579ab919280 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:09.289 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 10 -- 172.21.15.51:0/1760026037 wait: done. 2020-06-27T04:49:09.289 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.179+0000 7f24ff47bf40 1 -- 172.21.15.51:0/1760026037 wait complete. 2020-06-27T04:49:09.540 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[18409]: cluster 2020-06-27T04:49:09.391965+0000 mon.a (mon.0) 1299 : cluster [WRN] Health check update: Reduced data availability: 152 pgs inactive, 150 pgs down (PG_AVAILABILITY) 2020-06-27T04:49:09.541 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[18409]: cluster 2020-06-27T04:49:09.392000+0000 mon.a (mon.0) 1300 : cluster [WRN] Health check update: Degraded data redundancy: 490/1101 objects degraded (44.505%), 113 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:09.541 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:09 smithi051 podman[43449]: 2020-06-27 04:49:09.323026161 +0000 UTC m=+1.044800620 container start cad10a105e8f8a8f875f36cb39975fe4cd85ae5da61c586332d00a92cc61c540 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:49:09.542 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:09 smithi051 podman[43449]: 2020-06-27 04:49:09.323107535 +0000 UTC m=+1.044882030 container attach cad10a105e8f8a8f875f36cb39975fe4cd85ae5da61c586332d00a92cc61c540 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:49:09.542 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43446]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-06-27T04:49:09.542 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43446]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2020-06-27T04:49:09.542 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43446]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2020-06-27T04:49:09.543 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43446]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2020-06-27T04:49:09.543 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43446]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2020-06-27T04:49:09.543 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43446]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-06-27T04:49:09.543 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43446]: --> ceph-volume lvm activate successful for osd ID: 4 2020-06-27T04:49:09.604 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:09 smithi031 bash[18426]: cluster 2020-06-27T04:49:09.391965+0000 mon.a (mon.0) 1299 : cluster [WRN] Health check update: Reduced data availability: 152 pgs inactive, 150 pgs down (PG_AVAILABILITY) 2020-06-27T04:49:09.604 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:09 smithi031 bash[18426]: cluster 2020-06-27T04:49:09.392000+0000 mon.a (mon.0) 1300 : cluster [WRN] Health check update: Degraded data redundancy: 490/1101 objects degraded (44.505%), 113 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:09.605 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:09 smithi031 bash[22603]: cluster 2020-06-27T04:49:09.391965+0000 mon.a (mon.0) 1299 : cluster [WRN] Health check update: Reduced data availability: 152 pgs inactive, 150 pgs down (PG_AVAILABILITY) 2020-06-27T04:49:09.605 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:09 smithi031 bash[22603]: cluster 2020-06-27T04:49:09.392000+0000 mon.a (mon.0) 1300 : cluster [WRN] Health check update: Degraded data redundancy: 490/1101 objects degraded (44.505%), 113 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:09.605 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:09 smithi031 podman[113786]: 2020-06-27 04:49:09.254838819 +0000 UTC m=+5.353746632 container died 422dc2ec11dff45185ae1e78d987d3bcfae8bdf4011f9fcd1889acb5a6e071e3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:49:09.968 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:09 smithi051 podman[43449]: 2020-06-27 04:49:09.591643815 +0000 UTC m=+1.313418289 container died cad10a105e8f8a8f875f36cb39975fe4cd85ae5da61c586332d00a92cc61c540 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:49:09.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:09 smithi051 bash[43244]: debug 2020-06-27T04:49:09.699+0000 7f24ff47bf40 -1 Falling back to public interface 2020-06-27T04:49:09.973 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:09 smithi031 podman[114599]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0 found: no such container 2020-06-27T04:49:09.973 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:09 smithi031 systemd[1]: Started Ceph osd.0 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:09.974 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:09 smithi031 podman[114527]: 2020-06-27 04:49:09.602031563 +0000 UTC m=+1.863684498 container remove 3cae4b16ea1bc093137764cf2a622190bffe4fd3e7ad3ac9f9a54cb9fd955ece (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.1-deactivate) 2020-06-27T04:49:09.974 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:09 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Failed with result 'exit-code'. 2020-06-27T04:49:09.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:09 smithi031 podman[111898]: 2020-06-27 04:49:09.694969291 +0000 UTC m=+26.992728039 container remove 34a49be92896c51eb50324d79d4b48ea69a72bd4361b07572ea076accb8517cd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:49:09.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:09 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:49:10.358 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:10 smithi051 podman[43449]: 2020-06-27 04:49:10.033934667 +0000 UTC m=+1.755709157 container remove cad10a105e8f8a8f875f36cb39975fe4cd85ae5da61c586332d00a92cc61c540 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-activate) 2020-06-27T04:49:10.359 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:10 smithi051 bash[43446]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4 found: no such container 2020-06-27T04:49:10.359 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:10 smithi051 bash[43446]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4 2020-06-27T04:49:10.359 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:10 smithi051 bash[43446]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4" found: no such container 2020-06-27T04:49:10.418 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:10 smithi031 podman[113786]: 2020-06-27 04:49:10.055483997 +0000 UTC m=+6.154391698 container remove 422dc2ec11dff45185ae1e78d987d3bcfae8bdf4011f9fcd1889acb5a6e071e3 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3) 2020-06-27T04:49:10.418 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:10 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:49:10.671 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:10 smithi031 podman[114673]: 2020-06-27 04:49:10.41578638 +0000 UTC m=+0.700137953 container create 13f4924d673d7c8a7bafdc7ba3e11f7023817b99f24a2ffdc867d39d87ef381a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:49:10.671 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:10 smithi031 bash[18426]: cluster 2020-06-27T04:49:09.254830+0000 mgr.x (mgr.34109) 280 : cluster [DBG] pgmap v349: 777 pgs: 1 creating+down, 53 stale+undersized+degraded+peered, 12 active+undersized+degraded, 2 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 58 down, 89 stale+down, 22 unknown, 35 active+undersized, 65 stale+peering, 14 stale+active+undersized+degraded, 33 undersized+degraded+peered, 190 stale+undersized+peered, 60 stale+active+undersized, 142 undersized+peered; 26 KiB data, 23 MiB used, 707 GiB / 715 GiB avail; 490/1101 objects degraded (44.505%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:10.671 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:10 smithi031 bash[18426]: cluster 2020-06-27T04:49:09.466728+0000 mon.a (mon.0) 1301 : cluster [DBG] osdmap e156: 8 total, 2 up, 8 in 2020-06-27T04:49:10.671 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:10 smithi031 bash[18426]: audit 2020-06-27T04:49:10.413443+0000 mon.b (mon.2) 334 : audit [INF] from='osd.6 v2:172.21.15.51:6801/2631527633' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:49:10.672 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:10 smithi031 bash[18426]: audit 2020-06-27T04:49:10.413821+0000 mon.a (mon.0) 1302 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:49:10.672 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:10 smithi031 bash[18426]: audit 2020-06-27T04:49:10.414515+0000 mon.b (mon.2) 335 : audit [INF] from='osd.6 v2:172.21.15.51:6801/2631527633' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:49:10.672 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:10 smithi031 bash[18426]: audit 2020-06-27T04:49:10.414777+0000 mon.a (mon.0) 1303 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:49:10.672 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:10 smithi031 podman[114656]: 2020-06-27 04:49:10.575570298 +0000 UTC m=+0.950131757 container create c8eb3388a4798f284d973b48cd8a30f26f986930ddcf2e0c73e93f3dee7ebeb7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:49:10.673 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:10 smithi031 bash[22603]: cluster 2020-06-27T04:49:09.254830+0000 mgr.x (mgr.34109) 280 : cluster [DBG] pgmap v349: 777 pgs: 1 creating+down, 53 stale+undersized+degraded+peered, 12 active+undersized+degraded, 2 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 58 down, 89 stale+down, 22 unknown, 35 active+undersized, 65 stale+peering, 14 stale+active+undersized+degraded, 33 undersized+degraded+peered, 190 stale+undersized+peered, 60 stale+active+undersized, 142 undersized+peered; 26 KiB data, 23 MiB used, 707 GiB / 715 GiB avail; 490/1101 objects degraded (44.505%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:10.673 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:10 smithi031 bash[22603]: cluster 2020-06-27T04:49:09.466728+0000 mon.a (mon.0) 1301 : cluster [DBG] osdmap e156: 8 total, 2 up, 8 in 2020-06-27T04:49:10.673 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:10 smithi031 bash[22603]: audit 2020-06-27T04:49:10.413443+0000 mon.b (mon.2) 334 : audit [INF] from='osd.6 v2:172.21.15.51:6801/2631527633' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:49:10.673 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:10 smithi031 bash[22603]: audit 2020-06-27T04:49:10.413821+0000 mon.a (mon.0) 1302 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:49:10.673 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:10 smithi031 bash[22603]: audit 2020-06-27T04:49:10.414515+0000 mon.b (mon.2) 335 : audit [INF] from='osd.6 v2:172.21.15.51:6801/2631527633' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:49:10.674 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:10 smithi031 bash[22603]: audit 2020-06-27T04:49:10.414777+0000 mon.a (mon.0) 1303 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:49:10.718 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:10 smithi051 bash[43244]: debug 2020-06-27T04:49:10.408+0000 7f24ff47bf40 -1 osd.6 146 log_to_monitors {default=true} 2020-06-27T04:49:10.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:10 smithi051 bash[18409]: cluster 2020-06-27T04:49:09.254830+0000 mgr.x (mgr.34109) 280 : cluster [DBG] pgmap v349: 777 pgs: 1 creating+down, 53 stale+undersized+degraded+peered, 12 active+undersized+degraded, 2 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 58 down, 89 stale+down, 22 unknown, 35 active+undersized, 65 stale+peering, 14 stale+active+undersized+degraded, 33 undersized+degraded+peered, 190 stale+undersized+peered, 60 stale+active+undersized, 142 undersized+peered; 26 KiB data, 23 MiB used, 707 GiB / 715 GiB avail; 490/1101 objects degraded (44.505%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:10.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:10 smithi051 bash[18409]: cluster 2020-06-27T04:49:09.466728+0000 mon.a (mon.0) 1301 : cluster [DBG] osdmap e156: 8 total, 2 up, 8 in 2020-06-27T04:49:10.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:10 smithi051 bash[18409]: audit 2020-06-27T04:49:10.413443+0000 mon.b (mon.2) 334 : audit [INF] from='osd.6 v2:172.21.15.51:6801/2631527633' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:49:10.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:10 smithi051 bash[18409]: audit 2020-06-27T04:49:10.413821+0000 mon.a (mon.0) 1302 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-06-27T04:49:10.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:10 smithi051 bash[18409]: audit 2020-06-27T04:49:10.414515+0000 mon.b (mon.2) 335 : audit [INF] from='osd.6 v2:172.21.15.51:6801/2631527633' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:49:10.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:10 smithi051 bash[18409]: audit 2020-06-27T04:49:10.414777+0000 mon.a (mon.0) 1303 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:49:10.719 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:10 smithi051 podman[43789]: 2020-06-27 04:49:10.356132634 +0000 UTC m=+0.229646370 container create 9a1de4f1139e24215886ef38c934f797a6ccf73767f38b84d94d2beca0c13d44 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:49:10.720 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:10 smithi051 podman[43789]: 2020-06-27 04:49:10.472812397 +0000 UTC m=+0.346326160 container init 9a1de4f1139e24215886ef38c934f797a6ccf73767f38b84d94d2beca0c13d44 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:49:10.720 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:10 smithi051 podman[43789]: 2020-06-27 04:49:10.506169955 +0000 UTC m=+0.379683692 container start 9a1de4f1139e24215886ef38c934f797a6ccf73767f38b84d94d2beca0c13d44 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:49:10.720 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:10 smithi051 podman[43789]: 2020-06-27 04:49:10.506432498 +0000 UTC m=+0.379946253 container attach 9a1de4f1139e24215886ef38c934f797a6ccf73767f38b84d94d2beca0c13d44 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:49:10.926 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:10 smithi031 podman[114673]: 2020-06-27 04:49:10.668551614 +0000 UTC m=+0.952903200 container init 13f4924d673d7c8a7bafdc7ba3e11f7023817b99f24a2ffdc867d39d87ef381a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:49:10.927 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:10 smithi031 podman[114673]: 2020-06-27 04:49:10.743503886 +0000 UTC m=+1.027855468 container start 13f4924d673d7c8a7bafdc7ba3e11f7023817b99f24a2ffdc867d39d87ef381a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:49:10.927 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:10 smithi031 podman[114673]: 2020-06-27 04:49:10.743570217 +0000 UTC m=+1.027921829 container attach 13f4924d673d7c8a7bafdc7ba3e11f7023817b99f24a2ffdc867d39d87ef381a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:49:10.927 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:10 smithi031 podman[114702]: 2020-06-27 04:49:10.876789813 +0000 UTC m=+0.802258787 container create e6be5d9efc18a92cbc9b4440e2f087ee8ed3fb11907a509bc6aed259c0f0c3c5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:49:11.217 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:10 smithi051 bash[43446]: debug 2020-06-27T04:49:10.782+0000 7ffb48ce8f40 -1 Falling back to public interface 2020-06-27T04:49:11.221 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:10 smithi031 podman[114673]: 2020-06-27 04:49:10.92438163 +0000 UTC m=+1.208733249 container died 13f4924d673d7c8a7bafdc7ba3e11f7023817b99f24a2ffdc867d39d87ef381a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:49:11.222 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:11 smithi031 podman[114702]: 2020-06-27 04:49:11.219792145 +0000 UTC m=+1.145261260 container init e6be5d9efc18a92cbc9b4440e2f087ee8ed3fb11907a509bc6aed259c0f0c3c5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:49:11.473 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:11 smithi031 podman[114702]: 2020-06-27 04:49:11.41007736 +0000 UTC m=+1.335546331 container start e6be5d9efc18a92cbc9b4440e2f087ee8ed3fb11907a509bc6aed259c0f0c3c5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:49:11.473 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:11 smithi031 podman[114702]: 2020-06-27 04:49:11.41014623 +0000 UTC m=+1.335615190 container attach e6be5d9efc18a92cbc9b4440e2f087ee8ed3fb11907a509bc6aed259c0f0c3c5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:49:11.782 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:11 smithi031 podman[114673]: 2020-06-27 04:49:11.568397946 +0000 UTC m=+1.852749555 container remove 13f4924d673d7c8a7bafdc7ba3e11f7023817b99f24a2ffdc867d39d87ef381a (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:49:11.783 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:11 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Failed with result 'exit-code'. 2020-06-27T04:49:11.783 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:11 smithi031 podman[114656]: 2020-06-27 04:49:11.530019977 +0000 UTC m=+1.904581259 container init c8eb3388a4798f284d973b48cd8a30f26f986930ddcf2e0c73e93f3dee7ebeb7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:49:11.783 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:11 smithi031 podman[114656]: 2020-06-27 04:49:11.576715211 +0000 UTC m=+1.951276513 container start c8eb3388a4798f284d973b48cd8a30f26f986930ddcf2e0c73e93f3dee7ebeb7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:49:11.783 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:11 smithi031 podman[114656]: 2020-06-27 04:49:11.576800518 +0000 UTC m=+1.951361826 container attach c8eb3388a4798f284d973b48cd8a30f26f986930ddcf2e0c73e93f3dee7ebeb7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:49:11.784 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[18426]: cluster 2020-06-27T04:49:10.462313+0000 mon.a (mon.0) 1304 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:49:11.784 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[18426]: cluster 2020-06-27T04:49:10.462348+0000 mon.a (mon.0) 1305 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:49:11.784 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[18426]: cluster 2020-06-27T04:49:10.469236+0000 mon.a (mon.0) 1306 : cluster [INF] osd.6 v2:172.21.15.51:6801/2631527633 boot 2020-06-27T04:49:11.784 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[18426]: cluster 2020-06-27T04:49:10.469273+0000 mon.a (mon.0) 1307 : cluster [DBG] osdmap e157: 8 total, 3 up, 8 in 2020-06-27T04:49:11.784 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[18426]: audit 2020-06-27T04:49:10.469731+0000 mon.b (mon.2) 336 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:49:11.785 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[18426]: cluster 2020-06-27T04:49:10.490791+0000 mon.a (mon.0) 1308 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:49:11.785 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[18426]: cluster 2020-06-27T04:49:10.490837+0000 mon.a (mon.0) 1309 : cluster [INF] osd.3 failed (root=default,host=smithi031) (connection refused reported by osd.6) 2020-06-27T04:49:11.785 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:11 smithi031 podman[114702]: 2020-06-27 04:49:11.595552333 +0000 UTC m=+1.521021319 container died e6be5d9efc18a92cbc9b4440e2f087ee8ed3fb11907a509bc6aed259c0f0c3c5 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.3-deactivate) 2020-06-27T04:49:11.785 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[22603]: cluster 2020-06-27T04:49:10.462313+0000 mon.a (mon.0) 1304 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:49:11.785 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[22603]: cluster 2020-06-27T04:49:10.462348+0000 mon.a (mon.0) 1305 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:49:11.786 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[22603]: cluster 2020-06-27T04:49:10.469236+0000 mon.a (mon.0) 1306 : cluster [INF] osd.6 v2:172.21.15.51:6801/2631527633 boot 2020-06-27T04:49:11.786 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[22603]: cluster 2020-06-27T04:49:10.469273+0000 mon.a (mon.0) 1307 : cluster [DBG] osdmap e157: 8 total, 3 up, 8 in 2020-06-27T04:49:11.786 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[22603]: audit 2020-06-27T04:49:10.469731+0000 mon.b (mon.2) 336 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:49:11.786 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[22603]: cluster 2020-06-27T04:49:10.490791+0000 mon.a (mon.0) 1308 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:49:11.786 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[22603]: cluster 2020-06-27T04:49:10.490837+0000 mon.a (mon.0) 1309 : cluster [INF] osd.3 failed (root=default,host=smithi031) (connection refused reported by osd.6) 2020-06-27T04:49:11.967 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:11 smithi051 bash[43446]: debug 2020-06-27T04:49:11.503+0000 7ffb48ce8f40 -1 osd.4 148 log_to_monitors {default=true} 2020-06-27T04:49:11.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:11 smithi051 bash[18409]: cluster 2020-06-27T04:49:10.462313+0000 mon.a (mon.0) 1304 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:49:11.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:11 smithi051 bash[18409]: cluster 2020-06-27T04:49:10.462348+0000 mon.a (mon.0) 1305 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:49:11.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:11 smithi051 bash[18409]: cluster 2020-06-27T04:49:10.469236+0000 mon.a (mon.0) 1306 : cluster [INF] osd.6 v2:172.21.15.51:6801/2631527633 boot 2020-06-27T04:49:11.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:11 smithi051 bash[18409]: cluster 2020-06-27T04:49:10.469273+0000 mon.a (mon.0) 1307 : cluster [DBG] osdmap e157: 8 total, 3 up, 8 in 2020-06-27T04:49:11.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:11 smithi051 bash[18409]: audit 2020-06-27T04:49:10.469731+0000 mon.b (mon.2) 336 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-06-27T04:49:11.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:11 smithi051 bash[18409]: cluster 2020-06-27T04:49:10.490791+0000 mon.a (mon.0) 1308 : cluster [DBG] osd.3 reported immediately failed by osd.6 2020-06-27T04:49:11.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:11 smithi051 bash[18409]: cluster 2020-06-27T04:49:10.490837+0000 mon.a (mon.0) 1309 : cluster [INF] osd.3 failed (root=default,host=smithi031) (connection refused reported by osd.6) 2020-06-27T04:49:12.152 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[114654]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-06-27T04:49:12.153 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[114654]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2020-06-27T04:49:12.153 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[114654]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2020-06-27T04:49:12.153 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[114654]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2020-06-27T04:49:12.153 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[114654]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2020-06-27T04:49:12.153 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[114654]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-06-27T04:49:12.154 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:11 smithi031 bash[114654]: --> ceph-volume lvm activate successful for osd ID: 0 2020-06-27T04:49:12.154 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:11 smithi031 podman[114656]: 2020-06-27 04:49:11.915486177 +0000 UTC m=+2.290047502 container died c8eb3388a4798f284d973b48cd8a30f26f986930ddcf2e0c73e93f3dee7ebeb7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:49:12.473 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:12 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2020-06-27T04:49:12.862 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:12 smithi031 podman[114656]: 2020-06-27 04:49:12.509394196 +0000 UTC m=+2.883955488 container remove c8eb3388a4798f284d973b48cd8a30f26f986930ddcf2e0c73e93f3dee7ebeb7 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:49:12.863 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:12 smithi031 bash[114654]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0 found: no such container 2020-06-27T04:49:12.863 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:12 smithi031 bash[114654]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0 2020-06-27T04:49:12.863 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:12 smithi031 bash[114654]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0" found: no such container 2020-06-27T04:49:12.863 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:12 smithi031 bash[22603]: cluster 2020-06-27T04:49:11.255997+0000 mgr.x (mgr.34109) 281 : cluster [DBG] pgmap v352: 777 pgs: 2 creating+down, 53 stale+undersized+degraded+peered, 12 active+undersized+degraded, 2 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 76 down, 71 stale+down, 21 unknown, 35 active+undersized, 65 stale+peering, 14 stale+active+undersized+degraded, 33 undersized+degraded+peered, 190 stale+undersized+peered, 60 stale+active+undersized, 142 undersized+peered; 26 KiB data, 23 MiB used, 707 GiB / 715 GiB avail; 490/1101 objects degraded (44.505%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:12.863 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:12 smithi031 bash[22603]: cluster 2020-06-27T04:49:11.481991+0000 mon.a (mon.0) 1310 : cluster [DBG] osdmap e158: 8 total, 2 up, 8 in 2020-06-27T04:49:12.864 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:12 smithi031 bash[22603]: audit 2020-06-27T04:49:11.511788+0000 mon.a (mon.0) 1311 : audit [INF] from='osd.4 v2:172.21.15.51:6805/589505942' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:49:12.864 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:12 smithi031 bash[22603]: audit 2020-06-27T04:49:11.512514+0000 mon.a (mon.0) 1312 : audit [INF] from='osd.4 v2:172.21.15.51:6805/589505942' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:49:12.864 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:12 smithi031 bash[18426]: cluster 2020-06-27T04:49:11.255997+0000 mgr.x (mgr.34109) 281 : cluster [DBG] pgmap v352: 777 pgs: 2 creating+down, 53 stale+undersized+degraded+peered, 12 active+undersized+degraded, 2 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 76 down, 71 stale+down, 21 unknown, 35 active+undersized, 65 stale+peering, 14 stale+active+undersized+degraded, 33 undersized+degraded+peered, 190 stale+undersized+peered, 60 stale+active+undersized, 142 undersized+peered; 26 KiB data, 23 MiB used, 707 GiB / 715 GiB avail; 490/1101 objects degraded (44.505%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:12.864 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:12 smithi031 bash[18426]: cluster 2020-06-27T04:49:11.481991+0000 mon.a (mon.0) 1310 : cluster [DBG] osdmap e158: 8 total, 2 up, 8 in 2020-06-27T04:49:12.865 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:12 smithi031 bash[18426]: audit 2020-06-27T04:49:11.511788+0000 mon.a (mon.0) 1311 : audit [INF] from='osd.4 v2:172.21.15.51:6805/589505942' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:49:12.865 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:12 smithi031 bash[18426]: audit 2020-06-27T04:49:11.512514+0000 mon.a (mon.0) 1312 : audit [INF] from='osd.4 v2:172.21.15.51:6805/589505942' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:49:12.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:12 smithi051 bash[18409]: cluster 2020-06-27T04:49:11.255997+0000 mgr.x (mgr.34109) 281 : cluster [DBG] pgmap v352: 777 pgs: 2 creating+down, 53 stale+undersized+degraded+peered, 12 active+undersized+degraded, 2 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 76 down, 71 stale+down, 21 unknown, 35 active+undersized, 65 stale+peering, 14 stale+active+undersized+degraded, 33 undersized+degraded+peered, 190 stale+undersized+peered, 60 stale+active+undersized, 142 undersized+peered; 26 KiB data, 23 MiB used, 707 GiB / 715 GiB avail; 490/1101 objects degraded (44.505%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:12.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:12 smithi051 bash[18409]: cluster 2020-06-27T04:49:11.481991+0000 mon.a (mon.0) 1310 : cluster [DBG] osdmap e158: 8 total, 2 up, 8 in 2020-06-27T04:49:12.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:12 smithi051 bash[18409]: audit 2020-06-27T04:49:11.511788+0000 mon.a (mon.0) 1311 : audit [INF] from='osd.4 v2:172.21.15.51:6805/589505942' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-06-27T04:49:12.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:12 smithi051 bash[18409]: audit 2020-06-27T04:49:11.512514+0000 mon.a (mon.0) 1312 : audit [INF] from='osd.4 v2:172.21.15.51:6805/589505942' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:49:13.223 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:12 smithi031 podman[114928]: 2020-06-27 04:49:12.859786972 +0000 UTC m=+0.242437601 container create 43c6d0503d9cd22868bd284fce9218e95910ec57f13e52618645b6829de0b9bc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:49:13.224 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 podman[114928]: 2020-06-27 04:49:13.009884278 +0000 UTC m=+0.392534979 container init 43c6d0503d9cd22868bd284fce9218e95910ec57f13e52618645b6829de0b9bc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:49:13.224 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 podman[114928]: 2020-06-27 04:49:13.051549007 +0000 UTC m=+0.434199712 container start 43c6d0503d9cd22868bd284fce9218e95910ec57f13e52618645b6829de0b9bc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:49:13.224 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 podman[114928]: 2020-06-27 04:49:13.051700738 +0000 UTC m=+0.434351510 container attach 43c6d0503d9cd22868bd284fce9218e95910ec57f13e52618645b6829de0b9bc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:49:13.224 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 1 -- 172.21.15.31:0/3210270052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cfb04b4c00 msgr2=0x55cfb0425400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-27T04:49:13.224 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 1 --2- 172.21.15.31:0/3210270052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cfb04b4c00 0x55cfb0425400 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 rx=0x55cfb0437a70 tx=0x55cfb0404c00).stop 2020-06-27T04:49:13.225 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 5 --2- 172.21.15.31:0/3210270052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cfb04b4c00 0x55cfb0425400 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 rx=0x55cfb0437a70 tx=0x55cfb0404c00).reset_recv_state 2020-06-27T04:49:13.225 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 20 Event(0x55cfb0449040 nevent=5000 time_id=3).wakeup 2020-06-27T04:49:13.225 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 10 --2- 172.21.15.31:0/3210270052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cfb04b4c00 0x55cfb0425400 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 rx=0x55cfb0437a70 tx=0x55cfb0404c00).discard_out_queue started 2020-06-27T04:49:13.225 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f40364f2700 20 -- 172.21.15.31:0/3210270052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cfb04b4c00 msgr2=0x55cfb0425400 secure :-1 s=STATE_CLOSED l=1).process 2020-06-27T04:49:13.225 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f40364f2700 20 -- 172.21.15.31:0/3210270052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cfb04b4c00 msgr2=0x55cfb0425400 secure :-1 s=STATE_CLOSED l=1).process socket closed 2020-06-27T04:49:13.226 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f40364f2700 5 --2- 172.21.15.31:0/3210270052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cfb04b4c00 0x55cfb0425400 secure :-1 s=CLOSED pgs=2508 cs=0 l=1 rev1=1 rx=0x55cfb0437a70 tx=0x55cfb0404c00).reset_recv_state (warped) reseting crypto handlers 2020-06-27T04:49:13.226 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f40364f2700 5 --2- 172.21.15.31:0/3210270052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cfb04b4c00 0x55cfb0425400 secure :-1 s=CLOSED pgs=2508 cs=0 l=1 rev1=1 rx=0x55cfb0437a70 tx=0x55cfb0404c00).reset_security 2020-06-27T04:49:13.226 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f40364f2700 20 EpollDriver.del_event del event fd=14 cur_mask=1 delmask=3 to 8 2020-06-27T04:49:13.226 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 10 -- 172.21.15.31:0/3210270052 shutdown 172.21.15.31:0/3210270052 2020-06-27T04:49:13.226 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 10 Processor -- stop 2020-06-27T04:49:13.227 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 20 Event(0x55cfb0448e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:13.227 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 1 -- 172.21.15.31:0/3210270052 shutdown_connections 2020-06-27T04:49:13.227 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 5 -- 172.21.15.31:0/3210270052 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55cfb04b5400 2020-06-27T04:49:13.227 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 1 --2- 172.21.15.31:0/3210270052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfb04b5400 0x55cfb0426300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:49:13.228 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 5 -- 172.21.15.31:0/3210270052 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55cfb04b4c00 2020-06-27T04:49:13.228 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 1 --2- 172.21.15.31:0/3210270052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cfb04b4c00 0x55cfb0425400 unknown :-1 s=CLOSED pgs=2508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:49:13.228 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 5 -- 172.21.15.31:0/3210270052 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55cfb04b5000 2020-06-27T04:49:13.228 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 1 --2- 172.21.15.31:0/3210270052 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55cfb04b5000 0x55cfb0425e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:49:13.228 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 5 -- 172.21.15.31:0/3210270052 shutdown_connections delete 0x55cfb04b4c00 2020-06-27T04:49:13.229 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 5 -- 172.21.15.31:0/3210270052 shutdown_connections delete 0x55cfb04b5000 2020-06-27T04:49:13.229 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 5 -- 172.21.15.31:0/3210270052 shutdown_connections delete 0x55cfb04b5400 2020-06-27T04:49:13.229 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 1 -- 172.21.15.31:0/3210270052 >> 172.21.15.31:0/3210270052 conn(0x55cfb04b4800 msgr2=0x55cfb051d000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:49:13.229 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 20 --1- 172.21.15.31:0/3210270052 >> 172.21.15.31:0/3210270052 conn(0x55cfb04b4800 0x55cfb051d000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:49:13.229 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 2 --1- 172.21.15.31:0/3210270052 >> 172.21.15.31:0/3210270052 conn(0x55cfb04b4800 0x55cfb051d000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:49:13.230 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 5 --1- 172.21.15.31:0/3210270052 >> 172.21.15.31:0/3210270052 conn(0x55cfb04b4800 0x55cfb051d000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:49:13.230 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 20 Event(0x55cfb0448e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:13.230 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 10 --1- 172.21.15.31:0/3210270052 >> 172.21.15.31:0/3210270052 conn(0x55cfb04b4800 0x55cfb051d000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:49:13.230 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 20 Event(0x55cfb0449040 nevent=5000 time_id=3).wakeup 2020-06-27T04:49:13.230 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 20 Event(0x55cfb0449280 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:13.231 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f4036cf3700 5 --1- 172.21.15.31:0/3210270052 >> 172.21.15.31:0/3210270052 conn(0x55cfb04b4800 0x55cfb051d000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:49:13.231 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f4036cf3700 5 --1- 172.21.15.31:0/3210270052 >> 172.21.15.31:0/3210270052 conn(0x55cfb04b4800 0x55cfb051d000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:49:13.231 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 10 -- 172.21.15.31:0/3210270052 wait: waiting for dispatch queue 2020-06-27T04:49:13.231 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 10 -- 172.21.15.31:0/3210270052 wait: dispatch queue is stopped 2020-06-27T04:49:13.231 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 1 -- 172.21.15.31:0/3210270052 shutdown_connections 2020-06-27T04:49:13.232 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 5 -- 172.21.15.31:0/3210270052 shutdown_connections delete 0x55cfb04b4800 2020-06-27T04:49:13.232 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 20 Event(0x55cfb0448e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:13.232 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 20 Event(0x55cfb0449040 nevent=5000 time_id=3).wakeup 2020-06-27T04:49:13.232 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.032+0000 7f403cf70f40 20 Event(0x55cfb0449280 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:13.232 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.033+0000 7f403cf70f40 10 -- 172.21.15.31:0/3210270052 wait: done. 2020-06-27T04:49:13.233 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.033+0000 7f403cf70f40 1 -- 172.21.15.31:0/3210270052 wait complete. 2020-06-27T04:49:13.763 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[18409]: cluster 2020-06-27T04:49:12.487057+0000 mon.a (mon.0) 1313 : cluster [INF] osd.4 v2:172.21.15.51:6805/589505942 boot 2020-06-27T04:49:13.763 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[18409]: cluster 2020-06-27T04:49:12.487104+0000 mon.a (mon.0) 1314 : cluster [DBG] osdmap e159: 8 total, 3 up, 8 in 2020-06-27T04:49:13.763 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[18409]: audit 2020-06-27T04:49:12.487166+0000 mon.b (mon.2) 337 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:49:13.763 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[18409]: cluster 2020-06-27T04:49:12.519809+0000 mon.a (mon.0) 1315 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:49:13.764 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[18409]: cluster 2020-06-27T04:49:12.519847+0000 mon.a (mon.0) 1316 : cluster [INF] osd.2 failed (root=default,host=smithi031) (connection refused reported by osd.4) 2020-06-27T04:49:13.764 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:13.764 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: in thread 7ffb1bc4a700 thread_name:tp_osd_tp 2020-06-27T04:49:13.764 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:13.765 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 1: (()+0x12dd0) [0x7ffb46a5bdd0] 2020-06-27T04:49:13.765 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x560ade2ea707] 2020-06-27T04:49:13.765 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x560ade2eaaa0] 2020-06-27T04:49:13.765 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x560ade31c67a] 2020-06-27T04:49:13.765 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x560ade31da57] 2020-06-27T04:49:13.766 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x560addfa8938] 2020-06-27T04:49:13.766 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x560ade15ca70] 2020-06-27T04:49:13.766 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x560ade16cdd7] 2020-06-27T04:49:13.766 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x560addfdb252] 2020-06-27T04:49:13.766 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x560addf7ee2e] 2020-06-27T04:49:13.767 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x560adddff4e9] 2020-06-27T04:49:13.767 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x560ade063f78] 2020-06-27T04:49:13.767 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x560adde1e70f] 2020-06-27T04:49:13.767 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x560ade45cb94] 2020-06-27T04:49:13.767 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x560ade45f7f4] 2020-06-27T04:49:13.768 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 16: (()+0x82de) [0x7ffb46a512de] 2020-06-27T04:49:13.768 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 17: (clone()+0x43) [0x7ffb45788e83] 2020-06-27T04:49:13.768 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: debug 2020-06-27T04:49:13.615+0000 7ffb1bc4a700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:13.768 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: in thread 7ffb1bc4a700 thread_name:tp_osd_tp 2020-06-27T04:49:13.768 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:13.769 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 1: (()+0x12dd0) [0x7ffb46a5bdd0] 2020-06-27T04:49:13.769 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x560ade2ea707] 2020-06-27T04:49:13.769 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x560ade2eaaa0] 2020-06-27T04:49:13.769 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x560ade31c67a] 2020-06-27T04:49:13.770 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x560ade31da57] 2020-06-27T04:49:13.770 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x560addfa8938] 2020-06-27T04:49:13.770 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x560ade15ca70] 2020-06-27T04:49:13.770 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x560ade16cdd7] 2020-06-27T04:49:13.770 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x560addfdb252] 2020-06-27T04:49:13.771 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x560addf7ee2e] 2020-06-27T04:49:13.772 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x560adddff4e9] 2020-06-27T04:49:13.772 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x560ade063f78] 2020-06-27T04:49:13.772 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x560adde1e70f] 2020-06-27T04:49:13.772 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x560ade45cb94] 2020-06-27T04:49:13.773 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x560ade45f7f4] 2020-06-27T04:49:13.773 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 16: (()+0x82de) [0x7ffb46a512de] 2020-06-27T04:49:13.773 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 17: (clone()+0x43) [0x7ffb45788e83] 2020-06-27T04:49:13.773 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:49:13.773 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: debug -9999> 2020-06-27T04:49:13.615+0000 7ffb1bc4a700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:13.774 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: in thread 7ffb1bc4a700 thread_name:tp_osd_tp 2020-06-27T04:49:13.774 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:13.774 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 1: (()+0x12dd0) [0x7ffb46a5bdd0] 2020-06-27T04:49:13.774 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x560ade2ea707] 2020-06-27T04:49:13.774 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x560ade2eaaa0] 2020-06-27T04:49:13.783 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x560ade31c67a] 2020-06-27T04:49:13.784 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x560ade31da57] 2020-06-27T04:49:13.784 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x560addfa8938] 2020-06-27T04:49:13.784 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x560ade15ca70] 2020-06-27T04:49:13.784 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x560ade16cdd7] 2020-06-27T04:49:13.784 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x560addfdb252] 2020-06-27T04:49:13.785 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x560addf7ee2e] 2020-06-27T04:49:13.785 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x560adddff4e9] 2020-06-27T04:49:13.785 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x560ade063f78] 2020-06-27T04:49:13.785 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x560adde1e70f] 2020-06-27T04:49:13.786 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x560ade45cb94] 2020-06-27T04:49:13.786 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x560ade45f7f4] 2020-06-27T04:49:13.786 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 16: (()+0x82de) [0x7ffb46a512de] 2020-06-27T04:49:13.786 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 17: (clone()+0x43) [0x7ffb45788e83] 2020-06-27T04:49:13.786 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:49:13.787 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: debug -9999> 2020-06-27T04:49:13.615+0000 7ffb1bc4a700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:13.787 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: in thread 7ffb1bc4a700 thread_name:tp_osd_tp 2020-06-27T04:49:13.787 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:13.787 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 1: (()+0x12dd0) [0x7ffb46a5bdd0] 2020-06-27T04:49:13.788 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x560ade2ea707] 2020-06-27T04:49:13.788 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x560ade2eaaa0] 2020-06-27T04:49:13.788 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x560ade31c67a] 2020-06-27T04:49:13.788 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x560ade31da57] 2020-06-27T04:49:13.788 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x560addfa8938] 2020-06-27T04:49:13.789 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x560ade15ca70] 2020-06-27T04:49:13.789 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x560ade16cdd7] 2020-06-27T04:49:13.789 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x560addfdb252] 2020-06-27T04:49:13.789 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x560addf7ee2e] 2020-06-27T04:49:13.789 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x560adddff4e9] 2020-06-27T04:49:13.790 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x560ade063f78] 2020-06-27T04:49:13.790 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x560adde1e70f] 2020-06-27T04:49:13.790 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x560ade45cb94] 2020-06-27T04:49:13.790 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x560ade45f7f4] 2020-06-27T04:49:13.790 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 16: (()+0x82de) [0x7ffb46a512de] 2020-06-27T04:49:13.791 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: 17: (clone()+0x43) [0x7ffb45788e83] 2020-06-27T04:49:13.791 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:49:13.791 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43446]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:49:13.791 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:13 smithi051 podman[43789]: 2020-06-27 04:49:13.759695813 +0000 UTC m=+3.633209573 container died 9a1de4f1139e24215886ef38c934f797a6ccf73767f38b84d94d2beca0c13d44 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:49:13.791 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:13.792 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: in thread 7f24d23dd700 thread_name:tp_osd_tp 2020-06-27T04:49:13.792 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:13.792 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 1: (()+0x12dd0) [0x7f24fd1eedd0] 2020-06-27T04:49:13.792 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5579a0eff707] 2020-06-27T04:49:13.793 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5579a0effaa0] 2020-06-27T04:49:13.793 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5579a0f3167a] 2020-06-27T04:49:13.793 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5579a0f32a57] 2020-06-27T04:49:13.793 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5579a0bbd938] 2020-06-27T04:49:13.793 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5579a0d6e03d] 2020-06-27T04:49:13.794 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5579a0b2b5b0] 2020-06-27T04:49:13.794 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5579a0b8489d] 2020-06-27T04:49:13.794 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5579a0b8d380] 2020-06-27T04:49:13.794 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5579a0b94590] 2020-06-27T04:49:13.794 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5579a0a144e9] 2020-06-27T04:49:13.795 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5579a0c78f78] 2020-06-27T04:49:13.795 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5579a0a3370f] 2020-06-27T04:49:13.795 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5579a1071b94] 2020-06-27T04:49:13.795 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5579a10747f4] 2020-06-27T04:49:13.795 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 17: (()+0x82de) [0x7f24fd1e42de] 2020-06-27T04:49:13.796 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 18: (clone()+0x43) [0x7f24fbf1be83] 2020-06-27T04:49:13.796 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: debug 2020-06-27T04:49:13.586+0000 7f24d23dd700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:13.796 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: in thread 7f24d23dd700 thread_name:tp_osd_tp 2020-06-27T04:49:13.796 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:13.796 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 1: (()+0x12dd0) [0x7f24fd1eedd0] 2020-06-27T04:49:13.797 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5579a0eff707] 2020-06-27T04:49:13.797 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5579a0effaa0] 2020-06-27T04:49:13.797 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5579a0f3167a] 2020-06-27T04:49:13.797 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5579a0f32a57] 2020-06-27T04:49:13.797 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5579a0bbd938] 2020-06-27T04:49:13.798 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5579a0d6e03d] 2020-06-27T04:49:13.798 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5579a0b2b5b0] 2020-06-27T04:49:13.798 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5579a0b8489d] 2020-06-27T04:49:13.798 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5579a0b8d380] 2020-06-27T04:49:13.798 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5579a0b94590] 2020-06-27T04:49:13.799 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5579a0a144e9] 2020-06-27T04:49:13.799 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5579a0c78f78] 2020-06-27T04:49:13.799 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5579a0a3370f] 2020-06-27T04:49:13.799 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5579a1071b94] 2020-06-27T04:49:13.799 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5579a10747f4] 2020-06-27T04:49:13.800 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 17: (()+0x82de) [0x7f24fd1e42de] 2020-06-27T04:49:13.800 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 18: (clone()+0x43) [0x7f24fbf1be83] 2020-06-27T04:49:13.800 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:49:13.800 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: debug -9999> 2020-06-27T04:49:13.586+0000 7f24d23dd700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:13.800 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: in thread 7f24d23dd700 thread_name:tp_osd_tp 2020-06-27T04:49:13.800 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:13.801 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 1: (()+0x12dd0) [0x7f24fd1eedd0] 2020-06-27T04:49:13.801 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5579a0eff707] 2020-06-27T04:49:13.801 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5579a0effaa0] 2020-06-27T04:49:13.801 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5579a0f3167a] 2020-06-27T04:49:13.802 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5579a0f32a57] 2020-06-27T04:49:13.802 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5579a0bbd938] 2020-06-27T04:49:13.802 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5579a0d6e03d] 2020-06-27T04:49:13.802 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5579a0b2b5b0] 2020-06-27T04:49:13.802 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5579a0b8489d] 2020-06-27T04:49:13.803 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5579a0b8d380] 2020-06-27T04:49:13.803 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5579a0b94590] 2020-06-27T04:49:13.803 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5579a0a144e9] 2020-06-27T04:49:13.803 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5579a0c78f78] 2020-06-27T04:49:13.803 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5579a0a3370f] 2020-06-27T04:49:13.804 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5579a1071b94] 2020-06-27T04:49:13.804 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5579a10747f4] 2020-06-27T04:49:13.804 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 17: (()+0x82de) [0x7f24fd1e42de] 2020-06-27T04:49:13.804 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 18: (clone()+0x43) [0x7f24fbf1be83] 2020-06-27T04:49:13.804 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:49:13.805 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: debug -9999> 2020-06-27T04:49:13.586+0000 7f24d23dd700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:49:13.805 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: in thread 7f24d23dd700 thread_name:tp_osd_tp 2020-06-27T04:49:13.805 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:49:13.805 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 1: (()+0x12dd0) [0x7f24fd1eedd0] 2020-06-27T04:49:13.805 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5579a0eff707] 2020-06-27T04:49:13.806 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x5579a0effaa0] 2020-06-27T04:49:13.806 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x5579a0f3167a] 2020-06-27T04:49:13.806 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5579a0f32a57] 2020-06-27T04:49:13.806 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5579a0bbd938] 2020-06-27T04:49:13.806 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x5579a0d6e03d] 2020-06-27T04:49:13.807 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x5579a0b2b5b0] 2020-06-27T04:49:13.807 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x5579a0b8489d] 2020-06-27T04:49:13.807 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x5579a0b8d380] 2020-06-27T04:49:13.807 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x5579a0b94590] 2020-06-27T04:49:13.807 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5579a0a144e9] 2020-06-27T04:49:13.808 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5579a0c78f78] 2020-06-27T04:49:13.809 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5579a0a3370f] 2020-06-27T04:49:13.809 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5579a1071b94] 2020-06-27T04:49:13.809 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5579a10747f4] 2020-06-27T04:49:13.809 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 17: (()+0x82de) [0x7f24fd1e42de] 2020-06-27T04:49:13.810 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: 18: (clone()+0x43) [0x7f24fbf1be83] 2020-06-27T04:49:13.810 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:49:13.810 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 bash[43244]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:49:13.810 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:13 smithi051 podman[43443]: 2020-06-27 04:49:13.663695957 +0000 UTC m=+5.396618396 container died 8d2c202f6a753c7d5772b12881bff7a4bc3f6169923a3d76d69233a79d80a05e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:49:13.973 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[114654]: debug 2020-06-27T04:49:13.553+0000 7f403cf70f40 -1 Falling back to public interface 2020-06-27T04:49:13.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[18426]: cluster 2020-06-27T04:49:12.487057+0000 mon.a (mon.0) 1313 : cluster [INF] osd.4 v2:172.21.15.51:6805/589505942 boot 2020-06-27T04:49:13.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[18426]: cluster 2020-06-27T04:49:12.487104+0000 mon.a (mon.0) 1314 : cluster [DBG] osdmap e159: 8 total, 3 up, 8 in 2020-06-27T04:49:13.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[18426]: audit 2020-06-27T04:49:12.487166+0000 mon.b (mon.2) 337 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:49:13.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[18426]: cluster 2020-06-27T04:49:12.519809+0000 mon.a (mon.0) 1315 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:49:13.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[18426]: cluster 2020-06-27T04:49:12.519847+0000 mon.a (mon.0) 1316 : cluster [INF] osd.2 failed (root=default,host=smithi031) (connection refused reported by osd.4) 2020-06-27T04:49:13.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[22603]: cluster 2020-06-27T04:49:12.487057+0000 mon.a (mon.0) 1313 : cluster [INF] osd.4 v2:172.21.15.51:6805/589505942 boot 2020-06-27T04:49:13.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[22603]: cluster 2020-06-27T04:49:12.487104+0000 mon.a (mon.0) 1314 : cluster [DBG] osdmap e159: 8 total, 3 up, 8 in 2020-06-27T04:49:13.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[22603]: audit 2020-06-27T04:49:12.487166+0000 mon.b (mon.2) 337 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-06-27T04:49:13.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[22603]: cluster 2020-06-27T04:49:12.519809+0000 mon.a (mon.0) 1315 : cluster [DBG] osd.2 reported immediately failed by osd.4 2020-06-27T04:49:13.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:13 smithi031 bash[22603]: cluster 2020-06-27T04:49:12.519847+0000 mon.a (mon.0) 1316 : cluster [INF] osd.2 failed (root=default,host=smithi031) (connection refused reported by osd.4) 2020-06-27T04:49:14.467 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:14 smithi051 podman[43443]: 2020-06-27 04:49:14.197006719 +0000 UTC m=+5.929929124 container remove 8d2c202f6a753c7d5772b12881bff7a4bc3f6169923a3d76d69233a79d80a05e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6) 2020-06-27T04:49:14.468 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:14 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:49:14.723 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[114654]: debug 2020-06-27T04:49:14.297+0000 7f403cf70f40 -1 osd.0 148 log_to_monitors {default=true} 2020-06-27T04:49:14.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[18426]: cluster 2020-06-27T04:49:13.257295+0000 mgr.x (mgr.34109) 282 : cluster [DBG] pgmap v355: 777 pgs: 19 peering, 3 creating+down, 53 stale+undersized+degraded+peered, 12 active+undersized+degraded, 3 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 54 down, 86 stale+down, 19 unknown, 35 active+undersized, 65 stale+peering, 14 stale+active+undersized+degraded, 30 undersized+degraded+peered, 171 stale+undersized+peered, 60 stale+active+undersized, 152 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 482/1101 objects degraded (43.778%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:14.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[18426]: cluster 2020-06-27T04:49:13.492811+0000 mon.a (mon.0) 1317 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:49:14.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[18426]: cluster 2020-06-27T04:49:13.503434+0000 mon.a (mon.0) 1318 : cluster [DBG] osdmap e160: 8 total, 2 up, 8 in 2020-06-27T04:49:14.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[18426]: audit 2020-06-27T04:49:14.302227+0000 mon.c (mon.1) 84 : audit [INF] from='osd.0 v2:172.21.15.31:6800/1338716515' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:49:14.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[18426]: audit 2020-06-27T04:49:14.302463+0000 mon.a (mon.0) 1319 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:49:14.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[18426]: audit 2020-06-27T04:49:14.302934+0000 mon.c (mon.1) 85 : audit [INF] from='osd.0 v2:172.21.15.31:6800/1338716515' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:49:14.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[18426]: audit 2020-06-27T04:49:14.303166+0000 mon.a (mon.0) 1320 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:49:14.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[18426]: cluster 2020-06-27T04:49:14.392731+0000 mon.a (mon.0) 1321 : cluster [WRN] Health check update: Reduced data availability: 146 pgs inactive, 146 pgs down (PG_AVAILABILITY) 2020-06-27T04:49:14.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[18426]: cluster 2020-06-27T04:49:14.392795+0000 mon.a (mon.0) 1322 : cluster [WRN] Health check update: Degraded data redundancy: 482/1101 objects degraded (43.778%), 110 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:14.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[22603]: cluster 2020-06-27T04:49:13.257295+0000 mgr.x (mgr.34109) 282 : cluster [DBG] pgmap v355: 777 pgs: 19 peering, 3 creating+down, 53 stale+undersized+degraded+peered, 12 active+undersized+degraded, 3 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 54 down, 86 stale+down, 19 unknown, 35 active+undersized, 65 stale+peering, 14 stale+active+undersized+degraded, 30 undersized+degraded+peered, 171 stale+undersized+peered, 60 stale+active+undersized, 152 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 482/1101 objects degraded (43.778%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:14.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[22603]: cluster 2020-06-27T04:49:13.492811+0000 mon.a (mon.0) 1317 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:49:14.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[22603]: cluster 2020-06-27T04:49:13.503434+0000 mon.a (mon.0) 1318 : cluster [DBG] osdmap e160: 8 total, 2 up, 8 in 2020-06-27T04:49:14.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[22603]: audit 2020-06-27T04:49:14.302227+0000 mon.c (mon.1) 84 : audit [INF] from='osd.0 v2:172.21.15.31:6800/1338716515' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:49:14.729 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[22603]: audit 2020-06-27T04:49:14.302463+0000 mon.a (mon.0) 1319 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:49:14.729 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[22603]: audit 2020-06-27T04:49:14.302934+0000 mon.c (mon.1) 85 : audit [INF] from='osd.0 v2:172.21.15.31:6800/1338716515' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:49:14.733 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[22603]: audit 2020-06-27T04:49:14.303166+0000 mon.a (mon.0) 1320 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:49:14.733 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[22603]: cluster 2020-06-27T04:49:14.392731+0000 mon.a (mon.0) 1321 : cluster [WRN] Health check update: Reduced data availability: 146 pgs inactive, 146 pgs down (PG_AVAILABILITY) 2020-06-27T04:49:14.733 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:14 smithi031 bash[22603]: cluster 2020-06-27T04:49:14.392795+0000 mon.a (mon.0) 1322 : cluster [WRN] Health check update: Degraded data redundancy: 482/1101 objects degraded (43.778%), 110 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:14.854 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:14 smithi051 bash[18409]: cluster 2020-06-27T04:49:13.257295+0000 mgr.x (mgr.34109) 282 : cluster [DBG] pgmap v355: 777 pgs: 19 peering, 3 creating+down, 53 stale+undersized+degraded+peered, 12 active+undersized+degraded, 3 stale+creating+down, 1 recovery_unfound+undersized+degraded+peered, 54 down, 86 stale+down, 19 unknown, 35 active+undersized, 65 stale+peering, 14 stale+active+undersized+degraded, 30 undersized+degraded+peered, 171 stale+undersized+peered, 60 stale+active+undersized, 152 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 482/1101 objects degraded (43.778%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:14.855 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:14 smithi051 bash[18409]: cluster 2020-06-27T04:49:13.492811+0000 mon.a (mon.0) 1317 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:49:14.855 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:14 smithi051 bash[18409]: cluster 2020-06-27T04:49:13.503434+0000 mon.a (mon.0) 1318 : cluster [DBG] osdmap e160: 8 total, 2 up, 8 in 2020-06-27T04:49:14.855 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:14 smithi051 bash[18409]: audit 2020-06-27T04:49:14.302227+0000 mon.c (mon.1) 84 : audit [INF] from='osd.0 v2:172.21.15.31:6800/1338716515' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:49:14.855 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:14 smithi051 bash[18409]: audit 2020-06-27T04:49:14.302463+0000 mon.a (mon.0) 1319 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:49:14.856 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:14 smithi051 bash[18409]: audit 2020-06-27T04:49:14.302934+0000 mon.c (mon.1) 85 : audit [INF] from='osd.0 v2:172.21.15.31:6800/1338716515' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:49:14.856 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:14 smithi051 bash[18409]: audit 2020-06-27T04:49:14.303166+0000 mon.a (mon.0) 1320 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:49:14.856 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:14 smithi051 bash[18409]: cluster 2020-06-27T04:49:14.392731+0000 mon.a (mon.0) 1321 : cluster [WRN] Health check update: Reduced data availability: 146 pgs inactive, 146 pgs down (PG_AVAILABILITY) 2020-06-27T04:49:14.856 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:14 smithi051 bash[18409]: cluster 2020-06-27T04:49:14.392795+0000 mon.a (mon.0) 1322 : cluster [WRN] Health check update: Degraded data redundancy: 482/1101 objects degraded (43.778%), 110 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:14.856 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:14 smithi051 podman[43789]: 2020-06-27 04:49:14.506966807 +0000 UTC m=+4.380480540 container remove 9a1de4f1139e24215886ef38c934f797a6ccf73767f38b84d94d2beca0c13d44 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4) 2020-06-27T04:49:14.857 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:14 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:49:14.857 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:14 smithi051 podman[44397]: 2020-06-27 04:49:14.706516865 +0000 UTC m=+0.487221945 container create 0eac59ff44c810ad78211b679836489811017f358f86dedd1757edc44580a2a4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:49:15.166 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:14 smithi051 podman[44419]: 2020-06-27 04:49:14.905487545 +0000 UTC m=+0.380598174 container create 898007d6d893d83a4a5822cf6e2f0373bdee3c579c37a702f2d24af226001823 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:49:15.166 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:15 smithi051 podman[44419]: 2020-06-27 04:49:15.046983445 +0000 UTC m=+0.522094094 container init 898007d6d893d83a4a5822cf6e2f0373bdee3c579c37a702f2d24af226001823 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:49:15.166 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:15 smithi051 podman[44419]: 2020-06-27 04:49:15.088733825 +0000 UTC m=+0.563844460 container start 898007d6d893d83a4a5822cf6e2f0373bdee3c579c37a702f2d24af226001823 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:49:15.166 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:15 smithi051 podman[44419]: 2020-06-27 04:49:15.088806144 +0000 UTC m=+0.563916775 container attach 898007d6d893d83a4a5822cf6e2f0373bdee3c579c37a702f2d24af226001823 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:49:15.167 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:14 smithi051 podman[44397]: 2020-06-27 04:49:14.98046615 +0000 UTC m=+0.761171123 container init 0eac59ff44c810ad78211b679836489811017f358f86dedd1757edc44580a2a4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:49:15.468 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:15 smithi051 podman[44419]: 2020-06-27 04:49:15.315702797 +0000 UTC m=+0.790813463 container died 898007d6d893d83a4a5822cf6e2f0373bdee3c579c37a702f2d24af226001823 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:49:15.468 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:15 smithi051 podman[44397]: 2020-06-27 04:49:15.163764494 +0000 UTC m=+0.944469469 container start 0eac59ff44c810ad78211b679836489811017f358f86dedd1757edc44580a2a4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:49:15.468 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:15 smithi051 podman[44397]: 2020-06-27 04:49:15.163856173 +0000 UTC m=+0.944561160 container attach 0eac59ff44c810ad78211b679836489811017f358f86dedd1757edc44580a2a4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:49:15.468 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:15 smithi051 podman[44397]: 2020-06-27 04:49:15.26462972 +0000 UTC m=+1.045334712 container died 0eac59ff44c810ad78211b679836489811017f358f86dedd1757edc44580a2a4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:49:15.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:15 smithi051 podman[44397]: 2020-06-27 04:49:15.730557483 +0000 UTC m=+1.511262472 container remove 0eac59ff44c810ad78211b679836489811017f358f86dedd1757edc44580a2a4 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.6-deactivate) 2020-06-27T04:49:15.968 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:15 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2020-06-27T04:49:15.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:15 smithi051 bash[18409]: cluster 2020-06-27T04:49:14.499193+0000 mon.a (mon.0) 1323 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:49:15.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:15 smithi051 bash[18409]: audit 2020-06-27T04:49:14.508207+0000 mon.b (mon.2) 338 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:49:15.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:15 smithi051 bash[18409]: cluster 2020-06-27T04:49:14.510681+0000 mon.a (mon.0) 1324 : cluster [INF] osd.0 v2:172.21.15.31:6800/1338716515 boot 2020-06-27T04:49:15.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:15 smithi051 bash[18409]: cluster 2020-06-27T04:49:14.510721+0000 mon.a (mon.0) 1325 : cluster [DBG] osdmap e161: 8 total, 3 up, 8 in 2020-06-27T04:49:15.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:15 smithi051 bash[18409]: cluster 2020-06-27T04:49:14.535178+0000 mon.a (mon.0) 1326 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:49:15.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:15 smithi051 bash[18409]: cluster 2020-06-27T04:49:14.535213+0000 mon.a (mon.0) 1327 : cluster [INF] osd.6 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:49:15.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:15 smithi031 bash[18426]: cluster 2020-06-27T04:49:14.499193+0000 mon.a (mon.0) 1323 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:49:15.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:15 smithi031 bash[18426]: audit 2020-06-27T04:49:14.508207+0000 mon.b (mon.2) 338 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:49:15.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:15 smithi031 bash[18426]: cluster 2020-06-27T04:49:14.510681+0000 mon.a (mon.0) 1324 : cluster [INF] osd.0 v2:172.21.15.31:6800/1338716515 boot 2020-06-27T04:49:15.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:15 smithi031 bash[18426]: cluster 2020-06-27T04:49:14.510721+0000 mon.a (mon.0) 1325 : cluster [DBG] osdmap e161: 8 total, 3 up, 8 in 2020-06-27T04:49:15.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:15 smithi031 bash[18426]: cluster 2020-06-27T04:49:14.535178+0000 mon.a (mon.0) 1326 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:49:15.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:15 smithi031 bash[18426]: cluster 2020-06-27T04:49:14.535213+0000 mon.a (mon.0) 1327 : cluster [INF] osd.6 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:49:15.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:15 smithi031 bash[22603]: cluster 2020-06-27T04:49:14.499193+0000 mon.a (mon.0) 1323 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:49:15.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:15 smithi031 bash[22603]: audit 2020-06-27T04:49:14.508207+0000 mon.b (mon.2) 338 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:49:15.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:15 smithi031 bash[22603]: cluster 2020-06-27T04:49:14.510681+0000 mon.a (mon.0) 1324 : cluster [INF] osd.0 v2:172.21.15.31:6800/1338716515 boot 2020-06-27T04:49:15.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:15 smithi031 bash[22603]: cluster 2020-06-27T04:49:14.510721+0000 mon.a (mon.0) 1325 : cluster [DBG] osdmap e161: 8 total, 3 up, 8 in 2020-06-27T04:49:15.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:15 smithi031 bash[22603]: cluster 2020-06-27T04:49:14.535178+0000 mon.a (mon.0) 1326 : cluster [DBG] osd.6 reported immediately failed by osd.0 2020-06-27T04:49:15.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:15 smithi031 bash[22603]: cluster 2020-06-27T04:49:14.535213+0000 mon.a (mon.0) 1327 : cluster [INF] osd.6 failed (root=default,host=smithi051) (connection refused reported by osd.0) 2020-06-27T04:49:16.468 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:16 smithi051 podman[44419]: 2020-06-27 04:49:16.057090732 +0000 UTC m=+1.532201419 container remove 898007d6d893d83a4a5822cf6e2f0373bdee3c579c37a702f2d24af226001823 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.4-deactivate) 2020-06-27T04:49:16.468 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:16 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Failed with result 'exit-code'. 2020-06-27T04:49:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:16 smithi051 bash[18409]: cluster 2020-06-27T04:49:15.258495+0000 mgr.x (mgr.34109) 283 : cluster [DBG] pgmap v358: 777 pgs: 1 stale+recovery_unfound+undersized+degraded+peered, 19 peering, 5 creating+down, 82 stale+undersized+degraded+peered, 1 stale+creating+down, 61 down, 79 stale+down, 19 unknown, 65 stale+peering, 1 undersized+degraded+peered, 26 stale+active+undersized+degraded, 296 stale+undersized+peered, 95 stale+active+undersized, 27 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 482/1101 objects degraded (43.778%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:16 smithi051 bash[18409]: cluster 2020-06-27T04:49:15.515993+0000 mon.a (mon.0) 1328 : cluster [WRN] Health check update: 6 osds down (OSD_DOWN) 2020-06-27T04:49:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:16 smithi051 bash[18409]: cluster 2020-06-27T04:49:15.525369+0000 mon.a (mon.0) 1329 : cluster [DBG] osdmap e162: 8 total, 2 up, 8 in 2020-06-27T04:49:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:16 smithi031 bash[18426]: cluster 2020-06-27T04:49:15.258495+0000 mgr.x (mgr.34109) 283 : cluster [DBG] pgmap v358: 777 pgs: 1 stale+recovery_unfound+undersized+degraded+peered, 19 peering, 5 creating+down, 82 stale+undersized+degraded+peered, 1 stale+creating+down, 61 down, 79 stale+down, 19 unknown, 65 stale+peering, 1 undersized+degraded+peered, 26 stale+active+undersized+degraded, 296 stale+undersized+peered, 95 stale+active+undersized, 27 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 482/1101 objects degraded (43.778%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:16 smithi031 bash[18426]: cluster 2020-06-27T04:49:15.515993+0000 mon.a (mon.0) 1328 : cluster [WRN] Health check update: 6 osds down (OSD_DOWN) 2020-06-27T04:49:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:16 smithi031 bash[18426]: cluster 2020-06-27T04:49:15.525369+0000 mon.a (mon.0) 1329 : cluster [DBG] osdmap e162: 8 total, 2 up, 8 in 2020-06-27T04:49:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:16 smithi031 bash[22603]: cluster 2020-06-27T04:49:15.258495+0000 mgr.x (mgr.34109) 283 : cluster [DBG] pgmap v358: 777 pgs: 1 stale+recovery_unfound+undersized+degraded+peered, 19 peering, 5 creating+down, 82 stale+undersized+degraded+peered, 1 stale+creating+down, 61 down, 79 stale+down, 19 unknown, 65 stale+peering, 1 undersized+degraded+peered, 26 stale+active+undersized+degraded, 296 stale+undersized+peered, 95 stale+active+undersized, 27 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 482/1101 objects degraded (43.778%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:16.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:16 smithi031 bash[22603]: cluster 2020-06-27T04:49:15.515993+0000 mon.a (mon.0) 1328 : cluster [WRN] Health check update: 6 osds down (OSD_DOWN) 2020-06-27T04:49:16.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:16 smithi031 bash[22603]: cluster 2020-06-27T04:49:15.525369+0000 mon.a (mon.0) 1329 : cluster [DBG] osdmap e162: 8 total, 2 up, 8 in 2020-06-27T04:49:17.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:17 smithi051 bash[18409]: cluster 2020-06-27T04:49:16.526473+0000 mon.a (mon.0) 1330 : cluster [DBG] osdmap e163: 8 total, 2 up, 8 in 2020-06-27T04:49:17.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:17 smithi031 bash[18426]: cluster 2020-06-27T04:49:16.526473+0000 mon.a (mon.0) 1330 : cluster [DBG] osdmap e163: 8 total, 2 up, 8 in 2020-06-27T04:49:17.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:17 smithi031 bash[22603]: cluster 2020-06-27T04:49:16.526473+0000 mon.a (mon.0) 1330 : cluster [DBG] osdmap e163: 8 total, 2 up, 8 in 2020-06-27T04:49:18.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:18 smithi051 bash[18409]: cluster 2020-06-27T04:49:17.259837+0000 mgr.x (mgr.34109) 284 : cluster [DBG] pgmap v361: 777 pgs: 1 stale+recovery_unfound+undersized+degraded+peered, 19 peering, 4 creating+down, 82 stale+undersized+degraded+peered, 2 stale+creating+down, 43 down, 97 stale+down, 19 unknown, 65 stale+peering, 1 undersized+degraded+peered, 26 stale+active+undersized+degraded, 296 stale+undersized+peered, 95 stale+active+undersized, 27 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 482/1101 objects degraded (43.778%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:18.968 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:18 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:49:18.969 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:18 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Scheduled restart job, restart counter is at 4. 2020-06-27T04:49:18.969 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:18 smithi051 systemd[1]: Stopped Ceph osd.7 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:18.969 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:18 smithi051 systemd[1]: Starting Ceph osd.7 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:49:18.969 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:18 smithi051 podman[44555]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7 found: no such container 2020-06-27T04:49:18.969 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:18 smithi051 systemd[1]: Started Ceph osd.7 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:18 smithi031 bash[18426]: cluster 2020-06-27T04:49:17.259837+0000 mgr.x (mgr.34109) 284 : cluster [DBG] pgmap v361: 777 pgs: 1 stale+recovery_unfound+undersized+degraded+peered, 19 peering, 4 creating+down, 82 stale+undersized+degraded+peered, 2 stale+creating+down, 43 down, 97 stale+down, 19 unknown, 65 stale+peering, 1 undersized+degraded+peered, 26 stale+active+undersized+degraded, 296 stale+undersized+peered, 95 stale+active+undersized, 27 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 482/1101 objects degraded (43.778%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:18 smithi031 bash[22603]: cluster 2020-06-27T04:49:17.259837+0000 mgr.x (mgr.34109) 284 : cluster [DBG] pgmap v361: 777 pgs: 1 stale+recovery_unfound+undersized+degraded+peered, 19 peering, 4 creating+down, 82 stale+undersized+degraded+peered, 2 stale+creating+down, 43 down, 97 stale+down, 19 unknown, 65 stale+peering, 1 undersized+degraded+peered, 26 stale+active+undersized+degraded, 296 stale+undersized+peered, 95 stale+active+undersized, 27 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 482/1101 objects degraded (43.778%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:19.451 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:19 smithi051 podman[44572]: 2020-06-27 04:49:19.054810036 +0000 UTC m=+0.268260392 container create c711c90e00ea6cbd44ed203d5df99146b1c7e4e33766e221198986db433dea75 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:49:19.452 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:19 smithi051 podman[44572]: 2020-06-27 04:49:19.196524481 +0000 UTC m=+0.409974925 container init c711c90e00ea6cbd44ed203d5df99146b1c7e4e33766e221198986db433dea75 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:49:19.452 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:19 smithi051 podman[44572]: 2020-06-27 04:49:19.22977687 +0000 UTC m=+0.443227233 container start c711c90e00ea6cbd44ed203d5df99146b1c7e4e33766e221198986db433dea75 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:49:19.452 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:19 smithi051 podman[44572]: 2020-06-27 04:49:19.229870506 +0000 UTC m=+0.443320879 container attach c711c90e00ea6cbd44ed203d5df99146b1c7e4e33766e221198986db433dea75 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:49:19.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:19 smithi051 bash[18409]: cluster 2020-06-27T04:49:19.394391+0000 mon.a (mon.0) 1331 : cluster [WRN] Health check update: Reduced data availability: 163 pgs inactive, 146 pgs down (PG_AVAILABILITY) 2020-06-27T04:49:19.718 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:19 smithi051 bash[44570]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-06-27T04:49:19.718 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:19 smithi051 bash[44570]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2020-06-27T04:49:19.718 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:19 smithi051 bash[44570]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2020-06-27T04:49:19.719 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:19 smithi051 bash[44570]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2020-06-27T04:49:19.719 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:19 smithi051 bash[44570]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2020-06-27T04:49:19.719 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:19 smithi051 bash[44570]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-06-27T04:49:19.719 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:19 smithi051 bash[44570]: --> ceph-volume lvm activate successful for osd ID: 7 2020-06-27T04:49:19.719 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:19 smithi051 podman[44572]: 2020-06-27 04:49:19.503613506 +0000 UTC m=+0.717063876 container died c711c90e00ea6cbd44ed203d5df99146b1c7e4e33766e221198986db433dea75 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:49:19.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:19 smithi031 bash[18426]: cluster 2020-06-27T04:49:19.394391+0000 mon.a (mon.0) 1331 : cluster [WRN] Health check update: Reduced data availability: 163 pgs inactive, 146 pgs down (PG_AVAILABILITY) 2020-06-27T04:49:19.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:19 smithi031 bash[22603]: cluster 2020-06-27T04:49:19.394391+0000 mon.a (mon.0) 1331 : cluster [WRN] Health check update: Reduced data availability: 163 pgs inactive, 146 pgs down (PG_AVAILABILITY) 2020-06-27T04:49:19.974 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:19 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:49:19.974 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:19 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Scheduled restart job, restart counter is at 6. 2020-06-27T04:49:19.974 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:19 smithi031 systemd[1]: Stopped Ceph osd.1 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:19.974 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:19 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Start request repeated too quickly. 2020-06-27T04:49:19.975 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:19 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.1.service: Failed with result 'exit-code'. 2020-06-27T04:49:19.975 INFO:ceph.osd.1.smithi031.stdout:Jun 27 04:49:19 smithi031 systemd[1]: Failed to start Ceph osd.1 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:20.217 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:19 smithi051 podman[44572]: 2020-06-27 04:49:19.936754619 +0000 UTC m=+1.150204991 container remove c711c90e00ea6cbd44ed203d5df99146b1c7e4e33766e221198986db433dea75 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:49:20.218 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:19 smithi051 bash[44570]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7 found: no such container 2020-06-27T04:49:20.218 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7 2020-06-27T04:49:20.218 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7" found: no such container 2020-06-27T04:49:20.545 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 podman[44682]: 2020-06-27 04:49:20.271333636 +0000 UTC m=+0.239440939 container create 89d97a048d295bf9286c5549eda1d7d68d8285904d3d771a64e20e018558af1f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:49:20.546 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 podman[44682]: 2020-06-27 04:49:20.379581001 +0000 UTC m=+0.347688302 container init 89d97a048d295bf9286c5549eda1d7d68d8285904d3d771a64e20e018558af1f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:49:20.546 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 podman[44682]: 2020-06-27 04:49:20.412990278 +0000 UTC m=+0.381097669 container start 89d97a048d295bf9286c5549eda1d7d68d8285904d3d771a64e20e018558af1f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:49:20.546 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 podman[44682]: 2020-06-27 04:49:20.413143712 +0000 UTC m=+0.381251171 container attach 89d97a048d295bf9286c5549eda1d7d68d8285904d3d771a64e20e018558af1f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:49:20.546 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 10 -- 172.21.15.51:0/3371949572 shutdown 172.21.15.51:0/3371949572 2020-06-27T04:49:20.546 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 10 Processor -- stop 2020-06-27T04:49:20.547 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 20 Event(0x55d0c83aee00 nevent=5000 time_id=3).wakeup 2020-06-27T04:49:20.547 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 1 -- 172.21.15.51:0/3371949572 shutdown_connections 2020-06-27T04:49:20.547 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 5 -- 172.21.15.51:0/3371949572 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55d0c841b400 2020-06-27T04:49:20.547 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 1 --2- 172.21.15.51:0/3371949572 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55d0c841b400 0x55d0c838c300 unknown :-1 s=CLOSED pgs=3541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:49:20.547 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 5 -- 172.21.15.51:0/3371949572 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55d0c841ac00 2020-06-27T04:49:20.548 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 1 --2- 172.21.15.51:0/3371949572 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55d0c841ac00 0x55d0c838b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:49:20.548 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 5 -- 172.21.15.51:0/3371949572 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55d0c841b000 2020-06-27T04:49:20.548 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 1 --2- 172.21.15.51:0/3371949572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0c841b000 0x55d0c838be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:49:20.548 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 5 -- 172.21.15.51:0/3371949572 shutdown_connections delete 0x55d0c841ac00 2020-06-27T04:49:20.548 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 5 -- 172.21.15.51:0/3371949572 shutdown_connections delete 0x55d0c841b000 2020-06-27T04:49:20.549 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 5 -- 172.21.15.51:0/3371949572 shutdown_connections delete 0x55d0c841b400 2020-06-27T04:49:20.549 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 1 -- 172.21.15.51:0/3371949572 >> 172.21.15.51:0/3371949572 conn(0x55d0c841a800 msgr2=0x55d0c8483000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:49:20.549 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 20 --1- 172.21.15.51:0/3371949572 >> 172.21.15.51:0/3371949572 conn(0x55d0c841a800 0x55d0c8483000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:49:20.549 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 2 --1- 172.21.15.51:0/3371949572 >> 172.21.15.51:0/3371949572 conn(0x55d0c841a800 0x55d0c8483000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:49:20.549 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 5 --1- 172.21.15.51:0/3371949572 >> 172.21.15.51:0/3371949572 conn(0x55d0c841a800 0x55d0c8483000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:49:20.550 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 20 Event(0x55d0c83aee00 nevent=5000 time_id=3).wakeup 2020-06-27T04:49:20.550 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 10 --1- 172.21.15.51:0/3371949572 >> 172.21.15.51:0/3371949572 conn(0x55d0c841a800 0x55d0c8483000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:49:20.550 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 20 Event(0x55d0c83af040 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:20.550 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 20 Event(0x55d0c83af280 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:20.550 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e4b3ce700 5 --1- 172.21.15.51:0/3371949572 >> 172.21.15.51:0/3371949572 conn(0x55d0c841a800 0x55d0c8483000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:49:20.550 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e4b3ce700 5 --1- 172.21.15.51:0/3371949572 >> 172.21.15.51:0/3371949572 conn(0x55d0c841a800 0x55d0c8483000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:49:20.551 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 10 -- 172.21.15.51:0/3371949572 wait: waiting for dispatch queue 2020-06-27T04:49:20.551 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 10 -- 172.21.15.51:0/3371949572 wait: dispatch queue is stopped 2020-06-27T04:49:20.551 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 1 -- 172.21.15.51:0/3371949572 shutdown_connections 2020-06-27T04:49:20.551 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 5 -- 172.21.15.51:0/3371949572 shutdown_connections delete 0x55d0c841a800 2020-06-27T04:49:20.551 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 20 Event(0x55d0c83aee00 nevent=5000 time_id=3).wakeup 2020-06-27T04:49:20.552 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 20 Event(0x55d0c83af040 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:20.552 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 20 Event(0x55d0c83af280 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:20.552 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 10 -- 172.21.15.51:0/3371949572 wait: done. 2020-06-27T04:49:20.552 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.401+0000 7f2e5164bf40 1 -- 172.21.15.51:0/3371949572 wait complete. 2020-06-27T04:49:20.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[18409]: cluster 2020-06-27T04:49:19.260941+0000 mgr.x (mgr.34109) 285 : cluster [DBG] pgmap v362: 777 pgs: 1 stale+recovery_unfound+undersized+degraded+peered, 19 peering, 4 creating+down, 82 stale+undersized+degraded+peered, 2 stale+creating+down, 43 down, 97 stale+down, 19 unknown, 65 stale+peering, 1 undersized+degraded+peered, 26 stale+active+undersized+degraded, 296 stale+undersized+peered, 95 stale+active+undersized, 27 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 482/1101 objects degraded (43.778%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:20.968 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:20 smithi051 bash[44570]: debug 2020-06-27T04:49:20.668+0000 7f2e5164bf40 -1 Falling back to public interface 2020-06-27T04:49:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:20 smithi031 bash[18426]: cluster 2020-06-27T04:49:19.260941+0000 mgr.x (mgr.34109) 285 : cluster [DBG] pgmap v362: 777 pgs: 1 stale+recovery_unfound+undersized+degraded+peered, 19 peering, 4 creating+down, 82 stale+undersized+degraded+peered, 2 stale+creating+down, 43 down, 97 stale+down, 19 unknown, 65 stale+peering, 1 undersized+degraded+peered, 26 stale+active+undersized+degraded, 296 stale+undersized+peered, 95 stale+active+undersized, 27 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 482/1101 objects degraded (43.778%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:20.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:20 smithi031 bash[22603]: cluster 2020-06-27T04:49:19.260941+0000 mgr.x (mgr.34109) 285 : cluster [DBG] pgmap v362: 777 pgs: 1 stale+recovery_unfound+undersized+degraded+peered, 19 peering, 4 creating+down, 82 stale+undersized+degraded+peered, 2 stale+creating+down, 43 down, 97 stale+down, 19 unknown, 65 stale+peering, 1 undersized+degraded+peered, 26 stale+active+undersized+degraded, 296 stale+undersized+peered, 95 stale+active+undersized, 27 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 482/1101 objects degraded (43.778%); 2/367 objects unfound (0.545%) 2020-06-27T04:49:21.717 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:49:21 smithi051 bash[44570]: debug 2020-06-27T04:49:21.393+0000 7f2e5164bf40 -1 osd.7 153 log_to_monitors {default=true} 2020-06-27T04:49:21.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:21 smithi051 bash[18409]: audit 2020-06-27T04:49:21.398738+0000 mon.b (mon.2) 339 : audit [INF] from='osd.7 v2:172.21.15.51:6801/3097497257' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:49:21.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:21 smithi051 bash[18409]: audit 2020-06-27T04:49:21.399299+0000 mon.a (mon.0) 1332 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:49:21.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:21 smithi051 bash[18409]: audit 2020-06-27T04:49:21.399915+0000 mon.b (mon.2) 340 : audit [INF] from='osd.7 v2:172.21.15.51:6801/3097497257' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:49:21.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:21 smithi051 bash[18409]: audit 2020-06-27T04:49:21.400195+0000 mon.a (mon.0) 1333 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:49:21.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:21 smithi031 bash[18426]: audit 2020-06-27T04:49:21.398738+0000 mon.b (mon.2) 339 : audit [INF] from='osd.7 v2:172.21.15.51:6801/3097497257' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:49:21.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:21 smithi031 bash[18426]: audit 2020-06-27T04:49:21.399299+0000 mon.a (mon.0) 1332 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:49:21.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:21 smithi031 bash[18426]: audit 2020-06-27T04:49:21.399915+0000 mon.b (mon.2) 340 : audit [INF] from='osd.7 v2:172.21.15.51:6801/3097497257' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:49:21.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:21 smithi031 bash[18426]: audit 2020-06-27T04:49:21.400195+0000 mon.a (mon.0) 1333 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:49:21.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:21 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:49:21.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:21 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Scheduled restart job, restart counter is at 5. 2020-06-27T04:49:21.975 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:21 smithi031 systemd[1]: Stopped Ceph osd.2 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:21.975 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:21 smithi031 systemd[1]: Starting Ceph osd.2 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:49:21.975 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:21 smithi031 podman[115308]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2 found: no such container 2020-06-27T04:49:21.975 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:21 smithi031 systemd[1]: Started Ceph osd.2 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:21.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:21 smithi031 bash[22603]: audit 2020-06-27T04:49:21.398738+0000 mon.b (mon.2) 339 : audit [INF] from='osd.7 v2:172.21.15.51:6801/3097497257' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:49:21.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:21 smithi031 bash[22603]: audit 2020-06-27T04:49:21.399299+0000 mon.a (mon.0) 1332 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:49:21.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:21 smithi031 bash[22603]: audit 2020-06-27T04:49:21.399915+0000 mon.b (mon.2) 340 : audit [INF] from='osd.7 v2:172.21.15.51:6801/3097497257' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:49:21.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:21 smithi031 bash[22603]: audit 2020-06-27T04:49:21.400195+0000 mon.a (mon.0) 1333 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:49:22.408 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:22 smithi031 podman[115323]: 2020-06-27 04:49:22.024998443 +0000 UTC m=+0.242242299 container create d04709db77df52fe857a7074ada26b1b26c34c3cfffc5823182a5c923245cb31 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:49:22.408 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:22 smithi031 podman[115323]: 2020-06-27 04:49:22.15834572 +0000 UTC m=+0.375589546 container init d04709db77df52fe857a7074ada26b1b26c34c3cfffc5823182a5c923245cb31 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:49:22.409 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:22 smithi031 podman[115323]: 2020-06-27 04:49:22.241597527 +0000 UTC m=+0.458841283 container start d04709db77df52fe857a7074ada26b1b26c34c3cfffc5823182a5c923245cb31 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:49:22.409 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:22 smithi031 podman[115323]: 2020-06-27 04:49:22.241665286 +0000 UTC m=+0.458909050 container attach d04709db77df52fe857a7074ada26b1b26c34c3cfffc5823182a5c923245cb31 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:49:22.409 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:22 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:49:22.409 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:22 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 6. 2020-06-27T04:49:22.410 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:22 smithi031 systemd[1]: Stopped Ceph osd.3 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:22.410 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:22 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Start request repeated too quickly. 2020-06-27T04:49:22.410 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:22 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2020-06-27T04:49:22.410 INFO:ceph.osd.3.smithi031.stdout:Jun 27 04:49:22 smithi031 systemd[1]: Failed to start Ceph osd.3 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:22.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[18426]: cluster 2020-06-27T04:49:21.262588+0000 mgr.x (mgr.34109) 286 : cluster [DBG] pgmap v363: 777 pgs: 1 stale+recovery_unfound+undersized+degraded+peered, 63 peering, 4 creating+down, 57 stale+undersized+degraded+peered, 2 stale+creating+down, 104 down, 88 stale+down, 19 unknown, 18 stale+peering, 21 undersized+degraded+peered, 20 stale+active+undersized+degraded, 216 stale+undersized+peered, 66 stale+active+undersized, 98 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 303 B/s rd, 0 op/s; 440/1101 objects degraded (39.964%); 2/367 objects unfound (0.545%); 594 B/s, 0 objects/s recovering 2020-06-27T04:49:22.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[18426]: cluster 2020-06-27T04:49:21.543524+0000 mon.a (mon.0) 1334 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:49:22.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[18426]: cluster 2020-06-27T04:49:21.543983+0000 mon.a (mon.0) 1335 : cluster [WRN] Health check update: Degraded data redundancy: 440/1101 objects degraded (39.964%), 99 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:22.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[18426]: cluster 2020-06-27T04:49:21.548475+0000 mon.a (mon.0) 1336 : cluster [INF] osd.7 v2:172.21.15.51:6801/3097497257 boot 2020-06-27T04:49:22.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[18426]: cluster 2020-06-27T04:49:21.548530+0000 mon.a (mon.0) 1337 : cluster [DBG] osdmap e164: 8 total, 3 up, 8 in 2020-06-27T04:49:22.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[18426]: audit 2020-06-27T04:49:21.549126+0000 mon.b (mon.2) 341 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:49:22.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[18426]: cluster 2020-06-27T04:49:21.563406+0000 mon.a (mon.0) 1338 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:49:22.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[18426]: cluster 2020-06-27T04:49:21.563458+0000 mon.a (mon.0) 1339 : cluster [INF] osd.4 failed (root=default,host=smithi051) (connection refused reported by osd.7) 2020-06-27T04:49:22.725 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[115321]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-06-27T04:49:22.725 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[115321]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2020-06-27T04:49:22.725 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[115321]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2020-06-27T04:49:22.726 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[115321]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2020-06-27T04:49:22.726 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[115321]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2020-06-27T04:49:22.726 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[115321]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-06-27T04:49:22.726 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[115321]: --> ceph-volume lvm activate successful for osd ID: 2 2020-06-27T04:49:22.726 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:22 smithi031 podman[115323]: 2020-06-27 04:49:22.481386891 +0000 UTC m=+0.698630669 container died d04709db77df52fe857a7074ada26b1b26c34c3cfffc5823182a5c923245cb31 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:49:22.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[22603]: cluster 2020-06-27T04:49:21.262588+0000 mgr.x (mgr.34109) 286 : cluster [DBG] pgmap v363: 777 pgs: 1 stale+recovery_unfound+undersized+degraded+peered, 63 peering, 4 creating+down, 57 stale+undersized+degraded+peered, 2 stale+creating+down, 104 down, 88 stale+down, 19 unknown, 18 stale+peering, 21 undersized+degraded+peered, 20 stale+active+undersized+degraded, 216 stale+undersized+peered, 66 stale+active+undersized, 98 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 303 B/s rd, 0 op/s; 440/1101 objects degraded (39.964%); 2/367 objects unfound (0.545%); 594 B/s, 0 objects/s recovering 2020-06-27T04:49:22.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[22603]: cluster 2020-06-27T04:49:21.543524+0000 mon.a (mon.0) 1334 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:49:22.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[22603]: cluster 2020-06-27T04:49:21.543983+0000 mon.a (mon.0) 1335 : cluster [WRN] Health check update: Degraded data redundancy: 440/1101 objects degraded (39.964%), 99 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:22.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[22603]: cluster 2020-06-27T04:49:21.548475+0000 mon.a (mon.0) 1336 : cluster [INF] osd.7 v2:172.21.15.51:6801/3097497257 boot 2020-06-27T04:49:22.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[22603]: cluster 2020-06-27T04:49:21.548530+0000 mon.a (mon.0) 1337 : cluster [DBG] osdmap e164: 8 total, 3 up, 8 in 2020-06-27T04:49:22.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[22603]: audit 2020-06-27T04:49:21.549126+0000 mon.b (mon.2) 341 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:49:22.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[22603]: cluster 2020-06-27T04:49:21.563406+0000 mon.a (mon.0) 1338 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:49:22.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:22 smithi031 bash[22603]: cluster 2020-06-27T04:49:21.563458+0000 mon.a (mon.0) 1339 : cluster [INF] osd.4 failed (root=default,host=smithi051) (connection refused reported by osd.7) 2020-06-27T04:49:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:22 smithi051 bash[18409]: cluster 2020-06-27T04:49:21.262588+0000 mgr.x (mgr.34109) 286 : cluster [DBG] pgmap v363: 777 pgs: 1 stale+recovery_unfound+undersized+degraded+peered, 63 peering, 4 creating+down, 57 stale+undersized+degraded+peered, 2 stale+creating+down, 104 down, 88 stale+down, 19 unknown, 18 stale+peering, 21 undersized+degraded+peered, 20 stale+active+undersized+degraded, 216 stale+undersized+peered, 66 stale+active+undersized, 98 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 303 B/s rd, 0 op/s; 440/1101 objects degraded (39.964%); 2/367 objects unfound (0.545%); 594 B/s, 0 objects/s recovering 2020-06-27T04:49:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:22 smithi051 bash[18409]: cluster 2020-06-27T04:49:21.543524+0000 mon.a (mon.0) 1334 : cluster [WRN] Health check update: 5 osds down (OSD_DOWN) 2020-06-27T04:49:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:22 smithi051 bash[18409]: cluster 2020-06-27T04:49:21.543983+0000 mon.a (mon.0) 1335 : cluster [WRN] Health check update: Degraded data redundancy: 440/1101 objects degraded (39.964%), 99 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:22 smithi051 bash[18409]: cluster 2020-06-27T04:49:21.548475+0000 mon.a (mon.0) 1336 : cluster [INF] osd.7 v2:172.21.15.51:6801/3097497257 boot 2020-06-27T04:49:22.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:22 smithi051 bash[18409]: cluster 2020-06-27T04:49:21.548530+0000 mon.a (mon.0) 1337 : cluster [DBG] osdmap e164: 8 total, 3 up, 8 in 2020-06-27T04:49:22.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:22 smithi051 bash[18409]: audit 2020-06-27T04:49:21.549126+0000 mon.b (mon.2) 341 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:49:22.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:22 smithi051 bash[18409]: cluster 2020-06-27T04:49:21.563406+0000 mon.a (mon.0) 1338 : cluster [DBG] osd.4 reported immediately failed by osd.7 2020-06-27T04:49:22.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:22 smithi051 bash[18409]: cluster 2020-06-27T04:49:21.563458+0000 mon.a (mon.0) 1339 : cluster [INF] osd.4 failed (root=default,host=smithi051) (connection refused reported by osd.7) 2020-06-27T04:49:23.635 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[18426]: cluster 2020-06-27T04:49:22.556217+0000 mon.a (mon.0) 1340 : cluster [DBG] osdmap e165: 8 total, 2 up, 8 in 2020-06-27T04:49:23.636 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 podman[115323]: 2020-06-27 04:49:23.315985024 +0000 UTC m=+1.533228790 container remove d04709db77df52fe857a7074ada26b1b26c34c3cfffc5823182a5c923245cb31 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-activate) 2020-06-27T04:49:23.636 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2 found: no such container 2020-06-27T04:49:23.636 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2 2020-06-27T04:49:23.636 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2" found: no such container 2020-06-27T04:49:23.636 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[22603]: cluster 2020-06-27T04:49:22.556217+0000 mon.a (mon.0) 1340 : cluster [DBG] osdmap e165: 8 total, 2 up, 8 in 2020-06-27T04:49:23.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:23 smithi051 bash[18409]: cluster 2020-06-27T04:49:22.556217+0000 mon.a (mon.0) 1340 : cluster [DBG] osdmap e165: 8 total, 2 up, 8 in 2020-06-27T04:49:23.973 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 podman[115439]: 2020-06-27 04:49:23.633085243 +0000 UTC m=+0.209078175 container create 72fb1b0d97ca09f616601ce7f18b223887543b988ce179d2c4036bbef7820c7c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:49:23.973 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 podman[115439]: 2020-06-27 04:49:23.808078901 +0000 UTC m=+0.384071850 container init 72fb1b0d97ca09f616601ce7f18b223887543b988ce179d2c4036bbef7820c7c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:49:23.973 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 podman[115439]: 2020-06-27 04:49:23.858043243 +0000 UTC m=+0.434036068 container start 72fb1b0d97ca09f616601ce7f18b223887543b988ce179d2c4036bbef7820c7c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:49:23.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 podman[115439]: 2020-06-27 04:49:23.858117181 +0000 UTC m=+0.434110028 container attach 72fb1b0d97ca09f616601ce7f18b223887543b988ce179d2c4036bbef7820c7c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:49:23.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 1 -- 172.21.15.31:0/657522438 shutdown_connections 2020-06-27T04:49:23.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 5 -- 172.21.15.31:0/657522438 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55b34cf98c00 2020-06-27T04:49:23.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 1 --2- 172.21.15.31:0/657522438 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55b34cf98c00 0x55b34cf09400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-06-27T04:49:23.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 5 -- 172.21.15.31:0/657522438 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55b34cf99400 2020-06-27T04:49:23.975 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 1 --2- 172.21.15.31:0/657522438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b34cf99400 0x55b34cf0a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:49:23.975 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 5 -- 172.21.15.31:0/657522438 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55b34cf99000 2020-06-27T04:49:23.975 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 1 --2- 172.21.15.31:0/657522438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55b34cf99000 0x55b34cf09e00 unknown :-1 s=CLOSED pgs=2510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:49:23.975 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 5 -- 172.21.15.31:0/657522438 shutdown_connections delete 0x55b34cf98c00 2020-06-27T04:49:23.975 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 5 -- 172.21.15.31:0/657522438 shutdown_connections delete 0x55b34cf99000 2020-06-27T04:49:23.975 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 5 -- 172.21.15.31:0/657522438 shutdown_connections delete 0x55b34cf99400 2020-06-27T04:49:23.976 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 1 -- 172.21.15.31:0/657522438 >> 172.21.15.31:0/657522438 conn(0x55b34cf98800 msgr2=0x55b34d001000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:49:23.976 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 20 --1- 172.21.15.31:0/657522438 >> 172.21.15.31:0/657522438 conn(0x55b34cf98800 0x55b34d001000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:49:23.976 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 2 --1- 172.21.15.31:0/657522438 >> 172.21.15.31:0/657522438 conn(0x55b34cf98800 0x55b34d001000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:49:23.976 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 5 --1- 172.21.15.31:0/657522438 >> 172.21.15.31:0/657522438 conn(0x55b34cf98800 0x55b34d001000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:49:23.977 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 20 Event(0x55b34cf2ce00 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:23.977 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 10 --1- 172.21.15.31:0/657522438 >> 172.21.15.31:0/657522438 conn(0x55b34cf98800 0x55b34d001000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:49:23.977 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 20 Event(0x55b34cf2ce00 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:23.977 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 20 Event(0x55b34cf2d040 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:23.978 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 20 Event(0x55b34cf2d280 nevent=5000 time_id=3).wakeup 2020-06-27T04:49:23.978 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c55620700 5 --1- 172.21.15.31:0/657522438 >> 172.21.15.31:0/657522438 conn(0x55b34cf98800 0x55b34d001000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:49:23.978 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c55620700 5 --1- 172.21.15.31:0/657522438 >> 172.21.15.31:0/657522438 conn(0x55b34cf98800 0x55b34d001000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:49:23.978 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 10 -- 172.21.15.31:0/657522438 wait: waiting for dispatch queue 2020-06-27T04:49:23.979 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 10 -- 172.21.15.31:0/657522438 wait: dispatch queue is stopped 2020-06-27T04:49:23.979 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 1 -- 172.21.15.31:0/657522438 shutdown_connections 2020-06-27T04:49:23.979 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 5 -- 172.21.15.31:0/657522438 shutdown_connections delete 0x55b34cf98800 2020-06-27T04:49:23.979 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 20 Event(0x55b34cf2ce00 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:23.979 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 20 Event(0x55b34cf2d040 nevent=5000 time_id=2).wakeup 2020-06-27T04:49:23.979 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 20 Event(0x55b34cf2d280 nevent=5000 time_id=3).wakeup 2020-06-27T04:49:23.980 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 10 -- 172.21.15.31:0/657522438 wait: done. 2020-06-27T04:49:23.980 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:23 smithi031 bash[115321]: debug 2020-06-27T04:49:23.829+0000 7f3c5b89df40 1 -- 172.21.15.31:0/657522438 wait complete. 2020-06-27T04:49:24.473 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:24 smithi031 bash[115321]: debug 2020-06-27T04:49:24.096+0000 7f3c5b89df40 -1 Falling back to public interface 2020-06-27T04:49:24.834 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:24 smithi031 bash[18426]: cluster 2020-06-27T04:49:23.263952+0000 mgr.x (mgr.34109) 287 : cluster [DBG] pgmap v366: 777 pgs: 4 activating+undersized, 1 stale+recovery_unfound+undersized+degraded+peered, 44 peering, 2 creating+down, 48 stale+undersized+degraded+peered, 4 stale+creating+down, 88 down, 104 stale+down, 19 unknown, 37 stale+peering, 29 undersized+degraded+peered, 20 stale+active+undersized+degraded, 187 stale+undersized+peered, 66 stale+active+undersized, 124 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 303 B/s rd, 0 op/s; 440/1101 objects degraded (39.964%); 2/367 objects unfound (0.545%); 596 B/s, 0 objects/s recovering 2020-06-27T04:49:24.835 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:24 smithi031 bash[18426]: cluster 2020-06-27T04:49:23.567633+0000 mon.a (mon.0) 1341 : cluster [DBG] osdmap e166: 8 total, 2 up, 8 in 2020-06-27T04:49:24.835 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:24 smithi031 bash[18426]: cluster 2020-06-27T04:49:24.395285+0000 mon.a (mon.0) 1342 : cluster [WRN] Health check update: Reduced data availability: 185 pgs inactive, 198 pgs down (PG_AVAILABILITY) 2020-06-27T04:49:24.835 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:24 smithi031 bash[22603]: cluster 2020-06-27T04:49:23.263952+0000 mgr.x (mgr.34109) 287 : cluster [DBG] pgmap v366: 777 pgs: 4 activating+undersized, 1 stale+recovery_unfound+undersized+degraded+peered, 44 peering, 2 creating+down, 48 stale+undersized+degraded+peered, 4 stale+creating+down, 88 down, 104 stale+down, 19 unknown, 37 stale+peering, 29 undersized+degraded+peered, 20 stale+active+undersized+degraded, 187 stale+undersized+peered, 66 stale+active+undersized, 124 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 303 B/s rd, 0 op/s; 440/1101 objects degraded (39.964%); 2/367 objects unfound (0.545%); 596 B/s, 0 objects/s recovering 2020-06-27T04:49:24.836 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:24 smithi031 bash[22603]: cluster 2020-06-27T04:49:23.567633+0000 mon.a (mon.0) 1341 : cluster [DBG] osdmap e166: 8 total, 2 up, 8 in 2020-06-27T04:49:24.836 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:24 smithi031 bash[22603]: cluster 2020-06-27T04:49:24.395285+0000 mon.a (mon.0) 1342 : cluster [WRN] Health check update: Reduced data availability: 185 pgs inactive, 198 pgs down (PG_AVAILABILITY) 2020-06-27T04:49:24.975 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:24 smithi051 bash[18409]: cluster 2020-06-27T04:49:23.263952+0000 mgr.x (mgr.34109) 287 : cluster [DBG] pgmap v366: 777 pgs: 4 activating+undersized, 1 stale+recovery_unfound+undersized+degraded+peered, 44 peering, 2 creating+down, 48 stale+undersized+degraded+peered, 4 stale+creating+down, 88 down, 104 stale+down, 19 unknown, 37 stale+peering, 29 undersized+degraded+peered, 20 stale+active+undersized+degraded, 187 stale+undersized+peered, 66 stale+active+undersized, 124 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 303 B/s rd, 0 op/s; 440/1101 objects degraded (39.964%); 2/367 objects unfound (0.545%); 596 B/s, 0 objects/s recovering 2020-06-27T04:49:24.975 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:24 smithi051 bash[18409]: cluster 2020-06-27T04:49:23.567633+0000 mon.a (mon.0) 1341 : cluster [DBG] osdmap e166: 8 total, 2 up, 8 in 2020-06-27T04:49:24.975 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:24 smithi051 bash[18409]: cluster 2020-06-27T04:49:24.395285+0000 mon.a (mon.0) 1342 : cluster [WRN] Health check update: Reduced data availability: 185 pgs inactive, 198 pgs down (PG_AVAILABILITY) 2020-06-27T04:49:25.223 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:49:24 smithi031 bash[115321]: debug 2020-06-27T04:49:24.831+0000 7f3c5b89df40 -1 osd.2 155 log_to_monitors {default=true} 2020-06-27T04:49:25.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:25 smithi051 bash[18409]: audit 2020-06-27T04:49:24.835986+0000 mon.a (mon.0) 1343 : audit [INF] from='osd.2 v2:172.21.15.31:6804/2799878914' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:49:25.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:25 smithi051 bash[18409]: audit 2020-06-27T04:49:24.836412+0000 mon.a (mon.0) 1344 : audit [INF] from='osd.2 v2:172.21.15.31:6804/2799878914' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:49:25.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:25 smithi031 bash[18426]: audit 2020-06-27T04:49:24.835986+0000 mon.a (mon.0) 1343 : audit [INF] from='osd.2 v2:172.21.15.31:6804/2799878914' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:49:25.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:25 smithi031 bash[18426]: audit 2020-06-27T04:49:24.836412+0000 mon.a (mon.0) 1344 : audit [INF] from='osd.2 v2:172.21.15.31:6804/2799878914' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:49:25.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:25 smithi031 bash[22603]: audit 2020-06-27T04:49:24.835986+0000 mon.a (mon.0) 1343 : audit [INF] from='osd.2 v2:172.21.15.31:6804/2799878914' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-06-27T04:49:25.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:25 smithi031 bash[22603]: audit 2020-06-27T04:49:24.836412+0000 mon.a (mon.0) 1344 : audit [INF] from='osd.2 v2:172.21.15.31:6804/2799878914' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:49:26.218 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:26 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:49:26.218 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:26 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Scheduled restart job, restart counter is at 6. 2020-06-27T04:49:26.219 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:25 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:49:26.219 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:25 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Scheduled restart job, restart counter is at 6. 2020-06-27T04:49:26.219 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:25 smithi051 systemd[1]: Stopped Ceph osd.6 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:26.219 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:25 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Start request repeated too quickly. 2020-06-27T04:49:26.220 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:25 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2020-06-27T04:49:26.220 INFO:ceph.osd.6.smithi051.stdout:Jun 27 04:49:25 smithi051 systemd[1]: Failed to start Ceph osd.6 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:26.592 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:26 smithi051 systemd[1]: Stopped Ceph osd.4 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:26.592 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:26 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Start request repeated too quickly. 2020-06-27T04:49:26.593 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:26 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.4.service: Failed with result 'exit-code'. 2020-06-27T04:49:26.593 INFO:ceph.osd.4.smithi051.stdout:Jun 27 04:49:26 smithi051 systemd[1]: Failed to start Ceph osd.4 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:49:26.593 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:26 smithi051 bash[18409]: cluster 2020-06-27T04:49:25.265874+0000 mgr.x (mgr.34109) 288 : cluster [DBG] pgmap v368: 777 pgs: 15 active+undersized+degraded, 7 activating+undersized, 1 stale+recovery_unfound+undersized+degraded+peered, 14 peering, 2 creating+down, 39 stale+undersized+degraded+peered, 4 stale+creating+down, 2 creating+activating+undersized, 105 down, 91 stale+down, 19 unknown, 33 active+undersized, 18 stale+peering, 34 undersized+degraded+peered, 18 stale+active+undersized+degraded, 143 stale+undersized+peered, 62 stale+active+undersized, 170 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 464/1101 objects degraded (42.144%); 2/367 objects unfound (0.545%); 648 B/s, 0 objects/s recovering 2020-06-27T04:49:26.594 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:26 smithi051 bash[18409]: audit 2020-06-27T04:49:25.572069+0000 mon.b (mon.2) 342 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:49:26.594 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:26 smithi051 bash[18409]: cluster 2020-06-27T04:49:25.573270+0000 mon.a (mon.0) 1345 : cluster [INF] osd.2 v2:172.21.15.31:6804/2799878914 boot 2020-06-27T04:49:26.594 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:26 smithi051 bash[18409]: cluster 2020-06-27T04:49:25.573361+0000 mon.a (mon.0) 1346 : cluster [DBG] osdmap e167: 8 total, 3 up, 8 in 2020-06-27T04:49:26.594 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:26 smithi051 bash[18409]: cluster 2020-06-27T04:49:26.573727+0000 mon.a (mon.0) 1347 : cluster [DBG] osdmap e168: 8 total, 3 up, 8 in 2020-06-27T04:49:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:26 smithi031 bash[18426]: cluster 2020-06-27T04:49:25.265874+0000 mgr.x (mgr.34109) 288 : cluster [DBG] pgmap v368: 777 pgs: 15 active+undersized+degraded, 7 activating+undersized, 1 stale+recovery_unfound+undersized+degraded+peered, 14 peering, 2 creating+down, 39 stale+undersized+degraded+peered, 4 stale+creating+down, 2 creating+activating+undersized, 105 down, 91 stale+down, 19 unknown, 33 active+undersized, 18 stale+peering, 34 undersized+degraded+peered, 18 stale+active+undersized+degraded, 143 stale+undersized+peered, 62 stale+active+undersized, 170 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 464/1101 objects degraded (42.144%); 2/367 objects unfound (0.545%); 648 B/s, 0 objects/s recovering 2020-06-27T04:49:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:26 smithi031 bash[18426]: audit 2020-06-27T04:49:25.572069+0000 mon.b (mon.2) 342 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:49:26.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:26 smithi031 bash[18426]: cluster 2020-06-27T04:49:25.573270+0000 mon.a (mon.0) 1345 : cluster [INF] osd.2 v2:172.21.15.31:6804/2799878914 boot 2020-06-27T04:49:26.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:26 smithi031 bash[18426]: cluster 2020-06-27T04:49:25.573361+0000 mon.a (mon.0) 1346 : cluster [DBG] osdmap e167: 8 total, 3 up, 8 in 2020-06-27T04:49:26.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:26 smithi031 bash[18426]: cluster 2020-06-27T04:49:26.573727+0000 mon.a (mon.0) 1347 : cluster [DBG] osdmap e168: 8 total, 3 up, 8 in 2020-06-27T04:49:26.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:26 smithi031 bash[22603]: cluster 2020-06-27T04:49:25.265874+0000 mgr.x (mgr.34109) 288 : cluster [DBG] pgmap v368: 777 pgs: 15 active+undersized+degraded, 7 activating+undersized, 1 stale+recovery_unfound+undersized+degraded+peered, 14 peering, 2 creating+down, 39 stale+undersized+degraded+peered, 4 stale+creating+down, 2 creating+activating+undersized, 105 down, 91 stale+down, 19 unknown, 33 active+undersized, 18 stale+peering, 34 undersized+degraded+peered, 18 stale+active+undersized+degraded, 143 stale+undersized+peered, 62 stale+active+undersized, 170 undersized+peered; 26 KiB data, 24 MiB used, 707 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 464/1101 objects degraded (42.144%); 2/367 objects unfound (0.545%); 648 B/s, 0 objects/s recovering 2020-06-27T04:49:26.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:26 smithi031 bash[22603]: audit 2020-06-27T04:49:25.572069+0000 mon.b (mon.2) 342 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-06-27T04:49:26.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:26 smithi031 bash[22603]: cluster 2020-06-27T04:49:25.573270+0000 mon.a (mon.0) 1345 : cluster [INF] osd.2 v2:172.21.15.31:6804/2799878914 boot 2020-06-27T04:49:26.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:26 smithi031 bash[22603]: cluster 2020-06-27T04:49:25.573361+0000 mon.a (mon.0) 1346 : cluster [DBG] osdmap e167: 8 total, 3 up, 8 in 2020-06-27T04:49:26.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:26 smithi031 bash[22603]: cluster 2020-06-27T04:49:26.573727+0000 mon.a (mon.0) 1347 : cluster [DBG] osdmap e168: 8 total, 3 up, 8 in 2020-06-27T04:49:27.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:27 smithi051 bash[18409]: cluster 2020-06-27T04:49:27.585214+0000 mon.a (mon.0) 1348 : cluster [WRN] Health check update: 2/368 objects unfound (0.543%) (OBJECT_UNFOUND) 2020-06-27T04:49:27.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:27 smithi051 bash[18409]: cluster 2020-06-27T04:49:27.585258+0000 mon.a (mon.0) 1349 : cluster [WRN] Health check update: Degraded data redundancy: 398/1104 objects degraded (36.051%), 96 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:27.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:27 smithi031 bash[18426]: cluster 2020-06-27T04:49:27.585214+0000 mon.a (mon.0) 1348 : cluster [WRN] Health check update: 2/368 objects unfound (0.543%) (OBJECT_UNFOUND) 2020-06-27T04:49:27.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:27 smithi031 bash[18426]: cluster 2020-06-27T04:49:27.585258+0000 mon.a (mon.0) 1349 : cluster [WRN] Health check update: Degraded data redundancy: 398/1104 objects degraded (36.051%), 96 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:27.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:27 smithi031 bash[22603]: cluster 2020-06-27T04:49:27.585214+0000 mon.a (mon.0) 1348 : cluster [WRN] Health check update: 2/368 objects unfound (0.543%) (OBJECT_UNFOUND) 2020-06-27T04:49:27.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:27 smithi031 bash[22603]: cluster 2020-06-27T04:49:27.585258+0000 mon.a (mon.0) 1349 : cluster [WRN] Health check update: Degraded data redundancy: 398/1104 objects degraded (36.051%), 96 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:28.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:28 smithi051 bash[18409]: cluster 2020-06-27T04:49:27.267347+0000 mgr.x (mgr.34109) 289 : cluster [DBG] pgmap v371: 777 pgs: 24 active+undersized+degraded, 4 activating+undersized, 1 stale+recovery_unfound+undersized+degraded+peered, 55 peering, 4 creating+down, 18 stale+undersized+degraded+peered, 4 stale+creating+down, 2 creating+activating+undersized, 109 down, 89 stale+down, 19 unknown, 56 active+undersized, 18 stale+peering, 45 undersized+degraded+peered, 8 stale+active+undersized+degraded, 72 stale+undersized+peered, 33 stale+active+undersized, 216 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 217 B/s wr, 0 op/s; 398/1104 objects degraded (36.051%); 2/368 objects unfound (0.543%); 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:49:28.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:28 smithi031 bash[18426]: cluster 2020-06-27T04:49:27.267347+0000 mgr.x (mgr.34109) 289 : cluster [DBG] pgmap v371: 777 pgs: 24 active+undersized+degraded, 4 activating+undersized, 1 stale+recovery_unfound+undersized+degraded+peered, 55 peering, 4 creating+down, 18 stale+undersized+degraded+peered, 4 stale+creating+down, 2 creating+activating+undersized, 109 down, 89 stale+down, 19 unknown, 56 active+undersized, 18 stale+peering, 45 undersized+degraded+peered, 8 stale+active+undersized+degraded, 72 stale+undersized+peered, 33 stale+active+undersized, 216 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 217 B/s wr, 0 op/s; 398/1104 objects degraded (36.051%); 2/368 objects unfound (0.543%); 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:49:28.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:28 smithi031 bash[22603]: cluster 2020-06-27T04:49:27.267347+0000 mgr.x (mgr.34109) 289 : cluster [DBG] pgmap v371: 777 pgs: 24 active+undersized+degraded, 4 activating+undersized, 1 stale+recovery_unfound+undersized+degraded+peered, 55 peering, 4 creating+down, 18 stale+undersized+degraded+peered, 4 stale+creating+down, 2 creating+activating+undersized, 109 down, 89 stale+down, 19 unknown, 56 active+undersized, 18 stale+peering, 45 undersized+degraded+peered, 8 stale+active+undersized+degraded, 72 stale+undersized+peered, 33 stale+active+undersized, 216 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 217 B/s wr, 0 op/s; 398/1104 objects degraded (36.051%); 2/368 objects unfound (0.543%); 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:49:29.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:29 smithi051 bash[18409]: cluster 2020-06-27T04:49:29.396179+0000 mon.a (mon.0) 1350 : cluster [WRN] Health check update: Reduced data availability: 211 pgs inactive, 206 pgs down (PG_AVAILABILITY) 2020-06-27T04:49:29.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:29 smithi031 bash[18426]: cluster 2020-06-27T04:49:29.396179+0000 mon.a (mon.0) 1350 : cluster [WRN] Health check update: Reduced data availability: 211 pgs inactive, 206 pgs down (PG_AVAILABILITY) 2020-06-27T04:49:29.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:29 smithi031 bash[22603]: cluster 2020-06-27T04:49:29.396179+0000 mon.a (mon.0) 1350 : cluster [WRN] Health check update: Reduced data availability: 211 pgs inactive, 206 pgs down (PG_AVAILABILITY) 2020-06-27T04:49:30.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:30 smithi051 bash[18409]: cluster 2020-06-27T04:49:29.268705+0000 mgr.x (mgr.34109) 290 : cluster [DBG] pgmap v372: 777 pgs: 24 active+undersized+degraded, 4 activating+undersized, 1 stale+recovery_unfound+undersized+degraded+peered, 55 peering, 4 creating+down, 18 stale+undersized+degraded+peered, 4 stale+creating+down, 2 creating+activating+undersized, 109 down, 89 stale+down, 19 unknown, 56 active+undersized, 18 stale+peering, 45 undersized+degraded+peered, 8 stale+active+undersized+degraded, 72 stale+undersized+peered, 33 stale+active+undersized, 216 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 170 B/s wr, 0 op/s; 398/1104 objects degraded (36.051%); 2/368 objects unfound (0.543%); 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:49:30.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:30 smithi031 bash[18426]: cluster 2020-06-27T04:49:29.268705+0000 mgr.x (mgr.34109) 290 : cluster [DBG] pgmap v372: 777 pgs: 24 active+undersized+degraded, 4 activating+undersized, 1 stale+recovery_unfound+undersized+degraded+peered, 55 peering, 4 creating+down, 18 stale+undersized+degraded+peered, 4 stale+creating+down, 2 creating+activating+undersized, 109 down, 89 stale+down, 19 unknown, 56 active+undersized, 18 stale+peering, 45 undersized+degraded+peered, 8 stale+active+undersized+degraded, 72 stale+undersized+peered, 33 stale+active+undersized, 216 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 170 B/s wr, 0 op/s; 398/1104 objects degraded (36.051%); 2/368 objects unfound (0.543%); 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:49:30.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:30 smithi031 bash[22603]: cluster 2020-06-27T04:49:29.268705+0000 mgr.x (mgr.34109) 290 : cluster [DBG] pgmap v372: 777 pgs: 24 active+undersized+degraded, 4 activating+undersized, 1 stale+recovery_unfound+undersized+degraded+peered, 55 peering, 4 creating+down, 18 stale+undersized+degraded+peered, 4 stale+creating+down, 2 creating+activating+undersized, 109 down, 89 stale+down, 19 unknown, 56 active+undersized, 18 stale+peering, 45 undersized+degraded+peered, 8 stale+active+undersized+degraded, 72 stale+undersized+peered, 33 stale+active+undersized, 216 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 170 B/s wr, 0 op/s; 398/1104 objects degraded (36.051%); 2/368 objects unfound (0.543%); 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:49:32.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:32 smithi051 bash[18409]: cluster 2020-06-27T04:49:31.271071+0000 mgr.x (mgr.34109) 291 : cluster [DBG] pgmap v373: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 40 active+undersized+degraded, 43 peering, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 136 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 8 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 132 B/s wr, 0 op/s; 394/1104 objects degraded (35.688%); 2/368 objects unfound (0.543%); 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:49:32.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:32 smithi031 bash[18426]: cluster 2020-06-27T04:49:31.271071+0000 mgr.x (mgr.34109) 291 : cluster [DBG] pgmap v373: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 40 active+undersized+degraded, 43 peering, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 136 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 8 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 132 B/s wr, 0 op/s; 394/1104 objects degraded (35.688%); 2/368 objects unfound (0.543%); 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:49:32.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:32 smithi031 bash[22603]: cluster 2020-06-27T04:49:31.271071+0000 mgr.x (mgr.34109) 291 : cluster [DBG] pgmap v373: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 40 active+undersized+degraded, 43 peering, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 136 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 8 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 132 B/s wr, 0 op/s; 394/1104 objects degraded (35.688%); 2/368 objects unfound (0.543%); 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:49:33.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:33 smithi051 bash[18409]: cluster 2020-06-27T04:49:33.653623+0000 mon.a (mon.0) 1351 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:33.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:33 smithi031 bash[18426]: cluster 2020-06-27T04:49:33.653623+0000 mon.a (mon.0) 1351 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:33.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:33 smithi031 bash[22603]: cluster 2020-06-27T04:49:33.653623+0000 mon.a (mon.0) 1351 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded (PG_DEGRADED) 2020-06-27T04:49:34.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:34 smithi051 bash[18409]: cluster 2020-06-27T04:49:33.272925+0000 mgr.x (mgr.34109) 292 : cluster [DBG] pgmap v374: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 127 B/s wr, 0 op/s; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%); 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:49:34.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:34 smithi051 bash[18409]: cluster 2020-06-27T04:49:34.396986+0000 mon.a (mon.0) 1352 : cluster [WRN] Health check update: Reduced data availability: 220 pgs inactive, 181 pgs down, 3 pgs peering (PG_AVAILABILITY) 2020-06-27T04:49:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:34 smithi031 bash[18426]: cluster 2020-06-27T04:49:33.272925+0000 mgr.x (mgr.34109) 292 : cluster [DBG] pgmap v374: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 127 B/s wr, 0 op/s; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%); 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:49:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:34 smithi031 bash[18426]: cluster 2020-06-27T04:49:34.396986+0000 mon.a (mon.0) 1352 : cluster [WRN] Health check update: Reduced data availability: 220 pgs inactive, 181 pgs down, 3 pgs peering (PG_AVAILABILITY) 2020-06-27T04:49:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:34 smithi031 bash[22603]: cluster 2020-06-27T04:49:33.272925+0000 mgr.x (mgr.34109) 292 : cluster [DBG] pgmap v374: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 127 B/s wr, 0 op/s; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%); 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:49:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:34 smithi031 bash[22603]: cluster 2020-06-27T04:49:34.396986+0000 mon.a (mon.0) 1352 : cluster [WRN] Health check update: Reduced data availability: 220 pgs inactive, 181 pgs down, 3 pgs peering (PG_AVAILABILITY) 2020-06-27T04:49:36.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:36 smithi051 bash[18409]: cluster 2020-06-27T04:49:35.275124+0000 mgr.x (mgr.34109) 293 : cluster [DBG] pgmap v375: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 105 B/s wr, 0 op/s; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%); 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:49:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:36 smithi031 bash[18426]: cluster 2020-06-27T04:49:35.275124+0000 mgr.x (mgr.34109) 293 : cluster [DBG] pgmap v375: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 105 B/s wr, 0 op/s; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%); 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:49:36.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:36 smithi031 bash[22603]: cluster 2020-06-27T04:49:35.275124+0000 mgr.x (mgr.34109) 293 : cluster [DBG] pgmap v375: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 105 B/s wr, 0 op/s; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%); 0 B/s, 0 keys/s, 0 objects/s recovering 2020-06-27T04:49:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:38 smithi031 bash[18426]: cluster 2020-06-27T04:49:37.277028+0000 mgr.x (mgr.34109) 294 : cluster [DBG] pgmap v376: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:38 smithi031 bash[22603]: cluster 2020-06-27T04:49:37.277028+0000 mgr.x (mgr.34109) 294 : cluster [DBG] pgmap v376: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:39.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:38 smithi051 bash[18409]: cluster 2020-06-27T04:49:37.277028+0000 mgr.x (mgr.34109) 294 : cluster [DBG] pgmap v376: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:40.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:39 smithi051 bash[18409]: cluster 2020-06-27T04:49:39.397833+0000 mon.a (mon.0) 1353 : cluster [WRN] Health check update: Reduced data availability: 247 pgs inactive, 181 pgs down, 18 pgs peering (PG_AVAILABILITY) 2020-06-27T04:49:40.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:39 smithi031 bash[18426]: cluster 2020-06-27T04:49:39.397833+0000 mon.a (mon.0) 1353 : cluster [WRN] Health check update: Reduced data availability: 247 pgs inactive, 181 pgs down, 18 pgs peering (PG_AVAILABILITY) 2020-06-27T04:49:40.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:39 smithi031 bash[22603]: cluster 2020-06-27T04:49:39.397833+0000 mon.a (mon.0) 1353 : cluster [WRN] Health check update: Reduced data availability: 247 pgs inactive, 181 pgs down, 18 pgs peering (PG_AVAILABILITY) 2020-06-27T04:49:41.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:40 smithi051 bash[18409]: cluster 2020-06-27T04:49:39.278371+0000 mgr.x (mgr.34109) 295 : cluster [DBG] pgmap v377: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:41.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:40 smithi031 bash[18426]: cluster 2020-06-27T04:49:39.278371+0000 mgr.x (mgr.34109) 295 : cluster [DBG] pgmap v377: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:41.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:40 smithi031 bash[22603]: cluster 2020-06-27T04:49:39.278371+0000 mgr.x (mgr.34109) 295 : cluster [DBG] pgmap v377: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:43.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:42 smithi051 bash[18409]: cluster 2020-06-27T04:49:41.280700+0000 mgr.x (mgr.34109) 296 : cluster [DBG] pgmap v378: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:43.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:42 smithi031 bash[18426]: cluster 2020-06-27T04:49:41.280700+0000 mgr.x (mgr.34109) 296 : cluster [DBG] pgmap v378: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:43.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:42 smithi031 bash[22603]: cluster 2020-06-27T04:49:41.280700+0000 mgr.x (mgr.34109) 296 : cluster [DBG] pgmap v378: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:45.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:44 smithi051 bash[18409]: cluster 2020-06-27T04:49:43.282557+0000 mgr.x (mgr.34109) 297 : cluster [DBG] pgmap v379: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:45.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:44 smithi051 bash[18409]: cluster 2020-06-27T04:49:44.398727+0000 mon.a (mon.0) 1354 : cluster [WRN] Health check update: Reduced data availability: 249 pgs inactive, 181 pgs down, 18 pgs peering (PG_AVAILABILITY) 2020-06-27T04:49:45.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:44 smithi031 bash[18426]: cluster 2020-06-27T04:49:43.282557+0000 mgr.x (mgr.34109) 297 : cluster [DBG] pgmap v379: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:45.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:44 smithi031 bash[18426]: cluster 2020-06-27T04:49:44.398727+0000 mon.a (mon.0) 1354 : cluster [WRN] Health check update: Reduced data availability: 249 pgs inactive, 181 pgs down, 18 pgs peering (PG_AVAILABILITY) 2020-06-27T04:49:45.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:44 smithi031 bash[22603]: cluster 2020-06-27T04:49:43.282557+0000 mgr.x (mgr.34109) 297 : cluster [DBG] pgmap v379: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:45.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:44 smithi031 bash[22603]: cluster 2020-06-27T04:49:44.398727+0000 mon.a (mon.0) 1354 : cluster [WRN] Health check update: Reduced data availability: 249 pgs inactive, 181 pgs down, 18 pgs peering (PG_AVAILABILITY) 2020-06-27T04:49:47.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:46 smithi051 bash[18409]: cluster 2020-06-27T04:49:45.284810+0000 mgr.x (mgr.34109) 298 : cluster [DBG] pgmap v380: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:47.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:46 smithi031 bash[18426]: cluster 2020-06-27T04:49:45.284810+0000 mgr.x (mgr.34109) 298 : cluster [DBG] pgmap v380: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:47.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:46 smithi031 bash[22603]: cluster 2020-06-27T04:49:45.284810+0000 mgr.x (mgr.34109) 298 : cluster [DBG] pgmap v380: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:48.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:47 smithi051 bash[18409]: cluster 2020-06-27T04:49:47.737021+0000 mon.a (mon.0) 1355 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2020-06-27T04:49:48.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:47 smithi031 bash[18426]: cluster 2020-06-27T04:49:47.737021+0000 mon.a (mon.0) 1355 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2020-06-27T04:49:48.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:47 smithi031 bash[22603]: cluster 2020-06-27T04:49:47.737021+0000 mon.a (mon.0) 1355 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2020-06-27T04:49:49.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:48 smithi051 bash[18409]: cluster 2020-06-27T04:49:47.286725+0000 mgr.x (mgr.34109) 299 : cluster [DBG] pgmap v381: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:49.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:48 smithi031 bash[22603]: cluster 2020-06-27T04:49:47.286725+0000 mgr.x (mgr.34109) 299 : cluster [DBG] pgmap v381: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:49.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:48 smithi031 bash[18426]: cluster 2020-06-27T04:49:47.286725+0000 mgr.x (mgr.34109) 299 : cluster [DBG] pgmap v381: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:50.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:49 smithi051 bash[18409]: cluster 2020-06-27T04:49:49.399450+0000 mon.a (mon.0) 1356 : cluster [WRN] Health check update: Reduced data availability: 293 pgs inactive, 181 pgs down, 18 pgs peering, 1 pg stale (PG_AVAILABILITY) 2020-06-27T04:49:50.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:49 smithi031 bash[22603]: cluster 2020-06-27T04:49:49.399450+0000 mon.a (mon.0) 1356 : cluster [WRN] Health check update: Reduced data availability: 293 pgs inactive, 181 pgs down, 18 pgs peering, 1 pg stale (PG_AVAILABILITY) 2020-06-27T04:49:50.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:49 smithi031 bash[18426]: cluster 2020-06-27T04:49:49.399450+0000 mon.a (mon.0) 1356 : cluster [WRN] Health check update: Reduced data availability: 293 pgs inactive, 181 pgs down, 18 pgs peering, 1 pg stale (PG_AVAILABILITY) 2020-06-27T04:49:51.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:50 smithi051 bash[18409]: cluster 2020-06-27T04:49:49.288685+0000 mgr.x (mgr.34109) 300 : cluster [DBG] pgmap v382: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:51.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:50 smithi031 bash[22603]: cluster 2020-06-27T04:49:49.288685+0000 mgr.x (mgr.34109) 300 : cluster [DBG] pgmap v382: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:51.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:50 smithi031 bash[18426]: cluster 2020-06-27T04:49:49.288685+0000 mgr.x (mgr.34109) 300 : cluster [DBG] pgmap v382: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:53.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:52 smithi051 bash[18409]: cluster 2020-06-27T04:49:51.291189+0000 mgr.x (mgr.34109) 301 : cluster [DBG] pgmap v383: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:53.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:52 smithi031 bash[22603]: cluster 2020-06-27T04:49:51.291189+0000 mgr.x (mgr.34109) 301 : cluster [DBG] pgmap v383: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:53.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:52 smithi031 bash[18426]: cluster 2020-06-27T04:49:51.291189+0000 mgr.x (mgr.34109) 301 : cluster [DBG] pgmap v383: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:55.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:54 smithi051 bash[18409]: cluster 2020-06-27T04:49:53.293027+0000 mgr.x (mgr.34109) 302 : cluster [DBG] pgmap v384: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:55.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:54 smithi051 bash[18409]: cluster 2020-06-27T04:49:54.400259+0000 mon.a (mon.0) 1357 : cluster [WRN] Health check update: Reduced data availability: 330 pgs inactive, 181 pgs down, 18 pgs peering, 5 pgs stale (PG_AVAILABILITY) 2020-06-27T04:49:55.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:54 smithi031 bash[18426]: cluster 2020-06-27T04:49:53.293027+0000 mgr.x (mgr.34109) 302 : cluster [DBG] pgmap v384: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:55.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:54 smithi031 bash[18426]: cluster 2020-06-27T04:49:54.400259+0000 mon.a (mon.0) 1357 : cluster [WRN] Health check update: Reduced data availability: 330 pgs inactive, 181 pgs down, 18 pgs peering, 5 pgs stale (PG_AVAILABILITY) 2020-06-27T04:49:55.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:54 smithi031 bash[22603]: cluster 2020-06-27T04:49:53.293027+0000 mgr.x (mgr.34109) 302 : cluster [DBG] pgmap v384: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:55.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:54 smithi031 bash[22603]: cluster 2020-06-27T04:49:54.400259+0000 mon.a (mon.0) 1357 : cluster [WRN] Health check update: Reduced data availability: 330 pgs inactive, 181 pgs down, 18 pgs peering, 5 pgs stale (PG_AVAILABILITY) 2020-06-27T04:49:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:55 smithi051 bash[18409]: cluster 2020-06-27T04:49:55.804942+0000 mon.a (mon.0) 1358 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2020-06-27T04:49:56.245 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:55 smithi031 bash[18426]: cluster 2020-06-27T04:49:55.804942+0000 mon.a (mon.0) 1358 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2020-06-27T04:49:56.245 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:55 smithi031 bash[22603]: cluster 2020-06-27T04:49:55.804942+0000 mon.a (mon.0) 1358 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2020-06-27T04:49:57.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:56 smithi051 bash[18409]: cluster 2020-06-27T04:49:55.295243+0000 mgr.x (mgr.34109) 303 : cluster [DBG] pgmap v385: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:57.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:56 smithi031 bash[18426]: cluster 2020-06-27T04:49:55.295243+0000 mgr.x (mgr.34109) 303 : cluster [DBG] pgmap v385: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:57.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:56 smithi031 bash[22603]: cluster 2020-06-27T04:49:55.295243+0000 mgr.x (mgr.34109) 303 : cluster [DBG] pgmap v385: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:59.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:58 smithi051 bash[18409]: cluster 2020-06-27T04:49:57.297077+0000 mgr.x (mgr.34109) 304 : cluster [DBG] pgmap v386: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:59.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:58 smithi031 bash[18426]: cluster 2020-06-27T04:49:57.297077+0000 mgr.x (mgr.34109) 304 : cluster [DBG] pgmap v386: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:49:59.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:58 smithi031 bash[22603]: cluster 2020-06-27T04:49:57.297077+0000 mgr.x (mgr.34109) 304 : cluster [DBG] pgmap v386: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:00.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:49:59 smithi051 bash[18409]: cluster 2020-06-27T04:49:59.401151+0000 mon.a (mon.0) 1359 : cluster [WRN] Health check update: Reduced data availability: 400 pgs inactive, 181 pgs down, 18 pgs peering, 15 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:00.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:49:59 smithi031 bash[18426]: cluster 2020-06-27T04:49:59.401151+0000 mon.a (mon.0) 1359 : cluster [WRN] Health check update: Reduced data availability: 400 pgs inactive, 181 pgs down, 18 pgs peering, 15 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:00.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:49:59 smithi031 bash[22603]: cluster 2020-06-27T04:49:59.401151+0000 mon.a (mon.0) 1359 : cluster [WRN] Health check update: Reduced data availability: 400 pgs inactive, 181 pgs down, 18 pgs peering, 15 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:01.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:00 smithi051 bash[18409]: cluster 2020-06-27T04:49:59.298736+0000 mgr.x (mgr.34109) 305 : cluster [DBG] pgmap v387: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:01.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:00 smithi031 bash[18426]: cluster 2020-06-27T04:49:59.298736+0000 mgr.x (mgr.34109) 305 : cluster [DBG] pgmap v387: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:01.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:00 smithi031 bash[22603]: cluster 2020-06-27T04:49:59.298736+0000 mgr.x (mgr.34109) 305 : cluster [DBG] pgmap v387: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:02.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:01 smithi051 bash[18409]: cluster 2020-06-27T04:50:01.301147+0000 mgr.x (mgr.34109) 306 : cluster [DBG] pgmap v388: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:02.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:01 smithi031 bash[18426]: cluster 2020-06-27T04:50:01.301147+0000 mgr.x (mgr.34109) 306 : cluster [DBG] pgmap v388: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:02.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:01 smithi031 bash[22603]: cluster 2020-06-27T04:50:01.301147+0000 mgr.x (mgr.34109) 306 : cluster [DBG] pgmap v388: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:04.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:04 smithi051 bash[18409]: cluster 2020-06-27T04:50:03.303231+0000 mgr.x (mgr.34109) 307 : cluster [DBG] pgmap v389: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:04.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:04 smithi031 bash[18426]: cluster 2020-06-27T04:50:03.303231+0000 mgr.x (mgr.34109) 307 : cluster [DBG] pgmap v389: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:04.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:04 smithi031 bash[22603]: cluster 2020-06-27T04:50:03.303231+0000 mgr.x (mgr.34109) 307 : cluster [DBG] pgmap v389: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:05.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:05 smithi051 bash[18409]: cluster 2020-06-27T04:50:04.401971+0000 mon.a (mon.0) 1360 : cluster [WRN] Health check update: Reduced data availability: 467 pgs inactive, 181 pgs down, 18 pgs peering, 23 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:05 smithi031 bash[18426]: cluster 2020-06-27T04:50:04.401971+0000 mon.a (mon.0) 1360 : cluster [WRN] Health check update: Reduced data availability: 467 pgs inactive, 181 pgs down, 18 pgs peering, 23 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:05.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:05 smithi031 bash[22603]: cluster 2020-06-27T04:50:04.401971+0000 mon.a (mon.0) 1360 : cluster [WRN] Health check update: Reduced data availability: 467 pgs inactive, 181 pgs down, 18 pgs peering, 23 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:06.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:06 smithi051 bash[18409]: cluster 2020-06-27T04:50:05.305469+0000 mgr.x (mgr.34109) 308 : cluster [DBG] pgmap v390: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:06.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:06 smithi031 bash[18426]: cluster 2020-06-27T04:50:05.305469+0000 mgr.x (mgr.34109) 308 : cluster [DBG] pgmap v390: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:06.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:06 smithi031 bash[22603]: cluster 2020-06-27T04:50:05.305469+0000 mgr.x (mgr.34109) 308 : cluster [DBG] pgmap v390: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:07.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:07 smithi031 bash[18426]: cluster 2020-06-27T04:50:07.415948+0000 mon.a (mon.0) 1361 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 7 pgs undersized (PG_DEGRADED) 2020-06-27T04:50:07.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:07 smithi031 bash[22603]: cluster 2020-06-27T04:50:07.415948+0000 mon.a (mon.0) 1361 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 7 pgs undersized (PG_DEGRADED) 2020-06-27T04:50:07.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:07 smithi051 bash[18409]: cluster 2020-06-27T04:50:07.415948+0000 mon.a (mon.0) 1361 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 7 pgs undersized (PG_DEGRADED) 2020-06-27T04:50:08.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:08 smithi031 bash[18426]: cluster 2020-06-27T04:50:07.307472+0000 mgr.x (mgr.34109) 309 : cluster [DBG] pgmap v391: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:08.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:08 smithi031 bash[22603]: cluster 2020-06-27T04:50:07.307472+0000 mgr.x (mgr.34109) 309 : cluster [DBG] pgmap v391: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:08.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:08 smithi051 bash[18409]: cluster 2020-06-27T04:50:07.307472+0000 mgr.x (mgr.34109) 309 : cluster [DBG] pgmap v391: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:09.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:09 smithi051 bash[18409]: cluster 2020-06-27T04:50:09.404867+0000 mon.a (mon.0) 1362 : cluster [WRN] Health check update: Reduced data availability: 482 pgs inactive, 181 pgs down, 18 pgs peering, 23 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:09.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:09 smithi031 bash[18426]: cluster 2020-06-27T04:50:09.404867+0000 mon.a (mon.0) 1362 : cluster [WRN] Health check update: Reduced data availability: 482 pgs inactive, 181 pgs down, 18 pgs peering, 23 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:09.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:09 smithi031 bash[22603]: cluster 2020-06-27T04:50:09.404867+0000 mon.a (mon.0) 1362 : cluster [WRN] Health check update: Reduced data availability: 482 pgs inactive, 181 pgs down, 18 pgs peering, 23 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:10.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:10 smithi051 bash[18409]: cluster 2020-06-27T04:50:09.308851+0000 mgr.x (mgr.34109) 310 : cluster [DBG] pgmap v392: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:10.978 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:10 smithi031 bash[18426]: cluster 2020-06-27T04:50:09.308851+0000 mgr.x (mgr.34109) 310 : cluster [DBG] pgmap v392: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:10.978 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:10 smithi031 bash[22603]: cluster 2020-06-27T04:50:09.308851+0000 mgr.x (mgr.34109) 310 : cluster [DBG] pgmap v392: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:12.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:12 smithi051 bash[18409]: cluster 2020-06-27T04:50:11.311293+0000 mgr.x (mgr.34109) 311 : cluster [DBG] pgmap v393: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:12 smithi031 bash[18426]: cluster 2020-06-27T04:50:11.311293+0000 mgr.x (mgr.34109) 311 : cluster [DBG] pgmap v393: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:12.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:12 smithi031 bash[22603]: cluster 2020-06-27T04:50:11.311293+0000 mgr.x (mgr.34109) 311 : cluster [DBG] pgmap v393: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:13.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:13 smithi051 bash[18409]: cluster 2020-06-27T04:50:13.480909+0000 mon.a (mon.0) 1363 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 22 pgs undersized (PG_DEGRADED) 2020-06-27T04:50:13.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:13 smithi031 bash[22603]: cluster 2020-06-27T04:50:13.480909+0000 mon.a (mon.0) 1363 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 22 pgs undersized (PG_DEGRADED) 2020-06-27T04:50:13.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:13 smithi031 bash[18426]: cluster 2020-06-27T04:50:13.480909+0000 mon.a (mon.0) 1363 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 22 pgs undersized (PG_DEGRADED) 2020-06-27T04:50:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:14 smithi051 bash[18409]: cluster 2020-06-27T04:50:13.313239+0000 mgr.x (mgr.34109) 312 : cluster [DBG] pgmap v394: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:14 smithi051 bash[18409]: cluster 2020-06-27T04:50:14.406079+0000 mon.a (mon.0) 1364 : cluster [WRN] Health check update: Reduced data availability: 484 pgs inactive, 181 pgs down, 18 pgs peering, 78 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:14 smithi031 bash[22603]: cluster 2020-06-27T04:50:13.313239+0000 mgr.x (mgr.34109) 312 : cluster [DBG] pgmap v394: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:14 smithi031 bash[22603]: cluster 2020-06-27T04:50:14.406079+0000 mon.a (mon.0) 1364 : cluster [WRN] Health check update: Reduced data availability: 484 pgs inactive, 181 pgs down, 18 pgs peering, 78 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:14 smithi031 bash[18426]: cluster 2020-06-27T04:50:13.313239+0000 mgr.x (mgr.34109) 312 : cluster [DBG] pgmap v394: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:14 smithi031 bash[18426]: cluster 2020-06-27T04:50:14.406079+0000 mon.a (mon.0) 1364 : cluster [WRN] Health check update: Reduced data availability: 484 pgs inactive, 181 pgs down, 18 pgs peering, 78 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:16 smithi051 bash[18409]: cluster 2020-06-27T04:50:15.315500+0000 mgr.x (mgr.34109) 313 : cluster [DBG] pgmap v395: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:16.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:16 smithi031 bash[22603]: cluster 2020-06-27T04:50:15.315500+0000 mgr.x (mgr.34109) 313 : cluster [DBG] pgmap v395: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:16.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:16 smithi031 bash[18426]: cluster 2020-06-27T04:50:15.315500+0000 mgr.x (mgr.34109) 313 : cluster [DBG] pgmap v395: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:18.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:18 smithi051 bash[18409]: cluster 2020-06-27T04:50:17.317594+0000 mgr.x (mgr.34109) 314 : cluster [DBG] pgmap v396: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:18 smithi031 bash[18426]: cluster 2020-06-27T04:50:17.317594+0000 mgr.x (mgr.34109) 314 : cluster [DBG] pgmap v396: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:18 smithi031 bash[22603]: cluster 2020-06-27T04:50:17.317594+0000 mgr.x (mgr.34109) 314 : cluster [DBG] pgmap v396: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:19.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:19 smithi051 bash[18409]: cluster 2020-06-27T04:50:19.406947+0000 mon.a (mon.0) 1365 : cluster [WRN] Health check update: Reduced data availability: 515 pgs inactive, 181 pgs down, 18 pgs peering, 97 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:19.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:19 smithi051 bash[18409]: cluster 2020-06-27T04:50:19.407001+0000 mon.a (mon.0) 1366 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 74 pgs undersized (PG_DEGRADED) 2020-06-27T04:50:19.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:19 smithi031 bash[22603]: cluster 2020-06-27T04:50:19.406947+0000 mon.a (mon.0) 1365 : cluster [WRN] Health check update: Reduced data availability: 515 pgs inactive, 181 pgs down, 18 pgs peering, 97 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:19.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:19 smithi031 bash[22603]: cluster 2020-06-27T04:50:19.407001+0000 mon.a (mon.0) 1366 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 74 pgs undersized (PG_DEGRADED) 2020-06-27T04:50:19.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:19 smithi031 bash[18426]: cluster 2020-06-27T04:50:19.406947+0000 mon.a (mon.0) 1365 : cluster [WRN] Health check update: Reduced data availability: 515 pgs inactive, 181 pgs down, 18 pgs peering, 97 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:19.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:19 smithi031 bash[18426]: cluster 2020-06-27T04:50:19.407001+0000 mon.a (mon.0) 1366 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 74 pgs undersized (PG_DEGRADED) 2020-06-27T04:50:20.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:20 smithi051 bash[18409]: cluster 2020-06-27T04:50:19.319123+0000 mgr.x (mgr.34109) 315 : cluster [DBG] pgmap v397: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:20.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:20 smithi031 bash[22603]: cluster 2020-06-27T04:50:19.319123+0000 mgr.x (mgr.34109) 315 : cluster [DBG] pgmap v397: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:20.977 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:20 smithi031 bash[18426]: cluster 2020-06-27T04:50:19.319123+0000 mgr.x (mgr.34109) 315 : cluster [DBG] pgmap v397: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:22 smithi051 bash[18409]: cluster 2020-06-27T04:50:21.321655+0000 mgr.x (mgr.34109) 316 : cluster [DBG] pgmap v398: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:22.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:22 smithi031 bash[22603]: cluster 2020-06-27T04:50:21.321655+0000 mgr.x (mgr.34109) 316 : cluster [DBG] pgmap v398: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:22.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:22 smithi031 bash[18426]: cluster 2020-06-27T04:50:21.321655+0000 mgr.x (mgr.34109) 316 : cluster [DBG] pgmap v398: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:24 smithi051 bash[18409]: cluster 2020-06-27T04:50:23.323695+0000 mgr.x (mgr.34109) 317 : cluster [DBG] pgmap v399: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:24 smithi051 bash[18409]: cluster 2020-06-27T04:50:24.407818+0000 mon.a (mon.0) 1367 : cluster [WRN] Health check update: Reduced data availability: 530 pgs inactive, 181 pgs down, 18 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:24 smithi051 bash[18409]: cluster 2020-06-27T04:50:24.407888+0000 mon.a (mon.0) 1368 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 203 pgs undersized (PG_DEGRADED) 2020-06-27T04:50:24.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:24 smithi031 bash[18426]: cluster 2020-06-27T04:50:23.323695+0000 mgr.x (mgr.34109) 317 : cluster [DBG] pgmap v399: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:24.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:24 smithi031 bash[18426]: cluster 2020-06-27T04:50:24.407818+0000 mon.a (mon.0) 1367 : cluster [WRN] Health check update: Reduced data availability: 530 pgs inactive, 181 pgs down, 18 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:24.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:24 smithi031 bash[18426]: cluster 2020-06-27T04:50:24.407888+0000 mon.a (mon.0) 1368 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 203 pgs undersized (PG_DEGRADED) 2020-06-27T04:50:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:24 smithi031 bash[22603]: cluster 2020-06-27T04:50:23.323695+0000 mgr.x (mgr.34109) 317 : cluster [DBG] pgmap v399: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:24.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:24 smithi031 bash[22603]: cluster 2020-06-27T04:50:24.407818+0000 mon.a (mon.0) 1367 : cluster [WRN] Health check update: Reduced data availability: 530 pgs inactive, 181 pgs down, 18 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:24.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:24 smithi031 bash[22603]: cluster 2020-06-27T04:50:24.407888+0000 mon.a (mon.0) 1368 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 203 pgs undersized (PG_DEGRADED) 2020-06-27T04:50:26.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:26 smithi051 bash[18409]: cluster 2020-06-27T04:50:25.326077+0000 mgr.x (mgr.34109) 318 : cluster [DBG] pgmap v400: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:26 smithi031 bash[18426]: cluster 2020-06-27T04:50:25.326077+0000 mgr.x (mgr.34109) 318 : cluster [DBG] pgmap v400: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:26.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:26 smithi031 bash[22603]: cluster 2020-06-27T04:50:25.326077+0000 mgr.x (mgr.34109) 318 : cluster [DBG] pgmap v400: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:28.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:28 smithi051 bash[18409]: cluster 2020-06-27T04:50:27.328319+0000 mgr.x (mgr.34109) 319 : cluster [DBG] pgmap v401: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:28.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:28 smithi031 bash[18426]: cluster 2020-06-27T04:50:27.328319+0000 mgr.x (mgr.34109) 319 : cluster [DBG] pgmap v401: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:28.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:28 smithi031 bash[22603]: cluster 2020-06-27T04:50:27.328319+0000 mgr.x (mgr.34109) 319 : cluster [DBG] pgmap v401: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:29.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:29 smithi051 bash[18409]: cluster 2020-06-27T04:50:29.408651+0000 mon.a (mon.0) 1369 : cluster [WRN] Health check update: Reduced data availability: 550 pgs inactive, 181 pgs down, 18 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:29.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:29 smithi051 bash[18409]: cluster 2020-06-27T04:50:29.408718+0000 mon.a (mon.0) 1370 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 546 pgs undersized (PG_DEGRADED) 2020-06-27T04:50:29.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:29 smithi031 bash[18426]: cluster 2020-06-27T04:50:29.408651+0000 mon.a (mon.0) 1369 : cluster [WRN] Health check update: Reduced data availability: 550 pgs inactive, 181 pgs down, 18 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:29.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:29 smithi031 bash[18426]: cluster 2020-06-27T04:50:29.408718+0000 mon.a (mon.0) 1370 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 546 pgs undersized (PG_DEGRADED) 2020-06-27T04:50:29.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:29 smithi031 bash[22603]: cluster 2020-06-27T04:50:29.408651+0000 mon.a (mon.0) 1369 : cluster [WRN] Health check update: Reduced data availability: 550 pgs inactive, 181 pgs down, 18 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:50:29.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:29 smithi031 bash[22603]: cluster 2020-06-27T04:50:29.408718+0000 mon.a (mon.0) 1370 : cluster [WRN] Health check update: Degraded data redundancy: 410/1104 objects degraded (37.138%), 112 pgs degraded, 546 pgs undersized (PG_DEGRADED) 2020-06-27T04:50:30.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:30 smithi051 bash[18409]: cluster 2020-06-27T04:50:29.329928+0000 mgr.x (mgr.34109) 320 : cluster [DBG] pgmap v402: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:30.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:30 smithi031 bash[18426]: cluster 2020-06-27T04:50:29.329928+0000 mgr.x (mgr.34109) 320 : cluster [DBG] pgmap v402: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:30.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:30 smithi031 bash[22603]: cluster 2020-06-27T04:50:29.329928+0000 mgr.x (mgr.34109) 320 : cluster [DBG] pgmap v402: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:32.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:32 smithi051 bash[18409]: cluster 2020-06-27T04:50:31.332533+0000 mgr.x (mgr.34109) 321 : cluster [DBG] pgmap v403: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:32.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:32 smithi031 bash[18426]: cluster 2020-06-27T04:50:31.332533+0000 mgr.x (mgr.34109) 321 : cluster [DBG] pgmap v403: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:32.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:32 smithi031 bash[22603]: cluster 2020-06-27T04:50:31.332533+0000 mgr.x (mgr.34109) 321 : cluster [DBG] pgmap v403: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:34.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:34 smithi051 bash[18409]: cluster 2020-06-27T04:50:33.334660+0000 mgr.x (mgr.34109) 322 : cluster [DBG] pgmap v404: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:34 smithi031 bash[18426]: cluster 2020-06-27T04:50:33.334660+0000 mgr.x (mgr.34109) 322 : cluster [DBG] pgmap v404: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:34 smithi031 bash[22603]: cluster 2020-06-27T04:50:33.334660+0000 mgr.x (mgr.34109) 322 : cluster [DBG] pgmap v404: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:36 smithi051 bash[18409]: cluster 2020-06-27T04:50:35.337124+0000 mgr.x (mgr.34109) 323 : cluster [DBG] pgmap v405: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:36.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:36 smithi031 bash[22603]: cluster 2020-06-27T04:50:35.337124+0000 mgr.x (mgr.34109) 323 : cluster [DBG] pgmap v405: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:36 smithi031 bash[18426]: cluster 2020-06-27T04:50:35.337124+0000 mgr.x (mgr.34109) 323 : cluster [DBG] pgmap v405: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:38.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:38 smithi051 bash[18409]: cluster 2020-06-27T04:50:37.339102+0000 mgr.x (mgr.34109) 324 : cluster [DBG] pgmap v406: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:38 smithi031 bash[18426]: cluster 2020-06-27T04:50:37.339102+0000 mgr.x (mgr.34109) 324 : cluster [DBG] pgmap v406: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:38 smithi031 bash[22603]: cluster 2020-06-27T04:50:37.339102+0000 mgr.x (mgr.34109) 324 : cluster [DBG] pgmap v406: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:40.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:40 smithi051 bash[18409]: cluster 2020-06-27T04:50:39.340716+0000 mgr.x (mgr.34109) 325 : cluster [DBG] pgmap v407: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:40.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:40 smithi031 bash[22603]: cluster 2020-06-27T04:50:39.340716+0000 mgr.x (mgr.34109) 325 : cluster [DBG] pgmap v407: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:40 smithi031 bash[18426]: cluster 2020-06-27T04:50:39.340716+0000 mgr.x (mgr.34109) 325 : cluster [DBG] pgmap v407: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:42.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:42 smithi051 bash[18409]: cluster 2020-06-27T04:50:41.343249+0000 mgr.x (mgr.34109) 326 : cluster [DBG] pgmap v408: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:42.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:42 smithi031 bash[22603]: cluster 2020-06-27T04:50:41.343249+0000 mgr.x (mgr.34109) 326 : cluster [DBG] pgmap v408: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:42.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:42 smithi031 bash[18426]: cluster 2020-06-27T04:50:41.343249+0000 mgr.x (mgr.34109) 326 : cluster [DBG] pgmap v408: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:44.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:44 smithi051 bash[18409]: cluster 2020-06-27T04:50:43.345338+0000 mgr.x (mgr.34109) 327 : cluster [DBG] pgmap v409: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:44 smithi031 bash[22603]: cluster 2020-06-27T04:50:43.345338+0000 mgr.x (mgr.34109) 327 : cluster [DBG] pgmap v409: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:44 smithi031 bash[18426]: cluster 2020-06-27T04:50:43.345338+0000 mgr.x (mgr.34109) 327 : cluster [DBG] pgmap v409: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:46.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:46 smithi051 bash[18409]: cluster 2020-06-27T04:50:45.347857+0000 mgr.x (mgr.34109) 328 : cluster [DBG] pgmap v410: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:46.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:46 smithi031 bash[22603]: cluster 2020-06-27T04:50:45.347857+0000 mgr.x (mgr.34109) 328 : cluster [DBG] pgmap v410: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:46 smithi031 bash[18426]: cluster 2020-06-27T04:50:45.347857+0000 mgr.x (mgr.34109) 328 : cluster [DBG] pgmap v410: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:48.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:48 smithi051 bash[18409]: cluster 2020-06-27T04:50:47.349955+0000 mgr.x (mgr.34109) 329 : cluster [DBG] pgmap v411: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:48.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:48 smithi031 bash[22603]: cluster 2020-06-27T04:50:47.349955+0000 mgr.x (mgr.34109) 329 : cluster [DBG] pgmap v411: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:48.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:48 smithi031 bash[18426]: cluster 2020-06-27T04:50:47.349955+0000 mgr.x (mgr.34109) 329 : cluster [DBG] pgmap v411: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:50.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:50 smithi051 bash[18409]: cluster 2020-06-27T04:50:49.351854+0000 mgr.x (mgr.34109) 330 : cluster [DBG] pgmap v412: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:50.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:50 smithi031 bash[18426]: cluster 2020-06-27T04:50:49.351854+0000 mgr.x (mgr.34109) 330 : cluster [DBG] pgmap v412: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:50.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:50 smithi031 bash[22603]: cluster 2020-06-27T04:50:49.351854+0000 mgr.x (mgr.34109) 330 : cluster [DBG] pgmap v412: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:52 smithi051 bash[18409]: cluster 2020-06-27T04:50:51.354069+0000 mgr.x (mgr.34109) 331 : cluster [DBG] pgmap v413: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:52 smithi031 bash[18426]: cluster 2020-06-27T04:50:51.354069+0000 mgr.x (mgr.34109) 331 : cluster [DBG] pgmap v413: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:52 smithi031 bash[22603]: cluster 2020-06-27T04:50:51.354069+0000 mgr.x (mgr.34109) 331 : cluster [DBG] pgmap v413: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:54.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:54 smithi051 bash[18409]: cluster 2020-06-27T04:50:53.356207+0000 mgr.x (mgr.34109) 332 : cluster [DBG] pgmap v414: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:54.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:54 smithi031 bash[18426]: cluster 2020-06-27T04:50:53.356207+0000 mgr.x (mgr.34109) 332 : cluster [DBG] pgmap v414: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:54 smithi031 bash[22603]: cluster 2020-06-27T04:50:53.356207+0000 mgr.x (mgr.34109) 332 : cluster [DBG] pgmap v414: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:56.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:56 smithi051 bash[18409]: cluster 2020-06-27T04:50:55.358634+0000 mgr.x (mgr.34109) 333 : cluster [DBG] pgmap v415: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:56.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:56 smithi031 bash[18426]: cluster 2020-06-27T04:50:55.358634+0000 mgr.x (mgr.34109) 333 : cluster [DBG] pgmap v415: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:56.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:56 smithi031 bash[22603]: cluster 2020-06-27T04:50:55.358634+0000 mgr.x (mgr.34109) 333 : cluster [DBG] pgmap v415: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:58.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:50:58 smithi051 bash[18409]: cluster 2020-06-27T04:50:57.360860+0000 mgr.x (mgr.34109) 334 : cluster [DBG] pgmap v416: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:58.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:50:58 smithi031 bash[18426]: cluster 2020-06-27T04:50:57.360860+0000 mgr.x (mgr.34109) 334 : cluster [DBG] pgmap v416: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:50:58.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:50:58 smithi031 bash[22603]: cluster 2020-06-27T04:50:57.360860+0000 mgr.x (mgr.34109) 334 : cluster [DBG] pgmap v416: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:00.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:00 smithi051 bash[18409]: cluster 2020-06-27T04:50:59.362787+0000 mgr.x (mgr.34109) 335 : cluster [DBG] pgmap v417: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:00.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:00 smithi031 bash[18426]: cluster 2020-06-27T04:50:59.362787+0000 mgr.x (mgr.34109) 335 : cluster [DBG] pgmap v417: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:00.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:00 smithi031 bash[22603]: cluster 2020-06-27T04:50:59.362787+0000 mgr.x (mgr.34109) 335 : cluster [DBG] pgmap v417: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:02.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:02 smithi051 bash[18409]: cluster 2020-06-27T04:51:01.364938+0000 mgr.x (mgr.34109) 336 : cluster [DBG] pgmap v418: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:02.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:02 smithi031 bash[18426]: cluster 2020-06-27T04:51:01.364938+0000 mgr.x (mgr.34109) 336 : cluster [DBG] pgmap v418: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:02.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:02 smithi031 bash[22603]: cluster 2020-06-27T04:51:01.364938+0000 mgr.x (mgr.34109) 336 : cluster [DBG] pgmap v418: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:04.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:04 smithi051 bash[18409]: cluster 2020-06-27T04:51:03.367041+0000 mgr.x (mgr.34109) 337 : cluster [DBG] pgmap v419: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:04.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:04 smithi031 bash[18426]: cluster 2020-06-27T04:51:03.367041+0000 mgr.x (mgr.34109) 337 : cluster [DBG] pgmap v419: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:04.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:04 smithi031 bash[22603]: cluster 2020-06-27T04:51:03.367041+0000 mgr.x (mgr.34109) 337 : cluster [DBG] pgmap v419: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:06.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:06 smithi051 bash[18409]: cluster 2020-06-27T04:51:05.369389+0000 mgr.x (mgr.34109) 338 : cluster [DBG] pgmap v420: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:06.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:06 smithi031 bash[18426]: cluster 2020-06-27T04:51:05.369389+0000 mgr.x (mgr.34109) 338 : cluster [DBG] pgmap v420: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:06.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:06 smithi031 bash[22603]: cluster 2020-06-27T04:51:05.369389+0000 mgr.x (mgr.34109) 338 : cluster [DBG] pgmap v420: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:08.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:08 smithi051 bash[18409]: cluster 2020-06-27T04:51:07.371552+0000 mgr.x (mgr.34109) 339 : cluster [DBG] pgmap v421: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:08.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:08 smithi031 bash[18426]: cluster 2020-06-27T04:51:07.371552+0000 mgr.x (mgr.34109) 339 : cluster [DBG] pgmap v421: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:08.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:08 smithi031 bash[22603]: cluster 2020-06-27T04:51:07.371552+0000 mgr.x (mgr.34109) 339 : cluster [DBG] pgmap v421: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:10.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:10 smithi051 bash[18409]: cluster 2020-06-27T04:51:09.373485+0000 mgr.x (mgr.34109) 340 : cluster [DBG] pgmap v422: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:10.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:10 smithi031 bash[18426]: cluster 2020-06-27T04:51:09.373485+0000 mgr.x (mgr.34109) 340 : cluster [DBG] pgmap v422: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:10.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:10 smithi031 bash[22603]: cluster 2020-06-27T04:51:09.373485+0000 mgr.x (mgr.34109) 340 : cluster [DBG] pgmap v422: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:12.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:12 smithi051 bash[18409]: cluster 2020-06-27T04:51:11.375539+0000 mgr.x (mgr.34109) 341 : cluster [DBG] pgmap v423: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:12 smithi031 bash[18426]: cluster 2020-06-27T04:51:11.375539+0000 mgr.x (mgr.34109) 341 : cluster [DBG] pgmap v423: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:12.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:12 smithi031 bash[22603]: cluster 2020-06-27T04:51:11.375539+0000 mgr.x (mgr.34109) 341 : cluster [DBG] pgmap v423: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:14 smithi051 bash[18409]: cluster 2020-06-27T04:51:13.377635+0000 mgr.x (mgr.34109) 342 : cluster [DBG] pgmap v424: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:14 smithi031 bash[18426]: cluster 2020-06-27T04:51:13.377635+0000 mgr.x (mgr.34109) 342 : cluster [DBG] pgmap v424: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:14 smithi031 bash[22603]: cluster 2020-06-27T04:51:13.377635+0000 mgr.x (mgr.34109) 342 : cluster [DBG] pgmap v424: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:16.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:16 smithi051 bash[18409]: cluster 2020-06-27T04:51:15.380129+0000 mgr.x (mgr.34109) 343 : cluster [DBG] pgmap v425: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:16 smithi031 bash[18426]: cluster 2020-06-27T04:51:15.380129+0000 mgr.x (mgr.34109) 343 : cluster [DBG] pgmap v425: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:16 smithi031 bash[22603]: cluster 2020-06-27T04:51:15.380129+0000 mgr.x (mgr.34109) 343 : cluster [DBG] pgmap v425: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:18.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:18 smithi051 bash[18409]: cluster 2020-06-27T04:51:17.382222+0000 mgr.x (mgr.34109) 344 : cluster [DBG] pgmap v426: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:18 smithi031 bash[18426]: cluster 2020-06-27T04:51:17.382222+0000 mgr.x (mgr.34109) 344 : cluster [DBG] pgmap v426: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:18 smithi031 bash[22603]: cluster 2020-06-27T04:51:17.382222+0000 mgr.x (mgr.34109) 344 : cluster [DBG] pgmap v426: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:20.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:20 smithi051 bash[18409]: cluster 2020-06-27T04:51:19.384175+0000 mgr.x (mgr.34109) 345 : cluster [DBG] pgmap v427: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:20 smithi031 bash[18426]: cluster 2020-06-27T04:51:19.384175+0000 mgr.x (mgr.34109) 345 : cluster [DBG] pgmap v427: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:20.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:20 smithi031 bash[22603]: cluster 2020-06-27T04:51:19.384175+0000 mgr.x (mgr.34109) 345 : cluster [DBG] pgmap v427: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:22 smithi051 bash[18409]: cluster 2020-06-27T04:51:21.386198+0000 mgr.x (mgr.34109) 346 : cluster [DBG] pgmap v428: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:22.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:22 smithi031 bash[18426]: cluster 2020-06-27T04:51:21.386198+0000 mgr.x (mgr.34109) 346 : cluster [DBG] pgmap v428: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:22.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:22 smithi031 bash[22603]: cluster 2020-06-27T04:51:21.386198+0000 mgr.x (mgr.34109) 346 : cluster [DBG] pgmap v428: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:24 smithi051 bash[18409]: cluster 2020-06-27T04:51:23.388398+0000 mgr.x (mgr.34109) 347 : cluster [DBG] pgmap v429: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:24.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:24 smithi031 bash[18426]: cluster 2020-06-27T04:51:23.388398+0000 mgr.x (mgr.34109) 347 : cluster [DBG] pgmap v429: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:24 smithi031 bash[22603]: cluster 2020-06-27T04:51:23.388398+0000 mgr.x (mgr.34109) 347 : cluster [DBG] pgmap v429: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:26.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:26 smithi051 bash[18409]: cluster 2020-06-27T04:51:25.390955+0000 mgr.x (mgr.34109) 348 : cluster [DBG] pgmap v430: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:26 smithi031 bash[18426]: cluster 2020-06-27T04:51:25.390955+0000 mgr.x (mgr.34109) 348 : cluster [DBG] pgmap v430: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:26.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:26 smithi031 bash[22603]: cluster 2020-06-27T04:51:25.390955+0000 mgr.x (mgr.34109) 348 : cluster [DBG] pgmap v430: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:28.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:28 smithi051 bash[18409]: cluster 2020-06-27T04:51:27.393010+0000 mgr.x (mgr.34109) 349 : cluster [DBG] pgmap v431: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:28.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:28 smithi031 bash[18426]: cluster 2020-06-27T04:51:27.393010+0000 mgr.x (mgr.34109) 349 : cluster [DBG] pgmap v431: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:28.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:28 smithi031 bash[22603]: cluster 2020-06-27T04:51:27.393010+0000 mgr.x (mgr.34109) 349 : cluster [DBG] pgmap v431: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:30.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:30 smithi031 bash[18426]: cluster 2020-06-27T04:51:29.395101+0000 mgr.x (mgr.34109) 350 : cluster [DBG] pgmap v432: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:30.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:30 smithi031 bash[22603]: cluster 2020-06-27T04:51:29.395101+0000 mgr.x (mgr.34109) 350 : cluster [DBG] pgmap v432: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:31.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:30 smithi051 bash[18409]: cluster 2020-06-27T04:51:29.395101+0000 mgr.x (mgr.34109) 350 : cluster [DBG] pgmap v432: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:33.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:32 smithi051 bash[18409]: cluster 2020-06-27T04:51:31.397336+0000 mgr.x (mgr.34109) 351 : cluster [DBG] pgmap v433: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:33.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:32 smithi031 bash[18426]: cluster 2020-06-27T04:51:31.397336+0000 mgr.x (mgr.34109) 351 : cluster [DBG] pgmap v433: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:33.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:32 smithi031 bash[22603]: cluster 2020-06-27T04:51:31.397336+0000 mgr.x (mgr.34109) 351 : cluster [DBG] pgmap v433: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:35.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:34 smithi051 bash[18409]: cluster 2020-06-27T04:51:33.399492+0000 mgr.x (mgr.34109) 352 : cluster [DBG] pgmap v434: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:35.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:34 smithi031 bash[18426]: cluster 2020-06-27T04:51:33.399492+0000 mgr.x (mgr.34109) 352 : cluster [DBG] pgmap v434: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:35.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:34 smithi031 bash[22603]: cluster 2020-06-27T04:51:33.399492+0000 mgr.x (mgr.34109) 352 : cluster [DBG] pgmap v434: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:37.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:36 smithi051 bash[18409]: cluster 2020-06-27T04:51:35.401759+0000 mgr.x (mgr.34109) 353 : cluster [DBG] pgmap v435: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:37.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:36 smithi031 bash[18426]: cluster 2020-06-27T04:51:35.401759+0000 mgr.x (mgr.34109) 353 : cluster [DBG] pgmap v435: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:37.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:36 smithi031 bash[22603]: cluster 2020-06-27T04:51:35.401759+0000 mgr.x (mgr.34109) 353 : cluster [DBG] pgmap v435: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:39.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:38 smithi051 bash[18409]: cluster 2020-06-27T04:51:37.403808+0000 mgr.x (mgr.34109) 354 : cluster [DBG] pgmap v436: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:39.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:38 smithi031 bash[18426]: cluster 2020-06-27T04:51:37.403808+0000 mgr.x (mgr.34109) 354 : cluster [DBG] pgmap v436: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:39.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:38 smithi031 bash[22603]: cluster 2020-06-27T04:51:37.403808+0000 mgr.x (mgr.34109) 354 : cluster [DBG] pgmap v436: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:41.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:40 smithi051 bash[18409]: cluster 2020-06-27T04:51:39.405668+0000 mgr.x (mgr.34109) 355 : cluster [DBG] pgmap v437: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:41.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:40 smithi031 bash[18426]: cluster 2020-06-27T04:51:39.405668+0000 mgr.x (mgr.34109) 355 : cluster [DBG] pgmap v437: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:41.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:40 smithi031 bash[22603]: cluster 2020-06-27T04:51:39.405668+0000 mgr.x (mgr.34109) 355 : cluster [DBG] pgmap v437: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:43.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:42 smithi051 bash[18409]: cluster 2020-06-27T04:51:41.407646+0000 mgr.x (mgr.34109) 356 : cluster [DBG] pgmap v438: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:43.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:42 smithi031 bash[18426]: cluster 2020-06-27T04:51:41.407646+0000 mgr.x (mgr.34109) 356 : cluster [DBG] pgmap v438: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:43.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:42 smithi031 bash[22603]: cluster 2020-06-27T04:51:41.407646+0000 mgr.x (mgr.34109) 356 : cluster [DBG] pgmap v438: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:45.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:44 smithi051 bash[18409]: cluster 2020-06-27T04:51:43.409767+0000 mgr.x (mgr.34109) 357 : cluster [DBG] pgmap v439: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:45.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:44 smithi031 bash[18426]: cluster 2020-06-27T04:51:43.409767+0000 mgr.x (mgr.34109) 357 : cluster [DBG] pgmap v439: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:45.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:44 smithi031 bash[22603]: cluster 2020-06-27T04:51:43.409767+0000 mgr.x (mgr.34109) 357 : cluster [DBG] pgmap v439: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:47.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:46 smithi051 bash[18409]: cluster 2020-06-27T04:51:45.412391+0000 mgr.x (mgr.34109) 358 : cluster [DBG] pgmap v440: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:47.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:46 smithi031 bash[18426]: cluster 2020-06-27T04:51:45.412391+0000 mgr.x (mgr.34109) 358 : cluster [DBG] pgmap v440: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:47.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:46 smithi031 bash[22603]: cluster 2020-06-27T04:51:45.412391+0000 mgr.x (mgr.34109) 358 : cluster [DBG] pgmap v440: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:49.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:48 smithi051 bash[18409]: cluster 2020-06-27T04:51:47.414524+0000 mgr.x (mgr.34109) 359 : cluster [DBG] pgmap v441: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:49.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:48 smithi031 bash[18426]: cluster 2020-06-27T04:51:47.414524+0000 mgr.x (mgr.34109) 359 : cluster [DBG] pgmap v441: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:49.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:48 smithi031 bash[22603]: cluster 2020-06-27T04:51:47.414524+0000 mgr.x (mgr.34109) 359 : cluster [DBG] pgmap v441: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:51.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:50 smithi051 bash[18409]: cluster 2020-06-27T04:51:49.416371+0000 mgr.x (mgr.34109) 360 : cluster [DBG] pgmap v442: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:51.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:50 smithi031 bash[18426]: cluster 2020-06-27T04:51:49.416371+0000 mgr.x (mgr.34109) 360 : cluster [DBG] pgmap v442: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:51.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:50 smithi031 bash[22603]: cluster 2020-06-27T04:51:49.416371+0000 mgr.x (mgr.34109) 360 : cluster [DBG] pgmap v442: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:53.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:52 smithi051 bash[18409]: cluster 2020-06-27T04:51:51.418444+0000 mgr.x (mgr.34109) 361 : cluster [DBG] pgmap v443: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:53.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:52 smithi031 bash[18426]: cluster 2020-06-27T04:51:51.418444+0000 mgr.x (mgr.34109) 361 : cluster [DBG] pgmap v443: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:53.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:52 smithi031 bash[22603]: cluster 2020-06-27T04:51:51.418444+0000 mgr.x (mgr.34109) 361 : cluster [DBG] pgmap v443: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:55.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:54 smithi051 bash[18409]: cluster 2020-06-27T04:51:53.420525+0000 mgr.x (mgr.34109) 362 : cluster [DBG] pgmap v444: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:55.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:54 smithi031 bash[18426]: cluster 2020-06-27T04:51:53.420525+0000 mgr.x (mgr.34109) 362 : cluster [DBG] pgmap v444: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:55.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:54 smithi031 bash[22603]: cluster 2020-06-27T04:51:53.420525+0000 mgr.x (mgr.34109) 362 : cluster [DBG] pgmap v444: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:57.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:56 smithi051 bash[18409]: cluster 2020-06-27T04:51:55.422907+0000 mgr.x (mgr.34109) 363 : cluster [DBG] pgmap v445: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:57.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:56 smithi031 bash[18426]: cluster 2020-06-27T04:51:55.422907+0000 mgr.x (mgr.34109) 363 : cluster [DBG] pgmap v445: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:57.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:56 smithi031 bash[22603]: cluster 2020-06-27T04:51:55.422907+0000 mgr.x (mgr.34109) 363 : cluster [DBG] pgmap v445: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:59.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:51:58 smithi051 bash[18409]: cluster 2020-06-27T04:51:57.425007+0000 mgr.x (mgr.34109) 364 : cluster [DBG] pgmap v446: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:59.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:51:58 smithi031 bash[18426]: cluster 2020-06-27T04:51:57.425007+0000 mgr.x (mgr.34109) 364 : cluster [DBG] pgmap v446: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:51:59.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:51:58 smithi031 bash[22603]: cluster 2020-06-27T04:51:57.425007+0000 mgr.x (mgr.34109) 364 : cluster [DBG] pgmap v446: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:00.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:00 smithi051 bash[18409]: cluster 2020-06-27T04:51:59.427005+0000 mgr.x (mgr.34109) 365 : cluster [DBG] pgmap v447: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:00.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:00 smithi031 bash[22603]: cluster 2020-06-27T04:51:59.427005+0000 mgr.x (mgr.34109) 365 : cluster [DBG] pgmap v447: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:00.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:00 smithi031 bash[18426]: cluster 2020-06-27T04:51:59.427005+0000 mgr.x (mgr.34109) 365 : cluster [DBG] pgmap v447: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:02.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:02 smithi051 bash[18409]: cluster 2020-06-27T04:52:01.429196+0000 mgr.x (mgr.34109) 366 : cluster [DBG] pgmap v448: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:02.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:02 smithi031 bash[18426]: cluster 2020-06-27T04:52:01.429196+0000 mgr.x (mgr.34109) 366 : cluster [DBG] pgmap v448: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:02.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:02 smithi031 bash[22603]: cluster 2020-06-27T04:52:01.429196+0000 mgr.x (mgr.34109) 366 : cluster [DBG] pgmap v448: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:04.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:04 smithi051 bash[18409]: cluster 2020-06-27T04:52:03.431441+0000 mgr.x (mgr.34109) 367 : cluster [DBG] pgmap v449: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:04.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:04 smithi031 bash[18426]: cluster 2020-06-27T04:52:03.431441+0000 mgr.x (mgr.34109) 367 : cluster [DBG] pgmap v449: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:04.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:04 smithi031 bash[22603]: cluster 2020-06-27T04:52:03.431441+0000 mgr.x (mgr.34109) 367 : cluster [DBG] pgmap v449: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:06.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:06 smithi051 bash[18409]: cluster 2020-06-27T04:52:05.433729+0000 mgr.x (mgr.34109) 368 : cluster [DBG] pgmap v450: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:06.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:06 smithi031 bash[18426]: cluster 2020-06-27T04:52:05.433729+0000 mgr.x (mgr.34109) 368 : cluster [DBG] pgmap v450: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:06.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:06 smithi031 bash[22603]: cluster 2020-06-27T04:52:05.433729+0000 mgr.x (mgr.34109) 368 : cluster [DBG] pgmap v450: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:08.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:08 smithi051 bash[18409]: cluster 2020-06-27T04:52:07.435957+0000 mgr.x (mgr.34109) 369 : cluster [DBG] pgmap v451: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:08.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:08 smithi031 bash[18426]: cluster 2020-06-27T04:52:07.435957+0000 mgr.x (mgr.34109) 369 : cluster [DBG] pgmap v451: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:08.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:08 smithi031 bash[22603]: cluster 2020-06-27T04:52:07.435957+0000 mgr.x (mgr.34109) 369 : cluster [DBG] pgmap v451: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:10.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:10 smithi051 bash[18409]: cluster 2020-06-27T04:52:09.438101+0000 mgr.x (mgr.34109) 370 : cluster [DBG] pgmap v452: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:10.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:10 smithi031 bash[18426]: cluster 2020-06-27T04:52:09.438101+0000 mgr.x (mgr.34109) 370 : cluster [DBG] pgmap v452: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:10.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:10 smithi031 bash[22603]: cluster 2020-06-27T04:52:09.438101+0000 mgr.x (mgr.34109) 370 : cluster [DBG] pgmap v452: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:12.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:12 smithi051 bash[18409]: cluster 2020-06-27T04:52:11.440213+0000 mgr.x (mgr.34109) 371 : cluster [DBG] pgmap v453: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:12 smithi031 bash[18426]: cluster 2020-06-27T04:52:11.440213+0000 mgr.x (mgr.34109) 371 : cluster [DBG] pgmap v453: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:12.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:12 smithi031 bash[22603]: cluster 2020-06-27T04:52:11.440213+0000 mgr.x (mgr.34109) 371 : cluster [DBG] pgmap v453: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:14.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:14 smithi051 bash[18409]: cluster 2020-06-27T04:52:13.442381+0000 mgr.x (mgr.34109) 372 : cluster [DBG] pgmap v454: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:14 smithi031 bash[18426]: cluster 2020-06-27T04:52:13.442381+0000 mgr.x (mgr.34109) 372 : cluster [DBG] pgmap v454: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:14 smithi031 bash[22603]: cluster 2020-06-27T04:52:13.442381+0000 mgr.x (mgr.34109) 372 : cluster [DBG] pgmap v454: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:16 smithi051 bash[18409]: cluster 2020-06-27T04:52:15.444914+0000 mgr.x (mgr.34109) 373 : cluster [DBG] pgmap v455: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:16 smithi031 bash[18426]: cluster 2020-06-27T04:52:15.444914+0000 mgr.x (mgr.34109) 373 : cluster [DBG] pgmap v455: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:16 smithi031 bash[22603]: cluster 2020-06-27T04:52:15.444914+0000 mgr.x (mgr.34109) 373 : cluster [DBG] pgmap v455: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:18.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:18 smithi051 bash[18409]: cluster 2020-06-27T04:52:17.447027+0000 mgr.x (mgr.34109) 374 : cluster [DBG] pgmap v456: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:18 smithi031 bash[18426]: cluster 2020-06-27T04:52:17.447027+0000 mgr.x (mgr.34109) 374 : cluster [DBG] pgmap v456: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:18 smithi031 bash[22603]: cluster 2020-06-27T04:52:17.447027+0000 mgr.x (mgr.34109) 374 : cluster [DBG] pgmap v456: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:20.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:20 smithi051 bash[18409]: cluster 2020-06-27T04:52:19.449872+0000 mgr.x (mgr.34109) 375 : cluster [DBG] pgmap v457: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:20.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:20 smithi031 bash[18426]: cluster 2020-06-27T04:52:19.449872+0000 mgr.x (mgr.34109) 375 : cluster [DBG] pgmap v457: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:20.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:20 smithi031 bash[22603]: cluster 2020-06-27T04:52:19.449872+0000 mgr.x (mgr.34109) 375 : cluster [DBG] pgmap v457: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:22 smithi051 bash[18409]: cluster 2020-06-27T04:52:21.452130+0000 mgr.x (mgr.34109) 376 : cluster [DBG] pgmap v458: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:22.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:22 smithi031 bash[18426]: cluster 2020-06-27T04:52:21.452130+0000 mgr.x (mgr.34109) 376 : cluster [DBG] pgmap v458: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:22.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:22 smithi031 bash[22603]: cluster 2020-06-27T04:52:21.452130+0000 mgr.x (mgr.34109) 376 : cluster [DBG] pgmap v458: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:24 smithi051 bash[18409]: cluster 2020-06-27T04:52:23.454224+0000 mgr.x (mgr.34109) 377 : cluster [DBG] pgmap v459: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:24.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:24 smithi031 bash[18426]: cluster 2020-06-27T04:52:23.454224+0000 mgr.x (mgr.34109) 377 : cluster [DBG] pgmap v459: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:24 smithi031 bash[22603]: cluster 2020-06-27T04:52:23.454224+0000 mgr.x (mgr.34109) 377 : cluster [DBG] pgmap v459: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:26.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:26 smithi051 bash[18409]: cluster 2020-06-27T04:52:25.456628+0000 mgr.x (mgr.34109) 378 : cluster [DBG] pgmap v460: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:26 smithi031 bash[18426]: cluster 2020-06-27T04:52:25.456628+0000 mgr.x (mgr.34109) 378 : cluster [DBG] pgmap v460: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:26.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:26 smithi031 bash[22603]: cluster 2020-06-27T04:52:25.456628+0000 mgr.x (mgr.34109) 378 : cluster [DBG] pgmap v460: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:28.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:28 smithi051 bash[18409]: cluster 2020-06-27T04:52:27.458744+0000 mgr.x (mgr.34109) 379 : cluster [DBG] pgmap v461: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:28.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:28 smithi031 bash[18426]: cluster 2020-06-27T04:52:27.458744+0000 mgr.x (mgr.34109) 379 : cluster [DBG] pgmap v461: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:28.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:28 smithi031 bash[22603]: cluster 2020-06-27T04:52:27.458744+0000 mgr.x (mgr.34109) 379 : cluster [DBG] pgmap v461: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:30.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:30 smithi051 bash[18409]: cluster 2020-06-27T04:52:29.460720+0000 mgr.x (mgr.34109) 380 : cluster [DBG] pgmap v462: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:30.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:30 smithi031 bash[18426]: cluster 2020-06-27T04:52:29.460720+0000 mgr.x (mgr.34109) 380 : cluster [DBG] pgmap v462: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:30.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:30 smithi031 bash[22603]: cluster 2020-06-27T04:52:29.460720+0000 mgr.x (mgr.34109) 380 : cluster [DBG] pgmap v462: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:32.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:32 smithi051 bash[18409]: cluster 2020-06-27T04:52:31.463019+0000 mgr.x (mgr.34109) 381 : cluster [DBG] pgmap v463: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:32.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:32 smithi031 bash[18426]: cluster 2020-06-27T04:52:31.463019+0000 mgr.x (mgr.34109) 381 : cluster [DBG] pgmap v463: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:32.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:32 smithi031 bash[22603]: cluster 2020-06-27T04:52:31.463019+0000 mgr.x (mgr.34109) 381 : cluster [DBG] pgmap v463: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:34.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:34 smithi051 bash[18409]: cluster 2020-06-27T04:52:33.465258+0000 mgr.x (mgr.34109) 382 : cluster [DBG] pgmap v464: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:34 smithi031 bash[18426]: cluster 2020-06-27T04:52:33.465258+0000 mgr.x (mgr.34109) 382 : cluster [DBG] pgmap v464: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:34 smithi031 bash[22603]: cluster 2020-06-27T04:52:33.465258+0000 mgr.x (mgr.34109) 382 : cluster [DBG] pgmap v464: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:36 smithi051 bash[18409]: cluster 2020-06-27T04:52:35.467674+0000 mgr.x (mgr.34109) 383 : cluster [DBG] pgmap v465: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:36 smithi031 bash[18426]: cluster 2020-06-27T04:52:35.467674+0000 mgr.x (mgr.34109) 383 : cluster [DBG] pgmap v465: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:36.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:36 smithi031 bash[22603]: cluster 2020-06-27T04:52:35.467674+0000 mgr.x (mgr.34109) 383 : cluster [DBG] pgmap v465: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:38.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:38 smithi051 bash[18409]: cluster 2020-06-27T04:52:37.469862+0000 mgr.x (mgr.34109) 384 : cluster [DBG] pgmap v466: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:38 smithi031 bash[18426]: cluster 2020-06-27T04:52:37.469862+0000 mgr.x (mgr.34109) 384 : cluster [DBG] pgmap v466: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:38 smithi031 bash[22603]: cluster 2020-06-27T04:52:37.469862+0000 mgr.x (mgr.34109) 384 : cluster [DBG] pgmap v466: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:40.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:40 smithi051 bash[18409]: cluster 2020-06-27T04:52:39.471877+0000 mgr.x (mgr.34109) 385 : cluster [DBG] pgmap v467: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:40.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:40 smithi031 bash[18426]: cluster 2020-06-27T04:52:39.471877+0000 mgr.x (mgr.34109) 385 : cluster [DBG] pgmap v467: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:40.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:40 smithi031 bash[22603]: cluster 2020-06-27T04:52:39.471877+0000 mgr.x (mgr.34109) 385 : cluster [DBG] pgmap v467: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:42.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:42 smithi051 bash[18409]: cluster 2020-06-27T04:52:41.474307+0000 mgr.x (mgr.34109) 386 : cluster [DBG] pgmap v468: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:42.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:42 smithi031 bash[22603]: cluster 2020-06-27T04:52:41.474307+0000 mgr.x (mgr.34109) 386 : cluster [DBG] pgmap v468: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:42.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:42 smithi031 bash[18426]: cluster 2020-06-27T04:52:41.474307+0000 mgr.x (mgr.34109) 386 : cluster [DBG] pgmap v468: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:44.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:44 smithi051 bash[18409]: cluster 2020-06-27T04:52:43.476052+0000 mgr.x (mgr.34109) 387 : cluster [DBG] pgmap v469: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:44 smithi031 bash[18426]: cluster 2020-06-27T04:52:43.476052+0000 mgr.x (mgr.34109) 387 : cluster [DBG] pgmap v469: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:44 smithi031 bash[22603]: cluster 2020-06-27T04:52:43.476052+0000 mgr.x (mgr.34109) 387 : cluster [DBG] pgmap v469: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:46.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:46 smithi051 bash[18409]: cluster 2020-06-27T04:52:45.478652+0000 mgr.x (mgr.34109) 388 : cluster [DBG] pgmap v470: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:46 smithi031 bash[18426]: cluster 2020-06-27T04:52:45.478652+0000 mgr.x (mgr.34109) 388 : cluster [DBG] pgmap v470: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:46.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:46 smithi031 bash[22603]: cluster 2020-06-27T04:52:45.478652+0000 mgr.x (mgr.34109) 388 : cluster [DBG] pgmap v470: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:48.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:48 smithi051 bash[18409]: cluster 2020-06-27T04:52:47.480743+0000 mgr.x (mgr.34109) 389 : cluster [DBG] pgmap v471: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:48.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:48 smithi031 bash[18426]: cluster 2020-06-27T04:52:47.480743+0000 mgr.x (mgr.34109) 389 : cluster [DBG] pgmap v471: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:48.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:48 smithi031 bash[22603]: cluster 2020-06-27T04:52:47.480743+0000 mgr.x (mgr.34109) 389 : cluster [DBG] pgmap v471: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:50.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:50 smithi051 bash[18409]: cluster 2020-06-27T04:52:49.482821+0000 mgr.x (mgr.34109) 390 : cluster [DBG] pgmap v472: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:50.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:50 smithi031 bash[18426]: cluster 2020-06-27T04:52:49.482821+0000 mgr.x (mgr.34109) 390 : cluster [DBG] pgmap v472: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:50.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:50 smithi031 bash[22603]: cluster 2020-06-27T04:52:49.482821+0000 mgr.x (mgr.34109) 390 : cluster [DBG] pgmap v472: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:52 smithi051 bash[18409]: cluster 2020-06-27T04:52:51.485404+0000 mgr.x (mgr.34109) 391 : cluster [DBG] pgmap v473: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:52 smithi031 bash[18426]: cluster 2020-06-27T04:52:51.485404+0000 mgr.x (mgr.34109) 391 : cluster [DBG] pgmap v473: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:52 smithi031 bash[22603]: cluster 2020-06-27T04:52:51.485404+0000 mgr.x (mgr.34109) 391 : cluster [DBG] pgmap v473: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:54.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:54 smithi051 bash[18409]: cluster 2020-06-27T04:52:53.487027+0000 mgr.x (mgr.34109) 392 : cluster [DBG] pgmap v474: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:54.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:54 smithi031 bash[18426]: cluster 2020-06-27T04:52:53.487027+0000 mgr.x (mgr.34109) 392 : cluster [DBG] pgmap v474: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:54 smithi031 bash[22603]: cluster 2020-06-27T04:52:53.487027+0000 mgr.x (mgr.34109) 392 : cluster [DBG] pgmap v474: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:56.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:56 smithi051 bash[18409]: cluster 2020-06-27T04:52:55.489413+0000 mgr.x (mgr.34109) 393 : cluster [DBG] pgmap v475: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:56.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:56 smithi031 bash[18426]: cluster 2020-06-27T04:52:55.489413+0000 mgr.x (mgr.34109) 393 : cluster [DBG] pgmap v475: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:56.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:56 smithi031 bash[22603]: cluster 2020-06-27T04:52:55.489413+0000 mgr.x (mgr.34109) 393 : cluster [DBG] pgmap v475: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:58.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:52:58 smithi051 bash[18409]: cluster 2020-06-27T04:52:57.491614+0000 mgr.x (mgr.34109) 394 : cluster [DBG] pgmap v476: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:58.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:52:58 smithi031 bash[18426]: cluster 2020-06-27T04:52:57.491614+0000 mgr.x (mgr.34109) 394 : cluster [DBG] pgmap v476: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:52:58.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:52:58 smithi031 bash[22603]: cluster 2020-06-27T04:52:57.491614+0000 mgr.x (mgr.34109) 394 : cluster [DBG] pgmap v476: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:00.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:00 smithi051 bash[18409]: cluster 2020-06-27T04:52:59.493579+0000 mgr.x (mgr.34109) 395 : cluster [DBG] pgmap v477: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:00.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:00 smithi031 bash[18426]: cluster 2020-06-27T04:52:59.493579+0000 mgr.x (mgr.34109) 395 : cluster [DBG] pgmap v477: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:00.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:00 smithi031 bash[22603]: cluster 2020-06-27T04:52:59.493579+0000 mgr.x (mgr.34109) 395 : cluster [DBG] pgmap v477: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:02.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:02 smithi051 bash[18409]: cluster 2020-06-27T04:53:01.495939+0000 mgr.x (mgr.34109) 396 : cluster [DBG] pgmap v478: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:02.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:02 smithi031 bash[22603]: cluster 2020-06-27T04:53:01.495939+0000 mgr.x (mgr.34109) 396 : cluster [DBG] pgmap v478: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:02.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:02 smithi031 bash[18426]: cluster 2020-06-27T04:53:01.495939+0000 mgr.x (mgr.34109) 396 : cluster [DBG] pgmap v478: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:04.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:04 smithi051 bash[18409]: cluster 2020-06-27T04:53:03.497507+0000 mgr.x (mgr.34109) 397 : cluster [DBG] pgmap v479: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:04.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:04 smithi031 bash[18426]: cluster 2020-06-27T04:53:03.497507+0000 mgr.x (mgr.34109) 397 : cluster [DBG] pgmap v479: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:04.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:04 smithi031 bash[22603]: cluster 2020-06-27T04:53:03.497507+0000 mgr.x (mgr.34109) 397 : cluster [DBG] pgmap v479: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:06.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:06 smithi051 bash[18409]: cluster 2020-06-27T04:53:05.499844+0000 mgr.x (mgr.34109) 398 : cluster [DBG] pgmap v480: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:06.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:06 smithi031 bash[18426]: cluster 2020-06-27T04:53:05.499844+0000 mgr.x (mgr.34109) 398 : cluster [DBG] pgmap v480: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:06.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:06 smithi031 bash[22603]: cluster 2020-06-27T04:53:05.499844+0000 mgr.x (mgr.34109) 398 : cluster [DBG] pgmap v480: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:08.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:08 smithi051 bash[18409]: cluster 2020-06-27T04:53:07.502096+0000 mgr.x (mgr.34109) 399 : cluster [DBG] pgmap v481: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:08.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:08 smithi031 bash[18426]: cluster 2020-06-27T04:53:07.502096+0000 mgr.x (mgr.34109) 399 : cluster [DBG] pgmap v481: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:08.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:08 smithi031 bash[22603]: cluster 2020-06-27T04:53:07.502096+0000 mgr.x (mgr.34109) 399 : cluster [DBG] pgmap v481: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:10.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:10 smithi051 bash[18409]: cluster 2020-06-27T04:53:09.504043+0000 mgr.x (mgr.34109) 400 : cluster [DBG] pgmap v482: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:10.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:10 smithi031 bash[18426]: cluster 2020-06-27T04:53:09.504043+0000 mgr.x (mgr.34109) 400 : cluster [DBG] pgmap v482: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:10.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:10 smithi031 bash[22603]: cluster 2020-06-27T04:53:09.504043+0000 mgr.x (mgr.34109) 400 : cluster [DBG] pgmap v482: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:12.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:12 smithi051 bash[18409]: cluster 2020-06-27T04:53:11.506543+0000 mgr.x (mgr.34109) 401 : cluster [DBG] pgmap v483: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:12 smithi031 bash[18426]: cluster 2020-06-27T04:53:11.506543+0000 mgr.x (mgr.34109) 401 : cluster [DBG] pgmap v483: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:12.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:12 smithi031 bash[22603]: cluster 2020-06-27T04:53:11.506543+0000 mgr.x (mgr.34109) 401 : cluster [DBG] pgmap v483: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:14 smithi051 bash[18409]: cluster 2020-06-27T04:53:13.508028+0000 mgr.x (mgr.34109) 402 : cluster [DBG] pgmap v484: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:14 smithi031 bash[18426]: cluster 2020-06-27T04:53:13.508028+0000 mgr.x (mgr.34109) 402 : cluster [DBG] pgmap v484: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:14 smithi031 bash[22603]: cluster 2020-06-27T04:53:13.508028+0000 mgr.x (mgr.34109) 402 : cluster [DBG] pgmap v484: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:16 smithi051 bash[18409]: cluster 2020-06-27T04:53:15.510606+0000 mgr.x (mgr.34109) 403 : cluster [DBG] pgmap v485: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:16 smithi031 bash[18426]: cluster 2020-06-27T04:53:15.510606+0000 mgr.x (mgr.34109) 403 : cluster [DBG] pgmap v485: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:16 smithi031 bash[22603]: cluster 2020-06-27T04:53:15.510606+0000 mgr.x (mgr.34109) 403 : cluster [DBG] pgmap v485: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:18.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:18 smithi051 bash[18409]: cluster 2020-06-27T04:53:17.512631+0000 mgr.x (mgr.34109) 404 : cluster [DBG] pgmap v486: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:18 smithi031 bash[18426]: cluster 2020-06-27T04:53:17.512631+0000 mgr.x (mgr.34109) 404 : cluster [DBG] pgmap v486: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:18 smithi031 bash[22603]: cluster 2020-06-27T04:53:17.512631+0000 mgr.x (mgr.34109) 404 : cluster [DBG] pgmap v486: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:20.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:20 smithi051 bash[18409]: cluster 2020-06-27T04:53:19.514609+0000 mgr.x (mgr.34109) 405 : cluster [DBG] pgmap v487: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:20.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:20 smithi031 bash[18426]: cluster 2020-06-27T04:53:19.514609+0000 mgr.x (mgr.34109) 405 : cluster [DBG] pgmap v487: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:20.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:20 smithi031 bash[22603]: cluster 2020-06-27T04:53:19.514609+0000 mgr.x (mgr.34109) 405 : cluster [DBG] pgmap v487: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:22 smithi051 bash[18409]: cluster 2020-06-27T04:53:21.517042+0000 mgr.x (mgr.34109) 406 : cluster [DBG] pgmap v488: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:22.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:22 smithi031 bash[18426]: cluster 2020-06-27T04:53:21.517042+0000 mgr.x (mgr.34109) 406 : cluster [DBG] pgmap v488: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:22.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:22 smithi031 bash[22603]: cluster 2020-06-27T04:53:21.517042+0000 mgr.x (mgr.34109) 406 : cluster [DBG] pgmap v488: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:24 smithi051 bash[18409]: cluster 2020-06-27T04:53:23.518655+0000 mgr.x (mgr.34109) 407 : cluster [DBG] pgmap v489: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:24.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:24 smithi031 bash[18426]: cluster 2020-06-27T04:53:23.518655+0000 mgr.x (mgr.34109) 407 : cluster [DBG] pgmap v489: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:24 smithi031 bash[22603]: cluster 2020-06-27T04:53:23.518655+0000 mgr.x (mgr.34109) 407 : cluster [DBG] pgmap v489: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:26.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:26 smithi051 bash[18409]: cluster 2020-06-27T04:53:25.520938+0000 mgr.x (mgr.34109) 408 : cluster [DBG] pgmap v490: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:26 smithi031 bash[18426]: cluster 2020-06-27T04:53:25.520938+0000 mgr.x (mgr.34109) 408 : cluster [DBG] pgmap v490: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:26.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:26 smithi031 bash[22603]: cluster 2020-06-27T04:53:25.520938+0000 mgr.x (mgr.34109) 408 : cluster [DBG] pgmap v490: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:28.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:28 smithi051 bash[18409]: cluster 2020-06-27T04:53:27.523022+0000 mgr.x (mgr.34109) 409 : cluster [DBG] pgmap v491: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:28.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:28 smithi031 bash[18426]: cluster 2020-06-27T04:53:27.523022+0000 mgr.x (mgr.34109) 409 : cluster [DBG] pgmap v491: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:28.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:28 smithi031 bash[22603]: cluster 2020-06-27T04:53:27.523022+0000 mgr.x (mgr.34109) 409 : cluster [DBG] pgmap v491: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:30.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:30 smithi051 bash[18409]: cluster 2020-06-27T04:53:29.525070+0000 mgr.x (mgr.34109) 410 : cluster [DBG] pgmap v492: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:30.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:30 smithi031 bash[18426]: cluster 2020-06-27T04:53:29.525070+0000 mgr.x (mgr.34109) 410 : cluster [DBG] pgmap v492: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:30.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:30 smithi031 bash[22603]: cluster 2020-06-27T04:53:29.525070+0000 mgr.x (mgr.34109) 410 : cluster [DBG] pgmap v492: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:32.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:32 smithi051 bash[18409]: cluster 2020-06-27T04:53:31.527522+0000 mgr.x (mgr.34109) 411 : cluster [DBG] pgmap v493: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:32.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:32 smithi031 bash[18426]: cluster 2020-06-27T04:53:31.527522+0000 mgr.x (mgr.34109) 411 : cluster [DBG] pgmap v493: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:32.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:32 smithi031 bash[22603]: cluster 2020-06-27T04:53:31.527522+0000 mgr.x (mgr.34109) 411 : cluster [DBG] pgmap v493: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:34.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:34 smithi051 bash[18409]: cluster 2020-06-27T04:53:33.529050+0000 mgr.x (mgr.34109) 412 : cluster [DBG] pgmap v494: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:34 smithi031 bash[18426]: cluster 2020-06-27T04:53:33.529050+0000 mgr.x (mgr.34109) 412 : cluster [DBG] pgmap v494: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:34 smithi031 bash[22603]: cluster 2020-06-27T04:53:33.529050+0000 mgr.x (mgr.34109) 412 : cluster [DBG] pgmap v494: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:36 smithi051 bash[18409]: cluster 2020-06-27T04:53:35.531441+0000 mgr.x (mgr.34109) 413 : cluster [DBG] pgmap v495: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:36 smithi031 bash[18426]: cluster 2020-06-27T04:53:35.531441+0000 mgr.x (mgr.34109) 413 : cluster [DBG] pgmap v495: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:36.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:36 smithi031 bash[22603]: cluster 2020-06-27T04:53:35.531441+0000 mgr.x (mgr.34109) 413 : cluster [DBG] pgmap v495: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:38.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:38 smithi051 bash[18409]: cluster 2020-06-27T04:53:37.533647+0000 mgr.x (mgr.34109) 414 : cluster [DBG] pgmap v496: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:38 smithi031 bash[18426]: cluster 2020-06-27T04:53:37.533647+0000 mgr.x (mgr.34109) 414 : cluster [DBG] pgmap v496: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:38 smithi031 bash[22603]: cluster 2020-06-27T04:53:37.533647+0000 mgr.x (mgr.34109) 414 : cluster [DBG] pgmap v496: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:40.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:40 smithi051 bash[18409]: cluster 2020-06-27T04:53:39.535605+0000 mgr.x (mgr.34109) 415 : cluster [DBG] pgmap v497: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:40.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:40 smithi031 bash[18426]: cluster 2020-06-27T04:53:39.535605+0000 mgr.x (mgr.34109) 415 : cluster [DBG] pgmap v497: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:40.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:40 smithi031 bash[22603]: cluster 2020-06-27T04:53:39.535605+0000 mgr.x (mgr.34109) 415 : cluster [DBG] pgmap v497: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:42.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:42 smithi051 bash[18409]: cluster 2020-06-27T04:53:41.537962+0000 mgr.x (mgr.34109) 416 : cluster [DBG] pgmap v498: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:42.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:42 smithi031 bash[22603]: cluster 2020-06-27T04:53:41.537962+0000 mgr.x (mgr.34109) 416 : cluster [DBG] pgmap v498: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:42.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:42 smithi031 bash[18426]: cluster 2020-06-27T04:53:41.537962+0000 mgr.x (mgr.34109) 416 : cluster [DBG] pgmap v498: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:44.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:44 smithi051 bash[18409]: cluster 2020-06-27T04:53:43.539588+0000 mgr.x (mgr.34109) 417 : cluster [DBG] pgmap v499: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:44 smithi031 bash[18426]: cluster 2020-06-27T04:53:43.539588+0000 mgr.x (mgr.34109) 417 : cluster [DBG] pgmap v499: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:44 smithi031 bash[22603]: cluster 2020-06-27T04:53:43.539588+0000 mgr.x (mgr.34109) 417 : cluster [DBG] pgmap v499: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:46.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:46 smithi051 bash[18409]: cluster 2020-06-27T04:53:45.542017+0000 mgr.x (mgr.34109) 418 : cluster [DBG] pgmap v500: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:46.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:46 smithi031 bash[22603]: cluster 2020-06-27T04:53:45.542017+0000 mgr.x (mgr.34109) 418 : cluster [DBG] pgmap v500: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:46 smithi031 bash[18426]: cluster 2020-06-27T04:53:45.542017+0000 mgr.x (mgr.34109) 418 : cluster [DBG] pgmap v500: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:48.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:48 smithi051 bash[18409]: cluster 2020-06-27T04:53:47.544076+0000 mgr.x (mgr.34109) 419 : cluster [DBG] pgmap v501: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:48.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:48 smithi031 bash[18426]: cluster 2020-06-27T04:53:47.544076+0000 mgr.x (mgr.34109) 419 : cluster [DBG] pgmap v501: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:48.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:48 smithi031 bash[22603]: cluster 2020-06-27T04:53:47.544076+0000 mgr.x (mgr.34109) 419 : cluster [DBG] pgmap v501: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:50.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:50 smithi051 bash[18409]: cluster 2020-06-27T04:53:49.546224+0000 mgr.x (mgr.34109) 420 : cluster [DBG] pgmap v502: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:50.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:50 smithi031 bash[18426]: cluster 2020-06-27T04:53:49.546224+0000 mgr.x (mgr.34109) 420 : cluster [DBG] pgmap v502: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:50.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:50 smithi031 bash[22603]: cluster 2020-06-27T04:53:49.546224+0000 mgr.x (mgr.34109) 420 : cluster [DBG] pgmap v502: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:52 smithi051 bash[18409]: cluster 2020-06-27T04:53:51.548471+0000 mgr.x (mgr.34109) 421 : cluster [DBG] pgmap v503: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:52 smithi031 bash[18426]: cluster 2020-06-27T04:53:51.548471+0000 mgr.x (mgr.34109) 421 : cluster [DBG] pgmap v503: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:52 smithi031 bash[22603]: cluster 2020-06-27T04:53:51.548471+0000 mgr.x (mgr.34109) 421 : cluster [DBG] pgmap v503: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:54.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:54 smithi051 bash[18409]: cluster 2020-06-27T04:53:53.550108+0000 mgr.x (mgr.34109) 422 : cluster [DBG] pgmap v504: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:54.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:54 smithi031 bash[18426]: cluster 2020-06-27T04:53:53.550108+0000 mgr.x (mgr.34109) 422 : cluster [DBG] pgmap v504: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:54 smithi031 bash[22603]: cluster 2020-06-27T04:53:53.550108+0000 mgr.x (mgr.34109) 422 : cluster [DBG] pgmap v504: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:56.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:56 smithi051 bash[18409]: cluster 2020-06-27T04:53:55.552427+0000 mgr.x (mgr.34109) 423 : cluster [DBG] pgmap v505: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:56.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:56 smithi031 bash[18426]: cluster 2020-06-27T04:53:55.552427+0000 mgr.x (mgr.34109) 423 : cluster [DBG] pgmap v505: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:56.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:56 smithi031 bash[22603]: cluster 2020-06-27T04:53:55.552427+0000 mgr.x (mgr.34109) 423 : cluster [DBG] pgmap v505: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:58.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:53:58 smithi051 bash[18409]: cluster 2020-06-27T04:53:57.554425+0000 mgr.x (mgr.34109) 424 : cluster [DBG] pgmap v506: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:58.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:53:58 smithi031 bash[18426]: cluster 2020-06-27T04:53:57.554425+0000 mgr.x (mgr.34109) 424 : cluster [DBG] pgmap v506: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:53:58.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:53:58 smithi031 bash[22603]: cluster 2020-06-27T04:53:57.554425+0000 mgr.x (mgr.34109) 424 : cluster [DBG] pgmap v506: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:00.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:00 smithi051 bash[18409]: cluster 2020-06-27T04:53:59.556348+0000 mgr.x (mgr.34109) 425 : cluster [DBG] pgmap v507: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:00.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:00 smithi031 bash[18426]: cluster 2020-06-27T04:53:59.556348+0000 mgr.x (mgr.34109) 425 : cluster [DBG] pgmap v507: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:00.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:00 smithi031 bash[22603]: cluster 2020-06-27T04:53:59.556348+0000 mgr.x (mgr.34109) 425 : cluster [DBG] pgmap v507: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:02.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:02 smithi051 bash[18409]: cluster 2020-06-27T04:54:01.558646+0000 mgr.x (mgr.34109) 426 : cluster [DBG] pgmap v508: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:02.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:02 smithi031 bash[22603]: cluster 2020-06-27T04:54:01.558646+0000 mgr.x (mgr.34109) 426 : cluster [DBG] pgmap v508: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:02.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:02 smithi031 bash[18426]: cluster 2020-06-27T04:54:01.558646+0000 mgr.x (mgr.34109) 426 : cluster [DBG] pgmap v508: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:04.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:04 smithi051 bash[18409]: cluster 2020-06-27T04:54:03.560272+0000 mgr.x (mgr.34109) 427 : cluster [DBG] pgmap v509: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:04.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:04 smithi031 bash[18426]: cluster 2020-06-27T04:54:03.560272+0000 mgr.x (mgr.34109) 427 : cluster [DBG] pgmap v509: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:04.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:04 smithi031 bash[22603]: cluster 2020-06-27T04:54:03.560272+0000 mgr.x (mgr.34109) 427 : cluster [DBG] pgmap v509: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:06.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:06 smithi051 bash[18409]: cluster 2020-06-27T04:54:05.562678+0000 mgr.x (mgr.34109) 428 : cluster [DBG] pgmap v510: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:06.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:06 smithi031 bash[18426]: cluster 2020-06-27T04:54:05.562678+0000 mgr.x (mgr.34109) 428 : cluster [DBG] pgmap v510: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:06.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:06 smithi031 bash[22603]: cluster 2020-06-27T04:54:05.562678+0000 mgr.x (mgr.34109) 428 : cluster [DBG] pgmap v510: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:08.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:08 smithi051 bash[18409]: cluster 2020-06-27T04:54:07.564840+0000 mgr.x (mgr.34109) 429 : cluster [DBG] pgmap v511: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:08.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:08 smithi031 bash[18426]: cluster 2020-06-27T04:54:07.564840+0000 mgr.x (mgr.34109) 429 : cluster [DBG] pgmap v511: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:08.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:08 smithi031 bash[22603]: cluster 2020-06-27T04:54:07.564840+0000 mgr.x (mgr.34109) 429 : cluster [DBG] pgmap v511: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:10.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:10 smithi051 bash[18409]: cluster 2020-06-27T04:54:09.566793+0000 mgr.x (mgr.34109) 430 : cluster [DBG] pgmap v512: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:10.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:10 smithi031 bash[18426]: cluster 2020-06-27T04:54:09.566793+0000 mgr.x (mgr.34109) 430 : cluster [DBG] pgmap v512: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:10.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:10 smithi031 bash[22603]: cluster 2020-06-27T04:54:09.566793+0000 mgr.x (mgr.34109) 430 : cluster [DBG] pgmap v512: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:12.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:12 smithi051 bash[18409]: cluster 2020-06-27T04:54:11.569308+0000 mgr.x (mgr.34109) 431 : cluster [DBG] pgmap v513: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:12 smithi031 bash[18426]: cluster 2020-06-27T04:54:11.569308+0000 mgr.x (mgr.34109) 431 : cluster [DBG] pgmap v513: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:12.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:12 smithi031 bash[22603]: cluster 2020-06-27T04:54:11.569308+0000 mgr.x (mgr.34109) 431 : cluster [DBG] pgmap v513: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:14 smithi051 bash[18409]: cluster 2020-06-27T04:54:13.570883+0000 mgr.x (mgr.34109) 432 : cluster [DBG] pgmap v514: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:14 smithi031 bash[18426]: cluster 2020-06-27T04:54:13.570883+0000 mgr.x (mgr.34109) 432 : cluster [DBG] pgmap v514: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:14 smithi031 bash[22603]: cluster 2020-06-27T04:54:13.570883+0000 mgr.x (mgr.34109) 432 : cluster [DBG] pgmap v514: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:16 smithi051 bash[18409]: cluster 2020-06-27T04:54:15.573259+0000 mgr.x (mgr.34109) 433 : cluster [DBG] pgmap v515: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:16 smithi031 bash[18426]: cluster 2020-06-27T04:54:15.573259+0000 mgr.x (mgr.34109) 433 : cluster [DBG] pgmap v515: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:16 smithi031 bash[22603]: cluster 2020-06-27T04:54:15.573259+0000 mgr.x (mgr.34109) 433 : cluster [DBG] pgmap v515: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:18.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:18 smithi051 bash[18409]: cluster 2020-06-27T04:54:17.575476+0000 mgr.x (mgr.34109) 434 : cluster [DBG] pgmap v516: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:18 smithi031 bash[18426]: cluster 2020-06-27T04:54:17.575476+0000 mgr.x (mgr.34109) 434 : cluster [DBG] pgmap v516: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:18 smithi031 bash[22603]: cluster 2020-06-27T04:54:17.575476+0000 mgr.x (mgr.34109) 434 : cluster [DBG] pgmap v516: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:20.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:20 smithi051 bash[18409]: cluster 2020-06-27T04:54:19.577434+0000 mgr.x (mgr.34109) 435 : cluster [DBG] pgmap v517: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:20.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:20 smithi031 bash[18426]: cluster 2020-06-27T04:54:19.577434+0000 mgr.x (mgr.34109) 435 : cluster [DBG] pgmap v517: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:20.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:20 smithi031 bash[22603]: cluster 2020-06-27T04:54:19.577434+0000 mgr.x (mgr.34109) 435 : cluster [DBG] pgmap v517: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:22 smithi051 bash[18409]: cluster 2020-06-27T04:54:21.579776+0000 mgr.x (mgr.34109) 436 : cluster [DBG] pgmap v518: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:22.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:22 smithi031 bash[18426]: cluster 2020-06-27T04:54:21.579776+0000 mgr.x (mgr.34109) 436 : cluster [DBG] pgmap v518: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:22.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:22 smithi031 bash[22603]: cluster 2020-06-27T04:54:21.579776+0000 mgr.x (mgr.34109) 436 : cluster [DBG] pgmap v518: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:24 smithi051 bash[18409]: cluster 2020-06-27T04:54:23.581253+0000 mgr.x (mgr.34109) 437 : cluster [DBG] pgmap v519: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:24.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:24 smithi031 bash[18426]: cluster 2020-06-27T04:54:23.581253+0000 mgr.x (mgr.34109) 437 : cluster [DBG] pgmap v519: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:24 smithi031 bash[22603]: cluster 2020-06-27T04:54:23.581253+0000 mgr.x (mgr.34109) 437 : cluster [DBG] pgmap v519: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:26.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:26 smithi051 bash[18409]: cluster 2020-06-27T04:54:25.583661+0000 mgr.x (mgr.34109) 438 : cluster [DBG] pgmap v520: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:26 smithi031 bash[18426]: cluster 2020-06-27T04:54:25.583661+0000 mgr.x (mgr.34109) 438 : cluster [DBG] pgmap v520: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:26.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:26 smithi031 bash[22603]: cluster 2020-06-27T04:54:25.583661+0000 mgr.x (mgr.34109) 438 : cluster [DBG] pgmap v520: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:28.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:28 smithi051 bash[18409]: cluster 2020-06-27T04:54:27.585726+0000 mgr.x (mgr.34109) 439 : cluster [DBG] pgmap v521: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:28.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:28 smithi031 bash[18426]: cluster 2020-06-27T04:54:27.585726+0000 mgr.x (mgr.34109) 439 : cluster [DBG] pgmap v521: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:28.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:28 smithi031 bash[22603]: cluster 2020-06-27T04:54:27.585726+0000 mgr.x (mgr.34109) 439 : cluster [DBG] pgmap v521: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:30.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:30 smithi051 bash[18409]: cluster 2020-06-27T04:54:29.587812+0000 mgr.x (mgr.34109) 440 : cluster [DBG] pgmap v522: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:30.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:30 smithi031 bash[18426]: cluster 2020-06-27T04:54:29.587812+0000 mgr.x (mgr.34109) 440 : cluster [DBG] pgmap v522: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:30.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:30 smithi031 bash[22603]: cluster 2020-06-27T04:54:29.587812+0000 mgr.x (mgr.34109) 440 : cluster [DBG] pgmap v522: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:32.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:32 smithi051 bash[18409]: cluster 2020-06-27T04:54:31.590328+0000 mgr.x (mgr.34109) 441 : cluster [DBG] pgmap v523: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:32.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:32 smithi031 bash[18426]: cluster 2020-06-27T04:54:31.590328+0000 mgr.x (mgr.34109) 441 : cluster [DBG] pgmap v523: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:32.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:32 smithi031 bash[22603]: cluster 2020-06-27T04:54:31.590328+0000 mgr.x (mgr.34109) 441 : cluster [DBG] pgmap v523: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:34.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:34 smithi051 bash[18409]: cluster 2020-06-27T04:54:33.591906+0000 mgr.x (mgr.34109) 442 : cluster [DBG] pgmap v524: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:34 smithi031 bash[18426]: cluster 2020-06-27T04:54:33.591906+0000 mgr.x (mgr.34109) 442 : cluster [DBG] pgmap v524: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:34 smithi031 bash[22603]: cluster 2020-06-27T04:54:33.591906+0000 mgr.x (mgr.34109) 442 : cluster [DBG] pgmap v524: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:36 smithi051 bash[18409]: cluster 2020-06-27T04:54:35.594549+0000 mgr.x (mgr.34109) 443 : cluster [DBG] pgmap v525: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:36 smithi031 bash[18426]: cluster 2020-06-27T04:54:35.594549+0000 mgr.x (mgr.34109) 443 : cluster [DBG] pgmap v525: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:36.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:36 smithi031 bash[22603]: cluster 2020-06-27T04:54:35.594549+0000 mgr.x (mgr.34109) 443 : cluster [DBG] pgmap v525: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:38.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:38 smithi051 bash[18409]: cluster 2020-06-27T04:54:37.596605+0000 mgr.x (mgr.34109) 444 : cluster [DBG] pgmap v526: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:38 smithi031 bash[18426]: cluster 2020-06-27T04:54:37.596605+0000 mgr.x (mgr.34109) 444 : cluster [DBG] pgmap v526: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:38 smithi031 bash[22603]: cluster 2020-06-27T04:54:37.596605+0000 mgr.x (mgr.34109) 444 : cluster [DBG] pgmap v526: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:40.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:40 smithi051 bash[18409]: cluster 2020-06-27T04:54:39.598680+0000 mgr.x (mgr.34109) 445 : cluster [DBG] pgmap v527: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:40.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:40 smithi031 bash[18426]: cluster 2020-06-27T04:54:39.598680+0000 mgr.x (mgr.34109) 445 : cluster [DBG] pgmap v527: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:40.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:40 smithi031 bash[22603]: cluster 2020-06-27T04:54:39.598680+0000 mgr.x (mgr.34109) 445 : cluster [DBG] pgmap v527: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:42.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:42 smithi051 bash[18409]: cluster 2020-06-27T04:54:41.601012+0000 mgr.x (mgr.34109) 446 : cluster [DBG] pgmap v528: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:42.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:42 smithi031 bash[18426]: cluster 2020-06-27T04:54:41.601012+0000 mgr.x (mgr.34109) 446 : cluster [DBG] pgmap v528: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:42.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:42 smithi031 bash[22603]: cluster 2020-06-27T04:54:41.601012+0000 mgr.x (mgr.34109) 446 : cluster [DBG] pgmap v528: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:44.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:44 smithi051 bash[18409]: cluster 2020-06-27T04:54:43.602601+0000 mgr.x (mgr.34109) 447 : cluster [DBG] pgmap v529: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:44.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:44 smithi031 bash[18426]: cluster 2020-06-27T04:54:43.602601+0000 mgr.x (mgr.34109) 447 : cluster [DBG] pgmap v529: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:44.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:44 smithi031 bash[22603]: cluster 2020-06-27T04:54:43.602601+0000 mgr.x (mgr.34109) 447 : cluster [DBG] pgmap v529: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:46.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:46 smithi051 bash[18409]: cluster 2020-06-27T04:54:45.605198+0000 mgr.x (mgr.34109) 448 : cluster [DBG] pgmap v530: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:46 smithi031 bash[18426]: cluster 2020-06-27T04:54:45.605198+0000 mgr.x (mgr.34109) 448 : cluster [DBG] pgmap v530: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:46.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:46 smithi031 bash[22603]: cluster 2020-06-27T04:54:45.605198+0000 mgr.x (mgr.34109) 448 : cluster [DBG] pgmap v530: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:48.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:48 smithi051 bash[18409]: cluster 2020-06-27T04:54:47.607269+0000 mgr.x (mgr.34109) 449 : cluster [DBG] pgmap v531: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:48.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:48 smithi031 bash[18426]: cluster 2020-06-27T04:54:47.607269+0000 mgr.x (mgr.34109) 449 : cluster [DBG] pgmap v531: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:48.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:48 smithi031 bash[22603]: cluster 2020-06-27T04:54:47.607269+0000 mgr.x (mgr.34109) 449 : cluster [DBG] pgmap v531: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:50.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:50 smithi051 bash[18409]: cluster 2020-06-27T04:54:49.609229+0000 mgr.x (mgr.34109) 450 : cluster [DBG] pgmap v532: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:50.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:50 smithi031 bash[18426]: cluster 2020-06-27T04:54:49.609229+0000 mgr.x (mgr.34109) 450 : cluster [DBG] pgmap v532: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:50.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:50 smithi031 bash[22603]: cluster 2020-06-27T04:54:49.609229+0000 mgr.x (mgr.34109) 450 : cluster [DBG] pgmap v532: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:52 smithi051 bash[18409]: cluster 2020-06-27T04:54:51.611541+0000 mgr.x (mgr.34109) 451 : cluster [DBG] pgmap v533: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:52 smithi031 bash[18426]: cluster 2020-06-27T04:54:51.611541+0000 mgr.x (mgr.34109) 451 : cluster [DBG] pgmap v533: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:52 smithi031 bash[22603]: cluster 2020-06-27T04:54:51.611541+0000 mgr.x (mgr.34109) 451 : cluster [DBG] pgmap v533: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:54.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:54 smithi051 bash[18409]: cluster 2020-06-27T04:54:53.613108+0000 mgr.x (mgr.34109) 452 : cluster [DBG] pgmap v534: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:54.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:54 smithi031 bash[18426]: cluster 2020-06-27T04:54:53.613108+0000 mgr.x (mgr.34109) 452 : cluster [DBG] pgmap v534: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:54 smithi031 bash[22603]: cluster 2020-06-27T04:54:53.613108+0000 mgr.x (mgr.34109) 452 : cluster [DBG] pgmap v534: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:56.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:56 smithi051 bash[18409]: cluster 2020-06-27T04:54:55.615601+0000 mgr.x (mgr.34109) 453 : cluster [DBG] pgmap v535: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:56.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:56 smithi031 bash[18426]: cluster 2020-06-27T04:54:55.615601+0000 mgr.x (mgr.34109) 453 : cluster [DBG] pgmap v535: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:56.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:56 smithi031 bash[22603]: cluster 2020-06-27T04:54:55.615601+0000 mgr.x (mgr.34109) 453 : cluster [DBG] pgmap v535: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:58.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:54:58 smithi051 bash[18409]: cluster 2020-06-27T04:54:57.617649+0000 mgr.x (mgr.34109) 454 : cluster [DBG] pgmap v536: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:58.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:54:58 smithi031 bash[18426]: cluster 2020-06-27T04:54:57.617649+0000 mgr.x (mgr.34109) 454 : cluster [DBG] pgmap v536: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:54:58.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:54:58 smithi031 bash[22603]: cluster 2020-06-27T04:54:57.617649+0000 mgr.x (mgr.34109) 454 : cluster [DBG] pgmap v536: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:00.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:00 smithi031 bash[18426]: cluster 2020-06-27T04:54:59.619514+0000 mgr.x (mgr.34109) 455 : cluster [DBG] pgmap v537: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:00.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:00 smithi031 bash[22603]: cluster 2020-06-27T04:54:59.619514+0000 mgr.x (mgr.34109) 455 : cluster [DBG] pgmap v537: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:00.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:00 smithi051 bash[18409]: cluster 2020-06-27T04:54:59.619514+0000 mgr.x (mgr.34109) 455 : cluster [DBG] pgmap v537: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:02.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:02 smithi051 bash[18409]: cluster 2020-06-27T04:55:01.621949+0000 mgr.x (mgr.34109) 456 : cluster [DBG] pgmap v538: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:02.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:02 smithi031 bash[18426]: cluster 2020-06-27T04:55:01.621949+0000 mgr.x (mgr.34109) 456 : cluster [DBG] pgmap v538: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:02.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:02 smithi031 bash[22603]: cluster 2020-06-27T04:55:01.621949+0000 mgr.x (mgr.34109) 456 : cluster [DBG] pgmap v538: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:04.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:04 smithi051 bash[18409]: cluster 2020-06-27T04:55:03.623561+0000 mgr.x (mgr.34109) 457 : cluster [DBG] pgmap v539: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:04.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:04 smithi031 bash[18426]: cluster 2020-06-27T04:55:03.623561+0000 mgr.x (mgr.34109) 457 : cluster [DBG] pgmap v539: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:04.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:04 smithi031 bash[22603]: cluster 2020-06-27T04:55:03.623561+0000 mgr.x (mgr.34109) 457 : cluster [DBG] pgmap v539: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:06.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:06 smithi051 bash[18409]: cluster 2020-06-27T04:55:05.625877+0000 mgr.x (mgr.34109) 458 : cluster [DBG] pgmap v540: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:06.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:06 smithi031 bash[22603]: cluster 2020-06-27T04:55:05.625877+0000 mgr.x (mgr.34109) 458 : cluster [DBG] pgmap v540: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:06.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:06 smithi031 bash[18426]: cluster 2020-06-27T04:55:05.625877+0000 mgr.x (mgr.34109) 458 : cluster [DBG] pgmap v540: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:08.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:08 smithi051 bash[18409]: cluster 2020-06-27T04:55:07.628067+0000 mgr.x (mgr.34109) 459 : cluster [DBG] pgmap v541: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:08.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:08 smithi031 bash[18426]: cluster 2020-06-27T04:55:07.628067+0000 mgr.x (mgr.34109) 459 : cluster [DBG] pgmap v541: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:08.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:08 smithi031 bash[22603]: cluster 2020-06-27T04:55:07.628067+0000 mgr.x (mgr.34109) 459 : cluster [DBG] pgmap v541: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:10.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:10 smithi051 bash[18409]: cluster 2020-06-27T04:55:09.630218+0000 mgr.x (mgr.34109) 460 : cluster [DBG] pgmap v542: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:10.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:10 smithi031 bash[18426]: cluster 2020-06-27T04:55:09.630218+0000 mgr.x (mgr.34109) 460 : cluster [DBG] pgmap v542: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:10.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:10 smithi031 bash[22603]: cluster 2020-06-27T04:55:09.630218+0000 mgr.x (mgr.34109) 460 : cluster [DBG] pgmap v542: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:12.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:12 smithi051 bash[18409]: cluster 2020-06-27T04:55:11.632666+0000 mgr.x (mgr.34109) 461 : cluster [DBG] pgmap v543: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:12 smithi031 bash[18426]: cluster 2020-06-27T04:55:11.632666+0000 mgr.x (mgr.34109) 461 : cluster [DBG] pgmap v543: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:12.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:12 smithi031 bash[22603]: cluster 2020-06-27T04:55:11.632666+0000 mgr.x (mgr.34109) 461 : cluster [DBG] pgmap v543: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:14 smithi051 bash[18409]: cluster 2020-06-27T04:55:13.634294+0000 mgr.x (mgr.34109) 462 : cluster [DBG] pgmap v544: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:14 smithi031 bash[18426]: cluster 2020-06-27T04:55:13.634294+0000 mgr.x (mgr.34109) 462 : cluster [DBG] pgmap v544: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:14 smithi031 bash[22603]: cluster 2020-06-27T04:55:13.634294+0000 mgr.x (mgr.34109) 462 : cluster [DBG] pgmap v544: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:16 smithi051 bash[18409]: cluster 2020-06-27T04:55:15.636805+0000 mgr.x (mgr.34109) 463 : cluster [DBG] pgmap v545: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:16 smithi031 bash[18426]: cluster 2020-06-27T04:55:15.636805+0000 mgr.x (mgr.34109) 463 : cluster [DBG] pgmap v545: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:16 smithi031 bash[22603]: cluster 2020-06-27T04:55:15.636805+0000 mgr.x (mgr.34109) 463 : cluster [DBG] pgmap v545: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:18.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:18 smithi051 bash[18409]: cluster 2020-06-27T04:55:17.639006+0000 mgr.x (mgr.34109) 464 : cluster [DBG] pgmap v546: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:18 smithi031 bash[18426]: cluster 2020-06-27T04:55:17.639006+0000 mgr.x (mgr.34109) 464 : cluster [DBG] pgmap v546: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:18 smithi031 bash[22603]: cluster 2020-06-27T04:55:17.639006+0000 mgr.x (mgr.34109) 464 : cluster [DBG] pgmap v546: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:20.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:20 smithi031 bash[18426]: cluster 2020-06-27T04:55:19.641119+0000 mgr.x (mgr.34109) 465 : cluster [DBG] pgmap v547: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:20.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:20 smithi031 bash[22603]: cluster 2020-06-27T04:55:19.641119+0000 mgr.x (mgr.34109) 465 : cluster [DBG] pgmap v547: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:20.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:20 smithi051 bash[18409]: cluster 2020-06-27T04:55:19.641119+0000 mgr.x (mgr.34109) 465 : cluster [DBG] pgmap v547: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:22.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:22 smithi051 bash[18409]: cluster 2020-06-27T04:55:21.643452+0000 mgr.x (mgr.34109) 466 : cluster [DBG] pgmap v548: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:22.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:22 smithi031 bash[18426]: cluster 2020-06-27T04:55:21.643452+0000 mgr.x (mgr.34109) 466 : cluster [DBG] pgmap v548: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:22.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:22 smithi031 bash[22603]: cluster 2020-06-27T04:55:21.643452+0000 mgr.x (mgr.34109) 466 : cluster [DBG] pgmap v548: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:24.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:24 smithi051 bash[18409]: cluster 2020-06-27T04:55:23.644952+0000 mgr.x (mgr.34109) 467 : cluster [DBG] pgmap v549: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:24.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:24 smithi031 bash[18426]: cluster 2020-06-27T04:55:23.644952+0000 mgr.x (mgr.34109) 467 : cluster [DBG] pgmap v549: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:24 smithi031 bash[22603]: cluster 2020-06-27T04:55:23.644952+0000 mgr.x (mgr.34109) 467 : cluster [DBG] pgmap v549: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:26.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:26 smithi051 bash[18409]: cluster 2020-06-27T04:55:25.647325+0000 mgr.x (mgr.34109) 468 : cluster [DBG] pgmap v550: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:26 smithi031 bash[18426]: cluster 2020-06-27T04:55:25.647325+0000 mgr.x (mgr.34109) 468 : cluster [DBG] pgmap v550: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:26.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:26 smithi031 bash[22603]: cluster 2020-06-27T04:55:25.647325+0000 mgr.x (mgr.34109) 468 : cluster [DBG] pgmap v550: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:28.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:28 smithi051 bash[18409]: cluster 2020-06-27T04:55:27.649453+0000 mgr.x (mgr.34109) 469 : cluster [DBG] pgmap v551: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:28.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:28 smithi031 bash[18426]: cluster 2020-06-27T04:55:27.649453+0000 mgr.x (mgr.34109) 469 : cluster [DBG] pgmap v551: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:28.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:28 smithi031 bash[22603]: cluster 2020-06-27T04:55:27.649453+0000 mgr.x (mgr.34109) 469 : cluster [DBG] pgmap v551: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:30.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:30 smithi031 bash[22603]: cluster 2020-06-27T04:55:29.651485+0000 mgr.x (mgr.34109) 470 : cluster [DBG] pgmap v552: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:30.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:30 smithi031 bash[18426]: cluster 2020-06-27T04:55:29.651485+0000 mgr.x (mgr.34109) 470 : cluster [DBG] pgmap v552: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:30.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:30 smithi051 bash[18409]: cluster 2020-06-27T04:55:29.651485+0000 mgr.x (mgr.34109) 470 : cluster [DBG] pgmap v552: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:32.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:32 smithi051 bash[18409]: cluster 2020-06-27T04:55:31.653929+0000 mgr.x (mgr.34109) 471 : cluster [DBG] pgmap v553: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:32.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:32 smithi031 bash[18426]: cluster 2020-06-27T04:55:31.653929+0000 mgr.x (mgr.34109) 471 : cluster [DBG] pgmap v553: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:32.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:32 smithi031 bash[22603]: cluster 2020-06-27T04:55:31.653929+0000 mgr.x (mgr.34109) 471 : cluster [DBG] pgmap v553: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:34 smithi031 bash[18426]: cluster 2020-06-27T04:55:33.655503+0000 mgr.x (mgr.34109) 472 : cluster [DBG] pgmap v554: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:34.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:34 smithi031 bash[22603]: cluster 2020-06-27T04:55:33.655503+0000 mgr.x (mgr.34109) 472 : cluster [DBG] pgmap v554: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:35.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:34 smithi051 bash[18409]: cluster 2020-06-27T04:55:33.655503+0000 mgr.x (mgr.34109) 472 : cluster [DBG] pgmap v554: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:37.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:36 smithi051 bash[18409]: cluster 2020-06-27T04:55:35.657841+0000 mgr.x (mgr.34109) 473 : cluster [DBG] pgmap v555: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:37.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:36 smithi031 bash[18426]: cluster 2020-06-27T04:55:35.657841+0000 mgr.x (mgr.34109) 473 : cluster [DBG] pgmap v555: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:37.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:36 smithi031 bash[22603]: cluster 2020-06-27T04:55:35.657841+0000 mgr.x (mgr.34109) 473 : cluster [DBG] pgmap v555: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:39.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:38 smithi051 bash[18409]: cluster 2020-06-27T04:55:37.659968+0000 mgr.x (mgr.34109) 474 : cluster [DBG] pgmap v556: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:39.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:38 smithi031 bash[18426]: cluster 2020-06-27T04:55:37.659968+0000 mgr.x (mgr.34109) 474 : cluster [DBG] pgmap v556: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:39.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:38 smithi031 bash[22603]: cluster 2020-06-27T04:55:37.659968+0000 mgr.x (mgr.34109) 474 : cluster [DBG] pgmap v556: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:40.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:40 smithi031 bash[18426]: cluster 2020-06-27T04:55:39.661951+0000 mgr.x (mgr.34109) 475 : cluster [DBG] pgmap v557: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:40.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:40 smithi031 bash[22603]: cluster 2020-06-27T04:55:39.661951+0000 mgr.x (mgr.34109) 475 : cluster [DBG] pgmap v557: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:40.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:40 smithi051 bash[18409]: cluster 2020-06-27T04:55:39.661951+0000 mgr.x (mgr.34109) 475 : cluster [DBG] pgmap v557: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:43.141 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:42 smithi031 bash[18426]: cluster 2020-06-27T04:55:41.665001+0000 mgr.x (mgr.34109) 476 : cluster [DBG] pgmap v558: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:43.142 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:42 smithi031 bash[18426]: audit 2020-06-27T04:55:42.674725+0000 mon.b (mon.2) 343 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821142\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821218\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821251\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821446\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821562\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821671\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821778\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821813\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821843\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:41.821923\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:55:42.673784\"}"}]: dispatch 2020-06-27T04:55:43.142 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:42 smithi031 bash[18426]: audit 2020-06-27T04:55:42.675276+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821142\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821218\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821251\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821446\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821562\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821671\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821778\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821813\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821843\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:41.821923\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:55:42.673784\"}"}]: dispatch 2020-06-27T04:55:43.143 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:42 smithi031 bash[18426]: audit 2020-06-27T04:55:42.678635+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821142\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821218\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821251\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821446\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821562\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821671\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821778\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821813\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821843\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:41.821923\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:55:42.673784\"}"}]': finished 2020-06-27T04:55:43.143 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:42 smithi031 bash[18426]: audit 2020-06-27T04:55:42.679904+0000 mon.b (mon.2) 344 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385193\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385273\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385523\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385652\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385773\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385892\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385931\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385963\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:42.386049\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:55:42.679122\"}"}]: dispatch 2020-06-27T04:55:43.143 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:42 smithi031 bash[18426]: audit 2020-06-27T04:55:42.680168+0000 mon.b (mon.2) 345 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:55:43.143 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:42 smithi031 bash[18426]: audit 2020-06-27T04:55:42.680458+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385193\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385273\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385523\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385652\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385773\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385892\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385931\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385963\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:42.386049\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:55:42.679122\"}"}]: dispatch 2020-06-27T04:55:43.144 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:42 smithi031 bash[18426]: audit 2020-06-27T04:55:42.685429+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385193\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385273\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385523\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385652\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385773\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385892\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385931\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385963\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:42.386049\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:55:42.679122\"}"}]': finished 2020-06-27T04:55:43.144 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:42 smithi031 bash[18426]: audit 2020-06-27T04:55:42.686218+0000 mon.b (mon.2) 346 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:55:43.145 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:42 smithi031 bash[22603]: cluster 2020-06-27T04:55:41.665001+0000 mgr.x (mgr.34109) 476 : cluster [DBG] pgmap v558: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:43.145 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:42 smithi031 bash[22603]: audit 2020-06-27T04:55:42.674725+0000 mon.b (mon.2) 343 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821142\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821218\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821251\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821446\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821562\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821671\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821778\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821813\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821843\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:41.821923\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:55:42.673784\"}"}]: dispatch 2020-06-27T04:55:43.145 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:42 smithi031 bash[22603]: audit 2020-06-27T04:55:42.675276+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821142\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821218\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821251\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821446\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821562\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821671\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821778\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821813\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821843\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:41.821923\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:55:42.673784\"}"}]: dispatch 2020-06-27T04:55:43.146 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:42 smithi031 bash[22603]: audit 2020-06-27T04:55:42.678635+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821142\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821218\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821251\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821446\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821562\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821671\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821778\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821813\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821843\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:41.821923\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:55:42.673784\"}"}]': finished 2020-06-27T04:55:43.146 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:42 smithi031 bash[22603]: audit 2020-06-27T04:55:42.679904+0000 mon.b (mon.2) 344 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385193\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385273\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385523\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385652\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385773\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385892\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385931\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385963\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:42.386049\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:55:42.679122\"}"}]: dispatch 2020-06-27T04:55:43.146 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:42 smithi031 bash[22603]: audit 2020-06-27T04:55:42.680168+0000 mon.b (mon.2) 345 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:55:43.146 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:42 smithi031 bash[22603]: audit 2020-06-27T04:55:42.680458+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385193\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385273\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385523\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385652\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385773\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385892\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385931\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385963\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:42.386049\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:55:42.679122\"}"}]: dispatch 2020-06-27T04:55:43.147 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:42 smithi031 bash[22603]: audit 2020-06-27T04:55:42.685429+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385193\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385273\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385523\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385652\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385773\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385892\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385931\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385963\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:42.386049\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:55:42.679122\"}"}]': finished 2020-06-27T04:55:43.147 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:42 smithi031 bash[22603]: audit 2020-06-27T04:55:42.686218+0000 mon.b (mon.2) 346 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:55:43.155 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:42 smithi051 bash[18409]: cluster 2020-06-27T04:55:41.665001+0000 mgr.x (mgr.34109) 476 : cluster [DBG] pgmap v558: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:43.156 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:42 smithi051 bash[18409]: audit 2020-06-27T04:55:42.674725+0000 mon.b (mon.2) 343 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821142\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821218\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821251\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821446\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821562\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821671\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821778\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821813\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821843\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:41.821923\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:55:42.673784\"}"}]: dispatch 2020-06-27T04:55:43.156 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:42 smithi051 bash[18409]: audit 2020-06-27T04:55:42.675276+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821142\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821218\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821251\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821446\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821562\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821671\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821778\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821813\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821843\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:41.821923\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:55:42.673784\"}"}]: dispatch 2020-06-27T04:55:43.156 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:42 smithi051 bash[18409]: audit 2020-06-27T04:55:42.678635+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821142\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821218\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_id\": \"ada565114931\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821251\", \"created\": \"2020-06-27T04:43:30.625339\", \"started\": \"2020-06-27T04:43:32.408668\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_id\": \"da4eb380a0b7\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821446\", \"created\": \"2020-06-27T04:43:45.670093\", \"started\": \"2020-06-27T04:43:47.459470\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_id\": \"55271d6c0fde\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821562\", \"created\": \"2020-06-27T04:44:01.625833\", \"started\": \"2020-06-27T04:44:03.497359\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"6ff3e9a56526\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821671\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:44:19.212118\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821778\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821813\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:41.821843\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:45:41.821923\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:55:42.673784\"}"}]': finished 2020-06-27T04:55:43.157 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:42 smithi051 bash[18409]: audit 2020-06-27T04:55:42.679904+0000 mon.b (mon.2) 344 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385193\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385273\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385523\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385652\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385773\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385892\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385931\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385963\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:42.386049\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:55:42.679122\"}"}]: dispatch 2020-06-27T04:55:43.157 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:42 smithi051 bash[18409]: audit 2020-06-27T04:55:42.680168+0000 mon.b (mon.2) 345 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:55:43.157 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:42 smithi051 bash[18409]: audit 2020-06-27T04:55:42.680458+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385193\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385273\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385523\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385652\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385773\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385892\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385931\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385963\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:42.386049\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:55:42.679122\"}"}]: dispatch 2020-06-27T04:55:43.158 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:42 smithi051 bash[18409]: audit 2020-06-27T04:55:42.685429+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385193\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385273\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"bf7312b7e1fc\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385308\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:42:30.202698\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_id\": \"3c82a83d4166\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385523\", \"created\": \"2020-06-27T04:42:44.178826\", \"started\": \"2020-06-27T04:42:46.111080\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"c299b703ddec\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385652\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:43:02.522132\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_id\": \"97568baaffac\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385773\", \"created\": \"2020-06-27T04:43:16.917295\", \"started\": \"2020-06-27T04:43:18.676728\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385892\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385931\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:45:42.385963\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:45:42.386049\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:55:42.679122\"}"}]': finished 2020-06-27T04:55:43.158 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:42 smithi051 bash[18409]: audit 2020-06-27T04:55:42.686218+0000 mon.b (mon.2) 346 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T04:55:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:44 smithi031 bash[22603]: cluster 2020-06-27T04:55:43.666458+0000 mgr.x (mgr.34109) 477 : cluster [DBG] pgmap v559: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:44 smithi031 bash[18426]: cluster 2020-06-27T04:55:43.666458+0000 mgr.x (mgr.34109) 477 : cluster [DBG] pgmap v559: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:45.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:44 smithi051 bash[18409]: cluster 2020-06-27T04:55:43.666458+0000 mgr.x (mgr.34109) 477 : cluster [DBG] pgmap v559: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:46.121 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:45 smithi051 bash[18409]: audit 2020-06-27T04:55:44.745662+0000 mon.b (mon.2) 347 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744143\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744220\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"43c6d0503d9c\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744253\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:49:12.650483\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744457\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"72fb1b0d97ca\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744558\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:49:23.458946\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744665\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744758\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744794\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744824\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.744905\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:55:42.679122\"}"}]: dispatch 2020-06-27T04:55:46.122 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:45 smithi051 bash[18409]: audit 2020-06-27T04:55:44.746390+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744143\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744220\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"43c6d0503d9c\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744253\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:49:12.650483\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744457\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"72fb1b0d97ca\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744558\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:49:23.458946\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744665\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744758\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744794\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744824\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.744905\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:55:42.679122\"}"}]: dispatch 2020-06-27T04:55:46.122 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:45 smithi051 bash[18409]: audit 2020-06-27T04:55:44.751358+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744143\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744220\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"43c6d0503d9c\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744253\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:49:12.650483\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744457\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"72fb1b0d97ca\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744558\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:49:23.458946\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744665\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744758\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744794\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744824\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.744905\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:55:42.679122\"}"}]': finished 2020-06-27T04:55:46.123 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:45 smithi051 bash[18409]: audit 2020-06-27T04:55:44.960234+0000 mon.b (mon.2) 348 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958716\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958793\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.958827\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959014\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959112\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"89d97a048d29\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959205\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:49:20.065739\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959311\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959346\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959375\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.959460\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:55:42.673784\"}"}]: dispatch 2020-06-27T04:55:46.123 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:45 smithi051 bash[18409]: audit 2020-06-27T04:55:44.960739+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958716\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958793\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.958827\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959014\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959112\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"89d97a048d29\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959205\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:49:20.065739\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959311\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959346\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959375\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.959460\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:55:42.673784\"}"}]: dispatch 2020-06-27T04:55:46.123 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:45 smithi051 bash[18409]: audit 2020-06-27T04:55:44.965707+0000 mon.a (mon.0) 1378 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958716\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958793\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.958827\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959014\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959112\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"89d97a048d29\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959205\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:49:20.065739\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959311\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959346\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959375\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.959460\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:55:42.673784\"}"}]': finished 2020-06-27T04:55:46.124 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:45 smithi051 bash[18409]: audit 2020-06-27T04:55:44.968641+0000 mon.b (mon.2) 349 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:55:46.124 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:45 smithi051 bash[18409]: audit 2020-06-27T04:55:44.969681+0000 mon.b (mon.2) 350 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:55:46.124 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:45 smithi051 bash[18409]: audit 2020-06-27T04:55:44.970553+0000 mon.b (mon.2) 351 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:55:46.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:45 smithi031 bash[18426]: audit 2020-06-27T04:55:44.745662+0000 mon.b (mon.2) 347 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744143\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744220\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"43c6d0503d9c\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744253\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:49:12.650483\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744457\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"72fb1b0d97ca\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744558\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:49:23.458946\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744665\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744758\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744794\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744824\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.744905\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:55:42.679122\"}"}]: dispatch 2020-06-27T04:55:46.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:45 smithi031 bash[18426]: audit 2020-06-27T04:55:44.746390+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744143\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744220\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"43c6d0503d9c\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744253\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:49:12.650483\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744457\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"72fb1b0d97ca\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744558\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:49:23.458946\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744665\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744758\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744794\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744824\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.744905\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:55:42.679122\"}"}]: dispatch 2020-06-27T04:55:46.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:45 smithi031 bash[18426]: audit 2020-06-27T04:55:44.751358+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744143\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744220\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"43c6d0503d9c\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744253\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:49:12.650483\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744457\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"72fb1b0d97ca\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744558\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:49:23.458946\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744665\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744758\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744794\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744824\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.744905\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:55:42.679122\"}"}]': finished 2020-06-27T04:55:46.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:45 smithi031 bash[18426]: audit 2020-06-27T04:55:44.960234+0000 mon.b (mon.2) 348 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958716\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958793\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.958827\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959014\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959112\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"89d97a048d29\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959205\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:49:20.065739\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959311\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959346\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959375\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.959460\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:55:42.673784\"}"}]: dispatch 2020-06-27T04:55:46.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:45 smithi031 bash[18426]: audit 2020-06-27T04:55:44.960739+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958716\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958793\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.958827\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959014\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959112\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"89d97a048d29\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959205\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:49:20.065739\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959311\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959346\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959375\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.959460\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:55:42.673784\"}"}]: dispatch 2020-06-27T04:55:46.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:45 smithi031 bash[18426]: audit 2020-06-27T04:55:44.965707+0000 mon.a (mon.0) 1378 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958716\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958793\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.958827\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959014\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959112\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"89d97a048d29\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959205\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:49:20.065739\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959311\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959346\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959375\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.959460\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:55:42.673784\"}"}]': finished 2020-06-27T04:55:46.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:45 smithi031 bash[18426]: audit 2020-06-27T04:55:44.968641+0000 mon.b (mon.2) 349 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:55:46.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:45 smithi031 bash[18426]: audit 2020-06-27T04:55:44.969681+0000 mon.b (mon.2) 350 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:55:46.228 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:45 smithi031 bash[18426]: audit 2020-06-27T04:55:44.970553+0000 mon.b (mon.2) 351 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:55:46.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:45 smithi031 bash[22603]: audit 2020-06-27T04:55:44.745662+0000 mon.b (mon.2) 347 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744143\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744220\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"43c6d0503d9c\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744253\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:49:12.650483\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744457\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"72fb1b0d97ca\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744558\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:49:23.458946\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744665\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744758\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744794\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744824\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.744905\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:55:42.679122\"}"}]: dispatch 2020-06-27T04:55:46.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:45 smithi031 bash[22603]: audit 2020-06-27T04:55:44.746390+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744143\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744220\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"43c6d0503d9c\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744253\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:49:12.650483\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744457\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"72fb1b0d97ca\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744558\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:49:23.458946\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744665\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744758\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744794\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744824\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.744905\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:55:42.679122\"}"}]: dispatch 2020-06-27T04:55:46.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:45 smithi031 bash[22603]: audit 2020-06-27T04:55:44.751358+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744143\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744220\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"43c6d0503d9c\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744253\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:49:12.650483\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744457\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"72fb1b0d97ca\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744558\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:49:23.458946\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744665\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744758\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744794\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744824\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.744905\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T04:55:42.679122\"}"}]': finished 2020-06-27T04:55:46.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:45 smithi031 bash[22603]: audit 2020-06-27T04:55:44.960234+0000 mon.b (mon.2) 348 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958716\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958793\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.958827\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959014\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959112\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"89d97a048d29\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959205\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:49:20.065739\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959311\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959346\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959375\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.959460\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:55:42.673784\"}"}]: dispatch 2020-06-27T04:55:46.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:45 smithi031 bash[22603]: audit 2020-06-27T04:55:44.960739+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958716\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958793\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.958827\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959014\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959112\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"89d97a048d29\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959205\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:49:20.065739\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959311\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959346\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959375\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.959460\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:55:42.673784\"}"}]: dispatch 2020-06-27T04:55:46.230 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:45 smithi031 bash[22603]: audit 2020-06-27T04:55:44.965707+0000 mon.a (mon.0) 1378 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958716\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958793\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.958827\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959014\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959112\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"89d97a048d29\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959205\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:49:20.065739\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959311\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959346\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959375\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.959460\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T04:55:42.673784\"}"}]': finished 2020-06-27T04:55:46.230 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:45 smithi031 bash[22603]: audit 2020-06-27T04:55:44.968641+0000 mon.b (mon.2) 349 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:55:46.230 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:45 smithi031 bash[22603]: audit 2020-06-27T04:55:44.969681+0000 mon.b (mon.2) 350 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:55:46.230 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:45 smithi031 bash[22603]: audit 2020-06-27T04:55:44.970553+0000 mon.b (mon.2) 351 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:55:47.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:46 smithi051 bash[18409]: audit 2020-06-27T04:55:44.968954+0000 mgr.x (mgr.34109) 478 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:55:47.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:46 smithi051 bash[18409]: audit 2020-06-27T04:55:44.969919+0000 mgr.x (mgr.34109) 479 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:55:47.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:46 smithi051 bash[18409]: audit 2020-06-27T04:55:44.970766+0000 mgr.x (mgr.34109) 480 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:55:47.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:46 smithi051 bash[18409]: cluster 2020-06-27T04:55:45.668929+0000 mgr.x (mgr.34109) 481 : cluster [DBG] pgmap v560: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:47.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:46 smithi031 bash[18426]: audit 2020-06-27T04:55:44.968954+0000 mgr.x (mgr.34109) 478 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:55:47.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:46 smithi031 bash[18426]: audit 2020-06-27T04:55:44.969919+0000 mgr.x (mgr.34109) 479 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:55:47.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:46 smithi031 bash[18426]: audit 2020-06-27T04:55:44.970766+0000 mgr.x (mgr.34109) 480 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:55:47.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:46 smithi031 bash[18426]: cluster 2020-06-27T04:55:45.668929+0000 mgr.x (mgr.34109) 481 : cluster [DBG] pgmap v560: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:47.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:46 smithi031 bash[22603]: audit 2020-06-27T04:55:44.968954+0000 mgr.x (mgr.34109) 478 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T04:55:47.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:46 smithi031 bash[22603]: audit 2020-06-27T04:55:44.969919+0000 mgr.x (mgr.34109) 479 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T04:55:47.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:46 smithi031 bash[22603]: audit 2020-06-27T04:55:44.970766+0000 mgr.x (mgr.34109) 480 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T04:55:47.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:46 smithi031 bash[22603]: cluster 2020-06-27T04:55:45.668929+0000 mgr.x (mgr.34109) 481 : cluster [DBG] pgmap v560: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:49.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:48 smithi051 bash[18409]: cluster 2020-06-27T04:55:47.670998+0000 mgr.x (mgr.34109) 482 : cluster [DBG] pgmap v561: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:49.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:48 smithi031 bash[18426]: cluster 2020-06-27T04:55:47.670998+0000 mgr.x (mgr.34109) 482 : cluster [DBG] pgmap v561: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:49.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:48 smithi031 bash[22603]: cluster 2020-06-27T04:55:47.670998+0000 mgr.x (mgr.34109) 482 : cluster [DBG] pgmap v561: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:50.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:50 smithi051 bash[18409]: cluster 2020-06-27T04:55:49.673132+0000 mgr.x (mgr.34109) 483 : cluster [DBG] pgmap v562: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:50.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:50 smithi031 bash[18426]: cluster 2020-06-27T04:55:49.673132+0000 mgr.x (mgr.34109) 483 : cluster [DBG] pgmap v562: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:50.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:50 smithi031 bash[22603]: cluster 2020-06-27T04:55:49.673132+0000 mgr.x (mgr.34109) 483 : cluster [DBG] pgmap v562: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:53.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:52 smithi051 bash[18409]: cluster 2020-06-27T04:55:51.675609+0000 mgr.x (mgr.34109) 484 : cluster [DBG] pgmap v563: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:53.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:52 smithi031 bash[18426]: cluster 2020-06-27T04:55:51.675609+0000 mgr.x (mgr.34109) 484 : cluster [DBG] pgmap v563: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:53.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:52 smithi031 bash[22603]: cluster 2020-06-27T04:55:51.675609+0000 mgr.x (mgr.34109) 484 : cluster [DBG] pgmap v563: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:55.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:54 smithi051 bash[18409]: cluster 2020-06-27T04:55:53.677162+0000 mgr.x (mgr.34109) 485 : cluster [DBG] pgmap v564: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:55.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:54 smithi031 bash[18426]: cluster 2020-06-27T04:55:53.677162+0000 mgr.x (mgr.34109) 485 : cluster [DBG] pgmap v564: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:55.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:54 smithi031 bash[22603]: cluster 2020-06-27T04:55:53.677162+0000 mgr.x (mgr.34109) 485 : cluster [DBG] pgmap v564: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:57.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:56 smithi051 bash[18409]: cluster 2020-06-27T04:55:55.679538+0000 mgr.x (mgr.34109) 486 : cluster [DBG] pgmap v565: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:57.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:56 smithi031 bash[18426]: cluster 2020-06-27T04:55:55.679538+0000 mgr.x (mgr.34109) 486 : cluster [DBG] pgmap v565: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:57.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:56 smithi031 bash[22603]: cluster 2020-06-27T04:55:55.679538+0000 mgr.x (mgr.34109) 486 : cluster [DBG] pgmap v565: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:59.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:55:58 smithi051 bash[18409]: cluster 2020-06-27T04:55:57.681730+0000 mgr.x (mgr.34109) 487 : cluster [DBG] pgmap v566: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:59.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:55:58 smithi031 bash[18426]: cluster 2020-06-27T04:55:57.681730+0000 mgr.x (mgr.34109) 487 : cluster [DBG] pgmap v566: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:55:59.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:55:58 smithi031 bash[22603]: cluster 2020-06-27T04:55:57.681730+0000 mgr.x (mgr.34109) 487 : cluster [DBG] pgmap v566: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:00.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:00 smithi051 bash[18409]: cluster 2020-06-27T04:55:59.683773+0000 mgr.x (mgr.34109) 488 : cluster [DBG] pgmap v567: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:00.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:00 smithi031 bash[18426]: cluster 2020-06-27T04:55:59.683773+0000 mgr.x (mgr.34109) 488 : cluster [DBG] pgmap v567: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:00.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:00 smithi031 bash[22603]: cluster 2020-06-27T04:55:59.683773+0000 mgr.x (mgr.34109) 488 : cluster [DBG] pgmap v567: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:03.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:02 smithi051 bash[18409]: cluster 2020-06-27T04:56:01.686071+0000 mgr.x (mgr.34109) 489 : cluster [DBG] pgmap v568: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:03.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:02 smithi031 bash[18426]: cluster 2020-06-27T04:56:01.686071+0000 mgr.x (mgr.34109) 489 : cluster [DBG] pgmap v568: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:03.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:02 smithi031 bash[22603]: cluster 2020-06-27T04:56:01.686071+0000 mgr.x (mgr.34109) 489 : cluster [DBG] pgmap v568: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:05.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:04 smithi051 bash[18409]: cluster 2020-06-27T04:56:03.687725+0000 mgr.x (mgr.34109) 490 : cluster [DBG] pgmap v569: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:05.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:04 smithi031 bash[18426]: cluster 2020-06-27T04:56:03.687725+0000 mgr.x (mgr.34109) 490 : cluster [DBG] pgmap v569: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:05.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:04 smithi031 bash[22603]: cluster 2020-06-27T04:56:03.687725+0000 mgr.x (mgr.34109) 490 : cluster [DBG] pgmap v569: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:07.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:06 smithi051 bash[18409]: cluster 2020-06-27T04:56:05.690045+0000 mgr.x (mgr.34109) 491 : cluster [DBG] pgmap v570: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:07.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:06 smithi031 bash[18426]: cluster 2020-06-27T04:56:05.690045+0000 mgr.x (mgr.34109) 491 : cluster [DBG] pgmap v570: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:07.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:06 smithi031 bash[22603]: cluster 2020-06-27T04:56:05.690045+0000 mgr.x (mgr.34109) 491 : cluster [DBG] pgmap v570: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:09.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:08 smithi051 bash[18409]: cluster 2020-06-27T04:56:07.692109+0000 mgr.x (mgr.34109) 492 : cluster [DBG] pgmap v571: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:09.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:08 smithi031 bash[18426]: cluster 2020-06-27T04:56:07.692109+0000 mgr.x (mgr.34109) 492 : cluster [DBG] pgmap v571: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:09.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:08 smithi031 bash[22603]: cluster 2020-06-27T04:56:07.692109+0000 mgr.x (mgr.34109) 492 : cluster [DBG] pgmap v571: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:10.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:10 smithi051 bash[18409]: cluster 2020-06-27T04:56:09.694140+0000 mgr.x (mgr.34109) 493 : cluster [DBG] pgmap v572: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:10.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:10 smithi031 bash[18426]: cluster 2020-06-27T04:56:09.694140+0000 mgr.x (mgr.34109) 493 : cluster [DBG] pgmap v572: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:10.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:10 smithi031 bash[22603]: cluster 2020-06-27T04:56:09.694140+0000 mgr.x (mgr.34109) 493 : cluster [DBG] pgmap v572: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:13.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:12 smithi051 bash[18409]: cluster 2020-06-27T04:56:11.696470+0000 mgr.x (mgr.34109) 494 : cluster [DBG] pgmap v573: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:13.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:12 smithi031 bash[18426]: cluster 2020-06-27T04:56:11.696470+0000 mgr.x (mgr.34109) 494 : cluster [DBG] pgmap v573: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:13.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:12 smithi031 bash[22603]: cluster 2020-06-27T04:56:11.696470+0000 mgr.x (mgr.34109) 494 : cluster [DBG] pgmap v573: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:15.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:14 smithi051 bash[18409]: cluster 2020-06-27T04:56:13.698105+0000 mgr.x (mgr.34109) 495 : cluster [DBG] pgmap v574: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:15.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:14 smithi031 bash[18426]: cluster 2020-06-27T04:56:13.698105+0000 mgr.x (mgr.34109) 495 : cluster [DBG] pgmap v574: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:15.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:14 smithi031 bash[22603]: cluster 2020-06-27T04:56:13.698105+0000 mgr.x (mgr.34109) 495 : cluster [DBG] pgmap v574: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:17.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:16 smithi051 bash[18409]: cluster 2020-06-27T04:56:15.700512+0000 mgr.x (mgr.34109) 496 : cluster [DBG] pgmap v575: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:17.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:16 smithi031 bash[18426]: cluster 2020-06-27T04:56:15.700512+0000 mgr.x (mgr.34109) 496 : cluster [DBG] pgmap v575: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:17.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:16 smithi031 bash[22603]: cluster 2020-06-27T04:56:15.700512+0000 mgr.x (mgr.34109) 496 : cluster [DBG] pgmap v575: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:19.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:18 smithi051 bash[18409]: cluster 2020-06-27T04:56:17.702540+0000 mgr.x (mgr.34109) 497 : cluster [DBG] pgmap v576: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:19.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:18 smithi031 bash[18426]: cluster 2020-06-27T04:56:17.702540+0000 mgr.x (mgr.34109) 497 : cluster [DBG] pgmap v576: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:19.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:18 smithi031 bash[22603]: cluster 2020-06-27T04:56:17.702540+0000 mgr.x (mgr.34109) 497 : cluster [DBG] pgmap v576: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:20.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:20 smithi051 bash[18409]: cluster 2020-06-27T04:56:19.704513+0000 mgr.x (mgr.34109) 498 : cluster [DBG] pgmap v577: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:20 smithi031 bash[18426]: cluster 2020-06-27T04:56:19.704513+0000 mgr.x (mgr.34109) 498 : cluster [DBG] pgmap v577: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:20.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:20 smithi031 bash[22603]: cluster 2020-06-27T04:56:19.704513+0000 mgr.x (mgr.34109) 498 : cluster [DBG] pgmap v577: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:23.217 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:22 smithi051 bash[18409]: cluster 2020-06-27T04:56:21.706933+0000 mgr.x (mgr.34109) 499 : cluster [DBG] pgmap v578: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:23.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:22 smithi031 bash[18426]: cluster 2020-06-27T04:56:21.706933+0000 mgr.x (mgr.34109) 499 : cluster [DBG] pgmap v578: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:23.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:22 smithi031 bash[22603]: cluster 2020-06-27T04:56:21.706933+0000 mgr.x (mgr.34109) 499 : cluster [DBG] pgmap v578: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:25.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:24 smithi051 bash[18409]: cluster 2020-06-27T04:56:23.708614+0000 mgr.x (mgr.34109) 500 : cluster [DBG] pgmap v579: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:25.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:24 smithi031 bash[18426]: cluster 2020-06-27T04:56:23.708614+0000 mgr.x (mgr.34109) 500 : cluster [DBG] pgmap v579: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:25.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:24 smithi031 bash[22603]: cluster 2020-06-27T04:56:23.708614+0000 mgr.x (mgr.34109) 500 : cluster [DBG] pgmap v579: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:27.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:26 smithi051 bash[18409]: cluster 2020-06-27T04:56:25.711094+0000 mgr.x (mgr.34109) 501 : cluster [DBG] pgmap v580: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:27.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:26 smithi031 bash[18426]: cluster 2020-06-27T04:56:25.711094+0000 mgr.x (mgr.34109) 501 : cluster [DBG] pgmap v580: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:27.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:26 smithi031 bash[22603]: cluster 2020-06-27T04:56:25.711094+0000 mgr.x (mgr.34109) 501 : cluster [DBG] pgmap v580: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:29.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:28 smithi051 bash[18409]: cluster 2020-06-27T04:56:27.713309+0000 mgr.x (mgr.34109) 502 : cluster [DBG] pgmap v581: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:29.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:28 smithi031 bash[22603]: cluster 2020-06-27T04:56:27.713309+0000 mgr.x (mgr.34109) 502 : cluster [DBG] pgmap v581: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:29.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:28 smithi031 bash[18426]: cluster 2020-06-27T04:56:27.713309+0000 mgr.x (mgr.34109) 502 : cluster [DBG] pgmap v581: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:30.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:30 smithi051 bash[18409]: cluster 2020-06-27T04:56:29.715369+0000 mgr.x (mgr.34109) 503 : cluster [DBG] pgmap v582: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:30.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:30 smithi031 bash[18426]: cluster 2020-06-27T04:56:29.715369+0000 mgr.x (mgr.34109) 503 : cluster [DBG] pgmap v582: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:30.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:30 smithi031 bash[22603]: cluster 2020-06-27T04:56:29.715369+0000 mgr.x (mgr.34109) 503 : cluster [DBG] pgmap v582: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:33.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:32 smithi051 bash[18409]: cluster 2020-06-27T04:56:31.717738+0000 mgr.x (mgr.34109) 504 : cluster [DBG] pgmap v583: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:33.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:32 smithi031 bash[18426]: cluster 2020-06-27T04:56:31.717738+0000 mgr.x (mgr.34109) 504 : cluster [DBG] pgmap v583: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:33.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:32 smithi031 bash[22603]: cluster 2020-06-27T04:56:31.717738+0000 mgr.x (mgr.34109) 504 : cluster [DBG] pgmap v583: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:35.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:34 smithi051 bash[18409]: cluster 2020-06-27T04:56:33.719391+0000 mgr.x (mgr.34109) 505 : cluster [DBG] pgmap v584: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:35.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:34 smithi031 bash[22603]: cluster 2020-06-27T04:56:33.719391+0000 mgr.x (mgr.34109) 505 : cluster [DBG] pgmap v584: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:35.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:34 smithi031 bash[18426]: cluster 2020-06-27T04:56:33.719391+0000 mgr.x (mgr.34109) 505 : cluster [DBG] pgmap v584: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:37.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:36 smithi051 bash[18409]: cluster 2020-06-27T04:56:35.721944+0000 mgr.x (mgr.34109) 506 : cluster [DBG] pgmap v585: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:37.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:36 smithi031 bash[22603]: cluster 2020-06-27T04:56:35.721944+0000 mgr.x (mgr.34109) 506 : cluster [DBG] pgmap v585: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:37.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:36 smithi031 bash[18426]: cluster 2020-06-27T04:56:35.721944+0000 mgr.x (mgr.34109) 506 : cluster [DBG] pgmap v585: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:39.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:38 smithi051 bash[18409]: cluster 2020-06-27T04:56:37.724100+0000 mgr.x (mgr.34109) 507 : cluster [DBG] pgmap v586: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:39.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:38 smithi031 bash[18426]: cluster 2020-06-27T04:56:37.724100+0000 mgr.x (mgr.34109) 507 : cluster [DBG] pgmap v586: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:39.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:38 smithi031 bash[22603]: cluster 2020-06-27T04:56:37.724100+0000 mgr.x (mgr.34109) 507 : cluster [DBG] pgmap v586: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:40.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:40 smithi051 bash[18409]: cluster 2020-06-27T04:56:39.726162+0000 mgr.x (mgr.34109) 508 : cluster [DBG] pgmap v587: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:40.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:40 smithi031 bash[22603]: cluster 2020-06-27T04:56:39.726162+0000 mgr.x (mgr.34109) 508 : cluster [DBG] pgmap v587: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:40 smithi031 bash[18426]: cluster 2020-06-27T04:56:39.726162+0000 mgr.x (mgr.34109) 508 : cluster [DBG] pgmap v587: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:43.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:42 smithi051 bash[18409]: cluster 2020-06-27T04:56:41.728437+0000 mgr.x (mgr.34109) 509 : cluster [DBG] pgmap v588: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:43.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:42 smithi031 bash[18426]: cluster 2020-06-27T04:56:41.728437+0000 mgr.x (mgr.34109) 509 : cluster [DBG] pgmap v588: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:43.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:42 smithi031 bash[22603]: cluster 2020-06-27T04:56:41.728437+0000 mgr.x (mgr.34109) 509 : cluster [DBG] pgmap v588: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:45.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:44 smithi051 bash[18409]: cluster 2020-06-27T04:56:43.730024+0000 mgr.x (mgr.34109) 510 : cluster [DBG] pgmap v589: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:45.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:44 smithi031 bash[18426]: cluster 2020-06-27T04:56:43.730024+0000 mgr.x (mgr.34109) 510 : cluster [DBG] pgmap v589: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:45.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:44 smithi031 bash[22603]: cluster 2020-06-27T04:56:43.730024+0000 mgr.x (mgr.34109) 510 : cluster [DBG] pgmap v589: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:47.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:46 smithi051 bash[18409]: cluster 2020-06-27T04:56:45.732457+0000 mgr.x (mgr.34109) 511 : cluster [DBG] pgmap v590: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:47.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:46 smithi031 bash[18426]: cluster 2020-06-27T04:56:45.732457+0000 mgr.x (mgr.34109) 511 : cluster [DBG] pgmap v590: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:47.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:46 smithi031 bash[22603]: cluster 2020-06-27T04:56:45.732457+0000 mgr.x (mgr.34109) 511 : cluster [DBG] pgmap v590: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:49.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:48 smithi051 bash[18409]: cluster 2020-06-27T04:56:47.734658+0000 mgr.x (mgr.34109) 512 : cluster [DBG] pgmap v591: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:49.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:48 smithi031 bash[18426]: cluster 2020-06-27T04:56:47.734658+0000 mgr.x (mgr.34109) 512 : cluster [DBG] pgmap v591: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:49.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:48 smithi031 bash[22603]: cluster 2020-06-27T04:56:47.734658+0000 mgr.x (mgr.34109) 512 : cluster [DBG] pgmap v591: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:50.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:50 smithi051 bash[18409]: cluster 2020-06-27T04:56:49.736806+0000 mgr.x (mgr.34109) 513 : cluster [DBG] pgmap v592: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:50.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:50 smithi031 bash[18426]: cluster 2020-06-27T04:56:49.736806+0000 mgr.x (mgr.34109) 513 : cluster [DBG] pgmap v592: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:50.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:50 smithi031 bash[22603]: cluster 2020-06-27T04:56:49.736806+0000 mgr.x (mgr.34109) 513 : cluster [DBG] pgmap v592: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:53.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:52 smithi051 bash[18409]: cluster 2020-06-27T04:56:51.739155+0000 mgr.x (mgr.34109) 514 : cluster [DBG] pgmap v593: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:53.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:52 smithi031 bash[18426]: cluster 2020-06-27T04:56:51.739155+0000 mgr.x (mgr.34109) 514 : cluster [DBG] pgmap v593: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:53.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:52 smithi031 bash[22603]: cluster 2020-06-27T04:56:51.739155+0000 mgr.x (mgr.34109) 514 : cluster [DBG] pgmap v593: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:55.217 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:54 smithi051 bash[18409]: cluster 2020-06-27T04:56:53.740858+0000 mgr.x (mgr.34109) 515 : cluster [DBG] pgmap v594: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:55.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:54 smithi031 bash[18426]: cluster 2020-06-27T04:56:53.740858+0000 mgr.x (mgr.34109) 515 : cluster [DBG] pgmap v594: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:55.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:54 smithi031 bash[22603]: cluster 2020-06-27T04:56:53.740858+0000 mgr.x (mgr.34109) 515 : cluster [DBG] pgmap v594: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:57.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:56 smithi051 bash[18409]: cluster 2020-06-27T04:56:55.743301+0000 mgr.x (mgr.34109) 516 : cluster [DBG] pgmap v595: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:57.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:56 smithi031 bash[18426]: cluster 2020-06-27T04:56:55.743301+0000 mgr.x (mgr.34109) 516 : cluster [DBG] pgmap v595: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:57.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:56 smithi031 bash[22603]: cluster 2020-06-27T04:56:55.743301+0000 mgr.x (mgr.34109) 516 : cluster [DBG] pgmap v595: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:59.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:56:58 smithi051 bash[18409]: cluster 2020-06-27T04:56:57.745373+0000 mgr.x (mgr.34109) 517 : cluster [DBG] pgmap v596: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:59.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:56:58 smithi031 bash[18426]: cluster 2020-06-27T04:56:57.745373+0000 mgr.x (mgr.34109) 517 : cluster [DBG] pgmap v596: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:56:59.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:56:58 smithi031 bash[22603]: cluster 2020-06-27T04:56:57.745373+0000 mgr.x (mgr.34109) 517 : cluster [DBG] pgmap v596: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:00.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:00 smithi051 bash[18409]: cluster 2020-06-27T04:56:59.747336+0000 mgr.x (mgr.34109) 518 : cluster [DBG] pgmap v597: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:00.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:00 smithi031 bash[18426]: cluster 2020-06-27T04:56:59.747336+0000 mgr.x (mgr.34109) 518 : cluster [DBG] pgmap v597: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:00.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:00 smithi031 bash[22603]: cluster 2020-06-27T04:56:59.747336+0000 mgr.x (mgr.34109) 518 : cluster [DBG] pgmap v597: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:03.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:02 smithi051 bash[18409]: cluster 2020-06-27T04:57:01.749694+0000 mgr.x (mgr.34109) 519 : cluster [DBG] pgmap v598: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:03.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:02 smithi031 bash[22603]: cluster 2020-06-27T04:57:01.749694+0000 mgr.x (mgr.34109) 519 : cluster [DBG] pgmap v598: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:03.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:02 smithi031 bash[18426]: cluster 2020-06-27T04:57:01.749694+0000 mgr.x (mgr.34109) 519 : cluster [DBG] pgmap v598: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:05.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:04 smithi051 bash[18409]: cluster 2020-06-27T04:57:03.751178+0000 mgr.x (mgr.34109) 520 : cluster [DBG] pgmap v599: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:05.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:04 smithi031 bash[18426]: cluster 2020-06-27T04:57:03.751178+0000 mgr.x (mgr.34109) 520 : cluster [DBG] pgmap v599: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:05.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:04 smithi031 bash[22603]: cluster 2020-06-27T04:57:03.751178+0000 mgr.x (mgr.34109) 520 : cluster [DBG] pgmap v599: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:07.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:06 smithi051 bash[18409]: cluster 2020-06-27T04:57:05.753556+0000 mgr.x (mgr.34109) 521 : cluster [DBG] pgmap v600: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:07.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:06 smithi031 bash[18426]: cluster 2020-06-27T04:57:05.753556+0000 mgr.x (mgr.34109) 521 : cluster [DBG] pgmap v600: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:07.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:06 smithi031 bash[22603]: cluster 2020-06-27T04:57:05.753556+0000 mgr.x (mgr.34109) 521 : cluster [DBG] pgmap v600: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:09.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:08 smithi051 bash[18409]: cluster 2020-06-27T04:57:07.755748+0000 mgr.x (mgr.34109) 522 : cluster [DBG] pgmap v601: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:09.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:08 smithi031 bash[18426]: cluster 2020-06-27T04:57:07.755748+0000 mgr.x (mgr.34109) 522 : cluster [DBG] pgmap v601: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:09.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:08 smithi031 bash[22603]: cluster 2020-06-27T04:57:07.755748+0000 mgr.x (mgr.34109) 522 : cluster [DBG] pgmap v601: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:10.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:10 smithi051 bash[18409]: cluster 2020-06-27T04:57:09.757754+0000 mgr.x (mgr.34109) 523 : cluster [DBG] pgmap v602: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:10.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:10 smithi031 bash[18426]: cluster 2020-06-27T04:57:09.757754+0000 mgr.x (mgr.34109) 523 : cluster [DBG] pgmap v602: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:10.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:10 smithi031 bash[22603]: cluster 2020-06-27T04:57:09.757754+0000 mgr.x (mgr.34109) 523 : cluster [DBG] pgmap v602: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:13.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:12 smithi051 bash[18409]: cluster 2020-06-27T04:57:11.760152+0000 mgr.x (mgr.34109) 524 : cluster [DBG] pgmap v603: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:13.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:12 smithi031 bash[18426]: cluster 2020-06-27T04:57:11.760152+0000 mgr.x (mgr.34109) 524 : cluster [DBG] pgmap v603: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:13.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:12 smithi031 bash[22603]: cluster 2020-06-27T04:57:11.760152+0000 mgr.x (mgr.34109) 524 : cluster [DBG] pgmap v603: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:15.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:14 smithi051 bash[18409]: cluster 2020-06-27T04:57:13.761694+0000 mgr.x (mgr.34109) 525 : cluster [DBG] pgmap v604: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:15.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:14 smithi031 bash[22603]: cluster 2020-06-27T04:57:13.761694+0000 mgr.x (mgr.34109) 525 : cluster [DBG] pgmap v604: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:15.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:14 smithi031 bash[18426]: cluster 2020-06-27T04:57:13.761694+0000 mgr.x (mgr.34109) 525 : cluster [DBG] pgmap v604: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:17.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:16 smithi051 bash[18409]: cluster 2020-06-27T04:57:15.764260+0000 mgr.x (mgr.34109) 526 : cluster [DBG] pgmap v605: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:17.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:16 smithi031 bash[18426]: cluster 2020-06-27T04:57:15.764260+0000 mgr.x (mgr.34109) 526 : cluster [DBG] pgmap v605: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:17.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:16 smithi031 bash[22603]: cluster 2020-06-27T04:57:15.764260+0000 mgr.x (mgr.34109) 526 : cluster [DBG] pgmap v605: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:19.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:18 smithi051 bash[18409]: cluster 2020-06-27T04:57:17.766440+0000 mgr.x (mgr.34109) 527 : cluster [DBG] pgmap v606: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:19.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:18 smithi031 bash[18426]: cluster 2020-06-27T04:57:17.766440+0000 mgr.x (mgr.34109) 527 : cluster [DBG] pgmap v606: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:19.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:18 smithi031 bash[22603]: cluster 2020-06-27T04:57:17.766440+0000 mgr.x (mgr.34109) 527 : cluster [DBG] pgmap v606: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:20.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:20 smithi051 bash[18409]: cluster 2020-06-27T04:57:19.768401+0000 mgr.x (mgr.34109) 528 : cluster [DBG] pgmap v607: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:20 smithi031 bash[18426]: cluster 2020-06-27T04:57:19.768401+0000 mgr.x (mgr.34109) 528 : cluster [DBG] pgmap v607: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:20.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:20 smithi031 bash[22603]: cluster 2020-06-27T04:57:19.768401+0000 mgr.x (mgr.34109) 528 : cluster [DBG] pgmap v607: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:23.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:22 smithi051 bash[18409]: cluster 2020-06-27T04:57:21.770764+0000 mgr.x (mgr.34109) 529 : cluster [DBG] pgmap v608: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:23.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:22 smithi031 bash[18426]: cluster 2020-06-27T04:57:21.770764+0000 mgr.x (mgr.34109) 529 : cluster [DBG] pgmap v608: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:23.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:22 smithi031 bash[22603]: cluster 2020-06-27T04:57:21.770764+0000 mgr.x (mgr.34109) 529 : cluster [DBG] pgmap v608: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:25.217 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:24 smithi051 bash[18409]: cluster 2020-06-27T04:57:23.772345+0000 mgr.x (mgr.34109) 530 : cluster [DBG] pgmap v609: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:25.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:24 smithi031 bash[18426]: cluster 2020-06-27T04:57:23.772345+0000 mgr.x (mgr.34109) 530 : cluster [DBG] pgmap v609: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:25.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:24 smithi031 bash[22603]: cluster 2020-06-27T04:57:23.772345+0000 mgr.x (mgr.34109) 530 : cluster [DBG] pgmap v609: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:27.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:26 smithi051 bash[18409]: cluster 2020-06-27T04:57:25.774684+0000 mgr.x (mgr.34109) 531 : cluster [DBG] pgmap v610: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:27.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:26 smithi031 bash[18426]: cluster 2020-06-27T04:57:25.774684+0000 mgr.x (mgr.34109) 531 : cluster [DBG] pgmap v610: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:27.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:26 smithi031 bash[22603]: cluster 2020-06-27T04:57:25.774684+0000 mgr.x (mgr.34109) 531 : cluster [DBG] pgmap v610: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:29.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:28 smithi051 bash[18409]: cluster 2020-06-27T04:57:27.776922+0000 mgr.x (mgr.34109) 532 : cluster [DBG] pgmap v611: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:29.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:28 smithi031 bash[18426]: cluster 2020-06-27T04:57:27.776922+0000 mgr.x (mgr.34109) 532 : cluster [DBG] pgmap v611: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:29.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:28 smithi031 bash[22603]: cluster 2020-06-27T04:57:27.776922+0000 mgr.x (mgr.34109) 532 : cluster [DBG] pgmap v611: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:30.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:30 smithi051 bash[18409]: cluster 2020-06-27T04:57:29.778886+0000 mgr.x (mgr.34109) 533 : cluster [DBG] pgmap v612: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:30.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:30 smithi031 bash[18426]: cluster 2020-06-27T04:57:29.778886+0000 mgr.x (mgr.34109) 533 : cluster [DBG] pgmap v612: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:30.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:30 smithi031 bash[22603]: cluster 2020-06-27T04:57:29.778886+0000 mgr.x (mgr.34109) 533 : cluster [DBG] pgmap v612: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:33.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:32 smithi051 bash[18409]: cluster 2020-06-27T04:57:31.781185+0000 mgr.x (mgr.34109) 534 : cluster [DBG] pgmap v613: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:33.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:32 smithi031 bash[22603]: cluster 2020-06-27T04:57:31.781185+0000 mgr.x (mgr.34109) 534 : cluster [DBG] pgmap v613: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:33.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:32 smithi031 bash[18426]: cluster 2020-06-27T04:57:31.781185+0000 mgr.x (mgr.34109) 534 : cluster [DBG] pgmap v613: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:35.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:34 smithi051 bash[18409]: cluster 2020-06-27T04:57:33.782795+0000 mgr.x (mgr.34109) 535 : cluster [DBG] pgmap v614: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:35.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:34 smithi031 bash[22603]: cluster 2020-06-27T04:57:33.782795+0000 mgr.x (mgr.34109) 535 : cluster [DBG] pgmap v614: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:35.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:34 smithi031 bash[18426]: cluster 2020-06-27T04:57:33.782795+0000 mgr.x (mgr.34109) 535 : cluster [DBG] pgmap v614: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:37.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:36 smithi051 bash[18409]: cluster 2020-06-27T04:57:35.785272+0000 mgr.x (mgr.34109) 536 : cluster [DBG] pgmap v615: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:37.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:36 smithi031 bash[18426]: cluster 2020-06-27T04:57:35.785272+0000 mgr.x (mgr.34109) 536 : cluster [DBG] pgmap v615: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:37.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:36 smithi031 bash[22603]: cluster 2020-06-27T04:57:35.785272+0000 mgr.x (mgr.34109) 536 : cluster [DBG] pgmap v615: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:39.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:38 smithi051 bash[18409]: cluster 2020-06-27T04:57:37.787458+0000 mgr.x (mgr.34109) 537 : cluster [DBG] pgmap v616: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:39.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:38 smithi031 bash[18426]: cluster 2020-06-27T04:57:37.787458+0000 mgr.x (mgr.34109) 537 : cluster [DBG] pgmap v616: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:39.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:38 smithi031 bash[22603]: cluster 2020-06-27T04:57:37.787458+0000 mgr.x (mgr.34109) 537 : cluster [DBG] pgmap v616: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:40.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:40 smithi051 bash[18409]: cluster 2020-06-27T04:57:39.789527+0000 mgr.x (mgr.34109) 538 : cluster [DBG] pgmap v617: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:40 smithi031 bash[18426]: cluster 2020-06-27T04:57:39.789527+0000 mgr.x (mgr.34109) 538 : cluster [DBG] pgmap v617: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:40.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:40 smithi031 bash[22603]: cluster 2020-06-27T04:57:39.789527+0000 mgr.x (mgr.34109) 538 : cluster [DBG] pgmap v617: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:43.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:42 smithi051 bash[18409]: cluster 2020-06-27T04:57:41.791787+0000 mgr.x (mgr.34109) 539 : cluster [DBG] pgmap v618: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:43.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:42 smithi031 bash[18426]: cluster 2020-06-27T04:57:41.791787+0000 mgr.x (mgr.34109) 539 : cluster [DBG] pgmap v618: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:43.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:42 smithi031 bash[22603]: cluster 2020-06-27T04:57:41.791787+0000 mgr.x (mgr.34109) 539 : cluster [DBG] pgmap v618: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:45.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:44 smithi051 bash[18409]: cluster 2020-06-27T04:57:43.793395+0000 mgr.x (mgr.34109) 540 : cluster [DBG] pgmap v619: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:45.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:44 smithi031 bash[18426]: cluster 2020-06-27T04:57:43.793395+0000 mgr.x (mgr.34109) 540 : cluster [DBG] pgmap v619: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:45.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:44 smithi031 bash[22603]: cluster 2020-06-27T04:57:43.793395+0000 mgr.x (mgr.34109) 540 : cluster [DBG] pgmap v619: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:47.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:46 smithi051 bash[18409]: cluster 2020-06-27T04:57:45.795970+0000 mgr.x (mgr.34109) 541 : cluster [DBG] pgmap v620: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:47.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:46 smithi031 bash[22603]: cluster 2020-06-27T04:57:45.795970+0000 mgr.x (mgr.34109) 541 : cluster [DBG] pgmap v620: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:47.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:46 smithi031 bash[18426]: cluster 2020-06-27T04:57:45.795970+0000 mgr.x (mgr.34109) 541 : cluster [DBG] pgmap v620: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:49.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:48 smithi051 bash[18409]: cluster 2020-06-27T04:57:47.798178+0000 mgr.x (mgr.34109) 542 : cluster [DBG] pgmap v621: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:49.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:48 smithi031 bash[22603]: cluster 2020-06-27T04:57:47.798178+0000 mgr.x (mgr.34109) 542 : cluster [DBG] pgmap v621: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:49.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:48 smithi031 bash[18426]: cluster 2020-06-27T04:57:47.798178+0000 mgr.x (mgr.34109) 542 : cluster [DBG] pgmap v621: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:50.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:50 smithi051 bash[18409]: cluster 2020-06-27T04:57:49.800187+0000 mgr.x (mgr.34109) 543 : cluster [DBG] pgmap v622: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:50.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:50 smithi031 bash[22603]: cluster 2020-06-27T04:57:49.800187+0000 mgr.x (mgr.34109) 543 : cluster [DBG] pgmap v622: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:50.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:50 smithi031 bash[18426]: cluster 2020-06-27T04:57:49.800187+0000 mgr.x (mgr.34109) 543 : cluster [DBG] pgmap v622: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:53.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:52 smithi051 bash[18409]: cluster 2020-06-27T04:57:51.802565+0000 mgr.x (mgr.34109) 544 : cluster [DBG] pgmap v623: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:53.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:52 smithi031 bash[18426]: cluster 2020-06-27T04:57:51.802565+0000 mgr.x (mgr.34109) 544 : cluster [DBG] pgmap v623: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:53.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:52 smithi031 bash[22603]: cluster 2020-06-27T04:57:51.802565+0000 mgr.x (mgr.34109) 544 : cluster [DBG] pgmap v623: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:55.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:54 smithi051 bash[18409]: cluster 2020-06-27T04:57:53.804171+0000 mgr.x (mgr.34109) 545 : cluster [DBG] pgmap v624: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:55.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:54 smithi031 bash[18426]: cluster 2020-06-27T04:57:53.804171+0000 mgr.x (mgr.34109) 545 : cluster [DBG] pgmap v624: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:55.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:54 smithi031 bash[22603]: cluster 2020-06-27T04:57:53.804171+0000 mgr.x (mgr.34109) 545 : cluster [DBG] pgmap v624: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:57.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:56 smithi051 bash[18409]: cluster 2020-06-27T04:57:55.806521+0000 mgr.x (mgr.34109) 546 : cluster [DBG] pgmap v625: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:57.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:56 smithi031 bash[18426]: cluster 2020-06-27T04:57:55.806521+0000 mgr.x (mgr.34109) 546 : cluster [DBG] pgmap v625: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:57.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:56 smithi031 bash[22603]: cluster 2020-06-27T04:57:55.806521+0000 mgr.x (mgr.34109) 546 : cluster [DBG] pgmap v625: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:59.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:57:58 smithi051 bash[18409]: cluster 2020-06-27T04:57:57.808609+0000 mgr.x (mgr.34109) 547 : cluster [DBG] pgmap v626: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:59.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:57:58 smithi031 bash[18426]: cluster 2020-06-27T04:57:57.808609+0000 mgr.x (mgr.34109) 547 : cluster [DBG] pgmap v626: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:57:59.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:57:58 smithi031 bash[22603]: cluster 2020-06-27T04:57:57.808609+0000 mgr.x (mgr.34109) 547 : cluster [DBG] pgmap v626: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:00.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:00 smithi051 bash[18409]: cluster 2020-06-27T04:57:59.810537+0000 mgr.x (mgr.34109) 548 : cluster [DBG] pgmap v627: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:00.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:00 smithi031 bash[18426]: cluster 2020-06-27T04:57:59.810537+0000 mgr.x (mgr.34109) 548 : cluster [DBG] pgmap v627: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:00.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:00 smithi031 bash[22603]: cluster 2020-06-27T04:57:59.810537+0000 mgr.x (mgr.34109) 548 : cluster [DBG] pgmap v627: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:03.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:02 smithi051 bash[18409]: cluster 2020-06-27T04:58:01.812854+0000 mgr.x (mgr.34109) 549 : cluster [DBG] pgmap v628: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:03.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:02 smithi031 bash[18426]: cluster 2020-06-27T04:58:01.812854+0000 mgr.x (mgr.34109) 549 : cluster [DBG] pgmap v628: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:03.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:02 smithi031 bash[22603]: cluster 2020-06-27T04:58:01.812854+0000 mgr.x (mgr.34109) 549 : cluster [DBG] pgmap v628: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:05.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:04 smithi051 bash[18409]: cluster 2020-06-27T04:58:03.814396+0000 mgr.x (mgr.34109) 550 : cluster [DBG] pgmap v629: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:05.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:04 smithi031 bash[18426]: cluster 2020-06-27T04:58:03.814396+0000 mgr.x (mgr.34109) 550 : cluster [DBG] pgmap v629: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:05.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:04 smithi031 bash[22603]: cluster 2020-06-27T04:58:03.814396+0000 mgr.x (mgr.34109) 550 : cluster [DBG] pgmap v629: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:07.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:06 smithi051 bash[18409]: cluster 2020-06-27T04:58:05.816790+0000 mgr.x (mgr.34109) 551 : cluster [DBG] pgmap v630: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:07.222 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:06 smithi031 bash[22603]: cluster 2020-06-27T04:58:05.816790+0000 mgr.x (mgr.34109) 551 : cluster [DBG] pgmap v630: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:07.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:06 smithi031 bash[18426]: cluster 2020-06-27T04:58:05.816790+0000 mgr.x (mgr.34109) 551 : cluster [DBG] pgmap v630: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:09.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:08 smithi051 bash[18409]: cluster 2020-06-27T04:58:07.819075+0000 mgr.x (mgr.34109) 552 : cluster [DBG] pgmap v631: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:09.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:08 smithi031 bash[22603]: cluster 2020-06-27T04:58:07.819075+0000 mgr.x (mgr.34109) 552 : cluster [DBG] pgmap v631: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:09.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:08 smithi031 bash[18426]: cluster 2020-06-27T04:58:07.819075+0000 mgr.x (mgr.34109) 552 : cluster [DBG] pgmap v631: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:10.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:10 smithi051 bash[18409]: cluster 2020-06-27T04:58:09.821145+0000 mgr.x (mgr.34109) 553 : cluster [DBG] pgmap v632: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:10.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:10 smithi031 bash[18426]: cluster 2020-06-27T04:58:09.821145+0000 mgr.x (mgr.34109) 553 : cluster [DBG] pgmap v632: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:10.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:10 smithi031 bash[22603]: cluster 2020-06-27T04:58:09.821145+0000 mgr.x (mgr.34109) 553 : cluster [DBG] pgmap v632: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:13.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:12 smithi051 bash[18409]: cluster 2020-06-27T04:58:11.823734+0000 mgr.x (mgr.34109) 554 : cluster [DBG] pgmap v633: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:13.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:12 smithi031 bash[18426]: cluster 2020-06-27T04:58:11.823734+0000 mgr.x (mgr.34109) 554 : cluster [DBG] pgmap v633: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:13.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:12 smithi031 bash[22603]: cluster 2020-06-27T04:58:11.823734+0000 mgr.x (mgr.34109) 554 : cluster [DBG] pgmap v633: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:15.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:14 smithi051 bash[18409]: cluster 2020-06-27T04:58:13.825438+0000 mgr.x (mgr.34109) 555 : cluster [DBG] pgmap v634: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:15.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:14 smithi031 bash[18426]: cluster 2020-06-27T04:58:13.825438+0000 mgr.x (mgr.34109) 555 : cluster [DBG] pgmap v634: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:15.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:14 smithi031 bash[22603]: cluster 2020-06-27T04:58:13.825438+0000 mgr.x (mgr.34109) 555 : cluster [DBG] pgmap v634: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:17.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:16 smithi051 bash[18409]: cluster 2020-06-27T04:58:15.828043+0000 mgr.x (mgr.34109) 556 : cluster [DBG] pgmap v635: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:17.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:16 smithi031 bash[18426]: cluster 2020-06-27T04:58:15.828043+0000 mgr.x (mgr.34109) 556 : cluster [DBG] pgmap v635: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:17.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:16 smithi031 bash[22603]: cluster 2020-06-27T04:58:15.828043+0000 mgr.x (mgr.34109) 556 : cluster [DBG] pgmap v635: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:19.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:18 smithi051 bash[18409]: cluster 2020-06-27T04:58:17.830259+0000 mgr.x (mgr.34109) 557 : cluster [DBG] pgmap v636: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:19.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:18 smithi031 bash[18426]: cluster 2020-06-27T04:58:17.830259+0000 mgr.x (mgr.34109) 557 : cluster [DBG] pgmap v636: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:19.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:18 smithi031 bash[22603]: cluster 2020-06-27T04:58:17.830259+0000 mgr.x (mgr.34109) 557 : cluster [DBG] pgmap v636: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:20.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:20 smithi051 bash[18409]: cluster 2020-06-27T04:58:19.832335+0000 mgr.x (mgr.34109) 558 : cluster [DBG] pgmap v637: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:20.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:20 smithi031 bash[22603]: cluster 2020-06-27T04:58:19.832335+0000 mgr.x (mgr.34109) 558 : cluster [DBG] pgmap v637: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:20 smithi031 bash[18426]: cluster 2020-06-27T04:58:19.832335+0000 mgr.x (mgr.34109) 558 : cluster [DBG] pgmap v637: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:23.217 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:22 smithi051 bash[18409]: cluster 2020-06-27T04:58:21.834650+0000 mgr.x (mgr.34109) 559 : cluster [DBG] pgmap v638: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:23.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:22 smithi031 bash[18426]: cluster 2020-06-27T04:58:21.834650+0000 mgr.x (mgr.34109) 559 : cluster [DBG] pgmap v638: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:23.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:22 smithi031 bash[22603]: cluster 2020-06-27T04:58:21.834650+0000 mgr.x (mgr.34109) 559 : cluster [DBG] pgmap v638: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:25.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:24 smithi051 bash[18409]: cluster 2020-06-27T04:58:23.836211+0000 mgr.x (mgr.34109) 560 : cluster [DBG] pgmap v639: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:25.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:24 smithi031 bash[18426]: cluster 2020-06-27T04:58:23.836211+0000 mgr.x (mgr.34109) 560 : cluster [DBG] pgmap v639: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:25.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:24 smithi031 bash[22603]: cluster 2020-06-27T04:58:23.836211+0000 mgr.x (mgr.34109) 560 : cluster [DBG] pgmap v639: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:27.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:26 smithi051 bash[18409]: cluster 2020-06-27T04:58:25.838653+0000 mgr.x (mgr.34109) 561 : cluster [DBG] pgmap v640: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:27.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:26 smithi031 bash[18426]: cluster 2020-06-27T04:58:25.838653+0000 mgr.x (mgr.34109) 561 : cluster [DBG] pgmap v640: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:27.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:26 smithi031 bash[22603]: cluster 2020-06-27T04:58:25.838653+0000 mgr.x (mgr.34109) 561 : cluster [DBG] pgmap v640: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:29.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:28 smithi051 bash[18409]: cluster 2020-06-27T04:58:27.840915+0000 mgr.x (mgr.34109) 562 : cluster [DBG] pgmap v641: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:29.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:28 smithi031 bash[18426]: cluster 2020-06-27T04:58:27.840915+0000 mgr.x (mgr.34109) 562 : cluster [DBG] pgmap v641: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:29.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:28 smithi031 bash[22603]: cluster 2020-06-27T04:58:27.840915+0000 mgr.x (mgr.34109) 562 : cluster [DBG] pgmap v641: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:30.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:30 smithi051 bash[18409]: cluster 2020-06-27T04:58:29.843056+0000 mgr.x (mgr.34109) 563 : cluster [DBG] pgmap v642: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:30.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:30 smithi031 bash[18426]: cluster 2020-06-27T04:58:29.843056+0000 mgr.x (mgr.34109) 563 : cluster [DBG] pgmap v642: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:30.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:30 smithi031 bash[22603]: cluster 2020-06-27T04:58:29.843056+0000 mgr.x (mgr.34109) 563 : cluster [DBG] pgmap v642: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:33.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:32 smithi051 bash[18409]: cluster 2020-06-27T04:58:31.845524+0000 mgr.x (mgr.34109) 564 : cluster [DBG] pgmap v643: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:33.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:32 smithi031 bash[18426]: cluster 2020-06-27T04:58:31.845524+0000 mgr.x (mgr.34109) 564 : cluster [DBG] pgmap v643: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:33.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:32 smithi031 bash[22603]: cluster 2020-06-27T04:58:31.845524+0000 mgr.x (mgr.34109) 564 : cluster [DBG] pgmap v643: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:35.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:34 smithi051 bash[18409]: cluster 2020-06-27T04:58:33.847281+0000 mgr.x (mgr.34109) 565 : cluster [DBG] pgmap v644: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:35.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:34 smithi031 bash[22603]: cluster 2020-06-27T04:58:33.847281+0000 mgr.x (mgr.34109) 565 : cluster [DBG] pgmap v644: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:35.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:34 smithi031 bash[18426]: cluster 2020-06-27T04:58:33.847281+0000 mgr.x (mgr.34109) 565 : cluster [DBG] pgmap v644: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:37.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:36 smithi051 bash[18409]: cluster 2020-06-27T04:58:35.849841+0000 mgr.x (mgr.34109) 566 : cluster [DBG] pgmap v645: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:37.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:36 smithi031 bash[22603]: cluster 2020-06-27T04:58:35.849841+0000 mgr.x (mgr.34109) 566 : cluster [DBG] pgmap v645: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:37.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:36 smithi031 bash[18426]: cluster 2020-06-27T04:58:35.849841+0000 mgr.x (mgr.34109) 566 : cluster [DBG] pgmap v645: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:39.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:38 smithi051 bash[18409]: cluster 2020-06-27T04:58:37.851975+0000 mgr.x (mgr.34109) 567 : cluster [DBG] pgmap v646: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:39.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:38 smithi031 bash[22603]: cluster 2020-06-27T04:58:37.851975+0000 mgr.x (mgr.34109) 567 : cluster [DBG] pgmap v646: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:39.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:38 smithi031 bash[18426]: cluster 2020-06-27T04:58:37.851975+0000 mgr.x (mgr.34109) 567 : cluster [DBG] pgmap v646: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:40.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:40 smithi051 bash[18409]: cluster 2020-06-27T04:58:39.854091+0000 mgr.x (mgr.34109) 568 : cluster [DBG] pgmap v647: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:40.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:40 smithi031 bash[22603]: cluster 2020-06-27T04:58:39.854091+0000 mgr.x (mgr.34109) 568 : cluster [DBG] pgmap v647: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:40 smithi031 bash[18426]: cluster 2020-06-27T04:58:39.854091+0000 mgr.x (mgr.34109) 568 : cluster [DBG] pgmap v647: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:43.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:42 smithi051 bash[18409]: cluster 2020-06-27T04:58:41.856446+0000 mgr.x (mgr.34109) 569 : cluster [DBG] pgmap v648: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:43.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:42 smithi031 bash[22603]: cluster 2020-06-27T04:58:41.856446+0000 mgr.x (mgr.34109) 569 : cluster [DBG] pgmap v648: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:43.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:42 smithi031 bash[18426]: cluster 2020-06-27T04:58:41.856446+0000 mgr.x (mgr.34109) 569 : cluster [DBG] pgmap v648: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:45.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:44 smithi051 bash[18409]: cluster 2020-06-27T04:58:43.858087+0000 mgr.x (mgr.34109) 570 : cluster [DBG] pgmap v649: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:45.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:44 smithi031 bash[22603]: cluster 2020-06-27T04:58:43.858087+0000 mgr.x (mgr.34109) 570 : cluster [DBG] pgmap v649: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:45.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:44 smithi031 bash[18426]: cluster 2020-06-27T04:58:43.858087+0000 mgr.x (mgr.34109) 570 : cluster [DBG] pgmap v649: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:47.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:46 smithi051 bash[18409]: cluster 2020-06-27T04:58:45.860666+0000 mgr.x (mgr.34109) 571 : cluster [DBG] pgmap v650: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:47.222 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:46 smithi031 bash[22603]: cluster 2020-06-27T04:58:45.860666+0000 mgr.x (mgr.34109) 571 : cluster [DBG] pgmap v650: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:47.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:46 smithi031 bash[18426]: cluster 2020-06-27T04:58:45.860666+0000 mgr.x (mgr.34109) 571 : cluster [DBG] pgmap v650: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:49.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:48 smithi051 bash[18409]: cluster 2020-06-27T04:58:47.862763+0000 mgr.x (mgr.34109) 572 : cluster [DBG] pgmap v651: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:49.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:48 smithi031 bash[22603]: cluster 2020-06-27T04:58:47.862763+0000 mgr.x (mgr.34109) 572 : cluster [DBG] pgmap v651: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:49.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:48 smithi031 bash[18426]: cluster 2020-06-27T04:58:47.862763+0000 mgr.x (mgr.34109) 572 : cluster [DBG] pgmap v651: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 25 MiB used, 707 GiB / 715 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:50.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:49 smithi051 bash[18409]: cluster 2020-06-27T04:58:49.499945+0000 mon.a (mon.0) 1379 : cluster [INF] Marking osd.5 out (has been down for 603 seconds) 2020-06-27T04:58:50.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:49 smithi051 bash[18409]: cluster 2020-06-27T04:58:49.500442+0000 mon.a (mon.0) 1380 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:58:50.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:49 smithi051 bash[18409]: cluster 2020-06-27T04:58:49.506498+0000 mon.a (mon.0) 1381 : cluster [DBG] osdmap e169: 8 total, 3 up, 7 in 2020-06-27T04:58:50.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:49 smithi031 bash[22603]: cluster 2020-06-27T04:58:49.499945+0000 mon.a (mon.0) 1379 : cluster [INF] Marking osd.5 out (has been down for 603 seconds) 2020-06-27T04:58:50.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:49 smithi031 bash[22603]: cluster 2020-06-27T04:58:49.500442+0000 mon.a (mon.0) 1380 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:58:50.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:49 smithi031 bash[22603]: cluster 2020-06-27T04:58:49.506498+0000 mon.a (mon.0) 1381 : cluster [DBG] osdmap e169: 8 total, 3 up, 7 in 2020-06-27T04:58:50.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:49 smithi031 bash[18426]: cluster 2020-06-27T04:58:49.499945+0000 mon.a (mon.0) 1379 : cluster [INF] Marking osd.5 out (has been down for 603 seconds) 2020-06-27T04:58:50.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:49 smithi031 bash[18426]: cluster 2020-06-27T04:58:49.500442+0000 mon.a (mon.0) 1380 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:58:50.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:49 smithi031 bash[18426]: cluster 2020-06-27T04:58:49.506498+0000 mon.a (mon.0) 1381 : cluster [DBG] osdmap e169: 8 total, 3 up, 7 in 2020-06-27T04:58:51.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:50 smithi051 bash[18409]: cluster 2020-06-27T04:58:49.864312+0000 mgr.x (mgr.34109) 573 : cluster [DBG] pgmap v653: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:51.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:50 smithi051 bash[18409]: cluster 2020-06-27T04:58:50.526892+0000 mon.a (mon.0) 1382 : cluster [DBG] osdmap e170: 8 total, 3 up, 7 in 2020-06-27T04:58:51.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:50 smithi051 bash[18409]: audit 2020-06-27T04:58:50.582827+0000 mon.a (mon.0) 1383 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41319-6", "tierpool": "test-rados-api-smithi031-41319-7", "force_nonempty": "--force-nonempty" }]: dispatch 2020-06-27T04:58:51.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:50 smithi031 bash[22603]: cluster 2020-06-27T04:58:49.864312+0000 mgr.x (mgr.34109) 573 : cluster [DBG] pgmap v653: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:51.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:50 smithi031 bash[22603]: cluster 2020-06-27T04:58:50.526892+0000 mon.a (mon.0) 1382 : cluster [DBG] osdmap e170: 8 total, 3 up, 7 in 2020-06-27T04:58:51.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:50 smithi031 bash[22603]: audit 2020-06-27T04:58:50.582827+0000 mon.a (mon.0) 1383 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41319-6", "tierpool": "test-rados-api-smithi031-41319-7", "force_nonempty": "--force-nonempty" }]: dispatch 2020-06-27T04:58:51.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:50 smithi031 bash[18426]: cluster 2020-06-27T04:58:49.864312+0000 mgr.x (mgr.34109) 573 : cluster [DBG] pgmap v653: 777 pgs: 1 recovery_unfound+undersized+degraded+peered, 50 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 164 active+undersized, 18 stale+peering, 58 undersized+degraded+peered, 13 active+clean, 19 stale+undersized+peered, 251 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 410/1104 objects degraded (37.138%); 2/368 objects unfound (0.543%) 2020-06-27T04:58:51.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:50 smithi031 bash[18426]: cluster 2020-06-27T04:58:50.526892+0000 mon.a (mon.0) 1382 : cluster [DBG] osdmap e170: 8 total, 3 up, 7 in 2020-06-27T04:58:51.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:50 smithi031 bash[18426]: audit 2020-06-27T04:58:50.582827+0000 mon.a (mon.0) 1383 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41319-6", "tierpool": "test-rados-api-smithi031-41319-7", "force_nonempty": "--force-nonempty" }]: dispatch 2020-06-27T04:58:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:52 smithi051 bash[18409]: audit 2020-06-27T04:58:51.523741+0000 mon.a (mon.0) 1384 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41319-6", "tierpool": "test-rados-api-smithi031-41319-7", "force_nonempty": "--force-nonempty" }]': finished 2020-06-27T04:58:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:52 smithi051 bash[18409]: cluster 2020-06-27T04:58:51.523799+0000 mon.a (mon.0) 1385 : cluster [DBG] osdmap e171: 8 total, 3 up, 7 in 2020-06-27T04:58:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:52 smithi051 bash[18409]: audit 2020-06-27T04:58:51.526685+0000 mon.a (mon.0) 1386 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi031-41319-6", "overlaypool": "test-rados-api-smithi031-41319-7"}]: dispatch 2020-06-27T04:58:52.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:52 smithi051 bash[18409]: cluster 2020-06-27T04:58:51.866382+0000 mgr.x (mgr.34109) 574 : cluster [DBG] pgmap v656: 777 pgs: 1 creating+peering, 19 peering, 51 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 170 active+undersized, 18 stale+peering, 55 undersized+degraded+peered, 17 active+clean, 19 stale+undersized+peered, 224 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 170 B/s wr, 0 op/s; 397/1107 objects degraded (35.863%); 82 B/s, 0 objects/s recovering 2020-06-27T04:58:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:52 smithi031 bash[18426]: audit 2020-06-27T04:58:51.523741+0000 mon.a (mon.0) 1384 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41319-6", "tierpool": "test-rados-api-smithi031-41319-7", "force_nonempty": "--force-nonempty" }]': finished 2020-06-27T04:58:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:52 smithi031 bash[18426]: cluster 2020-06-27T04:58:51.523799+0000 mon.a (mon.0) 1385 : cluster [DBG] osdmap e171: 8 total, 3 up, 7 in 2020-06-27T04:58:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:52 smithi031 bash[18426]: audit 2020-06-27T04:58:51.526685+0000 mon.a (mon.0) 1386 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi031-41319-6", "overlaypool": "test-rados-api-smithi031-41319-7"}]: dispatch 2020-06-27T04:58:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:52 smithi031 bash[18426]: cluster 2020-06-27T04:58:51.866382+0000 mgr.x (mgr.34109) 574 : cluster [DBG] pgmap v656: 777 pgs: 1 creating+peering, 19 peering, 51 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 170 active+undersized, 18 stale+peering, 55 undersized+degraded+peered, 17 active+clean, 19 stale+undersized+peered, 224 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 170 B/s wr, 0 op/s; 397/1107 objects degraded (35.863%); 82 B/s, 0 objects/s recovering 2020-06-27T04:58:52.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:52 smithi031 bash[22603]: audit 2020-06-27T04:58:51.523741+0000 mon.a (mon.0) 1384 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi031-41319-6", "tierpool": "test-rados-api-smithi031-41319-7", "force_nonempty": "--force-nonempty" }]': finished 2020-06-27T04:58:52.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:52 smithi031 bash[22603]: cluster 2020-06-27T04:58:51.523799+0000 mon.a (mon.0) 1385 : cluster [DBG] osdmap e171: 8 total, 3 up, 7 in 2020-06-27T04:58:52.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:52 smithi031 bash[22603]: audit 2020-06-27T04:58:51.526685+0000 mon.a (mon.0) 1386 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi031-41319-6", "overlaypool": "test-rados-api-smithi031-41319-7"}]: dispatch 2020-06-27T04:58:52.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:52 smithi031 bash[22603]: cluster 2020-06-27T04:58:51.866382+0000 mgr.x (mgr.34109) 574 : cluster [DBG] pgmap v656: 777 pgs: 1 creating+peering, 19 peering, 51 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 170 active+undersized, 18 stale+peering, 55 undersized+degraded+peered, 17 active+clean, 19 stale+undersized+peered, 224 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 170 B/s wr, 0 op/s; 397/1107 objects degraded (35.863%); 82 B/s, 0 objects/s recovering 2020-06-27T04:58:53.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:53 smithi051 bash[18409]: cluster 2020-06-27T04:58:52.520338+0000 mon.a (mon.0) 1387 : cluster [WRN] Health check update: Reduced data availability: 535 pgs inactive, 181 pgs down, 38 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:58:53.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:53 smithi051 bash[18409]: cluster 2020-06-27T04:58:52.520417+0000 mon.a (mon.0) 1388 : cluster [WRN] Health check update: Degraded data redundancy: 397/1107 objects degraded (35.863%), 109 pgs degraded, 507 pgs undersized (PG_DEGRADED) 2020-06-27T04:58:53.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:53 smithi051 bash[18409]: cluster 2020-06-27T04:58:52.520440+0000 mon.a (mon.0) 1389 : cluster [INF] Health check cleared: OBJECT_UNFOUND (was: 2/368 objects unfound (0.543%)) 2020-06-27T04:58:53.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:53 smithi051 bash[18409]: cluster 2020-06-27T04:58:52.520466+0000 mon.a (mon.0) 1390 : cluster [INF] Health check cleared: PG_DAMAGED (was: Possible data damage: 1 pg recovery_unfound) 2020-06-27T04:58:53.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:53 smithi051 bash[18409]: audit 2020-06-27T04:58:52.534480+0000 mon.a (mon.0) 1391 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi031-41319-6", "overlaypool": "test-rados-api-smithi031-41319-7"}]': finished 2020-06-27T04:58:53.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:53 smithi051 bash[18409]: cluster 2020-06-27T04:58:52.534547+0000 mon.a (mon.0) 1392 : cluster [DBG] osdmap e172: 8 total, 3 up, 7 in 2020-06-27T04:58:53.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:53 smithi031 bash[18426]: cluster 2020-06-27T04:58:52.520338+0000 mon.a (mon.0) 1387 : cluster [WRN] Health check update: Reduced data availability: 535 pgs inactive, 181 pgs down, 38 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:58:53.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:53 smithi031 bash[18426]: cluster 2020-06-27T04:58:52.520417+0000 mon.a (mon.0) 1388 : cluster [WRN] Health check update: Degraded data redundancy: 397/1107 objects degraded (35.863%), 109 pgs degraded, 507 pgs undersized (PG_DEGRADED) 2020-06-27T04:58:53.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:53 smithi031 bash[18426]: cluster 2020-06-27T04:58:52.520440+0000 mon.a (mon.0) 1389 : cluster [INF] Health check cleared: OBJECT_UNFOUND (was: 2/368 objects unfound (0.543%)) 2020-06-27T04:58:53.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:53 smithi031 bash[18426]: cluster 2020-06-27T04:58:52.520466+0000 mon.a (mon.0) 1390 : cluster [INF] Health check cleared: PG_DAMAGED (was: Possible data damage: 1 pg recovery_unfound) 2020-06-27T04:58:53.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:53 smithi031 bash[18426]: audit 2020-06-27T04:58:52.534480+0000 mon.a (mon.0) 1391 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi031-41319-6", "overlaypool": "test-rados-api-smithi031-41319-7"}]': finished 2020-06-27T04:58:53.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:53 smithi031 bash[18426]: cluster 2020-06-27T04:58:52.534547+0000 mon.a (mon.0) 1392 : cluster [DBG] osdmap e172: 8 total, 3 up, 7 in 2020-06-27T04:58:53.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:53 smithi031 bash[22603]: cluster 2020-06-27T04:58:52.520338+0000 mon.a (mon.0) 1387 : cluster [WRN] Health check update: Reduced data availability: 535 pgs inactive, 181 pgs down, 38 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:58:53.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:53 smithi031 bash[22603]: cluster 2020-06-27T04:58:52.520417+0000 mon.a (mon.0) 1388 : cluster [WRN] Health check update: Degraded data redundancy: 397/1107 objects degraded (35.863%), 109 pgs degraded, 507 pgs undersized (PG_DEGRADED) 2020-06-27T04:58:53.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:53 smithi031 bash[22603]: cluster 2020-06-27T04:58:52.520440+0000 mon.a (mon.0) 1389 : cluster [INF] Health check cleared: OBJECT_UNFOUND (was: 2/368 objects unfound (0.543%)) 2020-06-27T04:58:53.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:53 smithi031 bash[22603]: cluster 2020-06-27T04:58:52.520466+0000 mon.a (mon.0) 1390 : cluster [INF] Health check cleared: PG_DAMAGED (was: Possible data damage: 1 pg recovery_unfound) 2020-06-27T04:58:53.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:53 smithi031 bash[22603]: audit 2020-06-27T04:58:52.534480+0000 mon.a (mon.0) 1391 : audit [INF] from='client.? 172.21.15.31:0/29543325' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi031-41319-6", "overlaypool": "test-rados-api-smithi031-41319-7"}]': finished 2020-06-27T04:58:53.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:53 smithi031 bash[22603]: cluster 2020-06-27T04:58:52.534547+0000 mon.a (mon.0) 1392 : cluster [DBG] osdmap e172: 8 total, 3 up, 7 in 2020-06-27T04:58:54.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:54 smithi051 bash[18409]: cluster 2020-06-27T04:58:53.867992+0000 mgr.x (mgr.34109) 575 : cluster [DBG] pgmap v658: 777 pgs: 1 creating+peering, 19 peering, 51 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 170 active+undersized, 18 stale+peering, 55 undersized+degraded+peered, 17 active+clean, 19 stale+undersized+peered, 224 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 234 B/s wr, 0 op/s; 397/1107 objects degraded (35.863%); 113 B/s, 1 objects/s recovering 2020-06-27T04:58:54.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:54 smithi031 bash[18426]: cluster 2020-06-27T04:58:53.867992+0000 mgr.x (mgr.34109) 575 : cluster [DBG] pgmap v658: 777 pgs: 1 creating+peering, 19 peering, 51 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 170 active+undersized, 18 stale+peering, 55 undersized+degraded+peered, 17 active+clean, 19 stale+undersized+peered, 224 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 234 B/s wr, 0 op/s; 397/1107 objects degraded (35.863%); 113 B/s, 1 objects/s recovering 2020-06-27T04:58:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:54 smithi031 bash[22603]: cluster 2020-06-27T04:58:53.867992+0000 mgr.x (mgr.34109) 575 : cluster [DBG] pgmap v658: 777 pgs: 1 creating+peering, 19 peering, 51 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 170 active+undersized, 18 stale+peering, 55 undersized+degraded+peered, 17 active+clean, 19 stale+undersized+peered, 224 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 234 B/s wr, 0 op/s; 397/1107 objects degraded (35.863%); 113 B/s, 1 objects/s recovering 2020-06-27T04:58:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:55 smithi031 bash[18426]: debug 2020-06-27T04:58:55.923+0000 7f8751183700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2020-06-27T04:58:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:55 smithi031 bash[18426]: cluster 2020-06-27T04:58:55.923609+0000 mon.a (mon.0) 1393 : cluster [WRN] Health check failed: 2/370 objects unfound (0.541%) (OBJECT_UNFOUND) 2020-06-27T04:58:56.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:55 smithi031 bash[18426]: cluster 2020-06-27T04:58:55.923647+0000 mon.a (mon.0) 1394 : cluster [ERR] Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2020-06-27T04:58:56.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:55 smithi031 bash[22603]: cluster 2020-06-27T04:58:55.923609+0000 mon.a (mon.0) 1393 : cluster [WRN] Health check failed: 2/370 objects unfound (0.541%) (OBJECT_UNFOUND) 2020-06-27T04:58:56.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:55 smithi031 bash[22603]: cluster 2020-06-27T04:58:55.923647+0000 mon.a (mon.0) 1394 : cluster [ERR] Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2020-06-27T04:58:56.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:55 smithi051 bash[18409]: cluster 2020-06-27T04:58:55.923609+0000 mon.a (mon.0) 1393 : cluster [WRN] Health check failed: 2/370 objects unfound (0.541%) (OBJECT_UNFOUND) 2020-06-27T04:58:56.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:55 smithi051 bash[18409]: cluster 2020-06-27T04:58:55.923647+0000 mon.a (mon.0) 1394 : cluster [ERR] Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2020-06-27T04:58:57.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:56 smithi051 bash[18409]: cluster 2020-06-27T04:58:55.870484+0000 mgr.x (mgr.34109) 576 : cluster [DBG] pgmap v659: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 511 B/s rd, 341 B/s wr, 0 op/s; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%); 167 B/s, 1 objects/s recovering 2020-06-27T04:58:57.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:56 smithi031 bash[18426]: cluster 2020-06-27T04:58:55.870484+0000 mgr.x (mgr.34109) 576 : cluster [DBG] pgmap v659: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 511 B/s rd, 341 B/s wr, 0 op/s; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%); 167 B/s, 1 objects/s recovering 2020-06-27T04:58:57.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:56 smithi031 bash[22603]: cluster 2020-06-27T04:58:55.870484+0000 mgr.x (mgr.34109) 576 : cluster [DBG] pgmap v659: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 511 B/s rd, 341 B/s wr, 0 op/s; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%); 167 B/s, 1 objects/s recovering 2020-06-27T04:58:58.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:57 smithi051 bash[18409]: cluster 2020-06-27T04:58:57.872678+0000 mgr.x (mgr.34109) 577 : cluster [DBG] pgmap v660: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 417 B/s rd, 278 B/s wr, 0 op/s; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%); 136 B/s, 1 objects/s recovering 2020-06-27T04:58:58.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:57 smithi031 bash[18426]: cluster 2020-06-27T04:58:57.872678+0000 mgr.x (mgr.34109) 577 : cluster [DBG] pgmap v660: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 417 B/s rd, 278 B/s wr, 0 op/s; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%); 136 B/s, 1 objects/s recovering 2020-06-27T04:58:58.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:57 smithi031 bash[22603]: cluster 2020-06-27T04:58:57.872678+0000 mgr.x (mgr.34109) 577 : cluster [DBG] pgmap v660: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 417 B/s rd, 278 B/s wr, 0 op/s; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%); 136 B/s, 1 objects/s recovering 2020-06-27T04:58:59.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:59 smithi051 bash[18409]: cluster 2020-06-27T04:58:59.502098+0000 mon.a (mon.0) 1395 : cluster [WRN] Health check update: Reduced data availability: 500 pgs inactive, 181 pgs down, 18 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:58:59.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:58:59 smithi051 bash[18409]: cluster 2020-06-27T04:58:59.502196+0000 mon.a (mon.0) 1396 : cluster [WRN] Health check update: Degraded data redundancy: 400/1110 objects degraded (36.036%), 111 pgs degraded, 485 pgs undersized (PG_DEGRADED) 2020-06-27T04:58:59.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:59 smithi031 bash[18426]: cluster 2020-06-27T04:58:59.502098+0000 mon.a (mon.0) 1395 : cluster [WRN] Health check update: Reduced data availability: 500 pgs inactive, 181 pgs down, 18 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:58:59.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:58:59 smithi031 bash[18426]: cluster 2020-06-27T04:58:59.502196+0000 mon.a (mon.0) 1396 : cluster [WRN] Health check update: Degraded data redundancy: 400/1110 objects degraded (36.036%), 111 pgs degraded, 485 pgs undersized (PG_DEGRADED) 2020-06-27T04:58:59.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:59 smithi031 bash[22603]: cluster 2020-06-27T04:58:59.502098+0000 mon.a (mon.0) 1395 : cluster [WRN] Health check update: Reduced data availability: 500 pgs inactive, 181 pgs down, 18 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:58:59.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:58:59 smithi031 bash[22603]: cluster 2020-06-27T04:58:59.502196+0000 mon.a (mon.0) 1396 : cluster [WRN] Health check update: Degraded data redundancy: 400/1110 objects degraded (36.036%), 111 pgs degraded, 485 pgs undersized (PG_DEGRADED) 2020-06-27T04:59:00.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:00 smithi051 bash[18409]: cluster 2020-06-27T04:58:59.874820+0000 mgr.x (mgr.34109) 578 : cluster [DBG] pgmap v661: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 367 B/s rd, 245 B/s wr, 0 op/s; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%); 120 B/s, 1 objects/s recovering 2020-06-27T04:59:00.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:00 smithi031 bash[18426]: cluster 2020-06-27T04:58:59.874820+0000 mgr.x (mgr.34109) 578 : cluster [DBG] pgmap v661: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 367 B/s rd, 245 B/s wr, 0 op/s; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%); 120 B/s, 1 objects/s recovering 2020-06-27T04:59:00.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:00 smithi031 bash[22603]: cluster 2020-06-27T04:58:59.874820+0000 mgr.x (mgr.34109) 578 : cluster [DBG] pgmap v661: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 367 B/s rd, 245 B/s wr, 0 op/s; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%); 120 B/s, 1 objects/s recovering 2020-06-27T04:59:03.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:02 smithi051 bash[18409]: cluster 2020-06-27T04:59:01.877232+0000 mgr.x (mgr.34109) 579 : cluster [DBG] pgmap v662: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 306 B/s rd, 102 B/s wr, 0 op/s; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%); 50 B/s, 0 objects/s recovering 2020-06-27T04:59:03.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:02 smithi031 bash[18426]: cluster 2020-06-27T04:59:01.877232+0000 mgr.x (mgr.34109) 579 : cluster [DBG] pgmap v662: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 306 B/s rd, 102 B/s wr, 0 op/s; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%); 50 B/s, 0 objects/s recovering 2020-06-27T04:59:03.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:02 smithi031 bash[22603]: cluster 2020-06-27T04:59:01.877232+0000 mgr.x (mgr.34109) 579 : cluster [DBG] pgmap v662: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 306 B/s rd, 102 B/s wr, 0 op/s; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%); 50 B/s, 0 objects/s recovering 2020-06-27T04:59:05.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:04 smithi051 bash[18409]: cluster 2020-06-27T04:59:03.878799+0000 mgr.x (mgr.34109) 580 : cluster [DBG] pgmap v663: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 271 B/s rd, 90 B/s wr, 0 op/s; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%); 44 B/s, 0 objects/s recovering 2020-06-27T04:59:05.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:04 smithi031 bash[18426]: cluster 2020-06-27T04:59:03.878799+0000 mgr.x (mgr.34109) 580 : cluster [DBG] pgmap v663: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 271 B/s rd, 90 B/s wr, 0 op/s; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%); 44 B/s, 0 objects/s recovering 2020-06-27T04:59:05.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:04 smithi031 bash[22603]: cluster 2020-06-27T04:59:03.878799+0000 mgr.x (mgr.34109) 580 : cluster [DBG] pgmap v663: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 271 B/s rd, 90 B/s wr, 0 op/s; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%); 44 B/s, 0 objects/s recovering 2020-06-27T04:59:07.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:06 smithi051 bash[18409]: cluster 2020-06-27T04:59:05.881446+0000 mgr.x (mgr.34109) 581 : cluster [DBG] pgmap v664: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 255 B/s rd, 85 B/s wr, 0 op/s; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%); 42 B/s, 0 objects/s recovering 2020-06-27T04:59:07.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:06 smithi031 bash[18426]: cluster 2020-06-27T04:59:05.881446+0000 mgr.x (mgr.34109) 581 : cluster [DBG] pgmap v664: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 255 B/s rd, 85 B/s wr, 0 op/s; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%); 42 B/s, 0 objects/s recovering 2020-06-27T04:59:07.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:06 smithi031 bash[22603]: cluster 2020-06-27T04:59:05.881446+0000 mgr.x (mgr.34109) 581 : cluster [DBG] pgmap v664: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 255 B/s rd, 85 B/s wr, 0 op/s; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%); 42 B/s, 0 objects/s recovering 2020-06-27T04:59:09.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:08 smithi051 bash[18409]: cluster 2020-06-27T04:59:07.883675+0000 mgr.x (mgr.34109) 582 : cluster [DBG] pgmap v665: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%) 2020-06-27T04:59:09.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:08 smithi031 bash[18426]: cluster 2020-06-27T04:59:07.883675+0000 mgr.x (mgr.34109) 582 : cluster [DBG] pgmap v665: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%) 2020-06-27T04:59:09.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:08 smithi031 bash[22603]: cluster 2020-06-27T04:59:07.883675+0000 mgr.x (mgr.34109) 582 : cluster [DBG] pgmap v665: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 23 MiB used, 619 GiB / 626 GiB avail; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%) 2020-06-27T04:59:10.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:09 smithi051 bash[18409]: cluster 2020-06-27T04:59:09.504565+0000 mon.a (mon.0) 1397 : cluster [INF] Marking osd.1 out (has been down for 602 seconds) 2020-06-27T04:59:10.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:09 smithi051 bash[18409]: cluster 2020-06-27T04:59:09.505138+0000 mon.a (mon.0) 1398 : cluster [WRN] Health check update: 3 osds down (OSD_DOWN) 2020-06-27T04:59:10.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:09 smithi051 bash[18409]: cluster 2020-06-27T04:59:09.510820+0000 mon.a (mon.0) 1399 : cluster [DBG] osdmap e173: 8 total, 3 up, 6 in 2020-06-27T04:59:10.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:09 smithi031 bash[18426]: cluster 2020-06-27T04:59:09.504565+0000 mon.a (mon.0) 1397 : cluster [INF] Marking osd.1 out (has been down for 602 seconds) 2020-06-27T04:59:10.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:09 smithi031 bash[18426]: cluster 2020-06-27T04:59:09.505138+0000 mon.a (mon.0) 1398 : cluster [WRN] Health check update: 3 osds down (OSD_DOWN) 2020-06-27T04:59:10.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:09 smithi031 bash[18426]: cluster 2020-06-27T04:59:09.510820+0000 mon.a (mon.0) 1399 : cluster [DBG] osdmap e173: 8 total, 3 up, 6 in 2020-06-27T04:59:10.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:09 smithi031 bash[22603]: cluster 2020-06-27T04:59:09.504565+0000 mon.a (mon.0) 1397 : cluster [INF] Marking osd.1 out (has been down for 602 seconds) 2020-06-27T04:59:10.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:09 smithi031 bash[22603]: cluster 2020-06-27T04:59:09.505138+0000 mon.a (mon.0) 1398 : cluster [WRN] Health check update: 3 osds down (OSD_DOWN) 2020-06-27T04:59:10.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:09 smithi031 bash[22603]: cluster 2020-06-27T04:59:09.510820+0000 mon.a (mon.0) 1399 : cluster [DBG] osdmap e173: 8 total, 3 up, 6 in 2020-06-27T04:59:10.966 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:10.966 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: in thread 7f3c3500c700 thread_name:tp_osd_tp 2020-06-27T04:59:10.966 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:10.966 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 1: (()+0x12dd0) [0x7f3c59610dd0] 2020-06-27T04:59:10.967 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55b3418a5707] 2020-06-27T04:59:10.967 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55b3418a5aa0] 2020-06-27T04:59:10.967 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55b3418d767a] 2020-06-27T04:59:10.967 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55b3418d8a57] 2020-06-27T04:59:10.967 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55b341563938] 2020-06-27T04:59:10.968 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55b34171403d] 2020-06-27T04:59:10.968 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55b3414d15b0] 2020-06-27T04:59:10.968 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55b34152a89d] 2020-06-27T04:59:10.968 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55b341533380] 2020-06-27T04:59:10.968 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55b34153a590] 2020-06-27T04:59:10.969 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55b3413ba4e9] 2020-06-27T04:59:10.969 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55b34161ef78] 2020-06-27T04:59:10.969 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55b3413d970f] 2020-06-27T04:59:10.969 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55b341a17b94] 2020-06-27T04:59:10.969 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55b341a1a7f4] 2020-06-27T04:59:10.970 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 17: (()+0x82de) [0x7f3c596062de] 2020-06-27T04:59:10.970 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 18: (clone()+0x43) [0x7f3c5833de83] 2020-06-27T04:59:10.970 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: debug 2020-06-27T04:59:10.570+0000 7f3c3500c700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:10.970 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: in thread 7f3c3500c700 thread_name:tp_osd_tp 2020-06-27T04:59:10.970 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:10.971 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 1: (()+0x12dd0) [0x7f3c59610dd0] 2020-06-27T04:59:10.971 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55b3418a5707] 2020-06-27T04:59:10.971 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55b3418a5aa0] 2020-06-27T04:59:10.971 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55b3418d767a] 2020-06-27T04:59:10.971 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55b3418d8a57] 2020-06-27T04:59:10.971 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55b341563938] 2020-06-27T04:59:10.972 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55b34171403d] 2020-06-27T04:59:10.972 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55b3414d15b0] 2020-06-27T04:59:10.972 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55b34152a89d] 2020-06-27T04:59:10.972 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55b341533380] 2020-06-27T04:59:10.972 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55b34153a590] 2020-06-27T04:59:10.973 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55b3413ba4e9] 2020-06-27T04:59:10.973 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55b34161ef78] 2020-06-27T04:59:10.973 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55b3413d970f] 2020-06-27T04:59:10.973 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55b341a17b94] 2020-06-27T04:59:10.973 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55b341a1a7f4] 2020-06-27T04:59:10.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 17: (()+0x82de) [0x7f3c596062de] 2020-06-27T04:59:10.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 18: (clone()+0x43) [0x7f3c5833de83] 2020-06-27T04:59:10.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:59:10.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: debug 0> 2020-06-27T04:59:10.570+0000 7f3c3500c700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:10.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: in thread 7f3c3500c700 thread_name:tp_osd_tp 2020-06-27T04:59:10.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:10.975 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 1: (()+0x12dd0) [0x7f3c59610dd0] 2020-06-27T04:59:10.975 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55b3418a5707] 2020-06-27T04:59:10.975 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55b3418a5aa0] 2020-06-27T04:59:10.975 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55b3418d767a] 2020-06-27T04:59:10.975 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55b3418d8a57] 2020-06-27T04:59:10.976 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55b341563938] 2020-06-27T04:59:10.976 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55b34171403d] 2020-06-27T04:59:10.976 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55b3414d15b0] 2020-06-27T04:59:10.976 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55b34152a89d] 2020-06-27T04:59:10.976 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55b341533380] 2020-06-27T04:59:10.977 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55b34153a590] 2020-06-27T04:59:10.977 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55b3413ba4e9] 2020-06-27T04:59:10.977 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55b34161ef78] 2020-06-27T04:59:10.977 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55b3413d970f] 2020-06-27T04:59:10.977 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55b341a17b94] 2020-06-27T04:59:10.978 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55b341a1a7f4] 2020-06-27T04:59:10.978 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 17: (()+0x82de) [0x7f3c596062de] 2020-06-27T04:59:10.978 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 18: (clone()+0x43) [0x7f3c5833de83] 2020-06-27T04:59:10.978 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:59:10.978 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: debug -9999> 2020-06-27T04:59:10.570+0000 7f3c3500c700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:10.978 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: in thread 7f3c3500c700 thread_name:tp_osd_tp 2020-06-27T04:59:10.979 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:10.979 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 1: (()+0x12dd0) [0x7f3c59610dd0] 2020-06-27T04:59:10.979 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55b3418a5707] 2020-06-27T04:59:10.979 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55b3418a5aa0] 2020-06-27T04:59:10.979 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55b3418d767a] 2020-06-27T04:59:10.980 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55b3418d8a57] 2020-06-27T04:59:10.980 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55b341563938] 2020-06-27T04:59:10.980 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55b34171403d] 2020-06-27T04:59:10.980 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55b3414d15b0] 2020-06-27T04:59:10.980 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55b34152a89d] 2020-06-27T04:59:10.980 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55b341533380] 2020-06-27T04:59:10.981 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55b34153a590] 2020-06-27T04:59:10.981 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55b3413ba4e9] 2020-06-27T04:59:10.981 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55b34161ef78] 2020-06-27T04:59:10.981 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55b3413d970f] 2020-06-27T04:59:10.981 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55b341a17b94] 2020-06-27T04:59:10.982 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55b341a1a7f4] 2020-06-27T04:59:10.982 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 17: (()+0x82de) [0x7f3c596062de] 2020-06-27T04:59:10.982 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: 18: (clone()+0x43) [0x7f3c5833de83] 2020-06-27T04:59:10.982 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:59:10.982 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[115321]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:59:10.982 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:10 smithi031 podman[115439]: 2020-06-27 04:59:10.694569174 +0000 UTC m=+587.270562016 container died 72fb1b0d97ca09f616601ce7f18b223887543b988ce179d2c4036bbef7820c7c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:59:11.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:10 smithi051 bash[18409]: cluster 2020-06-27T04:59:09.885224+0000 mgr.x (mgr.34109) 583 : cluster [DBG] pgmap v667: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 20 MiB used, 530 GiB / 536 GiB avail; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%) 2020-06-27T04:59:11.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:10 smithi051 bash[18409]: cluster 2020-06-27T04:59:10.513059+0000 mon.a (mon.0) 1400 : cluster [DBG] osdmap e174: 8 total, 3 up, 6 in 2020-06-27T04:59:11.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:10 smithi051 bash[18409]: cluster 2020-06-27T04:59:10.664825+0000 mon.a (mon.0) 1401 : cluster [DBG] osd.2 reported immediately failed by osd.7 2020-06-27T04:59:11.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:10 smithi051 bash[18409]: cluster 2020-06-27T04:59:10.664872+0000 mon.a (mon.0) 1402 : cluster [INF] osd.2 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:59:11.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[18426]: cluster 2020-06-27T04:59:09.885224+0000 mgr.x (mgr.34109) 583 : cluster [DBG] pgmap v667: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 20 MiB used, 530 GiB / 536 GiB avail; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%) 2020-06-27T04:59:11.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[18426]: cluster 2020-06-27T04:59:10.513059+0000 mon.a (mon.0) 1400 : cluster [DBG] osdmap e174: 8 total, 3 up, 6 in 2020-06-27T04:59:11.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[18426]: cluster 2020-06-27T04:59:10.664825+0000 mon.a (mon.0) 1401 : cluster [DBG] osd.2 reported immediately failed by osd.7 2020-06-27T04:59:11.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[18426]: cluster 2020-06-27T04:59:10.664872+0000 mon.a (mon.0) 1402 : cluster [INF] osd.2 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:59:11.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[22603]: cluster 2020-06-27T04:59:09.885224+0000 mgr.x (mgr.34109) 583 : cluster [DBG] pgmap v667: 777 pgs: 1 active+recovery_unfound+undersized+degraded, 56 active+undersized+degraded, 4 creating+down, 3 stale+undersized+degraded+peered, 4 stale+creating+down, 85 down, 88 stale+down, 19 unknown, 196 active+undersized, 18 stale+peering, 51 undersized+degraded+peered, 24 active+clean, 19 stale+undersized+peered, 209 undersized+peered; 26 KiB data, 20 MiB used, 530 GiB / 536 GiB avail; 400/1110 objects degraded (36.036%); 2/370 objects unfound (0.541%) 2020-06-27T04:59:11.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[22603]: cluster 2020-06-27T04:59:10.513059+0000 mon.a (mon.0) 1400 : cluster [DBG] osdmap e174: 8 total, 3 up, 6 in 2020-06-27T04:59:11.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[22603]: cluster 2020-06-27T04:59:10.664825+0000 mon.a (mon.0) 1401 : cluster [DBG] osd.2 reported immediately failed by osd.7 2020-06-27T04:59:11.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:10 smithi031 bash[22603]: cluster 2020-06-27T04:59:10.664872+0000 mon.a (mon.0) 1402 : cluster [INF] osd.2 failed (root=default,host=smithi031) (connection refused reported by osd.7) 2020-06-27T04:59:11.968 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:11.969 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: in thread 7f2e28db6700 thread_name:tp_osd_tp 2020-06-27T04:59:11.969 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:11.969 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 1: (()+0x12dd0) [0x7f2e4f3bedd0] 2020-06-27T04:59:11.969 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55d0be508707] 2020-06-27T04:59:11.970 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 3: (BlueStore::_do_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr)+0xce) [0x55d0be508fce] 2020-06-27T04:59:11.970 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 4: (BlueStore::_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&)+0x64) [0x55d0be50a9b4] 2020-06-27T04:59:11.970 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 5: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a1b) [0x55d0be53a64b] 2020-06-27T04:59:11.970 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 6: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55d0be53ba57] 2020-06-27T04:59:11.970 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 7: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55d0be1c6938] 2020-06-27T04:59:11.971 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 8: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55d0be37703d] 2020-06-27T04:59:11.971 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 9: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55d0be1345b0] 2020-06-27T04:59:11.971 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 10: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55d0be18d89d] 2020-06-27T04:59:11.971 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 11: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55d0be196380] 2020-06-27T04:59:11.971 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 12: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55d0be19d590] 2020-06-27T04:59:11.972 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 13: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55d0be01d4e9] 2020-06-27T04:59:11.972 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 14: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55d0be281f78] 2020-06-27T04:59:11.972 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 15: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55d0be03c70f] 2020-06-27T04:59:11.972 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 16: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55d0be67ab94] 2020-06-27T04:59:11.972 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 17: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55d0be67d7f4] 2020-06-27T04:59:11.973 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 18: (()+0x82de) [0x7f2e4f3b42de] 2020-06-27T04:59:11.973 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 19: (clone()+0x43) [0x7f2e4e0ebe83] 2020-06-27T04:59:11.973 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: debug 2020-06-27T04:59:11.593+0000 7f2e28db6700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:11.973 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: in thread 7f2e28db6700 thread_name:tp_osd_tp 2020-06-27T04:59:11.973 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:11.974 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 1: (()+0x12dd0) [0x7f2e4f3bedd0] 2020-06-27T04:59:11.974 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55d0be508707] 2020-06-27T04:59:11.974 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 3: (BlueStore::_do_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr)+0xce) [0x55d0be508fce] 2020-06-27T04:59:11.974 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 4: (BlueStore::_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&)+0x64) [0x55d0be50a9b4] 2020-06-27T04:59:11.974 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 5: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a1b) [0x55d0be53a64b] 2020-06-27T04:59:11.974 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 6: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55d0be53ba57] 2020-06-27T04:59:11.975 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 7: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55d0be1c6938] 2020-06-27T04:59:11.975 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 8: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55d0be37703d] 2020-06-27T04:59:11.975 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 9: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55d0be1345b0] 2020-06-27T04:59:11.975 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 10: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55d0be18d89d] 2020-06-27T04:59:11.975 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 11: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55d0be196380] 2020-06-27T04:59:11.976 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 12: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55d0be19d590] 2020-06-27T04:59:11.976 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 13: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55d0be01d4e9] 2020-06-27T04:59:11.976 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 14: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55d0be281f78] 2020-06-27T04:59:11.976 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 15: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55d0be03c70f] 2020-06-27T04:59:11.976 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 16: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55d0be67ab94] 2020-06-27T04:59:11.977 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 17: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55d0be67d7f4] 2020-06-27T04:59:11.977 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 18: (()+0x82de) [0x7f2e4f3b42de] 2020-06-27T04:59:11.977 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 19: (clone()+0x43) [0x7f2e4e0ebe83] 2020-06-27T04:59:11.977 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:59:11.977 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: debug -9999> 2020-06-27T04:59:11.593+0000 7f2e28db6700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:11.977 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: in thread 7f2e28db6700 thread_name:tp_osd_tp 2020-06-27T04:59:11.978 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:11.978 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 1: (()+0x12dd0) [0x7f2e4f3bedd0] 2020-06-27T04:59:11.978 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55d0be508707] 2020-06-27T04:59:11.978 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 3: (BlueStore::_do_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr)+0xce) [0x55d0be508fce] 2020-06-27T04:59:11.978 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 4: (BlueStore::_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&)+0x64) [0x55d0be50a9b4] 2020-06-27T04:59:11.979 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 5: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a1b) [0x55d0be53a64b] 2020-06-27T04:59:11.979 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 6: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55d0be53ba57] 2020-06-27T04:59:11.979 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 7: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55d0be1c6938] 2020-06-27T04:59:11.979 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 8: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55d0be37703d] 2020-06-27T04:59:11.979 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 9: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55d0be1345b0] 2020-06-27T04:59:11.980 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 10: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55d0be18d89d] 2020-06-27T04:59:11.980 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 11: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55d0be196380] 2020-06-27T04:59:11.980 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 12: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55d0be19d590] 2020-06-27T04:59:11.980 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 13: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55d0be01d4e9] 2020-06-27T04:59:11.980 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 14: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55d0be281f78] 2020-06-27T04:59:11.981 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 15: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55d0be03c70f] 2020-06-27T04:59:11.981 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 16: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55d0be67ab94] 2020-06-27T04:59:11.981 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 17: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55d0be67d7f4] 2020-06-27T04:59:11.981 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 18: (()+0x82de) [0x7f2e4f3b42de] 2020-06-27T04:59:11.981 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 19: (clone()+0x43) [0x7f2e4e0ebe83] 2020-06-27T04:59:11.982 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:59:11.982 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: debug -9999> 2020-06-27T04:59:11.593+0000 7f2e28db6700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:11.982 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: in thread 7f2e28db6700 thread_name:tp_osd_tp 2020-06-27T04:59:11.982 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:11.982 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 1: (()+0x12dd0) [0x7f2e4f3bedd0] 2020-06-27T04:59:11.982 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55d0be508707] 2020-06-27T04:59:11.983 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 3: (BlueStore::_do_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr)+0xce) [0x55d0be508fce] 2020-06-27T04:59:11.983 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 4: (BlueStore::_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&)+0x64) [0x55d0be50a9b4] 2020-06-27T04:59:11.983 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 5: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a1b) [0x55d0be53a64b] 2020-06-27T04:59:11.983 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 6: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55d0be53ba57] 2020-06-27T04:59:11.983 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 7: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55d0be1c6938] 2020-06-27T04:59:11.984 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 8: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55d0be37703d] 2020-06-27T04:59:11.984 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 9: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55d0be1345b0] 2020-06-27T04:59:11.984 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 10: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55d0be18d89d] 2020-06-27T04:59:11.984 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 11: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55d0be196380] 2020-06-27T04:59:11.984 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 12: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55d0be19d590] 2020-06-27T04:59:11.985 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 13: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55d0be01d4e9] 2020-06-27T04:59:11.985 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 14: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55d0be281f78] 2020-06-27T04:59:11.985 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 15: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55d0be03c70f] 2020-06-27T04:59:11.985 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 16: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55d0be67ab94] 2020-06-27T04:59:11.985 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 17: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55d0be67d7f4] 2020-06-27T04:59:11.985 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 18: (()+0x82de) [0x7f2e4f3b42de] 2020-06-27T04:59:11.986 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: 19: (clone()+0x43) [0x7f2e4e0ebe83] 2020-06-27T04:59:11.986 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:59:11.986 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 bash[44570]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:59:11.986 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:11 smithi051 podman[44682]: 2020-06-27 04:59:11.667686093 +0000 UTC m=+591.635793408 container died 89d97a048d295bf9286c5549eda1d7d68d8285904d3d771a64e20e018558af1f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:59:11.987 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:11 smithi031 podman[115439]: 2020-06-27 04:59:11.486612282 +0000 UTC m=+588.062605138 container remove 72fb1b0d97ca09f616601ce7f18b223887543b988ce179d2c4036bbef7820c7c (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2) 2020-06-27T04:59:11.988 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:11 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:59:11.988 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:11.988 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: in thread 7f40186e3700 thread_name:tp_osd_tp 2020-06-27T04:59:11.988 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:11.988 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 1: (()+0x12dd0) [0x7f403ace3dd0] 2020-06-27T04:59:11.989 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55cfa60ed707] 2020-06-27T04:59:11.989 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 3: (BlueStore::_do_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr)+0xce) [0x55cfa60edfce] 2020-06-27T04:59:11.989 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 4: (BlueStore::_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&)+0x64) [0x55cfa60ef9b4] 2020-06-27T04:59:11.989 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 5: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a1b) [0x55cfa611f64b] 2020-06-27T04:59:11.989 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 6: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55cfa6120a57] 2020-06-27T04:59:11.990 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 7: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55cfa5dab938] 2020-06-27T04:59:11.990 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 8: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55cfa5f5fa70] 2020-06-27T04:59:11.990 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 9: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55cfa5f6fdd7] 2020-06-27T04:59:11.990 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 10: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55cfa5dde252] 2020-06-27T04:59:11.990 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55cfa5d81e2e] 2020-06-27T04:59:11.991 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55cfa5c024e9] 2020-06-27T04:59:11.991 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55cfa5e66f78] 2020-06-27T04:59:11.991 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55cfa5c2170f] 2020-06-27T04:59:11.991 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55cfa625fb94] 2020-06-27T04:59:11.992 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55cfa62627f4] 2020-06-27T04:59:11.992 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 17: (()+0x82de) [0x7f403acd92de] 2020-06-27T04:59:11.992 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 18: (clone()+0x43) [0x7f4039a10e83] 2020-06-27T04:59:11.992 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: debug 2020-06-27T04:59:11.595+0000 7f40186e3700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:11.993 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: in thread 7f40186e3700 thread_name:tp_osd_tp 2020-06-27T04:59:11.993 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:11.993 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 1: (()+0x12dd0) [0x7f403ace3dd0] 2020-06-27T04:59:11.993 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55cfa60ed707] 2020-06-27T04:59:11.993 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 3: (BlueStore::_do_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr)+0xce) [0x55cfa60edfce] 2020-06-27T04:59:11.994 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 4: (BlueStore::_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&)+0x64) [0x55cfa60ef9b4] 2020-06-27T04:59:11.994 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 5: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a1b) [0x55cfa611f64b] 2020-06-27T04:59:11.994 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 6: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55cfa6120a57] 2020-06-27T04:59:11.994 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 7: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55cfa5dab938] 2020-06-27T04:59:11.994 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 8: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55cfa5f5fa70] 2020-06-27T04:59:11.995 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 9: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55cfa5f6fdd7] 2020-06-27T04:59:11.995 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 10: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55cfa5dde252] 2020-06-27T04:59:11.995 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55cfa5d81e2e] 2020-06-27T04:59:11.995 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55cfa5c024e9] 2020-06-27T04:59:11.995 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55cfa5e66f78] 2020-06-27T04:59:11.996 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55cfa5c2170f] 2020-06-27T04:59:11.996 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55cfa625fb94] 2020-06-27T04:59:11.996 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55cfa62627f4] 2020-06-27T04:59:11.996 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 17: (()+0x82de) [0x7f403acd92de] 2020-06-27T04:59:11.996 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 18: (clone()+0x43) [0x7f4039a10e83] 2020-06-27T04:59:11.997 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:59:11.997 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: debug -55> 2020-06-27T04:59:11.595+0000 7f40186e3700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:11.997 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: in thread 7f40186e3700 thread_name:tp_osd_tp 2020-06-27T04:59:11.997 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:11.997 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 1: (()+0x12dd0) [0x7f403ace3dd0] 2020-06-27T04:59:11.998 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55cfa60ed707] 2020-06-27T04:59:11.998 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 3: (BlueStore::_do_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr)+0xce) [0x55cfa60edfce] 2020-06-27T04:59:11.998 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 4: (BlueStore::_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&)+0x64) [0x55cfa60ef9b4] 2020-06-27T04:59:11.998 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 5: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a1b) [0x55cfa611f64b] 2020-06-27T04:59:11.998 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 6: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55cfa6120a57] 2020-06-27T04:59:11.999 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 7: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55cfa5dab938] 2020-06-27T04:59:12.000 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 8: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55cfa5f5fa70] 2020-06-27T04:59:12.000 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 9: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55cfa5f6fdd7] 2020-06-27T04:59:12.000 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 10: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55cfa5dde252] 2020-06-27T04:59:12.001 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55cfa5d81e2e] 2020-06-27T04:59:12.001 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55cfa5c024e9] 2020-06-27T04:59:12.001 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55cfa5e66f78] 2020-06-27T04:59:12.001 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55cfa5c2170f] 2020-06-27T04:59:12.001 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55cfa625fb94] 2020-06-27T04:59:12.002 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55cfa62627f4] 2020-06-27T04:59:12.002 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 17: (()+0x82de) [0x7f403acd92de] 2020-06-27T04:59:12.002 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 18: (clone()+0x43) [0x7f4039a10e83] 2020-06-27T04:59:12.002 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:59:12.003 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: debug -9999> 2020-06-27T04:59:11.595+0000 7f40186e3700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:12.003 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: in thread 7f40186e3700 thread_name:tp_osd_tp 2020-06-27T04:59:12.003 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:12.003 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 1: (()+0x12dd0) [0x7f403ace3dd0] 2020-06-27T04:59:12.003 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55cfa60ed707] 2020-06-27T04:59:12.003 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 3: (BlueStore::_do_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr)+0xce) [0x55cfa60edfce] 2020-06-27T04:59:12.004 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 4: (BlueStore::_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&)+0x64) [0x55cfa60ef9b4] 2020-06-27T04:59:12.004 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 5: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a1b) [0x55cfa611f64b] 2020-06-27T04:59:12.004 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 6: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55cfa6120a57] 2020-06-27T04:59:12.004 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 7: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55cfa5dab938] 2020-06-27T04:59:12.004 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 8: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x55cfa5f5fa70] 2020-06-27T04:59:12.005 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 9: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x55cfa5f6fdd7] 2020-06-27T04:59:12.005 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 10: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x55cfa5dde252] 2020-06-27T04:59:12.005 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x55cfa5d81e2e] 2020-06-27T04:59:12.005 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55cfa5c024e9] 2020-06-27T04:59:12.005 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55cfa5e66f78] 2020-06-27T04:59:12.006 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55cfa5c2170f] 2020-06-27T04:59:12.006 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55cfa625fb94] 2020-06-27T04:59:12.006 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55cfa62627f4] 2020-06-27T04:59:12.006 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 17: (()+0x82de) [0x7f403acd92de] 2020-06-27T04:59:12.006 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: 18: (clone()+0x43) [0x7f4039a10e83] 2020-06-27T04:59:12.006 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:59:12.007 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 bash[114654]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:59:12.007 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:11 smithi031 podman[114928]: 2020-06-27 04:59:11.687414725 +0000 UTC m=+599.070065390 container died 43c6d0503d9cd22868bd284fce9218e95910ec57f13e52618645b6829de0b9bc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:59:12.292 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:12 smithi031 podman[116298]: 2020-06-27 04:59:12.027573768 +0000 UTC m=+0.517543244 container create dc6a612945a184960348593fe1d57ea46636afe42ff3b2d32ffa0192d177a843 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:59:12.313 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:12 smithi051 podman[44682]: 2020-06-27 04:59:12.020211151 +0000 UTC m=+591.988318479 container remove 89d97a048d295bf9286c5549eda1d7d68d8285904d3d771a64e20e018558af1f (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:59:12.313 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:12 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:59:12.314 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:12 smithi051 podman[45616]: 2020-06-27 04:59:12.269193446 +0000 UTC m=+0.229375898 container create ffcf1dc0b39d36154c82821952062c9d8adef32d7bf6f57c6e2390b8dc432b72 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:59:12.640 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:12 smithi051 bash[18409]: cluster 2020-06-27T04:59:11.528781+0000 mon.a (mon.0) 1403 : cluster [DBG] osdmap e175: 8 total, 2 up, 6 in 2020-06-27T04:59:12.640 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:12 smithi051 bash[18409]: cluster 2020-06-27T04:59:11.887181+0000 mgr.x (mgr.34109) 584 : cluster [DBG] pgmap v670: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 20 MiB used, 530 GiB / 536 GiB avail; 681 B/s wr, 0 op/s; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:12.641 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:12 smithi051 podman[45616]: 2020-06-27 04:59:12.385802448 +0000 UTC m=+0.345984764 container init ffcf1dc0b39d36154c82821952062c9d8adef32d7bf6f57c6e2390b8dc432b72 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:59:12.641 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:12 smithi051 podman[45616]: 2020-06-27 04:59:12.452402265 +0000 UTC m=+0.412584587 container start ffcf1dc0b39d36154c82821952062c9d8adef32d7bf6f57c6e2390b8dc432b72 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:59:12.641 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:12 smithi051 podman[45616]: 2020-06-27 04:59:12.45248871 +0000 UTC m=+0.412671046 container attach ffcf1dc0b39d36154c82821952062c9d8adef32d7bf6f57c6e2390b8dc432b72 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:59:12.666 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:12 smithi031 bash[18426]: cluster 2020-06-27T04:59:11.528781+0000 mon.a (mon.0) 1403 : cluster [DBG] osdmap e175: 8 total, 2 up, 6 in 2020-06-27T04:59:12.666 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:12 smithi031 bash[18426]: cluster 2020-06-27T04:59:11.887181+0000 mgr.x (mgr.34109) 584 : cluster [DBG] pgmap v670: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 20 MiB used, 530 GiB / 536 GiB avail; 681 B/s wr, 0 op/s; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:12.666 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:12 smithi031 bash[22603]: cluster 2020-06-27T04:59:11.528781+0000 mon.a (mon.0) 1403 : cluster [DBG] osdmap e175: 8 total, 2 up, 6 in 2020-06-27T04:59:12.666 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:12 smithi031 bash[22603]: cluster 2020-06-27T04:59:11.887181+0000 mgr.x (mgr.34109) 584 : cluster [DBG] pgmap v670: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 20 MiB used, 530 GiB / 536 GiB avail; 681 B/s wr, 0 op/s; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:12.667 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:12 smithi031 podman[114928]: 2020-06-27 04:59:12.407856197 +0000 UTC m=+599.790506865 container remove 43c6d0503d9cd22868bd284fce9218e95910ec57f13e52618645b6829de0b9bc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:59:12.667 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:12 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:59:12.667 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:12 smithi031 podman[116298]: 2020-06-27 04:59:12.402037137 +0000 UTC m=+0.892006492 container init dc6a612945a184960348593fe1d57ea46636afe42ff3b2d32ffa0192d177a843 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:59:12.667 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:12 smithi031 podman[116298]: 2020-06-27 04:59:12.443628281 +0000 UTC m=+0.933597639 container start dc6a612945a184960348593fe1d57ea46636afe42ff3b2d32ffa0192d177a843 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:59:12.668 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:12 smithi031 podman[116298]: 2020-06-27 04:59:12.443704963 +0000 UTC m=+0.933674320 container attach dc6a612945a184960348593fe1d57ea46636afe42ff3b2d32ffa0192d177a843 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:59:12.968 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:12 smithi051 podman[45616]: 2020-06-27 04:59:12.654621665 +0000 UTC m=+0.614804007 container died ffcf1dc0b39d36154c82821952062c9d8adef32d7bf6f57c6e2390b8dc432b72 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:59:12.973 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:12 smithi031 podman[116298]: 2020-06-27 04:59:12.778559118 +0000 UTC m=+1.268528465 container died dc6a612945a184960348593fe1d57ea46636afe42ff3b2d32ffa0192d177a843 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:59:12.974 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:12 smithi031 podman[116370]: 2020-06-27 04:59:12.70187756 +0000 UTC m=+0.275382992 container create 5711cd7238e9c2c179f13851725bd2ac7c347411455dbc71ad497938d148e9fe (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:59:13.364 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:13 smithi031 podman[116298]: 2020-06-27 04:59:13.345734944 +0000 UTC m=+1.835704325 container remove dc6a612945a184960348593fe1d57ea46636afe42ff3b2d32ffa0192d177a843 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.2-deactivate) 2020-06-27T04:59:13.364 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:13 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Failed with result 'exit-code'. 2020-06-27T04:59:13.365 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:13 smithi031 podman[116370]: 2020-06-27 04:59:13.106903644 +0000 UTC m=+0.680409190 container init 5711cd7238e9c2c179f13851725bd2ac7c347411455dbc71ad497938d148e9fe (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:59:13.365 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:13 smithi031 podman[116370]: 2020-06-27 04:59:13.249575389 +0000 UTC m=+0.823080826 container start 5711cd7238e9c2c179f13851725bd2ac7c347411455dbc71ad497938d148e9fe (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:59:13.365 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:13 smithi031 podman[116370]: 2020-06-27 04:59:13.249657169 +0000 UTC m=+0.823162620 container attach 5711cd7238e9c2c179f13851725bd2ac7c347411455dbc71ad497938d148e9fe (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:59:13.468 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:13 smithi051 podman[45616]: 2020-06-27 04:59:13.063609358 +0000 UTC m=+1.023791678 container remove ffcf1dc0b39d36154c82821952062c9d8adef32d7bf6f57c6e2390b8dc432b72 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:59:13.468 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:13 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Failed with result 'exit-code'. 2020-06-27T04:59:13.723 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:13 smithi031 podman[116370]: 2020-06-27 04:59:13.361541588 +0000 UTC m=+0.935047032 container died 5711cd7238e9c2c179f13851725bd2ac7c347411455dbc71ad497938d148e9fe (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:59:13.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:13 smithi031 bash[18426]: cluster 2020-06-27T04:59:12.525518+0000 mon.a (mon.0) 1404 : cluster [WRN] Health check update: Reduced data availability: 516 pgs inactive, 193 pgs down, 65 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:59:13.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:13 smithi031 bash[18426]: cluster 2020-06-27T04:59:12.525546+0000 mon.a (mon.0) 1405 : cluster [WRN] Health check update: Degraded data redundancy: 287/1116 objects degraded (25.717%), 77 pgs degraded, 341 pgs undersized (PG_DEGRADED) 2020-06-27T04:59:13.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:13 smithi031 bash[18426]: cluster 2020-06-27T04:59:12.525564+0000 mon.a (mon.0) 1406 : cluster [INF] Health check cleared: OBJECT_UNFOUND (was: 2/370 objects unfound (0.541%)) 2020-06-27T04:59:13.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:13 smithi031 bash[18426]: cluster 2020-06-27T04:59:12.525576+0000 mon.a (mon.0) 1407 : cluster [INF] Health check cleared: PG_DAMAGED (was: Possible data damage: 1 pg recovery_unfound) 2020-06-27T04:59:13.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:13 smithi031 bash[18426]: cluster 2020-06-27T04:59:12.536318+0000 mon.a (mon.0) 1408 : cluster [DBG] osdmap e176: 8 total, 2 up, 6 in 2020-06-27T04:59:13.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:13 smithi031 bash[22603]: cluster 2020-06-27T04:59:12.525518+0000 mon.a (mon.0) 1404 : cluster [WRN] Health check update: Reduced data availability: 516 pgs inactive, 193 pgs down, 65 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:59:13.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:13 smithi031 bash[22603]: cluster 2020-06-27T04:59:12.525546+0000 mon.a (mon.0) 1405 : cluster [WRN] Health check update: Degraded data redundancy: 287/1116 objects degraded (25.717%), 77 pgs degraded, 341 pgs undersized (PG_DEGRADED) 2020-06-27T04:59:13.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:13 smithi031 bash[22603]: cluster 2020-06-27T04:59:12.525564+0000 mon.a (mon.0) 1406 : cluster [INF] Health check cleared: OBJECT_UNFOUND (was: 2/370 objects unfound (0.541%)) 2020-06-27T04:59:13.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:13 smithi031 bash[22603]: cluster 2020-06-27T04:59:12.525576+0000 mon.a (mon.0) 1407 : cluster [INF] Health check cleared: PG_DAMAGED (was: Possible data damage: 1 pg recovery_unfound) 2020-06-27T04:59:13.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:13 smithi031 bash[22603]: cluster 2020-06-27T04:59:12.536318+0000 mon.a (mon.0) 1408 : cluster [DBG] osdmap e176: 8 total, 2 up, 6 in 2020-06-27T04:59:13.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:13 smithi051 bash[18409]: cluster 2020-06-27T04:59:12.525518+0000 mon.a (mon.0) 1404 : cluster [WRN] Health check update: Reduced data availability: 516 pgs inactive, 193 pgs down, 65 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:59:13.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:13 smithi051 bash[18409]: cluster 2020-06-27T04:59:12.525546+0000 mon.a (mon.0) 1405 : cluster [WRN] Health check update: Degraded data redundancy: 287/1116 objects degraded (25.717%), 77 pgs degraded, 341 pgs undersized (PG_DEGRADED) 2020-06-27T04:59:13.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:13 smithi051 bash[18409]: cluster 2020-06-27T04:59:12.525564+0000 mon.a (mon.0) 1406 : cluster [INF] Health check cleared: OBJECT_UNFOUND (was: 2/370 objects unfound (0.541%)) 2020-06-27T04:59:13.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:13 smithi051 bash[18409]: cluster 2020-06-27T04:59:12.525576+0000 mon.a (mon.0) 1407 : cluster [INF] Health check cleared: PG_DAMAGED (was: Possible data damage: 1 pg recovery_unfound) 2020-06-27T04:59:13.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:13 smithi051 bash[18409]: cluster 2020-06-27T04:59:12.536318+0000 mon.a (mon.0) 1408 : cluster [DBG] osdmap e176: 8 total, 2 up, 6 in 2020-06-27T04:59:14.223 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:13 smithi031 podman[116370]: 2020-06-27 04:59:13.747465919 +0000 UTC m=+1.320971361 container remove 5711cd7238e9c2c179f13851725bd2ac7c347411455dbc71ad497938d148e9fe (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:59:14.223 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:13 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2020-06-27T04:59:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:14 smithi051 bash[18409]: cluster 2020-06-27T04:59:13.888975+0000 mgr.x (mgr.34109) 585 : cluster [DBG] pgmap v672: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 20 MiB used, 530 GiB / 536 GiB avail; 935 B/s wr, 0 op/s; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:14 smithi051 bash[18409]: cluster 2020-06-27T04:59:14.505848+0000 mon.a (mon.0) 1409 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:59:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:14 smithi051 bash[18409]: cluster 2020-06-27T04:59:14.506110+0000 mon.a (mon.0) 1410 : cluster [INF] Marking osd.3 out (has been down for 603 seconds) 2020-06-27T04:59:14.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:14 smithi051 bash[18409]: cluster 2020-06-27T04:59:14.510759+0000 mon.a (mon.0) 1411 : cluster [DBG] osdmap e177: 8 total, 2 up, 5 in 2020-06-27T04:59:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:14 smithi031 bash[18426]: cluster 2020-06-27T04:59:13.888975+0000 mgr.x (mgr.34109) 585 : cluster [DBG] pgmap v672: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 20 MiB used, 530 GiB / 536 GiB avail; 935 B/s wr, 0 op/s; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:14 smithi031 bash[18426]: cluster 2020-06-27T04:59:14.505848+0000 mon.a (mon.0) 1409 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:59:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:14 smithi031 bash[18426]: cluster 2020-06-27T04:59:14.506110+0000 mon.a (mon.0) 1410 : cluster [INF] Marking osd.3 out (has been down for 603 seconds) 2020-06-27T04:59:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:14 smithi031 bash[18426]: cluster 2020-06-27T04:59:14.510759+0000 mon.a (mon.0) 1411 : cluster [DBG] osdmap e177: 8 total, 2 up, 5 in 2020-06-27T04:59:14.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:14 smithi031 bash[22603]: cluster 2020-06-27T04:59:13.888975+0000 mgr.x (mgr.34109) 585 : cluster [DBG] pgmap v672: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 20 MiB used, 530 GiB / 536 GiB avail; 935 B/s wr, 0 op/s; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:14.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:14 smithi031 bash[22603]: cluster 2020-06-27T04:59:14.505848+0000 mon.a (mon.0) 1409 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:59:14.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:14 smithi031 bash[22603]: cluster 2020-06-27T04:59:14.506110+0000 mon.a (mon.0) 1410 : cluster [INF] Marking osd.3 out (has been down for 603 seconds) 2020-06-27T04:59:14.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:14 smithi031 bash[22603]: cluster 2020-06-27T04:59:14.510759+0000 mon.a (mon.0) 1411 : cluster [DBG] osdmap e177: 8 total, 2 up, 5 in 2020-06-27T04:59:17.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:16 smithi051 bash[18409]: cluster 2020-06-27T04:59:15.890513+0000 mgr.x (mgr.34109) 586 : cluster [DBG] pgmap v674: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 17 MiB used, 442 GiB / 447 GiB avail; 761 B/s wr, 0 op/s; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:17.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:16 smithi031 bash[18426]: cluster 2020-06-27T04:59:15.890513+0000 mgr.x (mgr.34109) 586 : cluster [DBG] pgmap v674: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 17 MiB used, 442 GiB / 447 GiB avail; 761 B/s wr, 0 op/s; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:17.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:16 smithi031 bash[22603]: cluster 2020-06-27T04:59:15.890513+0000 mgr.x (mgr.34109) 586 : cluster [DBG] pgmap v674: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 17 MiB used, 442 GiB / 447 GiB avail; 761 B/s wr, 0 op/s; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:19.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:18 smithi051 bash[18409]: cluster 2020-06-27T04:59:17.892089+0000 mgr.x (mgr.34109) 587 : cluster [DBG] pgmap v675: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 17 MiB used, 442 GiB / 447 GiB avail; 643 B/s wr, 0 op/s; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:19.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:18 smithi031 bash[18426]: cluster 2020-06-27T04:59:17.892089+0000 mgr.x (mgr.34109) 587 : cluster [DBG] pgmap v675: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 17 MiB used, 442 GiB / 447 GiB avail; 643 B/s wr, 0 op/s; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:19.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:18 smithi031 bash[22603]: cluster 2020-06-27T04:59:17.892089+0000 mgr.x (mgr.34109) 587 : cluster [DBG] pgmap v675: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 17 MiB used, 442 GiB / 447 GiB avail; 643 B/s wr, 0 op/s; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:20.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:19 smithi051 bash[18409]: cluster 2020-06-27T04:59:19.507401+0000 mon.a (mon.0) 1412 : cluster [WRN] Health check update: 3 osds down (OSD_DOWN) 2020-06-27T04:59:20.222 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:19 smithi031 bash[18426]: cluster 2020-06-27T04:59:19.507401+0000 mon.a (mon.0) 1412 : cluster [WRN] Health check update: 3 osds down (OSD_DOWN) 2020-06-27T04:59:20.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:19 smithi031 bash[22603]: cluster 2020-06-27T04:59:19.507401+0000 mon.a (mon.0) 1412 : cluster [WRN] Health check update: 3 osds down (OSD_DOWN) 2020-06-27T04:59:21.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:20 smithi051 bash[18409]: cluster 2020-06-27T04:59:19.893679+0000 mgr.x (mgr.34109) 588 : cluster [DBG] pgmap v676: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 17 MiB used, 442 GiB / 447 GiB avail; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:21.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:20 smithi031 bash[18426]: cluster 2020-06-27T04:59:19.893679+0000 mgr.x (mgr.34109) 588 : cluster [DBG] pgmap v676: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 17 MiB used, 442 GiB / 447 GiB avail; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:21.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:20 smithi031 bash[22603]: cluster 2020-06-27T04:59:19.893679+0000 mgr.x (mgr.34109) 588 : cluster [DBG] pgmap v676: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 17 MiB used, 442 GiB / 447 GiB avail; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:23.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:22 smithi051 bash[18409]: cluster 2020-06-27T04:59:21.895370+0000 mgr.x (mgr.34109) 589 : cluster [DBG] pgmap v677: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 17 MiB used, 442 GiB / 447 GiB avail; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:23.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:22 smithi031 bash[18426]: cluster 2020-06-27T04:59:21.895370+0000 mgr.x (mgr.34109) 589 : cluster [DBG] pgmap v677: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 17 MiB used, 442 GiB / 447 GiB avail; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:23.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:22 smithi031 bash[22603]: cluster 2020-06-27T04:59:21.895370+0000 mgr.x (mgr.34109) 589 : cluster [DBG] pgmap v677: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 17 MiB used, 442 GiB / 447 GiB avail; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:23.528 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:23 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:59:23.528 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:23 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Scheduled restart job, restart counter is at 5. 2020-06-27T04:59:23.528 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:23 smithi051 systemd[1]: Stopped Ceph osd.7 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:59:23.529 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:23 smithi051 systemd[1]: Starting Ceph osd.7 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:59:23.529 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:23 smithi051 podman[45694]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7 found: no such container 2020-06-27T04:59:23.529 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:23 smithi051 systemd[1]: Started Ceph osd.7 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:59:23.914 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:23 smithi051 podman[45710]: 2020-06-27 04:59:23.52574664 +0000 UTC m=+0.241161689 container create 5d188afebbd83fd79d0ad667ceba12eec7626db442d50f38913363e1914dbe3e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:59:23.914 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:23 smithi051 podman[45710]: 2020-06-27 04:59:23.659093745 +0000 UTC m=+0.374508838 container init 5d188afebbd83fd79d0ad667ceba12eec7626db442d50f38913363e1914dbe3e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:59:23.914 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:23 smithi051 podman[45710]: 2020-06-27 04:59:23.692328508 +0000 UTC m=+0.407743474 container start 5d188afebbd83fd79d0ad667ceba12eec7626db442d50f38913363e1914dbe3e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:59:23.915 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:23 smithi051 podman[45710]: 2020-06-27 04:59:23.692400731 +0000 UTC m=+0.407815709 container attach 5d188afebbd83fd79d0ad667ceba12eec7626db442d50f38913363e1914dbe3e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:59:23.973 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:23 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:59:23.973 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:23 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Scheduled restart job, restart counter is at 6. 2020-06-27T04:59:23.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:23 smithi031 systemd[1]: Stopped Ceph osd.2 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:59:23.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:23 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Start request repeated too quickly. 2020-06-27T04:59:23.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:23 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.2.service: Failed with result 'exit-code'. 2020-06-27T04:59:23.974 INFO:ceph.osd.2.smithi031.stdout:Jun 27 04:59:23 smithi031 systemd[1]: Failed to start Ceph osd.2 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:59:23.974 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:23 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:59:24.217 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:23 smithi051 bash[45708]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-06-27T04:59:24.218 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:23 smithi051 bash[45708]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2020-06-27T04:59:24.218 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:23 smithi051 bash[45708]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2020-06-27T04:59:24.218 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:23 smithi051 bash[45708]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2020-06-27T04:59:24.218 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:23 smithi051 bash[45708]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2020-06-27T04:59:24.219 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:23 smithi051 bash[45708]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-06-27T04:59:24.219 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:23 smithi051 bash[45708]: --> ceph-volume lvm activate successful for osd ID: 7 2020-06-27T04:59:24.219 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:23 smithi051 podman[45710]: 2020-06-27 04:59:23.957593261 +0000 UTC m=+0.673008236 container died 5d188afebbd83fd79d0ad667ceba12eec7626db442d50f38913363e1914dbe3e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:59:24.410 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:23 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 5. 2020-06-27T04:59:24.411 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:23 smithi031 systemd[1]: Stopped Ceph osd.0 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:59:24.411 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:23 smithi031 systemd[1]: Starting Ceph osd.0 for 12892ae2-b830-11ea-a06d-001a4aab830c... 2020-06-27T04:59:24.411 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:24 smithi031 podman[116489]: Error: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0 found: no such container 2020-06-27T04:59:24.411 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:24 smithi031 systemd[1]: Started Ceph osd.0 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:59:24.718 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 podman[45710]: 2020-06-27 04:59:24.400365941 +0000 UTC m=+1.115780914 container remove 5d188afebbd83fd79d0ad667ceba12eec7626db442d50f38913363e1914dbe3e (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-activate) 2020-06-27T04:59:24.718 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7 found: no such container 2020-06-27T04:59:24.718 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7 2020-06-27T04:59:24.719 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7" found: no such container 2020-06-27T04:59:24.722 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:24 smithi031 podman[116505]: 2020-06-27 04:59:24.408405313 +0000 UTC m=+0.369205250 container create d123cdecd0a1a23e881333e350bf0527095c611fad929746754e62bddf0b86ea (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:59:24.723 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:24 smithi031 podman[116505]: 2020-06-27 04:59:24.550055298 +0000 UTC m=+0.510855255 container init d123cdecd0a1a23e881333e350bf0527095c611fad929746754e62bddf0b86ea (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:59:24.723 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:24 smithi031 podman[116505]: 2020-06-27 04:59:24.591643241 +0000 UTC m=+0.552443097 container start d123cdecd0a1a23e881333e350bf0527095c611fad929746754e62bddf0b86ea (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:59:24.723 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:24 smithi031 podman[116505]: 2020-06-27 04:59:24.591728312 +0000 UTC m=+0.552528201 container attach d123cdecd0a1a23e881333e350bf0527095c611fad929746754e62bddf0b86ea (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:59:25.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[18409]: cluster 2020-06-27T04:59:23.897369+0000 mgr.x (mgr.34109) 590 : cluster [DBG] pgmap v678: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 17 MiB used, 442 GiB / 447 GiB avail; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:25.219 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 podman[45817]: 2020-06-27 04:59:24.742568651 +0000 UTC m=+0.243242357 container create 45a7814d52f68bfc9a59366fe769cfe96926ad87ac7517b506bd4c752f586840 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:59:25.219 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 podman[45817]: 2020-06-27 04:59:24.858818444 +0000 UTC m=+0.359492133 container init 45a7814d52f68bfc9a59366fe769cfe96926ad87ac7517b506bd4c752f586840 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:59:25.219 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 podman[45817]: 2020-06-27 04:59:24.927595531 +0000 UTC m=+0.428269233 container start 45a7814d52f68bfc9a59366fe769cfe96926ad87ac7517b506bd4c752f586840 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:59:25.219 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 podman[45817]: 2020-06-27 04:59:24.927677723 +0000 UTC m=+0.428351450 container attach 45a7814d52f68bfc9a59366fe769cfe96926ad87ac7517b506bd4c752f586840 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:59:25.220 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 10 --2- 172.21.15.51:0/1423186367 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55fcffce4c00 0x55fcffc55400 secure :-1 s=READY pgs=3543 cs=0 l=1 rev1=1 rx=0x55fcffc67a70 tx=0x55fcffc34c00).discard_out_queue started 2020-06-27T04:59:25.220 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 20 Event(0x55fcffc79040 nevent=5000 time_id=3).wakeup 2020-06-27T04:59:25.220 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa758d49700 5 --2- 172.21.15.51:0/1423186367 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55fcffce4c00 0x55fcffc55400 secure :-1 s=READY pgs=3543 cs=0 l=1 rev1=1 rx=0x55fcffc67a70 tx=0x55fcffc34c00).reset_recv_state (warped) reseting crypto handlers 2020-06-27T04:59:25.220 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa758d49700 5 --2- 172.21.15.51:0/1423186367 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55fcffce4c00 0x55fcffc55400 secure :-1 s=CLOSED pgs=3543 cs=0 l=1 rev1=1 rx=0x55fcffc67a70 tx=0x55fcffc34c00).reset_security 2020-06-27T04:59:25.221 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa758d49700 20 -- 172.21.15.51:0/1423186367 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55fcffce4c00 msgr2=0x55fcffc55400 unknown :-1 s=STATE_CLOSED l=1).process 2020-06-27T04:59:25.221 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa758d49700 20 -- 172.21.15.51:0/1423186367 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55fcffce4c00 msgr2=0x55fcffc55400 unknown :-1 s=STATE_CLOSED l=1).process socket closed 2020-06-27T04:59:25.221 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa758d49700 20 EpollDriver.del_event del event fd=15 cur_mask=1 delmask=3 to 8 2020-06-27T04:59:25.221 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 10 -- 172.21.15.51:0/1423186367 shutdown 172.21.15.51:0/1423186367 2020-06-27T04:59:25.222 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 10 Processor -- stop 2020-06-27T04:59:25.222 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 20 Event(0x55fcffc78e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:59:25.222 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 1 -- 172.21.15.51:0/1423186367 shutdown_connections 2020-06-27T04:59:25.222 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 5 -- 172.21.15.51:0/1423186367 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x55fcffce4c00 2020-06-27T04:59:25.222 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 1 --2- 172.21.15.51:0/1423186367 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x55fcffce4c00 0x55fcffc55400 unknown :-1 s=CLOSED pgs=3543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:59:25.223 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 5 -- 172.21.15.51:0/1423186367 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x55fcffce5400 2020-06-27T04:59:25.223 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 1 --2- 172.21.15.51:0/1423186367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcffce5400 0x55fcffc56300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:59:25.223 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 5 -- 172.21.15.51:0/1423186367 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x55fcffce5000 2020-06-27T04:59:25.223 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 1 --2- 172.21.15.51:0/1423186367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55fcffce5000 0x55fcffc55e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:59:25.224 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 5 -- 172.21.15.51:0/1423186367 shutdown_connections delete 0x55fcffce4c00 2020-06-27T04:59:25.224 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 5 -- 172.21.15.51:0/1423186367 shutdown_connections delete 0x55fcffce5000 2020-06-27T04:59:25.224 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 5 -- 172.21.15.51:0/1423186367 shutdown_connections delete 0x55fcffce5400 2020-06-27T04:59:25.224 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 1 -- 172.21.15.51:0/1423186367 >> 172.21.15.51:0/1423186367 conn(0x55fcffce4800 msgr2=0x55fcffd4d000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:59:25.224 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 20 --1- 172.21.15.51:0/1423186367 >> 172.21.15.51:0/1423186367 conn(0x55fcffce4800 0x55fcffd4d000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:59:25.225 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 2 --1- 172.21.15.51:0/1423186367 >> 172.21.15.51:0/1423186367 conn(0x55fcffce4800 0x55fcffd4d000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:59:25.225 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 5 --1- 172.21.15.51:0/1423186367 >> 172.21.15.51:0/1423186367 conn(0x55fcffce4800 0x55fcffd4d000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:59:25.225 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 20 Event(0x55fcffc78e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:59:25.225 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 10 --1- 172.21.15.51:0/1423186367 >> 172.21.15.51:0/1423186367 conn(0x55fcffce4800 0x55fcffd4d000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:59:25.226 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 20 Event(0x55fcffc79040 nevent=5000 time_id=3).wakeup 2020-06-27T04:59:25.226 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 20 Event(0x55fcffc79280 nevent=5000 time_id=2).wakeup 2020-06-27T04:59:25.226 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75954a700 5 --1- 172.21.15.51:0/1423186367 >> 172.21.15.51:0/1423186367 conn(0x55fcffce4800 0x55fcffd4d000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:59:25.226 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75954a700 5 --1- 172.21.15.51:0/1423186367 >> 172.21.15.51:0/1423186367 conn(0x55fcffce4800 0x55fcffd4d000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:59:25.226 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 10 -- 172.21.15.51:0/1423186367 wait: waiting for dispatch queue 2020-06-27T04:59:25.227 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 10 -- 172.21.15.51:0/1423186367 wait: dispatch queue is stopped 2020-06-27T04:59:25.227 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 1 -- 172.21.15.51:0/1423186367 shutdown_connections 2020-06-27T04:59:25.227 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 5 -- 172.21.15.51:0/1423186367 shutdown_connections delete 0x55fcffce4800 2020-06-27T04:59:25.227 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 20 Event(0x55fcffc78e00 nevent=5000 time_id=2).wakeup 2020-06-27T04:59:25.227 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 20 Event(0x55fcffc79040 nevent=5000 time_id=3).wakeup 2020-06-27T04:59:25.228 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 20 Event(0x55fcffc79280 nevent=5000 time_id=2).wakeup 2020-06-27T04:59:25.228 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 10 -- 172.21.15.51:0/1423186367 wait: done. 2020-06-27T04:59:25.228 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:24 smithi051 bash[45708]: debug 2020-06-27T04:59:24.880+0000 7fa75f7c7f40 1 -- 172.21.15.51:0/1423186367 wait complete. 2020-06-27T04:59:25.229 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:24 smithi031 bash[18426]: cluster 2020-06-27T04:59:23.897369+0000 mgr.x (mgr.34109) 590 : cluster [DBG] pgmap v678: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 17 MiB used, 442 GiB / 447 GiB avail; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:25.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:24 smithi031 bash[22603]: cluster 2020-06-27T04:59:23.897369+0000 mgr.x (mgr.34109) 590 : cluster [DBG] pgmap v678: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 17 MiB used, 442 GiB / 447 GiB avail; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:25.230 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:24 smithi031 bash[116503]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-06-27T04:59:25.230 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:24 smithi031 bash[116503]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2020-06-27T04:59:25.230 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:24 smithi031 bash[116503]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2020-06-27T04:59:25.230 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:24 smithi031 bash[116503]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2020-06-27T04:59:25.231 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:24 smithi031 bash[116503]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2020-06-27T04:59:25.231 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:24 smithi031 bash[116503]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-06-27T04:59:25.231 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:24 smithi031 bash[116503]: --> ceph-volume lvm activate successful for osd ID: 0 2020-06-27T04:59:25.231 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:24 smithi031 podman[116505]: 2020-06-27 04:59:24.850375081 +0000 UTC m=+0.811174952 container died d123cdecd0a1a23e881333e350bf0527095c611fad929746754e62bddf0b86ea (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:59:25.718 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:25 smithi051 bash[45708]: debug 2020-06-27T04:59:25.397+0000 7fa75f7c7f40 -1 Falling back to public interface 2020-06-27T04:59:25.723 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:25 smithi031 podman[116505]: 2020-06-27 04:59:25.434728643 +0000 UTC m=+1.395528527 container remove d123cdecd0a1a23e881333e350bf0527095c611fad929746754e62bddf0b86ea (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-activate) 2020-06-27T04:59:25.723 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:25 smithi031 bash[116503]: Error: Failed to evict container: "": Failed to find container "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0" in state: no container with name or ID ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0 found: no such container 2020-06-27T04:59:25.723 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:25 smithi031 bash[116503]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0 2020-06-27T04:59:25.724 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:25 smithi031 bash[116503]: Error: no container with ID or name "ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0" found: no such container 2020-06-27T04:59:26.077 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:25 smithi031 podman[116615]: 2020-06-27 04:59:25.749812678 +0000 UTC m=+0.212166488 container create 5ac4b3e5a9399cb04d6fdcc6d3a96f79fe0b1e84148e62345a05fd664612581b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:59:26.077 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 podman[116615]: 2020-06-27 04:59:26.074809318 +0000 UTC m=+0.537163097 container init 5ac4b3e5a9399cb04d6fdcc6d3a96f79fe0b1e84148e62345a05fd664612581b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:59:26.467 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:26 smithi051 bash[45708]: debug 2020-06-27T04:59:26.142+0000 7fa75f7c7f40 -1 osd.7 175 log_to_monitors {default=true} 2020-06-27T04:59:26.473 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 podman[116615]: 2020-06-27 04:59:26.124788655 +0000 UTC m=+0.587142338 container start 5ac4b3e5a9399cb04d6fdcc6d3a96f79fe0b1e84148e62345a05fd664612581b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:59:26.473 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 podman[116615]: 2020-06-27 04:59:26.124866341 +0000 UTC m=+0.587220053 container attach 5ac4b3e5a9399cb04d6fdcc6d3a96f79fe0b1e84148e62345a05fd664612581b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:59:26.474 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f9610f36700 20 EpollDriver.del_event del event fd=14 cur_mask=1 delmask=3 to 8 2020-06-27T04:59:26.474 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 10 -- 172.21.15.31:0/3256305494 shutdown 172.21.15.31:0/3256305494 2020-06-27T04:59:26.474 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 10 Processor -- stop 2020-06-27T04:59:26.474 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 20 Event(0x5603fe64ce00 nevent=5000 time_id=2).wakeup 2020-06-27T04:59:26.474 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 1 -- 172.21.15.31:0/3256305494 shutdown_connections 2020-06-27T04:59:26.475 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 5 -- 172.21.15.31:0/3256305494 shutdown_connections mark down [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] 0x5603fe6b9400 2020-06-27T04:59:26.475 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 1 --2- 172.21.15.31:0/3256305494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5603fe6b9400 0x5603fe62a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:59:26.475 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 5 -- 172.21.15.31:0/3256305494 shutdown_connections mark down [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] 0x5603fe6b8c00 2020-06-27T04:59:26.475 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 1 --2- 172.21.15.31:0/3256305494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe6b8c00 0x5603fe629400 unknown :-1 s=CLOSED pgs=2644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-06-27T04:59:26.475 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 5 -- 172.21.15.31:0/3256305494 shutdown_connections mark down [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] 0x5603fe6b9000 2020-06-27T04:59:26.476 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 1 --2- 172.21.15.31:0/3256305494 >> [v2:172.21.15.51:3300/0,v1:172.21.15.51:6789/0] conn(0x5603fe6b9000 0x5603fe629e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-06-27T04:59:26.476 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 5 -- 172.21.15.31:0/3256305494 shutdown_connections delete 0x5603fe6b8c00 2020-06-27T04:59:26.476 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 5 -- 172.21.15.31:0/3256305494 shutdown_connections delete 0x5603fe6b9000 2020-06-27T04:59:26.476 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 5 -- 172.21.15.31:0/3256305494 shutdown_connections delete 0x5603fe6b9400 2020-06-27T04:59:26.476 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 1 -- 172.21.15.31:0/3256305494 >> 172.21.15.31:0/3256305494 conn(0x5603fe6b8800 msgr2=0x5603fe721000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-27T04:59:26.476 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 20 --1- 172.21.15.31:0/3256305494 >> 172.21.15.31:0/3256305494 conn(0x5603fe6b8800 0x5603fe721000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:59:26.477 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 2 --1- 172.21.15.31:0/3256305494 >> 172.21.15.31:0/3256305494 conn(0x5603fe6b8800 0x5603fe721000 :-1 s=NONE pgs=0 cs=0 l=0).stop 2020-06-27T04:59:26.477 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 5 --1- 172.21.15.31:0/3256305494 >> 172.21.15.31:0/3256305494 conn(0x5603fe6b8800 0x5603fe721000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2020-06-27T04:59:26.477 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 20 Event(0x5603fe64ce00 nevent=5000 time_id=2).wakeup 2020-06-27T04:59:26.477 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 10 --1- 172.21.15.31:0/3256305494 >> 172.21.15.31:0/3256305494 conn(0x5603fe6b8800 0x5603fe721000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2020-06-27T04:59:26.477 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f9611737700 5 --1- 172.21.15.31:0/3256305494 >> 172.21.15.31:0/3256305494 conn(0x5603fe6b8800 0x5603fe721000 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2020-06-27T04:59:26.478 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 20 Event(0x5603fe64ce00 nevent=5000 time_id=2).wakeup 2020-06-27T04:59:26.478 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 20 Event(0x5603fe64d040 nevent=5000 time_id=3).wakeup 2020-06-27T04:59:26.478 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f9611737700 5 --1- 172.21.15.31:0/3256305494 >> 172.21.15.31:0/3256305494 conn(0x5603fe6b8800 0x5603fe721000 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2020-06-27T04:59:26.478 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 20 Event(0x5603fe64d280 nevent=5000 time_id=2).wakeup 2020-06-27T04:59:26.478 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 10 -- 172.21.15.31:0/3256305494 wait: waiting for dispatch queue 2020-06-27T04:59:26.479 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 10 -- 172.21.15.31:0/3256305494 wait: dispatch queue is stopped 2020-06-27T04:59:26.479 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 1 -- 172.21.15.31:0/3256305494 shutdown_connections 2020-06-27T04:59:26.479 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 5 -- 172.21.15.31:0/3256305494 shutdown_connections delete 0x5603fe6b8800 2020-06-27T04:59:26.479 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 20 Event(0x5603fe64ce00 nevent=5000 time_id=2).wakeup 2020-06-27T04:59:26.479 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 20 Event(0x5603fe64d040 nevent=5000 time_id=3).wakeup 2020-06-27T04:59:26.479 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 20 Event(0x5603fe64d280 nevent=5000 time_id=2).wakeup 2020-06-27T04:59:26.480 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 10 -- 172.21.15.31:0/3256305494 wait: done. 2020-06-27T04:59:26.480 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.099+0000 7f96179b4f40 1 -- 172.21.15.31:0/3256305494 wait complete. 2020-06-27T04:59:26.973 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[116503]: debug 2020-06-27T04:59:26.618+0000 7f96179b4f40 -1 Falling back to public interface 2020-06-27T04:59:27.367 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[18426]: cluster 2020-06-27T04:59:25.898982+0000 mgr.x (mgr.34109) 591 : cluster [DBG] pgmap v679: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 17 MiB used, 442 GiB / 447 GiB avail; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:27.367 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[18426]: audit 2020-06-27T04:59:26.147889+0000 mon.b (mon.2) 352 : audit [INF] from='osd.7 v2:172.21.15.51:6801/3158840834' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:59:27.367 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[18426]: audit 2020-06-27T04:59:26.148255+0000 mon.a (mon.0) 1413 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:59:27.368 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[18426]: audit 2020-06-27T04:59:26.148733+0000 mon.b (mon.2) 353 : audit [INF] from='osd.7 v2:172.21.15.51:6801/3158840834' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:59:27.368 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[18426]: audit 2020-06-27T04:59:26.149044+0000 mon.a (mon.0) 1414 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:59:27.368 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[22603]: cluster 2020-06-27T04:59:25.898982+0000 mgr.x (mgr.34109) 591 : cluster [DBG] pgmap v679: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 17 MiB used, 442 GiB / 447 GiB avail; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:27.368 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[22603]: audit 2020-06-27T04:59:26.147889+0000 mon.b (mon.2) 352 : audit [INF] from='osd.7 v2:172.21.15.51:6801/3158840834' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:59:27.369 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[22603]: audit 2020-06-27T04:59:26.148255+0000 mon.a (mon.0) 1413 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:59:27.369 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[22603]: audit 2020-06-27T04:59:26.148733+0000 mon.b (mon.2) 353 : audit [INF] from='osd.7 v2:172.21.15.51:6801/3158840834' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:59:27.369 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:26 smithi031 bash[22603]: audit 2020-06-27T04:59:26.149044+0000 mon.a (mon.0) 1414 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:59:27.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:26 smithi051 bash[18409]: cluster 2020-06-27T04:59:25.898982+0000 mgr.x (mgr.34109) 591 : cluster [DBG] pgmap v679: 777 pgs: 122 peering, 3 stale+active+clean, 30 active+undersized+degraded, 4 creating+down, 15 stale+undersized+degraded+peered, 4 stale+creating+down, 3 active+recovery_wait+undersized+degraded, 71 down, 114 stale+down, 19 unknown, 109 active+undersized, 33 stale+peering, 6 stale+active+undersized+degraded, 23 undersized+degraded+peered, 10 active+clean, 62 stale+undersized+peered, 30 stale+active+undersized, 119 undersized+peered; 27 KiB data, 17 MiB used, 442 GiB / 447 GiB avail; 287/1116 objects degraded (25.717%) 2020-06-27T04:59:27.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:26 smithi051 bash[18409]: audit 2020-06-27T04:59:26.147889+0000 mon.b (mon.2) 352 : audit [INF] from='osd.7 v2:172.21.15.51:6801/3158840834' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:59:27.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:26 smithi051 bash[18409]: audit 2020-06-27T04:59:26.148255+0000 mon.a (mon.0) 1413 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-06-27T04:59:27.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:26 smithi051 bash[18409]: audit 2020-06-27T04:59:26.148733+0000 mon.b (mon.2) 353 : audit [INF] from='osd.7 v2:172.21.15.51:6801/3158840834' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:59:27.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:26 smithi051 bash[18409]: audit 2020-06-27T04:59:26.149044+0000 mon.a (mon.0) 1414 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi051", "root=default"]}]: dispatch 2020-06-27T04:59:27.723 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:27 smithi031 bash[116503]: debug 2020-06-27T04:59:27.363+0000 7f96179b4f40 -1 osd.0 175 log_to_monitors {default=true} 2020-06-27T04:59:28.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:27 smithi051 bash[18409]: cluster 2020-06-27T04:59:26.968402+0000 mon.a (mon.0) 1415 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:59:28.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:27 smithi051 bash[18409]: cluster 2020-06-27T04:59:26.968441+0000 mon.a (mon.0) 1416 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:59:28.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:27 smithi051 bash[18409]: cluster 2020-06-27T04:59:26.973639+0000 mon.a (mon.0) 1417 : cluster [DBG] osdmap e178: 8 total, 1 up, 5 in 2020-06-27T04:59:28.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:27 smithi051 bash[18409]: audit 2020-06-27T04:59:27.368370+0000 mon.a (mon.0) 1418 : audit [INF] from='osd.0 v2:172.21.15.31:6800/962322209' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:59:28.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:27 smithi051 bash[18409]: audit 2020-06-27T04:59:27.368862+0000 mon.a (mon.0) 1419 : audit [INF] from='osd.0 v2:172.21.15.31:6800/962322209' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:59:28.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:27 smithi051 bash[18409]: cluster 2020-06-27T04:59:27.978234+0000 mon.a (mon.0) 1420 : cluster [INF] osd.7 v2:172.21.15.51:6801/3158840834 boot 2020-06-27T04:59:28.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:27 smithi051 bash[18409]: cluster 2020-06-27T04:59:27.978365+0000 mon.a (mon.0) 1421 : cluster [DBG] osdmap e179: 8 total, 1 up, 5 in 2020-06-27T04:59:28.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:27 smithi031 bash[18426]: cluster 2020-06-27T04:59:26.968402+0000 mon.a (mon.0) 1415 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:59:28.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:27 smithi031 bash[18426]: cluster 2020-06-27T04:59:26.968441+0000 mon.a (mon.0) 1416 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:59:28.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:27 smithi031 bash[18426]: cluster 2020-06-27T04:59:26.973639+0000 mon.a (mon.0) 1417 : cluster [DBG] osdmap e178: 8 total, 1 up, 5 in 2020-06-27T04:59:28.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:27 smithi031 bash[18426]: audit 2020-06-27T04:59:27.368370+0000 mon.a (mon.0) 1418 : audit [INF] from='osd.0 v2:172.21.15.31:6800/962322209' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:59:28.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:27 smithi031 bash[18426]: audit 2020-06-27T04:59:27.368862+0000 mon.a (mon.0) 1419 : audit [INF] from='osd.0 v2:172.21.15.31:6800/962322209' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:59:28.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:27 smithi031 bash[18426]: cluster 2020-06-27T04:59:27.978234+0000 mon.a (mon.0) 1420 : cluster [INF] osd.7 v2:172.21.15.51:6801/3158840834 boot 2020-06-27T04:59:28.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:27 smithi031 bash[18426]: cluster 2020-06-27T04:59:27.978365+0000 mon.a (mon.0) 1421 : cluster [DBG] osdmap e179: 8 total, 1 up, 5 in 2020-06-27T04:59:28.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:27 smithi031 bash[22603]: cluster 2020-06-27T04:59:26.968402+0000 mon.a (mon.0) 1415 : cluster [WRN] Health check update: 4 osds down (OSD_DOWN) 2020-06-27T04:59:28.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:27 smithi031 bash[22603]: cluster 2020-06-27T04:59:26.968441+0000 mon.a (mon.0) 1416 : cluster [WRN] Health check failed: 1 host (4 osds) down (OSD_HOST_DOWN) 2020-06-27T04:59:28.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:27 smithi031 bash[22603]: cluster 2020-06-27T04:59:26.973639+0000 mon.a (mon.0) 1417 : cluster [DBG] osdmap e178: 8 total, 1 up, 5 in 2020-06-27T04:59:28.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:27 smithi031 bash[22603]: audit 2020-06-27T04:59:27.368370+0000 mon.a (mon.0) 1418 : audit [INF] from='osd.0 v2:172.21.15.31:6800/962322209' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-06-27T04:59:28.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:27 smithi031 bash[22603]: audit 2020-06-27T04:59:27.368862+0000 mon.a (mon.0) 1419 : audit [INF] from='osd.0 v2:172.21.15.31:6800/962322209' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2020-06-27T04:59:28.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:27 smithi031 bash[22603]: cluster 2020-06-27T04:59:27.978234+0000 mon.a (mon.0) 1420 : cluster [INF] osd.7 v2:172.21.15.51:6801/3158840834 boot 2020-06-27T04:59:28.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:27 smithi031 bash[22603]: cluster 2020-06-27T04:59:27.978365+0000 mon.a (mon.0) 1421 : cluster [DBG] osdmap e179: 8 total, 1 up, 5 in 2020-06-27T04:59:29.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:28 smithi051 bash[18409]: cluster 2020-06-27T04:59:27.900702+0000 mgr.x (mgr.34109) 592 : cluster [DBG] pgmap v681: 777 pgs: 9 activating+undersized, 9 peering, 16 stale+activating+undersized, 3 stale+active+clean, 20 active+undersized+degraded, 2 creating+down, 27 stale+undersized+degraded+peered, 6 stale+creating+down, 35 down, 3 stale+active+recovery_wait+undersized+degraded, 150 stale+down, 19 unknown, 66 active+undersized, 155 stale+peering, 16 stale+active+undersized+degraded, 6 undersized+degraded+peered, 10 active+clean, 100 stale+undersized+peered, 73 stale+active+undersized, 52 undersized+peered; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:29.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:28 smithi051 bash[18409]: audit 2020-06-27T04:59:27.979635+0000 mon.b (mon.2) 354 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:59:29.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:28 smithi051 bash[18409]: cluster 2020-06-27T04:59:27.980667+0000 mon.a (mon.0) 1422 : cluster [WRN] Health check update: Reduced data availability: 507 pgs inactive, 193 pgs down, 65 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:59:29.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:28 smithi051 bash[18409]: cluster 2020-06-27T04:59:27.980694+0000 mon.a (mon.0) 1423 : cluster [WRN] Health check update: Degraded data redundancy: 273/1116 objects degraded (24.462%), 72 pgs degraded, 212 pgs undersized (PG_DEGRADED) 2020-06-27T04:59:29.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:28 smithi051 bash[18409]: cluster 2020-06-27T04:59:28.973890+0000 mon.a (mon.0) 1424 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:59:29.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:28 smithi051 bash[18409]: cluster 2020-06-27T04:59:28.979214+0000 mon.a (mon.0) 1425 : cluster [INF] osd.0 v2:172.21.15.31:6800/962322209 boot 2020-06-27T04:59:29.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:28 smithi051 bash[18409]: cluster 2020-06-27T04:59:28.979297+0000 mon.a (mon.0) 1426 : cluster [DBG] osdmap e180: 8 total, 2 up, 5 in 2020-06-27T04:59:29.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:28 smithi051 bash[18409]: audit 2020-06-27T04:59:28.980327+0000 mon.b (mon.2) 355 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:59:29.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:28 smithi031 bash[18426]: cluster 2020-06-27T04:59:27.900702+0000 mgr.x (mgr.34109) 592 : cluster [DBG] pgmap v681: 777 pgs: 9 activating+undersized, 9 peering, 16 stale+activating+undersized, 3 stale+active+clean, 20 active+undersized+degraded, 2 creating+down, 27 stale+undersized+degraded+peered, 6 stale+creating+down, 35 down, 3 stale+active+recovery_wait+undersized+degraded, 150 stale+down, 19 unknown, 66 active+undersized, 155 stale+peering, 16 stale+active+undersized+degraded, 6 undersized+degraded+peered, 10 active+clean, 100 stale+undersized+peered, 73 stale+active+undersized, 52 undersized+peered; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:29.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:28 smithi031 bash[18426]: audit 2020-06-27T04:59:27.979635+0000 mon.b (mon.2) 354 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:59:29.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:28 smithi031 bash[18426]: cluster 2020-06-27T04:59:27.980667+0000 mon.a (mon.0) 1422 : cluster [WRN] Health check update: Reduced data availability: 507 pgs inactive, 193 pgs down, 65 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:59:29.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:28 smithi031 bash[18426]: cluster 2020-06-27T04:59:27.980694+0000 mon.a (mon.0) 1423 : cluster [WRN] Health check update: Degraded data redundancy: 273/1116 objects degraded (24.462%), 72 pgs degraded, 212 pgs undersized (PG_DEGRADED) 2020-06-27T04:59:29.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:28 smithi031 bash[18426]: cluster 2020-06-27T04:59:28.973890+0000 mon.a (mon.0) 1424 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:59:29.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:28 smithi031 bash[18426]: cluster 2020-06-27T04:59:28.979214+0000 mon.a (mon.0) 1425 : cluster [INF] osd.0 v2:172.21.15.31:6800/962322209 boot 2020-06-27T04:59:29.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:28 smithi031 bash[18426]: cluster 2020-06-27T04:59:28.979297+0000 mon.a (mon.0) 1426 : cluster [DBG] osdmap e180: 8 total, 2 up, 5 in 2020-06-27T04:59:29.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:28 smithi031 bash[18426]: audit 2020-06-27T04:59:28.980327+0000 mon.b (mon.2) 355 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:59:29.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:28 smithi031 bash[22603]: cluster 2020-06-27T04:59:27.900702+0000 mgr.x (mgr.34109) 592 : cluster [DBG] pgmap v681: 777 pgs: 9 activating+undersized, 9 peering, 16 stale+activating+undersized, 3 stale+active+clean, 20 active+undersized+degraded, 2 creating+down, 27 stale+undersized+degraded+peered, 6 stale+creating+down, 35 down, 3 stale+active+recovery_wait+undersized+degraded, 150 stale+down, 19 unknown, 66 active+undersized, 155 stale+peering, 16 stale+active+undersized+degraded, 6 undersized+degraded+peered, 10 active+clean, 100 stale+undersized+peered, 73 stale+active+undersized, 52 undersized+peered; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:29.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:28 smithi031 bash[22603]: audit 2020-06-27T04:59:27.979635+0000 mon.b (mon.2) 354 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-06-27T04:59:29.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:28 smithi031 bash[22603]: cluster 2020-06-27T04:59:27.980667+0000 mon.a (mon.0) 1422 : cluster [WRN] Health check update: Reduced data availability: 507 pgs inactive, 193 pgs down, 65 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:59:29.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:28 smithi031 bash[22603]: cluster 2020-06-27T04:59:27.980694+0000 mon.a (mon.0) 1423 : cluster [WRN] Health check update: Degraded data redundancy: 273/1116 objects degraded (24.462%), 72 pgs degraded, 212 pgs undersized (PG_DEGRADED) 2020-06-27T04:59:29.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:28 smithi031 bash[22603]: cluster 2020-06-27T04:59:28.973890+0000 mon.a (mon.0) 1424 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (4 osds) down) 2020-06-27T04:59:29.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:28 smithi031 bash[22603]: cluster 2020-06-27T04:59:28.979214+0000 mon.a (mon.0) 1425 : cluster [INF] osd.0 v2:172.21.15.31:6800/962322209 boot 2020-06-27T04:59:29.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:28 smithi031 bash[22603]: cluster 2020-06-27T04:59:28.979297+0000 mon.a (mon.0) 1426 : cluster [DBG] osdmap e180: 8 total, 2 up, 5 in 2020-06-27T04:59:29.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:28 smithi031 bash[22603]: audit 2020-06-27T04:59:28.980327+0000 mon.b (mon.2) 355 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-06-27T04:59:30.468 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:30.468 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: in thread 7fa736f32700 thread_name:tp_osd_tp 2020-06-27T04:59:30.469 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:30.469 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 1: (()+0x12dd0) [0x7fa75d53add0] 2020-06-27T04:59:30.469 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55fcf62fd707] 2020-06-27T04:59:30.469 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 3: (BlueStore::_do_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr)+0xce) [0x55fcf62fdfce] 2020-06-27T04:59:30.470 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 4: (BlueStore::_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&)+0x64) [0x55fcf62ff9b4] 2020-06-27T04:59:30.470 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 5: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a1b) [0x55fcf632f64b] 2020-06-27T04:59:30.470 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 6: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55fcf6330a57] 2020-06-27T04:59:30.470 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 7: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55fcf5fbb938] 2020-06-27T04:59:30.470 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 8: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55fcf616c03d] 2020-06-27T04:59:30.471 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 9: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55fcf5f295b0] 2020-06-27T04:59:30.471 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 10: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55fcf5f8289d] 2020-06-27T04:59:30.471 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 11: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55fcf5f8b380] 2020-06-27T04:59:30.471 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 12: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55fcf5f92590] 2020-06-27T04:59:30.472 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 13: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55fcf5e124e9] 2020-06-27T04:59:30.472 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 14: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55fcf6076f78] 2020-06-27T04:59:30.472 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 15: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55fcf5e3170f] 2020-06-27T04:59:30.472 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 16: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55fcf646fb94] 2020-06-27T04:59:30.472 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 17: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55fcf64727f4] 2020-06-27T04:59:30.473 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 18: (()+0x82de) [0x7fa75d5302de] 2020-06-27T04:59:30.473 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 19: (clone()+0x43) [0x7fa75c267e83] 2020-06-27T04:59:30.473 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: debug 2020-06-27T04:59:30.105+0000 7fa736f32700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:30.473 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: in thread 7fa736f32700 thread_name:tp_osd_tp 2020-06-27T04:59:30.473 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:30.474 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 1: (()+0x12dd0) [0x7fa75d53add0] 2020-06-27T04:59:30.474 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55fcf62fd707] 2020-06-27T04:59:30.474 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 3: (BlueStore::_do_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr)+0xce) [0x55fcf62fdfce] 2020-06-27T04:59:30.474 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 4: (BlueStore::_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&)+0x64) [0x55fcf62ff9b4] 2020-06-27T04:59:30.474 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 5: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a1b) [0x55fcf632f64b] 2020-06-27T04:59:30.475 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 6: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55fcf6330a57] 2020-06-27T04:59:30.475 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 7: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55fcf5fbb938] 2020-06-27T04:59:30.475 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 8: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55fcf616c03d] 2020-06-27T04:59:30.475 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 9: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55fcf5f295b0] 2020-06-27T04:59:30.475 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 10: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55fcf5f8289d] 2020-06-27T04:59:30.476 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 11: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55fcf5f8b380] 2020-06-27T04:59:30.476 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 12: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55fcf5f92590] 2020-06-27T04:59:30.476 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 13: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55fcf5e124e9] 2020-06-27T04:59:30.476 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 14: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55fcf6076f78] 2020-06-27T04:59:30.476 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 15: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55fcf5e3170f] 2020-06-27T04:59:30.477 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 16: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55fcf646fb94] 2020-06-27T04:59:30.477 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 17: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55fcf64727f4] 2020-06-27T04:59:30.477 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 18: (()+0x82de) [0x7fa75d5302de] 2020-06-27T04:59:30.478 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 19: (clone()+0x43) [0x7fa75c267e83] 2020-06-27T04:59:30.478 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:59:30.478 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: debug -9999> 2020-06-27T04:59:30.105+0000 7fa736f32700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:30.478 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: in thread 7fa736f32700 thread_name:tp_osd_tp 2020-06-27T04:59:30.478 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:30.478 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 1: (()+0x12dd0) [0x7fa75d53add0] 2020-06-27T04:59:30.480 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:30.480 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: in thread 7f95ef11f700 thread_name:tp_osd_tp 2020-06-27T04:59:30.480 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:30.480 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 1: (()+0x12dd0) [0x7f9615727dd0] 2020-06-27T04:59:30.481 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5603f419e707] 2020-06-27T04:59:30.481 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 3: (BlueStore::_do_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr)+0xce) [0x5603f419efce] 2020-06-27T04:59:30.481 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 4: (BlueStore::_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&)+0x64) [0x5603f41a09b4] 2020-06-27T04:59:30.481 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 5: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a1b) [0x5603f41d064b] 2020-06-27T04:59:30.481 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 6: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5603f41d1a57] 2020-06-27T04:59:30.482 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 7: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5603f3e5c938] 2020-06-27T04:59:30.482 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 8: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5603f4010a70] 2020-06-27T04:59:30.482 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 9: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5603f4020dd7] 2020-06-27T04:59:30.482 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 10: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5603f3e8f252] 2020-06-27T04:59:30.483 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5603f3e32e2e] 2020-06-27T04:59:30.483 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5603f3cb34e9] 2020-06-27T04:59:30.483 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5603f3f17f78] 2020-06-27T04:59:30.483 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5603f3cd270f] 2020-06-27T04:59:30.483 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5603f4310b94] 2020-06-27T04:59:30.484 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5603f43137f4] 2020-06-27T04:59:30.484 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 17: (()+0x82de) [0x7f961571d2de] 2020-06-27T04:59:30.484 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 18: (clone()+0x43) [0x7f9614454e83] 2020-06-27T04:59:30.484 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: debug 2020-06-27T04:59:30.157+0000 7f95ef11f700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:30.484 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: in thread 7f95ef11f700 thread_name:tp_osd_tp 2020-06-27T04:59:30.485 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:30.485 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 1: (()+0x12dd0) [0x7f9615727dd0] 2020-06-27T04:59:30.485 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5603f419e707] 2020-06-27T04:59:30.485 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 3: (BlueStore::_do_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr)+0xce) [0x5603f419efce] 2020-06-27T04:59:30.485 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 4: (BlueStore::_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&)+0x64) [0x5603f41a09b4] 2020-06-27T04:59:30.486 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 5: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a1b) [0x5603f41d064b] 2020-06-27T04:59:30.486 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 6: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5603f41d1a57] 2020-06-27T04:59:30.486 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 7: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5603f3e5c938] 2020-06-27T04:59:30.486 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 8: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5603f4010a70] 2020-06-27T04:59:30.486 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 9: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5603f4020dd7] 2020-06-27T04:59:30.487 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 10: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5603f3e8f252] 2020-06-27T04:59:30.487 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5603f3e32e2e] 2020-06-27T04:59:30.487 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5603f3cb34e9] 2020-06-27T04:59:30.487 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5603f3f17f78] 2020-06-27T04:59:30.487 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5603f3cd270f] 2020-06-27T04:59:30.488 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5603f4310b94] 2020-06-27T04:59:30.488 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5603f43137f4] 2020-06-27T04:59:30.488 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 17: (()+0x82de) [0x7f961571d2de] 2020-06-27T04:59:30.488 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 18: (clone()+0x43) [0x7f9614454e83] 2020-06-27T04:59:30.488 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:59:30.489 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: debug -4> 2020-06-27T04:59:30.157+0000 7f95ef11f700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:30.489 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: in thread 7f95ef11f700 thread_name:tp_osd_tp 2020-06-27T04:59:30.489 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:30.489 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 1: (()+0x12dd0) [0x7f9615727dd0] 2020-06-27T04:59:30.489 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5603f419e707] 2020-06-27T04:59:30.490 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 3: (BlueStore::_do_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr)+0xce) [0x5603f419efce] 2020-06-27T04:59:30.490 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 4: (BlueStore::_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&)+0x64) [0x5603f41a09b4] 2020-06-27T04:59:30.490 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 5: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a1b) [0x5603f41d064b] 2020-06-27T04:59:30.490 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 6: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5603f41d1a57] 2020-06-27T04:59:30.490 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 7: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5603f3e5c938] 2020-06-27T04:59:30.491 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 8: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5603f4010a70] 2020-06-27T04:59:30.491 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 9: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5603f4020dd7] 2020-06-27T04:59:30.491 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 10: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5603f3e8f252] 2020-06-27T04:59:30.491 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5603f3e32e2e] 2020-06-27T04:59:30.491 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5603f3cb34e9] 2020-06-27T04:59:30.492 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5603f3f17f78] 2020-06-27T04:59:30.492 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5603f3cd270f] 2020-06-27T04:59:30.492 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5603f4310b94] 2020-06-27T04:59:30.492 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5603f43137f4] 2020-06-27T04:59:30.492 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 17: (()+0x82de) [0x7f961571d2de] 2020-06-27T04:59:30.493 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 18: (clone()+0x43) [0x7f9614454e83] 2020-06-27T04:59:30.493 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:59:30.493 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: debug -9999> 2020-06-27T04:59:30.157+0000 7f95ef11f700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:30.493 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: in thread 7f95ef11f700 thread_name:tp_osd_tp 2020-06-27T04:59:30.494 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:30.495 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 1: (()+0x12dd0) [0x7f9615727dd0] 2020-06-27T04:59:30.495 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x5603f419e707] 2020-06-27T04:59:30.497 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 3: (BlueStore::_do_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr)+0xce) [0x5603f419efce] 2020-06-27T04:59:30.497 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 4: (BlueStore::_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&)+0x64) [0x5603f41a09b4] 2020-06-27T04:59:30.497 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 5: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a1b) [0x5603f41d064b] 2020-06-27T04:59:30.498 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 6: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x5603f41d1a57] 2020-06-27T04:59:30.498 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 7: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x5603f3e5c938] 2020-06-27T04:59:30.498 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 8: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x5603f4010a70] 2020-06-27T04:59:30.498 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 9: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x5603f4020dd7] 2020-06-27T04:59:30.498 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 10: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x5603f3e8f252] 2020-06-27T04:59:30.499 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x5603f3e32e2e] 2020-06-27T04:59:30.499 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x5603f3cb34e9] 2020-06-27T04:59:30.499 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x5603f3f17f78] 2020-06-27T04:59:30.499 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x5603f3cd270f] 2020-06-27T04:59:30.499 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x5603f4310b94] 2020-06-27T04:59:30.500 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x5603f43137f4] 2020-06-27T04:59:30.500 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 17: (()+0x82de) [0x7f961571d2de] 2020-06-27T04:59:30.500 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: 18: (clone()+0x43) [0x7f9614454e83] 2020-06-27T04:59:30.500 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:59:30.500 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[116503]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:59:30.501 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:30 smithi031 podman[116615]: 2020-06-27 04:59:30.299435215 +0000 UTC m=+4.761788946 container died 5ac4b3e5a9399cb04d6fdcc6d3a96f79fe0b1e84148e62345a05fd664612581b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:59:30.501 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55fcf62fd707] 2020-06-27T04:59:30.501 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 3: (BlueStore::_do_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr)+0xce) [0x55fcf62fdfce] 2020-06-27T04:59:30.501 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 4: (BlueStore::_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&)+0x64) [0x55fcf62ff9b4] 2020-06-27T04:59:30.502 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 5: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a1b) [0x55fcf632f64b] 2020-06-27T04:59:30.502 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 6: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55fcf6330a57] 2020-06-27T04:59:30.502 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 7: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55fcf5fbb938] 2020-06-27T04:59:30.502 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 8: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55fcf616c03d] 2020-06-27T04:59:30.502 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 9: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55fcf5f295b0] 2020-06-27T04:59:30.503 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 10: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55fcf5f8289d] 2020-06-27T04:59:30.503 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 11: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55fcf5f8b380] 2020-06-27T04:59:30.503 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 12: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55fcf5f92590] 2020-06-27T04:59:30.503 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 13: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55fcf5e124e9] 2020-06-27T04:59:30.503 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 14: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55fcf6076f78] 2020-06-27T04:59:30.504 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 15: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55fcf5e3170f] 2020-06-27T04:59:30.504 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 16: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55fcf646fb94] 2020-06-27T04:59:30.504 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 17: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55fcf64727f4] 2020-06-27T04:59:30.504 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 18: (()+0x82de) [0x7fa75d5302de] 2020-06-27T04:59:30.505 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 19: (clone()+0x43) [0x7fa75c267e83] 2020-06-27T04:59:30.505 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:59:30.505 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: debug -9999> 2020-06-27T04:59:30.105+0000 7fa736f32700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:59:30.505 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: in thread 7fa736f32700 thread_name:tp_osd_tp 2020-06-27T04:59:30.505 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:59:30.506 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 1: (()+0x12dd0) [0x7fa75d53add0] 2020-06-27T04:59:30.506 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55fcf62fd707] 2020-06-27T04:59:30.506 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 3: (BlueStore::_do_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr)+0xce) [0x55fcf62fdfce] 2020-06-27T04:59:30.507 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 4: (BlueStore::_remove(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&)+0x64) [0x55fcf62ff9b4] 2020-06-27T04:59:30.507 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 5: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a1b) [0x55fcf632f64b] 2020-06-27T04:59:30.507 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 6: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55fcf6330a57] 2020-06-27T04:59:30.507 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 7: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55fcf5fbb938] 2020-06-27T04:59:30.507 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 8: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55fcf616c03d] 2020-06-27T04:59:30.508 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 9: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55fcf5f295b0] 2020-06-27T04:59:30.508 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 10: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55fcf5f8289d] 2020-06-27T04:59:30.508 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 11: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55fcf5f8b380] 2020-06-27T04:59:30.508 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 12: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55fcf5f92590] 2020-06-27T04:59:30.508 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 13: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55fcf5e124e9] 2020-06-27T04:59:30.509 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 14: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55fcf6076f78] 2020-06-27T04:59:30.509 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 15: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55fcf5e3170f] 2020-06-27T04:59:30.509 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 16: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55fcf646fb94] 2020-06-27T04:59:30.509 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 17: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55fcf64727f4] 2020-06-27T04:59:30.509 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 18: (()+0x82de) [0x7fa75d5302de] 2020-06-27T04:59:30.510 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: 19: (clone()+0x43) [0x7fa75c267e83] 2020-06-27T04:59:30.510 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:59:30.510 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[45708]: reraise_fatal: default handler for signal 11 didn't terminate the process? 2020-06-27T04:59:30.510 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 podman[45817]: 2020-06-27 04:59:30.170696095 +0000 UTC m=+5.671369825 container died 45a7814d52f68bfc9a59366fe769cfe96926ad87ac7517b506bd4c752f586840 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:59:30.917 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 podman[45817]: 2020-06-27 04:59:30.646152769 +0000 UTC m=+6.146826491 container remove 45a7814d52f68bfc9a59366fe769cfe96926ad87ac7517b506bd4c752f586840 (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7) 2020-06-27T04:59:30.918 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:59:30.918 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:30 smithi051 podman[46230]: 2020-06-27 04:59:30.874521887 +0000 UTC m=+0.209337572 container create 329cad743f24496655a707387fb3c3eab30e16353726125c05fa0f07abb882fd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:59:31.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[18409]: cluster 2020-06-27T04:59:29.902229+0000 mgr.x (mgr.34109) 593 : cluster [DBG] pgmap v684: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:31.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:30 smithi051 bash[18409]: cluster 2020-06-27T04:59:29.982815+0000 mon.a (mon.0) 1427 : cluster [DBG] osdmap e181: 8 total, 2 up, 5 in 2020-06-27T04:59:31.219 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:31 smithi051 podman[46230]: 2020-06-27 04:59:30.999568166 +0000 UTC m=+0.334383952 container init 329cad743f24496655a707387fb3c3eab30e16353726125c05fa0f07abb882fd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:59:31.219 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:31 smithi051 podman[46230]: 2020-06-27 04:59:31.032799677 +0000 UTC m=+0.367615364 container start 329cad743f24496655a707387fb3c3eab30e16353726125c05fa0f07abb882fd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:59:31.219 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:31 smithi051 podman[46230]: 2020-06-27 04:59:31.032868173 +0000 UTC m=+0.367683883 container attach 329cad743f24496655a707387fb3c3eab30e16353726125c05fa0f07abb882fd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:59:31.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[18426]: cluster 2020-06-27T04:59:29.902229+0000 mgr.x (mgr.34109) 593 : cluster [DBG] pgmap v684: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:31.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[18426]: cluster 2020-06-27T04:59:29.982815+0000 mon.a (mon.0) 1427 : cluster [DBG] osdmap e181: 8 total, 2 up, 5 in 2020-06-27T04:59:31.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[22603]: cluster 2020-06-27T04:59:29.902229+0000 mgr.x (mgr.34109) 593 : cluster [DBG] pgmap v684: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:31.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:30 smithi031 bash[22603]: cluster 2020-06-27T04:59:29.982815+0000 mon.a (mon.0) 1427 : cluster [DBG] osdmap e181: 8 total, 2 up, 5 in 2020-06-27T04:59:31.474 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:31 smithi031 podman[116615]: 2020-06-27 04:59:31.147034423 +0000 UTC m=+5.609388140 container remove 5ac4b3e5a9399cb04d6fdcc6d3a96f79fe0b1e84148e62345a05fd664612581b (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0) 2020-06-27T04:59:31.474 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:31 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Main process exited, code=exited, status=1/FAILURE 2020-06-27T04:59:31.717 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:31 smithi051 podman[46230]: 2020-06-27 04:59:31.29564828 +0000 UTC m=+0.630463988 container died 329cad743f24496655a707387fb3c3eab30e16353726125c05fa0f07abb882fd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:59:31.973 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:31 smithi031 podman[117022]: 2020-06-27 04:59:31.557189561 +0000 UTC m=+0.387417009 container create 2c3a7663e6c775b385c05f4931ee66df2018592f629aa0f890fbabf22bfb83bc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:59:31.973 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:31 smithi031 podman[117022]: 2020-06-27 04:59:31.732230341 +0000 UTC m=+0.562457783 container init 2c3a7663e6c775b385c05f4931ee66df2018592f629aa0f890fbabf22bfb83bc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:59:31.973 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:31 smithi031 podman[117022]: 2020-06-27 04:59:31.77378178 +0000 UTC m=+0.604009151 container start 2c3a7663e6c775b385c05f4931ee66df2018592f629aa0f890fbabf22bfb83bc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:59:31.974 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:31 smithi031 podman[117022]: 2020-06-27 04:59:31.773863129 +0000 UTC m=+0.604090518 container attach 2c3a7663e6c775b385c05f4931ee66df2018592f629aa0f890fbabf22bfb83bc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:59:32.218 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:31 smithi051 podman[46230]: 2020-06-27 04:59:31.875198814 +0000 UTC m=+1.210014508 container remove 329cad743f24496655a707387fb3c3eab30e16353726125c05fa0f07abb882fd (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.7-deactivate) 2020-06-27T04:59:32.218 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:31 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Failed with result 'exit-code'. 2020-06-27T04:59:32.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:32 smithi051 bash[18409]: cluster 2020-06-27T04:59:31.903490+0000 mgr.x (mgr.34109) 594 : cluster [DBG] pgmap v686: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:32.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:32 smithi031 bash[18426]: cluster 2020-06-27T04:59:31.903490+0000 mgr.x (mgr.34109) 594 : cluster [DBG] pgmap v686: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:32.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:32 smithi031 bash[22603]: cluster 2020-06-27T04:59:31.903490+0000 mgr.x (mgr.34109) 594 : cluster [DBG] pgmap v686: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:32.474 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:32 smithi031 podman[117022]: 2020-06-27 04:59:32.026335498 +0000 UTC m=+0.856562890 container died 2c3a7663e6c775b385c05f4931ee66df2018592f629aa0f890fbabf22bfb83bc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:59:32.973 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:32 smithi031 podman[117022]: 2020-06-27 04:59:32.526419399 +0000 UTC m=+1.356646794 container remove 2c3a7663e6c775b385c05f4931ee66df2018592f629aa0f890fbabf22bfb83bc (image=quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5, name=ceph-12892ae2-b830-11ea-a06d-001a4aab830c-osd.0-deactivate) 2020-06-27T04:59:32.973 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:32 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2020-06-27T04:59:35.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:34 smithi051 bash[18409]: cluster 2020-06-27T04:59:33.904963+0000 mgr.x (mgr.34109) 595 : cluster [DBG] pgmap v687: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:35.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:34 smithi051 bash[18409]: cluster 2020-06-27T04:59:34.510092+0000 mon.a (mon.0) 1428 : cluster [WRN] Health check update: 3 osds down (OSD_DOWN) 2020-06-27T04:59:35.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:34 smithi031 bash[18426]: cluster 2020-06-27T04:59:33.904963+0000 mgr.x (mgr.34109) 595 : cluster [DBG] pgmap v687: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:35.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:34 smithi031 bash[18426]: cluster 2020-06-27T04:59:34.510092+0000 mon.a (mon.0) 1428 : cluster [WRN] Health check update: 3 osds down (OSD_DOWN) 2020-06-27T04:59:35.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:34 smithi031 bash[22603]: cluster 2020-06-27T04:59:33.904963+0000 mgr.x (mgr.34109) 595 : cluster [DBG] pgmap v687: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:35.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:34 smithi031 bash[22603]: cluster 2020-06-27T04:59:34.510092+0000 mon.a (mon.0) 1428 : cluster [WRN] Health check update: 3 osds down (OSD_DOWN) 2020-06-27T04:59:37.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:36 smithi031 bash[18426]: cluster 2020-06-27T04:59:35.906413+0000 mgr.x (mgr.34109) 596 : cluster [DBG] pgmap v688: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:37.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:36 smithi031 bash[22603]: cluster 2020-06-27T04:59:35.906413+0000 mgr.x (mgr.34109) 596 : cluster [DBG] pgmap v688: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:37.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:36 smithi051 bash[18409]: cluster 2020-06-27T04:59:35.906413+0000 mgr.x (mgr.34109) 596 : cluster [DBG] pgmap v688: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:39.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:38 smithi031 bash[18426]: cluster 2020-06-27T04:59:37.907984+0000 mgr.x (mgr.34109) 597 : cluster [DBG] pgmap v689: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:39.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:38 smithi031 bash[22603]: cluster 2020-06-27T04:59:37.907984+0000 mgr.x (mgr.34109) 597 : cluster [DBG] pgmap v689: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:39.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:38 smithi051 bash[18409]: cluster 2020-06-27T04:59:37.907984+0000 mgr.x (mgr.34109) 597 : cluster [DBG] pgmap v689: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:40.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:40 smithi051 bash[18409]: cluster 2020-06-27T04:59:39.909537+0000 mgr.x (mgr.34109) 598 : cluster [DBG] pgmap v690: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:40 smithi031 bash[18426]: cluster 2020-06-27T04:59:39.909537+0000 mgr.x (mgr.34109) 598 : cluster [DBG] pgmap v690: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:40.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:40 smithi031 bash[22603]: cluster 2020-06-27T04:59:39.909537+0000 mgr.x (mgr.34109) 598 : cluster [DBG] pgmap v690: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:42.468 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:41 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:59:42.468 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:41 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Scheduled restart job, restart counter is at 6. 2020-06-27T04:59:42.468 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:41 smithi051 systemd[1]: Stopped Ceph osd.7 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:59:42.469 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:41 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Start request repeated too quickly. 2020-06-27T04:59:42.469 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:41 smithi051 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.7.service: Failed with result 'exit-code'. 2020-06-27T04:59:42.469 INFO:ceph.osd.7.smithi051.stdout:Jun 27 04:59:41 smithi051 systemd[1]: Failed to start Ceph osd.7 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:59:43.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:42 smithi031 bash[18426]: cluster 2020-06-27T04:59:41.911032+0000 mgr.x (mgr.34109) 599 : cluster [DBG] pgmap v691: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:43.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:42 smithi031 bash[22603]: cluster 2020-06-27T04:59:41.911032+0000 mgr.x (mgr.34109) 599 : cluster [DBG] pgmap v691: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:43.224 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:42 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Service RestartSec=10s expired, scheduling restart. 2020-06-27T04:59:43.224 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:42 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 6. 2020-06-27T04:59:43.224 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:42 smithi031 systemd[1]: Stopped Ceph osd.0 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:59:43.224 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:42 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Start request repeated too quickly. 2020-06-27T04:59:43.224 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:42 smithi031 systemd[1]: ceph-12892ae2-b830-11ea-a06d-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2020-06-27T04:59:43.225 INFO:ceph.osd.0.smithi031.stdout:Jun 27 04:59:42 smithi031 systemd[1]: Failed to start Ceph osd.0 for 12892ae2-b830-11ea-a06d-001a4aab830c. 2020-06-27T04:59:43.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:42 smithi051 bash[18409]: cluster 2020-06-27T04:59:41.911032+0000 mgr.x (mgr.34109) 599 : cluster [DBG] pgmap v691: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:45.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:44 smithi051 bash[18409]: cluster 2020-06-27T04:59:43.912437+0000 mgr.x (mgr.34109) 600 : cluster [DBG] pgmap v692: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:45.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:44 smithi031 bash[18426]: cluster 2020-06-27T04:59:43.912437+0000 mgr.x (mgr.34109) 600 : cluster [DBG] pgmap v692: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:45.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:44 smithi031 bash[22603]: cluster 2020-06-27T04:59:43.912437+0000 mgr.x (mgr.34109) 600 : cluster [DBG] pgmap v692: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:47.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:46 smithi051 bash[18409]: cluster 2020-06-27T04:59:45.914000+0000 mgr.x (mgr.34109) 601 : cluster [DBG] pgmap v693: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:47.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:46 smithi031 bash[18426]: cluster 2020-06-27T04:59:45.914000+0000 mgr.x (mgr.34109) 601 : cluster [DBG] pgmap v693: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:47.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:46 smithi031 bash[22603]: cluster 2020-06-27T04:59:45.914000+0000 mgr.x (mgr.34109) 601 : cluster [DBG] pgmap v693: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:49.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:48 smithi051 bash[18409]: cluster 2020-06-27T04:59:47.915577+0000 mgr.x (mgr.34109) 602 : cluster [DBG] pgmap v694: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:49.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:48 smithi031 bash[18426]: cluster 2020-06-27T04:59:47.915577+0000 mgr.x (mgr.34109) 602 : cluster [DBG] pgmap v694: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:49.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:48 smithi031 bash[22603]: cluster 2020-06-27T04:59:47.915577+0000 mgr.x (mgr.34109) 602 : cluster [DBG] pgmap v694: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:50.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:50 smithi051 bash[18409]: cluster 2020-06-27T04:59:49.917004+0000 mgr.x (mgr.34109) 603 : cluster [DBG] pgmap v695: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:50.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:50 smithi031 bash[18426]: cluster 2020-06-27T04:59:49.917004+0000 mgr.x (mgr.34109) 603 : cluster [DBG] pgmap v695: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:50.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:50 smithi031 bash[22603]: cluster 2020-06-27T04:59:49.917004+0000 mgr.x (mgr.34109) 603 : cluster [DBG] pgmap v695: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:51.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:51 smithi051 bash[18409]: cluster 2020-06-27T04:59:50.536772+0000 mon.a (mon.0) 1429 : cluster [WRN] Health check update: Reduced data availability: 508 pgs inactive, 193 pgs down, 65 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:59:51.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:51 smithi031 bash[18426]: cluster 2020-06-27T04:59:50.536772+0000 mon.a (mon.0) 1429 : cluster [WRN] Health check update: Reduced data availability: 508 pgs inactive, 193 pgs down, 65 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:59:51.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:51 smithi031 bash[22603]: cluster 2020-06-27T04:59:50.536772+0000 mon.a (mon.0) 1429 : cluster [WRN] Health check update: Reduced data availability: 508 pgs inactive, 193 pgs down, 65 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T04:59:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:52 smithi051 bash[18409]: cluster 2020-06-27T04:59:51.918543+0000 mgr.x (mgr.34109) 604 : cluster [DBG] pgmap v696: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:52 smithi031 bash[22603]: cluster 2020-06-27T04:59:51.918543+0000 mgr.x (mgr.34109) 604 : cluster [DBG] pgmap v696: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:52 smithi031 bash[18426]: cluster 2020-06-27T04:59:51.918543+0000 mgr.x (mgr.34109) 604 : cluster [DBG] pgmap v696: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:53.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:53 smithi051 bash[18409]: cluster 2020-06-27T04:59:52.550169+0000 mon.a (mon.0) 1430 : cluster [WRN] Health check update: Degraded data redundancy: 273/1116 objects degraded (24.462%), 72 pgs degraded, 251 pgs undersized (PG_DEGRADED) 2020-06-27T04:59:53.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:53 smithi031 bash[18426]: cluster 2020-06-27T04:59:52.550169+0000 mon.a (mon.0) 1430 : cluster [WRN] Health check update: Degraded data redundancy: 273/1116 objects degraded (24.462%), 72 pgs degraded, 251 pgs undersized (PG_DEGRADED) 2020-06-27T04:59:53.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:53 smithi031 bash[22603]: cluster 2020-06-27T04:59:52.550169+0000 mon.a (mon.0) 1430 : cluster [WRN] Health check update: Degraded data redundancy: 273/1116 objects degraded (24.462%), 72 pgs degraded, 251 pgs undersized (PG_DEGRADED) 2020-06-27T04:59:54.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:54 smithi051 bash[18409]: cluster 2020-06-27T04:59:53.920023+0000 mgr.x (mgr.34109) 605 : cluster [DBG] pgmap v697: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:54.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:54 smithi031 bash[18426]: cluster 2020-06-27T04:59:53.920023+0000 mgr.x (mgr.34109) 605 : cluster [DBG] pgmap v697: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:54 smithi031 bash[22603]: cluster 2020-06-27T04:59:53.920023+0000 mgr.x (mgr.34109) 605 : cluster [DBG] pgmap v697: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:57.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:56 smithi051 bash[18409]: cluster 2020-06-27T04:59:55.921610+0000 mgr.x (mgr.34109) 606 : cluster [DBG] pgmap v698: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:57.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:56 smithi031 bash[18426]: cluster 2020-06-27T04:59:55.921610+0000 mgr.x (mgr.34109) 606 : cluster [DBG] pgmap v698: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:57.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:56 smithi031 bash[22603]: cluster 2020-06-27T04:59:55.921610+0000 mgr.x (mgr.34109) 606 : cluster [DBG] pgmap v698: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:59.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:58 smithi051 bash[18409]: cluster 2020-06-27T04:59:57.923170+0000 mgr.x (mgr.34109) 607 : cluster [DBG] pgmap v699: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:59.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:58 smithi031 bash[18426]: cluster 2020-06-27T04:59:57.923170+0000 mgr.x (mgr.34109) 607 : cluster [DBG] pgmap v699: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T04:59:59.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:58 smithi031 bash[22603]: cluster 2020-06-27T04:59:57.923170+0000 mgr.x (mgr.34109) 607 : cluster [DBG] pgmap v699: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 04:59:59 smithi051 bash[18409]: cluster 2020-06-27T04:59:59.532324+0000 mon.a (mon.0) 1431 : cluster [WRN] Health check update: Reduced data availability: 508 pgs inactive, 193 pgs down, 89 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T05:00:00.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 04:59:59 smithi031 bash[18426]: cluster 2020-06-27T04:59:59.532324+0000 mon.a (mon.0) 1431 : cluster [WRN] Health check update: Reduced data availability: 508 pgs inactive, 193 pgs down, 89 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T05:00:00.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 04:59:59 smithi031 bash[22603]: cluster 2020-06-27T04:59:59.532324+0000 mon.a (mon.0) 1431 : cluster [WRN] Health check update: Reduced data availability: 508 pgs inactive, 193 pgs down, 89 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T05:00:01.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:00 smithi051 bash[18409]: cluster 2020-06-27T04:59:59.924633+0000 mgr.x (mgr.34109) 608 : cluster [DBG] pgmap v700: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:01.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:00 smithi051 bash[18409]: cluster 2020-06-27T05:00:00.000215+0000 mon.a (mon.0) 1432 : cluster [WRN] overall HEALTH_WARN 3 osds down; Reduced data availability: 508 pgs inactive, 193 pgs down, 89 pgs peering, 132 pgs stale; Degraded data redundancy: 273/1116 objects degraded (24.462%), 72 pgs degraded, 251 pgs undersized; 9 pool(s) do not have an application enabled; 1 pool(s) full 2020-06-27T05:00:01.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:00 smithi031 bash[18426]: cluster 2020-06-27T04:59:59.924633+0000 mgr.x (mgr.34109) 608 : cluster [DBG] pgmap v700: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:01.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:00 smithi031 bash[18426]: cluster 2020-06-27T05:00:00.000215+0000 mon.a (mon.0) 1432 : cluster [WRN] overall HEALTH_WARN 3 osds down; Reduced data availability: 508 pgs inactive, 193 pgs down, 89 pgs peering, 132 pgs stale; Degraded data redundancy: 273/1116 objects degraded (24.462%), 72 pgs degraded, 251 pgs undersized; 9 pool(s) do not have an application enabled; 1 pool(s) full 2020-06-27T05:00:01.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:00 smithi031 bash[22603]: cluster 2020-06-27T04:59:59.924633+0000 mgr.x (mgr.34109) 608 : cluster [DBG] pgmap v700: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:01.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:00 smithi031 bash[22603]: cluster 2020-06-27T05:00:00.000215+0000 mon.a (mon.0) 1432 : cluster [WRN] overall HEALTH_WARN 3 osds down; Reduced data availability: 508 pgs inactive, 193 pgs down, 89 pgs peering, 132 pgs stale; Degraded data redundancy: 273/1116 objects degraded (24.462%), 72 pgs degraded, 251 pgs undersized; 9 pool(s) do not have an application enabled; 1 pool(s) full 2020-06-27T05:00:02.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:01 smithi051 bash[18409]: cluster 2020-06-27T05:00:01.926147+0000 mgr.x (mgr.34109) 609 : cluster [DBG] pgmap v701: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:02.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:01 smithi031 bash[18426]: cluster 2020-06-27T05:00:01.926147+0000 mgr.x (mgr.34109) 609 : cluster [DBG] pgmap v701: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:02.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:01 smithi031 bash[22603]: cluster 2020-06-27T05:00:01.926147+0000 mgr.x (mgr.34109) 609 : cluster [DBG] pgmap v701: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:05.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:04 smithi051 bash[18409]: cluster 2020-06-27T05:00:03.927799+0000 mgr.x (mgr.34109) 610 : cluster [DBG] pgmap v702: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:05.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:04 smithi031 bash[18426]: cluster 2020-06-27T05:00:03.927799+0000 mgr.x (mgr.34109) 610 : cluster [DBG] pgmap v702: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:05.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:04 smithi031 bash[22603]: cluster 2020-06-27T05:00:03.927799+0000 mgr.x (mgr.34109) 610 : cluster [DBG] pgmap v702: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:06.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:05 smithi051 bash[18409]: cluster 2020-06-27T05:00:05.929271+0000 mgr.x (mgr.34109) 611 : cluster [DBG] pgmap v703: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:06.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:05 smithi031 bash[18426]: cluster 2020-06-27T05:00:05.929271+0000 mgr.x (mgr.34109) 611 : cluster [DBG] pgmap v703: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:06.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:05 smithi031 bash[22603]: cluster 2020-06-27T05:00:05.929271+0000 mgr.x (mgr.34109) 611 : cluster [DBG] pgmap v703: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:09.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:08 smithi051 bash[18409]: cluster 2020-06-27T05:00:07.930841+0000 mgr.x (mgr.34109) 612 : cluster [DBG] pgmap v704: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:09.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:08 smithi031 bash[18426]: cluster 2020-06-27T05:00:07.930841+0000 mgr.x (mgr.34109) 612 : cluster [DBG] pgmap v704: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:09.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:08 smithi031 bash[22603]: cluster 2020-06-27T05:00:07.930841+0000 mgr.x (mgr.34109) 612 : cluster [DBG] pgmap v704: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:10.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:10 smithi051 bash[18409]: cluster 2020-06-27T05:00:09.932372+0000 mgr.x (mgr.34109) 613 : cluster [DBG] pgmap v705: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:10.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:10 smithi031 bash[18426]: cluster 2020-06-27T05:00:09.932372+0000 mgr.x (mgr.34109) 613 : cluster [DBG] pgmap v705: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:10.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:10 smithi031 bash[22603]: cluster 2020-06-27T05:00:09.932372+0000 mgr.x (mgr.34109) 613 : cluster [DBG] pgmap v705: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:11.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:11 smithi051 bash[18409]: cluster 2020-06-27T05:00:10.535861+0000 mon.a (mon.0) 1433 : cluster [WRN] Health check update: Reduced data availability: 510 pgs inactive, 193 pgs down, 89 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T05:00:11.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:11 smithi031 bash[18426]: cluster 2020-06-27T05:00:10.535861+0000 mon.a (mon.0) 1433 : cluster [WRN] Health check update: Reduced data availability: 510 pgs inactive, 193 pgs down, 89 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T05:00:11.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:11 smithi031 bash[22603]: cluster 2020-06-27T05:00:10.535861+0000 mon.a (mon.0) 1433 : cluster [WRN] Health check update: Reduced data availability: 510 pgs inactive, 193 pgs down, 89 pgs peering, 132 pgs stale (PG_AVAILABILITY) 2020-06-27T05:00:12.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:12 smithi051 bash[18409]: cluster 2020-06-27T05:00:11.933978+0000 mgr.x (mgr.34109) 614 : cluster [DBG] pgmap v706: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:12 smithi031 bash[18426]: cluster 2020-06-27T05:00:11.933978+0000 mgr.x (mgr.34109) 614 : cluster [DBG] pgmap v706: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:12.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:12 smithi031 bash[22603]: cluster 2020-06-27T05:00:11.933978+0000 mgr.x (mgr.34109) 614 : cluster [DBG] pgmap v706: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:13.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:13 smithi051 bash[18409]: cluster 2020-06-27T05:00:12.548853+0000 mon.a (mon.0) 1434 : cluster [WRN] Health check update: Degraded data redundancy: 273/1116 objects degraded (24.462%), 72 pgs degraded, 268 pgs undersized (PG_DEGRADED) 2020-06-27T05:00:13.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:13 smithi031 bash[18426]: cluster 2020-06-27T05:00:12.548853+0000 mon.a (mon.0) 1434 : cluster [WRN] Health check update: Degraded data redundancy: 273/1116 objects degraded (24.462%), 72 pgs degraded, 268 pgs undersized (PG_DEGRADED) 2020-06-27T05:00:13.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:13 smithi031 bash[22603]: cluster 2020-06-27T05:00:12.548853+0000 mon.a (mon.0) 1434 : cluster [WRN] Health check update: Degraded data redundancy: 273/1116 objects degraded (24.462%), 72 pgs degraded, 268 pgs undersized (PG_DEGRADED) 2020-06-27T05:00:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:14 smithi051 bash[18409]: cluster 2020-06-27T05:00:13.935495+0000 mgr.x (mgr.34109) 615 : cluster [DBG] pgmap v707: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:14.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:14 smithi031 bash[18426]: cluster 2020-06-27T05:00:13.935495+0000 mgr.x (mgr.34109) 615 : cluster [DBG] pgmap v707: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:14 smithi031 bash[22603]: cluster 2020-06-27T05:00:13.935495+0000 mgr.x (mgr.34109) 615 : cluster [DBG] pgmap v707: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:16.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:16 smithi051 bash[18409]: cluster 2020-06-27T05:00:15.937037+0000 mgr.x (mgr.34109) 616 : cluster [DBG] pgmap v708: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:16.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:16 smithi031 bash[18426]: cluster 2020-06-27T05:00:15.937037+0000 mgr.x (mgr.34109) 616 : cluster [DBG] pgmap v708: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:16.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:16 smithi031 bash[22603]: cluster 2020-06-27T05:00:15.937037+0000 mgr.x (mgr.34109) 616 : cluster [DBG] pgmap v708: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:18.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:18 smithi051 bash[18409]: cluster 2020-06-27T05:00:17.938497+0000 mgr.x (mgr.34109) 617 : cluster [DBG] pgmap v709: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:18.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:18 smithi031 bash[18426]: cluster 2020-06-27T05:00:17.938497+0000 mgr.x (mgr.34109) 617 : cluster [DBG] pgmap v709: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:18.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:18 smithi031 bash[22603]: cluster 2020-06-27T05:00:17.938497+0000 mgr.x (mgr.34109) 617 : cluster [DBG] pgmap v709: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:19.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:19 smithi051 bash[18409]: cluster 2020-06-27T05:00:19.535674+0000 mon.a (mon.0) 1435 : cluster [WRN] Health check update: Reduced data availability: 577 pgs inactive, 193 pgs down, 164 pgs peering, 267 pgs stale (PG_AVAILABILITY) 2020-06-27T05:00:19.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:19 smithi031 bash[18426]: cluster 2020-06-27T05:00:19.535674+0000 mon.a (mon.0) 1435 : cluster [WRN] Health check update: Reduced data availability: 577 pgs inactive, 193 pgs down, 164 pgs peering, 267 pgs stale (PG_AVAILABILITY) 2020-06-27T05:00:19.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:19 smithi031 bash[22603]: cluster 2020-06-27T05:00:19.535674+0000 mon.a (mon.0) 1435 : cluster [WRN] Health check update: Reduced data availability: 577 pgs inactive, 193 pgs down, 164 pgs peering, 267 pgs stale (PG_AVAILABILITY) 2020-06-27T05:00:20.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:20 smithi051 bash[18409]: cluster 2020-06-27T05:00:19.940042+0000 mgr.x (mgr.34109) 618 : cluster [DBG] pgmap v710: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:20 smithi031 bash[18426]: cluster 2020-06-27T05:00:19.940042+0000 mgr.x (mgr.34109) 618 : cluster [DBG] pgmap v710: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:20.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:20 smithi031 bash[22603]: cluster 2020-06-27T05:00:19.940042+0000 mgr.x (mgr.34109) 618 : cluster [DBG] pgmap v710: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:22.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:22 smithi051 bash[18409]: cluster 2020-06-27T05:00:21.941614+0000 mgr.x (mgr.34109) 619 : cluster [DBG] pgmap v711: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:22.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:22 smithi031 bash[18426]: cluster 2020-06-27T05:00:21.941614+0000 mgr.x (mgr.34109) 619 : cluster [DBG] pgmap v711: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:22.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:22 smithi031 bash[22603]: cluster 2020-06-27T05:00:21.941614+0000 mgr.x (mgr.34109) 619 : cluster [DBG] pgmap v711: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:24.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:24 smithi051 bash[18409]: cluster 2020-06-27T05:00:23.943226+0000 mgr.x (mgr.34109) 620 : cluster [DBG] pgmap v712: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:24.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:24 smithi031 bash[22603]: cluster 2020-06-27T05:00:23.943226+0000 mgr.x (mgr.34109) 620 : cluster [DBG] pgmap v712: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:24.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:24 smithi031 bash[18426]: cluster 2020-06-27T05:00:23.943226+0000 mgr.x (mgr.34109) 620 : cluster [DBG] pgmap v712: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:26.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:26 smithi051 bash[18409]: cluster 2020-06-27T05:00:25.944947+0000 mgr.x (mgr.34109) 621 : cluster [DBG] pgmap v713: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:26.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:26 smithi031 bash[18426]: cluster 2020-06-27T05:00:25.944947+0000 mgr.x (mgr.34109) 621 : cluster [DBG] pgmap v713: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:26.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:26 smithi031 bash[22603]: cluster 2020-06-27T05:00:25.944947+0000 mgr.x (mgr.34109) 621 : cluster [DBG] pgmap v713: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:28.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:28 smithi051 bash[18409]: cluster 2020-06-27T05:00:27.946570+0000 mgr.x (mgr.34109) 622 : cluster [DBG] pgmap v714: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:28.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:28 smithi051 bash[18409]: cluster 2020-06-27T05:00:27.999505+0000 mon.a (mon.0) 1436 : cluster [WRN] Health check update: Reduced data availability: 586 pgs inactive, 193 pgs down, 164 pgs peering, 549 pgs stale (PG_AVAILABILITY) 2020-06-27T05:00:28.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:28 smithi051 bash[18409]: cluster 2020-06-27T05:00:27.999543+0000 mon.a (mon.0) 1437 : cluster [WRN] Health check update: Degraded data redundancy: 273/1116 objects degraded (24.462%), 72 pgs degraded, 388 pgs undersized (PG_DEGRADED) 2020-06-27T05:00:28.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:28 smithi031 bash[18426]: cluster 2020-06-27T05:00:27.946570+0000 mgr.x (mgr.34109) 622 : cluster [DBG] pgmap v714: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:28.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:28 smithi031 bash[18426]: cluster 2020-06-27T05:00:27.999505+0000 mon.a (mon.0) 1436 : cluster [WRN] Health check update: Reduced data availability: 586 pgs inactive, 193 pgs down, 164 pgs peering, 549 pgs stale (PG_AVAILABILITY) 2020-06-27T05:00:28.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:28 smithi031 bash[18426]: cluster 2020-06-27T05:00:27.999543+0000 mon.a (mon.0) 1437 : cluster [WRN] Health check update: Degraded data redundancy: 273/1116 objects degraded (24.462%), 72 pgs degraded, 388 pgs undersized (PG_DEGRADED) 2020-06-27T05:00:28.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:28 smithi031 bash[22603]: cluster 2020-06-27T05:00:27.946570+0000 mgr.x (mgr.34109) 622 : cluster [DBG] pgmap v714: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:28.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:28 smithi031 bash[22603]: cluster 2020-06-27T05:00:27.999505+0000 mon.a (mon.0) 1436 : cluster [WRN] Health check update: Reduced data availability: 586 pgs inactive, 193 pgs down, 164 pgs peering, 549 pgs stale (PG_AVAILABILITY) 2020-06-27T05:00:28.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:28 smithi031 bash[22603]: cluster 2020-06-27T05:00:27.999543+0000 mon.a (mon.0) 1437 : cluster [WRN] Health check update: Degraded data redundancy: 273/1116 objects degraded (24.462%), 72 pgs degraded, 388 pgs undersized (PG_DEGRADED) 2020-06-27T05:00:30.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:30 smithi051 bash[18409]: cluster 2020-06-27T05:00:29.948165+0000 mgr.x (mgr.34109) 623 : cluster [DBG] pgmap v715: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:30.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:30 smithi031 bash[18426]: cluster 2020-06-27T05:00:29.948165+0000 mgr.x (mgr.34109) 623 : cluster [DBG] pgmap v715: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:30.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:30 smithi031 bash[22603]: cluster 2020-06-27T05:00:29.948165+0000 mgr.x (mgr.34109) 623 : cluster [DBG] pgmap v715: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:32.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:32 smithi051 bash[18409]: cluster 2020-06-27T05:00:31.949926+0000 mgr.x (mgr.34109) 624 : cluster [DBG] pgmap v716: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:32.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:32 smithi031 bash[18426]: cluster 2020-06-27T05:00:31.949926+0000 mgr.x (mgr.34109) 624 : cluster [DBG] pgmap v716: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:32.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:32 smithi031 bash[22603]: cluster 2020-06-27T05:00:31.949926+0000 mgr.x (mgr.34109) 624 : cluster [DBG] pgmap v716: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:34.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:34 smithi051 bash[18409]: cluster 2020-06-27T05:00:33.951637+0000 mgr.x (mgr.34109) 625 : cluster [DBG] pgmap v717: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:34.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:34 smithi031 bash[18426]: cluster 2020-06-27T05:00:33.951637+0000 mgr.x (mgr.34109) 625 : cluster [DBG] pgmap v717: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:34.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:34 smithi031 bash[22603]: cluster 2020-06-27T05:00:33.951637+0000 mgr.x (mgr.34109) 625 : cluster [DBG] pgmap v717: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:35.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:35 smithi051 bash[18409]: cluster 2020-06-27T05:00:34.538308+0000 mon.a (mon.0) 1438 : cluster [WRN] Health check update: Reduced data availability: 586 pgs inactive, 193 pgs down, 164 pgs peering, 758 pgs stale (PG_AVAILABILITY) 2020-06-27T05:00:35.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:35 smithi031 bash[18426]: cluster 2020-06-27T05:00:34.538308+0000 mon.a (mon.0) 1438 : cluster [WRN] Health check update: Reduced data availability: 586 pgs inactive, 193 pgs down, 164 pgs peering, 758 pgs stale (PG_AVAILABILITY) 2020-06-27T05:00:35.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:35 smithi031 bash[22603]: cluster 2020-06-27T05:00:34.538308+0000 mon.a (mon.0) 1438 : cluster [WRN] Health check update: Reduced data availability: 586 pgs inactive, 193 pgs down, 164 pgs peering, 758 pgs stale (PG_AVAILABILITY) 2020-06-27T05:00:36.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:36 smithi051 bash[18409]: cluster 2020-06-27T05:00:35.953144+0000 mgr.x (mgr.34109) 626 : cluster [DBG] pgmap v718: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:36.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:36 smithi031 bash[18426]: cluster 2020-06-27T05:00:35.953144+0000 mgr.x (mgr.34109) 626 : cluster [DBG] pgmap v718: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:36.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:36 smithi031 bash[22603]: cluster 2020-06-27T05:00:35.953144+0000 mgr.x (mgr.34109) 626 : cluster [DBG] pgmap v718: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:38.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:38 smithi051 bash[18409]: cluster 2020-06-27T05:00:37.954908+0000 mgr.x (mgr.34109) 627 : cluster [DBG] pgmap v719: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:38.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:38 smithi031 bash[18426]: cluster 2020-06-27T05:00:37.954908+0000 mgr.x (mgr.34109) 627 : cluster [DBG] pgmap v719: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:38.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:38 smithi031 bash[22603]: cluster 2020-06-27T05:00:37.954908+0000 mgr.x (mgr.34109) 627 : cluster [DBG] pgmap v719: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:40.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:40 smithi051 bash[18409]: cluster 2020-06-27T05:00:39.956605+0000 mgr.x (mgr.34109) 628 : cluster [DBG] pgmap v720: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:40 smithi031 bash[18426]: cluster 2020-06-27T05:00:39.956605+0000 mgr.x (mgr.34109) 628 : cluster [DBG] pgmap v720: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:40.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:40 smithi031 bash[22603]: cluster 2020-06-27T05:00:39.956605+0000 mgr.x (mgr.34109) 628 : cluster [DBG] pgmap v720: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:42.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:42 smithi051 bash[18409]: cluster 2020-06-27T05:00:41.958298+0000 mgr.x (mgr.34109) 629 : cluster [DBG] pgmap v721: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:42.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:42 smithi031 bash[18426]: cluster 2020-06-27T05:00:41.958298+0000 mgr.x (mgr.34109) 629 : cluster [DBG] pgmap v721: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:42.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:42 smithi031 bash[22603]: cluster 2020-06-27T05:00:41.958298+0000 mgr.x (mgr.34109) 629 : cluster [DBG] pgmap v721: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:44.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:44 smithi051 bash[18409]: cluster 2020-06-27T05:00:43.959990+0000 mgr.x (mgr.34109) 630 : cluster [DBG] pgmap v722: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:44.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:44 smithi031 bash[18426]: cluster 2020-06-27T05:00:43.959990+0000 mgr.x (mgr.34109) 630 : cluster [DBG] pgmap v722: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:44.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:44 smithi031 bash[22603]: cluster 2020-06-27T05:00:43.959990+0000 mgr.x (mgr.34109) 630 : cluster [DBG] pgmap v722: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:46.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:46 smithi051 bash[18409]: cluster 2020-06-27T05:00:45.961639+0000 mgr.x (mgr.34109) 631 : cluster [DBG] pgmap v723: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:46.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:46 smithi031 bash[18426]: cluster 2020-06-27T05:00:45.961639+0000 mgr.x (mgr.34109) 631 : cluster [DBG] pgmap v723: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:46.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:46 smithi031 bash[22603]: cluster 2020-06-27T05:00:45.961639+0000 mgr.x (mgr.34109) 631 : cluster [DBG] pgmap v723: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:48.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:48 smithi051 bash[18409]: cluster 2020-06-27T05:00:47.963249+0000 mgr.x (mgr.34109) 632 : cluster [DBG] pgmap v724: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:48.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:48 smithi031 bash[18426]: cluster 2020-06-27T05:00:47.963249+0000 mgr.x (mgr.34109) 632 : cluster [DBG] pgmap v724: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:48.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:48 smithi031 bash[22603]: cluster 2020-06-27T05:00:47.963249+0000 mgr.x (mgr.34109) 632 : cluster [DBG] pgmap v724: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:50.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:50 smithi051 bash[18409]: cluster 2020-06-27T05:00:49.964874+0000 mgr.x (mgr.34109) 633 : cluster [DBG] pgmap v725: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:50.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:50 smithi031 bash[18426]: cluster 2020-06-27T05:00:49.964874+0000 mgr.x (mgr.34109) 633 : cluster [DBG] pgmap v725: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:50.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:50 smithi031 bash[22603]: cluster 2020-06-27T05:00:49.964874+0000 mgr.x (mgr.34109) 633 : cluster [DBG] pgmap v725: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:52.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:52 smithi051 bash[18409]: cluster 2020-06-27T05:00:51.966614+0000 mgr.x (mgr.34109) 634 : cluster [DBG] pgmap v726: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:52.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:52 smithi031 bash[18426]: cluster 2020-06-27T05:00:51.966614+0000 mgr.x (mgr.34109) 634 : cluster [DBG] pgmap v726: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:52.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:52 smithi031 bash[22603]: cluster 2020-06-27T05:00:51.966614+0000 mgr.x (mgr.34109) 634 : cluster [DBG] pgmap v726: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:54.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:54 smithi051 bash[18409]: cluster 2020-06-27T05:00:53.968158+0000 mgr.x (mgr.34109) 635 : cluster [DBG] pgmap v727: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:54.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:54 smithi031 bash[18426]: cluster 2020-06-27T05:00:53.968158+0000 mgr.x (mgr.34109) 635 : cluster [DBG] pgmap v727: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:54.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:54 smithi031 bash[22603]: cluster 2020-06-27T05:00:53.968158+0000 mgr.x (mgr.34109) 635 : cluster [DBG] pgmap v727: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:56.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:56 smithi051 bash[18409]: cluster 2020-06-27T05:00:55.969930+0000 mgr.x (mgr.34109) 636 : cluster [DBG] pgmap v728: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:56.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:56 smithi031 bash[18426]: cluster 2020-06-27T05:00:55.969930+0000 mgr.x (mgr.34109) 636 : cluster [DBG] pgmap v728: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:56.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:56 smithi031 bash[22603]: cluster 2020-06-27T05:00:55.969930+0000 mgr.x (mgr.34109) 636 : cluster [DBG] pgmap v728: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:58.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:00:58 smithi051 bash[18409]: cluster 2020-06-27T05:00:57.971553+0000 mgr.x (mgr.34109) 637 : cluster [DBG] pgmap v729: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:58.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:00:58 smithi031 bash[18426]: cluster 2020-06-27T05:00:57.971553+0000 mgr.x (mgr.34109) 637 : cluster [DBG] pgmap v729: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:00:58.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:00:58 smithi031 bash[22603]: cluster 2020-06-27T05:00:57.971553+0000 mgr.x (mgr.34109) 637 : cluster [DBG] pgmap v729: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:00.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:00 smithi051 bash[18409]: cluster 2020-06-27T05:00:59.973278+0000 mgr.x (mgr.34109) 638 : cluster [DBG] pgmap v730: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:00.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:00 smithi031 bash[18426]: cluster 2020-06-27T05:00:59.973278+0000 mgr.x (mgr.34109) 638 : cluster [DBG] pgmap v730: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:00.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:00 smithi031 bash[22603]: cluster 2020-06-27T05:00:59.973278+0000 mgr.x (mgr.34109) 638 : cluster [DBG] pgmap v730: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:02.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:02 smithi051 bash[18409]: cluster 2020-06-27T05:01:01.975012+0000 mgr.x (mgr.34109) 639 : cluster [DBG] pgmap v731: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:02.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:02 smithi031 bash[18426]: cluster 2020-06-27T05:01:01.975012+0000 mgr.x (mgr.34109) 639 : cluster [DBG] pgmap v731: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:02.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:02 smithi031 bash[22603]: cluster 2020-06-27T05:01:01.975012+0000 mgr.x (mgr.34109) 639 : cluster [DBG] pgmap v731: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:04.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:04 smithi051 bash[18409]: cluster 2020-06-27T05:01:03.976800+0000 mgr.x (mgr.34109) 640 : cluster [DBG] pgmap v732: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:04.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:04 smithi031 bash[18426]: cluster 2020-06-27T05:01:03.976800+0000 mgr.x (mgr.34109) 640 : cluster [DBG] pgmap v732: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:04.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:04 smithi031 bash[22603]: cluster 2020-06-27T05:01:03.976800+0000 mgr.x (mgr.34109) 640 : cluster [DBG] pgmap v732: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:06.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:06 smithi051 bash[18409]: cluster 2020-06-27T05:01:05.978610+0000 mgr.x (mgr.34109) 641 : cluster [DBG] pgmap v733: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:06.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:06 smithi031 bash[18426]: cluster 2020-06-27T05:01:05.978610+0000 mgr.x (mgr.34109) 641 : cluster [DBG] pgmap v733: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:06.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:06 smithi031 bash[22603]: cluster 2020-06-27T05:01:05.978610+0000 mgr.x (mgr.34109) 641 : cluster [DBG] pgmap v733: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:08.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:08 smithi051 bash[18409]: cluster 2020-06-27T05:01:07.980309+0000 mgr.x (mgr.34109) 642 : cluster [DBG] pgmap v734: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:08.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:08 smithi031 bash[18426]: cluster 2020-06-27T05:01:07.980309+0000 mgr.x (mgr.34109) 642 : cluster [DBG] pgmap v734: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:08.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:08 smithi031 bash[22603]: cluster 2020-06-27T05:01:07.980309+0000 mgr.x (mgr.34109) 642 : cluster [DBG] pgmap v734: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:10.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:10 smithi051 bash[18409]: cluster 2020-06-27T05:01:09.982019+0000 mgr.x (mgr.34109) 643 : cluster [DBG] pgmap v735: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:10.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:10 smithi031 bash[18426]: cluster 2020-06-27T05:01:09.982019+0000 mgr.x (mgr.34109) 643 : cluster [DBG] pgmap v735: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:10.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:10 smithi031 bash[22603]: cluster 2020-06-27T05:01:09.982019+0000 mgr.x (mgr.34109) 643 : cluster [DBG] pgmap v735: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:12.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:12 smithi051 bash[18409]: cluster 2020-06-27T05:01:11.983782+0000 mgr.x (mgr.34109) 644 : cluster [DBG] pgmap v736: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:12.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:12 smithi031 bash[18426]: cluster 2020-06-27T05:01:11.983782+0000 mgr.x (mgr.34109) 644 : cluster [DBG] pgmap v736: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:12.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:12 smithi031 bash[22603]: cluster 2020-06-27T05:01:11.983782+0000 mgr.x (mgr.34109) 644 : cluster [DBG] pgmap v736: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:14.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:14 smithi051 bash[18409]: cluster 2020-06-27T05:01:13.985404+0000 mgr.x (mgr.34109) 645 : cluster [DBG] pgmap v737: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:14.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:14 smithi031 bash[18426]: cluster 2020-06-27T05:01:13.985404+0000 mgr.x (mgr.34109) 645 : cluster [DBG] pgmap v737: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:14.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:14 smithi031 bash[22603]: cluster 2020-06-27T05:01:13.985404+0000 mgr.x (mgr.34109) 645 : cluster [DBG] pgmap v737: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:16.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:16 smithi051 bash[18409]: cluster 2020-06-27T05:01:15.986892+0000 mgr.x (mgr.34109) 646 : cluster [DBG] pgmap v738: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:16.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:16 smithi031 bash[18426]: cluster 2020-06-27T05:01:15.986892+0000 mgr.x (mgr.34109) 646 : cluster [DBG] pgmap v738: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:16.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:16 smithi031 bash[22603]: cluster 2020-06-27T05:01:15.986892+0000 mgr.x (mgr.34109) 646 : cluster [DBG] pgmap v738: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:18.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:18 smithi051 bash[18409]: cluster 2020-06-27T05:01:17.988460+0000 mgr.x (mgr.34109) 647 : cluster [DBG] pgmap v739: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:18.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:18 smithi031 bash[18426]: cluster 2020-06-27T05:01:17.988460+0000 mgr.x (mgr.34109) 647 : cluster [DBG] pgmap v739: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:18.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:18 smithi031 bash[22603]: cluster 2020-06-27T05:01:17.988460+0000 mgr.x (mgr.34109) 647 : cluster [DBG] pgmap v739: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:20.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:20 smithi051 bash[18409]: cluster 2020-06-27T05:01:19.990119+0000 mgr.x (mgr.34109) 648 : cluster [DBG] pgmap v740: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:20 smithi031 bash[18426]: cluster 2020-06-27T05:01:19.990119+0000 mgr.x (mgr.34109) 648 : cluster [DBG] pgmap v740: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:20.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:20 smithi031 bash[22603]: cluster 2020-06-27T05:01:19.990119+0000 mgr.x (mgr.34109) 648 : cluster [DBG] pgmap v740: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:22.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:22 smithi051 bash[18409]: cluster 2020-06-27T05:01:21.991827+0000 mgr.x (mgr.34109) 649 : cluster [DBG] pgmap v741: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:22.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:22 smithi031 bash[18426]: cluster 2020-06-27T05:01:21.991827+0000 mgr.x (mgr.34109) 649 : cluster [DBG] pgmap v741: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:22.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:22 smithi031 bash[22603]: cluster 2020-06-27T05:01:21.991827+0000 mgr.x (mgr.34109) 649 : cluster [DBG] pgmap v741: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:24.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:24 smithi051 bash[18409]: cluster 2020-06-27T05:01:23.993427+0000 mgr.x (mgr.34109) 650 : cluster [DBG] pgmap v742: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:24.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:24 smithi031 bash[18426]: cluster 2020-06-27T05:01:23.993427+0000 mgr.x (mgr.34109) 650 : cluster [DBG] pgmap v742: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:24.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:24 smithi031 bash[22603]: cluster 2020-06-27T05:01:23.993427+0000 mgr.x (mgr.34109) 650 : cluster [DBG] pgmap v742: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:26.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:26 smithi051 bash[18409]: cluster 2020-06-27T05:01:25.995146+0000 mgr.x (mgr.34109) 651 : cluster [DBG] pgmap v743: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:26.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:26 smithi031 bash[18426]: cluster 2020-06-27T05:01:25.995146+0000 mgr.x (mgr.34109) 651 : cluster [DBG] pgmap v743: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:26.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:26 smithi031 bash[22603]: cluster 2020-06-27T05:01:25.995146+0000 mgr.x (mgr.34109) 651 : cluster [DBG] pgmap v743: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:28.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:28 smithi051 bash[18409]: cluster 2020-06-27T05:01:27.996858+0000 mgr.x (mgr.34109) 652 : cluster [DBG] pgmap v744: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:28.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:28 smithi031 bash[18426]: cluster 2020-06-27T05:01:27.996858+0000 mgr.x (mgr.34109) 652 : cluster [DBG] pgmap v744: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:28.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:28 smithi031 bash[22603]: cluster 2020-06-27T05:01:27.996858+0000 mgr.x (mgr.34109) 652 : cluster [DBG] pgmap v744: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:30.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:30 smithi051 bash[18409]: cluster 2020-06-27T05:01:29.998457+0000 mgr.x (mgr.34109) 653 : cluster [DBG] pgmap v745: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:30.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:30 smithi031 bash[18426]: cluster 2020-06-27T05:01:29.998457+0000 mgr.x (mgr.34109) 653 : cluster [DBG] pgmap v745: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:30.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:30 smithi031 bash[22603]: cluster 2020-06-27T05:01:29.998457+0000 mgr.x (mgr.34109) 653 : cluster [DBG] pgmap v745: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:32.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:32 smithi051 bash[18409]: cluster 2020-06-27T05:01:32.000107+0000 mgr.x (mgr.34109) 654 : cluster [DBG] pgmap v746: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:32.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:32 smithi031 bash[18426]: cluster 2020-06-27T05:01:32.000107+0000 mgr.x (mgr.34109) 654 : cluster [DBG] pgmap v746: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:32.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:32 smithi031 bash[22603]: cluster 2020-06-27T05:01:32.000107+0000 mgr.x (mgr.34109) 654 : cluster [DBG] pgmap v746: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:35.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:35 smithi051 bash[18409]: cluster 2020-06-27T05:01:34.001900+0000 mgr.x (mgr.34109) 655 : cluster [DBG] pgmap v747: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:35.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:35 smithi031 bash[18426]: cluster 2020-06-27T05:01:34.001900+0000 mgr.x (mgr.34109) 655 : cluster [DBG] pgmap v747: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:35.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:35 smithi031 bash[22603]: cluster 2020-06-27T05:01:34.001900+0000 mgr.x (mgr.34109) 655 : cluster [DBG] pgmap v747: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:37.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:37 smithi051 bash[18409]: cluster 2020-06-27T05:01:36.003616+0000 mgr.x (mgr.34109) 656 : cluster [DBG] pgmap v748: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:37.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:37 smithi031 bash[22603]: cluster 2020-06-27T05:01:36.003616+0000 mgr.x (mgr.34109) 656 : cluster [DBG] pgmap v748: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:37.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:37 smithi031 bash[18426]: cluster 2020-06-27T05:01:36.003616+0000 mgr.x (mgr.34109) 656 : cluster [DBG] pgmap v748: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:39.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:39 smithi051 bash[18409]: cluster 2020-06-27T05:01:38.005253+0000 mgr.x (mgr.34109) 657 : cluster [DBG] pgmap v749: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:39.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:39 smithi031 bash[18426]: cluster 2020-06-27T05:01:38.005253+0000 mgr.x (mgr.34109) 657 : cluster [DBG] pgmap v749: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:39.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:39 smithi031 bash[22603]: cluster 2020-06-27T05:01:38.005253+0000 mgr.x (mgr.34109) 657 : cluster [DBG] pgmap v749: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:41.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:41 smithi051 bash[18409]: cluster 2020-06-27T05:01:40.006989+0000 mgr.x (mgr.34109) 658 : cluster [DBG] pgmap v750: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:41.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:41 smithi031 bash[22603]: cluster 2020-06-27T05:01:40.006989+0000 mgr.x (mgr.34109) 658 : cluster [DBG] pgmap v750: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:41.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:41 smithi031 bash[18426]: cluster 2020-06-27T05:01:40.006989+0000 mgr.x (mgr.34109) 658 : cluster [DBG] pgmap v750: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:43.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:43 smithi051 bash[18409]: cluster 2020-06-27T05:01:42.008698+0000 mgr.x (mgr.34109) 659 : cluster [DBG] pgmap v751: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:43.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:43 smithi031 bash[18426]: cluster 2020-06-27T05:01:42.008698+0000 mgr.x (mgr.34109) 659 : cluster [DBG] pgmap v751: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:43.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:43 smithi031 bash[22603]: cluster 2020-06-27T05:01:42.008698+0000 mgr.x (mgr.34109) 659 : cluster [DBG] pgmap v751: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:45.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:45 smithi051 bash[18409]: cluster 2020-06-27T05:01:44.010349+0000 mgr.x (mgr.34109) 660 : cluster [DBG] pgmap v752: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:45.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:45 smithi031 bash[18426]: cluster 2020-06-27T05:01:44.010349+0000 mgr.x (mgr.34109) 660 : cluster [DBG] pgmap v752: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:45.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:45 smithi031 bash[22603]: cluster 2020-06-27T05:01:44.010349+0000 mgr.x (mgr.34109) 660 : cluster [DBG] pgmap v752: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:47.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:47 smithi051 bash[18409]: cluster 2020-06-27T05:01:46.012036+0000 mgr.x (mgr.34109) 661 : cluster [DBG] pgmap v753: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:47.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:47 smithi031 bash[18426]: cluster 2020-06-27T05:01:46.012036+0000 mgr.x (mgr.34109) 661 : cluster [DBG] pgmap v753: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:47.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:47 smithi031 bash[22603]: cluster 2020-06-27T05:01:46.012036+0000 mgr.x (mgr.34109) 661 : cluster [DBG] pgmap v753: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:49.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:49 smithi051 bash[18409]: cluster 2020-06-27T05:01:48.013761+0000 mgr.x (mgr.34109) 662 : cluster [DBG] pgmap v754: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:49.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:49 smithi031 bash[18426]: cluster 2020-06-27T05:01:48.013761+0000 mgr.x (mgr.34109) 662 : cluster [DBG] pgmap v754: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:49.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:49 smithi031 bash[22603]: cluster 2020-06-27T05:01:48.013761+0000 mgr.x (mgr.34109) 662 : cluster [DBG] pgmap v754: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:51.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:51 smithi051 bash[18409]: cluster 2020-06-27T05:01:50.015466+0000 mgr.x (mgr.34109) 663 : cluster [DBG] pgmap v755: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:51.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:51 smithi031 bash[18426]: cluster 2020-06-27T05:01:50.015466+0000 mgr.x (mgr.34109) 663 : cluster [DBG] pgmap v755: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:51.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:51 smithi031 bash[22603]: cluster 2020-06-27T05:01:50.015466+0000 mgr.x (mgr.34109) 663 : cluster [DBG] pgmap v755: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:53.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:53 smithi051 bash[18409]: cluster 2020-06-27T05:01:52.017112+0000 mgr.x (mgr.34109) 664 : cluster [DBG] pgmap v756: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:53.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:53 smithi031 bash[18426]: cluster 2020-06-27T05:01:52.017112+0000 mgr.x (mgr.34109) 664 : cluster [DBG] pgmap v756: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:53.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:53 smithi031 bash[22603]: cluster 2020-06-27T05:01:52.017112+0000 mgr.x (mgr.34109) 664 : cluster [DBG] pgmap v756: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:55.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:55 smithi051 bash[18409]: cluster 2020-06-27T05:01:54.018753+0000 mgr.x (mgr.34109) 665 : cluster [DBG] pgmap v757: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:55.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:55 smithi031 bash[18426]: cluster 2020-06-27T05:01:54.018753+0000 mgr.x (mgr.34109) 665 : cluster [DBG] pgmap v757: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:55.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:55 smithi031 bash[22603]: cluster 2020-06-27T05:01:54.018753+0000 mgr.x (mgr.34109) 665 : cluster [DBG] pgmap v757: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:57.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:57 smithi051 bash[18409]: cluster 2020-06-27T05:01:56.020323+0000 mgr.x (mgr.34109) 666 : cluster [DBG] pgmap v758: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:57.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:57 smithi031 bash[18426]: cluster 2020-06-27T05:01:56.020323+0000 mgr.x (mgr.34109) 666 : cluster [DBG] pgmap v758: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:57.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:57 smithi031 bash[22603]: cluster 2020-06-27T05:01:56.020323+0000 mgr.x (mgr.34109) 666 : cluster [DBG] pgmap v758: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:59.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:01:59 smithi051 bash[18409]: cluster 2020-06-27T05:01:58.021921+0000 mgr.x (mgr.34109) 667 : cluster [DBG] pgmap v759: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:59.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:01:59 smithi031 bash[18426]: cluster 2020-06-27T05:01:58.021921+0000 mgr.x (mgr.34109) 667 : cluster [DBG] pgmap v759: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:01:59.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:01:59 smithi031 bash[22603]: cluster 2020-06-27T05:01:58.021921+0000 mgr.x (mgr.34109) 667 : cluster [DBG] pgmap v759: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:01.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:01 smithi051 bash[18409]: cluster 2020-06-27T05:02:00.023589+0000 mgr.x (mgr.34109) 668 : cluster [DBG] pgmap v760: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:01.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:01 smithi031 bash[18426]: cluster 2020-06-27T05:02:00.023589+0000 mgr.x (mgr.34109) 668 : cluster [DBG] pgmap v760: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:01.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:01 smithi031 bash[22603]: cluster 2020-06-27T05:02:00.023589+0000 mgr.x (mgr.34109) 668 : cluster [DBG] pgmap v760: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:03.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:03 smithi051 bash[18409]: cluster 2020-06-27T05:02:02.025174+0000 mgr.x (mgr.34109) 669 : cluster [DBG] pgmap v761: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:03.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:03 smithi031 bash[18426]: cluster 2020-06-27T05:02:02.025174+0000 mgr.x (mgr.34109) 669 : cluster [DBG] pgmap v761: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:03.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:03 smithi031 bash[22603]: cluster 2020-06-27T05:02:02.025174+0000 mgr.x (mgr.34109) 669 : cluster [DBG] pgmap v761: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:05.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:05 smithi051 bash[18409]: cluster 2020-06-27T05:02:04.026925+0000 mgr.x (mgr.34109) 670 : cluster [DBG] pgmap v762: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:05.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:05 smithi031 bash[18426]: cluster 2020-06-27T05:02:04.026925+0000 mgr.x (mgr.34109) 670 : cluster [DBG] pgmap v762: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:05.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:05 smithi031 bash[22603]: cluster 2020-06-27T05:02:04.026925+0000 mgr.x (mgr.34109) 670 : cluster [DBG] pgmap v762: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:07.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:07 smithi051 bash[18409]: cluster 2020-06-27T05:02:06.028514+0000 mgr.x (mgr.34109) 671 : cluster [DBG] pgmap v763: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:07.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:07 smithi031 bash[18426]: cluster 2020-06-27T05:02:06.028514+0000 mgr.x (mgr.34109) 671 : cluster [DBG] pgmap v763: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:07.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:07 smithi031 bash[22603]: cluster 2020-06-27T05:02:06.028514+0000 mgr.x (mgr.34109) 671 : cluster [DBG] pgmap v763: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:09.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:09 smithi051 bash[18409]: cluster 2020-06-27T05:02:08.030236+0000 mgr.x (mgr.34109) 672 : cluster [DBG] pgmap v764: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:09.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:09 smithi031 bash[18426]: cluster 2020-06-27T05:02:08.030236+0000 mgr.x (mgr.34109) 672 : cluster [DBG] pgmap v764: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:09.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:09 smithi031 bash[22603]: cluster 2020-06-27T05:02:08.030236+0000 mgr.x (mgr.34109) 672 : cluster [DBG] pgmap v764: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:11.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:11 smithi051 bash[18409]: cluster 2020-06-27T05:02:10.031980+0000 mgr.x (mgr.34109) 673 : cluster [DBG] pgmap v765: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:11.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:11 smithi031 bash[18426]: cluster 2020-06-27T05:02:10.031980+0000 mgr.x (mgr.34109) 673 : cluster [DBG] pgmap v765: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:11.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:11 smithi031 bash[22603]: cluster 2020-06-27T05:02:10.031980+0000 mgr.x (mgr.34109) 673 : cluster [DBG] pgmap v765: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:13.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:13 smithi051 bash[18409]: cluster 2020-06-27T05:02:12.033759+0000 mgr.x (mgr.34109) 674 : cluster [DBG] pgmap v766: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:13.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:13 smithi031 bash[18426]: cluster 2020-06-27T05:02:12.033759+0000 mgr.x (mgr.34109) 674 : cluster [DBG] pgmap v766: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:13.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:13 smithi031 bash[22603]: cluster 2020-06-27T05:02:12.033759+0000 mgr.x (mgr.34109) 674 : cluster [DBG] pgmap v766: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:15.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:15 smithi051 bash[18409]: cluster 2020-06-27T05:02:14.035457+0000 mgr.x (mgr.34109) 675 : cluster [DBG] pgmap v767: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:15.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:15 smithi031 bash[18426]: cluster 2020-06-27T05:02:14.035457+0000 mgr.x (mgr.34109) 675 : cluster [DBG] pgmap v767: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:15.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:15 smithi031 bash[22603]: cluster 2020-06-27T05:02:14.035457+0000 mgr.x (mgr.34109) 675 : cluster [DBG] pgmap v767: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:17.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:17 smithi051 bash[18409]: cluster 2020-06-27T05:02:16.037084+0000 mgr.x (mgr.34109) 676 : cluster [DBG] pgmap v768: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:17.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:17 smithi031 bash[18426]: cluster 2020-06-27T05:02:16.037084+0000 mgr.x (mgr.34109) 676 : cluster [DBG] pgmap v768: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:17.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:17 smithi031 bash[22603]: cluster 2020-06-27T05:02:16.037084+0000 mgr.x (mgr.34109) 676 : cluster [DBG] pgmap v768: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:19.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:19 smithi051 bash[18409]: cluster 2020-06-27T05:02:18.038643+0000 mgr.x (mgr.34109) 677 : cluster [DBG] pgmap v769: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:19.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:19 smithi031 bash[22603]: cluster 2020-06-27T05:02:18.038643+0000 mgr.x (mgr.34109) 677 : cluster [DBG] pgmap v769: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:19.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:19 smithi031 bash[18426]: cluster 2020-06-27T05:02:18.038643+0000 mgr.x (mgr.34109) 677 : cluster [DBG] pgmap v769: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:21.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:21 smithi051 bash[18409]: cluster 2020-06-27T05:02:20.040239+0000 mgr.x (mgr.34109) 678 : cluster [DBG] pgmap v770: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:21.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:21 smithi031 bash[18426]: cluster 2020-06-27T05:02:20.040239+0000 mgr.x (mgr.34109) 678 : cluster [DBG] pgmap v770: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:21.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:21 smithi031 bash[22603]: cluster 2020-06-27T05:02:20.040239+0000 mgr.x (mgr.34109) 678 : cluster [DBG] pgmap v770: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:23.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:23 smithi051 bash[18409]: cluster 2020-06-27T05:02:22.041839+0000 mgr.x (mgr.34109) 679 : cluster [DBG] pgmap v771: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:23.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:23 smithi031 bash[22603]: cluster 2020-06-27T05:02:22.041839+0000 mgr.x (mgr.34109) 679 : cluster [DBG] pgmap v771: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:23.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:23 smithi031 bash[18426]: cluster 2020-06-27T05:02:22.041839+0000 mgr.x (mgr.34109) 679 : cluster [DBG] pgmap v771: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:25.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:25 smithi051 bash[18409]: cluster 2020-06-27T05:02:24.043505+0000 mgr.x (mgr.34109) 680 : cluster [DBG] pgmap v772: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:25.972 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:25 smithi031 bash[22603]: cluster 2020-06-27T05:02:24.043505+0000 mgr.x (mgr.34109) 680 : cluster [DBG] pgmap v772: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:25.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:25 smithi031 bash[18426]: cluster 2020-06-27T05:02:24.043505+0000 mgr.x (mgr.34109) 680 : cluster [DBG] pgmap v772: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:27.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:27 smithi051 bash[18409]: cluster 2020-06-27T05:02:26.045287+0000 mgr.x (mgr.34109) 681 : cluster [DBG] pgmap v773: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:27.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:27 smithi031 bash[22603]: cluster 2020-06-27T05:02:26.045287+0000 mgr.x (mgr.34109) 681 : cluster [DBG] pgmap v773: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:27.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:27 smithi031 bash[18426]: cluster 2020-06-27T05:02:26.045287+0000 mgr.x (mgr.34109) 681 : cluster [DBG] pgmap v773: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:29.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:29 smithi051 bash[18409]: cluster 2020-06-27T05:02:28.046968+0000 mgr.x (mgr.34109) 682 : cluster [DBG] pgmap v774: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:29.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:29 smithi031 bash[18426]: cluster 2020-06-27T05:02:28.046968+0000 mgr.x (mgr.34109) 682 : cluster [DBG] pgmap v774: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:29.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:29 smithi031 bash[22603]: cluster 2020-06-27T05:02:28.046968+0000 mgr.x (mgr.34109) 682 : cluster [DBG] pgmap v774: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:31.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:31 smithi051 bash[18409]: cluster 2020-06-27T05:02:30.048738+0000 mgr.x (mgr.34109) 683 : cluster [DBG] pgmap v775: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:31.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:31 smithi031 bash[18426]: cluster 2020-06-27T05:02:30.048738+0000 mgr.x (mgr.34109) 683 : cluster [DBG] pgmap v775: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:31.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:31 smithi031 bash[22603]: cluster 2020-06-27T05:02:30.048738+0000 mgr.x (mgr.34109) 683 : cluster [DBG] pgmap v775: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:33.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:33 smithi051 bash[18409]: cluster 2020-06-27T05:02:32.050390+0000 mgr.x (mgr.34109) 684 : cluster [DBG] pgmap v776: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:33.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:33 smithi031 bash[18426]: cluster 2020-06-27T05:02:32.050390+0000 mgr.x (mgr.34109) 684 : cluster [DBG] pgmap v776: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:33.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:33 smithi031 bash[22603]: cluster 2020-06-27T05:02:32.050390+0000 mgr.x (mgr.34109) 684 : cluster [DBG] pgmap v776: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:35.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:35 smithi031 bash[18426]: cluster 2020-06-27T05:02:34.052102+0000 mgr.x (mgr.34109) 685 : cluster [DBG] pgmap v777: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:35.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:35 smithi031 bash[22603]: cluster 2020-06-27T05:02:34.052102+0000 mgr.x (mgr.34109) 685 : cluster [DBG] pgmap v777: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:35 smithi051 bash[18409]: cluster 2020-06-27T05:02:34.052102+0000 mgr.x (mgr.34109) 685 : cluster [DBG] pgmap v777: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:38.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:37 smithi051 bash[18409]: cluster 2020-06-27T05:02:36.053785+0000 mgr.x (mgr.34109) 686 : cluster [DBG] pgmap v778: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:38.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:37 smithi031 bash[18426]: cluster 2020-06-27T05:02:36.053785+0000 mgr.x (mgr.34109) 686 : cluster [DBG] pgmap v778: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:38.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:37 smithi031 bash[22603]: cluster 2020-06-27T05:02:36.053785+0000 mgr.x (mgr.34109) 686 : cluster [DBG] pgmap v778: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:40.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:39 smithi051 bash[18409]: cluster 2020-06-27T05:02:38.055459+0000 mgr.x (mgr.34109) 687 : cluster [DBG] pgmap v779: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:40.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:39 smithi031 bash[18426]: cluster 2020-06-27T05:02:38.055459+0000 mgr.x (mgr.34109) 687 : cluster [DBG] pgmap v779: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:40.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:39 smithi031 bash[22603]: cluster 2020-06-27T05:02:38.055459+0000 mgr.x (mgr.34109) 687 : cluster [DBG] pgmap v779: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:42.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:41 smithi051 bash[18409]: cluster 2020-06-27T05:02:40.057182+0000 mgr.x (mgr.34109) 688 : cluster [DBG] pgmap v780: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:42.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:41 smithi031 bash[18426]: cluster 2020-06-27T05:02:40.057182+0000 mgr.x (mgr.34109) 688 : cluster [DBG] pgmap v780: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:42.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:41 smithi031 bash[22603]: cluster 2020-06-27T05:02:40.057182+0000 mgr.x (mgr.34109) 688 : cluster [DBG] pgmap v780: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:44.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:43 smithi051 bash[18409]: cluster 2020-06-27T05:02:42.058696+0000 mgr.x (mgr.34109) 689 : cluster [DBG] pgmap v781: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:44.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:43 smithi031 bash[18426]: cluster 2020-06-27T05:02:42.058696+0000 mgr.x (mgr.34109) 689 : cluster [DBG] pgmap v781: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:44.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:43 smithi031 bash[22603]: cluster 2020-06-27T05:02:42.058696+0000 mgr.x (mgr.34109) 689 : cluster [DBG] pgmap v781: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:46.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:45 smithi051 bash[18409]: cluster 2020-06-27T05:02:44.060294+0000 mgr.x (mgr.34109) 690 : cluster [DBG] pgmap v782: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:46.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:45 smithi031 bash[18426]: cluster 2020-06-27T05:02:44.060294+0000 mgr.x (mgr.34109) 690 : cluster [DBG] pgmap v782: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:46.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:45 smithi031 bash[22603]: cluster 2020-06-27T05:02:44.060294+0000 mgr.x (mgr.34109) 690 : cluster [DBG] pgmap v782: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:48.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:47 smithi051 bash[18409]: cluster 2020-06-27T05:02:46.061907+0000 mgr.x (mgr.34109) 691 : cluster [DBG] pgmap v783: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:48.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:47 smithi031 bash[18426]: cluster 2020-06-27T05:02:46.061907+0000 mgr.x (mgr.34109) 691 : cluster [DBG] pgmap v783: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:48.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:47 smithi031 bash[22603]: cluster 2020-06-27T05:02:46.061907+0000 mgr.x (mgr.34109) 691 : cluster [DBG] pgmap v783: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:50.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:49 smithi051 bash[18409]: cluster 2020-06-27T05:02:48.063608+0000 mgr.x (mgr.34109) 692 : cluster [DBG] pgmap v784: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:50.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:49 smithi031 bash[22603]: cluster 2020-06-27T05:02:48.063608+0000 mgr.x (mgr.34109) 692 : cluster [DBG] pgmap v784: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:50.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:49 smithi031 bash[18426]: cluster 2020-06-27T05:02:48.063608+0000 mgr.x (mgr.34109) 692 : cluster [DBG] pgmap v784: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:52.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:51 smithi051 bash[18409]: cluster 2020-06-27T05:02:50.065299+0000 mgr.x (mgr.34109) 693 : cluster [DBG] pgmap v785: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:52.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:51 smithi031 bash[18426]: cluster 2020-06-27T05:02:50.065299+0000 mgr.x (mgr.34109) 693 : cluster [DBG] pgmap v785: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:52.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:51 smithi031 bash[22603]: cluster 2020-06-27T05:02:50.065299+0000 mgr.x (mgr.34109) 693 : cluster [DBG] pgmap v785: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:54.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:53 smithi051 bash[18409]: cluster 2020-06-27T05:02:52.066935+0000 mgr.x (mgr.34109) 694 : cluster [DBG] pgmap v786: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:54.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:53 smithi031 bash[22603]: cluster 2020-06-27T05:02:52.066935+0000 mgr.x (mgr.34109) 694 : cluster [DBG] pgmap v786: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:54.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:53 smithi031 bash[18426]: cluster 2020-06-27T05:02:52.066935+0000 mgr.x (mgr.34109) 694 : cluster [DBG] pgmap v786: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:55 smithi051 bash[18409]: cluster 2020-06-27T05:02:54.068613+0000 mgr.x (mgr.34109) 695 : cluster [DBG] pgmap v787: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:56.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:55 smithi031 bash[22603]: cluster 2020-06-27T05:02:54.068613+0000 mgr.x (mgr.34109) 695 : cluster [DBG] pgmap v787: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:55 smithi031 bash[18426]: cluster 2020-06-27T05:02:54.068613+0000 mgr.x (mgr.34109) 695 : cluster [DBG] pgmap v787: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:58.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:57 smithi051 bash[18409]: cluster 2020-06-27T05:02:56.070191+0000 mgr.x (mgr.34109) 696 : cluster [DBG] pgmap v788: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:58.222 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:57 smithi031 bash[22603]: cluster 2020-06-27T05:02:56.070191+0000 mgr.x (mgr.34109) 696 : cluster [DBG] pgmap v788: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:02:58.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:57 smithi031 bash[18426]: cluster 2020-06-27T05:02:56.070191+0000 mgr.x (mgr.34109) 696 : cluster [DBG] pgmap v788: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:00.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:02:59 smithi051 bash[18409]: cluster 2020-06-27T05:02:58.071837+0000 mgr.x (mgr.34109) 697 : cluster [DBG] pgmap v789: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:00.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:02:59 smithi031 bash[18426]: cluster 2020-06-27T05:02:58.071837+0000 mgr.x (mgr.34109) 697 : cluster [DBG] pgmap v789: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:00.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:02:59 smithi031 bash[22603]: cluster 2020-06-27T05:02:58.071837+0000 mgr.x (mgr.34109) 697 : cluster [DBG] pgmap v789: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:02.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:01 smithi051 bash[18409]: cluster 2020-06-27T05:03:00.073563+0000 mgr.x (mgr.34109) 698 : cluster [DBG] pgmap v790: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:02.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:01 smithi031 bash[18426]: cluster 2020-06-27T05:03:00.073563+0000 mgr.x (mgr.34109) 698 : cluster [DBG] pgmap v790: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:02.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:01 smithi031 bash[22603]: cluster 2020-06-27T05:03:00.073563+0000 mgr.x (mgr.34109) 698 : cluster [DBG] pgmap v790: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:04.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:03 smithi051 bash[18409]: cluster 2020-06-27T05:03:02.075353+0000 mgr.x (mgr.34109) 699 : cluster [DBG] pgmap v791: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:04.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:03 smithi031 bash[18426]: cluster 2020-06-27T05:03:02.075353+0000 mgr.x (mgr.34109) 699 : cluster [DBG] pgmap v791: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:04.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:03 smithi031 bash[22603]: cluster 2020-06-27T05:03:02.075353+0000 mgr.x (mgr.34109) 699 : cluster [DBG] pgmap v791: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:05 smithi051 bash[18409]: cluster 2020-06-27T05:03:04.077015+0000 mgr.x (mgr.34109) 700 : cluster [DBG] pgmap v792: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:06.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:05 smithi031 bash[22603]: cluster 2020-06-27T05:03:04.077015+0000 mgr.x (mgr.34109) 700 : cluster [DBG] pgmap v792: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:06.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:05 smithi031 bash[18426]: cluster 2020-06-27T05:03:04.077015+0000 mgr.x (mgr.34109) 700 : cluster [DBG] pgmap v792: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:08.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:07 smithi051 bash[18409]: cluster 2020-06-27T05:03:06.078865+0000 mgr.x (mgr.34109) 701 : cluster [DBG] pgmap v793: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:08.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:07 smithi031 bash[18426]: cluster 2020-06-27T05:03:06.078865+0000 mgr.x (mgr.34109) 701 : cluster [DBG] pgmap v793: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:08.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:07 smithi031 bash[22603]: cluster 2020-06-27T05:03:06.078865+0000 mgr.x (mgr.34109) 701 : cluster [DBG] pgmap v793: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:10.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:09 smithi051 bash[18409]: cluster 2020-06-27T05:03:08.080501+0000 mgr.x (mgr.34109) 702 : cluster [DBG] pgmap v794: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:10.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:09 smithi031 bash[18426]: cluster 2020-06-27T05:03:08.080501+0000 mgr.x (mgr.34109) 702 : cluster [DBG] pgmap v794: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:10.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:09 smithi031 bash[22603]: cluster 2020-06-27T05:03:08.080501+0000 mgr.x (mgr.34109) 702 : cluster [DBG] pgmap v794: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:12.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:11 smithi051 bash[18409]: cluster 2020-06-27T05:03:10.082236+0000 mgr.x (mgr.34109) 703 : cluster [DBG] pgmap v795: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:12.222 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:11 smithi031 bash[18426]: cluster 2020-06-27T05:03:10.082236+0000 mgr.x (mgr.34109) 703 : cluster [DBG] pgmap v795: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:12.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:11 smithi031 bash[22603]: cluster 2020-06-27T05:03:10.082236+0000 mgr.x (mgr.34109) 703 : cluster [DBG] pgmap v795: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:14.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:13 smithi051 bash[18409]: cluster 2020-06-27T05:03:12.083883+0000 mgr.x (mgr.34109) 704 : cluster [DBG] pgmap v796: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:14.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:13 smithi031 bash[22603]: cluster 2020-06-27T05:03:12.083883+0000 mgr.x (mgr.34109) 704 : cluster [DBG] pgmap v796: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:14.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:13 smithi031 bash[18426]: cluster 2020-06-27T05:03:12.083883+0000 mgr.x (mgr.34109) 704 : cluster [DBG] pgmap v796: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:15 smithi051 bash[18409]: cluster 2020-06-27T05:03:14.085602+0000 mgr.x (mgr.34109) 705 : cluster [DBG] pgmap v797: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:16.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:15 smithi031 bash[22603]: cluster 2020-06-27T05:03:14.085602+0000 mgr.x (mgr.34109) 705 : cluster [DBG] pgmap v797: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:15 smithi031 bash[18426]: cluster 2020-06-27T05:03:14.085602+0000 mgr.x (mgr.34109) 705 : cluster [DBG] pgmap v797: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:18.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:17 smithi051 bash[18409]: cluster 2020-06-27T05:03:16.087155+0000 mgr.x (mgr.34109) 706 : cluster [DBG] pgmap v798: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:18.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:17 smithi031 bash[22603]: cluster 2020-06-27T05:03:16.087155+0000 mgr.x (mgr.34109) 706 : cluster [DBG] pgmap v798: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:18.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:17 smithi031 bash[18426]: cluster 2020-06-27T05:03:16.087155+0000 mgr.x (mgr.34109) 706 : cluster [DBG] pgmap v798: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:20.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:19 smithi051 bash[18409]: cluster 2020-06-27T05:03:18.088806+0000 mgr.x (mgr.34109) 707 : cluster [DBG] pgmap v799: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:20.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:19 smithi031 bash[22603]: cluster 2020-06-27T05:03:18.088806+0000 mgr.x (mgr.34109) 707 : cluster [DBG] pgmap v799: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:20.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:19 smithi031 bash[18426]: cluster 2020-06-27T05:03:18.088806+0000 mgr.x (mgr.34109) 707 : cluster [DBG] pgmap v799: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:22.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:21 smithi051 bash[18409]: cluster 2020-06-27T05:03:20.090361+0000 mgr.x (mgr.34109) 708 : cluster [DBG] pgmap v800: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:22.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:21 smithi031 bash[22603]: cluster 2020-06-27T05:03:20.090361+0000 mgr.x (mgr.34109) 708 : cluster [DBG] pgmap v800: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:22.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:21 smithi031 bash[18426]: cluster 2020-06-27T05:03:20.090361+0000 mgr.x (mgr.34109) 708 : cluster [DBG] pgmap v800: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:24.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:23 smithi051 bash[18409]: cluster 2020-06-27T05:03:22.091993+0000 mgr.x (mgr.34109) 709 : cluster [DBG] pgmap v801: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:24.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:23 smithi031 bash[22603]: cluster 2020-06-27T05:03:22.091993+0000 mgr.x (mgr.34109) 709 : cluster [DBG] pgmap v801: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:24.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:23 smithi031 bash[18426]: cluster 2020-06-27T05:03:22.091993+0000 mgr.x (mgr.34109) 709 : cluster [DBG] pgmap v801: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:26.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:25 smithi051 bash[18409]: cluster 2020-06-27T05:03:24.093592+0000 mgr.x (mgr.34109) 710 : cluster [DBG] pgmap v802: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:25 smithi031 bash[22603]: cluster 2020-06-27T05:03:24.093592+0000 mgr.x (mgr.34109) 710 : cluster [DBG] pgmap v802: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:25 smithi031 bash[18426]: cluster 2020-06-27T05:03:24.093592+0000 mgr.x (mgr.34109) 710 : cluster [DBG] pgmap v802: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:28.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:27 smithi051 bash[18409]: cluster 2020-06-27T05:03:26.095212+0000 mgr.x (mgr.34109) 711 : cluster [DBG] pgmap v803: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:28.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:27 smithi031 bash[22603]: cluster 2020-06-27T05:03:26.095212+0000 mgr.x (mgr.34109) 711 : cluster [DBG] pgmap v803: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:28.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:27 smithi031 bash[18426]: cluster 2020-06-27T05:03:26.095212+0000 mgr.x (mgr.34109) 711 : cluster [DBG] pgmap v803: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:30.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:29 smithi051 bash[18409]: cluster 2020-06-27T05:03:28.096828+0000 mgr.x (mgr.34109) 712 : cluster [DBG] pgmap v804: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:30.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:29 smithi031 bash[22603]: cluster 2020-06-27T05:03:28.096828+0000 mgr.x (mgr.34109) 712 : cluster [DBG] pgmap v804: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:30.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:29 smithi031 bash[18426]: cluster 2020-06-27T05:03:28.096828+0000 mgr.x (mgr.34109) 712 : cluster [DBG] pgmap v804: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:32.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:31 smithi051 bash[18409]: cluster 2020-06-27T05:03:30.098394+0000 mgr.x (mgr.34109) 713 : cluster [DBG] pgmap v805: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:32.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:31 smithi031 bash[22603]: cluster 2020-06-27T05:03:30.098394+0000 mgr.x (mgr.34109) 713 : cluster [DBG] pgmap v805: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:32.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:31 smithi031 bash[18426]: cluster 2020-06-27T05:03:30.098394+0000 mgr.x (mgr.34109) 713 : cluster [DBG] pgmap v805: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:34.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:33 smithi051 bash[18409]: cluster 2020-06-27T05:03:32.100048+0000 mgr.x (mgr.34109) 714 : cluster [DBG] pgmap v806: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:34.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:33 smithi031 bash[22603]: cluster 2020-06-27T05:03:32.100048+0000 mgr.x (mgr.34109) 714 : cluster [DBG] pgmap v806: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:34.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:33 smithi031 bash[18426]: cluster 2020-06-27T05:03:32.100048+0000 mgr.x (mgr.34109) 714 : cluster [DBG] pgmap v806: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:35 smithi051 bash[18409]: cluster 2020-06-27T05:03:34.101644+0000 mgr.x (mgr.34109) 715 : cluster [DBG] pgmap v807: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:36.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:35 smithi031 bash[18426]: cluster 2020-06-27T05:03:34.101644+0000 mgr.x (mgr.34109) 715 : cluster [DBG] pgmap v807: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:36.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:35 smithi031 bash[22603]: cluster 2020-06-27T05:03:34.101644+0000 mgr.x (mgr.34109) 715 : cluster [DBG] pgmap v807: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:38.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:37 smithi051 bash[18409]: cluster 2020-06-27T05:03:36.103329+0000 mgr.x (mgr.34109) 716 : cluster [DBG] pgmap v808: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:38.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:37 smithi031 bash[18426]: cluster 2020-06-27T05:03:36.103329+0000 mgr.x (mgr.34109) 716 : cluster [DBG] pgmap v808: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:38.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:37 smithi031 bash[22603]: cluster 2020-06-27T05:03:36.103329+0000 mgr.x (mgr.34109) 716 : cluster [DBG] pgmap v808: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:40.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:39 smithi051 bash[18409]: cluster 2020-06-27T05:03:38.105038+0000 mgr.x (mgr.34109) 717 : cluster [DBG] pgmap v809: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:40.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:39 smithi031 bash[18426]: cluster 2020-06-27T05:03:38.105038+0000 mgr.x (mgr.34109) 717 : cluster [DBG] pgmap v809: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:40.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:39 smithi031 bash[22603]: cluster 2020-06-27T05:03:38.105038+0000 mgr.x (mgr.34109) 717 : cluster [DBG] pgmap v809: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:42.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:41 smithi051 bash[18409]: cluster 2020-06-27T05:03:40.106630+0000 mgr.x (mgr.34109) 718 : cluster [DBG] pgmap v810: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:42.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:41 smithi031 bash[18426]: cluster 2020-06-27T05:03:40.106630+0000 mgr.x (mgr.34109) 718 : cluster [DBG] pgmap v810: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:42.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:41 smithi031 bash[22603]: cluster 2020-06-27T05:03:40.106630+0000 mgr.x (mgr.34109) 718 : cluster [DBG] pgmap v810: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:44.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:43 smithi051 bash[18409]: cluster 2020-06-27T05:03:42.108334+0000 mgr.x (mgr.34109) 719 : cluster [DBG] pgmap v811: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:44.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:43 smithi031 bash[18426]: cluster 2020-06-27T05:03:42.108334+0000 mgr.x (mgr.34109) 719 : cluster [DBG] pgmap v811: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:44.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:43 smithi031 bash[22603]: cluster 2020-06-27T05:03:42.108334+0000 mgr.x (mgr.34109) 719 : cluster [DBG] pgmap v811: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:46.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:45 smithi051 bash[18409]: cluster 2020-06-27T05:03:44.110044+0000 mgr.x (mgr.34109) 720 : cluster [DBG] pgmap v812: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:46.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:45 smithi031 bash[18426]: cluster 2020-06-27T05:03:44.110044+0000 mgr.x (mgr.34109) 720 : cluster [DBG] pgmap v812: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:46.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:45 smithi031 bash[22603]: cluster 2020-06-27T05:03:44.110044+0000 mgr.x (mgr.34109) 720 : cluster [DBG] pgmap v812: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:48.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:47 smithi051 bash[18409]: cluster 2020-06-27T05:03:46.111729+0000 mgr.x (mgr.34109) 721 : cluster [DBG] pgmap v813: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:48.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:47 smithi031 bash[18426]: cluster 2020-06-27T05:03:46.111729+0000 mgr.x (mgr.34109) 721 : cluster [DBG] pgmap v813: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:48.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:47 smithi031 bash[22603]: cluster 2020-06-27T05:03:46.111729+0000 mgr.x (mgr.34109) 721 : cluster [DBG] pgmap v813: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:50.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:49 smithi051 bash[18409]: cluster 2020-06-27T05:03:48.113438+0000 mgr.x (mgr.34109) 722 : cluster [DBG] pgmap v814: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:50.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:49 smithi031 bash[18426]: cluster 2020-06-27T05:03:48.113438+0000 mgr.x (mgr.34109) 722 : cluster [DBG] pgmap v814: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:50.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:49 smithi031 bash[22603]: cluster 2020-06-27T05:03:48.113438+0000 mgr.x (mgr.34109) 722 : cluster [DBG] pgmap v814: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:52.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:51 smithi051 bash[18409]: cluster 2020-06-27T05:03:50.115105+0000 mgr.x (mgr.34109) 723 : cluster [DBG] pgmap v815: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:52.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:51 smithi031 bash[18426]: cluster 2020-06-27T05:03:50.115105+0000 mgr.x (mgr.34109) 723 : cluster [DBG] pgmap v815: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:52.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:51 smithi031 bash[22603]: cluster 2020-06-27T05:03:50.115105+0000 mgr.x (mgr.34109) 723 : cluster [DBG] pgmap v815: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:54.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:53 smithi051 bash[18409]: cluster 2020-06-27T05:03:52.116820+0000 mgr.x (mgr.34109) 724 : cluster [DBG] pgmap v816: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:54.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:53 smithi031 bash[18426]: cluster 2020-06-27T05:03:52.116820+0000 mgr.x (mgr.34109) 724 : cluster [DBG] pgmap v816: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:54.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:53 smithi031 bash[22603]: cluster 2020-06-27T05:03:52.116820+0000 mgr.x (mgr.34109) 724 : cluster [DBG] pgmap v816: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:55 smithi051 bash[18409]: cluster 2020-06-27T05:03:54.118444+0000 mgr.x (mgr.34109) 725 : cluster [DBG] pgmap v817: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:55 smithi031 bash[18426]: cluster 2020-06-27T05:03:54.118444+0000 mgr.x (mgr.34109) 725 : cluster [DBG] pgmap v817: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:56.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:55 smithi031 bash[22603]: cluster 2020-06-27T05:03:54.118444+0000 mgr.x (mgr.34109) 725 : cluster [DBG] pgmap v817: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:58.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:57 smithi051 bash[18409]: cluster 2020-06-27T05:03:56.120129+0000 mgr.x (mgr.34109) 726 : cluster [DBG] pgmap v818: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:58.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:57 smithi031 bash[18426]: cluster 2020-06-27T05:03:56.120129+0000 mgr.x (mgr.34109) 726 : cluster [DBG] pgmap v818: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:03:58.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:57 smithi031 bash[22603]: cluster 2020-06-27T05:03:56.120129+0000 mgr.x (mgr.34109) 726 : cluster [DBG] pgmap v818: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:00.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:03:59 smithi031 bash[18426]: cluster 2020-06-27T05:03:58.121778+0000 mgr.x (mgr.34109) 727 : cluster [DBG] pgmap v819: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:00.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:03:59 smithi031 bash[22603]: cluster 2020-06-27T05:03:58.121778+0000 mgr.x (mgr.34109) 727 : cluster [DBG] pgmap v819: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:03:59 smithi051 bash[18409]: cluster 2020-06-27T05:03:58.121778+0000 mgr.x (mgr.34109) 727 : cluster [DBG] pgmap v819: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:02.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:01 smithi051 bash[18409]: cluster 2020-06-27T05:04:00.123531+0000 mgr.x (mgr.34109) 728 : cluster [DBG] pgmap v820: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:02.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:01 smithi031 bash[18426]: cluster 2020-06-27T05:04:00.123531+0000 mgr.x (mgr.34109) 728 : cluster [DBG] pgmap v820: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:02.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:01 smithi031 bash[22603]: cluster 2020-06-27T05:04:00.123531+0000 mgr.x (mgr.34109) 728 : cluster [DBG] pgmap v820: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:04.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:03 smithi051 bash[18409]: cluster 2020-06-27T05:04:02.125112+0000 mgr.x (mgr.34109) 729 : cluster [DBG] pgmap v821: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:04.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:03 smithi031 bash[18426]: cluster 2020-06-27T05:04:02.125112+0000 mgr.x (mgr.34109) 729 : cluster [DBG] pgmap v821: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:04.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:03 smithi031 bash[22603]: cluster 2020-06-27T05:04:02.125112+0000 mgr.x (mgr.34109) 729 : cluster [DBG] pgmap v821: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:06.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:05 smithi051 bash[18409]: cluster 2020-06-27T05:04:04.126694+0000 mgr.x (mgr.34109) 730 : cluster [DBG] pgmap v822: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:06.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:05 smithi031 bash[18426]: cluster 2020-06-27T05:04:04.126694+0000 mgr.x (mgr.34109) 730 : cluster [DBG] pgmap v822: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:06.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:05 smithi031 bash[22603]: cluster 2020-06-27T05:04:04.126694+0000 mgr.x (mgr.34109) 730 : cluster [DBG] pgmap v822: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:08.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:07 smithi051 bash[18409]: cluster 2020-06-27T05:04:06.128279+0000 mgr.x (mgr.34109) 731 : cluster [DBG] pgmap v823: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:08.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:07 smithi031 bash[22603]: cluster 2020-06-27T05:04:06.128279+0000 mgr.x (mgr.34109) 731 : cluster [DBG] pgmap v823: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:08.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:07 smithi031 bash[18426]: cluster 2020-06-27T05:04:06.128279+0000 mgr.x (mgr.34109) 731 : cluster [DBG] pgmap v823: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:10.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:10 smithi051 bash[18409]: cluster 2020-06-27T05:04:08.129833+0000 mgr.x (mgr.34109) 732 : cluster [DBG] pgmap v824: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:10.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:10 smithi031 bash[18426]: cluster 2020-06-27T05:04:08.129833+0000 mgr.x (mgr.34109) 732 : cluster [DBG] pgmap v824: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:10.480 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:10 smithi031 bash[22603]: cluster 2020-06-27T05:04:08.129833+0000 mgr.x (mgr.34109) 732 : cluster [DBG] pgmap v824: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:12.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:12 smithi051 bash[18409]: cluster 2020-06-27T05:04:10.131493+0000 mgr.x (mgr.34109) 733 : cluster [DBG] pgmap v825: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:12.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:12 smithi031 bash[18426]: cluster 2020-06-27T05:04:10.131493+0000 mgr.x (mgr.34109) 733 : cluster [DBG] pgmap v825: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:12.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:12 smithi031 bash[22603]: cluster 2020-06-27T05:04:10.131493+0000 mgr.x (mgr.34109) 733 : cluster [DBG] pgmap v825: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:14.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:14 smithi051 bash[18409]: cluster 2020-06-27T05:04:12.133200+0000 mgr.x (mgr.34109) 734 : cluster [DBG] pgmap v826: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:14.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:14 smithi031 bash[18426]: cluster 2020-06-27T05:04:12.133200+0000 mgr.x (mgr.34109) 734 : cluster [DBG] pgmap v826: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:14.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:14 smithi031 bash[22603]: cluster 2020-06-27T05:04:12.133200+0000 mgr.x (mgr.34109) 734 : cluster [DBG] pgmap v826: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:16.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:16 smithi051 bash[18409]: cluster 2020-06-27T05:04:14.134779+0000 mgr.x (mgr.34109) 735 : cluster [DBG] pgmap v827: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:16.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:16 smithi031 bash[18426]: cluster 2020-06-27T05:04:14.134779+0000 mgr.x (mgr.34109) 735 : cluster [DBG] pgmap v827: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:16.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:16 smithi031 bash[22603]: cluster 2020-06-27T05:04:14.134779+0000 mgr.x (mgr.34109) 735 : cluster [DBG] pgmap v827: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:18.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:18 smithi051 bash[18409]: cluster 2020-06-27T05:04:16.136481+0000 mgr.x (mgr.34109) 736 : cluster [DBG] pgmap v828: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:18.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:18 smithi031 bash[18426]: cluster 2020-06-27T05:04:16.136481+0000 mgr.x (mgr.34109) 736 : cluster [DBG] pgmap v828: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:18.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:18 smithi031 bash[22603]: cluster 2020-06-27T05:04:16.136481+0000 mgr.x (mgr.34109) 736 : cluster [DBG] pgmap v828: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:20.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:20 smithi051 bash[18409]: cluster 2020-06-27T05:04:18.138142+0000 mgr.x (mgr.34109) 737 : cluster [DBG] pgmap v829: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:20.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:20 smithi031 bash[18426]: cluster 2020-06-27T05:04:18.138142+0000 mgr.x (mgr.34109) 737 : cluster [DBG] pgmap v829: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:20.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:20 smithi031 bash[22603]: cluster 2020-06-27T05:04:18.138142+0000 mgr.x (mgr.34109) 737 : cluster [DBG] pgmap v829: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:22.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:22 smithi051 bash[18409]: cluster 2020-06-27T05:04:20.139728+0000 mgr.x (mgr.34109) 738 : cluster [DBG] pgmap v830: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:22.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:22 smithi031 bash[22603]: cluster 2020-06-27T05:04:20.139728+0000 mgr.x (mgr.34109) 738 : cluster [DBG] pgmap v830: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:22.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:22 smithi031 bash[18426]: cluster 2020-06-27T05:04:20.139728+0000 mgr.x (mgr.34109) 738 : cluster [DBG] pgmap v830: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:23.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:23 smithi051 bash[18409]: cluster 2020-06-27T05:04:22.141354+0000 mgr.x (mgr.34109) 739 : cluster [DBG] pgmap v831: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:23.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:23 smithi031 bash[18426]: cluster 2020-06-27T05:04:22.141354+0000 mgr.x (mgr.34109) 739 : cluster [DBG] pgmap v831: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:23.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:23 smithi031 bash[22603]: cluster 2020-06-27T05:04:22.141354+0000 mgr.x (mgr.34109) 739 : cluster [DBG] pgmap v831: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:25.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:25 smithi051 bash[18409]: cluster 2020-06-27T05:04:24.142880+0000 mgr.x (mgr.34109) 740 : cluster [DBG] pgmap v832: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:25.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:25 smithi031 bash[18426]: cluster 2020-06-27T05:04:24.142880+0000 mgr.x (mgr.34109) 740 : cluster [DBG] pgmap v832: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:25.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:25 smithi031 bash[22603]: cluster 2020-06-27T05:04:24.142880+0000 mgr.x (mgr.34109) 740 : cluster [DBG] pgmap v832: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:27.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:27 smithi051 bash[18409]: cluster 2020-06-27T05:04:26.144573+0000 mgr.x (mgr.34109) 741 : cluster [DBG] pgmap v833: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:27.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:27 smithi031 bash[18426]: cluster 2020-06-27T05:04:26.144573+0000 mgr.x (mgr.34109) 741 : cluster [DBG] pgmap v833: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:27.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:27 smithi031 bash[22603]: cluster 2020-06-27T05:04:26.144573+0000 mgr.x (mgr.34109) 741 : cluster [DBG] pgmap v833: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:29.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:29 smithi051 bash[18409]: cluster 2020-06-27T05:04:28.146195+0000 mgr.x (mgr.34109) 742 : cluster [DBG] pgmap v834: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:29.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:29 smithi031 bash[18426]: cluster 2020-06-27T05:04:28.146195+0000 mgr.x (mgr.34109) 742 : cluster [DBG] pgmap v834: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:29.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:29 smithi031 bash[22603]: cluster 2020-06-27T05:04:28.146195+0000 mgr.x (mgr.34109) 742 : cluster [DBG] pgmap v834: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:31.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:31 smithi051 bash[18409]: cluster 2020-06-27T05:04:30.147780+0000 mgr.x (mgr.34109) 743 : cluster [DBG] pgmap v835: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:31.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:31 smithi031 bash[18426]: cluster 2020-06-27T05:04:30.147780+0000 mgr.x (mgr.34109) 743 : cluster [DBG] pgmap v835: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:31.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:31 smithi031 bash[22603]: cluster 2020-06-27T05:04:30.147780+0000 mgr.x (mgr.34109) 743 : cluster [DBG] pgmap v835: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:33.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:33 smithi051 bash[18409]: cluster 2020-06-27T05:04:32.149307+0000 mgr.x (mgr.34109) 744 : cluster [DBG] pgmap v836: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:33.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:33 smithi031 bash[18426]: cluster 2020-06-27T05:04:32.149307+0000 mgr.x (mgr.34109) 744 : cluster [DBG] pgmap v836: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:33.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:33 smithi031 bash[22603]: cluster 2020-06-27T05:04:32.149307+0000 mgr.x (mgr.34109) 744 : cluster [DBG] pgmap v836: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:35.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:35 smithi051 bash[18409]: cluster 2020-06-27T05:04:34.150954+0000 mgr.x (mgr.34109) 745 : cluster [DBG] pgmap v837: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:35.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:35 smithi031 bash[18426]: cluster 2020-06-27T05:04:34.150954+0000 mgr.x (mgr.34109) 745 : cluster [DBG] pgmap v837: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:35.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:35 smithi031 bash[22603]: cluster 2020-06-27T05:04:34.150954+0000 mgr.x (mgr.34109) 745 : cluster [DBG] pgmap v837: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:37.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:37 smithi051 bash[18409]: cluster 2020-06-27T05:04:36.152640+0000 mgr.x (mgr.34109) 746 : cluster [DBG] pgmap v838: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:37.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:37 smithi031 bash[18426]: cluster 2020-06-27T05:04:36.152640+0000 mgr.x (mgr.34109) 746 : cluster [DBG] pgmap v838: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:37.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:37 smithi031 bash[22603]: cluster 2020-06-27T05:04:36.152640+0000 mgr.x (mgr.34109) 746 : cluster [DBG] pgmap v838: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:39.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:39 smithi051 bash[18409]: cluster 2020-06-27T05:04:38.154160+0000 mgr.x (mgr.34109) 747 : cluster [DBG] pgmap v839: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:39.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:39 smithi031 bash[18426]: cluster 2020-06-27T05:04:38.154160+0000 mgr.x (mgr.34109) 747 : cluster [DBG] pgmap v839: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:39.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:39 smithi031 bash[22603]: cluster 2020-06-27T05:04:38.154160+0000 mgr.x (mgr.34109) 747 : cluster [DBG] pgmap v839: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:41.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:41 smithi051 bash[18409]: cluster 2020-06-27T05:04:40.155769+0000 mgr.x (mgr.34109) 748 : cluster [DBG] pgmap v840: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:41.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:41 smithi031 bash[18426]: cluster 2020-06-27T05:04:40.155769+0000 mgr.x (mgr.34109) 748 : cluster [DBG] pgmap v840: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:41.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:41 smithi031 bash[22603]: cluster 2020-06-27T05:04:40.155769+0000 mgr.x (mgr.34109) 748 : cluster [DBG] pgmap v840: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:43.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:43 smithi051 bash[18409]: cluster 2020-06-27T05:04:42.157497+0000 mgr.x (mgr.34109) 749 : cluster [DBG] pgmap v841: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:43.972 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:43 smithi031 bash[22603]: cluster 2020-06-27T05:04:42.157497+0000 mgr.x (mgr.34109) 749 : cluster [DBG] pgmap v841: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:43.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:43 smithi031 bash[18426]: cluster 2020-06-27T05:04:42.157497+0000 mgr.x (mgr.34109) 749 : cluster [DBG] pgmap v841: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:45.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:45 smithi051 bash[18409]: cluster 2020-06-27T05:04:44.159244+0000 mgr.x (mgr.34109) 750 : cluster [DBG] pgmap v842: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:45.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:45 smithi031 bash[22603]: cluster 2020-06-27T05:04:44.159244+0000 mgr.x (mgr.34109) 750 : cluster [DBG] pgmap v842: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:45.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:45 smithi031 bash[18426]: cluster 2020-06-27T05:04:44.159244+0000 mgr.x (mgr.34109) 750 : cluster [DBG] pgmap v842: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:47.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:47 smithi051 bash[18409]: cluster 2020-06-27T05:04:46.160872+0000 mgr.x (mgr.34109) 751 : cluster [DBG] pgmap v843: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:47.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:47 smithi031 bash[22603]: cluster 2020-06-27T05:04:46.160872+0000 mgr.x (mgr.34109) 751 : cluster [DBG] pgmap v843: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:47.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:47 smithi031 bash[18426]: cluster 2020-06-27T05:04:46.160872+0000 mgr.x (mgr.34109) 751 : cluster [DBG] pgmap v843: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:49.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:49 smithi051 bash[18409]: cluster 2020-06-27T05:04:48.162556+0000 mgr.x (mgr.34109) 752 : cluster [DBG] pgmap v844: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:49.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:49 smithi031 bash[22603]: cluster 2020-06-27T05:04:48.162556+0000 mgr.x (mgr.34109) 752 : cluster [DBG] pgmap v844: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:49.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:49 smithi031 bash[18426]: cluster 2020-06-27T05:04:48.162556+0000 mgr.x (mgr.34109) 752 : cluster [DBG] pgmap v844: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:51.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:51 smithi051 bash[18409]: cluster 2020-06-27T05:04:50.164280+0000 mgr.x (mgr.34109) 753 : cluster [DBG] pgmap v845: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:51.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:51 smithi031 bash[22603]: cluster 2020-06-27T05:04:50.164280+0000 mgr.x (mgr.34109) 753 : cluster [DBG] pgmap v845: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:51.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:51 smithi031 bash[18426]: cluster 2020-06-27T05:04:50.164280+0000 mgr.x (mgr.34109) 753 : cluster [DBG] pgmap v845: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:53.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:53 smithi051 bash[18409]: cluster 2020-06-27T05:04:52.165967+0000 mgr.x (mgr.34109) 754 : cluster [DBG] pgmap v846: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:53.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:53 smithi031 bash[22603]: cluster 2020-06-27T05:04:52.165967+0000 mgr.x (mgr.34109) 754 : cluster [DBG] pgmap v846: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:53.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:53 smithi031 bash[18426]: cluster 2020-06-27T05:04:52.165967+0000 mgr.x (mgr.34109) 754 : cluster [DBG] pgmap v846: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:55.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:55 smithi051 bash[18409]: cluster 2020-06-27T05:04:54.167590+0000 mgr.x (mgr.34109) 755 : cluster [DBG] pgmap v847: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:55.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:55 smithi031 bash[18426]: cluster 2020-06-27T05:04:54.167590+0000 mgr.x (mgr.34109) 755 : cluster [DBG] pgmap v847: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:55.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:55 smithi031 bash[22603]: cluster 2020-06-27T05:04:54.167590+0000 mgr.x (mgr.34109) 755 : cluster [DBG] pgmap v847: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:57.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:57 smithi051 bash[18409]: cluster 2020-06-27T05:04:56.169260+0000 mgr.x (mgr.34109) 756 : cluster [DBG] pgmap v848: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:57.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:57 smithi031 bash[18426]: cluster 2020-06-27T05:04:56.169260+0000 mgr.x (mgr.34109) 756 : cluster [DBG] pgmap v848: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:57.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:57 smithi031 bash[22603]: cluster 2020-06-27T05:04:56.169260+0000 mgr.x (mgr.34109) 756 : cluster [DBG] pgmap v848: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:59.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:04:59 smithi051 bash[18409]: cluster 2020-06-27T05:04:58.170964+0000 mgr.x (mgr.34109) 757 : cluster [DBG] pgmap v849: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:59.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:04:59 smithi031 bash[22603]: cluster 2020-06-27T05:04:58.170964+0000 mgr.x (mgr.34109) 757 : cluster [DBG] pgmap v849: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:04:59.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:04:59 smithi031 bash[18426]: cluster 2020-06-27T05:04:58.170964+0000 mgr.x (mgr.34109) 757 : cluster [DBG] pgmap v849: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:01.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:01 smithi051 bash[18409]: cluster 2020-06-27T05:05:00.173409+0000 mgr.x (mgr.34109) 758 : cluster [DBG] pgmap v850: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:01.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:01 smithi031 bash[22603]: cluster 2020-06-27T05:05:00.173409+0000 mgr.x (mgr.34109) 758 : cluster [DBG] pgmap v850: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:01.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:01 smithi031 bash[18426]: cluster 2020-06-27T05:05:00.173409+0000 mgr.x (mgr.34109) 758 : cluster [DBG] pgmap v850: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:03.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:03 smithi051 bash[18409]: cluster 2020-06-27T05:05:02.175052+0000 mgr.x (mgr.34109) 759 : cluster [DBG] pgmap v851: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:03.972 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:03 smithi031 bash[22603]: cluster 2020-06-27T05:05:02.175052+0000 mgr.x (mgr.34109) 759 : cluster [DBG] pgmap v851: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:03.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:03 smithi031 bash[18426]: cluster 2020-06-27T05:05:02.175052+0000 mgr.x (mgr.34109) 759 : cluster [DBG] pgmap v851: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:05.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:05 smithi051 bash[18409]: cluster 2020-06-27T05:05:04.176715+0000 mgr.x (mgr.34109) 760 : cluster [DBG] pgmap v852: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:05.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:05 smithi031 bash[22603]: cluster 2020-06-27T05:05:04.176715+0000 mgr.x (mgr.34109) 760 : cluster [DBG] pgmap v852: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:05.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:05 smithi031 bash[18426]: cluster 2020-06-27T05:05:04.176715+0000 mgr.x (mgr.34109) 760 : cluster [DBG] pgmap v852: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:07.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:07 smithi051 bash[18409]: cluster 2020-06-27T05:05:06.178275+0000 mgr.x (mgr.34109) 761 : cluster [DBG] pgmap v853: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:07.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:07 smithi031 bash[18426]: cluster 2020-06-27T05:05:06.178275+0000 mgr.x (mgr.34109) 761 : cluster [DBG] pgmap v853: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:07.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:07 smithi031 bash[22603]: cluster 2020-06-27T05:05:06.178275+0000 mgr.x (mgr.34109) 761 : cluster [DBG] pgmap v853: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:09.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:09 smithi051 bash[18409]: cluster 2020-06-27T05:05:08.179897+0000 mgr.x (mgr.34109) 762 : cluster [DBG] pgmap v854: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:09.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:09 smithi031 bash[18426]: cluster 2020-06-27T05:05:08.179897+0000 mgr.x (mgr.34109) 762 : cluster [DBG] pgmap v854: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:09.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:09 smithi031 bash[22603]: cluster 2020-06-27T05:05:08.179897+0000 mgr.x (mgr.34109) 762 : cluster [DBG] pgmap v854: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:11.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:11 smithi051 bash[18409]: cluster 2020-06-27T05:05:10.181584+0000 mgr.x (mgr.34109) 763 : cluster [DBG] pgmap v855: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:11.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:11 smithi031 bash[18426]: cluster 2020-06-27T05:05:10.181584+0000 mgr.x (mgr.34109) 763 : cluster [DBG] pgmap v855: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:11.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:11 smithi031 bash[22603]: cluster 2020-06-27T05:05:10.181584+0000 mgr.x (mgr.34109) 763 : cluster [DBG] pgmap v855: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:13.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:13 smithi031 bash[18426]: cluster 2020-06-27T05:05:12.183286+0000 mgr.x (mgr.34109) 764 : cluster [DBG] pgmap v856: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:13.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:13 smithi031 bash[22603]: cluster 2020-06-27T05:05:12.183286+0000 mgr.x (mgr.34109) 764 : cluster [DBG] pgmap v856: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:14.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:13 smithi051 bash[18409]: cluster 2020-06-27T05:05:12.183286+0000 mgr.x (mgr.34109) 764 : cluster [DBG] pgmap v856: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:15 smithi051 bash[18409]: cluster 2020-06-27T05:05:14.184916+0000 mgr.x (mgr.34109) 765 : cluster [DBG] pgmap v857: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:15 smithi031 bash[18426]: cluster 2020-06-27T05:05:14.184916+0000 mgr.x (mgr.34109) 765 : cluster [DBG] pgmap v857: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:16.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:15 smithi031 bash[22603]: cluster 2020-06-27T05:05:14.184916+0000 mgr.x (mgr.34109) 765 : cluster [DBG] pgmap v857: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:18.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:17 smithi051 bash[18409]: cluster 2020-06-27T05:05:16.186611+0000 mgr.x (mgr.34109) 766 : cluster [DBG] pgmap v858: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:18.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:17 smithi031 bash[18426]: cluster 2020-06-27T05:05:16.186611+0000 mgr.x (mgr.34109) 766 : cluster [DBG] pgmap v858: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:18.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:17 smithi031 bash[22603]: cluster 2020-06-27T05:05:16.186611+0000 mgr.x (mgr.34109) 766 : cluster [DBG] pgmap v858: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:20.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:19 smithi051 bash[18409]: cluster 2020-06-27T05:05:18.188078+0000 mgr.x (mgr.34109) 767 : cluster [DBG] pgmap v859: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:20.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:19 smithi031 bash[18426]: cluster 2020-06-27T05:05:18.188078+0000 mgr.x (mgr.34109) 767 : cluster [DBG] pgmap v859: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:20.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:19 smithi031 bash[22603]: cluster 2020-06-27T05:05:18.188078+0000 mgr.x (mgr.34109) 767 : cluster [DBG] pgmap v859: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:22.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:21 smithi051 bash[18409]: cluster 2020-06-27T05:05:20.189702+0000 mgr.x (mgr.34109) 768 : cluster [DBG] pgmap v860: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:22.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:21 smithi031 bash[18426]: cluster 2020-06-27T05:05:20.189702+0000 mgr.x (mgr.34109) 768 : cluster [DBG] pgmap v860: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:22.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:21 smithi031 bash[22603]: cluster 2020-06-27T05:05:20.189702+0000 mgr.x (mgr.34109) 768 : cluster [DBG] pgmap v860: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:24.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:23 smithi051 bash[18409]: cluster 2020-06-27T05:05:22.191252+0000 mgr.x (mgr.34109) 769 : cluster [DBG] pgmap v861: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:24.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:23 smithi031 bash[18426]: cluster 2020-06-27T05:05:22.191252+0000 mgr.x (mgr.34109) 769 : cluster [DBG] pgmap v861: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:24.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:23 smithi031 bash[22603]: cluster 2020-06-27T05:05:22.191252+0000 mgr.x (mgr.34109) 769 : cluster [DBG] pgmap v861: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:26.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:25 smithi051 bash[18409]: cluster 2020-06-27T05:05:24.192856+0000 mgr.x (mgr.34109) 770 : cluster [DBG] pgmap v862: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:25 smithi031 bash[18426]: cluster 2020-06-27T05:05:24.192856+0000 mgr.x (mgr.34109) 770 : cluster [DBG] pgmap v862: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:25 smithi031 bash[22603]: cluster 2020-06-27T05:05:24.192856+0000 mgr.x (mgr.34109) 770 : cluster [DBG] pgmap v862: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:28.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:27 smithi051 bash[18409]: cluster 2020-06-27T05:05:26.194482+0000 mgr.x (mgr.34109) 771 : cluster [DBG] pgmap v863: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:28.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:27 smithi031 bash[18426]: cluster 2020-06-27T05:05:26.194482+0000 mgr.x (mgr.34109) 771 : cluster [DBG] pgmap v863: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:28.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:27 smithi031 bash[22603]: cluster 2020-06-27T05:05:26.194482+0000 mgr.x (mgr.34109) 771 : cluster [DBG] pgmap v863: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:30.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:29 smithi051 bash[18409]: cluster 2020-06-27T05:05:28.196093+0000 mgr.x (mgr.34109) 772 : cluster [DBG] pgmap v864: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:30.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:29 smithi031 bash[18426]: cluster 2020-06-27T05:05:28.196093+0000 mgr.x (mgr.34109) 772 : cluster [DBG] pgmap v864: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:30.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:29 smithi031 bash[22603]: cluster 2020-06-27T05:05:28.196093+0000 mgr.x (mgr.34109) 772 : cluster [DBG] pgmap v864: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:32.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:31 smithi051 bash[18409]: cluster 2020-06-27T05:05:30.197941+0000 mgr.x (mgr.34109) 773 : cluster [DBG] pgmap v865: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:32.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:31 smithi031 bash[18426]: cluster 2020-06-27T05:05:30.197941+0000 mgr.x (mgr.34109) 773 : cluster [DBG] pgmap v865: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:32.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:31 smithi031 bash[22603]: cluster 2020-06-27T05:05:30.197941+0000 mgr.x (mgr.34109) 773 : cluster [DBG] pgmap v865: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:34.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:33 smithi051 bash[18409]: cluster 2020-06-27T05:05:32.199525+0000 mgr.x (mgr.34109) 774 : cluster [DBG] pgmap v866: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:34.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:33 smithi031 bash[18426]: cluster 2020-06-27T05:05:32.199525+0000 mgr.x (mgr.34109) 774 : cluster [DBG] pgmap v866: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:34.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:33 smithi031 bash[22603]: cluster 2020-06-27T05:05:32.199525+0000 mgr.x (mgr.34109) 774 : cluster [DBG] pgmap v866: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:35 smithi051 bash[18409]: cluster 2020-06-27T05:05:34.201226+0000 mgr.x (mgr.34109) 775 : cluster [DBG] pgmap v867: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:36.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:35 smithi031 bash[18426]: cluster 2020-06-27T05:05:34.201226+0000 mgr.x (mgr.34109) 775 : cluster [DBG] pgmap v867: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:36.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:35 smithi031 bash[22603]: cluster 2020-06-27T05:05:34.201226+0000 mgr.x (mgr.34109) 775 : cluster [DBG] pgmap v867: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:38.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:37 smithi051 bash[18409]: cluster 2020-06-27T05:05:36.202815+0000 mgr.x (mgr.34109) 776 : cluster [DBG] pgmap v868: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:38.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:37 smithi031 bash[18426]: cluster 2020-06-27T05:05:36.202815+0000 mgr.x (mgr.34109) 776 : cluster [DBG] pgmap v868: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:38.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:37 smithi031 bash[22603]: cluster 2020-06-27T05:05:36.202815+0000 mgr.x (mgr.34109) 776 : cluster [DBG] pgmap v868: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:40.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:39 smithi051 bash[18409]: cluster 2020-06-27T05:05:38.204344+0000 mgr.x (mgr.34109) 777 : cluster [DBG] pgmap v869: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:40.222 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:39 smithi031 bash[18426]: cluster 2020-06-27T05:05:38.204344+0000 mgr.x (mgr.34109) 777 : cluster [DBG] pgmap v869: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:40.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:39 smithi031 bash[22603]: cluster 2020-06-27T05:05:38.204344+0000 mgr.x (mgr.34109) 777 : cluster [DBG] pgmap v869: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:42.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:41 smithi051 bash[18409]: cluster 2020-06-27T05:05:40.205951+0000 mgr.x (mgr.34109) 778 : cluster [DBG] pgmap v870: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:42.222 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:41 smithi031 bash[18426]: cluster 2020-06-27T05:05:40.205951+0000 mgr.x (mgr.34109) 778 : cluster [DBG] pgmap v870: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:42.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:41 smithi031 bash[22603]: cluster 2020-06-27T05:05:40.205951+0000 mgr.x (mgr.34109) 778 : cluster [DBG] pgmap v870: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:44.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:43 smithi051 bash[18409]: cluster 2020-06-27T05:05:42.207670+0000 mgr.x (mgr.34109) 779 : cluster [DBG] pgmap v871: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:44.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:43 smithi031 bash[18426]: cluster 2020-06-27T05:05:42.207670+0000 mgr.x (mgr.34109) 779 : cluster [DBG] pgmap v871: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:44.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:43 smithi031 bash[22603]: cluster 2020-06-27T05:05:42.207670+0000 mgr.x (mgr.34109) 779 : cluster [DBG] pgmap v871: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:46.021 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:45 smithi051 bash[18409]: cluster 2020-06-27T05:05:44.209260+0000 mgr.x (mgr.34109) 780 : cluster [DBG] pgmap v872: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:46.022 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:45 smithi051 bash[18409]: audit 2020-06-27T05:05:45.245897+0000 mon.b (mon.2) 356 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958716\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958793\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.958827\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959014\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959112\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"89d97a048d29\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959205\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:49:20.065739\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959311\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959346\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959375\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.959460\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:05:45.245091\"}"}]: dispatch 2020-06-27T05:05:46.022 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:45 smithi051 bash[18409]: audit 2020-06-27T05:05:45.246649+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958716\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958793\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.958827\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959014\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959112\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"89d97a048d29\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959205\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:49:20.065739\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959311\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959346\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959375\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.959460\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:05:45.245091\"}"}]: dispatch 2020-06-27T05:05:46.022 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:45 smithi051 bash[18409]: audit 2020-06-27T05:05:45.247147+0000 mon.b (mon.2) 357 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744143\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744220\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"43c6d0503d9c\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744253\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:49:12.650483\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744457\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"72fb1b0d97ca\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744558\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:49:23.458946\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744665\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744758\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744794\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744824\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.744905\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:05:45.246379\"}"}]: dispatch 2020-06-27T05:05:46.023 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:45 smithi051 bash[18409]: audit 2020-06-27T05:05:45.249615+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958716\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958793\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.958827\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959014\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959112\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"89d97a048d29\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959205\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:49:20.065739\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959311\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959346\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959375\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.959460\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:05:45.245091\"}"}]': finished 2020-06-27T05:05:46.023 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:45 smithi051 bash[18409]: audit 2020-06-27T05:05:45.250032+0000 mon.b (mon.2) 358 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:05:46.023 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:45 smithi051 bash[18409]: audit 2020-06-27T05:05:45.250548+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744143\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744220\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"43c6d0503d9c\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744253\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:49:12.650483\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744457\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"72fb1b0d97ca\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744558\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:49:23.458946\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744665\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744758\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744794\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744824\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.744905\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:05:45.246379\"}"}]: dispatch 2020-06-27T05:05:46.024 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:45 smithi051 bash[18409]: audit 2020-06-27T05:05:45.279686+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744143\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744220\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"43c6d0503d9c\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744253\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:49:12.650483\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744457\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"72fb1b0d97ca\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744558\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:49:23.458946\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744665\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744758\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744794\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744824\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.744905\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:05:45.246379\"}"}]': finished 2020-06-27T05:05:46.024 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:45 smithi051 bash[18409]: audit 2020-06-27T05:05:45.280352+0000 mon.b (mon.2) 359 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:05:46.027 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:45 smithi031 bash[18426]: cluster 2020-06-27T05:05:44.209260+0000 mgr.x (mgr.34109) 780 : cluster [DBG] pgmap v872: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:46.027 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:45 smithi031 bash[18426]: audit 2020-06-27T05:05:45.245897+0000 mon.b (mon.2) 356 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958716\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958793\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.958827\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959014\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959112\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"89d97a048d29\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959205\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:49:20.065739\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959311\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959346\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959375\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.959460\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:05:45.245091\"}"}]: dispatch 2020-06-27T05:05:46.038 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:45 smithi031 bash[18426]: audit 2020-06-27T05:05:45.246649+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958716\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958793\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.958827\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959014\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959112\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"89d97a048d29\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959205\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:49:20.065739\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959311\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959346\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959375\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.959460\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:05:45.245091\"}"}]: dispatch 2020-06-27T05:05:46.038 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:45 smithi031 bash[18426]: audit 2020-06-27T05:05:45.247147+0000 mon.b (mon.2) 357 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744143\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744220\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"43c6d0503d9c\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744253\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:49:12.650483\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744457\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"72fb1b0d97ca\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744558\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:49:23.458946\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744665\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744758\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744794\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744824\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.744905\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:05:45.246379\"}"}]: dispatch 2020-06-27T05:05:46.039 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:45 smithi031 bash[18426]: audit 2020-06-27T05:05:45.249615+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958716\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958793\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.958827\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959014\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959112\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"89d97a048d29\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959205\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:49:20.065739\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959311\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959346\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959375\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.959460\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:05:45.245091\"}"}]': finished 2020-06-27T05:05:46.039 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:45 smithi031 bash[18426]: audit 2020-06-27T05:05:45.250032+0000 mon.b (mon.2) 358 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:05:46.039 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:45 smithi031 bash[18426]: audit 2020-06-27T05:05:45.250548+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744143\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744220\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"43c6d0503d9c\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744253\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:49:12.650483\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744457\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"72fb1b0d97ca\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744558\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:49:23.458946\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744665\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744758\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744794\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744824\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.744905\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:05:45.246379\"}"}]: dispatch 2020-06-27T05:05:46.040 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:45 smithi031 bash[18426]: audit 2020-06-27T05:05:45.279686+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744143\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744220\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"43c6d0503d9c\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744253\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:49:12.650483\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744457\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"72fb1b0d97ca\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744558\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:49:23.458946\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744665\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744758\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744794\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744824\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.744905\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:05:45.246379\"}"}]': finished 2020-06-27T05:05:46.040 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:45 smithi031 bash[18426]: audit 2020-06-27T05:05:45.280352+0000 mon.b (mon.2) 359 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:05:46.040 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:45 smithi031 bash[22603]: cluster 2020-06-27T05:05:44.209260+0000 mgr.x (mgr.34109) 780 : cluster [DBG] pgmap v872: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:46.041 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:45 smithi031 bash[22603]: audit 2020-06-27T05:05:45.245897+0000 mon.b (mon.2) 356 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958716\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958793\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.958827\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959014\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959112\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"89d97a048d29\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959205\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:49:20.065739\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959311\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959346\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959375\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.959460\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:05:45.245091\"}"}]: dispatch 2020-06-27T05:05:46.041 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:45 smithi031 bash[22603]: audit 2020-06-27T05:05:45.246649+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958716\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958793\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.958827\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959014\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959112\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"89d97a048d29\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959205\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:49:20.065739\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959311\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959346\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959375\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.959460\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:05:45.245091\"}"}]: dispatch 2020-06-27T05:05:46.041 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:45 smithi031 bash[22603]: audit 2020-06-27T05:05:45.247147+0000 mon.b (mon.2) 357 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744143\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744220\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"43c6d0503d9c\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744253\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:49:12.650483\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744457\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"72fb1b0d97ca\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744558\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:49:23.458946\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744665\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744758\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744794\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744824\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.744905\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:05:45.246379\"}"}]: dispatch 2020-06-27T05:05:46.042 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:45 smithi031 bash[22603]: audit 2020-06-27T05:05:45.249615+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958716\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.958793\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.958827\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959014\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.959112\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_id\": \"89d97a048d29\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959205\", \"created\": \"2020-06-27T04:44:17.341577\", \"started\": \"2020-06-27T04:49:20.065739\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959311\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959346\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.959375\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.959460\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:05:45.245091\"}"}]': finished 2020-06-27T05:05:46.042 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:45 smithi031 bash[22603]: audit 2020-06-27T05:05:45.250032+0000 mon.b (mon.2) 358 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:05:46.042 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:45 smithi031 bash[22603]: audit 2020-06-27T05:05:45.250548+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744143\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744220\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"43c6d0503d9c\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744253\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:49:12.650483\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744457\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"72fb1b0d97ca\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744558\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:49:23.458946\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744665\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744758\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744794\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744824\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.744905\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:05:45.246379\"}"}]: dispatch 2020-06-27T05:05:46.042 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:45 smithi031 bash[22603]: audit 2020-06-27T05:05:45.279686+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744143\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744220\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_id\": \"43c6d0503d9c\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744253\", \"created\": \"2020-06-27T04:42:27.975089\", \"started\": \"2020-06-27T04:49:12.650483\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744457\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_id\": \"72fb1b0d97ca\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744558\", \"created\": \"2020-06-27T04:43:00.603559\", \"started\": \"2020-06-27T04:49:23.458946\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T04:55:44.744665\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744758\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744794\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T04:55:44.744824\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T04:55:44.744905\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:05:45.246379\"}"}]': finished 2020-06-27T05:05:46.043 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:45 smithi031 bash[22603]: audit 2020-06-27T05:05:45.280352+0000 mon.b (mon.2) 359 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:05:47.820 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:47 smithi051 bash[18409]: cluster 2020-06-27T05:05:46.211160+0000 mgr.x (mgr.34109) 781 : cluster [DBG] pgmap v873: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:47.820 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:47 smithi051 bash[18409]: audit 2020-06-27T05:05:47.211663+0000 mon.b (mon.2) 360 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210130\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210205\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210239\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210436\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210540\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210636\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210730\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210767\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210797\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.210877\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:05:45.246379\"}"}]: dispatch 2020-06-27T05:05:47.820 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:47 smithi051 bash[18409]: audit 2020-06-27T05:05:47.212470+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210130\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210205\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210239\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210436\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210540\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210636\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210730\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210767\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210797\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.210877\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:05:45.246379\"}"}]: dispatch 2020-06-27T05:05:47.821 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:47 smithi051 bash[18409]: audit 2020-06-27T05:05:47.215108+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210130\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210205\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210239\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210436\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210540\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210636\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210730\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210767\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210797\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.210877\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:05:45.246379\"}"}]': finished 2020-06-27T05:05:47.821 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:47 smithi051 bash[18409]: audit 2020-06-27T05:05:47.564848+0000 mon.b (mon.2) 361 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563352\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563438\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563475\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563657\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563758\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563855\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563952\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563989\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.564019\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.564100\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:05:45.245091\"}"}]: dispatch 2020-06-27T05:05:47.822 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:47 smithi051 bash[18409]: audit 2020-06-27T05:05:47.565688+0000 mon.a (mon.0) 1445 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563352\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563438\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563475\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563657\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563758\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563855\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563952\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563989\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.564019\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.564100\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:05:45.245091\"}"}]: dispatch 2020-06-27T05:05:47.822 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:47 smithi051 bash[18409]: audit 2020-06-27T05:05:47.568602+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563352\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563438\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563475\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563657\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563758\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563855\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563952\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563989\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.564019\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.564100\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:05:45.245091\"}"}]': finished 2020-06-27T05:05:47.822 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:47 smithi051 bash[18409]: audit 2020-06-27T05:05:47.571155+0000 mon.b (mon.2) 362 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:05:47.822 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:47 smithi051 bash[18409]: audit 2020-06-27T05:05:47.572181+0000 mon.b (mon.2) 363 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:05:47.823 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:47 smithi051 bash[18409]: audit 2020-06-27T05:05:47.573034+0000 mon.b (mon.2) 364 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:05:48.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[22603]: cluster 2020-06-27T05:05:46.211160+0000 mgr.x (mgr.34109) 781 : cluster [DBG] pgmap v873: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:48.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[22603]: audit 2020-06-27T05:05:47.211663+0000 mon.b (mon.2) 360 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210130\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210205\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210239\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210436\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210540\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210636\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210730\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210767\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210797\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.210877\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:05:45.246379\"}"}]: dispatch 2020-06-27T05:05:48.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[22603]: audit 2020-06-27T05:05:47.212470+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210130\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210205\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210239\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210436\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210540\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210636\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210730\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210767\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210797\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.210877\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:05:45.246379\"}"}]: dispatch 2020-06-27T05:05:48.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[22603]: audit 2020-06-27T05:05:47.215108+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210130\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210205\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210239\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210436\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210540\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210636\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210730\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210767\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210797\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.210877\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:05:45.246379\"}"}]': finished 2020-06-27T05:05:48.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[22603]: audit 2020-06-27T05:05:47.564848+0000 mon.b (mon.2) 361 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563352\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563438\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563475\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563657\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563758\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563855\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563952\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563989\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.564019\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.564100\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:05:45.245091\"}"}]: dispatch 2020-06-27T05:05:48.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[22603]: audit 2020-06-27T05:05:47.565688+0000 mon.a (mon.0) 1445 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563352\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563438\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563475\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563657\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563758\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563855\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563952\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563989\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.564019\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.564100\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:05:45.245091\"}"}]: dispatch 2020-06-27T05:05:48.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[22603]: audit 2020-06-27T05:05:47.568602+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563352\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563438\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563475\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563657\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563758\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563855\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563952\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563989\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.564019\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.564100\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:05:45.245091\"}"}]': finished 2020-06-27T05:05:48.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[22603]: audit 2020-06-27T05:05:47.571155+0000 mon.b (mon.2) 362 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:05:48.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[22603]: audit 2020-06-27T05:05:47.572181+0000 mon.b (mon.2) 363 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:05:48.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[22603]: audit 2020-06-27T05:05:47.573034+0000 mon.b (mon.2) 364 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:05:48.229 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[18426]: cluster 2020-06-27T05:05:46.211160+0000 mgr.x (mgr.34109) 781 : cluster [DBG] pgmap v873: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:48.230 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[18426]: audit 2020-06-27T05:05:47.211663+0000 mon.b (mon.2) 360 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210130\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210205\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210239\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210436\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210540\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210636\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210730\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210767\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210797\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.210877\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:05:45.246379\"}"}]: dispatch 2020-06-27T05:05:48.231 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[18426]: audit 2020-06-27T05:05:47.212470+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210130\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210205\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210239\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210436\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210540\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210636\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210730\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210767\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210797\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.210877\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:05:45.246379\"}"}]: dispatch 2020-06-27T05:05:48.232 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[18426]: audit 2020-06-27T05:05:47.215108+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210130\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210205\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210239\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210436\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210540\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210636\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210730\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210767\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210797\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.210877\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:05:45.246379\"}"}]': finished 2020-06-27T05:05:48.233 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[18426]: audit 2020-06-27T05:05:47.564848+0000 mon.b (mon.2) 361 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563352\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563438\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563475\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563657\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563758\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563855\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563952\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563989\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.564019\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.564100\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:05:45.245091\"}"}]: dispatch 2020-06-27T05:05:48.233 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[18426]: audit 2020-06-27T05:05:47.565688+0000 mon.a (mon.0) 1445 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563352\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563438\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563475\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563657\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563758\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563855\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563952\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563989\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.564019\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.564100\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:05:45.245091\"}"}]: dispatch 2020-06-27T05:05:48.234 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[18426]: audit 2020-06-27T05:05:47.568602+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563352\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563438\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563475\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563657\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563758\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563855\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563952\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563989\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.564019\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.564100\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:05:45.245091\"}"}]': finished 2020-06-27T05:05:48.234 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[18426]: audit 2020-06-27T05:05:47.571155+0000 mon.b (mon.2) 362 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:05:48.235 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[18426]: audit 2020-06-27T05:05:47.572181+0000 mon.b (mon.2) 363 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:05:48.235 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:47 smithi031 bash[18426]: audit 2020-06-27T05:05:47.573034+0000 mon.b (mon.2) 364 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:05:49.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:48 smithi051 bash[18409]: audit 2020-06-27T05:05:47.571489+0000 mgr.x (mgr.34109) 782 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:05:49.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:48 smithi051 bash[18409]: audit 2020-06-27T05:05:47.572440+0000 mgr.x (mgr.34109) 783 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:05:49.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:48 smithi051 bash[18409]: audit 2020-06-27T05:05:47.573275+0000 mgr.x (mgr.34109) 784 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:05:49.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:48 smithi031 bash[18426]: audit 2020-06-27T05:05:47.571489+0000 mgr.x (mgr.34109) 782 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:05:49.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:48 smithi031 bash[18426]: audit 2020-06-27T05:05:47.572440+0000 mgr.x (mgr.34109) 783 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:05:49.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:48 smithi031 bash[18426]: audit 2020-06-27T05:05:47.573275+0000 mgr.x (mgr.34109) 784 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:05:49.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:48 smithi031 bash[22603]: audit 2020-06-27T05:05:47.571489+0000 mgr.x (mgr.34109) 782 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:05:49.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:48 smithi031 bash[22603]: audit 2020-06-27T05:05:47.572440+0000 mgr.x (mgr.34109) 783 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:05:49.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:48 smithi031 bash[22603]: audit 2020-06-27T05:05:47.573275+0000 mgr.x (mgr.34109) 784 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:05:50.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:49 smithi051 bash[18409]: cluster 2020-06-27T05:05:48.212747+0000 mgr.x (mgr.34109) 785 : cluster [DBG] pgmap v874: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:50.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:49 smithi031 bash[18426]: cluster 2020-06-27T05:05:48.212747+0000 mgr.x (mgr.34109) 785 : cluster [DBG] pgmap v874: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:50.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:49 smithi031 bash[22603]: cluster 2020-06-27T05:05:48.212747+0000 mgr.x (mgr.34109) 785 : cluster [DBG] pgmap v874: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:52.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:51 smithi051 bash[18409]: cluster 2020-06-27T05:05:50.214359+0000 mgr.x (mgr.34109) 786 : cluster [DBG] pgmap v875: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:52.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:51 smithi031 bash[18426]: cluster 2020-06-27T05:05:50.214359+0000 mgr.x (mgr.34109) 786 : cluster [DBG] pgmap v875: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:52.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:51 smithi031 bash[22603]: cluster 2020-06-27T05:05:50.214359+0000 mgr.x (mgr.34109) 786 : cluster [DBG] pgmap v875: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:54.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:53 smithi051 bash[18409]: cluster 2020-06-27T05:05:52.216164+0000 mgr.x (mgr.34109) 787 : cluster [DBG] pgmap v876: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:54.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:53 smithi031 bash[18426]: cluster 2020-06-27T05:05:52.216164+0000 mgr.x (mgr.34109) 787 : cluster [DBG] pgmap v876: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:54.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:53 smithi031 bash[22603]: cluster 2020-06-27T05:05:52.216164+0000 mgr.x (mgr.34109) 787 : cluster [DBG] pgmap v876: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:55 smithi051 bash[18409]: cluster 2020-06-27T05:05:54.217739+0000 mgr.x (mgr.34109) 788 : cluster [DBG] pgmap v877: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:56.222 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:55 smithi031 bash[18426]: cluster 2020-06-27T05:05:54.217739+0000 mgr.x (mgr.34109) 788 : cluster [DBG] pgmap v877: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:56.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:55 smithi031 bash[22603]: cluster 2020-06-27T05:05:54.217739+0000 mgr.x (mgr.34109) 788 : cluster [DBG] pgmap v877: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:58.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:57 smithi051 bash[18409]: cluster 2020-06-27T05:05:56.219359+0000 mgr.x (mgr.34109) 789 : cluster [DBG] pgmap v878: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:58.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:57 smithi031 bash[18426]: cluster 2020-06-27T05:05:56.219359+0000 mgr.x (mgr.34109) 789 : cluster [DBG] pgmap v878: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:05:58.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:57 smithi031 bash[22603]: cluster 2020-06-27T05:05:56.219359+0000 mgr.x (mgr.34109) 789 : cluster [DBG] pgmap v878: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:00.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:05:59 smithi051 bash[18409]: cluster 2020-06-27T05:05:58.221016+0000 mgr.x (mgr.34109) 790 : cluster [DBG] pgmap v879: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:00.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:05:59 smithi031 bash[18426]: cluster 2020-06-27T05:05:58.221016+0000 mgr.x (mgr.34109) 790 : cluster [DBG] pgmap v879: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:00.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:05:59 smithi031 bash[22603]: cluster 2020-06-27T05:05:58.221016+0000 mgr.x (mgr.34109) 790 : cluster [DBG] pgmap v879: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:02.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:01 smithi051 bash[18409]: cluster 2020-06-27T05:06:00.222613+0000 mgr.x (mgr.34109) 791 : cluster [DBG] pgmap v880: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:02.222 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:01 smithi031 bash[18426]: cluster 2020-06-27T05:06:00.222613+0000 mgr.x (mgr.34109) 791 : cluster [DBG] pgmap v880: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:02.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:01 smithi031 bash[22603]: cluster 2020-06-27T05:06:00.222613+0000 mgr.x (mgr.34109) 791 : cluster [DBG] pgmap v880: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:04.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:03 smithi051 bash[18409]: cluster 2020-06-27T05:06:02.224281+0000 mgr.x (mgr.34109) 792 : cluster [DBG] pgmap v881: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:04.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:03 smithi031 bash[18426]: cluster 2020-06-27T05:06:02.224281+0000 mgr.x (mgr.34109) 792 : cluster [DBG] pgmap v881: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:04.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:03 smithi031 bash[22603]: cluster 2020-06-27T05:06:02.224281+0000 mgr.x (mgr.34109) 792 : cluster [DBG] pgmap v881: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:05 smithi051 bash[18409]: cluster 2020-06-27T05:06:04.225879+0000 mgr.x (mgr.34109) 793 : cluster [DBG] pgmap v882: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:06.222 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:05 smithi031 bash[18426]: cluster 2020-06-27T05:06:04.225879+0000 mgr.x (mgr.34109) 793 : cluster [DBG] pgmap v882: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:06.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:05 smithi031 bash[22603]: cluster 2020-06-27T05:06:04.225879+0000 mgr.x (mgr.34109) 793 : cluster [DBG] pgmap v882: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:08.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:07 smithi051 bash[18409]: cluster 2020-06-27T05:06:06.227614+0000 mgr.x (mgr.34109) 794 : cluster [DBG] pgmap v883: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:08.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:07 smithi031 bash[18426]: cluster 2020-06-27T05:06:06.227614+0000 mgr.x (mgr.34109) 794 : cluster [DBG] pgmap v883: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:08.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:07 smithi031 bash[22603]: cluster 2020-06-27T05:06:06.227614+0000 mgr.x (mgr.34109) 794 : cluster [DBG] pgmap v883: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:10.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:09 smithi051 bash[18409]: cluster 2020-06-27T05:06:08.229183+0000 mgr.x (mgr.34109) 795 : cluster [DBG] pgmap v884: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:10.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:09 smithi031 bash[18426]: cluster 2020-06-27T05:06:08.229183+0000 mgr.x (mgr.34109) 795 : cluster [DBG] pgmap v884: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:10.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:09 smithi031 bash[22603]: cluster 2020-06-27T05:06:08.229183+0000 mgr.x (mgr.34109) 795 : cluster [DBG] pgmap v884: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:12.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:11 smithi051 bash[18409]: cluster 2020-06-27T05:06:10.230825+0000 mgr.x (mgr.34109) 796 : cluster [DBG] pgmap v885: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:12.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:11 smithi031 bash[18426]: cluster 2020-06-27T05:06:10.230825+0000 mgr.x (mgr.34109) 796 : cluster [DBG] pgmap v885: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:12.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:11 smithi031 bash[22603]: cluster 2020-06-27T05:06:10.230825+0000 mgr.x (mgr.34109) 796 : cluster [DBG] pgmap v885: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:14.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:13 smithi051 bash[18409]: cluster 2020-06-27T05:06:12.232579+0000 mgr.x (mgr.34109) 797 : cluster [DBG] pgmap v886: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:14.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:13 smithi031 bash[18426]: cluster 2020-06-27T05:06:12.232579+0000 mgr.x (mgr.34109) 797 : cluster [DBG] pgmap v886: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:14.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:13 smithi031 bash[22603]: cluster 2020-06-27T05:06:12.232579+0000 mgr.x (mgr.34109) 797 : cluster [DBG] pgmap v886: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:15 smithi051 bash[18409]: cluster 2020-06-27T05:06:14.234161+0000 mgr.x (mgr.34109) 798 : cluster [DBG] pgmap v887: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:15 smithi031 bash[18426]: cluster 2020-06-27T05:06:14.234161+0000 mgr.x (mgr.34109) 798 : cluster [DBG] pgmap v887: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:16.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:15 smithi031 bash[22603]: cluster 2020-06-27T05:06:14.234161+0000 mgr.x (mgr.34109) 798 : cluster [DBG] pgmap v887: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:18.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:17 smithi051 bash[18409]: cluster 2020-06-27T05:06:16.235784+0000 mgr.x (mgr.34109) 799 : cluster [DBG] pgmap v888: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:18.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:17 smithi031 bash[18426]: cluster 2020-06-27T05:06:16.235784+0000 mgr.x (mgr.34109) 799 : cluster [DBG] pgmap v888: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:18.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:17 smithi031 bash[22603]: cluster 2020-06-27T05:06:16.235784+0000 mgr.x (mgr.34109) 799 : cluster [DBG] pgmap v888: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:20.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:19 smithi051 bash[18409]: cluster 2020-06-27T05:06:18.237371+0000 mgr.x (mgr.34109) 800 : cluster [DBG] pgmap v889: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:20.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:19 smithi031 bash[18426]: cluster 2020-06-27T05:06:18.237371+0000 mgr.x (mgr.34109) 800 : cluster [DBG] pgmap v889: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:20.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:19 smithi031 bash[22603]: cluster 2020-06-27T05:06:18.237371+0000 mgr.x (mgr.34109) 800 : cluster [DBG] pgmap v889: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:22.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:21 smithi051 bash[18409]: cluster 2020-06-27T05:06:20.239105+0000 mgr.x (mgr.34109) 801 : cluster [DBG] pgmap v890: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:22.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:21 smithi031 bash[18426]: cluster 2020-06-27T05:06:20.239105+0000 mgr.x (mgr.34109) 801 : cluster [DBG] pgmap v890: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:22.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:21 smithi031 bash[22603]: cluster 2020-06-27T05:06:20.239105+0000 mgr.x (mgr.34109) 801 : cluster [DBG] pgmap v890: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:24.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:23 smithi051 bash[18409]: cluster 2020-06-27T05:06:22.240904+0000 mgr.x (mgr.34109) 802 : cluster [DBG] pgmap v891: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:24.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:23 smithi031 bash[18426]: cluster 2020-06-27T05:06:22.240904+0000 mgr.x (mgr.34109) 802 : cluster [DBG] pgmap v891: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:24.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:23 smithi031 bash[22603]: cluster 2020-06-27T05:06:22.240904+0000 mgr.x (mgr.34109) 802 : cluster [DBG] pgmap v891: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:26.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:25 smithi051 bash[18409]: cluster 2020-06-27T05:06:24.242587+0000 mgr.x (mgr.34109) 803 : cluster [DBG] pgmap v892: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:25 smithi031 bash[18426]: cluster 2020-06-27T05:06:24.242587+0000 mgr.x (mgr.34109) 803 : cluster [DBG] pgmap v892: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:25 smithi031 bash[22603]: cluster 2020-06-27T05:06:24.242587+0000 mgr.x (mgr.34109) 803 : cluster [DBG] pgmap v892: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:28.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:27 smithi051 bash[18409]: cluster 2020-06-27T05:06:26.244287+0000 mgr.x (mgr.34109) 804 : cluster [DBG] pgmap v893: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:28.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:27 smithi031 bash[18426]: cluster 2020-06-27T05:06:26.244287+0000 mgr.x (mgr.34109) 804 : cluster [DBG] pgmap v893: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:28.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:27 smithi031 bash[22603]: cluster 2020-06-27T05:06:26.244287+0000 mgr.x (mgr.34109) 804 : cluster [DBG] pgmap v893: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:30.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:29 smithi051 bash[18409]: cluster 2020-06-27T05:06:28.245965+0000 mgr.x (mgr.34109) 805 : cluster [DBG] pgmap v894: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:30.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:29 smithi031 bash[18426]: cluster 2020-06-27T05:06:28.245965+0000 mgr.x (mgr.34109) 805 : cluster [DBG] pgmap v894: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:30.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:29 smithi031 bash[22603]: cluster 2020-06-27T05:06:28.245965+0000 mgr.x (mgr.34109) 805 : cluster [DBG] pgmap v894: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:32.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:31 smithi051 bash[18409]: cluster 2020-06-27T05:06:30.247647+0000 mgr.x (mgr.34109) 806 : cluster [DBG] pgmap v895: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:32.222 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:31 smithi031 bash[18426]: cluster 2020-06-27T05:06:30.247647+0000 mgr.x (mgr.34109) 806 : cluster [DBG] pgmap v895: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:32.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:31 smithi031 bash[22603]: cluster 2020-06-27T05:06:30.247647+0000 mgr.x (mgr.34109) 806 : cluster [DBG] pgmap v895: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:34.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:33 smithi051 bash[18409]: cluster 2020-06-27T05:06:32.249382+0000 mgr.x (mgr.34109) 807 : cluster [DBG] pgmap v896: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:34.222 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:33 smithi031 bash[18426]: cluster 2020-06-27T05:06:32.249382+0000 mgr.x (mgr.34109) 807 : cluster [DBG] pgmap v896: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:34.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:33 smithi031 bash[22603]: cluster 2020-06-27T05:06:32.249382+0000 mgr.x (mgr.34109) 807 : cluster [DBG] pgmap v896: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:35 smithi051 bash[18409]: cluster 2020-06-27T05:06:34.251010+0000 mgr.x (mgr.34109) 808 : cluster [DBG] pgmap v897: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:36.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:35 smithi031 bash[18426]: cluster 2020-06-27T05:06:34.251010+0000 mgr.x (mgr.34109) 808 : cluster [DBG] pgmap v897: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:36.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:35 smithi031 bash[22603]: cluster 2020-06-27T05:06:34.251010+0000 mgr.x (mgr.34109) 808 : cluster [DBG] pgmap v897: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:38.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:37 smithi031 bash[18426]: cluster 2020-06-27T05:06:36.252610+0000 mgr.x (mgr.34109) 809 : cluster [DBG] pgmap v898: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:38.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:37 smithi031 bash[22603]: cluster 2020-06-27T05:06:36.252610+0000 mgr.x (mgr.34109) 809 : cluster [DBG] pgmap v898: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:38.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:37 smithi051 bash[18409]: cluster 2020-06-27T05:06:36.252610+0000 mgr.x (mgr.34109) 809 : cluster [DBG] pgmap v898: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:40.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:39 smithi051 bash[18409]: cluster 2020-06-27T05:06:38.254328+0000 mgr.x (mgr.34109) 810 : cluster [DBG] pgmap v899: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:40.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:39 smithi031 bash[18426]: cluster 2020-06-27T05:06:38.254328+0000 mgr.x (mgr.34109) 810 : cluster [DBG] pgmap v899: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:40.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:39 smithi031 bash[22603]: cluster 2020-06-27T05:06:38.254328+0000 mgr.x (mgr.34109) 810 : cluster [DBG] pgmap v899: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:42.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:41 smithi051 bash[18409]: cluster 2020-06-27T05:06:40.256022+0000 mgr.x (mgr.34109) 811 : cluster [DBG] pgmap v900: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:42.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:41 smithi031 bash[18426]: cluster 2020-06-27T05:06:40.256022+0000 mgr.x (mgr.34109) 811 : cluster [DBG] pgmap v900: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:42.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:41 smithi031 bash[22603]: cluster 2020-06-27T05:06:40.256022+0000 mgr.x (mgr.34109) 811 : cluster [DBG] pgmap v900: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:44.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:43 smithi051 bash[18409]: cluster 2020-06-27T05:06:42.257675+0000 mgr.x (mgr.34109) 812 : cluster [DBG] pgmap v901: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:44.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:43 smithi031 bash[18426]: cluster 2020-06-27T05:06:42.257675+0000 mgr.x (mgr.34109) 812 : cluster [DBG] pgmap v901: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:44.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:43 smithi031 bash[22603]: cluster 2020-06-27T05:06:42.257675+0000 mgr.x (mgr.34109) 812 : cluster [DBG] pgmap v901: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:46.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:45 smithi051 bash[18409]: cluster 2020-06-27T05:06:44.259279+0000 mgr.x (mgr.34109) 813 : cluster [DBG] pgmap v902: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:46.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:45 smithi031 bash[18426]: cluster 2020-06-27T05:06:44.259279+0000 mgr.x (mgr.34109) 813 : cluster [DBG] pgmap v902: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:46.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:45 smithi031 bash[22603]: cluster 2020-06-27T05:06:44.259279+0000 mgr.x (mgr.34109) 813 : cluster [DBG] pgmap v902: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:48.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:48 smithi051 bash[18409]: cluster 2020-06-27T05:06:46.260893+0000 mgr.x (mgr.34109) 814 : cluster [DBG] pgmap v903: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:48.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:48 smithi031 bash[18426]: cluster 2020-06-27T05:06:46.260893+0000 mgr.x (mgr.34109) 814 : cluster [DBG] pgmap v903: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:48.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:48 smithi031 bash[22603]: cluster 2020-06-27T05:06:46.260893+0000 mgr.x (mgr.34109) 814 : cluster [DBG] pgmap v903: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:50.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:50 smithi051 bash[18409]: cluster 2020-06-27T05:06:48.262527+0000 mgr.x (mgr.34109) 815 : cluster [DBG] pgmap v904: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:50.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:50 smithi031 bash[18426]: cluster 2020-06-27T05:06:48.262527+0000 mgr.x (mgr.34109) 815 : cluster [DBG] pgmap v904: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:50.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:50 smithi031 bash[22603]: cluster 2020-06-27T05:06:48.262527+0000 mgr.x (mgr.34109) 815 : cluster [DBG] pgmap v904: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:52.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:52 smithi051 bash[18409]: cluster 2020-06-27T05:06:50.264060+0000 mgr.x (mgr.34109) 816 : cluster [DBG] pgmap v905: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:52.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:52 smithi031 bash[18426]: cluster 2020-06-27T05:06:50.264060+0000 mgr.x (mgr.34109) 816 : cluster [DBG] pgmap v905: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:52.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:52 smithi031 bash[22603]: cluster 2020-06-27T05:06:50.264060+0000 mgr.x (mgr.34109) 816 : cluster [DBG] pgmap v905: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:54.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:54 smithi051 bash[18409]: cluster 2020-06-27T05:06:52.265724+0000 mgr.x (mgr.34109) 817 : cluster [DBG] pgmap v906: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:54.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:54 smithi031 bash[18426]: cluster 2020-06-27T05:06:52.265724+0000 mgr.x (mgr.34109) 817 : cluster [DBG] pgmap v906: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:54.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:54 smithi031 bash[22603]: cluster 2020-06-27T05:06:52.265724+0000 mgr.x (mgr.34109) 817 : cluster [DBG] pgmap v906: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:56.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:56 smithi051 bash[18409]: cluster 2020-06-27T05:06:54.267409+0000 mgr.x (mgr.34109) 818 : cluster [DBG] pgmap v907: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:56.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:56 smithi031 bash[18426]: cluster 2020-06-27T05:06:54.267409+0000 mgr.x (mgr.34109) 818 : cluster [DBG] pgmap v907: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:56.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:56 smithi031 bash[22603]: cluster 2020-06-27T05:06:54.267409+0000 mgr.x (mgr.34109) 818 : cluster [DBG] pgmap v907: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:58.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:06:58 smithi051 bash[18409]: cluster 2020-06-27T05:06:56.269006+0000 mgr.x (mgr.34109) 819 : cluster [DBG] pgmap v908: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:58.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:06:58 smithi031 bash[18426]: cluster 2020-06-27T05:06:56.269006+0000 mgr.x (mgr.34109) 819 : cluster [DBG] pgmap v908: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:06:58.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:06:58 smithi031 bash[22603]: cluster 2020-06-27T05:06:56.269006+0000 mgr.x (mgr.34109) 819 : cluster [DBG] pgmap v908: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:00 smithi051 bash[18409]: cluster 2020-06-27T05:06:58.270615+0000 mgr.x (mgr.34109) 820 : cluster [DBG] pgmap v909: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:00.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:00 smithi031 bash[18426]: cluster 2020-06-27T05:06:58.270615+0000 mgr.x (mgr.34109) 820 : cluster [DBG] pgmap v909: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:00.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:00 smithi031 bash[22603]: cluster 2020-06-27T05:06:58.270615+0000 mgr.x (mgr.34109) 820 : cluster [DBG] pgmap v909: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:02.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:02 smithi051 bash[18409]: cluster 2020-06-27T05:07:00.272245+0000 mgr.x (mgr.34109) 821 : cluster [DBG] pgmap v910: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:02.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:02 smithi031 bash[18426]: cluster 2020-06-27T05:07:00.272245+0000 mgr.x (mgr.34109) 821 : cluster [DBG] pgmap v910: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:02.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:02 smithi031 bash[22603]: cluster 2020-06-27T05:07:00.272245+0000 mgr.x (mgr.34109) 821 : cluster [DBG] pgmap v910: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:04.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:04 smithi051 bash[18409]: cluster 2020-06-27T05:07:02.273886+0000 mgr.x (mgr.34109) 822 : cluster [DBG] pgmap v911: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:04.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:04 smithi031 bash[18426]: cluster 2020-06-27T05:07:02.273886+0000 mgr.x (mgr.34109) 822 : cluster [DBG] pgmap v911: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:04.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:04 smithi031 bash[22603]: cluster 2020-06-27T05:07:02.273886+0000 mgr.x (mgr.34109) 822 : cluster [DBG] pgmap v911: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:06.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:06 smithi051 bash[18409]: cluster 2020-06-27T05:07:04.275615+0000 mgr.x (mgr.34109) 823 : cluster [DBG] pgmap v912: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:06.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:06 smithi031 bash[18426]: cluster 2020-06-27T05:07:04.275615+0000 mgr.x (mgr.34109) 823 : cluster [DBG] pgmap v912: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:06.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:06 smithi031 bash[22603]: cluster 2020-06-27T05:07:04.275615+0000 mgr.x (mgr.34109) 823 : cluster [DBG] pgmap v912: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:08.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:08 smithi051 bash[18409]: cluster 2020-06-27T05:07:06.277319+0000 mgr.x (mgr.34109) 824 : cluster [DBG] pgmap v913: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:08.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:08 smithi031 bash[18426]: cluster 2020-06-27T05:07:06.277319+0000 mgr.x (mgr.34109) 824 : cluster [DBG] pgmap v913: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:08.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:08 smithi031 bash[22603]: cluster 2020-06-27T05:07:06.277319+0000 mgr.x (mgr.34109) 824 : cluster [DBG] pgmap v913: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:10.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:10 smithi051 bash[18409]: cluster 2020-06-27T05:07:08.278983+0000 mgr.x (mgr.34109) 825 : cluster [DBG] pgmap v914: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:10.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:10 smithi031 bash[18426]: cluster 2020-06-27T05:07:08.278983+0000 mgr.x (mgr.34109) 825 : cluster [DBG] pgmap v914: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:10.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:10 smithi031 bash[22603]: cluster 2020-06-27T05:07:08.278983+0000 mgr.x (mgr.34109) 825 : cluster [DBG] pgmap v914: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:11.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:11 smithi051 bash[18409]: cluster 2020-06-27T05:07:10.280715+0000 mgr.x (mgr.34109) 826 : cluster [DBG] pgmap v915: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:11 smithi031 bash[18426]: cluster 2020-06-27T05:07:10.280715+0000 mgr.x (mgr.34109) 826 : cluster [DBG] pgmap v915: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:11.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:11 smithi031 bash[22603]: cluster 2020-06-27T05:07:10.280715+0000 mgr.x (mgr.34109) 826 : cluster [DBG] pgmap v915: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:13.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:13 smithi051 bash[18409]: cluster 2020-06-27T05:07:12.282378+0000 mgr.x (mgr.34109) 827 : cluster [DBG] pgmap v916: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:13.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:13 smithi031 bash[18426]: cluster 2020-06-27T05:07:12.282378+0000 mgr.x (mgr.34109) 827 : cluster [DBG] pgmap v916: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:13.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:13 smithi031 bash[22603]: cluster 2020-06-27T05:07:12.282378+0000 mgr.x (mgr.34109) 827 : cluster [DBG] pgmap v916: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:15.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:15 smithi051 bash[18409]: cluster 2020-06-27T05:07:14.283980+0000 mgr.x (mgr.34109) 828 : cluster [DBG] pgmap v917: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:15.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:15 smithi031 bash[18426]: cluster 2020-06-27T05:07:14.283980+0000 mgr.x (mgr.34109) 828 : cluster [DBG] pgmap v917: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:15.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:15 smithi031 bash[22603]: cluster 2020-06-27T05:07:14.283980+0000 mgr.x (mgr.34109) 828 : cluster [DBG] pgmap v917: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:17.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:17 smithi051 bash[18409]: cluster 2020-06-27T05:07:16.285622+0000 mgr.x (mgr.34109) 829 : cluster [DBG] pgmap v918: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:17.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:17 smithi031 bash[18426]: cluster 2020-06-27T05:07:16.285622+0000 mgr.x (mgr.34109) 829 : cluster [DBG] pgmap v918: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:17.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:17 smithi031 bash[22603]: cluster 2020-06-27T05:07:16.285622+0000 mgr.x (mgr.34109) 829 : cluster [DBG] pgmap v918: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:19.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:19 smithi051 bash[18409]: cluster 2020-06-27T05:07:18.287280+0000 mgr.x (mgr.34109) 830 : cluster [DBG] pgmap v919: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:19.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:19 smithi031 bash[18426]: cluster 2020-06-27T05:07:18.287280+0000 mgr.x (mgr.34109) 830 : cluster [DBG] pgmap v919: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:19.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:19 smithi031 bash[22603]: cluster 2020-06-27T05:07:18.287280+0000 mgr.x (mgr.34109) 830 : cluster [DBG] pgmap v919: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:21.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:21 smithi051 bash[18409]: cluster 2020-06-27T05:07:20.288953+0000 mgr.x (mgr.34109) 831 : cluster [DBG] pgmap v920: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:21.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:21 smithi031 bash[18426]: cluster 2020-06-27T05:07:20.288953+0000 mgr.x (mgr.34109) 831 : cluster [DBG] pgmap v920: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:21.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:21 smithi031 bash[22603]: cluster 2020-06-27T05:07:20.288953+0000 mgr.x (mgr.34109) 831 : cluster [DBG] pgmap v920: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:23.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:23 smithi051 bash[18409]: cluster 2020-06-27T05:07:22.290611+0000 mgr.x (mgr.34109) 832 : cluster [DBG] pgmap v921: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:23.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:23 smithi031 bash[22603]: cluster 2020-06-27T05:07:22.290611+0000 mgr.x (mgr.34109) 832 : cluster [DBG] pgmap v921: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:23.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:23 smithi031 bash[18426]: cluster 2020-06-27T05:07:22.290611+0000 mgr.x (mgr.34109) 832 : cluster [DBG] pgmap v921: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:25.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:25 smithi051 bash[18409]: cluster 2020-06-27T05:07:24.292225+0000 mgr.x (mgr.34109) 833 : cluster [DBG] pgmap v922: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:25.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:25 smithi031 bash[18426]: cluster 2020-06-27T05:07:24.292225+0000 mgr.x (mgr.34109) 833 : cluster [DBG] pgmap v922: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:25.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:25 smithi031 bash[22603]: cluster 2020-06-27T05:07:24.292225+0000 mgr.x (mgr.34109) 833 : cluster [DBG] pgmap v922: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:27.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:27 smithi051 bash[18409]: cluster 2020-06-27T05:07:26.293887+0000 mgr.x (mgr.34109) 834 : cluster [DBG] pgmap v923: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:27.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:27 smithi031 bash[18426]: cluster 2020-06-27T05:07:26.293887+0000 mgr.x (mgr.34109) 834 : cluster [DBG] pgmap v923: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:27.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:27 smithi031 bash[22603]: cluster 2020-06-27T05:07:26.293887+0000 mgr.x (mgr.34109) 834 : cluster [DBG] pgmap v923: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:29.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:29 smithi051 bash[18409]: cluster 2020-06-27T05:07:28.295555+0000 mgr.x (mgr.34109) 835 : cluster [DBG] pgmap v924: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:29.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:29 smithi031 bash[18426]: cluster 2020-06-27T05:07:28.295555+0000 mgr.x (mgr.34109) 835 : cluster [DBG] pgmap v924: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:29.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:29 smithi031 bash[22603]: cluster 2020-06-27T05:07:28.295555+0000 mgr.x (mgr.34109) 835 : cluster [DBG] pgmap v924: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:31.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:31 smithi051 bash[18409]: cluster 2020-06-27T05:07:30.297190+0000 mgr.x (mgr.34109) 836 : cluster [DBG] pgmap v925: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:31.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:31 smithi031 bash[18426]: cluster 2020-06-27T05:07:30.297190+0000 mgr.x (mgr.34109) 836 : cluster [DBG] pgmap v925: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:31.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:31 smithi031 bash[22603]: cluster 2020-06-27T05:07:30.297190+0000 mgr.x (mgr.34109) 836 : cluster [DBG] pgmap v925: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:33.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:33 smithi051 bash[18409]: cluster 2020-06-27T05:07:32.298814+0000 mgr.x (mgr.34109) 837 : cluster [DBG] pgmap v926: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:33.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:33 smithi031 bash[18426]: cluster 2020-06-27T05:07:32.298814+0000 mgr.x (mgr.34109) 837 : cluster [DBG] pgmap v926: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:33.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:33 smithi031 bash[22603]: cluster 2020-06-27T05:07:32.298814+0000 mgr.x (mgr.34109) 837 : cluster [DBG] pgmap v926: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:35.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:35 smithi051 bash[18409]: cluster 2020-06-27T05:07:34.300584+0000 mgr.x (mgr.34109) 838 : cluster [DBG] pgmap v927: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:35.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:35 smithi031 bash[18426]: cluster 2020-06-27T05:07:34.300584+0000 mgr.x (mgr.34109) 838 : cluster [DBG] pgmap v927: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:35.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:35 smithi031 bash[22603]: cluster 2020-06-27T05:07:34.300584+0000 mgr.x (mgr.34109) 838 : cluster [DBG] pgmap v927: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:37.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:37 smithi051 bash[18409]: cluster 2020-06-27T05:07:36.302252+0000 mgr.x (mgr.34109) 839 : cluster [DBG] pgmap v928: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:37.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:37 smithi031 bash[22603]: cluster 2020-06-27T05:07:36.302252+0000 mgr.x (mgr.34109) 839 : cluster [DBG] pgmap v928: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:37.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:37 smithi031 bash[18426]: cluster 2020-06-27T05:07:36.302252+0000 mgr.x (mgr.34109) 839 : cluster [DBG] pgmap v928: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:39.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:39 smithi051 bash[18409]: cluster 2020-06-27T05:07:38.303900+0000 mgr.x (mgr.34109) 840 : cluster [DBG] pgmap v929: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:39.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:39 smithi031 bash[22603]: cluster 2020-06-27T05:07:38.303900+0000 mgr.x (mgr.34109) 840 : cluster [DBG] pgmap v929: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:39.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:39 smithi031 bash[18426]: cluster 2020-06-27T05:07:38.303900+0000 mgr.x (mgr.34109) 840 : cluster [DBG] pgmap v929: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:41.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:41 smithi051 bash[18409]: cluster 2020-06-27T05:07:40.305660+0000 mgr.x (mgr.34109) 841 : cluster [DBG] pgmap v930: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:41.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:41 smithi031 bash[18426]: cluster 2020-06-27T05:07:40.305660+0000 mgr.x (mgr.34109) 841 : cluster [DBG] pgmap v930: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:41.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:41 smithi031 bash[22603]: cluster 2020-06-27T05:07:40.305660+0000 mgr.x (mgr.34109) 841 : cluster [DBG] pgmap v930: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:43.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:43 smithi051 bash[18409]: cluster 2020-06-27T05:07:42.307432+0000 mgr.x (mgr.34109) 842 : cluster [DBG] pgmap v931: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:43.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:43 smithi031 bash[18426]: cluster 2020-06-27T05:07:42.307432+0000 mgr.x (mgr.34109) 842 : cluster [DBG] pgmap v931: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:43.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:43 smithi031 bash[22603]: cluster 2020-06-27T05:07:42.307432+0000 mgr.x (mgr.34109) 842 : cluster [DBG] pgmap v931: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:45.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:45 smithi051 bash[18409]: cluster 2020-06-27T05:07:44.309140+0000 mgr.x (mgr.34109) 843 : cluster [DBG] pgmap v932: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:45.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:45 smithi031 bash[18426]: cluster 2020-06-27T05:07:44.309140+0000 mgr.x (mgr.34109) 843 : cluster [DBG] pgmap v932: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:45.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:45 smithi031 bash[22603]: cluster 2020-06-27T05:07:44.309140+0000 mgr.x (mgr.34109) 843 : cluster [DBG] pgmap v932: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:47.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:47 smithi051 bash[18409]: cluster 2020-06-27T05:07:46.310782+0000 mgr.x (mgr.34109) 844 : cluster [DBG] pgmap v933: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:47.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:47 smithi031 bash[18426]: cluster 2020-06-27T05:07:46.310782+0000 mgr.x (mgr.34109) 844 : cluster [DBG] pgmap v933: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:47.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:47 smithi031 bash[22603]: cluster 2020-06-27T05:07:46.310782+0000 mgr.x (mgr.34109) 844 : cluster [DBG] pgmap v933: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:49.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:49 smithi031 bash[22603]: cluster 2020-06-27T05:07:48.312408+0000 mgr.x (mgr.34109) 845 : cluster [DBG] pgmap v934: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:49.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:49 smithi031 bash[18426]: cluster 2020-06-27T05:07:48.312408+0000 mgr.x (mgr.34109) 845 : cluster [DBG] pgmap v934: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:50.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:49 smithi051 bash[18409]: cluster 2020-06-27T05:07:48.312408+0000 mgr.x (mgr.34109) 845 : cluster [DBG] pgmap v934: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:52.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:51 smithi051 bash[18409]: cluster 2020-06-27T05:07:50.314141+0000 mgr.x (mgr.34109) 846 : cluster [DBG] pgmap v935: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:52.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:51 smithi031 bash[18426]: cluster 2020-06-27T05:07:50.314141+0000 mgr.x (mgr.34109) 846 : cluster [DBG] pgmap v935: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:52.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:51 smithi031 bash[22603]: cluster 2020-06-27T05:07:50.314141+0000 mgr.x (mgr.34109) 846 : cluster [DBG] pgmap v935: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:54.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:53 smithi051 bash[18409]: cluster 2020-06-27T05:07:52.315839+0000 mgr.x (mgr.34109) 847 : cluster [DBG] pgmap v936: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:54.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:53 smithi031 bash[18426]: cluster 2020-06-27T05:07:52.315839+0000 mgr.x (mgr.34109) 847 : cluster [DBG] pgmap v936: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:54.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:53 smithi031 bash[22603]: cluster 2020-06-27T05:07:52.315839+0000 mgr.x (mgr.34109) 847 : cluster [DBG] pgmap v936: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:55 smithi051 bash[18409]: cluster 2020-06-27T05:07:54.317535+0000 mgr.x (mgr.34109) 848 : cluster [DBG] pgmap v937: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:55 smithi031 bash[18426]: cluster 2020-06-27T05:07:54.317535+0000 mgr.x (mgr.34109) 848 : cluster [DBG] pgmap v937: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:56.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:55 smithi031 bash[22603]: cluster 2020-06-27T05:07:54.317535+0000 mgr.x (mgr.34109) 848 : cluster [DBG] pgmap v937: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:58.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:57 smithi051 bash[18409]: cluster 2020-06-27T05:07:56.319239+0000 mgr.x (mgr.34109) 849 : cluster [DBG] pgmap v938: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:58.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:57 smithi031 bash[18426]: cluster 2020-06-27T05:07:56.319239+0000 mgr.x (mgr.34109) 849 : cluster [DBG] pgmap v938: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:07:58.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:57 smithi031 bash[22603]: cluster 2020-06-27T05:07:56.319239+0000 mgr.x (mgr.34109) 849 : cluster [DBG] pgmap v938: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:00.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:07:59 smithi051 bash[18409]: cluster 2020-06-27T05:07:58.320847+0000 mgr.x (mgr.34109) 850 : cluster [DBG] pgmap v939: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:00.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:07:59 smithi031 bash[18426]: cluster 2020-06-27T05:07:58.320847+0000 mgr.x (mgr.34109) 850 : cluster [DBG] pgmap v939: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:00.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:07:59 smithi031 bash[22603]: cluster 2020-06-27T05:07:58.320847+0000 mgr.x (mgr.34109) 850 : cluster [DBG] pgmap v939: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:02.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:01 smithi051 bash[18409]: cluster 2020-06-27T05:08:00.322537+0000 mgr.x (mgr.34109) 851 : cluster [DBG] pgmap v940: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:02.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:01 smithi031 bash[18426]: cluster 2020-06-27T05:08:00.322537+0000 mgr.x (mgr.34109) 851 : cluster [DBG] pgmap v940: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:02.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:01 smithi031 bash[22603]: cluster 2020-06-27T05:08:00.322537+0000 mgr.x (mgr.34109) 851 : cluster [DBG] pgmap v940: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:04.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:03 smithi051 bash[18409]: cluster 2020-06-27T05:08:02.324293+0000 mgr.x (mgr.34109) 852 : cluster [DBG] pgmap v941: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:04.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:03 smithi031 bash[18426]: cluster 2020-06-27T05:08:02.324293+0000 mgr.x (mgr.34109) 852 : cluster [DBG] pgmap v941: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:04.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:03 smithi031 bash[22603]: cluster 2020-06-27T05:08:02.324293+0000 mgr.x (mgr.34109) 852 : cluster [DBG] pgmap v941: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:06.224 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:05 smithi051 bash[18409]: cluster 2020-06-27T05:08:04.325918+0000 mgr.x (mgr.34109) 853 : cluster [DBG] pgmap v942: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:06.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:05 smithi031 bash[18426]: cluster 2020-06-27T05:08:04.325918+0000 mgr.x (mgr.34109) 853 : cluster [DBG] pgmap v942: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:06.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:05 smithi031 bash[22603]: cluster 2020-06-27T05:08:04.325918+0000 mgr.x (mgr.34109) 853 : cluster [DBG] pgmap v942: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:08.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:07 smithi051 bash[18409]: cluster 2020-06-27T05:08:06.327658+0000 mgr.x (mgr.34109) 854 : cluster [DBG] pgmap v943: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:08.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:07 smithi031 bash[18426]: cluster 2020-06-27T05:08:06.327658+0000 mgr.x (mgr.34109) 854 : cluster [DBG] pgmap v943: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:08.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:07 smithi031 bash[22603]: cluster 2020-06-27T05:08:06.327658+0000 mgr.x (mgr.34109) 854 : cluster [DBG] pgmap v943: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:10.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:09 smithi051 bash[18409]: cluster 2020-06-27T05:08:08.329267+0000 mgr.x (mgr.34109) 855 : cluster [DBG] pgmap v944: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:10.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:09 smithi031 bash[18426]: cluster 2020-06-27T05:08:08.329267+0000 mgr.x (mgr.34109) 855 : cluster [DBG] pgmap v944: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:10.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:09 smithi031 bash[22603]: cluster 2020-06-27T05:08:08.329267+0000 mgr.x (mgr.34109) 855 : cluster [DBG] pgmap v944: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:12.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:11 smithi051 bash[18409]: cluster 2020-06-27T05:08:10.330899+0000 mgr.x (mgr.34109) 856 : cluster [DBG] pgmap v945: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:12.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:11 smithi031 bash[18426]: cluster 2020-06-27T05:08:10.330899+0000 mgr.x (mgr.34109) 856 : cluster [DBG] pgmap v945: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:12.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:11 smithi031 bash[22603]: cluster 2020-06-27T05:08:10.330899+0000 mgr.x (mgr.34109) 856 : cluster [DBG] pgmap v945: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:14.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:13 smithi051 bash[18409]: cluster 2020-06-27T05:08:12.332539+0000 mgr.x (mgr.34109) 857 : cluster [DBG] pgmap v946: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:14.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:13 smithi031 bash[18426]: cluster 2020-06-27T05:08:12.332539+0000 mgr.x (mgr.34109) 857 : cluster [DBG] pgmap v946: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:14.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:13 smithi031 bash[22603]: cluster 2020-06-27T05:08:12.332539+0000 mgr.x (mgr.34109) 857 : cluster [DBG] pgmap v946: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:15 smithi051 bash[18409]: cluster 2020-06-27T05:08:14.334077+0000 mgr.x (mgr.34109) 858 : cluster [DBG] pgmap v947: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:15 smithi031 bash[18426]: cluster 2020-06-27T05:08:14.334077+0000 mgr.x (mgr.34109) 858 : cluster [DBG] pgmap v947: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:16.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:15 smithi031 bash[22603]: cluster 2020-06-27T05:08:14.334077+0000 mgr.x (mgr.34109) 858 : cluster [DBG] pgmap v947: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:18.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:17 smithi051 bash[18409]: cluster 2020-06-27T05:08:16.335759+0000 mgr.x (mgr.34109) 859 : cluster [DBG] pgmap v948: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:18.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:17 smithi031 bash[18426]: cluster 2020-06-27T05:08:16.335759+0000 mgr.x (mgr.34109) 859 : cluster [DBG] pgmap v948: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:18.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:17 smithi031 bash[22603]: cluster 2020-06-27T05:08:16.335759+0000 mgr.x (mgr.34109) 859 : cluster [DBG] pgmap v948: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:20.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:19 smithi051 bash[18409]: cluster 2020-06-27T05:08:18.337321+0000 mgr.x (mgr.34109) 860 : cluster [DBG] pgmap v949: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:20.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:19 smithi031 bash[18426]: cluster 2020-06-27T05:08:18.337321+0000 mgr.x (mgr.34109) 860 : cluster [DBG] pgmap v949: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:20.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:19 smithi031 bash[22603]: cluster 2020-06-27T05:08:18.337321+0000 mgr.x (mgr.34109) 860 : cluster [DBG] pgmap v949: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:22.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:21 smithi051 bash[18409]: cluster 2020-06-27T05:08:20.338894+0000 mgr.x (mgr.34109) 861 : cluster [DBG] pgmap v950: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:22.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:21 smithi031 bash[22603]: cluster 2020-06-27T05:08:20.338894+0000 mgr.x (mgr.34109) 861 : cluster [DBG] pgmap v950: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:22.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:21 smithi031 bash[18426]: cluster 2020-06-27T05:08:20.338894+0000 mgr.x (mgr.34109) 861 : cluster [DBG] pgmap v950: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:24.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:23 smithi051 bash[18409]: cluster 2020-06-27T05:08:22.340607+0000 mgr.x (mgr.34109) 862 : cluster [DBG] pgmap v951: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:24.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:23 smithi031 bash[22603]: cluster 2020-06-27T05:08:22.340607+0000 mgr.x (mgr.34109) 862 : cluster [DBG] pgmap v951: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:24.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:23 smithi031 bash[18426]: cluster 2020-06-27T05:08:22.340607+0000 mgr.x (mgr.34109) 862 : cluster [DBG] pgmap v951: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:26.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:25 smithi051 bash[18409]: cluster 2020-06-27T05:08:24.342330+0000 mgr.x (mgr.34109) 863 : cluster [DBG] pgmap v952: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:25 smithi031 bash[18426]: cluster 2020-06-27T05:08:24.342330+0000 mgr.x (mgr.34109) 863 : cluster [DBG] pgmap v952: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:26.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:25 smithi031 bash[22603]: cluster 2020-06-27T05:08:24.342330+0000 mgr.x (mgr.34109) 863 : cluster [DBG] pgmap v952: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:28.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:27 smithi051 bash[18409]: cluster 2020-06-27T05:08:26.344062+0000 mgr.x (mgr.34109) 864 : cluster [DBG] pgmap v953: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:28.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:27 smithi031 bash[22603]: cluster 2020-06-27T05:08:26.344062+0000 mgr.x (mgr.34109) 864 : cluster [DBG] pgmap v953: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:28.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:27 smithi031 bash[18426]: cluster 2020-06-27T05:08:26.344062+0000 mgr.x (mgr.34109) 864 : cluster [DBG] pgmap v953: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:30.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:29 smithi051 bash[18409]: cluster 2020-06-27T05:08:28.345725+0000 mgr.x (mgr.34109) 865 : cluster [DBG] pgmap v954: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:30.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:29 smithi031 bash[18426]: cluster 2020-06-27T05:08:28.345725+0000 mgr.x (mgr.34109) 865 : cluster [DBG] pgmap v954: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:30.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:29 smithi031 bash[22603]: cluster 2020-06-27T05:08:28.345725+0000 mgr.x (mgr.34109) 865 : cluster [DBG] pgmap v954: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:32.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:31 smithi051 bash[18409]: cluster 2020-06-27T05:08:30.347458+0000 mgr.x (mgr.34109) 866 : cluster [DBG] pgmap v955: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:32.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:31 smithi031 bash[18426]: cluster 2020-06-27T05:08:30.347458+0000 mgr.x (mgr.34109) 866 : cluster [DBG] pgmap v955: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:32.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:31 smithi031 bash[22603]: cluster 2020-06-27T05:08:30.347458+0000 mgr.x (mgr.34109) 866 : cluster [DBG] pgmap v955: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:34.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:33 smithi051 bash[18409]: cluster 2020-06-27T05:08:32.349076+0000 mgr.x (mgr.34109) 867 : cluster [DBG] pgmap v956: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:34.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:33 smithi031 bash[18426]: cluster 2020-06-27T05:08:32.349076+0000 mgr.x (mgr.34109) 867 : cluster [DBG] pgmap v956: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:34.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:33 smithi031 bash[22603]: cluster 2020-06-27T05:08:32.349076+0000 mgr.x (mgr.34109) 867 : cluster [DBG] pgmap v956: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:35 smithi051 bash[18409]: cluster 2020-06-27T05:08:34.350811+0000 mgr.x (mgr.34109) 868 : cluster [DBG] pgmap v957: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:36.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:35 smithi031 bash[18426]: cluster 2020-06-27T05:08:34.350811+0000 mgr.x (mgr.34109) 868 : cluster [DBG] pgmap v957: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:36.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:35 smithi031 bash[22603]: cluster 2020-06-27T05:08:34.350811+0000 mgr.x (mgr.34109) 868 : cluster [DBG] pgmap v957: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:38.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:37 smithi051 bash[18409]: cluster 2020-06-27T05:08:36.352442+0000 mgr.x (mgr.34109) 869 : cluster [DBG] pgmap v958: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:38.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:37 smithi031 bash[18426]: cluster 2020-06-27T05:08:36.352442+0000 mgr.x (mgr.34109) 869 : cluster [DBG] pgmap v958: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:38.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:37 smithi031 bash[22603]: cluster 2020-06-27T05:08:36.352442+0000 mgr.x (mgr.34109) 869 : cluster [DBG] pgmap v958: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:40.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:39 smithi051 bash[18409]: cluster 2020-06-27T05:08:38.354131+0000 mgr.x (mgr.34109) 870 : cluster [DBG] pgmap v959: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:40.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:39 smithi031 bash[18426]: cluster 2020-06-27T05:08:38.354131+0000 mgr.x (mgr.34109) 870 : cluster [DBG] pgmap v959: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:40.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:39 smithi031 bash[22603]: cluster 2020-06-27T05:08:38.354131+0000 mgr.x (mgr.34109) 870 : cluster [DBG] pgmap v959: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:42.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:41 smithi051 bash[18409]: cluster 2020-06-27T05:08:40.355723+0000 mgr.x (mgr.34109) 871 : cluster [DBG] pgmap v960: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:42.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:41 smithi031 bash[18426]: cluster 2020-06-27T05:08:40.355723+0000 mgr.x (mgr.34109) 871 : cluster [DBG] pgmap v960: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:42.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:41 smithi031 bash[22603]: cluster 2020-06-27T05:08:40.355723+0000 mgr.x (mgr.34109) 871 : cluster [DBG] pgmap v960: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:44.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:43 smithi031 bash[22603]: cluster 2020-06-27T05:08:42.357338+0000 mgr.x (mgr.34109) 872 : cluster [DBG] pgmap v961: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:44.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:43 smithi031 bash[18426]: cluster 2020-06-27T05:08:42.357338+0000 mgr.x (mgr.34109) 872 : cluster [DBG] pgmap v961: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:44.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:43 smithi051 bash[18409]: cluster 2020-06-27T05:08:42.357338+0000 mgr.x (mgr.34109) 872 : cluster [DBG] pgmap v961: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:46.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:45 smithi031 bash[18426]: cluster 2020-06-27T05:08:44.358928+0000 mgr.x (mgr.34109) 873 : cluster [DBG] pgmap v962: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:46.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:45 smithi031 bash[22603]: cluster 2020-06-27T05:08:44.358928+0000 mgr.x (mgr.34109) 873 : cluster [DBG] pgmap v962: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:46.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:45 smithi051 bash[18409]: cluster 2020-06-27T05:08:44.358928+0000 mgr.x (mgr.34109) 873 : cluster [DBG] pgmap v962: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:48.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:47 smithi051 bash[18409]: cluster 2020-06-27T05:08:46.360656+0000 mgr.x (mgr.34109) 874 : cluster [DBG] pgmap v963: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:48.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:47 smithi031 bash[18426]: cluster 2020-06-27T05:08:46.360656+0000 mgr.x (mgr.34109) 874 : cluster [DBG] pgmap v963: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:48.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:47 smithi031 bash[22603]: cluster 2020-06-27T05:08:46.360656+0000 mgr.x (mgr.34109) 874 : cluster [DBG] pgmap v963: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:50.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:49 smithi051 bash[18409]: cluster 2020-06-27T05:08:48.362241+0000 mgr.x (mgr.34109) 875 : cluster [DBG] pgmap v964: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:50.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:49 smithi031 bash[18426]: cluster 2020-06-27T05:08:48.362241+0000 mgr.x (mgr.34109) 875 : cluster [DBG] pgmap v964: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:50.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:49 smithi031 bash[22603]: cluster 2020-06-27T05:08:48.362241+0000 mgr.x (mgr.34109) 875 : cluster [DBG] pgmap v964: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:52.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:51 smithi051 bash[18409]: cluster 2020-06-27T05:08:50.363952+0000 mgr.x (mgr.34109) 876 : cluster [DBG] pgmap v965: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:52.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:51 smithi031 bash[18426]: cluster 2020-06-27T05:08:50.363952+0000 mgr.x (mgr.34109) 876 : cluster [DBG] pgmap v965: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:52.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:51 smithi031 bash[22603]: cluster 2020-06-27T05:08:50.363952+0000 mgr.x (mgr.34109) 876 : cluster [DBG] pgmap v965: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:54.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:53 smithi051 bash[18409]: cluster 2020-06-27T05:08:52.365669+0000 mgr.x (mgr.34109) 877 : cluster [DBG] pgmap v966: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:54.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:53 smithi031 bash[18426]: cluster 2020-06-27T05:08:52.365669+0000 mgr.x (mgr.34109) 877 : cluster [DBG] pgmap v966: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:54.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:53 smithi031 bash[22603]: cluster 2020-06-27T05:08:52.365669+0000 mgr.x (mgr.34109) 877 : cluster [DBG] pgmap v966: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:56.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:55 smithi051 bash[18409]: cluster 2020-06-27T05:08:54.367392+0000 mgr.x (mgr.34109) 878 : cluster [DBG] pgmap v967: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:56.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:55 smithi031 bash[18426]: cluster 2020-06-27T05:08:54.367392+0000 mgr.x (mgr.34109) 878 : cluster [DBG] pgmap v967: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:56.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:55 smithi031 bash[22603]: cluster 2020-06-27T05:08:54.367392+0000 mgr.x (mgr.34109) 878 : cluster [DBG] pgmap v967: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:58.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:08:58 smithi051 bash[18409]: cluster 2020-06-27T05:08:56.369111+0000 mgr.x (mgr.34109) 879 : cluster [DBG] pgmap v968: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:58.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:08:57 smithi031 bash[18426]: cluster 2020-06-27T05:08:56.369111+0000 mgr.x (mgr.34109) 879 : cluster [DBG] pgmap v968: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:08:58.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:08:58 smithi031 bash[22603]: cluster 2020-06-27T05:08:56.369111+0000 mgr.x (mgr.34109) 879 : cluster [DBG] pgmap v968: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:00 smithi051 bash[18409]: cluster 2020-06-27T05:08:58.370736+0000 mgr.x (mgr.34109) 880 : cluster [DBG] pgmap v969: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:00.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:00 smithi031 bash[18426]: cluster 2020-06-27T05:08:58.370736+0000 mgr.x (mgr.34109) 880 : cluster [DBG] pgmap v969: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:00.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:00 smithi031 bash[22603]: cluster 2020-06-27T05:08:58.370736+0000 mgr.x (mgr.34109) 880 : cluster [DBG] pgmap v969: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:02.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:02 smithi051 bash[18409]: cluster 2020-06-27T05:09:00.372469+0000 mgr.x (mgr.34109) 881 : cluster [DBG] pgmap v970: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:02.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:02 smithi031 bash[18426]: cluster 2020-06-27T05:09:00.372469+0000 mgr.x (mgr.34109) 881 : cluster [DBG] pgmap v970: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:02.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:02 smithi031 bash[22603]: cluster 2020-06-27T05:09:00.372469+0000 mgr.x (mgr.34109) 881 : cluster [DBG] pgmap v970: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:04.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:04 smithi051 bash[18409]: cluster 2020-06-27T05:09:02.374047+0000 mgr.x (mgr.34109) 882 : cluster [DBG] pgmap v971: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:04.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:04 smithi031 bash[18426]: cluster 2020-06-27T05:09:02.374047+0000 mgr.x (mgr.34109) 882 : cluster [DBG] pgmap v971: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:04.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:04 smithi031 bash[22603]: cluster 2020-06-27T05:09:02.374047+0000 mgr.x (mgr.34109) 882 : cluster [DBG] pgmap v971: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:06.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:06 smithi051 bash[18409]: cluster 2020-06-27T05:09:04.375737+0000 mgr.x (mgr.34109) 883 : cluster [DBG] pgmap v972: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:06.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:06 smithi031 bash[18426]: cluster 2020-06-27T05:09:04.375737+0000 mgr.x (mgr.34109) 883 : cluster [DBG] pgmap v972: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:06.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:06 smithi031 bash[22603]: cluster 2020-06-27T05:09:04.375737+0000 mgr.x (mgr.34109) 883 : cluster [DBG] pgmap v972: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:08.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:08 smithi051 bash[18409]: cluster 2020-06-27T05:09:06.377415+0000 mgr.x (mgr.34109) 884 : cluster [DBG] pgmap v973: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:08.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:08 smithi031 bash[18426]: cluster 2020-06-27T05:09:06.377415+0000 mgr.x (mgr.34109) 884 : cluster [DBG] pgmap v973: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:08.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:08 smithi031 bash[22603]: cluster 2020-06-27T05:09:06.377415+0000 mgr.x (mgr.34109) 884 : cluster [DBG] pgmap v973: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:10.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:10 smithi051 bash[18409]: cluster 2020-06-27T05:09:08.379108+0000 mgr.x (mgr.34109) 885 : cluster [DBG] pgmap v974: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:10.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:10 smithi031 bash[18426]: cluster 2020-06-27T05:09:08.379108+0000 mgr.x (mgr.34109) 885 : cluster [DBG] pgmap v974: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:10.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:10 smithi031 bash[22603]: cluster 2020-06-27T05:09:08.379108+0000 mgr.x (mgr.34109) 885 : cluster [DBG] pgmap v974: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:12.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:12 smithi051 bash[18409]: cluster 2020-06-27T05:09:10.380767+0000 mgr.x (mgr.34109) 886 : cluster [DBG] pgmap v975: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:12.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:12 smithi031 bash[18426]: cluster 2020-06-27T05:09:10.380767+0000 mgr.x (mgr.34109) 886 : cluster [DBG] pgmap v975: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:12.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:12 smithi031 bash[22603]: cluster 2020-06-27T05:09:10.380767+0000 mgr.x (mgr.34109) 886 : cluster [DBG] pgmap v975: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:14.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:14 smithi051 bash[18409]: cluster 2020-06-27T05:09:12.382202+0000 mgr.x (mgr.34109) 887 : cluster [DBG] pgmap v976: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:14.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:14 smithi031 bash[18426]: cluster 2020-06-27T05:09:12.382202+0000 mgr.x (mgr.34109) 887 : cluster [DBG] pgmap v976: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:14.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:14 smithi031 bash[22603]: cluster 2020-06-27T05:09:12.382202+0000 mgr.x (mgr.34109) 887 : cluster [DBG] pgmap v976: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:16.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:16 smithi051 bash[18409]: cluster 2020-06-27T05:09:14.383902+0000 mgr.x (mgr.34109) 888 : cluster [DBG] pgmap v977: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:16.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:16 smithi031 bash[18426]: cluster 2020-06-27T05:09:14.383902+0000 mgr.x (mgr.34109) 888 : cluster [DBG] pgmap v977: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:16.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:16 smithi031 bash[22603]: cluster 2020-06-27T05:09:14.383902+0000 mgr.x (mgr.34109) 888 : cluster [DBG] pgmap v977: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:18.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:18 smithi051 bash[18409]: cluster 2020-06-27T05:09:16.385574+0000 mgr.x (mgr.34109) 889 : cluster [DBG] pgmap v978: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:18.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:18 smithi031 bash[18426]: cluster 2020-06-27T05:09:16.385574+0000 mgr.x (mgr.34109) 889 : cluster [DBG] pgmap v978: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:18.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:18 smithi031 bash[22603]: cluster 2020-06-27T05:09:16.385574+0000 mgr.x (mgr.34109) 889 : cluster [DBG] pgmap v978: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:20.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:20 smithi051 bash[18409]: cluster 2020-06-27T05:09:18.387339+0000 mgr.x (mgr.34109) 890 : cluster [DBG] pgmap v979: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:20.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:20 smithi031 bash[18426]: cluster 2020-06-27T05:09:18.387339+0000 mgr.x (mgr.34109) 890 : cluster [DBG] pgmap v979: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:20.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:20 smithi031 bash[22603]: cluster 2020-06-27T05:09:18.387339+0000 mgr.x (mgr.34109) 890 : cluster [DBG] pgmap v979: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:22.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:22 smithi051 bash[18409]: cluster 2020-06-27T05:09:20.389055+0000 mgr.x (mgr.34109) 891 : cluster [DBG] pgmap v980: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:22.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:22 smithi031 bash[18426]: cluster 2020-06-27T05:09:20.389055+0000 mgr.x (mgr.34109) 891 : cluster [DBG] pgmap v980: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:22.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:22 smithi031 bash[22603]: cluster 2020-06-27T05:09:20.389055+0000 mgr.x (mgr.34109) 891 : cluster [DBG] pgmap v980: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:24.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:24 smithi051 bash[18409]: cluster 2020-06-27T05:09:22.390835+0000 mgr.x (mgr.34109) 892 : cluster [DBG] pgmap v981: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:24.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:24 smithi031 bash[18426]: cluster 2020-06-27T05:09:22.390835+0000 mgr.x (mgr.34109) 892 : cluster [DBG] pgmap v981: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:24.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:24 smithi031 bash[22603]: cluster 2020-06-27T05:09:22.390835+0000 mgr.x (mgr.34109) 892 : cluster [DBG] pgmap v981: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:26.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:26 smithi051 bash[18409]: cluster 2020-06-27T05:09:24.392613+0000 mgr.x (mgr.34109) 893 : cluster [DBG] pgmap v982: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:26.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:26 smithi031 bash[18426]: cluster 2020-06-27T05:09:24.392613+0000 mgr.x (mgr.34109) 893 : cluster [DBG] pgmap v982: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:26.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:26 smithi031 bash[22603]: cluster 2020-06-27T05:09:24.392613+0000 mgr.x (mgr.34109) 893 : cluster [DBG] pgmap v982: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:28.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:28 smithi051 bash[18409]: cluster 2020-06-27T05:09:26.394317+0000 mgr.x (mgr.34109) 894 : cluster [DBG] pgmap v983: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:28.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:28 smithi031 bash[18426]: cluster 2020-06-27T05:09:26.394317+0000 mgr.x (mgr.34109) 894 : cluster [DBG] pgmap v983: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:28.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:28 smithi031 bash[22603]: cluster 2020-06-27T05:09:26.394317+0000 mgr.x (mgr.34109) 894 : cluster [DBG] pgmap v983: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:30.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:30 smithi051 bash[18409]: cluster 2020-06-27T05:09:28.395964+0000 mgr.x (mgr.34109) 895 : cluster [DBG] pgmap v984: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:30.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:30 smithi031 bash[18426]: cluster 2020-06-27T05:09:28.395964+0000 mgr.x (mgr.34109) 895 : cluster [DBG] pgmap v984: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:30.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:30 smithi031 bash[22603]: cluster 2020-06-27T05:09:28.395964+0000 mgr.x (mgr.34109) 895 : cluster [DBG] pgmap v984: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:31.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:31 smithi051 bash[18409]: cluster 2020-06-27T05:09:30.397695+0000 mgr.x (mgr.34109) 896 : cluster [DBG] pgmap v985: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:31.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:31 smithi031 bash[18426]: cluster 2020-06-27T05:09:30.397695+0000 mgr.x (mgr.34109) 896 : cluster [DBG] pgmap v985: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:31.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:31 smithi031 bash[22603]: cluster 2020-06-27T05:09:30.397695+0000 mgr.x (mgr.34109) 896 : cluster [DBG] pgmap v985: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:33 smithi051 bash[18409]: cluster 2020-06-27T05:09:32.399435+0000 mgr.x (mgr.34109) 897 : cluster [DBG] pgmap v986: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:33.722 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:33 smithi031 bash[18426]: cluster 2020-06-27T05:09:32.399435+0000 mgr.x (mgr.34109) 897 : cluster [DBG] pgmap v986: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:33.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:33 smithi031 bash[22603]: cluster 2020-06-27T05:09:32.399435+0000 mgr.x (mgr.34109) 897 : cluster [DBG] pgmap v986: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:35.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:35 smithi051 bash[18409]: cluster 2020-06-27T05:09:34.401198+0000 mgr.x (mgr.34109) 898 : cluster [DBG] pgmap v987: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:35.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:35 smithi031 bash[22603]: cluster 2020-06-27T05:09:34.401198+0000 mgr.x (mgr.34109) 898 : cluster [DBG] pgmap v987: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:35.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:35 smithi031 bash[18426]: cluster 2020-06-27T05:09:34.401198+0000 mgr.x (mgr.34109) 898 : cluster [DBG] pgmap v987: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:37.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:37 smithi051 bash[18409]: cluster 2020-06-27T05:09:36.402953+0000 mgr.x (mgr.34109) 899 : cluster [DBG] pgmap v988: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:37.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:37 smithi031 bash[22603]: cluster 2020-06-27T05:09:36.402953+0000 mgr.x (mgr.34109) 899 : cluster [DBG] pgmap v988: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:37.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:37 smithi031 bash[18426]: cluster 2020-06-27T05:09:36.402953+0000 mgr.x (mgr.34109) 899 : cluster [DBG] pgmap v988: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:39.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:39 smithi051 bash[18409]: cluster 2020-06-27T05:09:38.404516+0000 mgr.x (mgr.34109) 900 : cluster [DBG] pgmap v989: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:39.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:39 smithi031 bash[18426]: cluster 2020-06-27T05:09:38.404516+0000 mgr.x (mgr.34109) 900 : cluster [DBG] pgmap v989: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:39.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:39 smithi031 bash[22603]: cluster 2020-06-27T05:09:38.404516+0000 mgr.x (mgr.34109) 900 : cluster [DBG] pgmap v989: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:41.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:41 smithi051 bash[18409]: cluster 2020-06-27T05:09:40.406059+0000 mgr.x (mgr.34109) 901 : cluster [DBG] pgmap v990: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:41.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:41 smithi031 bash[18426]: cluster 2020-06-27T05:09:40.406059+0000 mgr.x (mgr.34109) 901 : cluster [DBG] pgmap v990: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:41.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:41 smithi031 bash[22603]: cluster 2020-06-27T05:09:40.406059+0000 mgr.x (mgr.34109) 901 : cluster [DBG] pgmap v990: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:43.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:43 smithi051 bash[18409]: cluster 2020-06-27T05:09:42.407717+0000 mgr.x (mgr.34109) 902 : cluster [DBG] pgmap v991: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:43.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:43 smithi031 bash[18426]: cluster 2020-06-27T05:09:42.407717+0000 mgr.x (mgr.34109) 902 : cluster [DBG] pgmap v991: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:43.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:43 smithi031 bash[22603]: cluster 2020-06-27T05:09:42.407717+0000 mgr.x (mgr.34109) 902 : cluster [DBG] pgmap v991: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:45.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:45 smithi051 bash[18409]: cluster 2020-06-27T05:09:44.409468+0000 mgr.x (mgr.34109) 903 : cluster [DBG] pgmap v992: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:45.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:45 smithi031 bash[18426]: cluster 2020-06-27T05:09:44.409468+0000 mgr.x (mgr.34109) 903 : cluster [DBG] pgmap v992: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:45.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:45 smithi031 bash[22603]: cluster 2020-06-27T05:09:44.409468+0000 mgr.x (mgr.34109) 903 : cluster [DBG] pgmap v992: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:47.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:47 smithi051 bash[18409]: cluster 2020-06-27T05:09:46.411068+0000 mgr.x (mgr.34109) 904 : cluster [DBG] pgmap v993: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:47.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:47 smithi031 bash[18426]: cluster 2020-06-27T05:09:46.411068+0000 mgr.x (mgr.34109) 904 : cluster [DBG] pgmap v993: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:47.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:47 smithi031 bash[22603]: cluster 2020-06-27T05:09:46.411068+0000 mgr.x (mgr.34109) 904 : cluster [DBG] pgmap v993: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:49.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:49 smithi051 bash[18409]: cluster 2020-06-27T05:09:48.412762+0000 mgr.x (mgr.34109) 905 : cluster [DBG] pgmap v994: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:49.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:49 smithi031 bash[18426]: cluster 2020-06-27T05:09:48.412762+0000 mgr.x (mgr.34109) 905 : cluster [DBG] pgmap v994: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:49.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:49 smithi031 bash[22603]: cluster 2020-06-27T05:09:48.412762+0000 mgr.x (mgr.34109) 905 : cluster [DBG] pgmap v994: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:51.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:51 smithi051 bash[18409]: cluster 2020-06-27T05:09:50.414457+0000 mgr.x (mgr.34109) 906 : cluster [DBG] pgmap v995: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:51.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:51 smithi031 bash[18426]: cluster 2020-06-27T05:09:50.414457+0000 mgr.x (mgr.34109) 906 : cluster [DBG] pgmap v995: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:51.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:51 smithi031 bash[22603]: cluster 2020-06-27T05:09:50.414457+0000 mgr.x (mgr.34109) 906 : cluster [DBG] pgmap v995: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:53.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:53 smithi051 bash[18409]: cluster 2020-06-27T05:09:52.415948+0000 mgr.x (mgr.34109) 907 : cluster [DBG] pgmap v996: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:53.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:53 smithi031 bash[18426]: cluster 2020-06-27T05:09:52.415948+0000 mgr.x (mgr.34109) 907 : cluster [DBG] pgmap v996: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:53.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:53 smithi031 bash[22603]: cluster 2020-06-27T05:09:52.415948+0000 mgr.x (mgr.34109) 907 : cluster [DBG] pgmap v996: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:55.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:55 smithi051 bash[18409]: cluster 2020-06-27T05:09:54.417572+0000 mgr.x (mgr.34109) 908 : cluster [DBG] pgmap v997: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:55.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:55 smithi031 bash[18426]: cluster 2020-06-27T05:09:54.417572+0000 mgr.x (mgr.34109) 908 : cluster [DBG] pgmap v997: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:55.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:55 smithi031 bash[22603]: cluster 2020-06-27T05:09:54.417572+0000 mgr.x (mgr.34109) 908 : cluster [DBG] pgmap v997: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:57.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:57 smithi031 bash[18426]: cluster 2020-06-27T05:09:56.419146+0000 mgr.x (mgr.34109) 909 : cluster [DBG] pgmap v998: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:57.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:57 smithi031 bash[22603]: cluster 2020-06-27T05:09:56.419146+0000 mgr.x (mgr.34109) 909 : cluster [DBG] pgmap v998: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:09:58.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:57 smithi051 bash[18409]: cluster 2020-06-27T05:09:56.419146+0000 mgr.x (mgr.34109) 909 : cluster [DBG] pgmap v998: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:00.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:09:59 smithi051 bash[18409]: cluster 2020-06-27T05:09:58.420869+0000 mgr.x (mgr.34109) 910 : cluster [DBG] pgmap v999: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:00.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:09:59 smithi031 bash[22603]: cluster 2020-06-27T05:09:58.420869+0000 mgr.x (mgr.34109) 910 : cluster [DBG] pgmap v999: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:00.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:09:59 smithi031 bash[18426]: cluster 2020-06-27T05:09:58.420869+0000 mgr.x (mgr.34109) 910 : cluster [DBG] pgmap v999: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:02.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:01 smithi051 bash[18409]: cluster 2020-06-27T05:10:00.422606+0000 mgr.x (mgr.34109) 911 : cluster [DBG] pgmap v1000: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:02.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:01 smithi031 bash[22603]: cluster 2020-06-27T05:10:00.422606+0000 mgr.x (mgr.34109) 911 : cluster [DBG] pgmap v1000: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:02.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:01 smithi031 bash[18426]: cluster 2020-06-27T05:10:00.422606+0000 mgr.x (mgr.34109) 911 : cluster [DBG] pgmap v1000: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:04.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:03 smithi051 bash[18409]: cluster 2020-06-27T05:10:02.424279+0000 mgr.x (mgr.34109) 912 : cluster [DBG] pgmap v1001: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:04.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:03 smithi031 bash[22603]: cluster 2020-06-27T05:10:02.424279+0000 mgr.x (mgr.34109) 912 : cluster [DBG] pgmap v1001: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:04.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:03 smithi031 bash[18426]: cluster 2020-06-27T05:10:02.424279+0000 mgr.x (mgr.34109) 912 : cluster [DBG] pgmap v1001: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:05 smithi051 bash[18409]: cluster 2020-06-27T05:10:04.425802+0000 mgr.x (mgr.34109) 913 : cluster [DBG] pgmap v1002: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:06.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:05 smithi031 bash[22603]: cluster 2020-06-27T05:10:04.425802+0000 mgr.x (mgr.34109) 913 : cluster [DBG] pgmap v1002: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:06.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:05 smithi031 bash[18426]: cluster 2020-06-27T05:10:04.425802+0000 mgr.x (mgr.34109) 913 : cluster [DBG] pgmap v1002: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:08.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:07 smithi051 bash[18409]: cluster 2020-06-27T05:10:06.427455+0000 mgr.x (mgr.34109) 914 : cluster [DBG] pgmap v1003: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:08.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:07 smithi031 bash[22603]: cluster 2020-06-27T05:10:06.427455+0000 mgr.x (mgr.34109) 914 : cluster [DBG] pgmap v1003: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:08.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:07 smithi031 bash[18426]: cluster 2020-06-27T05:10:06.427455+0000 mgr.x (mgr.34109) 914 : cluster [DBG] pgmap v1003: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:10.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:09 smithi051 bash[18409]: cluster 2020-06-27T05:10:08.429062+0000 mgr.x (mgr.34109) 915 : cluster [DBG] pgmap v1004: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:10.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:09 smithi031 bash[22603]: cluster 2020-06-27T05:10:08.429062+0000 mgr.x (mgr.34109) 915 : cluster [DBG] pgmap v1004: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:10.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:09 smithi031 bash[18426]: cluster 2020-06-27T05:10:08.429062+0000 mgr.x (mgr.34109) 915 : cluster [DBG] pgmap v1004: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:12.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:11 smithi051 bash[18409]: cluster 2020-06-27T05:10:10.430764+0000 mgr.x (mgr.34109) 916 : cluster [DBG] pgmap v1005: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:12.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:11 smithi031 bash[18426]: cluster 2020-06-27T05:10:10.430764+0000 mgr.x (mgr.34109) 916 : cluster [DBG] pgmap v1005: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:12.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:11 smithi031 bash[22603]: cluster 2020-06-27T05:10:10.430764+0000 mgr.x (mgr.34109) 916 : cluster [DBG] pgmap v1005: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:14.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:13 smithi051 bash[18409]: cluster 2020-06-27T05:10:12.432380+0000 mgr.x (mgr.34109) 917 : cluster [DBG] pgmap v1006: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:14.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:13 smithi031 bash[18426]: cluster 2020-06-27T05:10:12.432380+0000 mgr.x (mgr.34109) 917 : cluster [DBG] pgmap v1006: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:14.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:13 smithi031 bash[22603]: cluster 2020-06-27T05:10:12.432380+0000 mgr.x (mgr.34109) 917 : cluster [DBG] pgmap v1006: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:15 smithi051 bash[18409]: cluster 2020-06-27T05:10:14.434098+0000 mgr.x (mgr.34109) 918 : cluster [DBG] pgmap v1007: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:15 smithi031 bash[18426]: cluster 2020-06-27T05:10:14.434098+0000 mgr.x (mgr.34109) 918 : cluster [DBG] pgmap v1007: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:16.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:15 smithi031 bash[22603]: cluster 2020-06-27T05:10:14.434098+0000 mgr.x (mgr.34109) 918 : cluster [DBG] pgmap v1007: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:18.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:17 smithi051 bash[18409]: cluster 2020-06-27T05:10:16.435712+0000 mgr.x (mgr.34109) 919 : cluster [DBG] pgmap v1008: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:18.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:17 smithi031 bash[18426]: cluster 2020-06-27T05:10:16.435712+0000 mgr.x (mgr.34109) 919 : cluster [DBG] pgmap v1008: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:18.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:17 smithi031 bash[22603]: cluster 2020-06-27T05:10:16.435712+0000 mgr.x (mgr.34109) 919 : cluster [DBG] pgmap v1008: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:20.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:19 smithi051 bash[18409]: cluster 2020-06-27T05:10:18.437397+0000 mgr.x (mgr.34109) 920 : cluster [DBG] pgmap v1009: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:20.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:19 smithi031 bash[18426]: cluster 2020-06-27T05:10:18.437397+0000 mgr.x (mgr.34109) 920 : cluster [DBG] pgmap v1009: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:20.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:19 smithi031 bash[22603]: cluster 2020-06-27T05:10:18.437397+0000 mgr.x (mgr.34109) 920 : cluster [DBG] pgmap v1009: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:22.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:21 smithi051 bash[18409]: cluster 2020-06-27T05:10:20.439132+0000 mgr.x (mgr.34109) 921 : cluster [DBG] pgmap v1010: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:22.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:21 smithi031 bash[18426]: cluster 2020-06-27T05:10:20.439132+0000 mgr.x (mgr.34109) 921 : cluster [DBG] pgmap v1010: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:22.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:21 smithi031 bash[22603]: cluster 2020-06-27T05:10:20.439132+0000 mgr.x (mgr.34109) 921 : cluster [DBG] pgmap v1010: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:24.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:23 smithi051 bash[18409]: cluster 2020-06-27T05:10:22.440843+0000 mgr.x (mgr.34109) 922 : cluster [DBG] pgmap v1011: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:24.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:23 smithi031 bash[18426]: cluster 2020-06-27T05:10:22.440843+0000 mgr.x (mgr.34109) 922 : cluster [DBG] pgmap v1011: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:24.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:23 smithi031 bash[22603]: cluster 2020-06-27T05:10:22.440843+0000 mgr.x (mgr.34109) 922 : cluster [DBG] pgmap v1011: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:26.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:25 smithi051 bash[18409]: cluster 2020-06-27T05:10:24.442537+0000 mgr.x (mgr.34109) 923 : cluster [DBG] pgmap v1012: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:25 smithi031 bash[18426]: cluster 2020-06-27T05:10:24.442537+0000 mgr.x (mgr.34109) 923 : cluster [DBG] pgmap v1012: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:25 smithi031 bash[22603]: cluster 2020-06-27T05:10:24.442537+0000 mgr.x (mgr.34109) 923 : cluster [DBG] pgmap v1012: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:28.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:27 smithi051 bash[18409]: cluster 2020-06-27T05:10:26.444136+0000 mgr.x (mgr.34109) 924 : cluster [DBG] pgmap v1013: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:28.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:27 smithi031 bash[18426]: cluster 2020-06-27T05:10:26.444136+0000 mgr.x (mgr.34109) 924 : cluster [DBG] pgmap v1013: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:28.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:27 smithi031 bash[22603]: cluster 2020-06-27T05:10:26.444136+0000 mgr.x (mgr.34109) 924 : cluster [DBG] pgmap v1013: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:30.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:29 smithi051 bash[18409]: cluster 2020-06-27T05:10:28.445742+0000 mgr.x (mgr.34109) 925 : cluster [DBG] pgmap v1014: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:30.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:29 smithi031 bash[18426]: cluster 2020-06-27T05:10:28.445742+0000 mgr.x (mgr.34109) 925 : cluster [DBG] pgmap v1014: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:30.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:29 smithi031 bash[22603]: cluster 2020-06-27T05:10:28.445742+0000 mgr.x (mgr.34109) 925 : cluster [DBG] pgmap v1014: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:32.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:31 smithi051 bash[18409]: cluster 2020-06-27T05:10:30.447424+0000 mgr.x (mgr.34109) 926 : cluster [DBG] pgmap v1015: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:32.222 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:31 smithi031 bash[18426]: cluster 2020-06-27T05:10:30.447424+0000 mgr.x (mgr.34109) 926 : cluster [DBG] pgmap v1015: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:32.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:31 smithi031 bash[22603]: cluster 2020-06-27T05:10:30.447424+0000 mgr.x (mgr.34109) 926 : cluster [DBG] pgmap v1015: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:34.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:33 smithi051 bash[18409]: cluster 2020-06-27T05:10:32.449136+0000 mgr.x (mgr.34109) 927 : cluster [DBG] pgmap v1016: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:34.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:33 smithi031 bash[18426]: cluster 2020-06-27T05:10:32.449136+0000 mgr.x (mgr.34109) 927 : cluster [DBG] pgmap v1016: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:34.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:33 smithi031 bash[22603]: cluster 2020-06-27T05:10:32.449136+0000 mgr.x (mgr.34109) 927 : cluster [DBG] pgmap v1016: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:35 smithi051 bash[18409]: cluster 2020-06-27T05:10:34.450688+0000 mgr.x (mgr.34109) 928 : cluster [DBG] pgmap v1017: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:36.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:35 smithi031 bash[18426]: cluster 2020-06-27T05:10:34.450688+0000 mgr.x (mgr.34109) 928 : cluster [DBG] pgmap v1017: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:36.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:35 smithi031 bash[22603]: cluster 2020-06-27T05:10:34.450688+0000 mgr.x (mgr.34109) 928 : cluster [DBG] pgmap v1017: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:38.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:37 smithi051 bash[18409]: cluster 2020-06-27T05:10:36.452387+0000 mgr.x (mgr.34109) 929 : cluster [DBG] pgmap v1018: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:38.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:37 smithi031 bash[18426]: cluster 2020-06-27T05:10:36.452387+0000 mgr.x (mgr.34109) 929 : cluster [DBG] pgmap v1018: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:38.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:37 smithi031 bash[22603]: cluster 2020-06-27T05:10:36.452387+0000 mgr.x (mgr.34109) 929 : cluster [DBG] pgmap v1018: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:40.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:39 smithi051 bash[18409]: cluster 2020-06-27T05:10:38.454087+0000 mgr.x (mgr.34109) 930 : cluster [DBG] pgmap v1019: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:40.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:39 smithi031 bash[18426]: cluster 2020-06-27T05:10:38.454087+0000 mgr.x (mgr.34109) 930 : cluster [DBG] pgmap v1019: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:40.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:39 smithi031 bash[22603]: cluster 2020-06-27T05:10:38.454087+0000 mgr.x (mgr.34109) 930 : cluster [DBG] pgmap v1019: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:42.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:41 smithi051 bash[18409]: cluster 2020-06-27T05:10:40.455714+0000 mgr.x (mgr.34109) 931 : cluster [DBG] pgmap v1020: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:42.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:41 smithi031 bash[18426]: cluster 2020-06-27T05:10:40.455714+0000 mgr.x (mgr.34109) 931 : cluster [DBG] pgmap v1020: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:42.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:41 smithi031 bash[22603]: cluster 2020-06-27T05:10:40.455714+0000 mgr.x (mgr.34109) 931 : cluster [DBG] pgmap v1020: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:44.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:43 smithi051 bash[18409]: cluster 2020-06-27T05:10:42.457296+0000 mgr.x (mgr.34109) 932 : cluster [DBG] pgmap v1021: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:44.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:43 smithi031 bash[18426]: cluster 2020-06-27T05:10:42.457296+0000 mgr.x (mgr.34109) 932 : cluster [DBG] pgmap v1021: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:44.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:43 smithi031 bash[22603]: cluster 2020-06-27T05:10:42.457296+0000 mgr.x (mgr.34109) 932 : cluster [DBG] pgmap v1021: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:46.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:45 smithi051 bash[18409]: cluster 2020-06-27T05:10:44.458854+0000 mgr.x (mgr.34109) 933 : cluster [DBG] pgmap v1022: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:46.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:45 smithi031 bash[18426]: cluster 2020-06-27T05:10:44.458854+0000 mgr.x (mgr.34109) 933 : cluster [DBG] pgmap v1022: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:46.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:45 smithi031 bash[22603]: cluster 2020-06-27T05:10:44.458854+0000 mgr.x (mgr.34109) 933 : cluster [DBG] pgmap v1022: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:48.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:47 smithi051 bash[18409]: cluster 2020-06-27T05:10:46.460472+0000 mgr.x (mgr.34109) 934 : cluster [DBG] pgmap v1023: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:48.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:47 smithi031 bash[18426]: cluster 2020-06-27T05:10:46.460472+0000 mgr.x (mgr.34109) 934 : cluster [DBG] pgmap v1023: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:48.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:47 smithi031 bash[22603]: cluster 2020-06-27T05:10:46.460472+0000 mgr.x (mgr.34109) 934 : cluster [DBG] pgmap v1023: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:50.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:49 smithi051 bash[18409]: cluster 2020-06-27T05:10:48.462105+0000 mgr.x (mgr.34109) 935 : cluster [DBG] pgmap v1024: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:50.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:49 smithi031 bash[18426]: cluster 2020-06-27T05:10:48.462105+0000 mgr.x (mgr.34109) 935 : cluster [DBG] pgmap v1024: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:50.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:49 smithi031 bash[22603]: cluster 2020-06-27T05:10:48.462105+0000 mgr.x (mgr.34109) 935 : cluster [DBG] pgmap v1024: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:52.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:51 smithi051 bash[18409]: cluster 2020-06-27T05:10:50.463698+0000 mgr.x (mgr.34109) 936 : cluster [DBG] pgmap v1025: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:52.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:51 smithi031 bash[18426]: cluster 2020-06-27T05:10:50.463698+0000 mgr.x (mgr.34109) 936 : cluster [DBG] pgmap v1025: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:52.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:51 smithi031 bash[22603]: cluster 2020-06-27T05:10:50.463698+0000 mgr.x (mgr.34109) 936 : cluster [DBG] pgmap v1025: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:54.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:53 smithi051 bash[18409]: cluster 2020-06-27T05:10:52.465406+0000 mgr.x (mgr.34109) 937 : cluster [DBG] pgmap v1026: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:54.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:53 smithi031 bash[18426]: cluster 2020-06-27T05:10:52.465406+0000 mgr.x (mgr.34109) 937 : cluster [DBG] pgmap v1026: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:54.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:53 smithi031 bash[22603]: cluster 2020-06-27T05:10:52.465406+0000 mgr.x (mgr.34109) 937 : cluster [DBG] pgmap v1026: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:55 smithi051 bash[18409]: cluster 2020-06-27T05:10:54.467033+0000 mgr.x (mgr.34109) 938 : cluster [DBG] pgmap v1027: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:55 smithi031 bash[18426]: cluster 2020-06-27T05:10:54.467033+0000 mgr.x (mgr.34109) 938 : cluster [DBG] pgmap v1027: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:56.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:55 smithi031 bash[22603]: cluster 2020-06-27T05:10:54.467033+0000 mgr.x (mgr.34109) 938 : cluster [DBG] pgmap v1027: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:58.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:57 smithi051 bash[18409]: cluster 2020-06-27T05:10:56.468625+0000 mgr.x (mgr.34109) 939 : cluster [DBG] pgmap v1028: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:58.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:57 smithi031 bash[18426]: cluster 2020-06-27T05:10:56.468625+0000 mgr.x (mgr.34109) 939 : cluster [DBG] pgmap v1028: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:10:58.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:57 smithi031 bash[22603]: cluster 2020-06-27T05:10:56.468625+0000 mgr.x (mgr.34109) 939 : cluster [DBG] pgmap v1028: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:00.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:10:59 smithi051 bash[18409]: cluster 2020-06-27T05:10:58.470280+0000 mgr.x (mgr.34109) 940 : cluster [DBG] pgmap v1029: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:00.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:10:59 smithi031 bash[18426]: cluster 2020-06-27T05:10:58.470280+0000 mgr.x (mgr.34109) 940 : cluster [DBG] pgmap v1029: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:00.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:10:59 smithi031 bash[22603]: cluster 2020-06-27T05:10:58.470280+0000 mgr.x (mgr.34109) 940 : cluster [DBG] pgmap v1029: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:02.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:01 smithi051 bash[18409]: cluster 2020-06-27T05:11:00.471984+0000 mgr.x (mgr.34109) 941 : cluster [DBG] pgmap v1030: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:02.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:01 smithi031 bash[18426]: cluster 2020-06-27T05:11:00.471984+0000 mgr.x (mgr.34109) 941 : cluster [DBG] pgmap v1030: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:02.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:01 smithi031 bash[22603]: cluster 2020-06-27T05:11:00.471984+0000 mgr.x (mgr.34109) 941 : cluster [DBG] pgmap v1030: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:04.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:03 smithi051 bash[18409]: cluster 2020-06-27T05:11:02.473662+0000 mgr.x (mgr.34109) 942 : cluster [DBG] pgmap v1031: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:04.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:03 smithi031 bash[18426]: cluster 2020-06-27T05:11:02.473662+0000 mgr.x (mgr.34109) 942 : cluster [DBG] pgmap v1031: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:04.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:03 smithi031 bash[22603]: cluster 2020-06-27T05:11:02.473662+0000 mgr.x (mgr.34109) 942 : cluster [DBG] pgmap v1031: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:05 smithi051 bash[18409]: cluster 2020-06-27T05:11:04.475292+0000 mgr.x (mgr.34109) 943 : cluster [DBG] pgmap v1032: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:06.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:05 smithi031 bash[18426]: cluster 2020-06-27T05:11:04.475292+0000 mgr.x (mgr.34109) 943 : cluster [DBG] pgmap v1032: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:06.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:05 smithi031 bash[22603]: cluster 2020-06-27T05:11:04.475292+0000 mgr.x (mgr.34109) 943 : cluster [DBG] pgmap v1032: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:08.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:07 smithi051 bash[18409]: cluster 2020-06-27T05:11:06.476993+0000 mgr.x (mgr.34109) 944 : cluster [DBG] pgmap v1033: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:08.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:07 smithi031 bash[18426]: cluster 2020-06-27T05:11:06.476993+0000 mgr.x (mgr.34109) 944 : cluster [DBG] pgmap v1033: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:08.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:07 smithi031 bash[22603]: cluster 2020-06-27T05:11:06.476993+0000 mgr.x (mgr.34109) 944 : cluster [DBG] pgmap v1033: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:10.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:09 smithi051 bash[18409]: cluster 2020-06-27T05:11:08.478718+0000 mgr.x (mgr.34109) 945 : cluster [DBG] pgmap v1034: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:10.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:09 smithi031 bash[18426]: cluster 2020-06-27T05:11:08.478718+0000 mgr.x (mgr.34109) 945 : cluster [DBG] pgmap v1034: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:10.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:09 smithi031 bash[22603]: cluster 2020-06-27T05:11:08.478718+0000 mgr.x (mgr.34109) 945 : cluster [DBG] pgmap v1034: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:12.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:11 smithi051 bash[18409]: cluster 2020-06-27T05:11:10.480315+0000 mgr.x (mgr.34109) 946 : cluster [DBG] pgmap v1035: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:12.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:11 smithi031 bash[18426]: cluster 2020-06-27T05:11:10.480315+0000 mgr.x (mgr.34109) 946 : cluster [DBG] pgmap v1035: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:12.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:11 smithi031 bash[22603]: cluster 2020-06-27T05:11:10.480315+0000 mgr.x (mgr.34109) 946 : cluster [DBG] pgmap v1035: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:14.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:13 smithi051 bash[18409]: cluster 2020-06-27T05:11:12.481948+0000 mgr.x (mgr.34109) 947 : cluster [DBG] pgmap v1036: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:14.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:13 smithi031 bash[18426]: cluster 2020-06-27T05:11:12.481948+0000 mgr.x (mgr.34109) 947 : cluster [DBG] pgmap v1036: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:14.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:13 smithi031 bash[22603]: cluster 2020-06-27T05:11:12.481948+0000 mgr.x (mgr.34109) 947 : cluster [DBG] pgmap v1036: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:15 smithi051 bash[18409]: cluster 2020-06-27T05:11:14.483475+0000 mgr.x (mgr.34109) 948 : cluster [DBG] pgmap v1037: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:15 smithi031 bash[18426]: cluster 2020-06-27T05:11:14.483475+0000 mgr.x (mgr.34109) 948 : cluster [DBG] pgmap v1037: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:16.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:15 smithi031 bash[22603]: cluster 2020-06-27T05:11:14.483475+0000 mgr.x (mgr.34109) 948 : cluster [DBG] pgmap v1037: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:18.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:17 smithi051 bash[18409]: cluster 2020-06-27T05:11:16.485048+0000 mgr.x (mgr.34109) 949 : cluster [DBG] pgmap v1038: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:18.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:17 smithi031 bash[18426]: cluster 2020-06-27T05:11:16.485048+0000 mgr.x (mgr.34109) 949 : cluster [DBG] pgmap v1038: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:18.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:17 smithi031 bash[22603]: cluster 2020-06-27T05:11:16.485048+0000 mgr.x (mgr.34109) 949 : cluster [DBG] pgmap v1038: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:20.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:19 smithi051 bash[18409]: cluster 2020-06-27T05:11:18.486634+0000 mgr.x (mgr.34109) 950 : cluster [DBG] pgmap v1039: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:20.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:19 smithi031 bash[22603]: cluster 2020-06-27T05:11:18.486634+0000 mgr.x (mgr.34109) 950 : cluster [DBG] pgmap v1039: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:20.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:19 smithi031 bash[18426]: cluster 2020-06-27T05:11:18.486634+0000 mgr.x (mgr.34109) 950 : cluster [DBG] pgmap v1039: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:22.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:21 smithi031 bash[22603]: cluster 2020-06-27T05:11:20.488341+0000 mgr.x (mgr.34109) 951 : cluster [DBG] pgmap v1040: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:22.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:21 smithi031 bash[18426]: cluster 2020-06-27T05:11:20.488341+0000 mgr.x (mgr.34109) 951 : cluster [DBG] pgmap v1040: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:22.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:21 smithi051 bash[18409]: cluster 2020-06-27T05:11:20.488341+0000 mgr.x (mgr.34109) 951 : cluster [DBG] pgmap v1040: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:24.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:23 smithi031 bash[22603]: cluster 2020-06-27T05:11:22.490018+0000 mgr.x (mgr.34109) 952 : cluster [DBG] pgmap v1041: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:24.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:23 smithi031 bash[18426]: cluster 2020-06-27T05:11:22.490018+0000 mgr.x (mgr.34109) 952 : cluster [DBG] pgmap v1041: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:24.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:23 smithi051 bash[18409]: cluster 2020-06-27T05:11:22.490018+0000 mgr.x (mgr.34109) 952 : cluster [DBG] pgmap v1041: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:26.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:25 smithi051 bash[18409]: cluster 2020-06-27T05:11:24.491693+0000 mgr.x (mgr.34109) 953 : cluster [DBG] pgmap v1042: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:26.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:25 smithi031 bash[18426]: cluster 2020-06-27T05:11:24.491693+0000 mgr.x (mgr.34109) 953 : cluster [DBG] pgmap v1042: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:26.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:25 smithi031 bash[22603]: cluster 2020-06-27T05:11:24.491693+0000 mgr.x (mgr.34109) 953 : cluster [DBG] pgmap v1042: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:28.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:27 smithi051 bash[18409]: cluster 2020-06-27T05:11:26.493374+0000 mgr.x (mgr.34109) 954 : cluster [DBG] pgmap v1043: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:28.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:27 smithi031 bash[18426]: cluster 2020-06-27T05:11:26.493374+0000 mgr.x (mgr.34109) 954 : cluster [DBG] pgmap v1043: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:28.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:27 smithi031 bash[22603]: cluster 2020-06-27T05:11:26.493374+0000 mgr.x (mgr.34109) 954 : cluster [DBG] pgmap v1043: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:30.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:29 smithi051 bash[18409]: cluster 2020-06-27T05:11:28.495088+0000 mgr.x (mgr.34109) 955 : cluster [DBG] pgmap v1044: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:30.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:29 smithi031 bash[18426]: cluster 2020-06-27T05:11:28.495088+0000 mgr.x (mgr.34109) 955 : cluster [DBG] pgmap v1044: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:30.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:29 smithi031 bash[22603]: cluster 2020-06-27T05:11:28.495088+0000 mgr.x (mgr.34109) 955 : cluster [DBG] pgmap v1044: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:32.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:32 smithi051 bash[18409]: cluster 2020-06-27T05:11:30.496710+0000 mgr.x (mgr.34109) 956 : cluster [DBG] pgmap v1045: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:32.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:31 smithi031 bash[18426]: cluster 2020-06-27T05:11:30.496710+0000 mgr.x (mgr.34109) 956 : cluster [DBG] pgmap v1045: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:32.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:32 smithi031 bash[22603]: cluster 2020-06-27T05:11:30.496710+0000 mgr.x (mgr.34109) 956 : cluster [DBG] pgmap v1045: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:34.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:34 smithi051 bash[18409]: cluster 2020-06-27T05:11:32.498370+0000 mgr.x (mgr.34109) 957 : cluster [DBG] pgmap v1046: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:34.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:34 smithi031 bash[18426]: cluster 2020-06-27T05:11:32.498370+0000 mgr.x (mgr.34109) 957 : cluster [DBG] pgmap v1046: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:34.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:34 smithi031 bash[22603]: cluster 2020-06-27T05:11:32.498370+0000 mgr.x (mgr.34109) 957 : cluster [DBG] pgmap v1046: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:36.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:36 smithi051 bash[18409]: cluster 2020-06-27T05:11:34.500041+0000 mgr.x (mgr.34109) 958 : cluster [DBG] pgmap v1047: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:36.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:36 smithi031 bash[18426]: cluster 2020-06-27T05:11:34.500041+0000 mgr.x (mgr.34109) 958 : cluster [DBG] pgmap v1047: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:36.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:36 smithi031 bash[22603]: cluster 2020-06-27T05:11:34.500041+0000 mgr.x (mgr.34109) 958 : cluster [DBG] pgmap v1047: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:38.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:38 smithi051 bash[18409]: cluster 2020-06-27T05:11:36.501760+0000 mgr.x (mgr.34109) 959 : cluster [DBG] pgmap v1048: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:38.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:38 smithi031 bash[18426]: cluster 2020-06-27T05:11:36.501760+0000 mgr.x (mgr.34109) 959 : cluster [DBG] pgmap v1048: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:38.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:38 smithi031 bash[22603]: cluster 2020-06-27T05:11:36.501760+0000 mgr.x (mgr.34109) 959 : cluster [DBG] pgmap v1048: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:40.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:40 smithi051 bash[18409]: cluster 2020-06-27T05:11:38.503300+0000 mgr.x (mgr.34109) 960 : cluster [DBG] pgmap v1049: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:40.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:40 smithi031 bash[18426]: cluster 2020-06-27T05:11:38.503300+0000 mgr.x (mgr.34109) 960 : cluster [DBG] pgmap v1049: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:40.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:40 smithi031 bash[22603]: cluster 2020-06-27T05:11:38.503300+0000 mgr.x (mgr.34109) 960 : cluster [DBG] pgmap v1049: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:42.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:42 smithi051 bash[18409]: cluster 2020-06-27T05:11:40.504987+0000 mgr.x (mgr.34109) 961 : cluster [DBG] pgmap v1050: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:42.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:42 smithi031 bash[22603]: cluster 2020-06-27T05:11:40.504987+0000 mgr.x (mgr.34109) 961 : cluster [DBG] pgmap v1050: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:42.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:42 smithi031 bash[18426]: cluster 2020-06-27T05:11:40.504987+0000 mgr.x (mgr.34109) 961 : cluster [DBG] pgmap v1050: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:44.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:44 smithi051 bash[18409]: cluster 2020-06-27T05:11:42.506602+0000 mgr.x (mgr.34109) 962 : cluster [DBG] pgmap v1051: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:44.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:44 smithi031 bash[22603]: cluster 2020-06-27T05:11:42.506602+0000 mgr.x (mgr.34109) 962 : cluster [DBG] pgmap v1051: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:44.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:44 smithi031 bash[18426]: cluster 2020-06-27T05:11:42.506602+0000 mgr.x (mgr.34109) 962 : cluster [DBG] pgmap v1051: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:46.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:46 smithi051 bash[18409]: cluster 2020-06-27T05:11:44.508198+0000 mgr.x (mgr.34109) 963 : cluster [DBG] pgmap v1052: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:46.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:46 smithi031 bash[22603]: cluster 2020-06-27T05:11:44.508198+0000 mgr.x (mgr.34109) 963 : cluster [DBG] pgmap v1052: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:46.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:46 smithi031 bash[18426]: cluster 2020-06-27T05:11:44.508198+0000 mgr.x (mgr.34109) 963 : cluster [DBG] pgmap v1052: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:48.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:48 smithi051 bash[18409]: cluster 2020-06-27T05:11:46.509949+0000 mgr.x (mgr.34109) 964 : cluster [DBG] pgmap v1053: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:48.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:48 smithi031 bash[18426]: cluster 2020-06-27T05:11:46.509949+0000 mgr.x (mgr.34109) 964 : cluster [DBG] pgmap v1053: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:48.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:48 smithi031 bash[22603]: cluster 2020-06-27T05:11:46.509949+0000 mgr.x (mgr.34109) 964 : cluster [DBG] pgmap v1053: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:50.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:50 smithi051 bash[18409]: cluster 2020-06-27T05:11:48.511611+0000 mgr.x (mgr.34109) 965 : cluster [DBG] pgmap v1054: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:50.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:50 smithi031 bash[18426]: cluster 2020-06-27T05:11:48.511611+0000 mgr.x (mgr.34109) 965 : cluster [DBG] pgmap v1054: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:50.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:50 smithi031 bash[22603]: cluster 2020-06-27T05:11:48.511611+0000 mgr.x (mgr.34109) 965 : cluster [DBG] pgmap v1054: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:52.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:52 smithi051 bash[18409]: cluster 2020-06-27T05:11:50.513164+0000 mgr.x (mgr.34109) 966 : cluster [DBG] pgmap v1055: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:52.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:52 smithi031 bash[18426]: cluster 2020-06-27T05:11:50.513164+0000 mgr.x (mgr.34109) 966 : cluster [DBG] pgmap v1055: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:52.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:52 smithi031 bash[22603]: cluster 2020-06-27T05:11:50.513164+0000 mgr.x (mgr.34109) 966 : cluster [DBG] pgmap v1055: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:54.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:54 smithi051 bash[18409]: cluster 2020-06-27T05:11:52.514702+0000 mgr.x (mgr.34109) 967 : cluster [DBG] pgmap v1056: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:54.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:54 smithi031 bash[18426]: cluster 2020-06-27T05:11:52.514702+0000 mgr.x (mgr.34109) 967 : cluster [DBG] pgmap v1056: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:54.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:54 smithi031 bash[22603]: cluster 2020-06-27T05:11:52.514702+0000 mgr.x (mgr.34109) 967 : cluster [DBG] pgmap v1056: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:56.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:56 smithi051 bash[18409]: cluster 2020-06-27T05:11:54.516423+0000 mgr.x (mgr.34109) 968 : cluster [DBG] pgmap v1057: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:56.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:56 smithi031 bash[18426]: cluster 2020-06-27T05:11:54.516423+0000 mgr.x (mgr.34109) 968 : cluster [DBG] pgmap v1057: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:56.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:56 smithi031 bash[22603]: cluster 2020-06-27T05:11:54.516423+0000 mgr.x (mgr.34109) 968 : cluster [DBG] pgmap v1057: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:58.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:11:58 smithi051 bash[18409]: cluster 2020-06-27T05:11:56.518019+0000 mgr.x (mgr.34109) 969 : cluster [DBG] pgmap v1058: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:58.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:11:58 smithi031 bash[22603]: cluster 2020-06-27T05:11:56.518019+0000 mgr.x (mgr.34109) 969 : cluster [DBG] pgmap v1058: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:11:58.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:11:58 smithi031 bash[18426]: cluster 2020-06-27T05:11:56.518019+0000 mgr.x (mgr.34109) 969 : cluster [DBG] pgmap v1058: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:00 smithi051 bash[18409]: cluster 2020-06-27T05:11:58.519724+0000 mgr.x (mgr.34109) 970 : cluster [DBG] pgmap v1059: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:00.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:00 smithi031 bash[22603]: cluster 2020-06-27T05:11:58.519724+0000 mgr.x (mgr.34109) 970 : cluster [DBG] pgmap v1059: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:00.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:00 smithi031 bash[18426]: cluster 2020-06-27T05:11:58.519724+0000 mgr.x (mgr.34109) 970 : cluster [DBG] pgmap v1059: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:02.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:02 smithi051 bash[18409]: cluster 2020-06-27T05:12:00.521339+0000 mgr.x (mgr.34109) 971 : cluster [DBG] pgmap v1060: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:02.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:02 smithi031 bash[18426]: cluster 2020-06-27T05:12:00.521339+0000 mgr.x (mgr.34109) 971 : cluster [DBG] pgmap v1060: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:02.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:02 smithi031 bash[22603]: cluster 2020-06-27T05:12:00.521339+0000 mgr.x (mgr.34109) 971 : cluster [DBG] pgmap v1060: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:04.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:04 smithi051 bash[18409]: cluster 2020-06-27T05:12:02.523063+0000 mgr.x (mgr.34109) 972 : cluster [DBG] pgmap v1061: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:04.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:04 smithi031 bash[18426]: cluster 2020-06-27T05:12:02.523063+0000 mgr.x (mgr.34109) 972 : cluster [DBG] pgmap v1061: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:04.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:04 smithi031 bash[22603]: cluster 2020-06-27T05:12:02.523063+0000 mgr.x (mgr.34109) 972 : cluster [DBG] pgmap v1061: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:06.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:06 smithi051 bash[18409]: cluster 2020-06-27T05:12:04.524785+0000 mgr.x (mgr.34109) 973 : cluster [DBG] pgmap v1062: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:06.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:06 smithi031 bash[18426]: cluster 2020-06-27T05:12:04.524785+0000 mgr.x (mgr.34109) 973 : cluster [DBG] pgmap v1062: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:06.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:06 smithi031 bash[22603]: cluster 2020-06-27T05:12:04.524785+0000 mgr.x (mgr.34109) 973 : cluster [DBG] pgmap v1062: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:08.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:08 smithi051 bash[18409]: cluster 2020-06-27T05:12:06.526531+0000 mgr.x (mgr.34109) 974 : cluster [DBG] pgmap v1063: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:08.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:08 smithi031 bash[18426]: cluster 2020-06-27T05:12:06.526531+0000 mgr.x (mgr.34109) 974 : cluster [DBG] pgmap v1063: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:08.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:08 smithi031 bash[22603]: cluster 2020-06-27T05:12:06.526531+0000 mgr.x (mgr.34109) 974 : cluster [DBG] pgmap v1063: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:10.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:10 smithi051 bash[18409]: cluster 2020-06-27T05:12:08.528012+0000 mgr.x (mgr.34109) 975 : cluster [DBG] pgmap v1064: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:10.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:10 smithi031 bash[18426]: cluster 2020-06-27T05:12:08.528012+0000 mgr.x (mgr.34109) 975 : cluster [DBG] pgmap v1064: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:10.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:10 smithi031 bash[22603]: cluster 2020-06-27T05:12:08.528012+0000 mgr.x (mgr.34109) 975 : cluster [DBG] pgmap v1064: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:12.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:12 smithi051 bash[18409]: cluster 2020-06-27T05:12:10.529680+0000 mgr.x (mgr.34109) 976 : cluster [DBG] pgmap v1065: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:12.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:12 smithi031 bash[18426]: cluster 2020-06-27T05:12:10.529680+0000 mgr.x (mgr.34109) 976 : cluster [DBG] pgmap v1065: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:12.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:12 smithi031 bash[22603]: cluster 2020-06-27T05:12:10.529680+0000 mgr.x (mgr.34109) 976 : cluster [DBG] pgmap v1065: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:14.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:14 smithi051 bash[18409]: cluster 2020-06-27T05:12:12.531413+0000 mgr.x (mgr.34109) 977 : cluster [DBG] pgmap v1066: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:14.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:14 smithi031 bash[18426]: cluster 2020-06-27T05:12:12.531413+0000 mgr.x (mgr.34109) 977 : cluster [DBG] pgmap v1066: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:14.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:14 smithi031 bash[22603]: cluster 2020-06-27T05:12:12.531413+0000 mgr.x (mgr.34109) 977 : cluster [DBG] pgmap v1066: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:16.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:16 smithi051 bash[18409]: cluster 2020-06-27T05:12:14.533090+0000 mgr.x (mgr.34109) 978 : cluster [DBG] pgmap v1067: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:16.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:16 smithi031 bash[18426]: cluster 2020-06-27T05:12:14.533090+0000 mgr.x (mgr.34109) 978 : cluster [DBG] pgmap v1067: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:16.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:16 smithi031 bash[22603]: cluster 2020-06-27T05:12:14.533090+0000 mgr.x (mgr.34109) 978 : cluster [DBG] pgmap v1067: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:17.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:17 smithi051 bash[18409]: cluster 2020-06-27T05:12:16.534712+0000 mgr.x (mgr.34109) 979 : cluster [DBG] pgmap v1068: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:17.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:17 smithi031 bash[18426]: cluster 2020-06-27T05:12:16.534712+0000 mgr.x (mgr.34109) 979 : cluster [DBG] pgmap v1068: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:17.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:17 smithi031 bash[22603]: cluster 2020-06-27T05:12:16.534712+0000 mgr.x (mgr.34109) 979 : cluster [DBG] pgmap v1068: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:19.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:19 smithi051 bash[18409]: cluster 2020-06-27T05:12:18.536361+0000 mgr.x (mgr.34109) 980 : cluster [DBG] pgmap v1069: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:19.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:19 smithi031 bash[18426]: cluster 2020-06-27T05:12:18.536361+0000 mgr.x (mgr.34109) 980 : cluster [DBG] pgmap v1069: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:19.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:19 smithi031 bash[22603]: cluster 2020-06-27T05:12:18.536361+0000 mgr.x (mgr.34109) 980 : cluster [DBG] pgmap v1069: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:21.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:21 smithi051 bash[18409]: cluster 2020-06-27T05:12:20.537962+0000 mgr.x (mgr.34109) 981 : cluster [DBG] pgmap v1070: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:21.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:21 smithi031 bash[22603]: cluster 2020-06-27T05:12:20.537962+0000 mgr.x (mgr.34109) 981 : cluster [DBG] pgmap v1070: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:21.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:21 smithi031 bash[18426]: cluster 2020-06-27T05:12:20.537962+0000 mgr.x (mgr.34109) 981 : cluster [DBG] pgmap v1070: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:23.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:23 smithi051 bash[18409]: cluster 2020-06-27T05:12:22.539582+0000 mgr.x (mgr.34109) 982 : cluster [DBG] pgmap v1071: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:23.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:23 smithi031 bash[22603]: cluster 2020-06-27T05:12:22.539582+0000 mgr.x (mgr.34109) 982 : cluster [DBG] pgmap v1071: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:23.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:23 smithi031 bash[18426]: cluster 2020-06-27T05:12:22.539582+0000 mgr.x (mgr.34109) 982 : cluster [DBG] pgmap v1071: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:25.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:25 smithi051 bash[18409]: cluster 2020-06-27T05:12:24.541190+0000 mgr.x (mgr.34109) 983 : cluster [DBG] pgmap v1072: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:25.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:25 smithi031 bash[22603]: cluster 2020-06-27T05:12:24.541190+0000 mgr.x (mgr.34109) 983 : cluster [DBG] pgmap v1072: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:25.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:25 smithi031 bash[18426]: cluster 2020-06-27T05:12:24.541190+0000 mgr.x (mgr.34109) 983 : cluster [DBG] pgmap v1072: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:27.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:27 smithi051 bash[18409]: cluster 2020-06-27T05:12:26.542897+0000 mgr.x (mgr.34109) 984 : cluster [DBG] pgmap v1073: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:27.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:27 smithi031 bash[22603]: cluster 2020-06-27T05:12:26.542897+0000 mgr.x (mgr.34109) 984 : cluster [DBG] pgmap v1073: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:27.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:27 smithi031 bash[18426]: cluster 2020-06-27T05:12:26.542897+0000 mgr.x (mgr.34109) 984 : cluster [DBG] pgmap v1073: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:29.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:29 smithi051 bash[18409]: cluster 2020-06-27T05:12:28.544597+0000 mgr.x (mgr.34109) 985 : cluster [DBG] pgmap v1074: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:29.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:29 smithi031 bash[22603]: cluster 2020-06-27T05:12:28.544597+0000 mgr.x (mgr.34109) 985 : cluster [DBG] pgmap v1074: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:29.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:29 smithi031 bash[18426]: cluster 2020-06-27T05:12:28.544597+0000 mgr.x (mgr.34109) 985 : cluster [DBG] pgmap v1074: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:31.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:31 smithi051 bash[18409]: cluster 2020-06-27T05:12:30.546169+0000 mgr.x (mgr.34109) 986 : cluster [DBG] pgmap v1075: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:31.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:31 smithi031 bash[18426]: cluster 2020-06-27T05:12:30.546169+0000 mgr.x (mgr.34109) 986 : cluster [DBG] pgmap v1075: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:31.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:31 smithi031 bash[22603]: cluster 2020-06-27T05:12:30.546169+0000 mgr.x (mgr.34109) 986 : cluster [DBG] pgmap v1075: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:33.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:33 smithi031 bash[18426]: cluster 2020-06-27T05:12:32.547793+0000 mgr.x (mgr.34109) 987 : cluster [DBG] pgmap v1076: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:33.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:33 smithi031 bash[22603]: cluster 2020-06-27T05:12:32.547793+0000 mgr.x (mgr.34109) 987 : cluster [DBG] pgmap v1076: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:34.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:33 smithi051 bash[18409]: cluster 2020-06-27T05:12:32.547793+0000 mgr.x (mgr.34109) 987 : cluster [DBG] pgmap v1076: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:35 smithi051 bash[18409]: cluster 2020-06-27T05:12:34.549424+0000 mgr.x (mgr.34109) 988 : cluster [DBG] pgmap v1077: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:36.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:35 smithi031 bash[18426]: cluster 2020-06-27T05:12:34.549424+0000 mgr.x (mgr.34109) 988 : cluster [DBG] pgmap v1077: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:36.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:35 smithi031 bash[22603]: cluster 2020-06-27T05:12:34.549424+0000 mgr.x (mgr.34109) 988 : cluster [DBG] pgmap v1077: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:38.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:37 smithi051 bash[18409]: cluster 2020-06-27T05:12:36.551171+0000 mgr.x (mgr.34109) 989 : cluster [DBG] pgmap v1078: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:38.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:37 smithi031 bash[18426]: cluster 2020-06-27T05:12:36.551171+0000 mgr.x (mgr.34109) 989 : cluster [DBG] pgmap v1078: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:38.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:37 smithi031 bash[22603]: cluster 2020-06-27T05:12:36.551171+0000 mgr.x (mgr.34109) 989 : cluster [DBG] pgmap v1078: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:40.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:39 smithi051 bash[18409]: cluster 2020-06-27T05:12:38.552887+0000 mgr.x (mgr.34109) 990 : cluster [DBG] pgmap v1079: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:40.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:39 smithi031 bash[18426]: cluster 2020-06-27T05:12:38.552887+0000 mgr.x (mgr.34109) 990 : cluster [DBG] pgmap v1079: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:40.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:39 smithi031 bash[22603]: cluster 2020-06-27T05:12:38.552887+0000 mgr.x (mgr.34109) 990 : cluster [DBG] pgmap v1079: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:42.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:41 smithi051 bash[18409]: cluster 2020-06-27T05:12:40.554553+0000 mgr.x (mgr.34109) 991 : cluster [DBG] pgmap v1080: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:42.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:41 smithi031 bash[18426]: cluster 2020-06-27T05:12:40.554553+0000 mgr.x (mgr.34109) 991 : cluster [DBG] pgmap v1080: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:42.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:41 smithi031 bash[22603]: cluster 2020-06-27T05:12:40.554553+0000 mgr.x (mgr.34109) 991 : cluster [DBG] pgmap v1080: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:44.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:43 smithi051 bash[18409]: cluster 2020-06-27T05:12:42.556154+0000 mgr.x (mgr.34109) 992 : cluster [DBG] pgmap v1081: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:44.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:43 smithi031 bash[18426]: cluster 2020-06-27T05:12:42.556154+0000 mgr.x (mgr.34109) 992 : cluster [DBG] pgmap v1081: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:44.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:43 smithi031 bash[22603]: cluster 2020-06-27T05:12:42.556154+0000 mgr.x (mgr.34109) 992 : cluster [DBG] pgmap v1081: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:46.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:45 smithi051 bash[18409]: cluster 2020-06-27T05:12:44.557843+0000 mgr.x (mgr.34109) 993 : cluster [DBG] pgmap v1082: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:46.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:45 smithi031 bash[18426]: cluster 2020-06-27T05:12:44.557843+0000 mgr.x (mgr.34109) 993 : cluster [DBG] pgmap v1082: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:46.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:45 smithi031 bash[22603]: cluster 2020-06-27T05:12:44.557843+0000 mgr.x (mgr.34109) 993 : cluster [DBG] pgmap v1082: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:48.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:47 smithi051 bash[18409]: cluster 2020-06-27T05:12:46.559462+0000 mgr.x (mgr.34109) 994 : cluster [DBG] pgmap v1083: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:48.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:47 smithi031 bash[18426]: cluster 2020-06-27T05:12:46.559462+0000 mgr.x (mgr.34109) 994 : cluster [DBG] pgmap v1083: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:48.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:47 smithi031 bash[22603]: cluster 2020-06-27T05:12:46.559462+0000 mgr.x (mgr.34109) 994 : cluster [DBG] pgmap v1083: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:50.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:49 smithi051 bash[18409]: cluster 2020-06-27T05:12:48.561070+0000 mgr.x (mgr.34109) 995 : cluster [DBG] pgmap v1084: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:50.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:49 smithi031 bash[18426]: cluster 2020-06-27T05:12:48.561070+0000 mgr.x (mgr.34109) 995 : cluster [DBG] pgmap v1084: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:50.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:49 smithi031 bash[22603]: cluster 2020-06-27T05:12:48.561070+0000 mgr.x (mgr.34109) 995 : cluster [DBG] pgmap v1084: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:52.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:51 smithi051 bash[18409]: cluster 2020-06-27T05:12:50.562782+0000 mgr.x (mgr.34109) 996 : cluster [DBG] pgmap v1085: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:52.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:51 smithi031 bash[18426]: cluster 2020-06-27T05:12:50.562782+0000 mgr.x (mgr.34109) 996 : cluster [DBG] pgmap v1085: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:52.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:51 smithi031 bash[22603]: cluster 2020-06-27T05:12:50.562782+0000 mgr.x (mgr.34109) 996 : cluster [DBG] pgmap v1085: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:54.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:53 smithi051 bash[18409]: cluster 2020-06-27T05:12:52.564374+0000 mgr.x (mgr.34109) 997 : cluster [DBG] pgmap v1086: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:54.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:53 smithi031 bash[18426]: cluster 2020-06-27T05:12:52.564374+0000 mgr.x (mgr.34109) 997 : cluster [DBG] pgmap v1086: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:54.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:53 smithi031 bash[22603]: cluster 2020-06-27T05:12:52.564374+0000 mgr.x (mgr.34109) 997 : cluster [DBG] pgmap v1086: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:55 smithi051 bash[18409]: cluster 2020-06-27T05:12:54.566025+0000 mgr.x (mgr.34109) 998 : cluster [DBG] pgmap v1087: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:55 smithi031 bash[18426]: cluster 2020-06-27T05:12:54.566025+0000 mgr.x (mgr.34109) 998 : cluster [DBG] pgmap v1087: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:56.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:55 smithi031 bash[22603]: cluster 2020-06-27T05:12:54.566025+0000 mgr.x (mgr.34109) 998 : cluster [DBG] pgmap v1087: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:58.223 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:57 smithi051 bash[18409]: cluster 2020-06-27T05:12:56.567618+0000 mgr.x (mgr.34109) 999 : cluster [DBG] pgmap v1088: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:58.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:57 smithi031 bash[18426]: cluster 2020-06-27T05:12:56.567618+0000 mgr.x (mgr.34109) 999 : cluster [DBG] pgmap v1088: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:12:58.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:57 smithi031 bash[22603]: cluster 2020-06-27T05:12:56.567618+0000 mgr.x (mgr.34109) 999 : cluster [DBG] pgmap v1088: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:00.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:12:59 smithi051 bash[18409]: cluster 2020-06-27T05:12:58.569353+0000 mgr.x (mgr.34109) 1000 : cluster [DBG] pgmap v1089: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:00.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:12:59 smithi031 bash[18426]: cluster 2020-06-27T05:12:58.569353+0000 mgr.x (mgr.34109) 1000 : cluster [DBG] pgmap v1089: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:00.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:12:59 smithi031 bash[22603]: cluster 2020-06-27T05:12:58.569353+0000 mgr.x (mgr.34109) 1000 : cluster [DBG] pgmap v1089: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:02.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:01 smithi051 bash[18409]: cluster 2020-06-27T05:13:00.571082+0000 mgr.x (mgr.34109) 1001 : cluster [DBG] pgmap v1090: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:02.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:01 smithi031 bash[18426]: cluster 2020-06-27T05:13:00.571082+0000 mgr.x (mgr.34109) 1001 : cluster [DBG] pgmap v1090: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:02.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:01 smithi031 bash[22603]: cluster 2020-06-27T05:13:00.571082+0000 mgr.x (mgr.34109) 1001 : cluster [DBG] pgmap v1090: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:04.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:03 smithi051 bash[18409]: cluster 2020-06-27T05:13:02.572729+0000 mgr.x (mgr.34109) 1002 : cluster [DBG] pgmap v1091: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:04.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:03 smithi031 bash[18426]: cluster 2020-06-27T05:13:02.572729+0000 mgr.x (mgr.34109) 1002 : cluster [DBG] pgmap v1091: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:04.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:03 smithi031 bash[22603]: cluster 2020-06-27T05:13:02.572729+0000 mgr.x (mgr.34109) 1002 : cluster [DBG] pgmap v1091: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:05 smithi051 bash[18409]: cluster 2020-06-27T05:13:04.574298+0000 mgr.x (mgr.34109) 1003 : cluster [DBG] pgmap v1092: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:06.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:05 smithi031 bash[18426]: cluster 2020-06-27T05:13:04.574298+0000 mgr.x (mgr.34109) 1003 : cluster [DBG] pgmap v1092: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:06.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:05 smithi031 bash[22603]: cluster 2020-06-27T05:13:04.574298+0000 mgr.x (mgr.34109) 1003 : cluster [DBG] pgmap v1092: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:08.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:07 smithi051 bash[18409]: cluster 2020-06-27T05:13:06.575927+0000 mgr.x (mgr.34109) 1004 : cluster [DBG] pgmap v1093: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:08.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:07 smithi031 bash[18426]: cluster 2020-06-27T05:13:06.575927+0000 mgr.x (mgr.34109) 1004 : cluster [DBG] pgmap v1093: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:08.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:07 smithi031 bash[22603]: cluster 2020-06-27T05:13:06.575927+0000 mgr.x (mgr.34109) 1004 : cluster [DBG] pgmap v1093: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:10.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:09 smithi051 bash[18409]: cluster 2020-06-27T05:13:08.577546+0000 mgr.x (mgr.34109) 1005 : cluster [DBG] pgmap v1094: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:10.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:09 smithi031 bash[18426]: cluster 2020-06-27T05:13:08.577546+0000 mgr.x (mgr.34109) 1005 : cluster [DBG] pgmap v1094: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:10.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:09 smithi031 bash[22603]: cluster 2020-06-27T05:13:08.577546+0000 mgr.x (mgr.34109) 1005 : cluster [DBG] pgmap v1094: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:12.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:11 smithi051 bash[18409]: cluster 2020-06-27T05:13:10.579021+0000 mgr.x (mgr.34109) 1006 : cluster [DBG] pgmap v1095: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:12.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:11 smithi031 bash[18426]: cluster 2020-06-27T05:13:10.579021+0000 mgr.x (mgr.34109) 1006 : cluster [DBG] pgmap v1095: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:12.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:11 smithi031 bash[22603]: cluster 2020-06-27T05:13:10.579021+0000 mgr.x (mgr.34109) 1006 : cluster [DBG] pgmap v1095: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:14.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:13 smithi051 bash[18409]: cluster 2020-06-27T05:13:12.580771+0000 mgr.x (mgr.34109) 1007 : cluster [DBG] pgmap v1096: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:14.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:13 smithi031 bash[18426]: cluster 2020-06-27T05:13:12.580771+0000 mgr.x (mgr.34109) 1007 : cluster [DBG] pgmap v1096: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:14.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:13 smithi031 bash[22603]: cluster 2020-06-27T05:13:12.580771+0000 mgr.x (mgr.34109) 1007 : cluster [DBG] pgmap v1096: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:15 smithi051 bash[18409]: cluster 2020-06-27T05:13:14.582391+0000 mgr.x (mgr.34109) 1008 : cluster [DBG] pgmap v1097: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:16.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:15 smithi031 bash[22603]: cluster 2020-06-27T05:13:14.582391+0000 mgr.x (mgr.34109) 1008 : cluster [DBG] pgmap v1097: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:15 smithi031 bash[18426]: cluster 2020-06-27T05:13:14.582391+0000 mgr.x (mgr.34109) 1008 : cluster [DBG] pgmap v1097: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:18.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:17 smithi051 bash[18409]: cluster 2020-06-27T05:13:16.584077+0000 mgr.x (mgr.34109) 1009 : cluster [DBG] pgmap v1098: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:18.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:17 smithi031 bash[22603]: cluster 2020-06-27T05:13:16.584077+0000 mgr.x (mgr.34109) 1009 : cluster [DBG] pgmap v1098: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:18.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:17 smithi031 bash[18426]: cluster 2020-06-27T05:13:16.584077+0000 mgr.x (mgr.34109) 1009 : cluster [DBG] pgmap v1098: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:20.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:19 smithi051 bash[18409]: cluster 2020-06-27T05:13:18.585757+0000 mgr.x (mgr.34109) 1010 : cluster [DBG] pgmap v1099: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:20.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:19 smithi031 bash[22603]: cluster 2020-06-27T05:13:18.585757+0000 mgr.x (mgr.34109) 1010 : cluster [DBG] pgmap v1099: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:20.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:19 smithi031 bash[18426]: cluster 2020-06-27T05:13:18.585757+0000 mgr.x (mgr.34109) 1010 : cluster [DBG] pgmap v1099: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:22.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:21 smithi051 bash[18409]: cluster 2020-06-27T05:13:20.587293+0000 mgr.x (mgr.34109) 1011 : cluster [DBG] pgmap v1100: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:22.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:21 smithi031 bash[22603]: cluster 2020-06-27T05:13:20.587293+0000 mgr.x (mgr.34109) 1011 : cluster [DBG] pgmap v1100: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:22.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:21 smithi031 bash[18426]: cluster 2020-06-27T05:13:20.587293+0000 mgr.x (mgr.34109) 1011 : cluster [DBG] pgmap v1100: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:24.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:23 smithi051 bash[18409]: cluster 2020-06-27T05:13:22.588856+0000 mgr.x (mgr.34109) 1012 : cluster [DBG] pgmap v1101: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:24.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:23 smithi031 bash[18426]: cluster 2020-06-27T05:13:22.588856+0000 mgr.x (mgr.34109) 1012 : cluster [DBG] pgmap v1101: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:24.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:23 smithi031 bash[22603]: cluster 2020-06-27T05:13:22.588856+0000 mgr.x (mgr.34109) 1012 : cluster [DBG] pgmap v1101: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:26.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:25 smithi051 bash[18409]: cluster 2020-06-27T05:13:24.590472+0000 mgr.x (mgr.34109) 1013 : cluster [DBG] pgmap v1102: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:25 smithi031 bash[18426]: cluster 2020-06-27T05:13:24.590472+0000 mgr.x (mgr.34109) 1013 : cluster [DBG] pgmap v1102: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:25 smithi031 bash[22603]: cluster 2020-06-27T05:13:24.590472+0000 mgr.x (mgr.34109) 1013 : cluster [DBG] pgmap v1102: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:28.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:27 smithi051 bash[18409]: cluster 2020-06-27T05:13:26.592015+0000 mgr.x (mgr.34109) 1014 : cluster [DBG] pgmap v1103: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:28.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:27 smithi031 bash[18426]: cluster 2020-06-27T05:13:26.592015+0000 mgr.x (mgr.34109) 1014 : cluster [DBG] pgmap v1103: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:28.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:27 smithi031 bash[22603]: cluster 2020-06-27T05:13:26.592015+0000 mgr.x (mgr.34109) 1014 : cluster [DBG] pgmap v1103: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:30.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:29 smithi051 bash[18409]: cluster 2020-06-27T05:13:28.593606+0000 mgr.x (mgr.34109) 1015 : cluster [DBG] pgmap v1104: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:30.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:29 smithi031 bash[18426]: cluster 2020-06-27T05:13:28.593606+0000 mgr.x (mgr.34109) 1015 : cluster [DBG] pgmap v1104: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:30.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:29 smithi031 bash[22603]: cluster 2020-06-27T05:13:28.593606+0000 mgr.x (mgr.34109) 1015 : cluster [DBG] pgmap v1104: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:32.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:31 smithi051 bash[18409]: cluster 2020-06-27T05:13:30.595292+0000 mgr.x (mgr.34109) 1016 : cluster [DBG] pgmap v1105: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:32.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:31 smithi031 bash[18426]: cluster 2020-06-27T05:13:30.595292+0000 mgr.x (mgr.34109) 1016 : cluster [DBG] pgmap v1105: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:32.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:31 smithi031 bash[22603]: cluster 2020-06-27T05:13:30.595292+0000 mgr.x (mgr.34109) 1016 : cluster [DBG] pgmap v1105: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:34.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:33 smithi051 bash[18409]: cluster 2020-06-27T05:13:32.596971+0000 mgr.x (mgr.34109) 1017 : cluster [DBG] pgmap v1106: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:34.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:33 smithi031 bash[18426]: cluster 2020-06-27T05:13:32.596971+0000 mgr.x (mgr.34109) 1017 : cluster [DBG] pgmap v1106: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:34.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:33 smithi031 bash[22603]: cluster 2020-06-27T05:13:32.596971+0000 mgr.x (mgr.34109) 1017 : cluster [DBG] pgmap v1106: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:35 smithi051 bash[18409]: cluster 2020-06-27T05:13:34.598661+0000 mgr.x (mgr.34109) 1018 : cluster [DBG] pgmap v1107: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:36.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:35 smithi031 bash[18426]: cluster 2020-06-27T05:13:34.598661+0000 mgr.x (mgr.34109) 1018 : cluster [DBG] pgmap v1107: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:36.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:35 smithi031 bash[22603]: cluster 2020-06-27T05:13:34.598661+0000 mgr.x (mgr.34109) 1018 : cluster [DBG] pgmap v1107: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:38.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:37 smithi051 bash[18409]: cluster 2020-06-27T05:13:36.600383+0000 mgr.x (mgr.34109) 1019 : cluster [DBG] pgmap v1108: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:38.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:37 smithi031 bash[18426]: cluster 2020-06-27T05:13:36.600383+0000 mgr.x (mgr.34109) 1019 : cluster [DBG] pgmap v1108: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:38.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:37 smithi031 bash[22603]: cluster 2020-06-27T05:13:36.600383+0000 mgr.x (mgr.34109) 1019 : cluster [DBG] pgmap v1108: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:40.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:39 smithi051 bash[18409]: cluster 2020-06-27T05:13:38.602124+0000 mgr.x (mgr.34109) 1020 : cluster [DBG] pgmap v1109: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:40.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:39 smithi031 bash[18426]: cluster 2020-06-27T05:13:38.602124+0000 mgr.x (mgr.34109) 1020 : cluster [DBG] pgmap v1109: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:40.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:39 smithi031 bash[22603]: cluster 2020-06-27T05:13:38.602124+0000 mgr.x (mgr.34109) 1020 : cluster [DBG] pgmap v1109: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:42.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:41 smithi051 bash[18409]: cluster 2020-06-27T05:13:40.603735+0000 mgr.x (mgr.34109) 1021 : cluster [DBG] pgmap v1110: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:42.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:41 smithi031 bash[22603]: cluster 2020-06-27T05:13:40.603735+0000 mgr.x (mgr.34109) 1021 : cluster [DBG] pgmap v1110: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:42.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:41 smithi031 bash[18426]: cluster 2020-06-27T05:13:40.603735+0000 mgr.x (mgr.34109) 1021 : cluster [DBG] pgmap v1110: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:44.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:43 smithi051 bash[18409]: cluster 2020-06-27T05:13:42.605372+0000 mgr.x (mgr.34109) 1022 : cluster [DBG] pgmap v1111: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:44.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:43 smithi031 bash[18426]: cluster 2020-06-27T05:13:42.605372+0000 mgr.x (mgr.34109) 1022 : cluster [DBG] pgmap v1111: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:44.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:43 smithi031 bash[22603]: cluster 2020-06-27T05:13:42.605372+0000 mgr.x (mgr.34109) 1022 : cluster [DBG] pgmap v1111: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:46.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:45 smithi051 bash[18409]: cluster 2020-06-27T05:13:44.606963+0000 mgr.x (mgr.34109) 1023 : cluster [DBG] pgmap v1112: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:46.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:45 smithi031 bash[18426]: cluster 2020-06-27T05:13:44.606963+0000 mgr.x (mgr.34109) 1023 : cluster [DBG] pgmap v1112: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:46.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:45 smithi031 bash[22603]: cluster 2020-06-27T05:13:44.606963+0000 mgr.x (mgr.34109) 1023 : cluster [DBG] pgmap v1112: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:48.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:47 smithi051 bash[18409]: cluster 2020-06-27T05:13:46.608681+0000 mgr.x (mgr.34109) 1024 : cluster [DBG] pgmap v1113: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:48.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:47 smithi031 bash[18426]: cluster 2020-06-27T05:13:46.608681+0000 mgr.x (mgr.34109) 1024 : cluster [DBG] pgmap v1113: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:48.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:47 smithi031 bash[22603]: cluster 2020-06-27T05:13:46.608681+0000 mgr.x (mgr.34109) 1024 : cluster [DBG] pgmap v1113: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:50.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:49 smithi051 bash[18409]: cluster 2020-06-27T05:13:48.610253+0000 mgr.x (mgr.34109) 1025 : cluster [DBG] pgmap v1114: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:50.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:49 smithi031 bash[18426]: cluster 2020-06-27T05:13:48.610253+0000 mgr.x (mgr.34109) 1025 : cluster [DBG] pgmap v1114: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:50.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:49 smithi031 bash[22603]: cluster 2020-06-27T05:13:48.610253+0000 mgr.x (mgr.34109) 1025 : cluster [DBG] pgmap v1114: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:52.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:51 smithi051 bash[18409]: cluster 2020-06-27T05:13:50.611963+0000 mgr.x (mgr.34109) 1026 : cluster [DBG] pgmap v1115: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:52.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:51 smithi031 bash[18426]: cluster 2020-06-27T05:13:50.611963+0000 mgr.x (mgr.34109) 1026 : cluster [DBG] pgmap v1115: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:52.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:51 smithi031 bash[22603]: cluster 2020-06-27T05:13:50.611963+0000 mgr.x (mgr.34109) 1026 : cluster [DBG] pgmap v1115: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:54.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:53 smithi051 bash[18409]: cluster 2020-06-27T05:13:52.613617+0000 mgr.x (mgr.34109) 1027 : cluster [DBG] pgmap v1116: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:54.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:53 smithi031 bash[18426]: cluster 2020-06-27T05:13:52.613617+0000 mgr.x (mgr.34109) 1027 : cluster [DBG] pgmap v1116: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:54.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:53 smithi031 bash[22603]: cluster 2020-06-27T05:13:52.613617+0000 mgr.x (mgr.34109) 1027 : cluster [DBG] pgmap v1116: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:55 smithi051 bash[18409]: cluster 2020-06-27T05:13:54.615235+0000 mgr.x (mgr.34109) 1028 : cluster [DBG] pgmap v1117: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:55 smithi031 bash[18426]: cluster 2020-06-27T05:13:54.615235+0000 mgr.x (mgr.34109) 1028 : cluster [DBG] pgmap v1117: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:56.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:55 smithi031 bash[22603]: cluster 2020-06-27T05:13:54.615235+0000 mgr.x (mgr.34109) 1028 : cluster [DBG] pgmap v1117: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:58.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:57 smithi051 bash[18409]: cluster 2020-06-27T05:13:56.616868+0000 mgr.x (mgr.34109) 1029 : cluster [DBG] pgmap v1118: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:58.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:57 smithi031 bash[18426]: cluster 2020-06-27T05:13:56.616868+0000 mgr.x (mgr.34109) 1029 : cluster [DBG] pgmap v1118: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:13:58.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:57 smithi031 bash[22603]: cluster 2020-06-27T05:13:56.616868+0000 mgr.x (mgr.34109) 1029 : cluster [DBG] pgmap v1118: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:00.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:13:59 smithi051 bash[18409]: cluster 2020-06-27T05:13:58.618516+0000 mgr.x (mgr.34109) 1030 : cluster [DBG] pgmap v1119: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:00.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:13:59 smithi031 bash[18426]: cluster 2020-06-27T05:13:58.618516+0000 mgr.x (mgr.34109) 1030 : cluster [DBG] pgmap v1119: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:00.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:13:59 smithi031 bash[22603]: cluster 2020-06-27T05:13:58.618516+0000 mgr.x (mgr.34109) 1030 : cluster [DBG] pgmap v1119: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:02.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:01 smithi051 bash[18409]: cluster 2020-06-27T05:14:00.620160+0000 mgr.x (mgr.34109) 1031 : cluster [DBG] pgmap v1120: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:02.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:01 smithi031 bash[18426]: cluster 2020-06-27T05:14:00.620160+0000 mgr.x (mgr.34109) 1031 : cluster [DBG] pgmap v1120: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:02.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:01 smithi031 bash[22603]: cluster 2020-06-27T05:14:00.620160+0000 mgr.x (mgr.34109) 1031 : cluster [DBG] pgmap v1120: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:04.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:03 smithi051 bash[18409]: cluster 2020-06-27T05:14:02.621714+0000 mgr.x (mgr.34109) 1032 : cluster [DBG] pgmap v1121: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:04.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:03 smithi031 bash[22603]: cluster 2020-06-27T05:14:02.621714+0000 mgr.x (mgr.34109) 1032 : cluster [DBG] pgmap v1121: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:04.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:03 smithi031 bash[18426]: cluster 2020-06-27T05:14:02.621714+0000 mgr.x (mgr.34109) 1032 : cluster [DBG] pgmap v1121: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:06.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:05 smithi051 bash[18409]: cluster 2020-06-27T05:14:04.623303+0000 mgr.x (mgr.34109) 1033 : cluster [DBG] pgmap v1122: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:06.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:05 smithi031 bash[22603]: cluster 2020-06-27T05:14:04.623303+0000 mgr.x (mgr.34109) 1033 : cluster [DBG] pgmap v1122: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:06.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:05 smithi031 bash[18426]: cluster 2020-06-27T05:14:04.623303+0000 mgr.x (mgr.34109) 1033 : cluster [DBG] pgmap v1122: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:08.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:07 smithi031 bash[22603]: cluster 2020-06-27T05:14:06.624870+0000 mgr.x (mgr.34109) 1034 : cluster [DBG] pgmap v1123: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:08.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:07 smithi031 bash[18426]: cluster 2020-06-27T05:14:06.624870+0000 mgr.x (mgr.34109) 1034 : cluster [DBG] pgmap v1123: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:08.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:07 smithi051 bash[18409]: cluster 2020-06-27T05:14:06.624870+0000 mgr.x (mgr.34109) 1034 : cluster [DBG] pgmap v1123: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:10.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:09 smithi051 bash[18409]: cluster 2020-06-27T05:14:08.626546+0000 mgr.x (mgr.34109) 1035 : cluster [DBG] pgmap v1124: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:10.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:09 smithi031 bash[18426]: cluster 2020-06-27T05:14:08.626546+0000 mgr.x (mgr.34109) 1035 : cluster [DBG] pgmap v1124: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:10.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:09 smithi031 bash[22603]: cluster 2020-06-27T05:14:08.626546+0000 mgr.x (mgr.34109) 1035 : cluster [DBG] pgmap v1124: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:12.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:11 smithi051 bash[18409]: cluster 2020-06-27T05:14:10.628162+0000 mgr.x (mgr.34109) 1036 : cluster [DBG] pgmap v1125: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:12.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:11 smithi031 bash[18426]: cluster 2020-06-27T05:14:10.628162+0000 mgr.x (mgr.34109) 1036 : cluster [DBG] pgmap v1125: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:12.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:11 smithi031 bash[22603]: cluster 2020-06-27T05:14:10.628162+0000 mgr.x (mgr.34109) 1036 : cluster [DBG] pgmap v1125: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:14.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:13 smithi051 bash[18409]: cluster 2020-06-27T05:14:12.629739+0000 mgr.x (mgr.34109) 1037 : cluster [DBG] pgmap v1126: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:14.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:13 smithi031 bash[22603]: cluster 2020-06-27T05:14:12.629739+0000 mgr.x (mgr.34109) 1037 : cluster [DBG] pgmap v1126: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:14.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:13 smithi031 bash[18426]: cluster 2020-06-27T05:14:12.629739+0000 mgr.x (mgr.34109) 1037 : cluster [DBG] pgmap v1126: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:16.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:15 smithi051 bash[18409]: cluster 2020-06-27T05:14:14.631320+0000 mgr.x (mgr.34109) 1038 : cluster [DBG] pgmap v1127: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:16.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:15 smithi031 bash[18426]: cluster 2020-06-27T05:14:14.631320+0000 mgr.x (mgr.34109) 1038 : cluster [DBG] pgmap v1127: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:16.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:15 smithi031 bash[22603]: cluster 2020-06-27T05:14:14.631320+0000 mgr.x (mgr.34109) 1038 : cluster [DBG] pgmap v1127: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:18.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:17 smithi051 bash[18409]: cluster 2020-06-27T05:14:16.632901+0000 mgr.x (mgr.34109) 1039 : cluster [DBG] pgmap v1128: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:18.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:17 smithi031 bash[18426]: cluster 2020-06-27T05:14:16.632901+0000 mgr.x (mgr.34109) 1039 : cluster [DBG] pgmap v1128: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:18.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:17 smithi031 bash[22603]: cluster 2020-06-27T05:14:16.632901+0000 mgr.x (mgr.34109) 1039 : cluster [DBG] pgmap v1128: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:20.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:20 smithi051 bash[18409]: cluster 2020-06-27T05:14:18.634565+0000 mgr.x (mgr.34109) 1040 : cluster [DBG] pgmap v1129: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:20.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:19 smithi031 bash[18426]: cluster 2020-06-27T05:14:18.634565+0000 mgr.x (mgr.34109) 1040 : cluster [DBG] pgmap v1129: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:20.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:19 smithi031 bash[22603]: cluster 2020-06-27T05:14:18.634565+0000 mgr.x (mgr.34109) 1040 : cluster [DBG] pgmap v1129: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:22.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:22 smithi051 bash[18409]: cluster 2020-06-27T05:14:20.636177+0000 mgr.x (mgr.34109) 1041 : cluster [DBG] pgmap v1130: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:22.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:22 smithi031 bash[22603]: cluster 2020-06-27T05:14:20.636177+0000 mgr.x (mgr.34109) 1041 : cluster [DBG] pgmap v1130: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:22.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:22 smithi031 bash[18426]: cluster 2020-06-27T05:14:20.636177+0000 mgr.x (mgr.34109) 1041 : cluster [DBG] pgmap v1130: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:24.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:24 smithi051 bash[18409]: cluster 2020-06-27T05:14:22.637795+0000 mgr.x (mgr.34109) 1042 : cluster [DBG] pgmap v1131: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:24.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:24 smithi031 bash[18426]: cluster 2020-06-27T05:14:22.637795+0000 mgr.x (mgr.34109) 1042 : cluster [DBG] pgmap v1131: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:24.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:24 smithi031 bash[22603]: cluster 2020-06-27T05:14:22.637795+0000 mgr.x (mgr.34109) 1042 : cluster [DBG] pgmap v1131: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:26.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:26 smithi051 bash[18409]: cluster 2020-06-27T05:14:24.639445+0000 mgr.x (mgr.34109) 1043 : cluster [DBG] pgmap v1132: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:26.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:26 smithi031 bash[18426]: cluster 2020-06-27T05:14:24.639445+0000 mgr.x (mgr.34109) 1043 : cluster [DBG] pgmap v1132: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:26.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:26 smithi031 bash[22603]: cluster 2020-06-27T05:14:24.639445+0000 mgr.x (mgr.34109) 1043 : cluster [DBG] pgmap v1132: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:28.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:28 smithi051 bash[18409]: cluster 2020-06-27T05:14:26.641208+0000 mgr.x (mgr.34109) 1044 : cluster [DBG] pgmap v1133: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:28.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:28 smithi031 bash[18426]: cluster 2020-06-27T05:14:26.641208+0000 mgr.x (mgr.34109) 1044 : cluster [DBG] pgmap v1133: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:28.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:28 smithi031 bash[22603]: cluster 2020-06-27T05:14:26.641208+0000 mgr.x (mgr.34109) 1044 : cluster [DBG] pgmap v1133: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:30.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:30 smithi051 bash[18409]: cluster 2020-06-27T05:14:28.642907+0000 mgr.x (mgr.34109) 1045 : cluster [DBG] pgmap v1134: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:30.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:30 smithi031 bash[18426]: cluster 2020-06-27T05:14:28.642907+0000 mgr.x (mgr.34109) 1045 : cluster [DBG] pgmap v1134: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:30.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:30 smithi031 bash[22603]: cluster 2020-06-27T05:14:28.642907+0000 mgr.x (mgr.34109) 1045 : cluster [DBG] pgmap v1134: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:32.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:32 smithi051 bash[18409]: cluster 2020-06-27T05:14:30.644630+0000 mgr.x (mgr.34109) 1046 : cluster [DBG] pgmap v1135: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:32.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:32 smithi031 bash[18426]: cluster 2020-06-27T05:14:30.644630+0000 mgr.x (mgr.34109) 1046 : cluster [DBG] pgmap v1135: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:32.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:32 smithi031 bash[22603]: cluster 2020-06-27T05:14:30.644630+0000 mgr.x (mgr.34109) 1046 : cluster [DBG] pgmap v1135: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:34.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:34 smithi051 bash[18409]: cluster 2020-06-27T05:14:32.646209+0000 mgr.x (mgr.34109) 1047 : cluster [DBG] pgmap v1136: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:34.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:34 smithi031 bash[18426]: cluster 2020-06-27T05:14:32.646209+0000 mgr.x (mgr.34109) 1047 : cluster [DBG] pgmap v1136: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:34.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:34 smithi031 bash[22603]: cluster 2020-06-27T05:14:32.646209+0000 mgr.x (mgr.34109) 1047 : cluster [DBG] pgmap v1136: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:36.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:36 smithi051 bash[18409]: cluster 2020-06-27T05:14:34.647831+0000 mgr.x (mgr.34109) 1048 : cluster [DBG] pgmap v1137: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:36.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:36 smithi031 bash[18426]: cluster 2020-06-27T05:14:34.647831+0000 mgr.x (mgr.34109) 1048 : cluster [DBG] pgmap v1137: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:36.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:36 smithi031 bash[22603]: cluster 2020-06-27T05:14:34.647831+0000 mgr.x (mgr.34109) 1048 : cluster [DBG] pgmap v1137: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:38.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:38 smithi051 bash[18409]: cluster 2020-06-27T05:14:36.649444+0000 mgr.x (mgr.34109) 1049 : cluster [DBG] pgmap v1138: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:38.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:38 smithi031 bash[22603]: cluster 2020-06-27T05:14:36.649444+0000 mgr.x (mgr.34109) 1049 : cluster [DBG] pgmap v1138: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:38.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:38 smithi031 bash[18426]: cluster 2020-06-27T05:14:36.649444+0000 mgr.x (mgr.34109) 1049 : cluster [DBG] pgmap v1138: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:40.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:40 smithi051 bash[18409]: cluster 2020-06-27T05:14:38.650990+0000 mgr.x (mgr.34109) 1050 : cluster [DBG] pgmap v1139: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:40.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:40 smithi031 bash[22603]: cluster 2020-06-27T05:14:38.650990+0000 mgr.x (mgr.34109) 1050 : cluster [DBG] pgmap v1139: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:40.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:40 smithi031 bash[18426]: cluster 2020-06-27T05:14:38.650990+0000 mgr.x (mgr.34109) 1050 : cluster [DBG] pgmap v1139: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:42.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:42 smithi051 bash[18409]: cluster 2020-06-27T05:14:40.652707+0000 mgr.x (mgr.34109) 1051 : cluster [DBG] pgmap v1140: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:42.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:42 smithi031 bash[18426]: cluster 2020-06-27T05:14:40.652707+0000 mgr.x (mgr.34109) 1051 : cluster [DBG] pgmap v1140: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:42.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:42 smithi031 bash[22603]: cluster 2020-06-27T05:14:40.652707+0000 mgr.x (mgr.34109) 1051 : cluster [DBG] pgmap v1140: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:44.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:44 smithi051 bash[18409]: cluster 2020-06-27T05:14:42.654306+0000 mgr.x (mgr.34109) 1052 : cluster [DBG] pgmap v1141: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:44.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:44 smithi031 bash[18426]: cluster 2020-06-27T05:14:42.654306+0000 mgr.x (mgr.34109) 1052 : cluster [DBG] pgmap v1141: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:44.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:44 smithi031 bash[22603]: cluster 2020-06-27T05:14:42.654306+0000 mgr.x (mgr.34109) 1052 : cluster [DBG] pgmap v1141: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:46.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:46 smithi051 bash[18409]: cluster 2020-06-27T05:14:44.655980+0000 mgr.x (mgr.34109) 1053 : cluster [DBG] pgmap v1142: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:46.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:46 smithi031 bash[22603]: cluster 2020-06-27T05:14:44.655980+0000 mgr.x (mgr.34109) 1053 : cluster [DBG] pgmap v1142: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:46.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:46 smithi031 bash[18426]: cluster 2020-06-27T05:14:44.655980+0000 mgr.x (mgr.34109) 1053 : cluster [DBG] pgmap v1142: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:48.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:48 smithi051 bash[18409]: cluster 2020-06-27T05:14:46.657734+0000 mgr.x (mgr.34109) 1054 : cluster [DBG] pgmap v1143: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:48.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:48 smithi031 bash[18426]: cluster 2020-06-27T05:14:46.657734+0000 mgr.x (mgr.34109) 1054 : cluster [DBG] pgmap v1143: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:48.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:48 smithi031 bash[22603]: cluster 2020-06-27T05:14:46.657734+0000 mgr.x (mgr.34109) 1054 : cluster [DBG] pgmap v1143: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:50.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:50 smithi051 bash[18409]: cluster 2020-06-27T05:14:48.659347+0000 mgr.x (mgr.34109) 1055 : cluster [DBG] pgmap v1144: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:50.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:50 smithi031 bash[18426]: cluster 2020-06-27T05:14:48.659347+0000 mgr.x (mgr.34109) 1055 : cluster [DBG] pgmap v1144: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:50.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:50 smithi031 bash[22603]: cluster 2020-06-27T05:14:48.659347+0000 mgr.x (mgr.34109) 1055 : cluster [DBG] pgmap v1144: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:52.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:52 smithi051 bash[18409]: cluster 2020-06-27T05:14:50.661106+0000 mgr.x (mgr.34109) 1056 : cluster [DBG] pgmap v1145: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:52.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:52 smithi031 bash[18426]: cluster 2020-06-27T05:14:50.661106+0000 mgr.x (mgr.34109) 1056 : cluster [DBG] pgmap v1145: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:52.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:52 smithi031 bash[22603]: cluster 2020-06-27T05:14:50.661106+0000 mgr.x (mgr.34109) 1056 : cluster [DBG] pgmap v1145: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:54.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:54 smithi051 bash[18409]: cluster 2020-06-27T05:14:52.662830+0000 mgr.x (mgr.34109) 1057 : cluster [DBG] pgmap v1146: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:54.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:54 smithi031 bash[22603]: cluster 2020-06-27T05:14:52.662830+0000 mgr.x (mgr.34109) 1057 : cluster [DBG] pgmap v1146: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:54.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:54 smithi031 bash[18426]: cluster 2020-06-27T05:14:52.662830+0000 mgr.x (mgr.34109) 1057 : cluster [DBG] pgmap v1146: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:56.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:56 smithi051 bash[18409]: cluster 2020-06-27T05:14:54.664409+0000 mgr.x (mgr.34109) 1058 : cluster [DBG] pgmap v1147: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:56.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:56 smithi031 bash[18426]: cluster 2020-06-27T05:14:54.664409+0000 mgr.x (mgr.34109) 1058 : cluster [DBG] pgmap v1147: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:56.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:56 smithi031 bash[22603]: cluster 2020-06-27T05:14:54.664409+0000 mgr.x (mgr.34109) 1058 : cluster [DBG] pgmap v1147: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:58.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:14:58 smithi051 bash[18409]: cluster 2020-06-27T05:14:56.666127+0000 mgr.x (mgr.34109) 1059 : cluster [DBG] pgmap v1148: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:58.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:14:58 smithi031 bash[18426]: cluster 2020-06-27T05:14:56.666127+0000 mgr.x (mgr.34109) 1059 : cluster [DBG] pgmap v1148: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:14:58.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:14:58 smithi031 bash[22603]: cluster 2020-06-27T05:14:56.666127+0000 mgr.x (mgr.34109) 1059 : cluster [DBG] pgmap v1148: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:00 smithi051 bash[18409]: cluster 2020-06-27T05:14:58.667781+0000 mgr.x (mgr.34109) 1060 : cluster [DBG] pgmap v1149: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:00.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:00 smithi031 bash[18426]: cluster 2020-06-27T05:14:58.667781+0000 mgr.x (mgr.34109) 1060 : cluster [DBG] pgmap v1149: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:00.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:00 smithi031 bash[22603]: cluster 2020-06-27T05:14:58.667781+0000 mgr.x (mgr.34109) 1060 : cluster [DBG] pgmap v1149: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:02.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:02 smithi051 bash[18409]: cluster 2020-06-27T05:15:00.669440+0000 mgr.x (mgr.34109) 1061 : cluster [DBG] pgmap v1150: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:02.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:02 smithi031 bash[18426]: cluster 2020-06-27T05:15:00.669440+0000 mgr.x (mgr.34109) 1061 : cluster [DBG] pgmap v1150: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:02.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:02 smithi031 bash[22603]: cluster 2020-06-27T05:15:00.669440+0000 mgr.x (mgr.34109) 1061 : cluster [DBG] pgmap v1150: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:04.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:04 smithi051 bash[18409]: cluster 2020-06-27T05:15:02.670951+0000 mgr.x (mgr.34109) 1062 : cluster [DBG] pgmap v1151: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:04.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:04 smithi031 bash[18426]: cluster 2020-06-27T05:15:02.670951+0000 mgr.x (mgr.34109) 1062 : cluster [DBG] pgmap v1151: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:04.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:04 smithi031 bash[22603]: cluster 2020-06-27T05:15:02.670951+0000 mgr.x (mgr.34109) 1062 : cluster [DBG] pgmap v1151: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:06.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:06 smithi051 bash[18409]: cluster 2020-06-27T05:15:04.672587+0000 mgr.x (mgr.34109) 1063 : cluster [DBG] pgmap v1152: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:06.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:06 smithi031 bash[18426]: cluster 2020-06-27T05:15:04.672587+0000 mgr.x (mgr.34109) 1063 : cluster [DBG] pgmap v1152: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:06.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:06 smithi031 bash[22603]: cluster 2020-06-27T05:15:04.672587+0000 mgr.x (mgr.34109) 1063 : cluster [DBG] pgmap v1152: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:08.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:08 smithi051 bash[18409]: cluster 2020-06-27T05:15:06.674161+0000 mgr.x (mgr.34109) 1064 : cluster [DBG] pgmap v1153: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:08.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:08 smithi031 bash[18426]: cluster 2020-06-27T05:15:06.674161+0000 mgr.x (mgr.34109) 1064 : cluster [DBG] pgmap v1153: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:08.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:08 smithi031 bash[22603]: cluster 2020-06-27T05:15:06.674161+0000 mgr.x (mgr.34109) 1064 : cluster [DBG] pgmap v1153: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:10.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:10 smithi051 bash[18409]: cluster 2020-06-27T05:15:08.675969+0000 mgr.x (mgr.34109) 1065 : cluster [DBG] pgmap v1154: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:10.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:10 smithi031 bash[18426]: cluster 2020-06-27T05:15:08.675969+0000 mgr.x (mgr.34109) 1065 : cluster [DBG] pgmap v1154: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:10.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:10 smithi031 bash[22603]: cluster 2020-06-27T05:15:08.675969+0000 mgr.x (mgr.34109) 1065 : cluster [DBG] pgmap v1154: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:11.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:11 smithi051 bash[18409]: cluster 2020-06-27T05:15:10.677638+0000 mgr.x (mgr.34109) 1066 : cluster [DBG] pgmap v1155: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:11 smithi031 bash[18426]: cluster 2020-06-27T05:15:10.677638+0000 mgr.x (mgr.34109) 1066 : cluster [DBG] pgmap v1155: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:11.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:11 smithi031 bash[22603]: cluster 2020-06-27T05:15:10.677638+0000 mgr.x (mgr.34109) 1066 : cluster [DBG] pgmap v1155: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:14.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:13 smithi051 bash[18409]: cluster 2020-06-27T05:15:12.679177+0000 mgr.x (mgr.34109) 1067 : cluster [DBG] pgmap v1156: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:14.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:13 smithi031 bash[18426]: cluster 2020-06-27T05:15:12.679177+0000 mgr.x (mgr.34109) 1067 : cluster [DBG] pgmap v1156: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:14.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:13 smithi031 bash[22603]: cluster 2020-06-27T05:15:12.679177+0000 mgr.x (mgr.34109) 1067 : cluster [DBG] pgmap v1156: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:15 smithi051 bash[18409]: cluster 2020-06-27T05:15:14.680745+0000 mgr.x (mgr.34109) 1068 : cluster [DBG] pgmap v1157: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:15 smithi031 bash[18426]: cluster 2020-06-27T05:15:14.680745+0000 mgr.x (mgr.34109) 1068 : cluster [DBG] pgmap v1157: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:16.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:15 smithi031 bash[22603]: cluster 2020-06-27T05:15:14.680745+0000 mgr.x (mgr.34109) 1068 : cluster [DBG] pgmap v1157: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:18.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:17 smithi051 bash[18409]: cluster 2020-06-27T05:15:16.682364+0000 mgr.x (mgr.34109) 1069 : cluster [DBG] pgmap v1158: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:18.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:17 smithi031 bash[18426]: cluster 2020-06-27T05:15:16.682364+0000 mgr.x (mgr.34109) 1069 : cluster [DBG] pgmap v1158: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:18.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:17 smithi031 bash[22603]: cluster 2020-06-27T05:15:16.682364+0000 mgr.x (mgr.34109) 1069 : cluster [DBG] pgmap v1158: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:20.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:19 smithi051 bash[18409]: cluster 2020-06-27T05:15:18.684043+0000 mgr.x (mgr.34109) 1070 : cluster [DBG] pgmap v1159: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:20.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:19 smithi031 bash[18426]: cluster 2020-06-27T05:15:18.684043+0000 mgr.x (mgr.34109) 1070 : cluster [DBG] pgmap v1159: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:20.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:19 smithi031 bash[22603]: cluster 2020-06-27T05:15:18.684043+0000 mgr.x (mgr.34109) 1070 : cluster [DBG] pgmap v1159: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:22.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:21 smithi051 bash[18409]: cluster 2020-06-27T05:15:20.685644+0000 mgr.x (mgr.34109) 1071 : cluster [DBG] pgmap v1160: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:22.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:21 smithi031 bash[18426]: cluster 2020-06-27T05:15:20.685644+0000 mgr.x (mgr.34109) 1071 : cluster [DBG] pgmap v1160: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:22.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:21 smithi031 bash[22603]: cluster 2020-06-27T05:15:20.685644+0000 mgr.x (mgr.34109) 1071 : cluster [DBG] pgmap v1160: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:24.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:23 smithi051 bash[18409]: cluster 2020-06-27T05:15:22.687365+0000 mgr.x (mgr.34109) 1072 : cluster [DBG] pgmap v1161: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:24.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:23 smithi031 bash[18426]: cluster 2020-06-27T05:15:22.687365+0000 mgr.x (mgr.34109) 1072 : cluster [DBG] pgmap v1161: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:24.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:23 smithi031 bash[22603]: cluster 2020-06-27T05:15:22.687365+0000 mgr.x (mgr.34109) 1072 : cluster [DBG] pgmap v1161: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:26.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:25 smithi051 bash[18409]: cluster 2020-06-27T05:15:24.689059+0000 mgr.x (mgr.34109) 1073 : cluster [DBG] pgmap v1162: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:25 smithi031 bash[18426]: cluster 2020-06-27T05:15:24.689059+0000 mgr.x (mgr.34109) 1073 : cluster [DBG] pgmap v1162: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:25 smithi031 bash[22603]: cluster 2020-06-27T05:15:24.689059+0000 mgr.x (mgr.34109) 1073 : cluster [DBG] pgmap v1162: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:28.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:27 smithi051 bash[18409]: cluster 2020-06-27T05:15:26.690772+0000 mgr.x (mgr.34109) 1074 : cluster [DBG] pgmap v1163: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:28.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:27 smithi031 bash[18426]: cluster 2020-06-27T05:15:26.690772+0000 mgr.x (mgr.34109) 1074 : cluster [DBG] pgmap v1163: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:28.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:27 smithi031 bash[22603]: cluster 2020-06-27T05:15:26.690772+0000 mgr.x (mgr.34109) 1074 : cluster [DBG] pgmap v1163: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:30.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:29 smithi051 bash[18409]: cluster 2020-06-27T05:15:28.692322+0000 mgr.x (mgr.34109) 1075 : cluster [DBG] pgmap v1164: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:30.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:29 smithi031 bash[18426]: cluster 2020-06-27T05:15:28.692322+0000 mgr.x (mgr.34109) 1075 : cluster [DBG] pgmap v1164: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:30.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:29 smithi031 bash[22603]: cluster 2020-06-27T05:15:28.692322+0000 mgr.x (mgr.34109) 1075 : cluster [DBG] pgmap v1164: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:32.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:31 smithi051 bash[18409]: cluster 2020-06-27T05:15:30.693924+0000 mgr.x (mgr.34109) 1076 : cluster [DBG] pgmap v1165: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:32.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:31 smithi031 bash[18426]: cluster 2020-06-27T05:15:30.693924+0000 mgr.x (mgr.34109) 1076 : cluster [DBG] pgmap v1165: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:32.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:31 smithi031 bash[22603]: cluster 2020-06-27T05:15:30.693924+0000 mgr.x (mgr.34109) 1076 : cluster [DBG] pgmap v1165: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:34.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:33 smithi051 bash[18409]: cluster 2020-06-27T05:15:32.695590+0000 mgr.x (mgr.34109) 1077 : cluster [DBG] pgmap v1166: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:34.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:33 smithi031 bash[18426]: cluster 2020-06-27T05:15:32.695590+0000 mgr.x (mgr.34109) 1077 : cluster [DBG] pgmap v1166: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:34.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:33 smithi031 bash[22603]: cluster 2020-06-27T05:15:32.695590+0000 mgr.x (mgr.34109) 1077 : cluster [DBG] pgmap v1166: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:35 smithi051 bash[18409]: cluster 2020-06-27T05:15:34.697268+0000 mgr.x (mgr.34109) 1078 : cluster [DBG] pgmap v1167: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:36.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:35 smithi031 bash[22603]: cluster 2020-06-27T05:15:34.697268+0000 mgr.x (mgr.34109) 1078 : cluster [DBG] pgmap v1167: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:36.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:35 smithi031 bash[18426]: cluster 2020-06-27T05:15:34.697268+0000 mgr.x (mgr.34109) 1078 : cluster [DBG] pgmap v1167: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:38.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:37 smithi051 bash[18409]: cluster 2020-06-27T05:15:36.698867+0000 mgr.x (mgr.34109) 1079 : cluster [DBG] pgmap v1168: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:38.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:37 smithi031 bash[22603]: cluster 2020-06-27T05:15:36.698867+0000 mgr.x (mgr.34109) 1079 : cluster [DBG] pgmap v1168: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:38.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:37 smithi031 bash[18426]: cluster 2020-06-27T05:15:36.698867+0000 mgr.x (mgr.34109) 1079 : cluster [DBG] pgmap v1168: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:40.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:39 smithi051 bash[18409]: cluster 2020-06-27T05:15:38.700625+0000 mgr.x (mgr.34109) 1080 : cluster [DBG] pgmap v1169: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:40.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:39 smithi031 bash[18426]: cluster 2020-06-27T05:15:38.700625+0000 mgr.x (mgr.34109) 1080 : cluster [DBG] pgmap v1169: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:40.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:39 smithi031 bash[22603]: cluster 2020-06-27T05:15:38.700625+0000 mgr.x (mgr.34109) 1080 : cluster [DBG] pgmap v1169: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:42.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:41 smithi051 bash[18409]: cluster 2020-06-27T05:15:40.702408+0000 mgr.x (mgr.34109) 1081 : cluster [DBG] pgmap v1170: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:42.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:41 smithi031 bash[18426]: cluster 2020-06-27T05:15:40.702408+0000 mgr.x (mgr.34109) 1081 : cluster [DBG] pgmap v1170: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:42.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:41 smithi031 bash[22603]: cluster 2020-06-27T05:15:40.702408+0000 mgr.x (mgr.34109) 1081 : cluster [DBG] pgmap v1170: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:44.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:43 smithi051 bash[18409]: cluster 2020-06-27T05:15:42.704115+0000 mgr.x (mgr.34109) 1082 : cluster [DBG] pgmap v1171: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:44.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:43 smithi031 bash[18426]: cluster 2020-06-27T05:15:42.704115+0000 mgr.x (mgr.34109) 1082 : cluster [DBG] pgmap v1171: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:44.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:43 smithi031 bash[22603]: cluster 2020-06-27T05:15:42.704115+0000 mgr.x (mgr.34109) 1082 : cluster [DBG] pgmap v1171: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:46.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:45 smithi051 bash[18409]: cluster 2020-06-27T05:15:44.705700+0000 mgr.x (mgr.34109) 1083 : cluster [DBG] pgmap v1172: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:46.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:45 smithi031 bash[22603]: cluster 2020-06-27T05:15:44.705700+0000 mgr.x (mgr.34109) 1083 : cluster [DBG] pgmap v1172: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:46.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:45 smithi031 bash[18426]: cluster 2020-06-27T05:15:44.705700+0000 mgr.x (mgr.34109) 1083 : cluster [DBG] pgmap v1172: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:48.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:47 smithi051 bash[18409]: cluster 2020-06-27T05:15:46.707369+0000 mgr.x (mgr.34109) 1084 : cluster [DBG] pgmap v1173: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:48.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:47 smithi031 bash[18426]: cluster 2020-06-27T05:15:46.707369+0000 mgr.x (mgr.34109) 1084 : cluster [DBG] pgmap v1173: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:48.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:47 smithi031 bash[22603]: cluster 2020-06-27T05:15:46.707369+0000 mgr.x (mgr.34109) 1084 : cluster [DBG] pgmap v1173: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:49.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:48 smithi051 bash[18409]: audit 2020-06-27T05:15:47.847528+0000 mon.b (mon.2) 365 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210130\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210205\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210239\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210436\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210540\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210636\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210730\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210767\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210797\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.210877\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]: dispatch 2020-06-27T05:15:49.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:48 smithi051 bash[18409]: audit 2020-06-27T05:15:47.848457+0000 mon.b (mon.2) 366 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563352\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563438\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563475\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563657\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563758\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563855\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563952\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563989\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.564019\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.564100\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]: dispatch 2020-06-27T05:15:49.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:48 smithi051 bash[18409]: audit 2020-06-27T05:15:47.848536+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210130\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210205\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210239\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210436\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210540\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210636\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210730\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210767\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210797\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.210877\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]: dispatch 2020-06-27T05:15:49.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:48 smithi051 bash[18409]: audit 2020-06-27T05:15:47.849127+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563352\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563438\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563475\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563657\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563758\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563855\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563952\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563989\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.564019\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.564100\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]: dispatch 2020-06-27T05:15:49.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:48 smithi051 bash[18409]: audit 2020-06-27T05:15:47.851691+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210130\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210205\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210239\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210436\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210540\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210636\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210730\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210767\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210797\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.210877\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]': finished 2020-06-27T05:15:49.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:48 smithi051 bash[18409]: audit 2020-06-27T05:15:47.852132+0000 mon.b (mon.2) 367 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:15:49.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:48 smithi051 bash[18409]: audit 2020-06-27T05:15:47.854258+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563352\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563438\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563475\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563657\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563758\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563855\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563952\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563989\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.564019\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.564100\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]': finished 2020-06-27T05:15:49.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:48 smithi051 bash[18409]: audit 2020-06-27T05:15:47.854846+0000 mon.b (mon.2) 368 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:15:49.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:48 smithi031 bash[18426]: audit 2020-06-27T05:15:47.847528+0000 mon.b (mon.2) 365 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210130\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210205\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210239\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210436\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210540\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210636\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210730\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210767\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210797\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.210877\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]: dispatch 2020-06-27T05:15:49.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:48 smithi031 bash[18426]: audit 2020-06-27T05:15:47.848457+0000 mon.b (mon.2) 366 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563352\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563438\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563475\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563657\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563758\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563855\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563952\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563989\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.564019\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.564100\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]: dispatch 2020-06-27T05:15:49.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:48 smithi031 bash[18426]: audit 2020-06-27T05:15:47.848536+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210130\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210205\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210239\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210436\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210540\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210636\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210730\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210767\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210797\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.210877\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]: dispatch 2020-06-27T05:15:49.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:48 smithi031 bash[18426]: audit 2020-06-27T05:15:47.849127+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563352\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563438\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563475\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563657\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563758\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563855\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563952\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563989\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.564019\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.564100\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]: dispatch 2020-06-27T05:15:49.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:48 smithi031 bash[18426]: audit 2020-06-27T05:15:47.851691+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210130\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210205\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210239\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210436\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210540\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210636\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210730\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210767\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210797\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.210877\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]': finished 2020-06-27T05:15:49.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:48 smithi031 bash[18426]: audit 2020-06-27T05:15:47.852132+0000 mon.b (mon.2) 367 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:15:49.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:48 smithi031 bash[18426]: audit 2020-06-27T05:15:47.854258+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563352\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563438\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563475\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563657\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563758\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563855\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563952\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563989\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.564019\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.564100\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]': finished 2020-06-27T05:15:49.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:48 smithi031 bash[18426]: audit 2020-06-27T05:15:47.854846+0000 mon.b (mon.2) 368 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:15:49.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:48 smithi031 bash[22603]: audit 2020-06-27T05:15:47.847528+0000 mon.b (mon.2) 365 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210130\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210205\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210239\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210436\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210540\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210636\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210730\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210767\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210797\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.210877\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]: dispatch 2020-06-27T05:15:49.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:48 smithi031 bash[22603]: audit 2020-06-27T05:15:47.848457+0000 mon.b (mon.2) 366 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563352\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563438\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563475\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563657\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563758\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563855\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563952\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563989\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.564019\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.564100\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]: dispatch 2020-06-27T05:15:49.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:48 smithi031 bash[22603]: audit 2020-06-27T05:15:47.848536+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210130\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210205\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210239\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210436\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210540\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210636\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210730\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210767\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210797\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.210877\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]: dispatch 2020-06-27T05:15:49.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:48 smithi031 bash[22603]: audit 2020-06-27T05:15:47.849127+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563352\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563438\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563475\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563657\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563758\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563855\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563952\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563989\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.564019\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.564100\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]: dispatch 2020-06-27T05:15:49.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:48 smithi031 bash[22603]: audit 2020-06-27T05:15:47.851691+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210130\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210205\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210239\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210436\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210540\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.210636\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210730\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210767\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.210797\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.210877\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]': finished 2020-06-27T05:15:49.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:48 smithi031 bash[22603]: audit 2020-06-27T05:15:47.852132+0000 mon.b (mon.2) 367 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:15:49.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:48 smithi031 bash[22603]: audit 2020-06-27T05:15:47.854258+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563352\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563438\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563475\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563657\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563758\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:05:47.563855\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563952\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.563989\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:05:47.564019\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:05:47.564100\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]': finished 2020-06-27T05:15:49.229 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:48 smithi031 bash[22603]: audit 2020-06-27T05:15:47.854846+0000 mon.b (mon.2) 368 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:15:49.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:49 smithi051 bash[18409]: cluster 2020-06-27T05:15:48.709269+0000 mgr.x (mgr.34109) 1085 : cluster [DBG] pgmap v1174: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:49.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:49 smithi051 bash[18409]: audit 2020-06-27T05:15:49.752962+0000 mon.b (mon.2) 369 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]: dispatch 2020-06-27T05:15:49.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:49 smithi051 bash[18409]: audit 2020-06-27T05:15:49.753734+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]: dispatch 2020-06-27T05:15:49.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:49 smithi051 bash[18409]: audit 2020-06-27T05:15:49.758234+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]': finished 2020-06-27T05:15:49.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:49 smithi051 bash[18409]: audit 2020-06-27T05:15:49.759371+0000 mon.b (mon.2) 370 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T05:15:49.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:49 smithi031 bash[18426]: cluster 2020-06-27T05:15:48.709269+0000 mgr.x (mgr.34109) 1085 : cluster [DBG] pgmap v1174: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:49.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:49 smithi031 bash[18426]: audit 2020-06-27T05:15:49.752962+0000 mon.b (mon.2) 369 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]: dispatch 2020-06-27T05:15:49.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:49 smithi031 bash[18426]: audit 2020-06-27T05:15:49.753734+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]: dispatch 2020-06-27T05:15:49.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:49 smithi031 bash[18426]: audit 2020-06-27T05:15:49.758234+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]': finished 2020-06-27T05:15:49.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:49 smithi031 bash[18426]: audit 2020-06-27T05:15:49.759371+0000 mon.b (mon.2) 370 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T05:15:49.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:49 smithi031 bash[22603]: cluster 2020-06-27T05:15:48.709269+0000 mgr.x (mgr.34109) 1085 : cluster [DBG] pgmap v1174: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:49.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:49 smithi031 bash[22603]: audit 2020-06-27T05:15:49.752962+0000 mon.b (mon.2) 369 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]: dispatch 2020-06-27T05:15:49.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:49 smithi031 bash[22603]: audit 2020-06-27T05:15:49.753734+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]: dispatch 2020-06-27T05:15:49.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:49 smithi031 bash[22603]: audit 2020-06-27T05:15:49.758234+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T04:43:22.466984\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]': finished 2020-06-27T05:15:49.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:49 smithi031 bash[22603]: audit 2020-06-27T05:15:49.759371+0000 mon.b (mon.2) 370 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T05:15:50.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:50 smithi051 bash[18409]: audit 2020-06-27T05:15:50.219290+0000 mon.b (mon.2) 371 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]: dispatch 2020-06-27T05:15:50.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:50 smithi051 bash[18409]: audit 2020-06-27T05:15:50.220134+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]: dispatch 2020-06-27T05:15:50.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:50 smithi051 bash[18409]: audit 2020-06-27T05:15:50.222829+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]': finished 2020-06-27T05:15:50.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:50 smithi051 bash[18409]: audit 2020-06-27T05:15:50.225920+0000 mon.b (mon.2) 372 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T05:15:50.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:50 smithi031 bash[22603]: audit 2020-06-27T05:15:50.219290+0000 mon.b (mon.2) 371 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]: dispatch 2020-06-27T05:15:50.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:50 smithi031 bash[22603]: audit 2020-06-27T05:15:50.220134+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]: dispatch 2020-06-27T05:15:50.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:50 smithi031 bash[22603]: audit 2020-06-27T05:15:50.222829+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]': finished 2020-06-27T05:15:50.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:50 smithi031 bash[22603]: audit 2020-06-27T05:15:50.225920+0000 mon.b (mon.2) 372 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T05:15:50.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:50 smithi031 bash[18426]: audit 2020-06-27T05:15:50.219290+0000 mon.b (mon.2) 371 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]: dispatch 2020-06-27T05:15:50.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:50 smithi031 bash[18426]: audit 2020-06-27T05:15:50.220134+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]: dispatch 2020-06-27T05:15:50.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:50 smithi031 bash[18426]: audit 2020-06-27T05:15:50.222829+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T04:44:23.543361\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]': finished 2020-06-27T05:15:50.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:50 smithi031 bash[18426]: audit 2020-06-27T05:15:50.225920+0000 mon.b (mon.2) 372 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T05:15:52.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:51 smithi051 bash[18409]: cluster 2020-06-27T05:15:50.710732+0000 mgr.x (mgr.34109) 1086 : cluster [DBG] pgmap v1175: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:52.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:51 smithi031 bash[22603]: cluster 2020-06-27T05:15:50.710732+0000 mgr.x (mgr.34109) 1086 : cluster [DBG] pgmap v1175: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:52.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:51 smithi031 bash[18426]: cluster 2020-06-27T05:15:50.710732+0000 mgr.x (mgr.34109) 1086 : cluster [DBG] pgmap v1175: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:52 smithi051 bash[18409]: audit 2020-06-27T05:15:52.661623+0000 mon.b (mon.2) 373 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:15:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:52 smithi031 bash[18426]: audit 2020-06-27T05:15:52.661623+0000 mon.b (mon.2) 373 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:15:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:52 smithi031 bash[22603]: audit 2020-06-27T05:15:52.661623+0000 mon.b (mon.2) 373 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:15:54.220 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:53 smithi051 bash[18409]: cluster 2020-06-27T05:15:52.712066+0000 mgr.x (mgr.34109) 1087 : cluster [DBG] pgmap v1176: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:54.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:53 smithi051 bash[18409]: audit 2020-06-27T05:15:52.905586+0000 mon.b (mon.2) 374 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]: dispatch 2020-06-27T05:15:54.221 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:53 smithi051 bash[18409]: audit 2020-06-27T05:15:52.906475+0000 mon.a (mon.0) 1455 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]: dispatch 2020-06-27T05:15:54.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:53 smithi051 bash[18409]: audit 2020-06-27T05:15:52.908918+0000 mon.a (mon.0) 1456 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]': finished 2020-06-27T05:15:54.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:53 smithi051 bash[18409]: audit 2020-06-27T05:15:53.113394+0000 mon.b (mon.2) 375 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:15:54.222 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:53 smithi051 bash[18409]: audit 2020-06-27T05:15:53.355104+0000 mon.b (mon.2) 376 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]: dispatch 2020-06-27T05:15:54.223 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:53 smithi051 bash[18409]: audit 2020-06-27T05:15:53.356084+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]: dispatch 2020-06-27T05:15:54.223 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:53 smithi051 bash[18409]: audit 2020-06-27T05:15:53.358576+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]': finished 2020-06-27T05:15:54.224 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:53 smithi051 bash[18409]: audit 2020-06-27T05:15:53.360996+0000 mon.b (mon.2) 377 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:15:54.224 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:53 smithi051 bash[18409]: audit 2020-06-27T05:15:53.361918+0000 mon.b (mon.2) 378 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:15:54.225 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:53 smithi051 bash[18409]: audit 2020-06-27T05:15:53.362789+0000 mon.b (mon.2) 379 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:15:54.229 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[18426]: cluster 2020-06-27T05:15:52.712066+0000 mgr.x (mgr.34109) 1087 : cluster [DBG] pgmap v1176: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:54.229 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[18426]: audit 2020-06-27T05:15:52.905586+0000 mon.b (mon.2) 374 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]: dispatch 2020-06-27T05:15:54.230 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[18426]: audit 2020-06-27T05:15:52.906475+0000 mon.a (mon.0) 1455 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]: dispatch 2020-06-27T05:15:54.230 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[18426]: audit 2020-06-27T05:15:52.908918+0000 mon.a (mon.0) 1456 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]': finished 2020-06-27T05:15:54.231 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[18426]: audit 2020-06-27T05:15:53.113394+0000 mon.b (mon.2) 375 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:15:54.231 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[18426]: audit 2020-06-27T05:15:53.355104+0000 mon.b (mon.2) 376 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]: dispatch 2020-06-27T05:15:54.232 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[18426]: audit 2020-06-27T05:15:53.356084+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]: dispatch 2020-06-27T05:15:54.232 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[18426]: audit 2020-06-27T05:15:53.358576+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]': finished 2020-06-27T05:15:54.233 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[18426]: audit 2020-06-27T05:15:53.360996+0000 mon.b (mon.2) 377 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:15:54.233 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[18426]: audit 2020-06-27T05:15:53.361918+0000 mon.b (mon.2) 378 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:15:54.233 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[18426]: audit 2020-06-27T05:15:53.362789+0000 mon.b (mon.2) 379 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:15:54.234 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[22603]: cluster 2020-06-27T05:15:52.712066+0000 mgr.x (mgr.34109) 1087 : cluster [DBG] pgmap v1176: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:54.236 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[22603]: audit 2020-06-27T05:15:52.905586+0000 mon.b (mon.2) 374 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]: dispatch 2020-06-27T05:15:54.236 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[22603]: audit 2020-06-27T05:15:52.906475+0000 mon.a (mon.0) 1455 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]: dispatch 2020-06-27T05:15:54.237 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[22603]: audit 2020-06-27T05:15:52.908918+0000 mon.a (mon.0) 1456 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:15:47.846743\"}"}]': finished 2020-06-27T05:15:54.237 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[22603]: audit 2020-06-27T05:15:53.113394+0000 mon.b (mon.2) 375 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:15:54.237 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[22603]: audit 2020-06-27T05:15:53.355104+0000 mon.b (mon.2) 376 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]: dispatch 2020-06-27T05:15:54.238 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[22603]: audit 2020-06-27T05:15:53.356084+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]: dispatch 2020-06-27T05:15:54.238 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[22603]: audit 2020-06-27T05:15:53.358576+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:15:47.847832\"}"}]': finished 2020-06-27T05:15:54.239 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[22603]: audit 2020-06-27T05:15:53.360996+0000 mon.b (mon.2) 377 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:15:54.239 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[22603]: audit 2020-06-27T05:15:53.361918+0000 mon.b (mon.2) 378 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:15:54.240 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:53 smithi031 bash[22603]: audit 2020-06-27T05:15:53.362789+0000 mon.b (mon.2) 379 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:15:55.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:54 smithi051 bash[18409]: audit 2020-06-27T05:15:53.361258+0000 mgr.x (mgr.34109) 1088 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:15:55.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:54 smithi051 bash[18409]: audit 2020-06-27T05:15:53.362167+0000 mgr.x (mgr.34109) 1089 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:15:55.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:54 smithi051 bash[18409]: audit 2020-06-27T05:15:53.363036+0000 mgr.x (mgr.34109) 1090 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:15:55.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:54 smithi031 bash[18426]: audit 2020-06-27T05:15:53.361258+0000 mgr.x (mgr.34109) 1088 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:15:55.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:54 smithi031 bash[18426]: audit 2020-06-27T05:15:53.362167+0000 mgr.x (mgr.34109) 1089 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:15:55.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:54 smithi031 bash[18426]: audit 2020-06-27T05:15:53.363036+0000 mgr.x (mgr.34109) 1090 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:15:55.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:54 smithi031 bash[22603]: audit 2020-06-27T05:15:53.361258+0000 mgr.x (mgr.34109) 1088 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:15:55.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:54 smithi031 bash[22603]: audit 2020-06-27T05:15:53.362167+0000 mgr.x (mgr.34109) 1089 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:15:55.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:54 smithi031 bash[22603]: audit 2020-06-27T05:15:53.363036+0000 mgr.x (mgr.34109) 1090 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:15:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:55 smithi051 bash[18409]: cluster 2020-06-27T05:15:54.713657+0000 mgr.x (mgr.34109) 1091 : cluster [DBG] pgmap v1177: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:55 smithi031 bash[18426]: cluster 2020-06-27T05:15:54.713657+0000 mgr.x (mgr.34109) 1091 : cluster [DBG] pgmap v1177: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:56.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:55 smithi031 bash[22603]: cluster 2020-06-27T05:15:54.713657+0000 mgr.x (mgr.34109) 1091 : cluster [DBG] pgmap v1177: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:58.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:57 smithi051 bash[18409]: cluster 2020-06-27T05:15:56.715108+0000 mgr.x (mgr.34109) 1092 : cluster [DBG] pgmap v1178: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:58.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:57 smithi031 bash[18426]: cluster 2020-06-27T05:15:56.715108+0000 mgr.x (mgr.34109) 1092 : cluster [DBG] pgmap v1178: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:15:58.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:57 smithi031 bash[22603]: cluster 2020-06-27T05:15:56.715108+0000 mgr.x (mgr.34109) 1092 : cluster [DBG] pgmap v1178: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:00.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:15:59 smithi051 bash[18409]: cluster 2020-06-27T05:15:58.716826+0000 mgr.x (mgr.34109) 1093 : cluster [DBG] pgmap v1179: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:00.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:15:59 smithi031 bash[18426]: cluster 2020-06-27T05:15:58.716826+0000 mgr.x (mgr.34109) 1093 : cluster [DBG] pgmap v1179: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:00.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:15:59 smithi031 bash[22603]: cluster 2020-06-27T05:15:58.716826+0000 mgr.x (mgr.34109) 1093 : cluster [DBG] pgmap v1179: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:02.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:01 smithi051 bash[18409]: cluster 2020-06-27T05:16:00.718481+0000 mgr.x (mgr.34109) 1094 : cluster [DBG] pgmap v1180: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:02.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:01 smithi031 bash[18426]: cluster 2020-06-27T05:16:00.718481+0000 mgr.x (mgr.34109) 1094 : cluster [DBG] pgmap v1180: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:02.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:01 smithi031 bash[22603]: cluster 2020-06-27T05:16:00.718481+0000 mgr.x (mgr.34109) 1094 : cluster [DBG] pgmap v1180: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:04.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:03 smithi051 bash[18409]: cluster 2020-06-27T05:16:02.719987+0000 mgr.x (mgr.34109) 1095 : cluster [DBG] pgmap v1181: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:04.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:03 smithi031 bash[18426]: cluster 2020-06-27T05:16:02.719987+0000 mgr.x (mgr.34109) 1095 : cluster [DBG] pgmap v1181: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:04.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:03 smithi031 bash[22603]: cluster 2020-06-27T05:16:02.719987+0000 mgr.x (mgr.34109) 1095 : cluster [DBG] pgmap v1181: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:05 smithi051 bash[18409]: cluster 2020-06-27T05:16:04.721591+0000 mgr.x (mgr.34109) 1096 : cluster [DBG] pgmap v1182: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:06.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:05 smithi031 bash[18426]: cluster 2020-06-27T05:16:04.721591+0000 mgr.x (mgr.34109) 1096 : cluster [DBG] pgmap v1182: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:06.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:05 smithi031 bash[22603]: cluster 2020-06-27T05:16:04.721591+0000 mgr.x (mgr.34109) 1096 : cluster [DBG] pgmap v1182: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:08.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:07 smithi051 bash[18409]: cluster 2020-06-27T05:16:06.723363+0000 mgr.x (mgr.34109) 1097 : cluster [DBG] pgmap v1183: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:08.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:07 smithi031 bash[22603]: cluster 2020-06-27T05:16:06.723363+0000 mgr.x (mgr.34109) 1097 : cluster [DBG] pgmap v1183: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:08.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:07 smithi031 bash[18426]: cluster 2020-06-27T05:16:06.723363+0000 mgr.x (mgr.34109) 1097 : cluster [DBG] pgmap v1183: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:10.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:09 smithi051 bash[18409]: cluster 2020-06-27T05:16:08.725052+0000 mgr.x (mgr.34109) 1098 : cluster [DBG] pgmap v1184: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:10.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:09 smithi031 bash[18426]: cluster 2020-06-27T05:16:08.725052+0000 mgr.x (mgr.34109) 1098 : cluster [DBG] pgmap v1184: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:10.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:09 smithi031 bash[22603]: cluster 2020-06-27T05:16:08.725052+0000 mgr.x (mgr.34109) 1098 : cluster [DBG] pgmap v1184: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:12.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:11 smithi051 bash[18409]: cluster 2020-06-27T05:16:10.726689+0000 mgr.x (mgr.34109) 1099 : cluster [DBG] pgmap v1185: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:12.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:11 smithi031 bash[18426]: cluster 2020-06-27T05:16:10.726689+0000 mgr.x (mgr.34109) 1099 : cluster [DBG] pgmap v1185: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:12.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:11 smithi031 bash[22603]: cluster 2020-06-27T05:16:10.726689+0000 mgr.x (mgr.34109) 1099 : cluster [DBG] pgmap v1185: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:14.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:13 smithi051 bash[18409]: cluster 2020-06-27T05:16:12.728348+0000 mgr.x (mgr.34109) 1100 : cluster [DBG] pgmap v1186: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:14.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:13 smithi031 bash[18426]: cluster 2020-06-27T05:16:12.728348+0000 mgr.x (mgr.34109) 1100 : cluster [DBG] pgmap v1186: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:14.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:13 smithi031 bash[22603]: cluster 2020-06-27T05:16:12.728348+0000 mgr.x (mgr.34109) 1100 : cluster [DBG] pgmap v1186: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:15 smithi051 bash[18409]: cluster 2020-06-27T05:16:14.729880+0000 mgr.x (mgr.34109) 1101 : cluster [DBG] pgmap v1187: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:15 smithi031 bash[18426]: cluster 2020-06-27T05:16:14.729880+0000 mgr.x (mgr.34109) 1101 : cluster [DBG] pgmap v1187: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:16.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:15 smithi031 bash[22603]: cluster 2020-06-27T05:16:14.729880+0000 mgr.x (mgr.34109) 1101 : cluster [DBG] pgmap v1187: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:18.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:17 smithi051 bash[18409]: cluster 2020-06-27T05:16:16.731549+0000 mgr.x (mgr.34109) 1102 : cluster [DBG] pgmap v1188: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:18.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:17 smithi031 bash[18426]: cluster 2020-06-27T05:16:16.731549+0000 mgr.x (mgr.34109) 1102 : cluster [DBG] pgmap v1188: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:18.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:17 smithi031 bash[22603]: cluster 2020-06-27T05:16:16.731549+0000 mgr.x (mgr.34109) 1102 : cluster [DBG] pgmap v1188: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:20.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:19 smithi051 bash[18409]: cluster 2020-06-27T05:16:18.733257+0000 mgr.x (mgr.34109) 1103 : cluster [DBG] pgmap v1189: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:20.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:19 smithi031 bash[18426]: cluster 2020-06-27T05:16:18.733257+0000 mgr.x (mgr.34109) 1103 : cluster [DBG] pgmap v1189: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:20.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:19 smithi031 bash[22603]: cluster 2020-06-27T05:16:18.733257+0000 mgr.x (mgr.34109) 1103 : cluster [DBG] pgmap v1189: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:22.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:21 smithi051 bash[18409]: cluster 2020-06-27T05:16:20.734967+0000 mgr.x (mgr.34109) 1104 : cluster [DBG] pgmap v1190: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:22.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:21 smithi031 bash[18426]: cluster 2020-06-27T05:16:20.734967+0000 mgr.x (mgr.34109) 1104 : cluster [DBG] pgmap v1190: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:22.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:21 smithi031 bash[22603]: cluster 2020-06-27T05:16:20.734967+0000 mgr.x (mgr.34109) 1104 : cluster [DBG] pgmap v1190: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:24.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:23 smithi051 bash[18409]: cluster 2020-06-27T05:16:22.736598+0000 mgr.x (mgr.34109) 1105 : cluster [DBG] pgmap v1191: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:24.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:23 smithi031 bash[18426]: cluster 2020-06-27T05:16:22.736598+0000 mgr.x (mgr.34109) 1105 : cluster [DBG] pgmap v1191: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:24.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:23 smithi031 bash[22603]: cluster 2020-06-27T05:16:22.736598+0000 mgr.x (mgr.34109) 1105 : cluster [DBG] pgmap v1191: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:26.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:25 smithi051 bash[18409]: cluster 2020-06-27T05:16:24.738254+0000 mgr.x (mgr.34109) 1106 : cluster [DBG] pgmap v1192: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:25 smithi031 bash[18426]: cluster 2020-06-27T05:16:24.738254+0000 mgr.x (mgr.34109) 1106 : cluster [DBG] pgmap v1192: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:25 smithi031 bash[22603]: cluster 2020-06-27T05:16:24.738254+0000 mgr.x (mgr.34109) 1106 : cluster [DBG] pgmap v1192: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:28.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:27 smithi051 bash[18409]: cluster 2020-06-27T05:16:26.739915+0000 mgr.x (mgr.34109) 1107 : cluster [DBG] pgmap v1193: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:28.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:27 smithi031 bash[18426]: cluster 2020-06-27T05:16:26.739915+0000 mgr.x (mgr.34109) 1107 : cluster [DBG] pgmap v1193: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:28.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:27 smithi031 bash[22603]: cluster 2020-06-27T05:16:26.739915+0000 mgr.x (mgr.34109) 1107 : cluster [DBG] pgmap v1193: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:30.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:29 smithi051 bash[18409]: cluster 2020-06-27T05:16:28.741589+0000 mgr.x (mgr.34109) 1108 : cluster [DBG] pgmap v1194: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:30.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:29 smithi031 bash[18426]: cluster 2020-06-27T05:16:28.741589+0000 mgr.x (mgr.34109) 1108 : cluster [DBG] pgmap v1194: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:30.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:29 smithi031 bash[22603]: cluster 2020-06-27T05:16:28.741589+0000 mgr.x (mgr.34109) 1108 : cluster [DBG] pgmap v1194: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:32.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:31 smithi051 bash[18409]: cluster 2020-06-27T05:16:30.743096+0000 mgr.x (mgr.34109) 1109 : cluster [DBG] pgmap v1195: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:32.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:31 smithi031 bash[18426]: cluster 2020-06-27T05:16:30.743096+0000 mgr.x (mgr.34109) 1109 : cluster [DBG] pgmap v1195: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:32.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:31 smithi031 bash[22603]: cluster 2020-06-27T05:16:30.743096+0000 mgr.x (mgr.34109) 1109 : cluster [DBG] pgmap v1195: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:34.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:33 smithi051 bash[18409]: cluster 2020-06-27T05:16:32.744765+0000 mgr.x (mgr.34109) 1110 : cluster [DBG] pgmap v1196: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:34.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:33 smithi031 bash[18426]: cluster 2020-06-27T05:16:32.744765+0000 mgr.x (mgr.34109) 1110 : cluster [DBG] pgmap v1196: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:34.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:33 smithi031 bash[22603]: cluster 2020-06-27T05:16:32.744765+0000 mgr.x (mgr.34109) 1110 : cluster [DBG] pgmap v1196: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:35 smithi051 bash[18409]: cluster 2020-06-27T05:16:34.746312+0000 mgr.x (mgr.34109) 1111 : cluster [DBG] pgmap v1197: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:36.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:35 smithi031 bash[18426]: cluster 2020-06-27T05:16:34.746312+0000 mgr.x (mgr.34109) 1111 : cluster [DBG] pgmap v1197: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:36.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:35 smithi031 bash[22603]: cluster 2020-06-27T05:16:34.746312+0000 mgr.x (mgr.34109) 1111 : cluster [DBG] pgmap v1197: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:38.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:37 smithi051 bash[18409]: cluster 2020-06-27T05:16:36.748042+0000 mgr.x (mgr.34109) 1112 : cluster [DBG] pgmap v1198: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:38.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:37 smithi031 bash[18426]: cluster 2020-06-27T05:16:36.748042+0000 mgr.x (mgr.34109) 1112 : cluster [DBG] pgmap v1198: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:38.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:37 smithi031 bash[22603]: cluster 2020-06-27T05:16:36.748042+0000 mgr.x (mgr.34109) 1112 : cluster [DBG] pgmap v1198: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:40.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:39 smithi051 bash[18409]: cluster 2020-06-27T05:16:38.749632+0000 mgr.x (mgr.34109) 1113 : cluster [DBG] pgmap v1199: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:40.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:39 smithi031 bash[18426]: cluster 2020-06-27T05:16:38.749632+0000 mgr.x (mgr.34109) 1113 : cluster [DBG] pgmap v1199: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:40.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:39 smithi031 bash[22603]: cluster 2020-06-27T05:16:38.749632+0000 mgr.x (mgr.34109) 1113 : cluster [DBG] pgmap v1199: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:42.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:41 smithi051 bash[18409]: cluster 2020-06-27T05:16:40.751316+0000 mgr.x (mgr.34109) 1114 : cluster [DBG] pgmap v1200: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:42.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:41 smithi031 bash[18426]: cluster 2020-06-27T05:16:40.751316+0000 mgr.x (mgr.34109) 1114 : cluster [DBG] pgmap v1200: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:42.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:41 smithi031 bash[22603]: cluster 2020-06-27T05:16:40.751316+0000 mgr.x (mgr.34109) 1114 : cluster [DBG] pgmap v1200: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:44.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:43 smithi051 bash[18409]: cluster 2020-06-27T05:16:42.752932+0000 mgr.x (mgr.34109) 1115 : cluster [DBG] pgmap v1201: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:44.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:43 smithi031 bash[18426]: cluster 2020-06-27T05:16:42.752932+0000 mgr.x (mgr.34109) 1115 : cluster [DBG] pgmap v1201: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:44.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:43 smithi031 bash[22603]: cluster 2020-06-27T05:16:42.752932+0000 mgr.x (mgr.34109) 1115 : cluster [DBG] pgmap v1201: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:46.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:45 smithi051 bash[18409]: cluster 2020-06-27T05:16:44.754468+0000 mgr.x (mgr.34109) 1116 : cluster [DBG] pgmap v1202: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:46.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:45 smithi031 bash[18426]: cluster 2020-06-27T05:16:44.754468+0000 mgr.x (mgr.34109) 1116 : cluster [DBG] pgmap v1202: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:46.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:45 smithi031 bash[22603]: cluster 2020-06-27T05:16:44.754468+0000 mgr.x (mgr.34109) 1116 : cluster [DBG] pgmap v1202: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:48.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:47 smithi051 bash[18409]: cluster 2020-06-27T05:16:46.756090+0000 mgr.x (mgr.34109) 1117 : cluster [DBG] pgmap v1203: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:48.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:47 smithi031 bash[18426]: cluster 2020-06-27T05:16:46.756090+0000 mgr.x (mgr.34109) 1117 : cluster [DBG] pgmap v1203: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:48.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:47 smithi031 bash[22603]: cluster 2020-06-27T05:16:46.756090+0000 mgr.x (mgr.34109) 1117 : cluster [DBG] pgmap v1203: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:50.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:49 smithi051 bash[18409]: cluster 2020-06-27T05:16:48.757664+0000 mgr.x (mgr.34109) 1118 : cluster [DBG] pgmap v1204: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:50.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:49 smithi031 bash[22603]: cluster 2020-06-27T05:16:48.757664+0000 mgr.x (mgr.34109) 1118 : cluster [DBG] pgmap v1204: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:50.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:49 smithi031 bash[18426]: cluster 2020-06-27T05:16:48.757664+0000 mgr.x (mgr.34109) 1118 : cluster [DBG] pgmap v1204: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:52.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:51 smithi051 bash[18409]: cluster 2020-06-27T05:16:50.759327+0000 mgr.x (mgr.34109) 1119 : cluster [DBG] pgmap v1205: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:52.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:51 smithi031 bash[22603]: cluster 2020-06-27T05:16:50.759327+0000 mgr.x (mgr.34109) 1119 : cluster [DBG] pgmap v1205: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:52.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:51 smithi031 bash[18426]: cluster 2020-06-27T05:16:50.759327+0000 mgr.x (mgr.34109) 1119 : cluster [DBG] pgmap v1205: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:54.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:53 smithi051 bash[18409]: cluster 2020-06-27T05:16:52.761001+0000 mgr.x (mgr.34109) 1120 : cluster [DBG] pgmap v1206: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:54.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:53 smithi031 bash[18426]: cluster 2020-06-27T05:16:52.761001+0000 mgr.x (mgr.34109) 1120 : cluster [DBG] pgmap v1206: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:54.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:53 smithi031 bash[22603]: cluster 2020-06-27T05:16:52.761001+0000 mgr.x (mgr.34109) 1120 : cluster [DBG] pgmap v1206: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:55 smithi051 bash[18409]: cluster 2020-06-27T05:16:54.762710+0000 mgr.x (mgr.34109) 1121 : cluster [DBG] pgmap v1207: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:55 smithi031 bash[18426]: cluster 2020-06-27T05:16:54.762710+0000 mgr.x (mgr.34109) 1121 : cluster [DBG] pgmap v1207: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:56.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:55 smithi031 bash[22603]: cluster 2020-06-27T05:16:54.762710+0000 mgr.x (mgr.34109) 1121 : cluster [DBG] pgmap v1207: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:58.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:57 smithi051 bash[18409]: cluster 2020-06-27T05:16:56.764443+0000 mgr.x (mgr.34109) 1122 : cluster [DBG] pgmap v1208: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:58.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:57 smithi031 bash[18426]: cluster 2020-06-27T05:16:56.764443+0000 mgr.x (mgr.34109) 1122 : cluster [DBG] pgmap v1208: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:16:58.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:57 smithi031 bash[22603]: cluster 2020-06-27T05:16:56.764443+0000 mgr.x (mgr.34109) 1122 : cluster [DBG] pgmap v1208: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:00.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:16:59 smithi051 bash[18409]: cluster 2020-06-27T05:16:58.766117+0000 mgr.x (mgr.34109) 1123 : cluster [DBG] pgmap v1209: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:00.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:16:59 smithi031 bash[18426]: cluster 2020-06-27T05:16:58.766117+0000 mgr.x (mgr.34109) 1123 : cluster [DBG] pgmap v1209: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:00.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:16:59 smithi031 bash[22603]: cluster 2020-06-27T05:16:58.766117+0000 mgr.x (mgr.34109) 1123 : cluster [DBG] pgmap v1209: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:02.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:01 smithi051 bash[18409]: cluster 2020-06-27T05:17:00.767702+0000 mgr.x (mgr.34109) 1124 : cluster [DBG] pgmap v1210: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:02.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:01 smithi031 bash[18426]: cluster 2020-06-27T05:17:00.767702+0000 mgr.x (mgr.34109) 1124 : cluster [DBG] pgmap v1210: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:02.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:01 smithi031 bash[22603]: cluster 2020-06-27T05:17:00.767702+0000 mgr.x (mgr.34109) 1124 : cluster [DBG] pgmap v1210: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:04.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:03 smithi051 bash[18409]: cluster 2020-06-27T05:17:02.769260+0000 mgr.x (mgr.34109) 1125 : cluster [DBG] pgmap v1211: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:04.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:03 smithi031 bash[18426]: cluster 2020-06-27T05:17:02.769260+0000 mgr.x (mgr.34109) 1125 : cluster [DBG] pgmap v1211: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:04.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:03 smithi031 bash[22603]: cluster 2020-06-27T05:17:02.769260+0000 mgr.x (mgr.34109) 1125 : cluster [DBG] pgmap v1211: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:05 smithi051 bash[18409]: cluster 2020-06-27T05:17:04.770926+0000 mgr.x (mgr.34109) 1126 : cluster [DBG] pgmap v1212: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:06.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:05 smithi031 bash[18426]: cluster 2020-06-27T05:17:04.770926+0000 mgr.x (mgr.34109) 1126 : cluster [DBG] pgmap v1212: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:06.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:05 smithi031 bash[22603]: cluster 2020-06-27T05:17:04.770926+0000 mgr.x (mgr.34109) 1126 : cluster [DBG] pgmap v1212: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:08.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:07 smithi051 bash[18409]: cluster 2020-06-27T05:17:06.772531+0000 mgr.x (mgr.34109) 1127 : cluster [DBG] pgmap v1213: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:08.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:07 smithi031 bash[18426]: cluster 2020-06-27T05:17:06.772531+0000 mgr.x (mgr.34109) 1127 : cluster [DBG] pgmap v1213: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:08.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:07 smithi031 bash[22603]: cluster 2020-06-27T05:17:06.772531+0000 mgr.x (mgr.34109) 1127 : cluster [DBG] pgmap v1213: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:10.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:09 smithi051 bash[18409]: cluster 2020-06-27T05:17:08.774207+0000 mgr.x (mgr.34109) 1128 : cluster [DBG] pgmap v1214: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:10.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:09 smithi031 bash[18426]: cluster 2020-06-27T05:17:08.774207+0000 mgr.x (mgr.34109) 1128 : cluster [DBG] pgmap v1214: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:10.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:09 smithi031 bash[22603]: cluster 2020-06-27T05:17:08.774207+0000 mgr.x (mgr.34109) 1128 : cluster [DBG] pgmap v1214: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:12.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:11 smithi051 bash[18409]: cluster 2020-06-27T05:17:10.775802+0000 mgr.x (mgr.34109) 1129 : cluster [DBG] pgmap v1215: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:12.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:11 smithi031 bash[22603]: cluster 2020-06-27T05:17:10.775802+0000 mgr.x (mgr.34109) 1129 : cluster [DBG] pgmap v1215: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:12.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:11 smithi031 bash[18426]: cluster 2020-06-27T05:17:10.775802+0000 mgr.x (mgr.34109) 1129 : cluster [DBG] pgmap v1215: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:14.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:13 smithi051 bash[18409]: cluster 2020-06-27T05:17:12.777386+0000 mgr.x (mgr.34109) 1130 : cluster [DBG] pgmap v1216: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:14.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:13 smithi031 bash[22603]: cluster 2020-06-27T05:17:12.777386+0000 mgr.x (mgr.34109) 1130 : cluster [DBG] pgmap v1216: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:14.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:13 smithi031 bash[18426]: cluster 2020-06-27T05:17:12.777386+0000 mgr.x (mgr.34109) 1130 : cluster [DBG] pgmap v1216: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:15 smithi051 bash[18409]: cluster 2020-06-27T05:17:14.779093+0000 mgr.x (mgr.34109) 1131 : cluster [DBG] pgmap v1217: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:15 smithi031 bash[18426]: cluster 2020-06-27T05:17:14.779093+0000 mgr.x (mgr.34109) 1131 : cluster [DBG] pgmap v1217: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:16.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:15 smithi031 bash[22603]: cluster 2020-06-27T05:17:14.779093+0000 mgr.x (mgr.34109) 1131 : cluster [DBG] pgmap v1217: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:18.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:17 smithi051 bash[18409]: cluster 2020-06-27T05:17:16.780655+0000 mgr.x (mgr.34109) 1132 : cluster [DBG] pgmap v1218: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:18.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:17 smithi031 bash[18426]: cluster 2020-06-27T05:17:16.780655+0000 mgr.x (mgr.34109) 1132 : cluster [DBG] pgmap v1218: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:18.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:17 smithi031 bash[22603]: cluster 2020-06-27T05:17:16.780655+0000 mgr.x (mgr.34109) 1132 : cluster [DBG] pgmap v1218: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:20.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:19 smithi051 bash[18409]: cluster 2020-06-27T05:17:18.782326+0000 mgr.x (mgr.34109) 1133 : cluster [DBG] pgmap v1219: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:20.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:19 smithi031 bash[18426]: cluster 2020-06-27T05:17:18.782326+0000 mgr.x (mgr.34109) 1133 : cluster [DBG] pgmap v1219: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:20.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:19 smithi031 bash[22603]: cluster 2020-06-27T05:17:18.782326+0000 mgr.x (mgr.34109) 1133 : cluster [DBG] pgmap v1219: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:22.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:21 smithi051 bash[18409]: cluster 2020-06-27T05:17:20.783985+0000 mgr.x (mgr.34109) 1134 : cluster [DBG] pgmap v1220: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:22.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:21 smithi031 bash[18426]: cluster 2020-06-27T05:17:20.783985+0000 mgr.x (mgr.34109) 1134 : cluster [DBG] pgmap v1220: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:22.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:21 smithi031 bash[22603]: cluster 2020-06-27T05:17:20.783985+0000 mgr.x (mgr.34109) 1134 : cluster [DBG] pgmap v1220: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:24.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:23 smithi051 bash[18409]: cluster 2020-06-27T05:17:22.785650+0000 mgr.x (mgr.34109) 1135 : cluster [DBG] pgmap v1221: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:24.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:23 smithi031 bash[18426]: cluster 2020-06-27T05:17:22.785650+0000 mgr.x (mgr.34109) 1135 : cluster [DBG] pgmap v1221: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:24.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:23 smithi031 bash[22603]: cluster 2020-06-27T05:17:22.785650+0000 mgr.x (mgr.34109) 1135 : cluster [DBG] pgmap v1221: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:26.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:25 smithi051 bash[18409]: cluster 2020-06-27T05:17:24.787331+0000 mgr.x (mgr.34109) 1136 : cluster [DBG] pgmap v1222: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:25 smithi031 bash[18426]: cluster 2020-06-27T05:17:24.787331+0000 mgr.x (mgr.34109) 1136 : cluster [DBG] pgmap v1222: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:25 smithi031 bash[22603]: cluster 2020-06-27T05:17:24.787331+0000 mgr.x (mgr.34109) 1136 : cluster [DBG] pgmap v1222: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:28.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:27 smithi051 bash[18409]: cluster 2020-06-27T05:17:26.789053+0000 mgr.x (mgr.34109) 1137 : cluster [DBG] pgmap v1223: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:28.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:27 smithi031 bash[18426]: cluster 2020-06-27T05:17:26.789053+0000 mgr.x (mgr.34109) 1137 : cluster [DBG] pgmap v1223: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:28.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:27 smithi031 bash[22603]: cluster 2020-06-27T05:17:26.789053+0000 mgr.x (mgr.34109) 1137 : cluster [DBG] pgmap v1223: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:30.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:29 smithi051 bash[18409]: cluster 2020-06-27T05:17:28.790757+0000 mgr.x (mgr.34109) 1138 : cluster [DBG] pgmap v1224: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:30.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:29 smithi031 bash[18426]: cluster 2020-06-27T05:17:28.790757+0000 mgr.x (mgr.34109) 1138 : cluster [DBG] pgmap v1224: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:30.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:29 smithi031 bash[22603]: cluster 2020-06-27T05:17:28.790757+0000 mgr.x (mgr.34109) 1138 : cluster [DBG] pgmap v1224: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:32.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:31 smithi051 bash[18409]: cluster 2020-06-27T05:17:30.792411+0000 mgr.x (mgr.34109) 1139 : cluster [DBG] pgmap v1225: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:32.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:31 smithi031 bash[18426]: cluster 2020-06-27T05:17:30.792411+0000 mgr.x (mgr.34109) 1139 : cluster [DBG] pgmap v1225: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:32.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:31 smithi031 bash[22603]: cluster 2020-06-27T05:17:30.792411+0000 mgr.x (mgr.34109) 1139 : cluster [DBG] pgmap v1225: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:34.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:33 smithi051 bash[18409]: cluster 2020-06-27T05:17:32.794111+0000 mgr.x (mgr.34109) 1140 : cluster [DBG] pgmap v1226: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:34.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:33 smithi031 bash[18426]: cluster 2020-06-27T05:17:32.794111+0000 mgr.x (mgr.34109) 1140 : cluster [DBG] pgmap v1226: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:34.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:33 smithi031 bash[22603]: cluster 2020-06-27T05:17:32.794111+0000 mgr.x (mgr.34109) 1140 : cluster [DBG] pgmap v1226: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:35 smithi051 bash[18409]: cluster 2020-06-27T05:17:34.795792+0000 mgr.x (mgr.34109) 1141 : cluster [DBG] pgmap v1227: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:36.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:35 smithi031 bash[18426]: cluster 2020-06-27T05:17:34.795792+0000 mgr.x (mgr.34109) 1141 : cluster [DBG] pgmap v1227: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:36.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:35 smithi031 bash[22603]: cluster 2020-06-27T05:17:34.795792+0000 mgr.x (mgr.34109) 1141 : cluster [DBG] pgmap v1227: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:38.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:37 smithi051 bash[18409]: cluster 2020-06-27T05:17:36.797483+0000 mgr.x (mgr.34109) 1142 : cluster [DBG] pgmap v1228: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:38.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:37 smithi031 bash[18426]: cluster 2020-06-27T05:17:36.797483+0000 mgr.x (mgr.34109) 1142 : cluster [DBG] pgmap v1228: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:38.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:37 smithi031 bash[22603]: cluster 2020-06-27T05:17:36.797483+0000 mgr.x (mgr.34109) 1142 : cluster [DBG] pgmap v1228: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:40.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:39 smithi051 bash[18409]: cluster 2020-06-27T05:17:38.799025+0000 mgr.x (mgr.34109) 1143 : cluster [DBG] pgmap v1229: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:40.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:39 smithi031 bash[18426]: cluster 2020-06-27T05:17:38.799025+0000 mgr.x (mgr.34109) 1143 : cluster [DBG] pgmap v1229: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:40.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:39 smithi031 bash[22603]: cluster 2020-06-27T05:17:38.799025+0000 mgr.x (mgr.34109) 1143 : cluster [DBG] pgmap v1229: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:42.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:41 smithi051 bash[18409]: cluster 2020-06-27T05:17:40.800570+0000 mgr.x (mgr.34109) 1144 : cluster [DBG] pgmap v1230: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:42.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:41 smithi031 bash[18426]: cluster 2020-06-27T05:17:40.800570+0000 mgr.x (mgr.34109) 1144 : cluster [DBG] pgmap v1230: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:42.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:41 smithi031 bash[22603]: cluster 2020-06-27T05:17:40.800570+0000 mgr.x (mgr.34109) 1144 : cluster [DBG] pgmap v1230: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:44.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:43 smithi051 bash[18409]: cluster 2020-06-27T05:17:42.802099+0000 mgr.x (mgr.34109) 1145 : cluster [DBG] pgmap v1231: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:44.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:43 smithi031 bash[18426]: cluster 2020-06-27T05:17:42.802099+0000 mgr.x (mgr.34109) 1145 : cluster [DBG] pgmap v1231: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:44.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:43 smithi031 bash[22603]: cluster 2020-06-27T05:17:42.802099+0000 mgr.x (mgr.34109) 1145 : cluster [DBG] pgmap v1231: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:46.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:45 smithi051 bash[18409]: cluster 2020-06-27T05:17:44.803765+0000 mgr.x (mgr.34109) 1146 : cluster [DBG] pgmap v1232: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:46.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:45 smithi031 bash[18426]: cluster 2020-06-27T05:17:44.803765+0000 mgr.x (mgr.34109) 1146 : cluster [DBG] pgmap v1232: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:46.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:45 smithi031 bash[22603]: cluster 2020-06-27T05:17:44.803765+0000 mgr.x (mgr.34109) 1146 : cluster [DBG] pgmap v1232: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:48.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:47 smithi051 bash[18409]: cluster 2020-06-27T05:17:46.805374+0000 mgr.x (mgr.34109) 1147 : cluster [DBG] pgmap v1233: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:48.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:47 smithi031 bash[22603]: cluster 2020-06-27T05:17:46.805374+0000 mgr.x (mgr.34109) 1147 : cluster [DBG] pgmap v1233: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:48.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:47 smithi031 bash[18426]: cluster 2020-06-27T05:17:46.805374+0000 mgr.x (mgr.34109) 1147 : cluster [DBG] pgmap v1233: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:50.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:49 smithi051 bash[18409]: cluster 2020-06-27T05:17:48.806960+0000 mgr.x (mgr.34109) 1148 : cluster [DBG] pgmap v1234: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:50.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:49 smithi031 bash[18426]: cluster 2020-06-27T05:17:48.806960+0000 mgr.x (mgr.34109) 1148 : cluster [DBG] pgmap v1234: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:50.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:49 smithi031 bash[22603]: cluster 2020-06-27T05:17:48.806960+0000 mgr.x (mgr.34109) 1148 : cluster [DBG] pgmap v1234: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:52.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:51 smithi051 bash[18409]: cluster 2020-06-27T05:17:50.808549+0000 mgr.x (mgr.34109) 1149 : cluster [DBG] pgmap v1235: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:52.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:51 smithi031 bash[18426]: cluster 2020-06-27T05:17:50.808549+0000 mgr.x (mgr.34109) 1149 : cluster [DBG] pgmap v1235: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:52.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:51 smithi031 bash[22603]: cluster 2020-06-27T05:17:50.808549+0000 mgr.x (mgr.34109) 1149 : cluster [DBG] pgmap v1235: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:54.224 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:53 smithi051 bash[18409]: cluster 2020-06-27T05:17:52.810238+0000 mgr.x (mgr.34109) 1150 : cluster [DBG] pgmap v1236: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:54.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:53 smithi031 bash[18426]: cluster 2020-06-27T05:17:52.810238+0000 mgr.x (mgr.34109) 1150 : cluster [DBG] pgmap v1236: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:54.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:53 smithi031 bash[22603]: cluster 2020-06-27T05:17:52.810238+0000 mgr.x (mgr.34109) 1150 : cluster [DBG] pgmap v1236: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:55 smithi051 bash[18409]: cluster 2020-06-27T05:17:54.811824+0000 mgr.x (mgr.34109) 1151 : cluster [DBG] pgmap v1237: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:55 smithi031 bash[18426]: cluster 2020-06-27T05:17:54.811824+0000 mgr.x (mgr.34109) 1151 : cluster [DBG] pgmap v1237: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:56.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:55 smithi031 bash[22603]: cluster 2020-06-27T05:17:54.811824+0000 mgr.x (mgr.34109) 1151 : cluster [DBG] pgmap v1237: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:58.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:57 smithi051 bash[18409]: cluster 2020-06-27T05:17:56.813391+0000 mgr.x (mgr.34109) 1152 : cluster [DBG] pgmap v1238: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:58.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:57 smithi031 bash[18426]: cluster 2020-06-27T05:17:56.813391+0000 mgr.x (mgr.34109) 1152 : cluster [DBG] pgmap v1238: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:17:58.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:57 smithi031 bash[22603]: cluster 2020-06-27T05:17:56.813391+0000 mgr.x (mgr.34109) 1152 : cluster [DBG] pgmap v1238: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:00.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:17:59 smithi051 bash[18409]: cluster 2020-06-27T05:17:58.814955+0000 mgr.x (mgr.34109) 1153 : cluster [DBG] pgmap v1239: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:00.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:17:59 smithi031 bash[22603]: cluster 2020-06-27T05:17:58.814955+0000 mgr.x (mgr.34109) 1153 : cluster [DBG] pgmap v1239: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:00.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:17:59 smithi031 bash[18426]: cluster 2020-06-27T05:17:58.814955+0000 mgr.x (mgr.34109) 1153 : cluster [DBG] pgmap v1239: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:02.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:01 smithi051 bash[18409]: cluster 2020-06-27T05:18:00.816524+0000 mgr.x (mgr.34109) 1154 : cluster [DBG] pgmap v1240: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:02.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:01 smithi031 bash[18426]: cluster 2020-06-27T05:18:00.816524+0000 mgr.x (mgr.34109) 1154 : cluster [DBG] pgmap v1240: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:02.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:01 smithi031 bash[22603]: cluster 2020-06-27T05:18:00.816524+0000 mgr.x (mgr.34109) 1154 : cluster [DBG] pgmap v1240: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:04.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:03 smithi051 bash[18409]: cluster 2020-06-27T05:18:02.818189+0000 mgr.x (mgr.34109) 1155 : cluster [DBG] pgmap v1241: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:04.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:03 smithi031 bash[18426]: cluster 2020-06-27T05:18:02.818189+0000 mgr.x (mgr.34109) 1155 : cluster [DBG] pgmap v1241: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:04.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:03 smithi031 bash[22603]: cluster 2020-06-27T05:18:02.818189+0000 mgr.x (mgr.34109) 1155 : cluster [DBG] pgmap v1241: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:05 smithi051 bash[18409]: cluster 2020-06-27T05:18:04.819856+0000 mgr.x (mgr.34109) 1156 : cluster [DBG] pgmap v1242: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:06.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:05 smithi031 bash[18426]: cluster 2020-06-27T05:18:04.819856+0000 mgr.x (mgr.34109) 1156 : cluster [DBG] pgmap v1242: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:06.226 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:05 smithi031 bash[22603]: cluster 2020-06-27T05:18:04.819856+0000 mgr.x (mgr.34109) 1156 : cluster [DBG] pgmap v1242: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:08.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:07 smithi051 bash[18409]: cluster 2020-06-27T05:18:06.821512+0000 mgr.x (mgr.34109) 1157 : cluster [DBG] pgmap v1243: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:08.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:07 smithi031 bash[18426]: cluster 2020-06-27T05:18:06.821512+0000 mgr.x (mgr.34109) 1157 : cluster [DBG] pgmap v1243: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:08.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:07 smithi031 bash[22603]: cluster 2020-06-27T05:18:06.821512+0000 mgr.x (mgr.34109) 1157 : cluster [DBG] pgmap v1243: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:10.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:09 smithi051 bash[18409]: cluster 2020-06-27T05:18:08.823197+0000 mgr.x (mgr.34109) 1158 : cluster [DBG] pgmap v1244: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:10.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:09 smithi031 bash[18426]: cluster 2020-06-27T05:18:08.823197+0000 mgr.x (mgr.34109) 1158 : cluster [DBG] pgmap v1244: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:10.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:09 smithi031 bash[22603]: cluster 2020-06-27T05:18:08.823197+0000 mgr.x (mgr.34109) 1158 : cluster [DBG] pgmap v1244: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:12.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:11 smithi051 bash[18409]: cluster 2020-06-27T05:18:10.824892+0000 mgr.x (mgr.34109) 1159 : cluster [DBG] pgmap v1245: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:12.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:11 smithi031 bash[18426]: cluster 2020-06-27T05:18:10.824892+0000 mgr.x (mgr.34109) 1159 : cluster [DBG] pgmap v1245: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:12.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:11 smithi031 bash[22603]: cluster 2020-06-27T05:18:10.824892+0000 mgr.x (mgr.34109) 1159 : cluster [DBG] pgmap v1245: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:14.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:13 smithi051 bash[18409]: cluster 2020-06-27T05:18:12.826472+0000 mgr.x (mgr.34109) 1160 : cluster [DBG] pgmap v1246: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:14.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:13 smithi031 bash[18426]: cluster 2020-06-27T05:18:12.826472+0000 mgr.x (mgr.34109) 1160 : cluster [DBG] pgmap v1246: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:14.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:13 smithi031 bash[22603]: cluster 2020-06-27T05:18:12.826472+0000 mgr.x (mgr.34109) 1160 : cluster [DBG] pgmap v1246: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:15 smithi051 bash[18409]: cluster 2020-06-27T05:18:14.828047+0000 mgr.x (mgr.34109) 1161 : cluster [DBG] pgmap v1247: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:15 smithi031 bash[18426]: cluster 2020-06-27T05:18:14.828047+0000 mgr.x (mgr.34109) 1161 : cluster [DBG] pgmap v1247: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:16.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:15 smithi031 bash[22603]: cluster 2020-06-27T05:18:14.828047+0000 mgr.x (mgr.34109) 1161 : cluster [DBG] pgmap v1247: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:18.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:17 smithi051 bash[18409]: cluster 2020-06-27T05:18:16.829708+0000 mgr.x (mgr.34109) 1162 : cluster [DBG] pgmap v1248: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:18.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:17 smithi031 bash[18426]: cluster 2020-06-27T05:18:16.829708+0000 mgr.x (mgr.34109) 1162 : cluster [DBG] pgmap v1248: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:18.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:17 smithi031 bash[22603]: cluster 2020-06-27T05:18:16.829708+0000 mgr.x (mgr.34109) 1162 : cluster [DBG] pgmap v1248: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:20.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:19 smithi051 bash[18409]: cluster 2020-06-27T05:18:18.831252+0000 mgr.x (mgr.34109) 1163 : cluster [DBG] pgmap v1249: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:20.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:19 smithi031 bash[18426]: cluster 2020-06-27T05:18:18.831252+0000 mgr.x (mgr.34109) 1163 : cluster [DBG] pgmap v1249: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:20.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:19 smithi031 bash[22603]: cluster 2020-06-27T05:18:18.831252+0000 mgr.x (mgr.34109) 1163 : cluster [DBG] pgmap v1249: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:22.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:21 smithi051 bash[18409]: cluster 2020-06-27T05:18:20.832938+0000 mgr.x (mgr.34109) 1164 : cluster [DBG] pgmap v1250: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:22.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:21 smithi031 bash[18426]: cluster 2020-06-27T05:18:20.832938+0000 mgr.x (mgr.34109) 1164 : cluster [DBG] pgmap v1250: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:22.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:21 smithi031 bash[22603]: cluster 2020-06-27T05:18:20.832938+0000 mgr.x (mgr.34109) 1164 : cluster [DBG] pgmap v1250: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:24.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:23 smithi051 bash[18409]: cluster 2020-06-27T05:18:22.834635+0000 mgr.x (mgr.34109) 1165 : cluster [DBG] pgmap v1251: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:24.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:23 smithi031 bash[18426]: cluster 2020-06-27T05:18:22.834635+0000 mgr.x (mgr.34109) 1165 : cluster [DBG] pgmap v1251: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:24.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:23 smithi031 bash[22603]: cluster 2020-06-27T05:18:22.834635+0000 mgr.x (mgr.34109) 1165 : cluster [DBG] pgmap v1251: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:26.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:25 smithi051 bash[18409]: cluster 2020-06-27T05:18:24.836205+0000 mgr.x (mgr.34109) 1166 : cluster [DBG] pgmap v1252: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:25 smithi031 bash[18426]: cluster 2020-06-27T05:18:24.836205+0000 mgr.x (mgr.34109) 1166 : cluster [DBG] pgmap v1252: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:25 smithi031 bash[22603]: cluster 2020-06-27T05:18:24.836205+0000 mgr.x (mgr.34109) 1166 : cluster [DBG] pgmap v1252: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:28.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:27 smithi051 bash[18409]: cluster 2020-06-27T05:18:26.837757+0000 mgr.x (mgr.34109) 1167 : cluster [DBG] pgmap v1253: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:28.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:27 smithi031 bash[18426]: cluster 2020-06-27T05:18:26.837757+0000 mgr.x (mgr.34109) 1167 : cluster [DBG] pgmap v1253: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:28.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:27 smithi031 bash[22603]: cluster 2020-06-27T05:18:26.837757+0000 mgr.x (mgr.34109) 1167 : cluster [DBG] pgmap v1253: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:30.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:29 smithi051 bash[18409]: cluster 2020-06-27T05:18:28.839342+0000 mgr.x (mgr.34109) 1168 : cluster [DBG] pgmap v1254: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:30.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:29 smithi031 bash[22603]: cluster 2020-06-27T05:18:28.839342+0000 mgr.x (mgr.34109) 1168 : cluster [DBG] pgmap v1254: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:30.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:29 smithi031 bash[18426]: cluster 2020-06-27T05:18:28.839342+0000 mgr.x (mgr.34109) 1168 : cluster [DBG] pgmap v1254: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:32.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:31 smithi051 bash[18409]: cluster 2020-06-27T05:18:30.840927+0000 mgr.x (mgr.34109) 1169 : cluster [DBG] pgmap v1255: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:32.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:31 smithi031 bash[18426]: cluster 2020-06-27T05:18:30.840927+0000 mgr.x (mgr.34109) 1169 : cluster [DBG] pgmap v1255: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:32.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:31 smithi031 bash[22603]: cluster 2020-06-27T05:18:30.840927+0000 mgr.x (mgr.34109) 1169 : cluster [DBG] pgmap v1255: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:34.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:33 smithi051 bash[18409]: cluster 2020-06-27T05:18:32.842553+0000 mgr.x (mgr.34109) 1170 : cluster [DBG] pgmap v1256: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:34.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:33 smithi031 bash[18426]: cluster 2020-06-27T05:18:32.842553+0000 mgr.x (mgr.34109) 1170 : cluster [DBG] pgmap v1256: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:34.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:33 smithi031 bash[22603]: cluster 2020-06-27T05:18:32.842553+0000 mgr.x (mgr.34109) 1170 : cluster [DBG] pgmap v1256: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:35 smithi051 bash[18409]: cluster 2020-06-27T05:18:34.844136+0000 mgr.x (mgr.34109) 1171 : cluster [DBG] pgmap v1257: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:36.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:35 smithi031 bash[22603]: cluster 2020-06-27T05:18:34.844136+0000 mgr.x (mgr.34109) 1171 : cluster [DBG] pgmap v1257: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:36.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:35 smithi031 bash[18426]: cluster 2020-06-27T05:18:34.844136+0000 mgr.x (mgr.34109) 1171 : cluster [DBG] pgmap v1257: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:38.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:37 smithi051 bash[18409]: cluster 2020-06-27T05:18:36.845632+0000 mgr.x (mgr.34109) 1172 : cluster [DBG] pgmap v1258: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:38.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:37 smithi031 bash[22603]: cluster 2020-06-27T05:18:36.845632+0000 mgr.x (mgr.34109) 1172 : cluster [DBG] pgmap v1258: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:38.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:37 smithi031 bash[18426]: cluster 2020-06-27T05:18:36.845632+0000 mgr.x (mgr.34109) 1172 : cluster [DBG] pgmap v1258: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:40.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:39 smithi051 bash[18409]: cluster 2020-06-27T05:18:38.847361+0000 mgr.x (mgr.34109) 1173 : cluster [DBG] pgmap v1259: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:40.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:39 smithi031 bash[22603]: cluster 2020-06-27T05:18:38.847361+0000 mgr.x (mgr.34109) 1173 : cluster [DBG] pgmap v1259: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:40.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:39 smithi031 bash[18426]: cluster 2020-06-27T05:18:38.847361+0000 mgr.x (mgr.34109) 1173 : cluster [DBG] pgmap v1259: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:42.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:41 smithi051 bash[18409]: cluster 2020-06-27T05:18:40.848996+0000 mgr.x (mgr.34109) 1174 : cluster [DBG] pgmap v1260: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:42.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:41 smithi031 bash[22603]: cluster 2020-06-27T05:18:40.848996+0000 mgr.x (mgr.34109) 1174 : cluster [DBG] pgmap v1260: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:42.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:41 smithi031 bash[18426]: cluster 2020-06-27T05:18:40.848996+0000 mgr.x (mgr.34109) 1174 : cluster [DBG] pgmap v1260: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:44.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:43 smithi051 bash[18409]: cluster 2020-06-27T05:18:42.850719+0000 mgr.x (mgr.34109) 1175 : cluster [DBG] pgmap v1261: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:44.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:43 smithi031 bash[18426]: cluster 2020-06-27T05:18:42.850719+0000 mgr.x (mgr.34109) 1175 : cluster [DBG] pgmap v1261: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:44.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:43 smithi031 bash[22603]: cluster 2020-06-27T05:18:42.850719+0000 mgr.x (mgr.34109) 1175 : cluster [DBG] pgmap v1261: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:46.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:45 smithi051 bash[18409]: cluster 2020-06-27T05:18:44.852398+0000 mgr.x (mgr.34109) 1176 : cluster [DBG] pgmap v1262: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:46.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:45 smithi031 bash[18426]: cluster 2020-06-27T05:18:44.852398+0000 mgr.x (mgr.34109) 1176 : cluster [DBG] pgmap v1262: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:46.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:45 smithi031 bash[22603]: cluster 2020-06-27T05:18:44.852398+0000 mgr.x (mgr.34109) 1176 : cluster [DBG] pgmap v1262: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:48.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:47 smithi051 bash[18409]: cluster 2020-06-27T05:18:46.854023+0000 mgr.x (mgr.34109) 1177 : cluster [DBG] pgmap v1263: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:48.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:47 smithi031 bash[18426]: cluster 2020-06-27T05:18:46.854023+0000 mgr.x (mgr.34109) 1177 : cluster [DBG] pgmap v1263: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:48.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:47 smithi031 bash[22603]: cluster 2020-06-27T05:18:46.854023+0000 mgr.x (mgr.34109) 1177 : cluster [DBG] pgmap v1263: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:50.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:49 smithi051 bash[18409]: cluster 2020-06-27T05:18:48.855872+0000 mgr.x (mgr.34109) 1178 : cluster [DBG] pgmap v1264: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:50.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:49 smithi031 bash[18426]: cluster 2020-06-27T05:18:48.855872+0000 mgr.x (mgr.34109) 1178 : cluster [DBG] pgmap v1264: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:50.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:49 smithi031 bash[22603]: cluster 2020-06-27T05:18:48.855872+0000 mgr.x (mgr.34109) 1178 : cluster [DBG] pgmap v1264: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:52.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:51 smithi051 bash[18409]: cluster 2020-06-27T05:18:50.857455+0000 mgr.x (mgr.34109) 1179 : cluster [DBG] pgmap v1265: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:52.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:51 smithi031 bash[18426]: cluster 2020-06-27T05:18:50.857455+0000 mgr.x (mgr.34109) 1179 : cluster [DBG] pgmap v1265: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:52.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:51 smithi031 bash[22603]: cluster 2020-06-27T05:18:50.857455+0000 mgr.x (mgr.34109) 1179 : cluster [DBG] pgmap v1265: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:54.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:53 smithi051 bash[18409]: cluster 2020-06-27T05:18:52.859042+0000 mgr.x (mgr.34109) 1180 : cluster [DBG] pgmap v1266: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:54.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:53 smithi031 bash[22603]: cluster 2020-06-27T05:18:52.859042+0000 mgr.x (mgr.34109) 1180 : cluster [DBG] pgmap v1266: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:54.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:53 smithi031 bash[18426]: cluster 2020-06-27T05:18:52.859042+0000 mgr.x (mgr.34109) 1180 : cluster [DBG] pgmap v1266: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:55 smithi051 bash[18409]: cluster 2020-06-27T05:18:54.860775+0000 mgr.x (mgr.34109) 1181 : cluster [DBG] pgmap v1267: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:56.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:55 smithi031 bash[18426]: cluster 2020-06-27T05:18:54.860775+0000 mgr.x (mgr.34109) 1181 : cluster [DBG] pgmap v1267: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:56.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:55 smithi031 bash[22603]: cluster 2020-06-27T05:18:54.860775+0000 mgr.x (mgr.34109) 1181 : cluster [DBG] pgmap v1267: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:58.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:57 smithi051 bash[18409]: cluster 2020-06-27T05:18:56.862402+0000 mgr.x (mgr.34109) 1182 : cluster [DBG] pgmap v1268: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:58.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:57 smithi031 bash[18426]: cluster 2020-06-27T05:18:56.862402+0000 mgr.x (mgr.34109) 1182 : cluster [DBG] pgmap v1268: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:18:58.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:57 smithi031 bash[22603]: cluster 2020-06-27T05:18:56.862402+0000 mgr.x (mgr.34109) 1182 : cluster [DBG] pgmap v1268: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:00.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:18:59 smithi051 bash[18409]: cluster 2020-06-27T05:18:58.864008+0000 mgr.x (mgr.34109) 1183 : cluster [DBG] pgmap v1269: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:00.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:18:59 smithi031 bash[18426]: cluster 2020-06-27T05:18:58.864008+0000 mgr.x (mgr.34109) 1183 : cluster [DBG] pgmap v1269: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:00.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:18:59 smithi031 bash[22603]: cluster 2020-06-27T05:18:58.864008+0000 mgr.x (mgr.34109) 1183 : cluster [DBG] pgmap v1269: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:02.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:01 smithi051 bash[18409]: cluster 2020-06-27T05:19:00.865639+0000 mgr.x (mgr.34109) 1184 : cluster [DBG] pgmap v1270: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:02.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:01 smithi031 bash[18426]: cluster 2020-06-27T05:19:00.865639+0000 mgr.x (mgr.34109) 1184 : cluster [DBG] pgmap v1270: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:02.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:01 smithi031 bash[22603]: cluster 2020-06-27T05:19:00.865639+0000 mgr.x (mgr.34109) 1184 : cluster [DBG] pgmap v1270: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:04.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:03 smithi051 bash[18409]: cluster 2020-06-27T05:19:02.867297+0000 mgr.x (mgr.34109) 1185 : cluster [DBG] pgmap v1271: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:04.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:03 smithi031 bash[18426]: cluster 2020-06-27T05:19:02.867297+0000 mgr.x (mgr.34109) 1185 : cluster [DBG] pgmap v1271: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:04.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:03 smithi031 bash[22603]: cluster 2020-06-27T05:19:02.867297+0000 mgr.x (mgr.34109) 1185 : cluster [DBG] pgmap v1271: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:05 smithi051 bash[18409]: cluster 2020-06-27T05:19:04.868896+0000 mgr.x (mgr.34109) 1186 : cluster [DBG] pgmap v1272: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:06.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:05 smithi031 bash[18426]: cluster 2020-06-27T05:19:04.868896+0000 mgr.x (mgr.34109) 1186 : cluster [DBG] pgmap v1272: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:06.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:05 smithi031 bash[22603]: cluster 2020-06-27T05:19:04.868896+0000 mgr.x (mgr.34109) 1186 : cluster [DBG] pgmap v1272: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:08.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:07 smithi051 bash[18409]: cluster 2020-06-27T05:19:06.870482+0000 mgr.x (mgr.34109) 1187 : cluster [DBG] pgmap v1273: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:08.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:07 smithi031 bash[18426]: cluster 2020-06-27T05:19:06.870482+0000 mgr.x (mgr.34109) 1187 : cluster [DBG] pgmap v1273: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:08.227 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:07 smithi031 bash[22603]: cluster 2020-06-27T05:19:06.870482+0000 mgr.x (mgr.34109) 1187 : cluster [DBG] pgmap v1273: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:10.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:09 smithi051 bash[18409]: cluster 2020-06-27T05:19:08.872187+0000 mgr.x (mgr.34109) 1188 : cluster [DBG] pgmap v1274: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:10.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:09 smithi031 bash[18426]: cluster 2020-06-27T05:19:08.872187+0000 mgr.x (mgr.34109) 1188 : cluster [DBG] pgmap v1274: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:10.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:09 smithi031 bash[22603]: cluster 2020-06-27T05:19:08.872187+0000 mgr.x (mgr.34109) 1188 : cluster [DBG] pgmap v1274: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:12.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:11 smithi051 bash[18409]: cluster 2020-06-27T05:19:10.873826+0000 mgr.x (mgr.34109) 1189 : cluster [DBG] pgmap v1275: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:12.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:11 smithi031 bash[18426]: cluster 2020-06-27T05:19:10.873826+0000 mgr.x (mgr.34109) 1189 : cluster [DBG] pgmap v1275: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:12.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:11 smithi031 bash[22603]: cluster 2020-06-27T05:19:10.873826+0000 mgr.x (mgr.34109) 1189 : cluster [DBG] pgmap v1275: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:14.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:13 smithi051 bash[18409]: cluster 2020-06-27T05:19:12.875429+0000 mgr.x (mgr.34109) 1190 : cluster [DBG] pgmap v1276: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:14.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:13 smithi031 bash[18426]: cluster 2020-06-27T05:19:12.875429+0000 mgr.x (mgr.34109) 1190 : cluster [DBG] pgmap v1276: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:14.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:13 smithi031 bash[22603]: cluster 2020-06-27T05:19:12.875429+0000 mgr.x (mgr.34109) 1190 : cluster [DBG] pgmap v1276: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:15 smithi051 bash[18409]: cluster 2020-06-27T05:19:14.877152+0000 mgr.x (mgr.34109) 1191 : cluster [DBG] pgmap v1277: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:16.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:15 smithi031 bash[18426]: cluster 2020-06-27T05:19:14.877152+0000 mgr.x (mgr.34109) 1191 : cluster [DBG] pgmap v1277: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:16.225 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:15 smithi031 bash[22603]: cluster 2020-06-27T05:19:14.877152+0000 mgr.x (mgr.34109) 1191 : cluster [DBG] pgmap v1277: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:18.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:17 smithi051 bash[18409]: cluster 2020-06-27T05:19:16.878775+0000 mgr.x (mgr.34109) 1192 : cluster [DBG] pgmap v1278: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:18.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:17 smithi031 bash[18426]: cluster 2020-06-27T05:19:16.878775+0000 mgr.x (mgr.34109) 1192 : cluster [DBG] pgmap v1278: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:18.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:17 smithi031 bash[22603]: cluster 2020-06-27T05:19:16.878775+0000 mgr.x (mgr.34109) 1192 : cluster [DBG] pgmap v1278: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:20.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:19 smithi051 bash[18409]: cluster 2020-06-27T05:19:18.880342+0000 mgr.x (mgr.34109) 1193 : cluster [DBG] pgmap v1279: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:20.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:19 smithi031 bash[18426]: cluster 2020-06-27T05:19:18.880342+0000 mgr.x (mgr.34109) 1193 : cluster [DBG] pgmap v1279: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:20.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:19 smithi031 bash[22603]: cluster 2020-06-27T05:19:18.880342+0000 mgr.x (mgr.34109) 1193 : cluster [DBG] pgmap v1279: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:22.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:21 smithi051 bash[18409]: cluster 2020-06-27T05:19:20.881984+0000 mgr.x (mgr.34109) 1194 : cluster [DBG] pgmap v1280: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:22.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:21 smithi031 bash[18426]: cluster 2020-06-27T05:19:20.881984+0000 mgr.x (mgr.34109) 1194 : cluster [DBG] pgmap v1280: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:22.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:21 smithi031 bash[22603]: cluster 2020-06-27T05:19:20.881984+0000 mgr.x (mgr.34109) 1194 : cluster [DBG] pgmap v1280: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:24.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:23 smithi051 bash[18409]: cluster 2020-06-27T05:19:22.883699+0000 mgr.x (mgr.34109) 1195 : cluster [DBG] pgmap v1281: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:24.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:23 smithi031 bash[18426]: cluster 2020-06-27T05:19:22.883699+0000 mgr.x (mgr.34109) 1195 : cluster [DBG] pgmap v1281: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:24.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:23 smithi031 bash[22603]: cluster 2020-06-27T05:19:22.883699+0000 mgr.x (mgr.34109) 1195 : cluster [DBG] pgmap v1281: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:26.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:25 smithi051 bash[18409]: cluster 2020-06-27T05:19:24.885111+0000 mgr.x (mgr.34109) 1196 : cluster [DBG] pgmap v1282: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:25 smithi031 bash[22603]: cluster 2020-06-27T05:19:24.885111+0000 mgr.x (mgr.34109) 1196 : cluster [DBG] pgmap v1282: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:25 smithi031 bash[18426]: cluster 2020-06-27T05:19:24.885111+0000 mgr.x (mgr.34109) 1196 : cluster [DBG] pgmap v1282: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:28.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:27 smithi051 bash[18409]: cluster 2020-06-27T05:19:26.886851+0000 mgr.x (mgr.34109) 1197 : cluster [DBG] pgmap v1283: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:28.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:27 smithi031 bash[18426]: cluster 2020-06-27T05:19:26.886851+0000 mgr.x (mgr.34109) 1197 : cluster [DBG] pgmap v1283: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:28.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:27 smithi031 bash[22603]: cluster 2020-06-27T05:19:26.886851+0000 mgr.x (mgr.34109) 1197 : cluster [DBG] pgmap v1283: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:30.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:29 smithi051 bash[18409]: cluster 2020-06-27T05:19:28.888563+0000 mgr.x (mgr.34109) 1198 : cluster [DBG] pgmap v1284: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:30.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:29 smithi031 bash[18426]: cluster 2020-06-27T05:19:28.888563+0000 mgr.x (mgr.34109) 1198 : cluster [DBG] pgmap v1284: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:30.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:29 smithi031 bash[22603]: cluster 2020-06-27T05:19:28.888563+0000 mgr.x (mgr.34109) 1198 : cluster [DBG] pgmap v1284: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:32.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:31 smithi051 bash[18409]: cluster 2020-06-27T05:19:30.890203+0000 mgr.x (mgr.34109) 1199 : cluster [DBG] pgmap v1285: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:32.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:31 smithi031 bash[18426]: cluster 2020-06-27T05:19:30.890203+0000 mgr.x (mgr.34109) 1199 : cluster [DBG] pgmap v1285: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:32.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:31 smithi031 bash[22603]: cluster 2020-06-27T05:19:30.890203+0000 mgr.x (mgr.34109) 1199 : cluster [DBG] pgmap v1285: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:34.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:33 smithi051 bash[18409]: cluster 2020-06-27T05:19:32.891776+0000 mgr.x (mgr.34109) 1200 : cluster [DBG] pgmap v1286: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:34.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:33 smithi031 bash[18426]: cluster 2020-06-27T05:19:32.891776+0000 mgr.x (mgr.34109) 1200 : cluster [DBG] pgmap v1286: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:34.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:33 smithi031 bash[22603]: cluster 2020-06-27T05:19:32.891776+0000 mgr.x (mgr.34109) 1200 : cluster [DBG] pgmap v1286: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:36.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:35 smithi051 bash[18409]: cluster 2020-06-27T05:19:34.893311+0000 mgr.x (mgr.34109) 1201 : cluster [DBG] pgmap v1287: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:36.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:35 smithi031 bash[22603]: cluster 2020-06-27T05:19:34.893311+0000 mgr.x (mgr.34109) 1201 : cluster [DBG] pgmap v1287: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:36.229 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:35 smithi031 bash[18426]: cluster 2020-06-27T05:19:34.893311+0000 mgr.x (mgr.34109) 1201 : cluster [DBG] pgmap v1287: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:38.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:37 smithi051 bash[18409]: cluster 2020-06-27T05:19:36.894904+0000 mgr.x (mgr.34109) 1202 : cluster [DBG] pgmap v1288: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:38.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:37 smithi031 bash[18426]: cluster 2020-06-27T05:19:36.894904+0000 mgr.x (mgr.34109) 1202 : cluster [DBG] pgmap v1288: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:38.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:37 smithi031 bash[22603]: cluster 2020-06-27T05:19:36.894904+0000 mgr.x (mgr.34109) 1202 : cluster [DBG] pgmap v1288: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:40.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:39 smithi051 bash[18409]: cluster 2020-06-27T05:19:38.896638+0000 mgr.x (mgr.34109) 1203 : cluster [DBG] pgmap v1289: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:40.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:39 smithi031 bash[18426]: cluster 2020-06-27T05:19:38.896638+0000 mgr.x (mgr.34109) 1203 : cluster [DBG] pgmap v1289: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:40.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:39 smithi031 bash[22603]: cluster 2020-06-27T05:19:38.896638+0000 mgr.x (mgr.34109) 1203 : cluster [DBG] pgmap v1289: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:42.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:41 smithi031 bash[18426]: cluster 2020-06-27T05:19:40.898348+0000 mgr.x (mgr.34109) 1204 : cluster [DBG] pgmap v1290: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:42.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:41 smithi031 bash[22603]: cluster 2020-06-27T05:19:40.898348+0000 mgr.x (mgr.34109) 1204 : cluster [DBG] pgmap v1290: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:42.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:41 smithi051 bash[18409]: cluster 2020-06-27T05:19:40.898348+0000 mgr.x (mgr.34109) 1204 : cluster [DBG] pgmap v1290: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:44.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:43 smithi051 bash[18409]: cluster 2020-06-27T05:19:42.899944+0000 mgr.x (mgr.34109) 1205 : cluster [DBG] pgmap v1291: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:44.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:43 smithi031 bash[18426]: cluster 2020-06-27T05:19:42.899944+0000 mgr.x (mgr.34109) 1205 : cluster [DBG] pgmap v1291: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:44.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:43 smithi031 bash[22603]: cluster 2020-06-27T05:19:42.899944+0000 mgr.x (mgr.34109) 1205 : cluster [DBG] pgmap v1291: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:46.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:45 smithi051 bash[18409]: cluster 2020-06-27T05:19:44.901588+0000 mgr.x (mgr.34109) 1206 : cluster [DBG] pgmap v1292: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:46.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:45 smithi031 bash[18426]: cluster 2020-06-27T05:19:44.901588+0000 mgr.x (mgr.34109) 1206 : cluster [DBG] pgmap v1292: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:46.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:45 smithi031 bash[22603]: cluster 2020-06-27T05:19:44.901588+0000 mgr.x (mgr.34109) 1206 : cluster [DBG] pgmap v1292: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:48.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:47 smithi031 bash[18426]: cluster 2020-06-27T05:19:46.903199+0000 mgr.x (mgr.34109) 1207 : cluster [DBG] pgmap v1293: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:48.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:47 smithi031 bash[22603]: cluster 2020-06-27T05:19:46.903199+0000 mgr.x (mgr.34109) 1207 : cluster [DBG] pgmap v1293: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:48.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:47 smithi051 bash[18409]: cluster 2020-06-27T05:19:46.903199+0000 mgr.x (mgr.34109) 1207 : cluster [DBG] pgmap v1293: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:50.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:49 smithi051 bash[18409]: cluster 2020-06-27T05:19:48.904861+0000 mgr.x (mgr.34109) 1208 : cluster [DBG] pgmap v1294: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:50.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:49 smithi031 bash[18426]: cluster 2020-06-27T05:19:48.904861+0000 mgr.x (mgr.34109) 1208 : cluster [DBG] pgmap v1294: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:50.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:49 smithi031 bash[22603]: cluster 2020-06-27T05:19:48.904861+0000 mgr.x (mgr.34109) 1208 : cluster [DBG] pgmap v1294: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:52.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:51 smithi051 bash[18409]: cluster 2020-06-27T05:19:50.906501+0000 mgr.x (mgr.34109) 1209 : cluster [DBG] pgmap v1295: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:52.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:51 smithi031 bash[18426]: cluster 2020-06-27T05:19:50.906501+0000 mgr.x (mgr.34109) 1209 : cluster [DBG] pgmap v1295: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:52.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:51 smithi031 bash[22603]: cluster 2020-06-27T05:19:50.906501+0000 mgr.x (mgr.34109) 1209 : cluster [DBG] pgmap v1295: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:54.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:53 smithi051 bash[18409]: cluster 2020-06-27T05:19:52.908192+0000 mgr.x (mgr.34109) 1210 : cluster [DBG] pgmap v1296: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:54.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:53 smithi031 bash[18426]: cluster 2020-06-27T05:19:52.908192+0000 mgr.x (mgr.34109) 1210 : cluster [DBG] pgmap v1296: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:54.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:53 smithi031 bash[22603]: cluster 2020-06-27T05:19:52.908192+0000 mgr.x (mgr.34109) 1210 : cluster [DBG] pgmap v1296: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:55 smithi051 bash[18409]: cluster 2020-06-27T05:19:54.909761+0000 mgr.x (mgr.34109) 1211 : cluster [DBG] pgmap v1297: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:55 smithi031 bash[18426]: cluster 2020-06-27T05:19:54.909761+0000 mgr.x (mgr.34109) 1211 : cluster [DBG] pgmap v1297: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:56.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:55 smithi031 bash[22603]: cluster 2020-06-27T05:19:54.909761+0000 mgr.x (mgr.34109) 1211 : cluster [DBG] pgmap v1297: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:58.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:57 smithi031 bash[18426]: cluster 2020-06-27T05:19:56.911469+0000 mgr.x (mgr.34109) 1212 : cluster [DBG] pgmap v1298: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:58.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:57 smithi031 bash[22603]: cluster 2020-06-27T05:19:56.911469+0000 mgr.x (mgr.34109) 1212 : cluster [DBG] pgmap v1298: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:19:58.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:57 smithi051 bash[18409]: cluster 2020-06-27T05:19:56.911469+0000 mgr.x (mgr.34109) 1212 : cluster [DBG] pgmap v1298: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:19:59 smithi051 bash[18409]: cluster 2020-06-27T05:19:58.913197+0000 mgr.x (mgr.34109) 1213 : cluster [DBG] pgmap v1299: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:00.478 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:19:59 smithi031 bash[18426]: cluster 2020-06-27T05:19:58.913197+0000 mgr.x (mgr.34109) 1213 : cluster [DBG] pgmap v1299: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:00.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:19:59 smithi031 bash[22603]: cluster 2020-06-27T05:19:58.913197+0000 mgr.x (mgr.34109) 1213 : cluster [DBG] pgmap v1299: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:02.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:01 smithi051 bash[18409]: cluster 2020-06-27T05:20:00.914811+0000 mgr.x (mgr.34109) 1214 : cluster [DBG] pgmap v1300: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:02.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:01 smithi031 bash[18426]: cluster 2020-06-27T05:20:00.914811+0000 mgr.x (mgr.34109) 1214 : cluster [DBG] pgmap v1300: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:02.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:01 smithi031 bash[22603]: cluster 2020-06-27T05:20:00.914811+0000 mgr.x (mgr.34109) 1214 : cluster [DBG] pgmap v1300: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:04.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:03 smithi051 bash[18409]: cluster 2020-06-27T05:20:02.916517+0000 mgr.x (mgr.34109) 1215 : cluster [DBG] pgmap v1301: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:04.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:03 smithi031 bash[18426]: cluster 2020-06-27T05:20:02.916517+0000 mgr.x (mgr.34109) 1215 : cluster [DBG] pgmap v1301: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:04.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:03 smithi031 bash[22603]: cluster 2020-06-27T05:20:02.916517+0000 mgr.x (mgr.34109) 1215 : cluster [DBG] pgmap v1301: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:05 smithi051 bash[18409]: cluster 2020-06-27T05:20:04.918150+0000 mgr.x (mgr.34109) 1216 : cluster [DBG] pgmap v1302: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:06.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:05 smithi031 bash[18426]: cluster 2020-06-27T05:20:04.918150+0000 mgr.x (mgr.34109) 1216 : cluster [DBG] pgmap v1302: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:06.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:05 smithi031 bash[22603]: cluster 2020-06-27T05:20:04.918150+0000 mgr.x (mgr.34109) 1216 : cluster [DBG] pgmap v1302: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:08.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:07 smithi051 bash[18409]: cluster 2020-06-27T05:20:06.919925+0000 mgr.x (mgr.34109) 1217 : cluster [DBG] pgmap v1303: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:08.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:07 smithi031 bash[18426]: cluster 2020-06-27T05:20:06.919925+0000 mgr.x (mgr.34109) 1217 : cluster [DBG] pgmap v1303: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:08.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:07 smithi031 bash[22603]: cluster 2020-06-27T05:20:06.919925+0000 mgr.x (mgr.34109) 1217 : cluster [DBG] pgmap v1303: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:10.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:09 smithi051 bash[18409]: cluster 2020-06-27T05:20:08.921497+0000 mgr.x (mgr.34109) 1218 : cluster [DBG] pgmap v1304: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:10.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:09 smithi031 bash[18426]: cluster 2020-06-27T05:20:08.921497+0000 mgr.x (mgr.34109) 1218 : cluster [DBG] pgmap v1304: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:10.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:09 smithi031 bash[22603]: cluster 2020-06-27T05:20:08.921497+0000 mgr.x (mgr.34109) 1218 : cluster [DBG] pgmap v1304: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:12.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:11 smithi051 bash[18409]: cluster 2020-06-27T05:20:10.923213+0000 mgr.x (mgr.34109) 1219 : cluster [DBG] pgmap v1305: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:12.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:11 smithi031 bash[18426]: cluster 2020-06-27T05:20:10.923213+0000 mgr.x (mgr.34109) 1219 : cluster [DBG] pgmap v1305: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:12.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:11 smithi031 bash[22603]: cluster 2020-06-27T05:20:10.923213+0000 mgr.x (mgr.34109) 1219 : cluster [DBG] pgmap v1305: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:14.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:14 smithi051 bash[18409]: cluster 2020-06-27T05:20:12.924924+0000 mgr.x (mgr.34109) 1220 : cluster [DBG] pgmap v1306: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:14.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:14 smithi031 bash[18426]: cluster 2020-06-27T05:20:12.924924+0000 mgr.x (mgr.34109) 1220 : cluster [DBG] pgmap v1306: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:14.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:14 smithi031 bash[22603]: cluster 2020-06-27T05:20:12.924924+0000 mgr.x (mgr.34109) 1220 : cluster [DBG] pgmap v1306: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:15 smithi051 bash[18409]: cluster 2020-06-27T05:20:14.926630+0000 mgr.x (mgr.34109) 1221 : cluster [DBG] pgmap v1307: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:15 smithi031 bash[18426]: cluster 2020-06-27T05:20:14.926630+0000 mgr.x (mgr.34109) 1221 : cluster [DBG] pgmap v1307: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:16.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:15 smithi031 bash[22603]: cluster 2020-06-27T05:20:14.926630+0000 mgr.x (mgr.34109) 1221 : cluster [DBG] pgmap v1307: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:18.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:17 smithi051 bash[18409]: cluster 2020-06-27T05:20:16.928344+0000 mgr.x (mgr.34109) 1222 : cluster [DBG] pgmap v1308: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:18.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:17 smithi031 bash[18426]: cluster 2020-06-27T05:20:16.928344+0000 mgr.x (mgr.34109) 1222 : cluster [DBG] pgmap v1308: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:18.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:17 smithi031 bash[22603]: cluster 2020-06-27T05:20:16.928344+0000 mgr.x (mgr.34109) 1222 : cluster [DBG] pgmap v1308: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:20.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:19 smithi051 bash[18409]: cluster 2020-06-27T05:20:18.930031+0000 mgr.x (mgr.34109) 1223 : cluster [DBG] pgmap v1309: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:20.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:19 smithi031 bash[18426]: cluster 2020-06-27T05:20:18.930031+0000 mgr.x (mgr.34109) 1223 : cluster [DBG] pgmap v1309: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:20.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:19 smithi031 bash[22603]: cluster 2020-06-27T05:20:18.930031+0000 mgr.x (mgr.34109) 1223 : cluster [DBG] pgmap v1309: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:22.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:22 smithi051 bash[18409]: cluster 2020-06-27T05:20:20.931764+0000 mgr.x (mgr.34109) 1224 : cluster [DBG] pgmap v1310: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:22.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:22 smithi031 bash[18426]: cluster 2020-06-27T05:20:20.931764+0000 mgr.x (mgr.34109) 1224 : cluster [DBG] pgmap v1310: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:22.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:22 smithi031 bash[22603]: cluster 2020-06-27T05:20:20.931764+0000 mgr.x (mgr.34109) 1224 : cluster [DBG] pgmap v1310: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:24.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:24 smithi051 bash[18409]: cluster 2020-06-27T05:20:22.933453+0000 mgr.x (mgr.34109) 1225 : cluster [DBG] pgmap v1311: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:24.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:24 smithi031 bash[18426]: cluster 2020-06-27T05:20:22.933453+0000 mgr.x (mgr.34109) 1225 : cluster [DBG] pgmap v1311: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:24.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:24 smithi031 bash[22603]: cluster 2020-06-27T05:20:22.933453+0000 mgr.x (mgr.34109) 1225 : cluster [DBG] pgmap v1311: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:26.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:25 smithi051 bash[18409]: cluster 2020-06-27T05:20:24.935151+0000 mgr.x (mgr.34109) 1226 : cluster [DBG] pgmap v1312: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:25 smithi031 bash[22603]: cluster 2020-06-27T05:20:24.935151+0000 mgr.x (mgr.34109) 1226 : cluster [DBG] pgmap v1312: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:25 smithi031 bash[18426]: cluster 2020-06-27T05:20:24.935151+0000 mgr.x (mgr.34109) 1226 : cluster [DBG] pgmap v1312: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:28.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:27 smithi051 bash[18409]: cluster 2020-06-27T05:20:26.936849+0000 mgr.x (mgr.34109) 1227 : cluster [DBG] pgmap v1313: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:28.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:27 smithi031 bash[22603]: cluster 2020-06-27T05:20:26.936849+0000 mgr.x (mgr.34109) 1227 : cluster [DBG] pgmap v1313: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:28.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:27 smithi031 bash[18426]: cluster 2020-06-27T05:20:26.936849+0000 mgr.x (mgr.34109) 1227 : cluster [DBG] pgmap v1313: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:30.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:30 smithi051 bash[18409]: cluster 2020-06-27T05:20:28.938406+0000 mgr.x (mgr.34109) 1228 : cluster [DBG] pgmap v1314: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:30.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:30 smithi031 bash[18426]: cluster 2020-06-27T05:20:28.938406+0000 mgr.x (mgr.34109) 1228 : cluster [DBG] pgmap v1314: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:30.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:30 smithi031 bash[22603]: cluster 2020-06-27T05:20:28.938406+0000 mgr.x (mgr.34109) 1228 : cluster [DBG] pgmap v1314: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:32.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:32 smithi051 bash[18409]: cluster 2020-06-27T05:20:30.940094+0000 mgr.x (mgr.34109) 1229 : cluster [DBG] pgmap v1315: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:32.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:32 smithi031 bash[18426]: cluster 2020-06-27T05:20:30.940094+0000 mgr.x (mgr.34109) 1229 : cluster [DBG] pgmap v1315: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:32.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:32 smithi031 bash[22603]: cluster 2020-06-27T05:20:30.940094+0000 mgr.x (mgr.34109) 1229 : cluster [DBG] pgmap v1315: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:34.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:34 smithi051 bash[18409]: cluster 2020-06-27T05:20:32.941796+0000 mgr.x (mgr.34109) 1230 : cluster [DBG] pgmap v1316: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:34.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:34 smithi031 bash[18426]: cluster 2020-06-27T05:20:32.941796+0000 mgr.x (mgr.34109) 1230 : cluster [DBG] pgmap v1316: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:34.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:34 smithi031 bash[22603]: cluster 2020-06-27T05:20:32.941796+0000 mgr.x (mgr.34109) 1230 : cluster [DBG] pgmap v1316: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:35 smithi051 bash[18409]: cluster 2020-06-27T05:20:34.943369+0000 mgr.x (mgr.34109) 1231 : cluster [DBG] pgmap v1317: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:36.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:35 smithi031 bash[18426]: cluster 2020-06-27T05:20:34.943369+0000 mgr.x (mgr.34109) 1231 : cluster [DBG] pgmap v1317: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:36.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:35 smithi031 bash[22603]: cluster 2020-06-27T05:20:34.943369+0000 mgr.x (mgr.34109) 1231 : cluster [DBG] pgmap v1317: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:38.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:38 smithi051 bash[18409]: cluster 2020-06-27T05:20:36.945032+0000 mgr.x (mgr.34109) 1232 : cluster [DBG] pgmap v1318: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:38.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:38 smithi031 bash[18426]: cluster 2020-06-27T05:20:36.945032+0000 mgr.x (mgr.34109) 1232 : cluster [DBG] pgmap v1318: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:38.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:38 smithi031 bash[22603]: cluster 2020-06-27T05:20:36.945032+0000 mgr.x (mgr.34109) 1232 : cluster [DBG] pgmap v1318: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:40.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:40 smithi051 bash[18409]: cluster 2020-06-27T05:20:38.946666+0000 mgr.x (mgr.34109) 1233 : cluster [DBG] pgmap v1319: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:40.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:40 smithi031 bash[18426]: cluster 2020-06-27T05:20:38.946666+0000 mgr.x (mgr.34109) 1233 : cluster [DBG] pgmap v1319: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:40.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:40 smithi031 bash[22603]: cluster 2020-06-27T05:20:38.946666+0000 mgr.x (mgr.34109) 1233 : cluster [DBG] pgmap v1319: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:42.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:42 smithi051 bash[18409]: cluster 2020-06-27T05:20:40.948147+0000 mgr.x (mgr.34109) 1234 : cluster [DBG] pgmap v1320: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:42.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:42 smithi031 bash[18426]: cluster 2020-06-27T05:20:40.948147+0000 mgr.x (mgr.34109) 1234 : cluster [DBG] pgmap v1320: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:42.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:42 smithi031 bash[22603]: cluster 2020-06-27T05:20:40.948147+0000 mgr.x (mgr.34109) 1234 : cluster [DBG] pgmap v1320: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:44.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:44 smithi051 bash[18409]: cluster 2020-06-27T05:20:42.949862+0000 mgr.x (mgr.34109) 1235 : cluster [DBG] pgmap v1321: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:44.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:44 smithi031 bash[18426]: cluster 2020-06-27T05:20:42.949862+0000 mgr.x (mgr.34109) 1235 : cluster [DBG] pgmap v1321: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:44.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:44 smithi031 bash[22603]: cluster 2020-06-27T05:20:42.949862+0000 mgr.x (mgr.34109) 1235 : cluster [DBG] pgmap v1321: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:46.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:45 smithi051 bash[18409]: cluster 2020-06-27T05:20:44.951405+0000 mgr.x (mgr.34109) 1236 : cluster [DBG] pgmap v1322: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:46.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:45 smithi031 bash[18426]: cluster 2020-06-27T05:20:44.951405+0000 mgr.x (mgr.34109) 1236 : cluster [DBG] pgmap v1322: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:46.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:45 smithi031 bash[22603]: cluster 2020-06-27T05:20:44.951405+0000 mgr.x (mgr.34109) 1236 : cluster [DBG] pgmap v1322: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:48.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:48 smithi051 bash[18409]: cluster 2020-06-27T05:20:46.953139+0000 mgr.x (mgr.34109) 1237 : cluster [DBG] pgmap v1323: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:48.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:48 smithi031 bash[18426]: cluster 2020-06-27T05:20:46.953139+0000 mgr.x (mgr.34109) 1237 : cluster [DBG] pgmap v1323: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:48.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:48 smithi031 bash[22603]: cluster 2020-06-27T05:20:46.953139+0000 mgr.x (mgr.34109) 1237 : cluster [DBG] pgmap v1323: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:50.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:50 smithi051 bash[18409]: cluster 2020-06-27T05:20:48.954816+0000 mgr.x (mgr.34109) 1238 : cluster [DBG] pgmap v1324: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:50.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:50 smithi031 bash[18426]: cluster 2020-06-27T05:20:48.954816+0000 mgr.x (mgr.34109) 1238 : cluster [DBG] pgmap v1324: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:50.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:50 smithi031 bash[22603]: cluster 2020-06-27T05:20:48.954816+0000 mgr.x (mgr.34109) 1238 : cluster [DBG] pgmap v1324: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:52.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:52 smithi051 bash[18409]: cluster 2020-06-27T05:20:50.956538+0000 mgr.x (mgr.34109) 1239 : cluster [DBG] pgmap v1325: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:52.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:52 smithi031 bash[18426]: cluster 2020-06-27T05:20:50.956538+0000 mgr.x (mgr.34109) 1239 : cluster [DBG] pgmap v1325: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:52.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:52 smithi031 bash[22603]: cluster 2020-06-27T05:20:50.956538+0000 mgr.x (mgr.34109) 1239 : cluster [DBG] pgmap v1325: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:54.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:54 smithi051 bash[18409]: cluster 2020-06-27T05:20:52.958238+0000 mgr.x (mgr.34109) 1240 : cluster [DBG] pgmap v1326: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:54.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:54 smithi031 bash[18426]: cluster 2020-06-27T05:20:52.958238+0000 mgr.x (mgr.34109) 1240 : cluster [DBG] pgmap v1326: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:54.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:54 smithi031 bash[22603]: cluster 2020-06-27T05:20:52.958238+0000 mgr.x (mgr.34109) 1240 : cluster [DBG] pgmap v1326: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:55 smithi051 bash[18409]: cluster 2020-06-27T05:20:54.959962+0000 mgr.x (mgr.34109) 1241 : cluster [DBG] pgmap v1327: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:55 smithi031 bash[18426]: cluster 2020-06-27T05:20:54.959962+0000 mgr.x (mgr.34109) 1241 : cluster [DBG] pgmap v1327: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:56.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:55 smithi031 bash[22603]: cluster 2020-06-27T05:20:54.959962+0000 mgr.x (mgr.34109) 1241 : cluster [DBG] pgmap v1327: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:58.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:20:58 smithi051 bash[18409]: cluster 2020-06-27T05:20:56.961678+0000 mgr.x (mgr.34109) 1242 : cluster [DBG] pgmap v1328: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:58.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:20:58 smithi031 bash[18426]: cluster 2020-06-27T05:20:56.961678+0000 mgr.x (mgr.34109) 1242 : cluster [DBG] pgmap v1328: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:20:58.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:20:58 smithi031 bash[22603]: cluster 2020-06-27T05:20:56.961678+0000 mgr.x (mgr.34109) 1242 : cluster [DBG] pgmap v1328: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:00 smithi051 bash[18409]: cluster 2020-06-27T05:20:58.963346+0000 mgr.x (mgr.34109) 1243 : cluster [DBG] pgmap v1329: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:00.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:00 smithi031 bash[18426]: cluster 2020-06-27T05:20:58.963346+0000 mgr.x (mgr.34109) 1243 : cluster [DBG] pgmap v1329: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:00.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:00 smithi031 bash[22603]: cluster 2020-06-27T05:20:58.963346+0000 mgr.x (mgr.34109) 1243 : cluster [DBG] pgmap v1329: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:02.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:02 smithi051 bash[18409]: cluster 2020-06-27T05:21:00.965036+0000 mgr.x (mgr.34109) 1244 : cluster [DBG] pgmap v1330: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:02.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:02 smithi031 bash[18426]: cluster 2020-06-27T05:21:00.965036+0000 mgr.x (mgr.34109) 1244 : cluster [DBG] pgmap v1330: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:02.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:02 smithi031 bash[22603]: cluster 2020-06-27T05:21:00.965036+0000 mgr.x (mgr.34109) 1244 : cluster [DBG] pgmap v1330: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:04.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:04 smithi051 bash[18409]: cluster 2020-06-27T05:21:02.966615+0000 mgr.x (mgr.34109) 1245 : cluster [DBG] pgmap v1331: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:04.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:04 smithi031 bash[18426]: cluster 2020-06-27T05:21:02.966615+0000 mgr.x (mgr.34109) 1245 : cluster [DBG] pgmap v1331: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:04.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:04 smithi031 bash[22603]: cluster 2020-06-27T05:21:02.966615+0000 mgr.x (mgr.34109) 1245 : cluster [DBG] pgmap v1331: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:05 smithi051 bash[18409]: cluster 2020-06-27T05:21:04.968190+0000 mgr.x (mgr.34109) 1246 : cluster [DBG] pgmap v1332: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:06.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:05 smithi031 bash[18426]: cluster 2020-06-27T05:21:04.968190+0000 mgr.x (mgr.34109) 1246 : cluster [DBG] pgmap v1332: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:06.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:05 smithi031 bash[22603]: cluster 2020-06-27T05:21:04.968190+0000 mgr.x (mgr.34109) 1246 : cluster [DBG] pgmap v1332: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:08.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:08 smithi051 bash[18409]: cluster 2020-06-27T05:21:06.969947+0000 mgr.x (mgr.34109) 1247 : cluster [DBG] pgmap v1333: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:08.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:08 smithi031 bash[18426]: cluster 2020-06-27T05:21:06.969947+0000 mgr.x (mgr.34109) 1247 : cluster [DBG] pgmap v1333: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:08.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:08 smithi031 bash[22603]: cluster 2020-06-27T05:21:06.969947+0000 mgr.x (mgr.34109) 1247 : cluster [DBG] pgmap v1333: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:10.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:10 smithi051 bash[18409]: cluster 2020-06-27T05:21:08.971686+0000 mgr.x (mgr.34109) 1248 : cluster [DBG] pgmap v1334: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:10.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:10 smithi031 bash[18426]: cluster 2020-06-27T05:21:08.971686+0000 mgr.x (mgr.34109) 1248 : cluster [DBG] pgmap v1334: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:10.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:10 smithi031 bash[22603]: cluster 2020-06-27T05:21:08.971686+0000 mgr.x (mgr.34109) 1248 : cluster [DBG] pgmap v1334: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:12.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:12 smithi051 bash[18409]: cluster 2020-06-27T05:21:10.973352+0000 mgr.x (mgr.34109) 1249 : cluster [DBG] pgmap v1335: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:12.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:12 smithi031 bash[18426]: cluster 2020-06-27T05:21:10.973352+0000 mgr.x (mgr.34109) 1249 : cluster [DBG] pgmap v1335: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:12.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:12 smithi031 bash[22603]: cluster 2020-06-27T05:21:10.973352+0000 mgr.x (mgr.34109) 1249 : cluster [DBG] pgmap v1335: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:14.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:14 smithi051 bash[18409]: cluster 2020-06-27T05:21:12.974961+0000 mgr.x (mgr.34109) 1250 : cluster [DBG] pgmap v1336: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:14.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:14 smithi031 bash[18426]: cluster 2020-06-27T05:21:12.974961+0000 mgr.x (mgr.34109) 1250 : cluster [DBG] pgmap v1336: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:14.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:14 smithi031 bash[22603]: cluster 2020-06-27T05:21:12.974961+0000 mgr.x (mgr.34109) 1250 : cluster [DBG] pgmap v1336: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:15 smithi051 bash[18409]: cluster 2020-06-27T05:21:14.976717+0000 mgr.x (mgr.34109) 1251 : cluster [DBG] pgmap v1337: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:15 smithi031 bash[18426]: cluster 2020-06-27T05:21:14.976717+0000 mgr.x (mgr.34109) 1251 : cluster [DBG] pgmap v1337: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:16.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:15 smithi031 bash[22603]: cluster 2020-06-27T05:21:14.976717+0000 mgr.x (mgr.34109) 1251 : cluster [DBG] pgmap v1337: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:18.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:18 smithi051 bash[18409]: cluster 2020-06-27T05:21:16.978412+0000 mgr.x (mgr.34109) 1252 : cluster [DBG] pgmap v1338: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:18.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:18 smithi031 bash[18426]: cluster 2020-06-27T05:21:16.978412+0000 mgr.x (mgr.34109) 1252 : cluster [DBG] pgmap v1338: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:18.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:18 smithi031 bash[22603]: cluster 2020-06-27T05:21:16.978412+0000 mgr.x (mgr.34109) 1252 : cluster [DBG] pgmap v1338: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:20.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:20 smithi051 bash[18409]: cluster 2020-06-27T05:21:18.979883+0000 mgr.x (mgr.34109) 1253 : cluster [DBG] pgmap v1339: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:20.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:20 smithi031 bash[18426]: cluster 2020-06-27T05:21:18.979883+0000 mgr.x (mgr.34109) 1253 : cluster [DBG] pgmap v1339: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:20.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:20 smithi031 bash[22603]: cluster 2020-06-27T05:21:18.979883+0000 mgr.x (mgr.34109) 1253 : cluster [DBG] pgmap v1339: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:22.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:22 smithi051 bash[18409]: cluster 2020-06-27T05:21:20.981639+0000 mgr.x (mgr.34109) 1254 : cluster [DBG] pgmap v1340: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:22.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:22 smithi031 bash[18426]: cluster 2020-06-27T05:21:20.981639+0000 mgr.x (mgr.34109) 1254 : cluster [DBG] pgmap v1340: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:22.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:22 smithi031 bash[22603]: cluster 2020-06-27T05:21:20.981639+0000 mgr.x (mgr.34109) 1254 : cluster [DBG] pgmap v1340: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:24.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:24 smithi051 bash[18409]: cluster 2020-06-27T05:21:22.983254+0000 mgr.x (mgr.34109) 1255 : cluster [DBG] pgmap v1341: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:24.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:24 smithi031 bash[18426]: cluster 2020-06-27T05:21:22.983254+0000 mgr.x (mgr.34109) 1255 : cluster [DBG] pgmap v1341: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:24.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:24 smithi031 bash[22603]: cluster 2020-06-27T05:21:22.983254+0000 mgr.x (mgr.34109) 1255 : cluster [DBG] pgmap v1341: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:26.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:25 smithi051 bash[18409]: cluster 2020-06-27T05:21:24.984980+0000 mgr.x (mgr.34109) 1256 : cluster [DBG] pgmap v1342: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:25 smithi031 bash[18426]: cluster 2020-06-27T05:21:24.984980+0000 mgr.x (mgr.34109) 1256 : cluster [DBG] pgmap v1342: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:25 smithi031 bash[22603]: cluster 2020-06-27T05:21:24.984980+0000 mgr.x (mgr.34109) 1256 : cluster [DBG] pgmap v1342: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:28.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:28 smithi051 bash[18409]: cluster 2020-06-27T05:21:26.986583+0000 mgr.x (mgr.34109) 1257 : cluster [DBG] pgmap v1343: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:28.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:28 smithi031 bash[18426]: cluster 2020-06-27T05:21:26.986583+0000 mgr.x (mgr.34109) 1257 : cluster [DBG] pgmap v1343: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:28.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:28 smithi031 bash[22603]: cluster 2020-06-27T05:21:26.986583+0000 mgr.x (mgr.34109) 1257 : cluster [DBG] pgmap v1343: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:30.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:30 smithi051 bash[18409]: cluster 2020-06-27T05:21:28.988385+0000 mgr.x (mgr.34109) 1258 : cluster [DBG] pgmap v1344: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:30.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:30 smithi031 bash[18426]: cluster 2020-06-27T05:21:28.988385+0000 mgr.x (mgr.34109) 1258 : cluster [DBG] pgmap v1344: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:30.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:30 smithi031 bash[22603]: cluster 2020-06-27T05:21:28.988385+0000 mgr.x (mgr.34109) 1258 : cluster [DBG] pgmap v1344: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:32.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:32 smithi051 bash[18409]: cluster 2020-06-27T05:21:30.990101+0000 mgr.x (mgr.34109) 1259 : cluster [DBG] pgmap v1345: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:32.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:32 smithi031 bash[18426]: cluster 2020-06-27T05:21:30.990101+0000 mgr.x (mgr.34109) 1259 : cluster [DBG] pgmap v1345: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:32.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:32 smithi031 bash[22603]: cluster 2020-06-27T05:21:30.990101+0000 mgr.x (mgr.34109) 1259 : cluster [DBG] pgmap v1345: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:34.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:34 smithi051 bash[18409]: cluster 2020-06-27T05:21:32.991837+0000 mgr.x (mgr.34109) 1260 : cluster [DBG] pgmap v1346: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:34.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:34 smithi031 bash[22603]: cluster 2020-06-27T05:21:32.991837+0000 mgr.x (mgr.34109) 1260 : cluster [DBG] pgmap v1346: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:34.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:34 smithi031 bash[18426]: cluster 2020-06-27T05:21:32.991837+0000 mgr.x (mgr.34109) 1260 : cluster [DBG] pgmap v1346: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:35 smithi051 bash[18409]: cluster 2020-06-27T05:21:34.993552+0000 mgr.x (mgr.34109) 1261 : cluster [DBG] pgmap v1347: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:36.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:35 smithi031 bash[18426]: cluster 2020-06-27T05:21:34.993552+0000 mgr.x (mgr.34109) 1261 : cluster [DBG] pgmap v1347: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:36.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:35 smithi031 bash[22603]: cluster 2020-06-27T05:21:34.993552+0000 mgr.x (mgr.34109) 1261 : cluster [DBG] pgmap v1347: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:38.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:38 smithi051 bash[18409]: cluster 2020-06-27T05:21:36.995163+0000 mgr.x (mgr.34109) 1262 : cluster [DBG] pgmap v1348: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:38.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:38 smithi031 bash[18426]: cluster 2020-06-27T05:21:36.995163+0000 mgr.x (mgr.34109) 1262 : cluster [DBG] pgmap v1348: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:38.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:38 smithi031 bash[22603]: cluster 2020-06-27T05:21:36.995163+0000 mgr.x (mgr.34109) 1262 : cluster [DBG] pgmap v1348: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:40.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:40 smithi051 bash[18409]: cluster 2020-06-27T05:21:38.996794+0000 mgr.x (mgr.34109) 1263 : cluster [DBG] pgmap v1349: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:40.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:40 smithi031 bash[18426]: cluster 2020-06-27T05:21:38.996794+0000 mgr.x (mgr.34109) 1263 : cluster [DBG] pgmap v1349: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:40.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:40 smithi031 bash[22603]: cluster 2020-06-27T05:21:38.996794+0000 mgr.x (mgr.34109) 1263 : cluster [DBG] pgmap v1349: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:42.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:42 smithi051 bash[18409]: cluster 2020-06-27T05:21:40.998428+0000 mgr.x (mgr.34109) 1264 : cluster [DBG] pgmap v1350: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:42.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:42 smithi031 bash[18426]: cluster 2020-06-27T05:21:40.998428+0000 mgr.x (mgr.34109) 1264 : cluster [DBG] pgmap v1350: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:42.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:42 smithi031 bash[22603]: cluster 2020-06-27T05:21:40.998428+0000 mgr.x (mgr.34109) 1264 : cluster [DBG] pgmap v1350: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:44.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:44 smithi051 bash[18409]: cluster 2020-06-27T05:21:43.000065+0000 mgr.x (mgr.34109) 1265 : cluster [DBG] pgmap v1351: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:44.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:44 smithi031 bash[22603]: cluster 2020-06-27T05:21:43.000065+0000 mgr.x (mgr.34109) 1265 : cluster [DBG] pgmap v1351: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:44.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:44 smithi031 bash[18426]: cluster 2020-06-27T05:21:43.000065+0000 mgr.x (mgr.34109) 1265 : cluster [DBG] pgmap v1351: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:46.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:45 smithi051 bash[18409]: cluster 2020-06-27T05:21:45.001680+0000 mgr.x (mgr.34109) 1266 : cluster [DBG] pgmap v1352: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:46.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:45 smithi031 bash[18426]: cluster 2020-06-27T05:21:45.001680+0000 mgr.x (mgr.34109) 1266 : cluster [DBG] pgmap v1352: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:46.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:45 smithi031 bash[22603]: cluster 2020-06-27T05:21:45.001680+0000 mgr.x (mgr.34109) 1266 : cluster [DBG] pgmap v1352: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:48.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:48 smithi051 bash[18409]: cluster 2020-06-27T05:21:47.003303+0000 mgr.x (mgr.34109) 1267 : cluster [DBG] pgmap v1353: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:48.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:48 smithi031 bash[18426]: cluster 2020-06-27T05:21:47.003303+0000 mgr.x (mgr.34109) 1267 : cluster [DBG] pgmap v1353: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:48.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:48 smithi031 bash[22603]: cluster 2020-06-27T05:21:47.003303+0000 mgr.x (mgr.34109) 1267 : cluster [DBG] pgmap v1353: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:50.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:50 smithi051 bash[18409]: cluster 2020-06-27T05:21:49.004887+0000 mgr.x (mgr.34109) 1268 : cluster [DBG] pgmap v1354: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:50.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:50 smithi031 bash[18426]: cluster 2020-06-27T05:21:49.004887+0000 mgr.x (mgr.34109) 1268 : cluster [DBG] pgmap v1354: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:50.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:50 smithi031 bash[22603]: cluster 2020-06-27T05:21:49.004887+0000 mgr.x (mgr.34109) 1268 : cluster [DBG] pgmap v1354: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:52.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:52 smithi051 bash[18409]: cluster 2020-06-27T05:21:51.006493+0000 mgr.x (mgr.34109) 1269 : cluster [DBG] pgmap v1355: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:52.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:52 smithi031 bash[18426]: cluster 2020-06-27T05:21:51.006493+0000 mgr.x (mgr.34109) 1269 : cluster [DBG] pgmap v1355: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:52.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:52 smithi031 bash[22603]: cluster 2020-06-27T05:21:51.006493+0000 mgr.x (mgr.34109) 1269 : cluster [DBG] pgmap v1355: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:54.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:54 smithi051 bash[18409]: cluster 2020-06-27T05:21:53.008141+0000 mgr.x (mgr.34109) 1270 : cluster [DBG] pgmap v1356: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:54.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:54 smithi031 bash[18426]: cluster 2020-06-27T05:21:53.008141+0000 mgr.x (mgr.34109) 1270 : cluster [DBG] pgmap v1356: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:54.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:54 smithi031 bash[22603]: cluster 2020-06-27T05:21:53.008141+0000 mgr.x (mgr.34109) 1270 : cluster [DBG] pgmap v1356: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:55 smithi051 bash[18409]: cluster 2020-06-27T05:21:55.009807+0000 mgr.x (mgr.34109) 1271 : cluster [DBG] pgmap v1357: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:56.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:55 smithi031 bash[22603]: cluster 2020-06-27T05:21:55.009807+0000 mgr.x (mgr.34109) 1271 : cluster [DBG] pgmap v1357: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:55 smithi031 bash[18426]: cluster 2020-06-27T05:21:55.009807+0000 mgr.x (mgr.34109) 1271 : cluster [DBG] pgmap v1357: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:58.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:21:58 smithi051 bash[18409]: cluster 2020-06-27T05:21:57.011442+0000 mgr.x (mgr.34109) 1272 : cluster [DBG] pgmap v1358: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:58.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:21:58 smithi031 bash[18426]: cluster 2020-06-27T05:21:57.011442+0000 mgr.x (mgr.34109) 1272 : cluster [DBG] pgmap v1358: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:21:58.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:21:58 smithi031 bash[22603]: cluster 2020-06-27T05:21:57.011442+0000 mgr.x (mgr.34109) 1272 : cluster [DBG] pgmap v1358: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:00 smithi051 bash[18409]: cluster 2020-06-27T05:21:59.013077+0000 mgr.x (mgr.34109) 1273 : cluster [DBG] pgmap v1359: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:00.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:00 smithi031 bash[18426]: cluster 2020-06-27T05:21:59.013077+0000 mgr.x (mgr.34109) 1273 : cluster [DBG] pgmap v1359: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:00.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:00 smithi031 bash[22603]: cluster 2020-06-27T05:21:59.013077+0000 mgr.x (mgr.34109) 1273 : cluster [DBG] pgmap v1359: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:02.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:02 smithi051 bash[18409]: cluster 2020-06-27T05:22:01.014715+0000 mgr.x (mgr.34109) 1274 : cluster [DBG] pgmap v1360: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:02.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:02 smithi031 bash[18426]: cluster 2020-06-27T05:22:01.014715+0000 mgr.x (mgr.34109) 1274 : cluster [DBG] pgmap v1360: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:02.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:02 smithi031 bash[22603]: cluster 2020-06-27T05:22:01.014715+0000 mgr.x (mgr.34109) 1274 : cluster [DBG] pgmap v1360: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:04.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:04 smithi051 bash[18409]: cluster 2020-06-27T05:22:03.016335+0000 mgr.x (mgr.34109) 1275 : cluster [DBG] pgmap v1361: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:04.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:04 smithi031 bash[22603]: cluster 2020-06-27T05:22:03.016335+0000 mgr.x (mgr.34109) 1275 : cluster [DBG] pgmap v1361: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:04.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:04 smithi031 bash[18426]: cluster 2020-06-27T05:22:03.016335+0000 mgr.x (mgr.34109) 1275 : cluster [DBG] pgmap v1361: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:05 smithi051 bash[18409]: cluster 2020-06-27T05:22:05.017893+0000 mgr.x (mgr.34109) 1276 : cluster [DBG] pgmap v1362: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:06.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:05 smithi031 bash[18426]: cluster 2020-06-27T05:22:05.017893+0000 mgr.x (mgr.34109) 1276 : cluster [DBG] pgmap v1362: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:06.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:05 smithi031 bash[22603]: cluster 2020-06-27T05:22:05.017893+0000 mgr.x (mgr.34109) 1276 : cluster [DBG] pgmap v1362: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:08.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:08 smithi051 bash[18409]: cluster 2020-06-27T05:22:07.019477+0000 mgr.x (mgr.34109) 1277 : cluster [DBG] pgmap v1363: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:08.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:08 smithi031 bash[18426]: cluster 2020-06-27T05:22:07.019477+0000 mgr.x (mgr.34109) 1277 : cluster [DBG] pgmap v1363: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:08.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:08 smithi031 bash[22603]: cluster 2020-06-27T05:22:07.019477+0000 mgr.x (mgr.34109) 1277 : cluster [DBG] pgmap v1363: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:10.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:10 smithi051 bash[18409]: cluster 2020-06-27T05:22:09.021067+0000 mgr.x (mgr.34109) 1278 : cluster [DBG] pgmap v1364: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:10.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:10 smithi031 bash[18426]: cluster 2020-06-27T05:22:09.021067+0000 mgr.x (mgr.34109) 1278 : cluster [DBG] pgmap v1364: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:10.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:10 smithi031 bash[22603]: cluster 2020-06-27T05:22:09.021067+0000 mgr.x (mgr.34109) 1278 : cluster [DBG] pgmap v1364: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:12.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:12 smithi051 bash[18409]: cluster 2020-06-27T05:22:11.022812+0000 mgr.x (mgr.34109) 1279 : cluster [DBG] pgmap v1365: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:12.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:12 smithi031 bash[18426]: cluster 2020-06-27T05:22:11.022812+0000 mgr.x (mgr.34109) 1279 : cluster [DBG] pgmap v1365: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:12.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:12 smithi031 bash[22603]: cluster 2020-06-27T05:22:11.022812+0000 mgr.x (mgr.34109) 1279 : cluster [DBG] pgmap v1365: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:14.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:14 smithi051 bash[18409]: cluster 2020-06-27T05:22:13.024565+0000 mgr.x (mgr.34109) 1280 : cluster [DBG] pgmap v1366: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:14.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:14 smithi031 bash[18426]: cluster 2020-06-27T05:22:13.024565+0000 mgr.x (mgr.34109) 1280 : cluster [DBG] pgmap v1366: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:14.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:14 smithi031 bash[22603]: cluster 2020-06-27T05:22:13.024565+0000 mgr.x (mgr.34109) 1280 : cluster [DBG] pgmap v1366: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:16.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:15 smithi051 bash[18409]: cluster 2020-06-27T05:22:15.026273+0000 mgr.x (mgr.34109) 1281 : cluster [DBG] pgmap v1367: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:15 smithi031 bash[18426]: cluster 2020-06-27T05:22:15.026273+0000 mgr.x (mgr.34109) 1281 : cluster [DBG] pgmap v1367: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:16.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:15 smithi031 bash[22603]: cluster 2020-06-27T05:22:15.026273+0000 mgr.x (mgr.34109) 1281 : cluster [DBG] pgmap v1367: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:18.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:18 smithi051 bash[18409]: cluster 2020-06-27T05:22:17.027859+0000 mgr.x (mgr.34109) 1282 : cluster [DBG] pgmap v1368: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:18.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:18 smithi031 bash[18426]: cluster 2020-06-27T05:22:17.027859+0000 mgr.x (mgr.34109) 1282 : cluster [DBG] pgmap v1368: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:18.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:18 smithi031 bash[22603]: cluster 2020-06-27T05:22:17.027859+0000 mgr.x (mgr.34109) 1282 : cluster [DBG] pgmap v1368: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:20.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:20 smithi051 bash[18409]: cluster 2020-06-27T05:22:19.029517+0000 mgr.x (mgr.34109) 1283 : cluster [DBG] pgmap v1369: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:20.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:20 smithi031 bash[18426]: cluster 2020-06-27T05:22:19.029517+0000 mgr.x (mgr.34109) 1283 : cluster [DBG] pgmap v1369: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:20.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:20 smithi031 bash[22603]: cluster 2020-06-27T05:22:19.029517+0000 mgr.x (mgr.34109) 1283 : cluster [DBG] pgmap v1369: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:22.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:22 smithi051 bash[18409]: cluster 2020-06-27T05:22:21.031141+0000 mgr.x (mgr.34109) 1284 : cluster [DBG] pgmap v1370: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:22.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:22 smithi031 bash[18426]: cluster 2020-06-27T05:22:21.031141+0000 mgr.x (mgr.34109) 1284 : cluster [DBG] pgmap v1370: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:22.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:22 smithi031 bash[22603]: cluster 2020-06-27T05:22:21.031141+0000 mgr.x (mgr.34109) 1284 : cluster [DBG] pgmap v1370: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:24.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:24 smithi051 bash[18409]: cluster 2020-06-27T05:22:23.032833+0000 mgr.x (mgr.34109) 1285 : cluster [DBG] pgmap v1371: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:24.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:24 smithi031 bash[18426]: cluster 2020-06-27T05:22:23.032833+0000 mgr.x (mgr.34109) 1285 : cluster [DBG] pgmap v1371: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:24.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:24 smithi031 bash[22603]: cluster 2020-06-27T05:22:23.032833+0000 mgr.x (mgr.34109) 1285 : cluster [DBG] pgmap v1371: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:26.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:25 smithi051 bash[18409]: cluster 2020-06-27T05:22:25.034515+0000 mgr.x (mgr.34109) 1286 : cluster [DBG] pgmap v1372: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:25 smithi031 bash[22603]: cluster 2020-06-27T05:22:25.034515+0000 mgr.x (mgr.34109) 1286 : cluster [DBG] pgmap v1372: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:25 smithi031 bash[18426]: cluster 2020-06-27T05:22:25.034515+0000 mgr.x (mgr.34109) 1286 : cluster [DBG] pgmap v1372: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:28.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:28 smithi051 bash[18409]: cluster 2020-06-27T05:22:27.036148+0000 mgr.x (mgr.34109) 1287 : cluster [DBG] pgmap v1373: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:28.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:28 smithi031 bash[22603]: cluster 2020-06-27T05:22:27.036148+0000 mgr.x (mgr.34109) 1287 : cluster [DBG] pgmap v1373: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:28.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:28 smithi031 bash[18426]: cluster 2020-06-27T05:22:27.036148+0000 mgr.x (mgr.34109) 1287 : cluster [DBG] pgmap v1373: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:30.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:30 smithi051 bash[18409]: cluster 2020-06-27T05:22:29.037752+0000 mgr.x (mgr.34109) 1288 : cluster [DBG] pgmap v1374: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:30.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:30 smithi031 bash[18426]: cluster 2020-06-27T05:22:29.037752+0000 mgr.x (mgr.34109) 1288 : cluster [DBG] pgmap v1374: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:30.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:30 smithi031 bash[22603]: cluster 2020-06-27T05:22:29.037752+0000 mgr.x (mgr.34109) 1288 : cluster [DBG] pgmap v1374: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:32.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:32 smithi051 bash[18409]: cluster 2020-06-27T05:22:31.039338+0000 mgr.x (mgr.34109) 1289 : cluster [DBG] pgmap v1375: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:32.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:32 smithi031 bash[18426]: cluster 2020-06-27T05:22:31.039338+0000 mgr.x (mgr.34109) 1289 : cluster [DBG] pgmap v1375: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:32.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:32 smithi031 bash[22603]: cluster 2020-06-27T05:22:31.039338+0000 mgr.x (mgr.34109) 1289 : cluster [DBG] pgmap v1375: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:34.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:34 smithi051 bash[18409]: cluster 2020-06-27T05:22:33.041090+0000 mgr.x (mgr.34109) 1290 : cluster [DBG] pgmap v1376: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:34.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:34 smithi031 bash[18426]: cluster 2020-06-27T05:22:33.041090+0000 mgr.x (mgr.34109) 1290 : cluster [DBG] pgmap v1376: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:34.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:34 smithi031 bash[22603]: cluster 2020-06-27T05:22:33.041090+0000 mgr.x (mgr.34109) 1290 : cluster [DBG] pgmap v1376: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:35 smithi051 bash[18409]: cluster 2020-06-27T05:22:35.042675+0000 mgr.x (mgr.34109) 1291 : cluster [DBG] pgmap v1377: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:36.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:35 smithi031 bash[18426]: cluster 2020-06-27T05:22:35.042675+0000 mgr.x (mgr.34109) 1291 : cluster [DBG] pgmap v1377: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:36.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:35 smithi031 bash[22603]: cluster 2020-06-27T05:22:35.042675+0000 mgr.x (mgr.34109) 1291 : cluster [DBG] pgmap v1377: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:38.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:38 smithi051 bash[18409]: cluster 2020-06-27T05:22:37.044433+0000 mgr.x (mgr.34109) 1292 : cluster [DBG] pgmap v1378: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:38.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:38 smithi031 bash[18426]: cluster 2020-06-27T05:22:37.044433+0000 mgr.x (mgr.34109) 1292 : cluster [DBG] pgmap v1378: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:38.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:38 smithi031 bash[22603]: cluster 2020-06-27T05:22:37.044433+0000 mgr.x (mgr.34109) 1292 : cluster [DBG] pgmap v1378: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:40.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:40 smithi051 bash[18409]: cluster 2020-06-27T05:22:39.046158+0000 mgr.x (mgr.34109) 1293 : cluster [DBG] pgmap v1379: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:40.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:40 smithi031 bash[18426]: cluster 2020-06-27T05:22:39.046158+0000 mgr.x (mgr.34109) 1293 : cluster [DBG] pgmap v1379: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:40.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:40 smithi031 bash[22603]: cluster 2020-06-27T05:22:39.046158+0000 mgr.x (mgr.34109) 1293 : cluster [DBG] pgmap v1379: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:42.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:42 smithi051 bash[18409]: cluster 2020-06-27T05:22:41.047875+0000 mgr.x (mgr.34109) 1294 : cluster [DBG] pgmap v1380: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:42.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:42 smithi031 bash[18426]: cluster 2020-06-27T05:22:41.047875+0000 mgr.x (mgr.34109) 1294 : cluster [DBG] pgmap v1380: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:42.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:42 smithi031 bash[22603]: cluster 2020-06-27T05:22:41.047875+0000 mgr.x (mgr.34109) 1294 : cluster [DBG] pgmap v1380: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:44.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:44 smithi051 bash[18409]: cluster 2020-06-27T05:22:43.049572+0000 mgr.x (mgr.34109) 1295 : cluster [DBG] pgmap v1381: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:44.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:44 smithi031 bash[18426]: cluster 2020-06-27T05:22:43.049572+0000 mgr.x (mgr.34109) 1295 : cluster [DBG] pgmap v1381: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:44.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:44 smithi031 bash[22603]: cluster 2020-06-27T05:22:43.049572+0000 mgr.x (mgr.34109) 1295 : cluster [DBG] pgmap v1381: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:46.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:45 smithi051 bash[18409]: cluster 2020-06-27T05:22:45.051300+0000 mgr.x (mgr.34109) 1296 : cluster [DBG] pgmap v1382: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:46.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:45 smithi031 bash[18426]: cluster 2020-06-27T05:22:45.051300+0000 mgr.x (mgr.34109) 1296 : cluster [DBG] pgmap v1382: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:46.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:45 smithi031 bash[22603]: cluster 2020-06-27T05:22:45.051300+0000 mgr.x (mgr.34109) 1296 : cluster [DBG] pgmap v1382: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:48.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:48 smithi051 bash[18409]: cluster 2020-06-27T05:22:47.053044+0000 mgr.x (mgr.34109) 1297 : cluster [DBG] pgmap v1383: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:48.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:48 smithi031 bash[18426]: cluster 2020-06-27T05:22:47.053044+0000 mgr.x (mgr.34109) 1297 : cluster [DBG] pgmap v1383: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:48.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:48 smithi031 bash[22603]: cluster 2020-06-27T05:22:47.053044+0000 mgr.x (mgr.34109) 1297 : cluster [DBG] pgmap v1383: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:50.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:50 smithi051 bash[18409]: cluster 2020-06-27T05:22:49.054663+0000 mgr.x (mgr.34109) 1298 : cluster [DBG] pgmap v1384: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:50.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:50 smithi031 bash[18426]: cluster 2020-06-27T05:22:49.054663+0000 mgr.x (mgr.34109) 1298 : cluster [DBG] pgmap v1384: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:50.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:50 smithi031 bash[22603]: cluster 2020-06-27T05:22:49.054663+0000 mgr.x (mgr.34109) 1298 : cluster [DBG] pgmap v1384: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:52.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:52 smithi051 bash[18409]: cluster 2020-06-27T05:22:51.056318+0000 mgr.x (mgr.34109) 1299 : cluster [DBG] pgmap v1385: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:52.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:52 smithi031 bash[18426]: cluster 2020-06-27T05:22:51.056318+0000 mgr.x (mgr.34109) 1299 : cluster [DBG] pgmap v1385: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:52.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:52 smithi031 bash[22603]: cluster 2020-06-27T05:22:51.056318+0000 mgr.x (mgr.34109) 1299 : cluster [DBG] pgmap v1385: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:54.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:54 smithi051 bash[18409]: cluster 2020-06-27T05:22:53.057912+0000 mgr.x (mgr.34109) 1300 : cluster [DBG] pgmap v1386: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:54.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:54 smithi031 bash[18426]: cluster 2020-06-27T05:22:53.057912+0000 mgr.x (mgr.34109) 1300 : cluster [DBG] pgmap v1386: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:54.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:54 smithi031 bash[22603]: cluster 2020-06-27T05:22:53.057912+0000 mgr.x (mgr.34109) 1300 : cluster [DBG] pgmap v1386: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:55 smithi051 bash[18409]: cluster 2020-06-27T05:22:55.059475+0000 mgr.x (mgr.34109) 1301 : cluster [DBG] pgmap v1387: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:56.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:55 smithi031 bash[22603]: cluster 2020-06-27T05:22:55.059475+0000 mgr.x (mgr.34109) 1301 : cluster [DBG] pgmap v1387: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:55 smithi031 bash[18426]: cluster 2020-06-27T05:22:55.059475+0000 mgr.x (mgr.34109) 1301 : cluster [DBG] pgmap v1387: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:58.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:22:58 smithi051 bash[18409]: cluster 2020-06-27T05:22:57.061088+0000 mgr.x (mgr.34109) 1302 : cluster [DBG] pgmap v1388: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:58.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:22:58 smithi031 bash[22603]: cluster 2020-06-27T05:22:57.061088+0000 mgr.x (mgr.34109) 1302 : cluster [DBG] pgmap v1388: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:22:58.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:22:58 smithi031 bash[18426]: cluster 2020-06-27T05:22:57.061088+0000 mgr.x (mgr.34109) 1302 : cluster [DBG] pgmap v1388: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:00 smithi051 bash[18409]: cluster 2020-06-27T05:22:59.062680+0000 mgr.x (mgr.34109) 1303 : cluster [DBG] pgmap v1389: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:00.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:00 smithi031 bash[18426]: cluster 2020-06-27T05:22:59.062680+0000 mgr.x (mgr.34109) 1303 : cluster [DBG] pgmap v1389: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:00.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:00 smithi031 bash[22603]: cluster 2020-06-27T05:22:59.062680+0000 mgr.x (mgr.34109) 1303 : cluster [DBG] pgmap v1389: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:02.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:02 smithi051 bash[18409]: cluster 2020-06-27T05:23:01.064277+0000 mgr.x (mgr.34109) 1304 : cluster [DBG] pgmap v1390: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:02.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:02 smithi031 bash[18426]: cluster 2020-06-27T05:23:01.064277+0000 mgr.x (mgr.34109) 1304 : cluster [DBG] pgmap v1390: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:02.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:02 smithi031 bash[22603]: cluster 2020-06-27T05:23:01.064277+0000 mgr.x (mgr.34109) 1304 : cluster [DBG] pgmap v1390: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:04.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:04 smithi051 bash[18409]: cluster 2020-06-27T05:23:03.065971+0000 mgr.x (mgr.34109) 1305 : cluster [DBG] pgmap v1391: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:04.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:04 smithi031 bash[18426]: cluster 2020-06-27T05:23:03.065971+0000 mgr.x (mgr.34109) 1305 : cluster [DBG] pgmap v1391: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:04.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:04 smithi031 bash[22603]: cluster 2020-06-27T05:23:03.065971+0000 mgr.x (mgr.34109) 1305 : cluster [DBG] pgmap v1391: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:05 smithi051 bash[18409]: cluster 2020-06-27T05:23:05.067644+0000 mgr.x (mgr.34109) 1306 : cluster [DBG] pgmap v1392: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:06.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:05 smithi031 bash[18426]: cluster 2020-06-27T05:23:05.067644+0000 mgr.x (mgr.34109) 1306 : cluster [DBG] pgmap v1392: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:06.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:05 smithi031 bash[22603]: cluster 2020-06-27T05:23:05.067644+0000 mgr.x (mgr.34109) 1306 : cluster [DBG] pgmap v1392: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:08.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:08 smithi051 bash[18409]: cluster 2020-06-27T05:23:07.069275+0000 mgr.x (mgr.34109) 1307 : cluster [DBG] pgmap v1393: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:08.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:08 smithi031 bash[18426]: cluster 2020-06-27T05:23:07.069275+0000 mgr.x (mgr.34109) 1307 : cluster [DBG] pgmap v1393: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:08.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:08 smithi031 bash[22603]: cluster 2020-06-27T05:23:07.069275+0000 mgr.x (mgr.34109) 1307 : cluster [DBG] pgmap v1393: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:10.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:10 smithi051 bash[18409]: cluster 2020-06-27T05:23:09.070990+0000 mgr.x (mgr.34109) 1308 : cluster [DBG] pgmap v1394: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:10.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:10 smithi031 bash[22603]: cluster 2020-06-27T05:23:09.070990+0000 mgr.x (mgr.34109) 1308 : cluster [DBG] pgmap v1394: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:10.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:10 smithi031 bash[18426]: cluster 2020-06-27T05:23:09.070990+0000 mgr.x (mgr.34109) 1308 : cluster [DBG] pgmap v1394: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:12.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:12 smithi051 bash[18409]: cluster 2020-06-27T05:23:11.072765+0000 mgr.x (mgr.34109) 1309 : cluster [DBG] pgmap v1395: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:12.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:12 smithi031 bash[22603]: cluster 2020-06-27T05:23:11.072765+0000 mgr.x (mgr.34109) 1309 : cluster [DBG] pgmap v1395: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:12.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:12 smithi031 bash[18426]: cluster 2020-06-27T05:23:11.072765+0000 mgr.x (mgr.34109) 1309 : cluster [DBG] pgmap v1395: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:14.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:14 smithi051 bash[18409]: cluster 2020-06-27T05:23:13.074380+0000 mgr.x (mgr.34109) 1310 : cluster [DBG] pgmap v1396: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:14.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:14 smithi031 bash[18426]: cluster 2020-06-27T05:23:13.074380+0000 mgr.x (mgr.34109) 1310 : cluster [DBG] pgmap v1396: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:14.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:14 smithi031 bash[22603]: cluster 2020-06-27T05:23:13.074380+0000 mgr.x (mgr.34109) 1310 : cluster [DBG] pgmap v1396: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:15 smithi051 bash[18409]: cluster 2020-06-27T05:23:15.075943+0000 mgr.x (mgr.34109) 1311 : cluster [DBG] pgmap v1397: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:15 smithi031 bash[18426]: cluster 2020-06-27T05:23:15.075943+0000 mgr.x (mgr.34109) 1311 : cluster [DBG] pgmap v1397: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:16.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:15 smithi031 bash[22603]: cluster 2020-06-27T05:23:15.075943+0000 mgr.x (mgr.34109) 1311 : cluster [DBG] pgmap v1397: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:18.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:18 smithi051 bash[18409]: cluster 2020-06-27T05:23:17.077698+0000 mgr.x (mgr.34109) 1312 : cluster [DBG] pgmap v1398: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:18.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:18 smithi031 bash[18426]: cluster 2020-06-27T05:23:17.077698+0000 mgr.x (mgr.34109) 1312 : cluster [DBG] pgmap v1398: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:18.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:18 smithi031 bash[22603]: cluster 2020-06-27T05:23:17.077698+0000 mgr.x (mgr.34109) 1312 : cluster [DBG] pgmap v1398: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:20.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:20 smithi051 bash[18409]: cluster 2020-06-27T05:23:19.079365+0000 mgr.x (mgr.34109) 1313 : cluster [DBG] pgmap v1399: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:20.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:20 smithi031 bash[18426]: cluster 2020-06-27T05:23:19.079365+0000 mgr.x (mgr.34109) 1313 : cluster [DBG] pgmap v1399: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:20.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:20 smithi031 bash[22603]: cluster 2020-06-27T05:23:19.079365+0000 mgr.x (mgr.34109) 1313 : cluster [DBG] pgmap v1399: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:22.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:22 smithi051 bash[18409]: cluster 2020-06-27T05:23:21.081073+0000 mgr.x (mgr.34109) 1314 : cluster [DBG] pgmap v1400: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:22.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:22 smithi031 bash[18426]: cluster 2020-06-27T05:23:21.081073+0000 mgr.x (mgr.34109) 1314 : cluster [DBG] pgmap v1400: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:22.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:22 smithi031 bash[22603]: cluster 2020-06-27T05:23:21.081073+0000 mgr.x (mgr.34109) 1314 : cluster [DBG] pgmap v1400: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:24.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:24 smithi051 bash[18409]: cluster 2020-06-27T05:23:23.082733+0000 mgr.x (mgr.34109) 1315 : cluster [DBG] pgmap v1401: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:24.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:24 smithi031 bash[22603]: cluster 2020-06-27T05:23:23.082733+0000 mgr.x (mgr.34109) 1315 : cluster [DBG] pgmap v1401: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:24.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:24 smithi031 bash[18426]: cluster 2020-06-27T05:23:23.082733+0000 mgr.x (mgr.34109) 1315 : cluster [DBG] pgmap v1401: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:26.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:25 smithi051 bash[18409]: cluster 2020-06-27T05:23:25.084271+0000 mgr.x (mgr.34109) 1316 : cluster [DBG] pgmap v1402: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:25 smithi031 bash[18426]: cluster 2020-06-27T05:23:25.084271+0000 mgr.x (mgr.34109) 1316 : cluster [DBG] pgmap v1402: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:25 smithi031 bash[22603]: cluster 2020-06-27T05:23:25.084271+0000 mgr.x (mgr.34109) 1316 : cluster [DBG] pgmap v1402: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:28.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:28 smithi051 bash[18409]: cluster 2020-06-27T05:23:27.085995+0000 mgr.x (mgr.34109) 1317 : cluster [DBG] pgmap v1403: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:28.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:28 smithi031 bash[22603]: cluster 2020-06-27T05:23:27.085995+0000 mgr.x (mgr.34109) 1317 : cluster [DBG] pgmap v1403: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:28.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:28 smithi031 bash[18426]: cluster 2020-06-27T05:23:27.085995+0000 mgr.x (mgr.34109) 1317 : cluster [DBG] pgmap v1403: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:30.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:30 smithi051 bash[18409]: cluster 2020-06-27T05:23:29.087539+0000 mgr.x (mgr.34109) 1318 : cluster [DBG] pgmap v1404: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:30.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:30 smithi031 bash[22603]: cluster 2020-06-27T05:23:29.087539+0000 mgr.x (mgr.34109) 1318 : cluster [DBG] pgmap v1404: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:30.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:30 smithi031 bash[18426]: cluster 2020-06-27T05:23:29.087539+0000 mgr.x (mgr.34109) 1318 : cluster [DBG] pgmap v1404: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:32.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:32 smithi031 bash[18426]: cluster 2020-06-27T05:23:31.089087+0000 mgr.x (mgr.34109) 1319 : cluster [DBG] pgmap v1405: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:32.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:32 smithi031 bash[22603]: cluster 2020-06-27T05:23:31.089087+0000 mgr.x (mgr.34109) 1319 : cluster [DBG] pgmap v1405: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:32.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:32 smithi051 bash[18409]: cluster 2020-06-27T05:23:31.089087+0000 mgr.x (mgr.34109) 1319 : cluster [DBG] pgmap v1405: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:34.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:34 smithi051 bash[18409]: cluster 2020-06-27T05:23:33.090646+0000 mgr.x (mgr.34109) 1320 : cluster [DBG] pgmap v1406: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:34.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:34 smithi031 bash[22603]: cluster 2020-06-27T05:23:33.090646+0000 mgr.x (mgr.34109) 1320 : cluster [DBG] pgmap v1406: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:34.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:34 smithi031 bash[18426]: cluster 2020-06-27T05:23:33.090646+0000 mgr.x (mgr.34109) 1320 : cluster [DBG] pgmap v1406: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:35 smithi051 bash[18409]: cluster 2020-06-27T05:23:35.092361+0000 mgr.x (mgr.34109) 1321 : cluster [DBG] pgmap v1407: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:36.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:35 smithi031 bash[18426]: cluster 2020-06-27T05:23:35.092361+0000 mgr.x (mgr.34109) 1321 : cluster [DBG] pgmap v1407: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:36.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:35 smithi031 bash[22603]: cluster 2020-06-27T05:23:35.092361+0000 mgr.x (mgr.34109) 1321 : cluster [DBG] pgmap v1407: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:38.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:38 smithi051 bash[18409]: cluster 2020-06-27T05:23:37.093960+0000 mgr.x (mgr.34109) 1322 : cluster [DBG] pgmap v1408: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:38.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:38 smithi031 bash[18426]: cluster 2020-06-27T05:23:37.093960+0000 mgr.x (mgr.34109) 1322 : cluster [DBG] pgmap v1408: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:38.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:38 smithi031 bash[22603]: cluster 2020-06-27T05:23:37.093960+0000 mgr.x (mgr.34109) 1322 : cluster [DBG] pgmap v1408: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:40.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:40 smithi051 bash[18409]: cluster 2020-06-27T05:23:39.095604+0000 mgr.x (mgr.34109) 1323 : cluster [DBG] pgmap v1409: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:40.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:40 smithi031 bash[18426]: cluster 2020-06-27T05:23:39.095604+0000 mgr.x (mgr.34109) 1323 : cluster [DBG] pgmap v1409: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:40.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:40 smithi031 bash[22603]: cluster 2020-06-27T05:23:39.095604+0000 mgr.x (mgr.34109) 1323 : cluster [DBG] pgmap v1409: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:42.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:42 smithi051 bash[18409]: cluster 2020-06-27T05:23:41.097210+0000 mgr.x (mgr.34109) 1324 : cluster [DBG] pgmap v1410: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:42.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:42 smithi031 bash[18426]: cluster 2020-06-27T05:23:41.097210+0000 mgr.x (mgr.34109) 1324 : cluster [DBG] pgmap v1410: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:42.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:42 smithi031 bash[22603]: cluster 2020-06-27T05:23:41.097210+0000 mgr.x (mgr.34109) 1324 : cluster [DBG] pgmap v1410: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:44.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:44 smithi051 bash[18409]: cluster 2020-06-27T05:23:43.098938+0000 mgr.x (mgr.34109) 1325 : cluster [DBG] pgmap v1411: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:44.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:44 smithi031 bash[18426]: cluster 2020-06-27T05:23:43.098938+0000 mgr.x (mgr.34109) 1325 : cluster [DBG] pgmap v1411: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:44.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:44 smithi031 bash[22603]: cluster 2020-06-27T05:23:43.098938+0000 mgr.x (mgr.34109) 1325 : cluster [DBG] pgmap v1411: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:46.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:45 smithi051 bash[18409]: cluster 2020-06-27T05:23:45.100551+0000 mgr.x (mgr.34109) 1326 : cluster [DBG] pgmap v1412: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:46.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:45 smithi031 bash[18426]: cluster 2020-06-27T05:23:45.100551+0000 mgr.x (mgr.34109) 1326 : cluster [DBG] pgmap v1412: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:46.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:45 smithi031 bash[22603]: cluster 2020-06-27T05:23:45.100551+0000 mgr.x (mgr.34109) 1326 : cluster [DBG] pgmap v1412: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:48.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:48 smithi051 bash[18409]: cluster 2020-06-27T05:23:47.102107+0000 mgr.x (mgr.34109) 1327 : cluster [DBG] pgmap v1413: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:48.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:48 smithi031 bash[18426]: cluster 2020-06-27T05:23:47.102107+0000 mgr.x (mgr.34109) 1327 : cluster [DBG] pgmap v1413: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:48.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:48 smithi031 bash[22603]: cluster 2020-06-27T05:23:47.102107+0000 mgr.x (mgr.34109) 1327 : cluster [DBG] pgmap v1413: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:50.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:50 smithi051 bash[18409]: cluster 2020-06-27T05:23:49.103666+0000 mgr.x (mgr.34109) 1328 : cluster [DBG] pgmap v1414: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:50.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:50 smithi031 bash[18426]: cluster 2020-06-27T05:23:49.103666+0000 mgr.x (mgr.34109) 1328 : cluster [DBG] pgmap v1414: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:50.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:50 smithi031 bash[22603]: cluster 2020-06-27T05:23:49.103666+0000 mgr.x (mgr.34109) 1328 : cluster [DBG] pgmap v1414: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:52.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:52 smithi051 bash[18409]: cluster 2020-06-27T05:23:51.105427+0000 mgr.x (mgr.34109) 1329 : cluster [DBG] pgmap v1415: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:52.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:52 smithi031 bash[18426]: cluster 2020-06-27T05:23:51.105427+0000 mgr.x (mgr.34109) 1329 : cluster [DBG] pgmap v1415: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:52.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:52 smithi031 bash[22603]: cluster 2020-06-27T05:23:51.105427+0000 mgr.x (mgr.34109) 1329 : cluster [DBG] pgmap v1415: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:54.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:54 smithi051 bash[18409]: cluster 2020-06-27T05:23:53.107057+0000 mgr.x (mgr.34109) 1330 : cluster [DBG] pgmap v1416: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:54.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:54 smithi031 bash[18426]: cluster 2020-06-27T05:23:53.107057+0000 mgr.x (mgr.34109) 1330 : cluster [DBG] pgmap v1416: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:54.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:54 smithi031 bash[22603]: cluster 2020-06-27T05:23:53.107057+0000 mgr.x (mgr.34109) 1330 : cluster [DBG] pgmap v1416: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:55 smithi051 bash[18409]: cluster 2020-06-27T05:23:55.108667+0000 mgr.x (mgr.34109) 1331 : cluster [DBG] pgmap v1417: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:55 smithi031 bash[18426]: cluster 2020-06-27T05:23:55.108667+0000 mgr.x (mgr.34109) 1331 : cluster [DBG] pgmap v1417: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:56.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:55 smithi031 bash[22603]: cluster 2020-06-27T05:23:55.108667+0000 mgr.x (mgr.34109) 1331 : cluster [DBG] pgmap v1417: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:58.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:23:58 smithi051 bash[18409]: cluster 2020-06-27T05:23:57.110263+0000 mgr.x (mgr.34109) 1332 : cluster [DBG] pgmap v1418: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:58.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:23:58 smithi031 bash[18426]: cluster 2020-06-27T05:23:57.110263+0000 mgr.x (mgr.34109) 1332 : cluster [DBG] pgmap v1418: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:23:58.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:23:58 smithi031 bash[22603]: cluster 2020-06-27T05:23:57.110263+0000 mgr.x (mgr.34109) 1332 : cluster [DBG] pgmap v1418: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:00 smithi051 bash[18409]: cluster 2020-06-27T05:23:59.111858+0000 mgr.x (mgr.34109) 1333 : cluster [DBG] pgmap v1419: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:00.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:00 smithi031 bash[18426]: cluster 2020-06-27T05:23:59.111858+0000 mgr.x (mgr.34109) 1333 : cluster [DBG] pgmap v1419: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:00.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:00 smithi031 bash[22603]: cluster 2020-06-27T05:23:59.111858+0000 mgr.x (mgr.34109) 1333 : cluster [DBG] pgmap v1419: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:02.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:02 smithi051 bash[18409]: cluster 2020-06-27T05:24:01.113433+0000 mgr.x (mgr.34109) 1334 : cluster [DBG] pgmap v1420: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:02.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:02 smithi031 bash[18426]: cluster 2020-06-27T05:24:01.113433+0000 mgr.x (mgr.34109) 1334 : cluster [DBG] pgmap v1420: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:02.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:02 smithi031 bash[22603]: cluster 2020-06-27T05:24:01.113433+0000 mgr.x (mgr.34109) 1334 : cluster [DBG] pgmap v1420: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:04.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:04 smithi051 bash[18409]: cluster 2020-06-27T05:24:03.114925+0000 mgr.x (mgr.34109) 1335 : cluster [DBG] pgmap v1421: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:04.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:04 smithi031 bash[18426]: cluster 2020-06-27T05:24:03.114925+0000 mgr.x (mgr.34109) 1335 : cluster [DBG] pgmap v1421: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:04.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:04 smithi031 bash[22603]: cluster 2020-06-27T05:24:03.114925+0000 mgr.x (mgr.34109) 1335 : cluster [DBG] pgmap v1421: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:05 smithi051 bash[18409]: cluster 2020-06-27T05:24:05.116576+0000 mgr.x (mgr.34109) 1336 : cluster [DBG] pgmap v1422: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:06.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:05 smithi031 bash[18426]: cluster 2020-06-27T05:24:05.116576+0000 mgr.x (mgr.34109) 1336 : cluster [DBG] pgmap v1422: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:06.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:05 smithi031 bash[22603]: cluster 2020-06-27T05:24:05.116576+0000 mgr.x (mgr.34109) 1336 : cluster [DBG] pgmap v1422: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:08.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:08 smithi051 bash[18409]: cluster 2020-06-27T05:24:07.118280+0000 mgr.x (mgr.34109) 1337 : cluster [DBG] pgmap v1423: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:08.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:08 smithi031 bash[18426]: cluster 2020-06-27T05:24:07.118280+0000 mgr.x (mgr.34109) 1337 : cluster [DBG] pgmap v1423: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:08.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:08 smithi031 bash[22603]: cluster 2020-06-27T05:24:07.118280+0000 mgr.x (mgr.34109) 1337 : cluster [DBG] pgmap v1423: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:10.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:10 smithi051 bash[18409]: cluster 2020-06-27T05:24:09.119983+0000 mgr.x (mgr.34109) 1338 : cluster [DBG] pgmap v1424: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:10.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:10 smithi031 bash[18426]: cluster 2020-06-27T05:24:09.119983+0000 mgr.x (mgr.34109) 1338 : cluster [DBG] pgmap v1424: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:10.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:10 smithi031 bash[22603]: cluster 2020-06-27T05:24:09.119983+0000 mgr.x (mgr.34109) 1338 : cluster [DBG] pgmap v1424: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:12.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:12 smithi051 bash[18409]: cluster 2020-06-27T05:24:11.121572+0000 mgr.x (mgr.34109) 1339 : cluster [DBG] pgmap v1425: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:12.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:12 smithi031 bash[18426]: cluster 2020-06-27T05:24:11.121572+0000 mgr.x (mgr.34109) 1339 : cluster [DBG] pgmap v1425: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:12.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:12 smithi031 bash[22603]: cluster 2020-06-27T05:24:11.121572+0000 mgr.x (mgr.34109) 1339 : cluster [DBG] pgmap v1425: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:14.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:14 smithi051 bash[18409]: cluster 2020-06-27T05:24:13.123152+0000 mgr.x (mgr.34109) 1340 : cluster [DBG] pgmap v1426: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:14.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:14 smithi031 bash[18426]: cluster 2020-06-27T05:24:13.123152+0000 mgr.x (mgr.34109) 1340 : cluster [DBG] pgmap v1426: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:14.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:14 smithi031 bash[22603]: cluster 2020-06-27T05:24:13.123152+0000 mgr.x (mgr.34109) 1340 : cluster [DBG] pgmap v1426: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:15 smithi051 bash[18409]: cluster 2020-06-27T05:24:15.124812+0000 mgr.x (mgr.34109) 1341 : cluster [DBG] pgmap v1427: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:15 smithi031 bash[18426]: cluster 2020-06-27T05:24:15.124812+0000 mgr.x (mgr.34109) 1341 : cluster [DBG] pgmap v1427: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:16.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:15 smithi031 bash[22603]: cluster 2020-06-27T05:24:15.124812+0000 mgr.x (mgr.34109) 1341 : cluster [DBG] pgmap v1427: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:18.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:18 smithi051 bash[18409]: cluster 2020-06-27T05:24:17.126566+0000 mgr.x (mgr.34109) 1342 : cluster [DBG] pgmap v1428: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:18.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:18 smithi031 bash[18426]: cluster 2020-06-27T05:24:17.126566+0000 mgr.x (mgr.34109) 1342 : cluster [DBG] pgmap v1428: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:18.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:18 smithi031 bash[22603]: cluster 2020-06-27T05:24:17.126566+0000 mgr.x (mgr.34109) 1342 : cluster [DBG] pgmap v1428: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:20.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:20 smithi051 bash[18409]: cluster 2020-06-27T05:24:19.128244+0000 mgr.x (mgr.34109) 1343 : cluster [DBG] pgmap v1429: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:20.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:20 smithi031 bash[18426]: cluster 2020-06-27T05:24:19.128244+0000 mgr.x (mgr.34109) 1343 : cluster [DBG] pgmap v1429: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:20.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:20 smithi031 bash[22603]: cluster 2020-06-27T05:24:19.128244+0000 mgr.x (mgr.34109) 1343 : cluster [DBG] pgmap v1429: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:22.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:22 smithi051 bash[18409]: cluster 2020-06-27T05:24:21.129880+0000 mgr.x (mgr.34109) 1344 : cluster [DBG] pgmap v1430: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:22.478 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:22 smithi031 bash[18426]: cluster 2020-06-27T05:24:21.129880+0000 mgr.x (mgr.34109) 1344 : cluster [DBG] pgmap v1430: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:22.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:22 smithi031 bash[22603]: cluster 2020-06-27T05:24:21.129880+0000 mgr.x (mgr.34109) 1344 : cluster [DBG] pgmap v1430: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:24.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:24 smithi051 bash[18409]: cluster 2020-06-27T05:24:23.131599+0000 mgr.x (mgr.34109) 1345 : cluster [DBG] pgmap v1431: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:24.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:24 smithi031 bash[18426]: cluster 2020-06-27T05:24:23.131599+0000 mgr.x (mgr.34109) 1345 : cluster [DBG] pgmap v1431: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:24.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:24 smithi031 bash[22603]: cluster 2020-06-27T05:24:23.131599+0000 mgr.x (mgr.34109) 1345 : cluster [DBG] pgmap v1431: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:26.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:25 smithi051 bash[18409]: cluster 2020-06-27T05:24:25.133260+0000 mgr.x (mgr.34109) 1346 : cluster [DBG] pgmap v1432: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:25 smithi031 bash[18426]: cluster 2020-06-27T05:24:25.133260+0000 mgr.x (mgr.34109) 1346 : cluster [DBG] pgmap v1432: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:25 smithi031 bash[22603]: cluster 2020-06-27T05:24:25.133260+0000 mgr.x (mgr.34109) 1346 : cluster [DBG] pgmap v1432: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:28.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:28 smithi051 bash[18409]: cluster 2020-06-27T05:24:27.134884+0000 mgr.x (mgr.34109) 1347 : cluster [DBG] pgmap v1433: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:28.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:28 smithi031 bash[18426]: cluster 2020-06-27T05:24:27.134884+0000 mgr.x (mgr.34109) 1347 : cluster [DBG] pgmap v1433: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:28.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:28 smithi031 bash[22603]: cluster 2020-06-27T05:24:27.134884+0000 mgr.x (mgr.34109) 1347 : cluster [DBG] pgmap v1433: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:30.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:30 smithi051 bash[18409]: cluster 2020-06-27T05:24:29.136624+0000 mgr.x (mgr.34109) 1348 : cluster [DBG] pgmap v1434: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:30.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:30 smithi031 bash[18426]: cluster 2020-06-27T05:24:29.136624+0000 mgr.x (mgr.34109) 1348 : cluster [DBG] pgmap v1434: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:30.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:30 smithi031 bash[22603]: cluster 2020-06-27T05:24:29.136624+0000 mgr.x (mgr.34109) 1348 : cluster [DBG] pgmap v1434: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:32.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:32 smithi051 bash[18409]: cluster 2020-06-27T05:24:31.138369+0000 mgr.x (mgr.34109) 1349 : cluster [DBG] pgmap v1435: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:32.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:32 smithi031 bash[18426]: cluster 2020-06-27T05:24:31.138369+0000 mgr.x (mgr.34109) 1349 : cluster [DBG] pgmap v1435: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:32.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:32 smithi031 bash[22603]: cluster 2020-06-27T05:24:31.138369+0000 mgr.x (mgr.34109) 1349 : cluster [DBG] pgmap v1435: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:34.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:34 smithi031 bash[18426]: cluster 2020-06-27T05:24:33.140032+0000 mgr.x (mgr.34109) 1350 : cluster [DBG] pgmap v1436: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:34.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:34 smithi031 bash[22603]: cluster 2020-06-27T05:24:33.140032+0000 mgr.x (mgr.34109) 1350 : cluster [DBG] pgmap v1436: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:34.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:34 smithi051 bash[18409]: cluster 2020-06-27T05:24:33.140032+0000 mgr.x (mgr.34109) 1350 : cluster [DBG] pgmap v1436: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:35 smithi051 bash[18409]: cluster 2020-06-27T05:24:35.141613+0000 mgr.x (mgr.34109) 1351 : cluster [DBG] pgmap v1437: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:36.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:35 smithi031 bash[18426]: cluster 2020-06-27T05:24:35.141613+0000 mgr.x (mgr.34109) 1351 : cluster [DBG] pgmap v1437: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:36.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:35 smithi031 bash[22603]: cluster 2020-06-27T05:24:35.141613+0000 mgr.x (mgr.34109) 1351 : cluster [DBG] pgmap v1437: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:38.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:38 smithi051 bash[18409]: cluster 2020-06-27T05:24:37.143322+0000 mgr.x (mgr.34109) 1352 : cluster [DBG] pgmap v1438: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:38.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:38 smithi031 bash[18426]: cluster 2020-06-27T05:24:37.143322+0000 mgr.x (mgr.34109) 1352 : cluster [DBG] pgmap v1438: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:38.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:38 smithi031 bash[22603]: cluster 2020-06-27T05:24:37.143322+0000 mgr.x (mgr.34109) 1352 : cluster [DBG] pgmap v1438: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:40.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:40 smithi051 bash[18409]: cluster 2020-06-27T05:24:39.145005+0000 mgr.x (mgr.34109) 1353 : cluster [DBG] pgmap v1439: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:40.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:40 smithi031 bash[18426]: cluster 2020-06-27T05:24:39.145005+0000 mgr.x (mgr.34109) 1353 : cluster [DBG] pgmap v1439: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:40.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:40 smithi031 bash[22603]: cluster 2020-06-27T05:24:39.145005+0000 mgr.x (mgr.34109) 1353 : cluster [DBG] pgmap v1439: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:42.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:42 smithi051 bash[18409]: cluster 2020-06-27T05:24:41.146707+0000 mgr.x (mgr.34109) 1354 : cluster [DBG] pgmap v1440: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:42.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:42 smithi031 bash[22603]: cluster 2020-06-27T05:24:41.146707+0000 mgr.x (mgr.34109) 1354 : cluster [DBG] pgmap v1440: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:42.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:42 smithi031 bash[18426]: cluster 2020-06-27T05:24:41.146707+0000 mgr.x (mgr.34109) 1354 : cluster [DBG] pgmap v1440: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:44.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:44 smithi031 bash[18426]: cluster 2020-06-27T05:24:43.148284+0000 mgr.x (mgr.34109) 1355 : cluster [DBG] pgmap v1441: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:44.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:44 smithi031 bash[22603]: cluster 2020-06-27T05:24:43.148284+0000 mgr.x (mgr.34109) 1355 : cluster [DBG] pgmap v1441: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:44.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:44 smithi051 bash[18409]: cluster 2020-06-27T05:24:43.148284+0000 mgr.x (mgr.34109) 1355 : cluster [DBG] pgmap v1441: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:46.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:45 smithi051 bash[18409]: cluster 2020-06-27T05:24:45.149984+0000 mgr.x (mgr.34109) 1356 : cluster [DBG] pgmap v1442: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:46.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:45 smithi031 bash[18426]: cluster 2020-06-27T05:24:45.149984+0000 mgr.x (mgr.34109) 1356 : cluster [DBG] pgmap v1442: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:46.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:45 smithi031 bash[22603]: cluster 2020-06-27T05:24:45.149984+0000 mgr.x (mgr.34109) 1356 : cluster [DBG] pgmap v1442: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:48.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:48 smithi051 bash[18409]: cluster 2020-06-27T05:24:47.151596+0000 mgr.x (mgr.34109) 1357 : cluster [DBG] pgmap v1443: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:48.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:48 smithi031 bash[18426]: cluster 2020-06-27T05:24:47.151596+0000 mgr.x (mgr.34109) 1357 : cluster [DBG] pgmap v1443: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:48.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:48 smithi031 bash[22603]: cluster 2020-06-27T05:24:47.151596+0000 mgr.x (mgr.34109) 1357 : cluster [DBG] pgmap v1443: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:50.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:50 smithi031 bash[18426]: cluster 2020-06-27T05:24:49.153216+0000 mgr.x (mgr.34109) 1358 : cluster [DBG] pgmap v1444: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:50.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:50 smithi031 bash[22603]: cluster 2020-06-27T05:24:49.153216+0000 mgr.x (mgr.34109) 1358 : cluster [DBG] pgmap v1444: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:50.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:50 smithi051 bash[18409]: cluster 2020-06-27T05:24:49.153216+0000 mgr.x (mgr.34109) 1358 : cluster [DBG] pgmap v1444: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:52.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:52 smithi051 bash[18409]: cluster 2020-06-27T05:24:51.154929+0000 mgr.x (mgr.34109) 1359 : cluster [DBG] pgmap v1445: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:52.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:52 smithi031 bash[18426]: cluster 2020-06-27T05:24:51.154929+0000 mgr.x (mgr.34109) 1359 : cluster [DBG] pgmap v1445: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:52.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:52 smithi031 bash[22603]: cluster 2020-06-27T05:24:51.154929+0000 mgr.x (mgr.34109) 1359 : cluster [DBG] pgmap v1445: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:54.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:54 smithi051 bash[18409]: cluster 2020-06-27T05:24:53.156590+0000 mgr.x (mgr.34109) 1360 : cluster [DBG] pgmap v1446: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:54.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:54 smithi031 bash[18426]: cluster 2020-06-27T05:24:53.156590+0000 mgr.x (mgr.34109) 1360 : cluster [DBG] pgmap v1446: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:54.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:54 smithi031 bash[22603]: cluster 2020-06-27T05:24:53.156590+0000 mgr.x (mgr.34109) 1360 : cluster [DBG] pgmap v1446: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:55 smithi051 bash[18409]: cluster 2020-06-27T05:24:55.158083+0000 mgr.x (mgr.34109) 1361 : cluster [DBG] pgmap v1447: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:55 smithi031 bash[18426]: cluster 2020-06-27T05:24:55.158083+0000 mgr.x (mgr.34109) 1361 : cluster [DBG] pgmap v1447: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:56.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:55 smithi031 bash[22603]: cluster 2020-06-27T05:24:55.158083+0000 mgr.x (mgr.34109) 1361 : cluster [DBG] pgmap v1447: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:58.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:24:58 smithi031 bash[18426]: cluster 2020-06-27T05:24:57.159764+0000 mgr.x (mgr.34109) 1362 : cluster [DBG] pgmap v1448: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:58.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:24:58 smithi031 bash[22603]: cluster 2020-06-27T05:24:57.159764+0000 mgr.x (mgr.34109) 1362 : cluster [DBG] pgmap v1448: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:24:58.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:24:58 smithi051 bash[18409]: cluster 2020-06-27T05:24:57.159764+0000 mgr.x (mgr.34109) 1362 : cluster [DBG] pgmap v1448: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:00.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:00 smithi051 bash[18409]: cluster 2020-06-27T05:24:59.161476+0000 mgr.x (mgr.34109) 1363 : cluster [DBG] pgmap v1449: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:00.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:00 smithi031 bash[18426]: cluster 2020-06-27T05:24:59.161476+0000 mgr.x (mgr.34109) 1363 : cluster [DBG] pgmap v1449: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:00.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:00 smithi031 bash[22603]: cluster 2020-06-27T05:24:59.161476+0000 mgr.x (mgr.34109) 1363 : cluster [DBG] pgmap v1449: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:02.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:02 smithi051 bash[18409]: cluster 2020-06-27T05:25:01.163247+0000 mgr.x (mgr.34109) 1364 : cluster [DBG] pgmap v1450: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:02.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:02 smithi031 bash[18426]: cluster 2020-06-27T05:25:01.163247+0000 mgr.x (mgr.34109) 1364 : cluster [DBG] pgmap v1450: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:02.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:02 smithi031 bash[22603]: cluster 2020-06-27T05:25:01.163247+0000 mgr.x (mgr.34109) 1364 : cluster [DBG] pgmap v1450: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:04.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:04 smithi051 bash[18409]: cluster 2020-06-27T05:25:03.164820+0000 mgr.x (mgr.34109) 1365 : cluster [DBG] pgmap v1451: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:04.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:04 smithi031 bash[18426]: cluster 2020-06-27T05:25:03.164820+0000 mgr.x (mgr.34109) 1365 : cluster [DBG] pgmap v1451: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:04.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:04 smithi031 bash[22603]: cluster 2020-06-27T05:25:03.164820+0000 mgr.x (mgr.34109) 1365 : cluster [DBG] pgmap v1451: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:05 smithi051 bash[18409]: cluster 2020-06-27T05:25:05.166537+0000 mgr.x (mgr.34109) 1366 : cluster [DBG] pgmap v1452: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:06.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:05 smithi031 bash[18426]: cluster 2020-06-27T05:25:05.166537+0000 mgr.x (mgr.34109) 1366 : cluster [DBG] pgmap v1452: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:06.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:05 smithi031 bash[22603]: cluster 2020-06-27T05:25:05.166537+0000 mgr.x (mgr.34109) 1366 : cluster [DBG] pgmap v1452: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:08.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:08 smithi051 bash[18409]: cluster 2020-06-27T05:25:07.168222+0000 mgr.x (mgr.34109) 1367 : cluster [DBG] pgmap v1453: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:08.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:08 smithi031 bash[18426]: cluster 2020-06-27T05:25:07.168222+0000 mgr.x (mgr.34109) 1367 : cluster [DBG] pgmap v1453: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:08.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:08 smithi031 bash[22603]: cluster 2020-06-27T05:25:07.168222+0000 mgr.x (mgr.34109) 1367 : cluster [DBG] pgmap v1453: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:10.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:10 smithi051 bash[18409]: cluster 2020-06-27T05:25:09.169974+0000 mgr.x (mgr.34109) 1368 : cluster [DBG] pgmap v1454: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:10.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:10 smithi031 bash[18426]: cluster 2020-06-27T05:25:09.169974+0000 mgr.x (mgr.34109) 1368 : cluster [DBG] pgmap v1454: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:10.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:10 smithi031 bash[22603]: cluster 2020-06-27T05:25:09.169974+0000 mgr.x (mgr.34109) 1368 : cluster [DBG] pgmap v1454: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:12.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:12 smithi051 bash[18409]: cluster 2020-06-27T05:25:11.171545+0000 mgr.x (mgr.34109) 1369 : cluster [DBG] pgmap v1455: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:12.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:12 smithi031 bash[18426]: cluster 2020-06-27T05:25:11.171545+0000 mgr.x (mgr.34109) 1369 : cluster [DBG] pgmap v1455: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:12.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:12 smithi031 bash[22603]: cluster 2020-06-27T05:25:11.171545+0000 mgr.x (mgr.34109) 1369 : cluster [DBG] pgmap v1455: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:14.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:14 smithi051 bash[18409]: cluster 2020-06-27T05:25:13.173258+0000 mgr.x (mgr.34109) 1370 : cluster [DBG] pgmap v1456: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:14.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:14 smithi031 bash[18426]: cluster 2020-06-27T05:25:13.173258+0000 mgr.x (mgr.34109) 1370 : cluster [DBG] pgmap v1456: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:14.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:14 smithi031 bash[22603]: cluster 2020-06-27T05:25:13.173258+0000 mgr.x (mgr.34109) 1370 : cluster [DBG] pgmap v1456: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:15 smithi051 bash[18409]: cluster 2020-06-27T05:25:15.175317+0000 mgr.x (mgr.34109) 1371 : cluster [DBG] pgmap v1457: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:15 smithi031 bash[18426]: cluster 2020-06-27T05:25:15.175317+0000 mgr.x (mgr.34109) 1371 : cluster [DBG] pgmap v1457: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:16.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:15 smithi031 bash[22603]: cluster 2020-06-27T05:25:15.175317+0000 mgr.x (mgr.34109) 1371 : cluster [DBG] pgmap v1457: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:18.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:18 smithi051 bash[18409]: cluster 2020-06-27T05:25:17.176864+0000 mgr.x (mgr.34109) 1372 : cluster [DBG] pgmap v1458: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:18.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:18 smithi031 bash[18426]: cluster 2020-06-27T05:25:17.176864+0000 mgr.x (mgr.34109) 1372 : cluster [DBG] pgmap v1458: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:18.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:18 smithi031 bash[22603]: cluster 2020-06-27T05:25:17.176864+0000 mgr.x (mgr.34109) 1372 : cluster [DBG] pgmap v1458: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:20.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:20 smithi051 bash[18409]: cluster 2020-06-27T05:25:19.178475+0000 mgr.x (mgr.34109) 1373 : cluster [DBG] pgmap v1459: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:20.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:20 smithi031 bash[18426]: cluster 2020-06-27T05:25:19.178475+0000 mgr.x (mgr.34109) 1373 : cluster [DBG] pgmap v1459: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:20.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:20 smithi031 bash[22603]: cluster 2020-06-27T05:25:19.178475+0000 mgr.x (mgr.34109) 1373 : cluster [DBG] pgmap v1459: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:22.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:22 smithi051 bash[18409]: cluster 2020-06-27T05:25:21.180081+0000 mgr.x (mgr.34109) 1374 : cluster [DBG] pgmap v1460: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:22.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:22 smithi031 bash[18426]: cluster 2020-06-27T05:25:21.180081+0000 mgr.x (mgr.34109) 1374 : cluster [DBG] pgmap v1460: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:22.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:22 smithi031 bash[22603]: cluster 2020-06-27T05:25:21.180081+0000 mgr.x (mgr.34109) 1374 : cluster [DBG] pgmap v1460: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:24.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:24 smithi051 bash[18409]: cluster 2020-06-27T05:25:23.181930+0000 mgr.x (mgr.34109) 1375 : cluster [DBG] pgmap v1461: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:24.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:24 smithi031 bash[18426]: cluster 2020-06-27T05:25:23.181930+0000 mgr.x (mgr.34109) 1375 : cluster [DBG] pgmap v1461: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:24.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:24 smithi031 bash[22603]: cluster 2020-06-27T05:25:23.181930+0000 mgr.x (mgr.34109) 1375 : cluster [DBG] pgmap v1461: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:26.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:25 smithi051 bash[18409]: cluster 2020-06-27T05:25:25.183500+0000 mgr.x (mgr.34109) 1376 : cluster [DBG] pgmap v1462: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:25 smithi031 bash[18426]: cluster 2020-06-27T05:25:25.183500+0000 mgr.x (mgr.34109) 1376 : cluster [DBG] pgmap v1462: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:25 smithi031 bash[22603]: cluster 2020-06-27T05:25:25.183500+0000 mgr.x (mgr.34109) 1376 : cluster [DBG] pgmap v1462: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:28.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:28 smithi051 bash[18409]: cluster 2020-06-27T05:25:27.185152+0000 mgr.x (mgr.34109) 1377 : cluster [DBG] pgmap v1463: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:28.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:28 smithi031 bash[18426]: cluster 2020-06-27T05:25:27.185152+0000 mgr.x (mgr.34109) 1377 : cluster [DBG] pgmap v1463: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:28.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:28 smithi031 bash[22603]: cluster 2020-06-27T05:25:27.185152+0000 mgr.x (mgr.34109) 1377 : cluster [DBG] pgmap v1463: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:30.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:30 smithi051 bash[18409]: cluster 2020-06-27T05:25:29.186881+0000 mgr.x (mgr.34109) 1378 : cluster [DBG] pgmap v1464: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:30.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:30 smithi031 bash[18426]: cluster 2020-06-27T05:25:29.186881+0000 mgr.x (mgr.34109) 1378 : cluster [DBG] pgmap v1464: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:30.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:30 smithi031 bash[22603]: cluster 2020-06-27T05:25:29.186881+0000 mgr.x (mgr.34109) 1378 : cluster [DBG] pgmap v1464: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:32.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:32 smithi051 bash[18409]: cluster 2020-06-27T05:25:31.188472+0000 mgr.x (mgr.34109) 1379 : cluster [DBG] pgmap v1465: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:32.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:32 smithi031 bash[18426]: cluster 2020-06-27T05:25:31.188472+0000 mgr.x (mgr.34109) 1379 : cluster [DBG] pgmap v1465: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:32.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:32 smithi031 bash[22603]: cluster 2020-06-27T05:25:31.188472+0000 mgr.x (mgr.34109) 1379 : cluster [DBG] pgmap v1465: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:34.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:34 smithi051 bash[18409]: cluster 2020-06-27T05:25:33.190057+0000 mgr.x (mgr.34109) 1380 : cluster [DBG] pgmap v1466: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:34.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:34 smithi031 bash[18426]: cluster 2020-06-27T05:25:33.190057+0000 mgr.x (mgr.34109) 1380 : cluster [DBG] pgmap v1466: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:34.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:34 smithi031 bash[22603]: cluster 2020-06-27T05:25:33.190057+0000 mgr.x (mgr.34109) 1380 : cluster [DBG] pgmap v1466: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:35 smithi051 bash[18409]: cluster 2020-06-27T05:25:35.191633+0000 mgr.x (mgr.34109) 1381 : cluster [DBG] pgmap v1467: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:36.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:35 smithi031 bash[18426]: cluster 2020-06-27T05:25:35.191633+0000 mgr.x (mgr.34109) 1381 : cluster [DBG] pgmap v1467: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:36.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:35 smithi031 bash[22603]: cluster 2020-06-27T05:25:35.191633+0000 mgr.x (mgr.34109) 1381 : cluster [DBG] pgmap v1467: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:38.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:38 smithi051 bash[18409]: cluster 2020-06-27T05:25:37.193259+0000 mgr.x (mgr.34109) 1382 : cluster [DBG] pgmap v1468: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:38.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:38 smithi031 bash[18426]: cluster 2020-06-27T05:25:37.193259+0000 mgr.x (mgr.34109) 1382 : cluster [DBG] pgmap v1468: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:38.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:38 smithi031 bash[22603]: cluster 2020-06-27T05:25:37.193259+0000 mgr.x (mgr.34109) 1382 : cluster [DBG] pgmap v1468: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:40.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:40 smithi051 bash[18409]: cluster 2020-06-27T05:25:39.194871+0000 mgr.x (mgr.34109) 1383 : cluster [DBG] pgmap v1469: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:40.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:40 smithi031 bash[18426]: cluster 2020-06-27T05:25:39.194871+0000 mgr.x (mgr.34109) 1383 : cluster [DBG] pgmap v1469: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:40.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:40 smithi031 bash[22603]: cluster 2020-06-27T05:25:39.194871+0000 mgr.x (mgr.34109) 1383 : cluster [DBG] pgmap v1469: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:42.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:42 smithi051 bash[18409]: cluster 2020-06-27T05:25:41.196579+0000 mgr.x (mgr.34109) 1384 : cluster [DBG] pgmap v1470: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:42.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:42 smithi031 bash[18426]: cluster 2020-06-27T05:25:41.196579+0000 mgr.x (mgr.34109) 1384 : cluster [DBG] pgmap v1470: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:42.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:42 smithi031 bash[22603]: cluster 2020-06-27T05:25:41.196579+0000 mgr.x (mgr.34109) 1384 : cluster [DBG] pgmap v1470: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:44.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:44 smithi051 bash[18409]: cluster 2020-06-27T05:25:43.198208+0000 mgr.x (mgr.34109) 1385 : cluster [DBG] pgmap v1471: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:44.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:44 smithi031 bash[18426]: cluster 2020-06-27T05:25:43.198208+0000 mgr.x (mgr.34109) 1385 : cluster [DBG] pgmap v1471: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:44.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:44 smithi031 bash[22603]: cluster 2020-06-27T05:25:43.198208+0000 mgr.x (mgr.34109) 1385 : cluster [DBG] pgmap v1471: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:46.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:45 smithi051 bash[18409]: cluster 2020-06-27T05:25:45.199853+0000 mgr.x (mgr.34109) 1386 : cluster [DBG] pgmap v1472: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:46.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:45 smithi031 bash[18426]: cluster 2020-06-27T05:25:45.199853+0000 mgr.x (mgr.34109) 1386 : cluster [DBG] pgmap v1472: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:46.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:45 smithi031 bash[22603]: cluster 2020-06-27T05:25:45.199853+0000 mgr.x (mgr.34109) 1386 : cluster [DBG] pgmap v1472: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:48.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:48 smithi051 bash[18409]: cluster 2020-06-27T05:25:47.201578+0000 mgr.x (mgr.34109) 1387 : cluster [DBG] pgmap v1473: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:48.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:48 smithi031 bash[18426]: cluster 2020-06-27T05:25:47.201578+0000 mgr.x (mgr.34109) 1387 : cluster [DBG] pgmap v1473: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:48.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:48 smithi031 bash[22603]: cluster 2020-06-27T05:25:47.201578+0000 mgr.x (mgr.34109) 1387 : cluster [DBG] pgmap v1473: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:50.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:50 smithi051 bash[18409]: cluster 2020-06-27T05:25:49.203324+0000 mgr.x (mgr.34109) 1388 : cluster [DBG] pgmap v1474: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:50.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:50 smithi031 bash[18426]: cluster 2020-06-27T05:25:49.203324+0000 mgr.x (mgr.34109) 1388 : cluster [DBG] pgmap v1474: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:50.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:50 smithi031 bash[22603]: cluster 2020-06-27T05:25:49.203324+0000 mgr.x (mgr.34109) 1388 : cluster [DBG] pgmap v1474: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:52.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:52 smithi051 bash[18409]: cluster 2020-06-27T05:25:51.204983+0000 mgr.x (mgr.34109) 1389 : cluster [DBG] pgmap v1475: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:52.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:52 smithi031 bash[18426]: cluster 2020-06-27T05:25:51.204983+0000 mgr.x (mgr.34109) 1389 : cluster [DBG] pgmap v1475: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:52.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:52 smithi031 bash[22603]: cluster 2020-06-27T05:25:51.204983+0000 mgr.x (mgr.34109) 1389 : cluster [DBG] pgmap v1475: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:53.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:53 smithi051 bash[18409]: cluster 2020-06-27T05:25:53.206765+0000 mgr.x (mgr.34109) 1390 : cluster [DBG] pgmap v1476: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:53.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:53 smithi031 bash[18426]: cluster 2020-06-27T05:25:53.206765+0000 mgr.x (mgr.34109) 1390 : cluster [DBG] pgmap v1476: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:53.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:53 smithi031 bash[22603]: cluster 2020-06-27T05:25:53.206765+0000 mgr.x (mgr.34109) 1390 : cluster [DBG] pgmap v1476: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:54.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:54 smithi051 bash[18409]: audit 2020-06-27T05:25:53.633885+0000 mon.b (mon.2) 380 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:25:53.633094\"}"}]: dispatch 2020-06-27T05:25:54.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:54 smithi051 bash[18409]: audit 2020-06-27T05:25:53.634414+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:25:53.633094\"}"}]: dispatch 2020-06-27T05:25:54.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:54 smithi051 bash[18409]: audit 2020-06-27T05:25:53.637655+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:25:53.633094\"}"}]': finished 2020-06-27T05:25:54.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:54 smithi051 bash[18409]: audit 2020-06-27T05:25:53.637936+0000 mon.b (mon.2) 381 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:25:53.636161\"}"}]: dispatch 2020-06-27T05:25:54.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:54 smithi051 bash[18409]: audit 2020-06-27T05:25:53.638343+0000 mon.a (mon.0) 1461 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:25:53.636161\"}"}]: dispatch 2020-06-27T05:25:54.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:54 smithi051 bash[18409]: audit 2020-06-27T05:25:53.638491+0000 mon.b (mon.2) 382 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:25:54.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:54 smithi051 bash[18409]: audit 2020-06-27T05:25:53.640951+0000 mon.a (mon.0) 1462 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:25:53.636161\"}"}]': finished 2020-06-27T05:25:54.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:54 smithi051 bash[18409]: audit 2020-06-27T05:25:53.643412+0000 mon.b (mon.2) 383 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:25:54.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:54 smithi031 bash[18426]: audit 2020-06-27T05:25:53.633885+0000 mon.b (mon.2) 380 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:25:53.633094\"}"}]: dispatch 2020-06-27T05:25:54.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:54 smithi031 bash[18426]: audit 2020-06-27T05:25:53.634414+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:25:53.633094\"}"}]: dispatch 2020-06-27T05:25:54.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:54 smithi031 bash[18426]: audit 2020-06-27T05:25:53.637655+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:25:53.633094\"}"}]': finished 2020-06-27T05:25:54.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:54 smithi031 bash[18426]: audit 2020-06-27T05:25:53.637936+0000 mon.b (mon.2) 381 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:25:53.636161\"}"}]: dispatch 2020-06-27T05:25:54.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:54 smithi031 bash[18426]: audit 2020-06-27T05:25:53.638343+0000 mon.a (mon.0) 1461 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:25:53.636161\"}"}]: dispatch 2020-06-27T05:25:54.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:54 smithi031 bash[18426]: audit 2020-06-27T05:25:53.638491+0000 mon.b (mon.2) 382 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:25:54.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:54 smithi031 bash[18426]: audit 2020-06-27T05:25:53.640951+0000 mon.a (mon.0) 1462 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:25:53.636161\"}"}]': finished 2020-06-27T05:25:54.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:54 smithi031 bash[18426]: audit 2020-06-27T05:25:53.643412+0000 mon.b (mon.2) 383 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:25:54.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:54 smithi031 bash[22603]: audit 2020-06-27T05:25:53.633885+0000 mon.b (mon.2) 380 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:25:53.633094\"}"}]: dispatch 2020-06-27T05:25:54.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:54 smithi031 bash[22603]: audit 2020-06-27T05:25:53.634414+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:25:53.633094\"}"}]: dispatch 2020-06-27T05:25:54.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:54 smithi031 bash[22603]: audit 2020-06-27T05:25:53.637655+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217788\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.217865\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.217900\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218079\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218178\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:50.218274\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218370\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218406\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:50.218449\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:15:50.218530\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:25:53.633094\"}"}]': finished 2020-06-27T05:25:54.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:54 smithi031 bash[22603]: audit 2020-06-27T05:25:53.637936+0000 mon.b (mon.2) 381 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:25:53.636161\"}"}]: dispatch 2020-06-27T05:25:54.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:54 smithi031 bash[22603]: audit 2020-06-27T05:25:53.638343+0000 mon.a (mon.0) 1461 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:25:53.636161\"}"}]: dispatch 2020-06-27T05:25:54.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:54 smithi031 bash[22603]: audit 2020-06-27T05:25:53.638491+0000 mon.b (mon.2) 382 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:25:54.480 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:54 smithi031 bash[22603]: audit 2020-06-27T05:25:53.640951+0000 mon.a (mon.0) 1462 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751550\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.751626\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751660\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751833\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.751931\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:15:49.752025\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752120\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752156\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:15:49.752186\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:15:49.752265\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:25:53.636161\"}"}]': finished 2020-06-27T05:25:54.480 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:54 smithi031 bash[22603]: audit 2020-06-27T05:25:53.643412+0000 mon.b (mon.2) 383 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:25:56.223 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:55 smithi051 bash[18409]: cluster 2020-06-27T05:25:55.208087+0000 mgr.x (mgr.34109) 1391 : cluster [DBG] pgmap v1477: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:56.224 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:55 smithi051 bash[18409]: audit 2020-06-27T05:25:55.544913+0000 mon.b (mon.2) 384 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542816\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.542852\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543112\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543290\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543463\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543628\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543685\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543746\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.543876\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:25:53.636161\"}"}]: dispatch 2020-06-27T05:25:56.224 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:55 smithi051 bash[18409]: audit 2020-06-27T05:25:55.545696+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542816\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.542852\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543112\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543290\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543463\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543628\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543685\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543746\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.543876\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:25:53.636161\"}"}]: dispatch 2020-06-27T05:25:56.225 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:55 smithi051 bash[18409]: audit 2020-06-27T05:25:55.548310+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542816\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.542852\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543112\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543290\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543463\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543628\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543685\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543746\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.543876\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:25:53.636161\"}"}]': finished 2020-06-27T05:25:56.225 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:55 smithi051 bash[18409]: audit 2020-06-27T05:25:55.873118+0000 mon.b (mon.2) 385 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871648\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871724\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871758\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871937\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872036\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872132\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872227\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872264\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872294\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.872372\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:25:53.633094\"}"}]: dispatch 2020-06-27T05:25:56.225 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:55 smithi051 bash[18409]: audit 2020-06-27T05:25:55.873599+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871648\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871724\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871758\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871937\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872036\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872132\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872227\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872264\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872294\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.872372\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:25:53.633094\"}"}]: dispatch 2020-06-27T05:25:56.226 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:55 smithi051 bash[18409]: audit 2020-06-27T05:25:55.876249+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871648\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871724\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871758\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871937\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872036\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872132\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872227\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872264\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872294\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.872372\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:25:53.633094\"}"}]': finished 2020-06-27T05:25:56.226 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:55 smithi051 bash[18409]: audit 2020-06-27T05:25:55.879082+0000 mon.b (mon.2) 386 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:25:56.226 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:55 smithi051 bash[18409]: audit 2020-06-27T05:25:55.880065+0000 mon.b (mon.2) 387 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:25:56.226 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:55 smithi051 bash[18409]: audit 2020-06-27T05:25:55.880909+0000 mon.b (mon.2) 388 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:25:56.229 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[18426]: cluster 2020-06-27T05:25:55.208087+0000 mgr.x (mgr.34109) 1391 : cluster [DBG] pgmap v1477: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:56.229 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[18426]: audit 2020-06-27T05:25:55.544913+0000 mon.b (mon.2) 384 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542816\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.542852\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543112\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543290\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543463\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543628\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543685\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543746\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.543876\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:25:53.636161\"}"}]: dispatch 2020-06-27T05:25:56.229 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[18426]: audit 2020-06-27T05:25:55.545696+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542816\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.542852\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543112\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543290\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543463\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543628\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543685\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543746\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.543876\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:25:53.636161\"}"}]: dispatch 2020-06-27T05:25:56.230 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[18426]: audit 2020-06-27T05:25:55.548310+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542816\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.542852\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543112\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543290\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543463\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543628\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543685\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543746\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.543876\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:25:53.636161\"}"}]': finished 2020-06-27T05:25:56.230 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[18426]: audit 2020-06-27T05:25:55.873118+0000 mon.b (mon.2) 385 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871648\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871724\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871758\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871937\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872036\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872132\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872227\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872264\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872294\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.872372\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:25:53.633094\"}"}]: dispatch 2020-06-27T05:25:56.230 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[18426]: audit 2020-06-27T05:25:55.873599+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871648\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871724\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871758\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871937\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872036\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872132\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872227\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872264\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872294\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.872372\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:25:53.633094\"}"}]: dispatch 2020-06-27T05:25:56.230 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[18426]: audit 2020-06-27T05:25:55.876249+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871648\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871724\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871758\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871937\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872036\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872132\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872227\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872264\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872294\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.872372\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:25:53.633094\"}"}]': finished 2020-06-27T05:25:56.231 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[18426]: audit 2020-06-27T05:25:55.879082+0000 mon.b (mon.2) 386 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:25:56.231 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[18426]: audit 2020-06-27T05:25:55.880065+0000 mon.b (mon.2) 387 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:25:56.231 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[18426]: audit 2020-06-27T05:25:55.880909+0000 mon.b (mon.2) 388 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:25:56.231 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[22603]: cluster 2020-06-27T05:25:55.208087+0000 mgr.x (mgr.34109) 1391 : cluster [DBG] pgmap v1477: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:56.232 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[22603]: audit 2020-06-27T05:25:55.544913+0000 mon.b (mon.2) 384 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542816\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.542852\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543112\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543290\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543463\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543628\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543685\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543746\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.543876\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:25:53.636161\"}"}]: dispatch 2020-06-27T05:25:56.232 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[22603]: audit 2020-06-27T05:25:55.545696+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542816\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.542852\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543112\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543290\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543463\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543628\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543685\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543746\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.543876\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:25:53.636161\"}"}]: dispatch 2020-06-27T05:25:56.232 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[22603]: audit 2020-06-27T05:25:55.548310+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542816\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.542852\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543112\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543290\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543463\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543628\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543685\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543746\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.543876\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:25:53.636161\"}"}]': finished 2020-06-27T05:25:56.233 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[22603]: audit 2020-06-27T05:25:55.873118+0000 mon.b (mon.2) 385 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871648\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871724\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871758\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871937\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872036\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872132\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872227\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872264\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872294\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.872372\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:25:53.633094\"}"}]: dispatch 2020-06-27T05:25:56.233 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[22603]: audit 2020-06-27T05:25:55.873599+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871648\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871724\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871758\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871937\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872036\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872132\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872227\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872264\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872294\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.872372\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:25:53.633094\"}"}]: dispatch 2020-06-27T05:25:56.233 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[22603]: audit 2020-06-27T05:25:55.876249+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871648\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871724\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871758\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871937\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872036\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872132\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872227\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872264\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872294\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.872372\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:25:53.633094\"}"}]': finished 2020-06-27T05:25:56.234 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[22603]: audit 2020-06-27T05:25:55.879082+0000 mon.b (mon.2) 386 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:25:56.234 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[22603]: audit 2020-06-27T05:25:55.880065+0000 mon.b (mon.2) 387 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:25:56.234 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:55 smithi031 bash[22603]: audit 2020-06-27T05:25:55.880909+0000 mon.b (mon.2) 388 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:25:57.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:56 smithi051 bash[18409]: audit 2020-06-27T05:25:55.879368+0000 mgr.x (mgr.34109) 1392 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:25:57.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:56 smithi051 bash[18409]: audit 2020-06-27T05:25:55.880295+0000 mgr.x (mgr.34109) 1393 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:25:57.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:56 smithi051 bash[18409]: audit 2020-06-27T05:25:55.881118+0000 mgr.x (mgr.34109) 1394 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:25:57.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:56 smithi031 bash[18426]: audit 2020-06-27T05:25:55.879368+0000 mgr.x (mgr.34109) 1392 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:25:57.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:56 smithi031 bash[18426]: audit 2020-06-27T05:25:55.880295+0000 mgr.x (mgr.34109) 1393 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:25:57.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:56 smithi031 bash[18426]: audit 2020-06-27T05:25:55.881118+0000 mgr.x (mgr.34109) 1394 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:25:57.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:56 smithi031 bash[22603]: audit 2020-06-27T05:25:55.879368+0000 mgr.x (mgr.34109) 1392 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:25:57.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:56 smithi031 bash[22603]: audit 2020-06-27T05:25:55.880295+0000 mgr.x (mgr.34109) 1393 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:25:57.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:56 smithi031 bash[22603]: audit 2020-06-27T05:25:55.881118+0000 mgr.x (mgr.34109) 1394 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:25:58.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:25:57 smithi051 bash[18409]: cluster 2020-06-27T05:25:57.209670+0000 mgr.x (mgr.34109) 1395 : cluster [DBG] pgmap v1478: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:58.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:25:57 smithi031 bash[18426]: cluster 2020-06-27T05:25:57.209670+0000 mgr.x (mgr.34109) 1395 : cluster [DBG] pgmap v1478: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:25:58.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:25:57 smithi031 bash[22603]: cluster 2020-06-27T05:25:57.209670+0000 mgr.x (mgr.34109) 1395 : cluster [DBG] pgmap v1478: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:00.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:00 smithi051 bash[18409]: cluster 2020-06-27T05:25:59.211267+0000 mgr.x (mgr.34109) 1396 : cluster [DBG] pgmap v1479: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:00.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:00 smithi031 bash[18426]: cluster 2020-06-27T05:25:59.211267+0000 mgr.x (mgr.34109) 1396 : cluster [DBG] pgmap v1479: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:00.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:00 smithi031 bash[22603]: cluster 2020-06-27T05:25:59.211267+0000 mgr.x (mgr.34109) 1396 : cluster [DBG] pgmap v1479: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:02.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:02 smithi051 bash[18409]: cluster 2020-06-27T05:26:01.212832+0000 mgr.x (mgr.34109) 1397 : cluster [DBG] pgmap v1480: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:02.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:02 smithi031 bash[18426]: cluster 2020-06-27T05:26:01.212832+0000 mgr.x (mgr.34109) 1397 : cluster [DBG] pgmap v1480: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:02.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:02 smithi031 bash[22603]: cluster 2020-06-27T05:26:01.212832+0000 mgr.x (mgr.34109) 1397 : cluster [DBG] pgmap v1480: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:04.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:04 smithi051 bash[18409]: cluster 2020-06-27T05:26:03.214545+0000 mgr.x (mgr.34109) 1398 : cluster [DBG] pgmap v1481: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:04.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:04 smithi031 bash[22603]: cluster 2020-06-27T05:26:03.214545+0000 mgr.x (mgr.34109) 1398 : cluster [DBG] pgmap v1481: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:04.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:04 smithi031 bash[18426]: cluster 2020-06-27T05:26:03.214545+0000 mgr.x (mgr.34109) 1398 : cluster [DBG] pgmap v1481: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:05 smithi051 bash[18409]: cluster 2020-06-27T05:26:05.216161+0000 mgr.x (mgr.34109) 1399 : cluster [DBG] pgmap v1482: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:06.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:05 smithi031 bash[18426]: cluster 2020-06-27T05:26:05.216161+0000 mgr.x (mgr.34109) 1399 : cluster [DBG] pgmap v1482: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:06.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:05 smithi031 bash[22603]: cluster 2020-06-27T05:26:05.216161+0000 mgr.x (mgr.34109) 1399 : cluster [DBG] pgmap v1482: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:08.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:08 smithi051 bash[18409]: cluster 2020-06-27T05:26:07.217812+0000 mgr.x (mgr.34109) 1400 : cluster [DBG] pgmap v1483: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:08.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:08 smithi031 bash[18426]: cluster 2020-06-27T05:26:07.217812+0000 mgr.x (mgr.34109) 1400 : cluster [DBG] pgmap v1483: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:08.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:08 smithi031 bash[22603]: cluster 2020-06-27T05:26:07.217812+0000 mgr.x (mgr.34109) 1400 : cluster [DBG] pgmap v1483: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:09 smithi051 bash[18409]: cluster 2020-06-27T05:26:09.219389+0000 mgr.x (mgr.34109) 1401 : cluster [DBG] pgmap v1484: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:09.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:09 smithi031 bash[18426]: cluster 2020-06-27T05:26:09.219389+0000 mgr.x (mgr.34109) 1401 : cluster [DBG] pgmap v1484: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:09.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:09 smithi031 bash[22603]: cluster 2020-06-27T05:26:09.219389+0000 mgr.x (mgr.34109) 1401 : cluster [DBG] pgmap v1484: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:12.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:12 smithi051 bash[18409]: cluster 2020-06-27T05:26:11.221079+0000 mgr.x (mgr.34109) 1402 : cluster [DBG] pgmap v1485: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:12.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:12 smithi031 bash[18426]: cluster 2020-06-27T05:26:11.221079+0000 mgr.x (mgr.34109) 1402 : cluster [DBG] pgmap v1485: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:12.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:12 smithi031 bash[22603]: cluster 2020-06-27T05:26:11.221079+0000 mgr.x (mgr.34109) 1402 : cluster [DBG] pgmap v1485: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:13.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:13 smithi051 bash[18409]: cluster 2020-06-27T05:26:13.222664+0000 mgr.x (mgr.34109) 1403 : cluster [DBG] pgmap v1486: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:13.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:13 smithi031 bash[18426]: cluster 2020-06-27T05:26:13.222664+0000 mgr.x (mgr.34109) 1403 : cluster [DBG] pgmap v1486: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:13.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:13 smithi031 bash[22603]: cluster 2020-06-27T05:26:13.222664+0000 mgr.x (mgr.34109) 1403 : cluster [DBG] pgmap v1486: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:15 smithi051 bash[18409]: cluster 2020-06-27T05:26:15.224099+0000 mgr.x (mgr.34109) 1404 : cluster [DBG] pgmap v1487: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:16.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:15 smithi031 bash[22603]: cluster 2020-06-27T05:26:15.224099+0000 mgr.x (mgr.34109) 1404 : cluster [DBG] pgmap v1487: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:15 smithi031 bash[18426]: cluster 2020-06-27T05:26:15.224099+0000 mgr.x (mgr.34109) 1404 : cluster [DBG] pgmap v1487: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:17 smithi051 bash[18409]: cluster 2020-06-27T05:26:17.225673+0000 mgr.x (mgr.34109) 1405 : cluster [DBG] pgmap v1488: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:17.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:17 smithi031 bash[22603]: cluster 2020-06-27T05:26:17.225673+0000 mgr.x (mgr.34109) 1405 : cluster [DBG] pgmap v1488: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:17.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:17 smithi031 bash[18426]: cluster 2020-06-27T05:26:17.225673+0000 mgr.x (mgr.34109) 1405 : cluster [DBG] pgmap v1488: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:19.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:19 smithi051 bash[18409]: cluster 2020-06-27T05:26:19.227319+0000 mgr.x (mgr.34109) 1406 : cluster [DBG] pgmap v1489: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:19.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:19 smithi031 bash[18426]: cluster 2020-06-27T05:26:19.227319+0000 mgr.x (mgr.34109) 1406 : cluster [DBG] pgmap v1489: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:19.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:19 smithi031 bash[22603]: cluster 2020-06-27T05:26:19.227319+0000 mgr.x (mgr.34109) 1406 : cluster [DBG] pgmap v1489: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:21.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:21 smithi051 bash[18409]: cluster 2020-06-27T05:26:21.229008+0000 mgr.x (mgr.34109) 1407 : cluster [DBG] pgmap v1490: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:21.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:21 smithi031 bash[22603]: cluster 2020-06-27T05:26:21.229008+0000 mgr.x (mgr.34109) 1407 : cluster [DBG] pgmap v1490: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:21.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:21 smithi031 bash[18426]: cluster 2020-06-27T05:26:21.229008+0000 mgr.x (mgr.34109) 1407 : cluster [DBG] pgmap v1490: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:23.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:23 smithi051 bash[18409]: cluster 2020-06-27T05:26:23.230707+0000 mgr.x (mgr.34109) 1408 : cluster [DBG] pgmap v1491: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:23.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:23 smithi031 bash[22603]: cluster 2020-06-27T05:26:23.230707+0000 mgr.x (mgr.34109) 1408 : cluster [DBG] pgmap v1491: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:23.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:23 smithi031 bash[18426]: cluster 2020-06-27T05:26:23.230707+0000 mgr.x (mgr.34109) 1408 : cluster [DBG] pgmap v1491: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:26.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:25 smithi051 bash[18409]: cluster 2020-06-27T05:26:25.232359+0000 mgr.x (mgr.34109) 1409 : cluster [DBG] pgmap v1492: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:25 smithi031 bash[22603]: cluster 2020-06-27T05:26:25.232359+0000 mgr.x (mgr.34109) 1409 : cluster [DBG] pgmap v1492: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:25 smithi031 bash[18426]: cluster 2020-06-27T05:26:25.232359+0000 mgr.x (mgr.34109) 1409 : cluster [DBG] pgmap v1492: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:27.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:27 smithi051 bash[18409]: cluster 2020-06-27T05:26:27.233908+0000 mgr.x (mgr.34109) 1410 : cluster [DBG] pgmap v1493: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:27.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:27 smithi031 bash[22603]: cluster 2020-06-27T05:26:27.233908+0000 mgr.x (mgr.34109) 1410 : cluster [DBG] pgmap v1493: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:27.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:27 smithi031 bash[18426]: cluster 2020-06-27T05:26:27.233908+0000 mgr.x (mgr.34109) 1410 : cluster [DBG] pgmap v1493: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:29.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:29 smithi051 bash[18409]: cluster 2020-06-27T05:26:29.235486+0000 mgr.x (mgr.34109) 1411 : cluster [DBG] pgmap v1494: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:29.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:29 smithi031 bash[22603]: cluster 2020-06-27T05:26:29.235486+0000 mgr.x (mgr.34109) 1411 : cluster [DBG] pgmap v1494: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:29.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:29 smithi031 bash[18426]: cluster 2020-06-27T05:26:29.235486+0000 mgr.x (mgr.34109) 1411 : cluster [DBG] pgmap v1494: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:31.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:31 smithi051 bash[18409]: cluster 2020-06-27T05:26:31.237233+0000 mgr.x (mgr.34109) 1412 : cluster [DBG] pgmap v1495: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:31.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:31 smithi031 bash[18426]: cluster 2020-06-27T05:26:31.237233+0000 mgr.x (mgr.34109) 1412 : cluster [DBG] pgmap v1495: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:31.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:31 smithi031 bash[22603]: cluster 2020-06-27T05:26:31.237233+0000 mgr.x (mgr.34109) 1412 : cluster [DBG] pgmap v1495: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:33 smithi051 bash[18409]: cluster 2020-06-27T05:26:33.238896+0000 mgr.x (mgr.34109) 1413 : cluster [DBG] pgmap v1496: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:33.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:33 smithi031 bash[18426]: cluster 2020-06-27T05:26:33.238896+0000 mgr.x (mgr.34109) 1413 : cluster [DBG] pgmap v1496: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:33.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:33 smithi031 bash[22603]: cluster 2020-06-27T05:26:33.238896+0000 mgr.x (mgr.34109) 1413 : cluster [DBG] pgmap v1496: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:35 smithi051 bash[18409]: cluster 2020-06-27T05:26:35.240553+0000 mgr.x (mgr.34109) 1414 : cluster [DBG] pgmap v1497: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:36.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:35 smithi031 bash[18426]: cluster 2020-06-27T05:26:35.240553+0000 mgr.x (mgr.34109) 1414 : cluster [DBG] pgmap v1497: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:36.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:35 smithi031 bash[22603]: cluster 2020-06-27T05:26:35.240553+0000 mgr.x (mgr.34109) 1414 : cluster [DBG] pgmap v1497: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:37.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:37 smithi051 bash[18409]: cluster 2020-06-27T05:26:37.242305+0000 mgr.x (mgr.34109) 1415 : cluster [DBG] pgmap v1498: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:37.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:37 smithi031 bash[18426]: cluster 2020-06-27T05:26:37.242305+0000 mgr.x (mgr.34109) 1415 : cluster [DBG] pgmap v1498: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:37.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:37 smithi031 bash[22603]: cluster 2020-06-27T05:26:37.242305+0000 mgr.x (mgr.34109) 1415 : cluster [DBG] pgmap v1498: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:39.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:39 smithi051 bash[18409]: cluster 2020-06-27T05:26:39.243890+0000 mgr.x (mgr.34109) 1416 : cluster [DBG] pgmap v1499: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:39 smithi031 bash[18426]: cluster 2020-06-27T05:26:39.243890+0000 mgr.x (mgr.34109) 1416 : cluster [DBG] pgmap v1499: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:39.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:39 smithi031 bash[22603]: cluster 2020-06-27T05:26:39.243890+0000 mgr.x (mgr.34109) 1416 : cluster [DBG] pgmap v1499: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:41 smithi051 bash[18409]: cluster 2020-06-27T05:26:41.245489+0000 mgr.x (mgr.34109) 1417 : cluster [DBG] pgmap v1500: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:41.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:41 smithi031 bash[22603]: cluster 2020-06-27T05:26:41.245489+0000 mgr.x (mgr.34109) 1417 : cluster [DBG] pgmap v1500: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:41 smithi031 bash[18426]: cluster 2020-06-27T05:26:41.245489+0000 mgr.x (mgr.34109) 1417 : cluster [DBG] pgmap v1500: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:43 smithi051 bash[18409]: cluster 2020-06-27T05:26:43.247194+0000 mgr.x (mgr.34109) 1418 : cluster [DBG] pgmap v1501: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:43.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:43 smithi031 bash[18426]: cluster 2020-06-27T05:26:43.247194+0000 mgr.x (mgr.34109) 1418 : cluster [DBG] pgmap v1501: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:43 smithi031 bash[22603]: cluster 2020-06-27T05:26:43.247194+0000 mgr.x (mgr.34109) 1418 : cluster [DBG] pgmap v1501: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:46.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:45 smithi051 bash[18409]: cluster 2020-06-27T05:26:45.248825+0000 mgr.x (mgr.34109) 1419 : cluster [DBG] pgmap v1502: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:46.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:45 smithi031 bash[18426]: cluster 2020-06-27T05:26:45.248825+0000 mgr.x (mgr.34109) 1419 : cluster [DBG] pgmap v1502: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:46.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:45 smithi031 bash[22603]: cluster 2020-06-27T05:26:45.248825+0000 mgr.x (mgr.34109) 1419 : cluster [DBG] pgmap v1502: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:47.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:47 smithi051 bash[18409]: cluster 2020-06-27T05:26:47.250328+0000 mgr.x (mgr.34109) 1420 : cluster [DBG] pgmap v1503: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:47.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:47 smithi031 bash[18426]: cluster 2020-06-27T05:26:47.250328+0000 mgr.x (mgr.34109) 1420 : cluster [DBG] pgmap v1503: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:47.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:47 smithi031 bash[22603]: cluster 2020-06-27T05:26:47.250328+0000 mgr.x (mgr.34109) 1420 : cluster [DBG] pgmap v1503: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:49.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:49 smithi051 bash[18409]: cluster 2020-06-27T05:26:49.251960+0000 mgr.x (mgr.34109) 1421 : cluster [DBG] pgmap v1504: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:49.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:49 smithi031 bash[18426]: cluster 2020-06-27T05:26:49.251960+0000 mgr.x (mgr.34109) 1421 : cluster [DBG] pgmap v1504: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:49.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:49 smithi031 bash[22603]: cluster 2020-06-27T05:26:49.251960+0000 mgr.x (mgr.34109) 1421 : cluster [DBG] pgmap v1504: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:51.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:51 smithi051 bash[18409]: cluster 2020-06-27T05:26:51.253500+0000 mgr.x (mgr.34109) 1422 : cluster [DBG] pgmap v1505: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:51.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:51 smithi031 bash[22603]: cluster 2020-06-27T05:26:51.253500+0000 mgr.x (mgr.34109) 1422 : cluster [DBG] pgmap v1505: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:51.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:51 smithi031 bash[18426]: cluster 2020-06-27T05:26:51.253500+0000 mgr.x (mgr.34109) 1422 : cluster [DBG] pgmap v1505: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:53.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:53 smithi051 bash[18409]: cluster 2020-06-27T05:26:53.255191+0000 mgr.x (mgr.34109) 1423 : cluster [DBG] pgmap v1506: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:53.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:53 smithi031 bash[22603]: cluster 2020-06-27T05:26:53.255191+0000 mgr.x (mgr.34109) 1423 : cluster [DBG] pgmap v1506: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:53.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:53 smithi031 bash[18426]: cluster 2020-06-27T05:26:53.255191+0000 mgr.x (mgr.34109) 1423 : cluster [DBG] pgmap v1506: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:56.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:55 smithi051 bash[18409]: cluster 2020-06-27T05:26:55.256788+0000 mgr.x (mgr.34109) 1424 : cluster [DBG] pgmap v1507: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:56.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:55 smithi031 bash[18426]: cluster 2020-06-27T05:26:55.256788+0000 mgr.x (mgr.34109) 1424 : cluster [DBG] pgmap v1507: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:56.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:55 smithi031 bash[22603]: cluster 2020-06-27T05:26:55.256788+0000 mgr.x (mgr.34109) 1424 : cluster [DBG] pgmap v1507: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:57.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:57 smithi051 bash[18409]: cluster 2020-06-27T05:26:57.258491+0000 mgr.x (mgr.34109) 1425 : cluster [DBG] pgmap v1508: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:57.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:57 smithi031 bash[18426]: cluster 2020-06-27T05:26:57.258491+0000 mgr.x (mgr.34109) 1425 : cluster [DBG] pgmap v1508: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:57.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:57 smithi031 bash[22603]: cluster 2020-06-27T05:26:57.258491+0000 mgr.x (mgr.34109) 1425 : cluster [DBG] pgmap v1508: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:59.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:26:59 smithi051 bash[18409]: cluster 2020-06-27T05:26:59.260160+0000 mgr.x (mgr.34109) 1426 : cluster [DBG] pgmap v1509: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:59.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:26:59 smithi031 bash[18426]: cluster 2020-06-27T05:26:59.260160+0000 mgr.x (mgr.34109) 1426 : cluster [DBG] pgmap v1509: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:26:59.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:26:59 smithi031 bash[22603]: cluster 2020-06-27T05:26:59.260160+0000 mgr.x (mgr.34109) 1426 : cluster [DBG] pgmap v1509: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:01.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:01 smithi051 bash[18409]: cluster 2020-06-27T05:27:01.261826+0000 mgr.x (mgr.34109) 1427 : cluster [DBG] pgmap v1510: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:01.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:01 smithi031 bash[18426]: cluster 2020-06-27T05:27:01.261826+0000 mgr.x (mgr.34109) 1427 : cluster [DBG] pgmap v1510: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:01.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:01 smithi031 bash[22603]: cluster 2020-06-27T05:27:01.261826+0000 mgr.x (mgr.34109) 1427 : cluster [DBG] pgmap v1510: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:03.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:03 smithi051 bash[18409]: cluster 2020-06-27T05:27:03.263468+0000 mgr.x (mgr.34109) 1428 : cluster [DBG] pgmap v1511: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:03.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:03 smithi031 bash[18426]: cluster 2020-06-27T05:27:03.263468+0000 mgr.x (mgr.34109) 1428 : cluster [DBG] pgmap v1511: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:03.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:03 smithi031 bash[22603]: cluster 2020-06-27T05:27:03.263468+0000 mgr.x (mgr.34109) 1428 : cluster [DBG] pgmap v1511: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:06.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:05 smithi051 bash[18409]: cluster 2020-06-27T05:27:05.265192+0000 mgr.x (mgr.34109) 1429 : cluster [DBG] pgmap v1512: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:06.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:05 smithi031 bash[18426]: cluster 2020-06-27T05:27:05.265192+0000 mgr.x (mgr.34109) 1429 : cluster [DBG] pgmap v1512: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:06.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:05 smithi031 bash[22603]: cluster 2020-06-27T05:27:05.265192+0000 mgr.x (mgr.34109) 1429 : cluster [DBG] pgmap v1512: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:07.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:07 smithi051 bash[18409]: cluster 2020-06-27T05:27:07.266962+0000 mgr.x (mgr.34109) 1430 : cluster [DBG] pgmap v1513: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:07.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:07 smithi031 bash[18426]: cluster 2020-06-27T05:27:07.266962+0000 mgr.x (mgr.34109) 1430 : cluster [DBG] pgmap v1513: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:07.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:07 smithi031 bash[22603]: cluster 2020-06-27T05:27:07.266962+0000 mgr.x (mgr.34109) 1430 : cluster [DBG] pgmap v1513: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:09 smithi051 bash[18409]: cluster 2020-06-27T05:27:09.268584+0000 mgr.x (mgr.34109) 1431 : cluster [DBG] pgmap v1514: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:09.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:09 smithi031 bash[18426]: cluster 2020-06-27T05:27:09.268584+0000 mgr.x (mgr.34109) 1431 : cluster [DBG] pgmap v1514: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:09.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:09 smithi031 bash[22603]: cluster 2020-06-27T05:27:09.268584+0000 mgr.x (mgr.34109) 1431 : cluster [DBG] pgmap v1514: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:11.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:11 smithi051 bash[18409]: cluster 2020-06-27T05:27:11.270243+0000 mgr.x (mgr.34109) 1432 : cluster [DBG] pgmap v1515: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:11.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:11 smithi031 bash[18426]: cluster 2020-06-27T05:27:11.270243+0000 mgr.x (mgr.34109) 1432 : cluster [DBG] pgmap v1515: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:11.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:11 smithi031 bash[22603]: cluster 2020-06-27T05:27:11.270243+0000 mgr.x (mgr.34109) 1432 : cluster [DBG] pgmap v1515: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:13.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:13 smithi051 bash[18409]: cluster 2020-06-27T05:27:13.271866+0000 mgr.x (mgr.34109) 1433 : cluster [DBG] pgmap v1516: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:13.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:13 smithi031 bash[18426]: cluster 2020-06-27T05:27:13.271866+0000 mgr.x (mgr.34109) 1433 : cluster [DBG] pgmap v1516: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:13.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:13 smithi031 bash[22603]: cluster 2020-06-27T05:27:13.271866+0000 mgr.x (mgr.34109) 1433 : cluster [DBG] pgmap v1516: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:16.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:15 smithi051 bash[18409]: cluster 2020-06-27T05:27:15.273575+0000 mgr.x (mgr.34109) 1434 : cluster [DBG] pgmap v1517: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:16.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:15 smithi031 bash[18426]: cluster 2020-06-27T05:27:15.273575+0000 mgr.x (mgr.34109) 1434 : cluster [DBG] pgmap v1517: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:16.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:15 smithi031 bash[22603]: cluster 2020-06-27T05:27:15.273575+0000 mgr.x (mgr.34109) 1434 : cluster [DBG] pgmap v1517: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:17 smithi051 bash[18409]: cluster 2020-06-27T05:27:17.275059+0000 mgr.x (mgr.34109) 1435 : cluster [DBG] pgmap v1518: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:17.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:17 smithi031 bash[22603]: cluster 2020-06-27T05:27:17.275059+0000 mgr.x (mgr.34109) 1435 : cluster [DBG] pgmap v1518: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:17.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:17 smithi031 bash[18426]: cluster 2020-06-27T05:27:17.275059+0000 mgr.x (mgr.34109) 1435 : cluster [DBG] pgmap v1518: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:19.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:19 smithi051 bash[18409]: cluster 2020-06-27T05:27:19.276621+0000 mgr.x (mgr.34109) 1436 : cluster [DBG] pgmap v1519: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:19.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:19 smithi031 bash[22603]: cluster 2020-06-27T05:27:19.276621+0000 mgr.x (mgr.34109) 1436 : cluster [DBG] pgmap v1519: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:19.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:19 smithi031 bash[18426]: cluster 2020-06-27T05:27:19.276621+0000 mgr.x (mgr.34109) 1436 : cluster [DBG] pgmap v1519: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:21.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:21 smithi051 bash[18409]: cluster 2020-06-27T05:27:21.278298+0000 mgr.x (mgr.34109) 1437 : cluster [DBG] pgmap v1520: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:21.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:21 smithi031 bash[18426]: cluster 2020-06-27T05:27:21.278298+0000 mgr.x (mgr.34109) 1437 : cluster [DBG] pgmap v1520: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:21.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:21 smithi031 bash[22603]: cluster 2020-06-27T05:27:21.278298+0000 mgr.x (mgr.34109) 1437 : cluster [DBG] pgmap v1520: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:23.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:23 smithi051 bash[18409]: cluster 2020-06-27T05:27:23.279924+0000 mgr.x (mgr.34109) 1438 : cluster [DBG] pgmap v1521: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:23.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:23 smithi031 bash[18426]: cluster 2020-06-27T05:27:23.279924+0000 mgr.x (mgr.34109) 1438 : cluster [DBG] pgmap v1521: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:23.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:23 smithi031 bash[22603]: cluster 2020-06-27T05:27:23.279924+0000 mgr.x (mgr.34109) 1438 : cluster [DBG] pgmap v1521: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:26.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:25 smithi051 bash[18409]: cluster 2020-06-27T05:27:25.281597+0000 mgr.x (mgr.34109) 1439 : cluster [DBG] pgmap v1522: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:26.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:25 smithi031 bash[22603]: cluster 2020-06-27T05:27:25.281597+0000 mgr.x (mgr.34109) 1439 : cluster [DBG] pgmap v1522: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:26.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:25 smithi031 bash[18426]: cluster 2020-06-27T05:27:25.281597+0000 mgr.x (mgr.34109) 1439 : cluster [DBG] pgmap v1522: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:27.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:27 smithi051 bash[18409]: cluster 2020-06-27T05:27:27.283125+0000 mgr.x (mgr.34109) 1440 : cluster [DBG] pgmap v1523: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:27.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:27 smithi031 bash[18426]: cluster 2020-06-27T05:27:27.283125+0000 mgr.x (mgr.34109) 1440 : cluster [DBG] pgmap v1523: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:27.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:27 smithi031 bash[22603]: cluster 2020-06-27T05:27:27.283125+0000 mgr.x (mgr.34109) 1440 : cluster [DBG] pgmap v1523: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:29.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:29 smithi051 bash[18409]: cluster 2020-06-27T05:27:29.284860+0000 mgr.x (mgr.34109) 1441 : cluster [DBG] pgmap v1524: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:29.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:29 smithi031 bash[22603]: cluster 2020-06-27T05:27:29.284860+0000 mgr.x (mgr.34109) 1441 : cluster [DBG] pgmap v1524: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:29.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:29 smithi031 bash[18426]: cluster 2020-06-27T05:27:29.284860+0000 mgr.x (mgr.34109) 1441 : cluster [DBG] pgmap v1524: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:31.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:31 smithi051 bash[18409]: cluster 2020-06-27T05:27:31.286599+0000 mgr.x (mgr.34109) 1442 : cluster [DBG] pgmap v1525: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:31.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:31 smithi031 bash[22603]: cluster 2020-06-27T05:27:31.286599+0000 mgr.x (mgr.34109) 1442 : cluster [DBG] pgmap v1525: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:31.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:31 smithi031 bash[18426]: cluster 2020-06-27T05:27:31.286599+0000 mgr.x (mgr.34109) 1442 : cluster [DBG] pgmap v1525: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:33 smithi051 bash[18409]: cluster 2020-06-27T05:27:33.288289+0000 mgr.x (mgr.34109) 1443 : cluster [DBG] pgmap v1526: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:33.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:33 smithi031 bash[22603]: cluster 2020-06-27T05:27:33.288289+0000 mgr.x (mgr.34109) 1443 : cluster [DBG] pgmap v1526: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:33.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:33 smithi031 bash[18426]: cluster 2020-06-27T05:27:33.288289+0000 mgr.x (mgr.34109) 1443 : cluster [DBG] pgmap v1526: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:36.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:35 smithi051 bash[18409]: cluster 2020-06-27T05:27:35.289983+0000 mgr.x (mgr.34109) 1444 : cluster [DBG] pgmap v1527: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:36.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:35 smithi031 bash[18426]: cluster 2020-06-27T05:27:35.289983+0000 mgr.x (mgr.34109) 1444 : cluster [DBG] pgmap v1527: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:36.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:35 smithi031 bash[22603]: cluster 2020-06-27T05:27:35.289983+0000 mgr.x (mgr.34109) 1444 : cluster [DBG] pgmap v1527: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:37.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:37 smithi051 bash[18409]: cluster 2020-06-27T05:27:37.291565+0000 mgr.x (mgr.34109) 1445 : cluster [DBG] pgmap v1528: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:37.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:37 smithi031 bash[18426]: cluster 2020-06-27T05:27:37.291565+0000 mgr.x (mgr.34109) 1445 : cluster [DBG] pgmap v1528: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:37.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:37 smithi031 bash[22603]: cluster 2020-06-27T05:27:37.291565+0000 mgr.x (mgr.34109) 1445 : cluster [DBG] pgmap v1528: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:39.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:39 smithi051 bash[18409]: cluster 2020-06-27T05:27:39.293101+0000 mgr.x (mgr.34109) 1446 : cluster [DBG] pgmap v1529: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:39.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:39 smithi031 bash[22603]: cluster 2020-06-27T05:27:39.293101+0000 mgr.x (mgr.34109) 1446 : cluster [DBG] pgmap v1529: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:39 smithi031 bash[18426]: cluster 2020-06-27T05:27:39.293101+0000 mgr.x (mgr.34109) 1446 : cluster [DBG] pgmap v1529: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:42.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:42 smithi051 bash[18409]: cluster 2020-06-27T05:27:41.294827+0000 mgr.x (mgr.34109) 1447 : cluster [DBG] pgmap v1530: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:42.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:42 smithi031 bash[22603]: cluster 2020-06-27T05:27:41.294827+0000 mgr.x (mgr.34109) 1447 : cluster [DBG] pgmap v1530: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:42.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:42 smithi031 bash[18426]: cluster 2020-06-27T05:27:41.294827+0000 mgr.x (mgr.34109) 1447 : cluster [DBG] pgmap v1530: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:44.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:44 smithi051 bash[18409]: cluster 2020-06-27T05:27:43.296548+0000 mgr.x (mgr.34109) 1448 : cluster [DBG] pgmap v1531: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:44.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:44 smithi031 bash[18426]: cluster 2020-06-27T05:27:43.296548+0000 mgr.x (mgr.34109) 1448 : cluster [DBG] pgmap v1531: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:44.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:44 smithi031 bash[22603]: cluster 2020-06-27T05:27:43.296548+0000 mgr.x (mgr.34109) 1448 : cluster [DBG] pgmap v1531: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:47.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:46 smithi051 bash[18409]: cluster 2020-06-27T05:27:45.298244+0000 mgr.x (mgr.34109) 1449 : cluster [DBG] pgmap v1532: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:47.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:46 smithi031 bash[18426]: cluster 2020-06-27T05:27:45.298244+0000 mgr.x (mgr.34109) 1449 : cluster [DBG] pgmap v1532: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:47.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:46 smithi031 bash[22603]: cluster 2020-06-27T05:27:45.298244+0000 mgr.x (mgr.34109) 1449 : cluster [DBG] pgmap v1532: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:49.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:48 smithi051 bash[18409]: cluster 2020-06-27T05:27:47.299952+0000 mgr.x (mgr.34109) 1450 : cluster [DBG] pgmap v1533: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:49.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:48 smithi031 bash[18426]: cluster 2020-06-27T05:27:47.299952+0000 mgr.x (mgr.34109) 1450 : cluster [DBG] pgmap v1533: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:49.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:48 smithi031 bash[22603]: cluster 2020-06-27T05:27:47.299952+0000 mgr.x (mgr.34109) 1450 : cluster [DBG] pgmap v1533: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:51.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:50 smithi051 bash[18409]: cluster 2020-06-27T05:27:49.302319+0000 mgr.x (mgr.34109) 1451 : cluster [DBG] pgmap v1534: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:51.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:50 smithi031 bash[18426]: cluster 2020-06-27T05:27:49.302319+0000 mgr.x (mgr.34109) 1451 : cluster [DBG] pgmap v1534: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:51.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:50 smithi031 bash[22603]: cluster 2020-06-27T05:27:49.302319+0000 mgr.x (mgr.34109) 1451 : cluster [DBG] pgmap v1534: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:53.223 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:52 smithi051 bash[18409]: cluster 2020-06-27T05:27:51.304047+0000 mgr.x (mgr.34109) 1452 : cluster [DBG] pgmap v1535: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:53.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:52 smithi031 bash[18426]: cluster 2020-06-27T05:27:51.304047+0000 mgr.x (mgr.34109) 1452 : cluster [DBG] pgmap v1535: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:53.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:52 smithi031 bash[22603]: cluster 2020-06-27T05:27:51.304047+0000 mgr.x (mgr.34109) 1452 : cluster [DBG] pgmap v1535: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:55.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:54 smithi051 bash[18409]: cluster 2020-06-27T05:27:53.305787+0000 mgr.x (mgr.34109) 1453 : cluster [DBG] pgmap v1536: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:55.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:54 smithi031 bash[18426]: cluster 2020-06-27T05:27:53.305787+0000 mgr.x (mgr.34109) 1453 : cluster [DBG] pgmap v1536: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:55.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:54 smithi031 bash[22603]: cluster 2020-06-27T05:27:53.305787+0000 mgr.x (mgr.34109) 1453 : cluster [DBG] pgmap v1536: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:57.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:56 smithi051 bash[18409]: cluster 2020-06-27T05:27:55.307487+0000 mgr.x (mgr.34109) 1454 : cluster [DBG] pgmap v1537: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:57.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:56 smithi031 bash[18426]: cluster 2020-06-27T05:27:55.307487+0000 mgr.x (mgr.34109) 1454 : cluster [DBG] pgmap v1537: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:57.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:56 smithi031 bash[22603]: cluster 2020-06-27T05:27:55.307487+0000 mgr.x (mgr.34109) 1454 : cluster [DBG] pgmap v1537: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:59.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:27:58 smithi051 bash[18409]: cluster 2020-06-27T05:27:57.309212+0000 mgr.x (mgr.34109) 1455 : cluster [DBG] pgmap v1538: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:59.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:27:58 smithi031 bash[18426]: cluster 2020-06-27T05:27:57.309212+0000 mgr.x (mgr.34109) 1455 : cluster [DBG] pgmap v1538: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:27:59.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:27:58 smithi031 bash[22603]: cluster 2020-06-27T05:27:57.309212+0000 mgr.x (mgr.34109) 1455 : cluster [DBG] pgmap v1538: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:01.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:00 smithi051 bash[18409]: cluster 2020-06-27T05:27:59.310914+0000 mgr.x (mgr.34109) 1456 : cluster [DBG] pgmap v1539: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:01.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:00 smithi031 bash[18426]: cluster 2020-06-27T05:27:59.310914+0000 mgr.x (mgr.34109) 1456 : cluster [DBG] pgmap v1539: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:01.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:00 smithi031 bash[22603]: cluster 2020-06-27T05:27:59.310914+0000 mgr.x (mgr.34109) 1456 : cluster [DBG] pgmap v1539: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:03.224 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:02 smithi031 bash[18426]: cluster 2020-06-27T05:28:01.312643+0000 mgr.x (mgr.34109) 1457 : cluster [DBG] pgmap v1540: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:03.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:02 smithi031 bash[22603]: cluster 2020-06-27T05:28:01.312643+0000 mgr.x (mgr.34109) 1457 : cluster [DBG] pgmap v1540: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:03.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:02 smithi051 bash[18409]: cluster 2020-06-27T05:28:01.312643+0000 mgr.x (mgr.34109) 1457 : cluster [DBG] pgmap v1540: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:05.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:04 smithi051 bash[18409]: cluster 2020-06-27T05:28:03.314252+0000 mgr.x (mgr.34109) 1458 : cluster [DBG] pgmap v1541: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:05.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:04 smithi031 bash[18426]: cluster 2020-06-27T05:28:03.314252+0000 mgr.x (mgr.34109) 1458 : cluster [DBG] pgmap v1541: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:05.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:04 smithi031 bash[22603]: cluster 2020-06-27T05:28:03.314252+0000 mgr.x (mgr.34109) 1458 : cluster [DBG] pgmap v1541: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:07.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:06 smithi051 bash[18409]: cluster 2020-06-27T05:28:05.315859+0000 mgr.x (mgr.34109) 1459 : cluster [DBG] pgmap v1542: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:07.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:06 smithi031 bash[18426]: cluster 2020-06-27T05:28:05.315859+0000 mgr.x (mgr.34109) 1459 : cluster [DBG] pgmap v1542: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:07.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:06 smithi031 bash[22603]: cluster 2020-06-27T05:28:05.315859+0000 mgr.x (mgr.34109) 1459 : cluster [DBG] pgmap v1542: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:09.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:08 smithi051 bash[18409]: cluster 2020-06-27T05:28:07.317535+0000 mgr.x (mgr.34109) 1460 : cluster [DBG] pgmap v1543: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:09.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:08 smithi031 bash[18426]: cluster 2020-06-27T05:28:07.317535+0000 mgr.x (mgr.34109) 1460 : cluster [DBG] pgmap v1543: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:09.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:08 smithi031 bash[22603]: cluster 2020-06-27T05:28:07.317535+0000 mgr.x (mgr.34109) 1460 : cluster [DBG] pgmap v1543: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:11.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:10 smithi051 bash[18409]: cluster 2020-06-27T05:28:09.319270+0000 mgr.x (mgr.34109) 1461 : cluster [DBG] pgmap v1544: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:10 smithi031 bash[18426]: cluster 2020-06-27T05:28:09.319270+0000 mgr.x (mgr.34109) 1461 : cluster [DBG] pgmap v1544: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:11.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:10 smithi031 bash[22603]: cluster 2020-06-27T05:28:09.319270+0000 mgr.x (mgr.34109) 1461 : cluster [DBG] pgmap v1544: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:13.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:13 smithi051 bash[18409]: cluster 2020-06-27T05:28:11.320897+0000 mgr.x (mgr.34109) 1462 : cluster [DBG] pgmap v1545: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:13.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:12 smithi031 bash[18426]: cluster 2020-06-27T05:28:11.320897+0000 mgr.x (mgr.34109) 1462 : cluster [DBG] pgmap v1545: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:13.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:13 smithi031 bash[22603]: cluster 2020-06-27T05:28:11.320897+0000 mgr.x (mgr.34109) 1462 : cluster [DBG] pgmap v1545: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:15.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:15 smithi051 bash[18409]: cluster 2020-06-27T05:28:13.322616+0000 mgr.x (mgr.34109) 1463 : cluster [DBG] pgmap v1546: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:15.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:15 smithi031 bash[18426]: cluster 2020-06-27T05:28:13.322616+0000 mgr.x (mgr.34109) 1463 : cluster [DBG] pgmap v1546: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:15.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:15 smithi031 bash[22603]: cluster 2020-06-27T05:28:13.322616+0000 mgr.x (mgr.34109) 1463 : cluster [DBG] pgmap v1546: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:17.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:17 smithi051 bash[18409]: cluster 2020-06-27T05:28:15.324202+0000 mgr.x (mgr.34109) 1464 : cluster [DBG] pgmap v1547: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:17.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:17 smithi031 bash[18426]: cluster 2020-06-27T05:28:15.324202+0000 mgr.x (mgr.34109) 1464 : cluster [DBG] pgmap v1547: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:17.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:17 smithi031 bash[22603]: cluster 2020-06-27T05:28:15.324202+0000 mgr.x (mgr.34109) 1464 : cluster [DBG] pgmap v1547: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:19.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:19 smithi051 bash[18409]: cluster 2020-06-27T05:28:17.325926+0000 mgr.x (mgr.34109) 1465 : cluster [DBG] pgmap v1548: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:19.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:19 smithi031 bash[18426]: cluster 2020-06-27T05:28:17.325926+0000 mgr.x (mgr.34109) 1465 : cluster [DBG] pgmap v1548: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:19.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:19 smithi031 bash[22603]: cluster 2020-06-27T05:28:17.325926+0000 mgr.x (mgr.34109) 1465 : cluster [DBG] pgmap v1548: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:21.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:21 smithi051 bash[18409]: cluster 2020-06-27T05:28:19.327611+0000 mgr.x (mgr.34109) 1466 : cluster [DBG] pgmap v1549: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:21.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:21 smithi031 bash[18426]: cluster 2020-06-27T05:28:19.327611+0000 mgr.x (mgr.34109) 1466 : cluster [DBG] pgmap v1549: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:21.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:21 smithi031 bash[22603]: cluster 2020-06-27T05:28:19.327611+0000 mgr.x (mgr.34109) 1466 : cluster [DBG] pgmap v1549: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:23.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:23 smithi051 bash[18409]: cluster 2020-06-27T05:28:21.329247+0000 mgr.x (mgr.34109) 1467 : cluster [DBG] pgmap v1550: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:23.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:23 smithi031 bash[18426]: cluster 2020-06-27T05:28:21.329247+0000 mgr.x (mgr.34109) 1467 : cluster [DBG] pgmap v1550: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:23.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:23 smithi031 bash[22603]: cluster 2020-06-27T05:28:21.329247+0000 mgr.x (mgr.34109) 1467 : cluster [DBG] pgmap v1550: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:25.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:25 smithi051 bash[18409]: cluster 2020-06-27T05:28:23.330837+0000 mgr.x (mgr.34109) 1468 : cluster [DBG] pgmap v1551: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:25.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:25 smithi031 bash[18426]: cluster 2020-06-27T05:28:23.330837+0000 mgr.x (mgr.34109) 1468 : cluster [DBG] pgmap v1551: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:25.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:25 smithi031 bash[22603]: cluster 2020-06-27T05:28:23.330837+0000 mgr.x (mgr.34109) 1468 : cluster [DBG] pgmap v1551: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:27.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:27 smithi051 bash[18409]: cluster 2020-06-27T05:28:25.332563+0000 mgr.x (mgr.34109) 1469 : cluster [DBG] pgmap v1552: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:27.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:27 smithi031 bash[18426]: cluster 2020-06-27T05:28:25.332563+0000 mgr.x (mgr.34109) 1469 : cluster [DBG] pgmap v1552: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:27.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:27 smithi031 bash[22603]: cluster 2020-06-27T05:28:25.332563+0000 mgr.x (mgr.34109) 1469 : cluster [DBG] pgmap v1552: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:29.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:29 smithi051 bash[18409]: cluster 2020-06-27T05:28:27.334232+0000 mgr.x (mgr.34109) 1470 : cluster [DBG] pgmap v1553: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:29.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:29 smithi031 bash[18426]: cluster 2020-06-27T05:28:27.334232+0000 mgr.x (mgr.34109) 1470 : cluster [DBG] pgmap v1553: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:29.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:29 smithi031 bash[22603]: cluster 2020-06-27T05:28:27.334232+0000 mgr.x (mgr.34109) 1470 : cluster [DBG] pgmap v1553: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:31.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:31 smithi051 bash[18409]: cluster 2020-06-27T05:28:29.335907+0000 mgr.x (mgr.34109) 1471 : cluster [DBG] pgmap v1554: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:31.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:31 smithi031 bash[18426]: cluster 2020-06-27T05:28:29.335907+0000 mgr.x (mgr.34109) 1471 : cluster [DBG] pgmap v1554: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:31.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:31 smithi031 bash[22603]: cluster 2020-06-27T05:28:29.335907+0000 mgr.x (mgr.34109) 1471 : cluster [DBG] pgmap v1554: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:33.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:33 smithi051 bash[18409]: cluster 2020-06-27T05:28:31.337637+0000 mgr.x (mgr.34109) 1472 : cluster [DBG] pgmap v1555: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:33.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:33 smithi031 bash[18426]: cluster 2020-06-27T05:28:31.337637+0000 mgr.x (mgr.34109) 1472 : cluster [DBG] pgmap v1555: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:33.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:33 smithi031 bash[22603]: cluster 2020-06-27T05:28:31.337637+0000 mgr.x (mgr.34109) 1472 : cluster [DBG] pgmap v1555: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:35.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:35 smithi051 bash[18409]: cluster 2020-06-27T05:28:33.339361+0000 mgr.x (mgr.34109) 1473 : cluster [DBG] pgmap v1556: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:35.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:35 smithi031 bash[18426]: cluster 2020-06-27T05:28:33.339361+0000 mgr.x (mgr.34109) 1473 : cluster [DBG] pgmap v1556: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:35.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:35 smithi031 bash[22603]: cluster 2020-06-27T05:28:33.339361+0000 mgr.x (mgr.34109) 1473 : cluster [DBG] pgmap v1556: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:37.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:37 smithi051 bash[18409]: cluster 2020-06-27T05:28:35.341019+0000 mgr.x (mgr.34109) 1474 : cluster [DBG] pgmap v1557: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:37.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:37 smithi031 bash[18426]: cluster 2020-06-27T05:28:35.341019+0000 mgr.x (mgr.34109) 1474 : cluster [DBG] pgmap v1557: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:37.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:37 smithi031 bash[22603]: cluster 2020-06-27T05:28:35.341019+0000 mgr.x (mgr.34109) 1474 : cluster [DBG] pgmap v1557: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:39.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:39 smithi051 bash[18409]: cluster 2020-06-27T05:28:37.342785+0000 mgr.x (mgr.34109) 1475 : cluster [DBG] pgmap v1558: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:39.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:39 smithi031 bash[18426]: cluster 2020-06-27T05:28:37.342785+0000 mgr.x (mgr.34109) 1475 : cluster [DBG] pgmap v1558: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:39.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:39 smithi031 bash[22603]: cluster 2020-06-27T05:28:37.342785+0000 mgr.x (mgr.34109) 1475 : cluster [DBG] pgmap v1558: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:41.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:41 smithi051 bash[18409]: cluster 2020-06-27T05:28:39.344452+0000 mgr.x (mgr.34109) 1476 : cluster [DBG] pgmap v1559: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:41.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:41 smithi031 bash[18426]: cluster 2020-06-27T05:28:39.344452+0000 mgr.x (mgr.34109) 1476 : cluster [DBG] pgmap v1559: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:41.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:41 smithi031 bash[22603]: cluster 2020-06-27T05:28:39.344452+0000 mgr.x (mgr.34109) 1476 : cluster [DBG] pgmap v1559: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:43.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:43 smithi051 bash[18409]: cluster 2020-06-27T05:28:41.346056+0000 mgr.x (mgr.34109) 1477 : cluster [DBG] pgmap v1560: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:43.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:43 smithi031 bash[18426]: cluster 2020-06-27T05:28:41.346056+0000 mgr.x (mgr.34109) 1477 : cluster [DBG] pgmap v1560: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:43.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:43 smithi031 bash[22603]: cluster 2020-06-27T05:28:41.346056+0000 mgr.x (mgr.34109) 1477 : cluster [DBG] pgmap v1560: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:45.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:45 smithi051 bash[18409]: cluster 2020-06-27T05:28:43.347655+0000 mgr.x (mgr.34109) 1478 : cluster [DBG] pgmap v1561: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:45.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:45 smithi031 bash[18426]: cluster 2020-06-27T05:28:43.347655+0000 mgr.x (mgr.34109) 1478 : cluster [DBG] pgmap v1561: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:45.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:45 smithi031 bash[22603]: cluster 2020-06-27T05:28:43.347655+0000 mgr.x (mgr.34109) 1478 : cluster [DBG] pgmap v1561: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:47.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:47 smithi051 bash[18409]: cluster 2020-06-27T05:28:45.349328+0000 mgr.x (mgr.34109) 1479 : cluster [DBG] pgmap v1562: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:47.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:47 smithi031 bash[18426]: cluster 2020-06-27T05:28:45.349328+0000 mgr.x (mgr.34109) 1479 : cluster [DBG] pgmap v1562: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:47.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:47 smithi031 bash[22603]: cluster 2020-06-27T05:28:45.349328+0000 mgr.x (mgr.34109) 1479 : cluster [DBG] pgmap v1562: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:49.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:49 smithi051 bash[18409]: cluster 2020-06-27T05:28:47.350943+0000 mgr.x (mgr.34109) 1480 : cluster [DBG] pgmap v1563: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:49.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:49 smithi031 bash[18426]: cluster 2020-06-27T05:28:47.350943+0000 mgr.x (mgr.34109) 1480 : cluster [DBG] pgmap v1563: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:49.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:49 smithi031 bash[22603]: cluster 2020-06-27T05:28:47.350943+0000 mgr.x (mgr.34109) 1480 : cluster [DBG] pgmap v1563: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:51.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:51 smithi051 bash[18409]: cluster 2020-06-27T05:28:49.352692+0000 mgr.x (mgr.34109) 1481 : cluster [DBG] pgmap v1564: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:51.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:51 smithi031 bash[18426]: cluster 2020-06-27T05:28:49.352692+0000 mgr.x (mgr.34109) 1481 : cluster [DBG] pgmap v1564: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:51.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:51 smithi031 bash[22603]: cluster 2020-06-27T05:28:49.352692+0000 mgr.x (mgr.34109) 1481 : cluster [DBG] pgmap v1564: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:53.479 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:53 smithi031 bash[18426]: cluster 2020-06-27T05:28:51.354393+0000 mgr.x (mgr.34109) 1482 : cluster [DBG] pgmap v1565: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:53.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:53 smithi031 bash[22603]: cluster 2020-06-27T05:28:51.354393+0000 mgr.x (mgr.34109) 1482 : cluster [DBG] pgmap v1565: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:53.480 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:53 smithi051 bash[18409]: cluster 2020-06-27T05:28:51.354393+0000 mgr.x (mgr.34109) 1482 : cluster [DBG] pgmap v1565: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:55.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:55 smithi051 bash[18409]: cluster 2020-06-27T05:28:53.355991+0000 mgr.x (mgr.34109) 1483 : cluster [DBG] pgmap v1566: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:55.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:55 smithi031 bash[18426]: cluster 2020-06-27T05:28:53.355991+0000 mgr.x (mgr.34109) 1483 : cluster [DBG] pgmap v1566: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:55.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:55 smithi031 bash[22603]: cluster 2020-06-27T05:28:53.355991+0000 mgr.x (mgr.34109) 1483 : cluster [DBG] pgmap v1566: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:57.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:57 smithi051 bash[18409]: cluster 2020-06-27T05:28:55.357573+0000 mgr.x (mgr.34109) 1484 : cluster [DBG] pgmap v1567: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:57.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:57 smithi031 bash[18426]: cluster 2020-06-27T05:28:55.357573+0000 mgr.x (mgr.34109) 1484 : cluster [DBG] pgmap v1567: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:57.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:57 smithi031 bash[22603]: cluster 2020-06-27T05:28:55.357573+0000 mgr.x (mgr.34109) 1484 : cluster [DBG] pgmap v1567: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:59.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:28:59 smithi051 bash[18409]: cluster 2020-06-27T05:28:57.359200+0000 mgr.x (mgr.34109) 1485 : cluster [DBG] pgmap v1568: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:59.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:28:59 smithi031 bash[18426]: cluster 2020-06-27T05:28:57.359200+0000 mgr.x (mgr.34109) 1485 : cluster [DBG] pgmap v1568: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:28:59.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:28:59 smithi031 bash[22603]: cluster 2020-06-27T05:28:57.359200+0000 mgr.x (mgr.34109) 1485 : cluster [DBG] pgmap v1568: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:01.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:01 smithi051 bash[18409]: cluster 2020-06-27T05:28:59.360838+0000 mgr.x (mgr.34109) 1486 : cluster [DBG] pgmap v1569: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:01.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:01 smithi031 bash[18426]: cluster 2020-06-27T05:28:59.360838+0000 mgr.x (mgr.34109) 1486 : cluster [DBG] pgmap v1569: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:01.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:01 smithi031 bash[22603]: cluster 2020-06-27T05:28:59.360838+0000 mgr.x (mgr.34109) 1486 : cluster [DBG] pgmap v1569: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:03.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:03 smithi051 bash[18409]: cluster 2020-06-27T05:29:01.362554+0000 mgr.x (mgr.34109) 1487 : cluster [DBG] pgmap v1570: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:03.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:03 smithi031 bash[18426]: cluster 2020-06-27T05:29:01.362554+0000 mgr.x (mgr.34109) 1487 : cluster [DBG] pgmap v1570: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:03.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:03 smithi031 bash[22603]: cluster 2020-06-27T05:29:01.362554+0000 mgr.x (mgr.34109) 1487 : cluster [DBG] pgmap v1570: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:05.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:05 smithi051 bash[18409]: cluster 2020-06-27T05:29:03.364239+0000 mgr.x (mgr.34109) 1488 : cluster [DBG] pgmap v1571: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:05.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:05 smithi031 bash[18426]: cluster 2020-06-27T05:29:03.364239+0000 mgr.x (mgr.34109) 1488 : cluster [DBG] pgmap v1571: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:05.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:05 smithi031 bash[22603]: cluster 2020-06-27T05:29:03.364239+0000 mgr.x (mgr.34109) 1488 : cluster [DBG] pgmap v1571: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:07.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:07 smithi051 bash[18409]: cluster 2020-06-27T05:29:05.365954+0000 mgr.x (mgr.34109) 1489 : cluster [DBG] pgmap v1572: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:07.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:07 smithi031 bash[18426]: cluster 2020-06-27T05:29:05.365954+0000 mgr.x (mgr.34109) 1489 : cluster [DBG] pgmap v1572: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:07.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:07 smithi031 bash[22603]: cluster 2020-06-27T05:29:05.365954+0000 mgr.x (mgr.34109) 1489 : cluster [DBG] pgmap v1572: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:09.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:09 smithi051 bash[18409]: cluster 2020-06-27T05:29:07.367596+0000 mgr.x (mgr.34109) 1490 : cluster [DBG] pgmap v1573: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:09.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:09 smithi031 bash[18426]: cluster 2020-06-27T05:29:07.367596+0000 mgr.x (mgr.34109) 1490 : cluster [DBG] pgmap v1573: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:09.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:09 smithi031 bash[22603]: cluster 2020-06-27T05:29:07.367596+0000 mgr.x (mgr.34109) 1490 : cluster [DBG] pgmap v1573: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:11.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:11 smithi051 bash[18409]: cluster 2020-06-27T05:29:09.369211+0000 mgr.x (mgr.34109) 1491 : cluster [DBG] pgmap v1574: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:11 smithi031 bash[18426]: cluster 2020-06-27T05:29:09.369211+0000 mgr.x (mgr.34109) 1491 : cluster [DBG] pgmap v1574: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:11.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:11 smithi031 bash[22603]: cluster 2020-06-27T05:29:09.369211+0000 mgr.x (mgr.34109) 1491 : cluster [DBG] pgmap v1574: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:13.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:13 smithi051 bash[18409]: cluster 2020-06-27T05:29:11.370859+0000 mgr.x (mgr.34109) 1492 : cluster [DBG] pgmap v1575: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:13.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:13 smithi031 bash[18426]: cluster 2020-06-27T05:29:11.370859+0000 mgr.x (mgr.34109) 1492 : cluster [DBG] pgmap v1575: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:13.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:13 smithi031 bash[22603]: cluster 2020-06-27T05:29:11.370859+0000 mgr.x (mgr.34109) 1492 : cluster [DBG] pgmap v1575: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:15.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:15 smithi051 bash[18409]: cluster 2020-06-27T05:29:13.372480+0000 mgr.x (mgr.34109) 1493 : cluster [DBG] pgmap v1576: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:15.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:15 smithi031 bash[18426]: cluster 2020-06-27T05:29:13.372480+0000 mgr.x (mgr.34109) 1493 : cluster [DBG] pgmap v1576: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:15.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:15 smithi031 bash[22603]: cluster 2020-06-27T05:29:13.372480+0000 mgr.x (mgr.34109) 1493 : cluster [DBG] pgmap v1576: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:17.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:17 smithi051 bash[18409]: cluster 2020-06-27T05:29:15.374180+0000 mgr.x (mgr.34109) 1494 : cluster [DBG] pgmap v1577: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:17.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:17 smithi031 bash[18426]: cluster 2020-06-27T05:29:15.374180+0000 mgr.x (mgr.34109) 1494 : cluster [DBG] pgmap v1577: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:17.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:17 smithi031 bash[22603]: cluster 2020-06-27T05:29:15.374180+0000 mgr.x (mgr.34109) 1494 : cluster [DBG] pgmap v1577: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:19.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:19 smithi051 bash[18409]: cluster 2020-06-27T05:29:17.375786+0000 mgr.x (mgr.34109) 1495 : cluster [DBG] pgmap v1578: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:19.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:19 smithi031 bash[22603]: cluster 2020-06-27T05:29:17.375786+0000 mgr.x (mgr.34109) 1495 : cluster [DBG] pgmap v1578: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:19.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:19 smithi031 bash[18426]: cluster 2020-06-27T05:29:17.375786+0000 mgr.x (mgr.34109) 1495 : cluster [DBG] pgmap v1578: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:21.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:21 smithi051 bash[18409]: cluster 2020-06-27T05:29:19.377377+0000 mgr.x (mgr.34109) 1496 : cluster [DBG] pgmap v1579: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:21.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:21 smithi031 bash[18426]: cluster 2020-06-27T05:29:19.377377+0000 mgr.x (mgr.34109) 1496 : cluster [DBG] pgmap v1579: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:21.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:21 smithi031 bash[22603]: cluster 2020-06-27T05:29:19.377377+0000 mgr.x (mgr.34109) 1496 : cluster [DBG] pgmap v1579: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:23.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:23 smithi051 bash[18409]: cluster 2020-06-27T05:29:21.378927+0000 mgr.x (mgr.34109) 1497 : cluster [DBG] pgmap v1580: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:23.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:23 smithi031 bash[18426]: cluster 2020-06-27T05:29:21.378927+0000 mgr.x (mgr.34109) 1497 : cluster [DBG] pgmap v1580: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:23.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:23 smithi031 bash[22603]: cluster 2020-06-27T05:29:21.378927+0000 mgr.x (mgr.34109) 1497 : cluster [DBG] pgmap v1580: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:25.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:25 smithi031 bash[18426]: cluster 2020-06-27T05:29:23.380548+0000 mgr.x (mgr.34109) 1498 : cluster [DBG] pgmap v1581: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:25.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:25 smithi031 bash[22603]: cluster 2020-06-27T05:29:23.380548+0000 mgr.x (mgr.34109) 1498 : cluster [DBG] pgmap v1581: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:25.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:25 smithi051 bash[18409]: cluster 2020-06-27T05:29:23.380548+0000 mgr.x (mgr.34109) 1498 : cluster [DBG] pgmap v1581: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:27.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:27 smithi031 bash[18426]: cluster 2020-06-27T05:29:25.382237+0000 mgr.x (mgr.34109) 1499 : cluster [DBG] pgmap v1582: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:27.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:27 smithi031 bash[22603]: cluster 2020-06-27T05:29:25.382237+0000 mgr.x (mgr.34109) 1499 : cluster [DBG] pgmap v1582: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:27.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:27 smithi051 bash[18409]: cluster 2020-06-27T05:29:25.382237+0000 mgr.x (mgr.34109) 1499 : cluster [DBG] pgmap v1582: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:29.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:29 smithi051 bash[18409]: cluster 2020-06-27T05:29:27.383990+0000 mgr.x (mgr.34109) 1500 : cluster [DBG] pgmap v1583: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:29.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:29 smithi031 bash[18426]: cluster 2020-06-27T05:29:27.383990+0000 mgr.x (mgr.34109) 1500 : cluster [DBG] pgmap v1583: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:29.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:29 smithi031 bash[22603]: cluster 2020-06-27T05:29:27.383990+0000 mgr.x (mgr.34109) 1500 : cluster [DBG] pgmap v1583: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:31.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:31 smithi051 bash[18409]: cluster 2020-06-27T05:29:29.385624+0000 mgr.x (mgr.34109) 1501 : cluster [DBG] pgmap v1584: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:31.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:31 smithi031 bash[18426]: cluster 2020-06-27T05:29:29.385624+0000 mgr.x (mgr.34109) 1501 : cluster [DBG] pgmap v1584: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:31.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:31 smithi031 bash[22603]: cluster 2020-06-27T05:29:29.385624+0000 mgr.x (mgr.34109) 1501 : cluster [DBG] pgmap v1584: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:33 smithi051 bash[18409]: cluster 2020-06-27T05:29:31.387284+0000 mgr.x (mgr.34109) 1502 : cluster [DBG] pgmap v1585: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:33.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:33 smithi031 bash[18426]: cluster 2020-06-27T05:29:31.387284+0000 mgr.x (mgr.34109) 1502 : cluster [DBG] pgmap v1585: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:33.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:33 smithi031 bash[22603]: cluster 2020-06-27T05:29:31.387284+0000 mgr.x (mgr.34109) 1502 : cluster [DBG] pgmap v1585: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:35.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:35 smithi051 bash[18409]: cluster 2020-06-27T05:29:33.388970+0000 mgr.x (mgr.34109) 1503 : cluster [DBG] pgmap v1586: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:35.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:35 smithi031 bash[18426]: cluster 2020-06-27T05:29:33.388970+0000 mgr.x (mgr.34109) 1503 : cluster [DBG] pgmap v1586: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:35.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:35 smithi031 bash[22603]: cluster 2020-06-27T05:29:33.388970+0000 mgr.x (mgr.34109) 1503 : cluster [DBG] pgmap v1586: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:37.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:37 smithi051 bash[18409]: cluster 2020-06-27T05:29:35.390601+0000 mgr.x (mgr.34109) 1504 : cluster [DBG] pgmap v1587: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:37.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:37 smithi031 bash[18426]: cluster 2020-06-27T05:29:35.390601+0000 mgr.x (mgr.34109) 1504 : cluster [DBG] pgmap v1587: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:37.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:37 smithi031 bash[22603]: cluster 2020-06-27T05:29:35.390601+0000 mgr.x (mgr.34109) 1504 : cluster [DBG] pgmap v1587: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:39.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:39 smithi051 bash[18409]: cluster 2020-06-27T05:29:37.392334+0000 mgr.x (mgr.34109) 1505 : cluster [DBG] pgmap v1588: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:39 smithi031 bash[18426]: cluster 2020-06-27T05:29:37.392334+0000 mgr.x (mgr.34109) 1505 : cluster [DBG] pgmap v1588: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:39.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:39 smithi031 bash[22603]: cluster 2020-06-27T05:29:37.392334+0000 mgr.x (mgr.34109) 1505 : cluster [DBG] pgmap v1588: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:41 smithi051 bash[18409]: cluster 2020-06-27T05:29:39.393985+0000 mgr.x (mgr.34109) 1506 : cluster [DBG] pgmap v1589: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:41 smithi031 bash[18426]: cluster 2020-06-27T05:29:39.393985+0000 mgr.x (mgr.34109) 1506 : cluster [DBG] pgmap v1589: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:41.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:41 smithi031 bash[22603]: cluster 2020-06-27T05:29:39.393985+0000 mgr.x (mgr.34109) 1506 : cluster [DBG] pgmap v1589: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:43 smithi051 bash[18409]: cluster 2020-06-27T05:29:41.395646+0000 mgr.x (mgr.34109) 1507 : cluster [DBG] pgmap v1590: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:43.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:43 smithi031 bash[18426]: cluster 2020-06-27T05:29:41.395646+0000 mgr.x (mgr.34109) 1507 : cluster [DBG] pgmap v1590: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:43 smithi031 bash[22603]: cluster 2020-06-27T05:29:41.395646+0000 mgr.x (mgr.34109) 1507 : cluster [DBG] pgmap v1590: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:45.724 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:45 smithi051 bash[18409]: cluster 2020-06-27T05:29:43.397304+0000 mgr.x (mgr.34109) 1508 : cluster [DBG] pgmap v1591: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:45.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:45 smithi031 bash[18426]: cluster 2020-06-27T05:29:43.397304+0000 mgr.x (mgr.34109) 1508 : cluster [DBG] pgmap v1591: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:45.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:45 smithi031 bash[22603]: cluster 2020-06-27T05:29:43.397304+0000 mgr.x (mgr.34109) 1508 : cluster [DBG] pgmap v1591: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:47.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:47 smithi051 bash[18409]: cluster 2020-06-27T05:29:45.398910+0000 mgr.x (mgr.34109) 1509 : cluster [DBG] pgmap v1592: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:47.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:47 smithi031 bash[18426]: cluster 2020-06-27T05:29:45.398910+0000 mgr.x (mgr.34109) 1509 : cluster [DBG] pgmap v1592: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:47.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:47 smithi031 bash[22603]: cluster 2020-06-27T05:29:45.398910+0000 mgr.x (mgr.34109) 1509 : cluster [DBG] pgmap v1592: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:49.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:49 smithi051 bash[18409]: cluster 2020-06-27T05:29:47.400555+0000 mgr.x (mgr.34109) 1510 : cluster [DBG] pgmap v1593: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:49.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:49 smithi031 bash[18426]: cluster 2020-06-27T05:29:47.400555+0000 mgr.x (mgr.34109) 1510 : cluster [DBG] pgmap v1593: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:49.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:49 smithi031 bash[22603]: cluster 2020-06-27T05:29:47.400555+0000 mgr.x (mgr.34109) 1510 : cluster [DBG] pgmap v1593: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:51.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:51 smithi051 bash[18409]: cluster 2020-06-27T05:29:49.402161+0000 mgr.x (mgr.34109) 1511 : cluster [DBG] pgmap v1594: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:51.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:51 smithi031 bash[18426]: cluster 2020-06-27T05:29:49.402161+0000 mgr.x (mgr.34109) 1511 : cluster [DBG] pgmap v1594: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:51.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:51 smithi031 bash[22603]: cluster 2020-06-27T05:29:49.402161+0000 mgr.x (mgr.34109) 1511 : cluster [DBG] pgmap v1594: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:53.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:53 smithi051 bash[18409]: cluster 2020-06-27T05:29:51.403921+0000 mgr.x (mgr.34109) 1512 : cluster [DBG] pgmap v1595: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:53.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:53 smithi031 bash[18426]: cluster 2020-06-27T05:29:51.403921+0000 mgr.x (mgr.34109) 1512 : cluster [DBG] pgmap v1595: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:53.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:53 smithi031 bash[22603]: cluster 2020-06-27T05:29:51.403921+0000 mgr.x (mgr.34109) 1512 : cluster [DBG] pgmap v1595: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:55.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:55 smithi051 bash[18409]: cluster 2020-06-27T05:29:53.405601+0000 mgr.x (mgr.34109) 1513 : cluster [DBG] pgmap v1596: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:55.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:55 smithi031 bash[18426]: cluster 2020-06-27T05:29:53.405601+0000 mgr.x (mgr.34109) 1513 : cluster [DBG] pgmap v1596: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:55.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:55 smithi031 bash[22603]: cluster 2020-06-27T05:29:53.405601+0000 mgr.x (mgr.34109) 1513 : cluster [DBG] pgmap v1596: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:57.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:57 smithi051 bash[18409]: cluster 2020-06-27T05:29:55.407326+0000 mgr.x (mgr.34109) 1514 : cluster [DBG] pgmap v1597: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:57.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:57 smithi031 bash[18426]: cluster 2020-06-27T05:29:55.407326+0000 mgr.x (mgr.34109) 1514 : cluster [DBG] pgmap v1597: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:57.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:57 smithi031 bash[22603]: cluster 2020-06-27T05:29:55.407326+0000 mgr.x (mgr.34109) 1514 : cluster [DBG] pgmap v1597: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:59.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:29:59 smithi051 bash[18409]: cluster 2020-06-27T05:29:57.408974+0000 mgr.x (mgr.34109) 1515 : cluster [DBG] pgmap v1598: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:59.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:29:59 smithi031 bash[18426]: cluster 2020-06-27T05:29:57.408974+0000 mgr.x (mgr.34109) 1515 : cluster [DBG] pgmap v1598: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:29:59.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:29:59 smithi031 bash[22603]: cluster 2020-06-27T05:29:57.408974+0000 mgr.x (mgr.34109) 1515 : cluster [DBG] pgmap v1598: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:01.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:00 smithi051 bash[18409]: cluster 2020-06-27T05:29:59.410682+0000 mgr.x (mgr.34109) 1516 : cluster [DBG] pgmap v1599: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:01.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:00 smithi031 bash[18426]: cluster 2020-06-27T05:29:59.410682+0000 mgr.x (mgr.34109) 1516 : cluster [DBG] pgmap v1599: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:01.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:00 smithi031 bash[22603]: cluster 2020-06-27T05:29:59.410682+0000 mgr.x (mgr.34109) 1516 : cluster [DBG] pgmap v1599: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:03.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:02 smithi051 bash[18409]: cluster 2020-06-27T05:30:01.412474+0000 mgr.x (mgr.34109) 1517 : cluster [DBG] pgmap v1600: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:03.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:02 smithi031 bash[18426]: cluster 2020-06-27T05:30:01.412474+0000 mgr.x (mgr.34109) 1517 : cluster [DBG] pgmap v1600: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:03.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:02 smithi031 bash[22603]: cluster 2020-06-27T05:30:01.412474+0000 mgr.x (mgr.34109) 1517 : cluster [DBG] pgmap v1600: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:05.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:04 smithi051 bash[18409]: cluster 2020-06-27T05:30:03.414131+0000 mgr.x (mgr.34109) 1518 : cluster [DBG] pgmap v1601: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:05.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:04 smithi031 bash[18426]: cluster 2020-06-27T05:30:03.414131+0000 mgr.x (mgr.34109) 1518 : cluster [DBG] pgmap v1601: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:05.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:04 smithi031 bash[22603]: cluster 2020-06-27T05:30:03.414131+0000 mgr.x (mgr.34109) 1518 : cluster [DBG] pgmap v1601: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:07.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:06 smithi051 bash[18409]: cluster 2020-06-27T05:30:05.415767+0000 mgr.x (mgr.34109) 1519 : cluster [DBG] pgmap v1602: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:07.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:06 smithi031 bash[18426]: cluster 2020-06-27T05:30:05.415767+0000 mgr.x (mgr.34109) 1519 : cluster [DBG] pgmap v1602: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:07.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:06 smithi031 bash[22603]: cluster 2020-06-27T05:30:05.415767+0000 mgr.x (mgr.34109) 1519 : cluster [DBG] pgmap v1602: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:09.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:08 smithi031 bash[18426]: cluster 2020-06-27T05:30:07.417435+0000 mgr.x (mgr.34109) 1520 : cluster [DBG] pgmap v1603: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:09.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:08 smithi031 bash[22603]: cluster 2020-06-27T05:30:07.417435+0000 mgr.x (mgr.34109) 1520 : cluster [DBG] pgmap v1603: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:09.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:08 smithi051 bash[18409]: cluster 2020-06-27T05:30:07.417435+0000 mgr.x (mgr.34109) 1520 : cluster [DBG] pgmap v1603: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:11.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:10 smithi051 bash[18409]: cluster 2020-06-27T05:30:09.419258+0000 mgr.x (mgr.34109) 1521 : cluster [DBG] pgmap v1604: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:10 smithi031 bash[18426]: cluster 2020-06-27T05:30:09.419258+0000 mgr.x (mgr.34109) 1521 : cluster [DBG] pgmap v1604: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:11.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:10 smithi031 bash[22603]: cluster 2020-06-27T05:30:09.419258+0000 mgr.x (mgr.34109) 1521 : cluster [DBG] pgmap v1604: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:13.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:12 smithi051 bash[18409]: cluster 2020-06-27T05:30:11.420935+0000 mgr.x (mgr.34109) 1522 : cluster [DBG] pgmap v1605: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:13.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:12 smithi031 bash[18426]: cluster 2020-06-27T05:30:11.420935+0000 mgr.x (mgr.34109) 1522 : cluster [DBG] pgmap v1605: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:13.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:12 smithi031 bash[22603]: cluster 2020-06-27T05:30:11.420935+0000 mgr.x (mgr.34109) 1522 : cluster [DBG] pgmap v1605: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:15.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:14 smithi051 bash[18409]: cluster 2020-06-27T05:30:13.422482+0000 mgr.x (mgr.34109) 1523 : cluster [DBG] pgmap v1606: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:15.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:14 smithi031 bash[18426]: cluster 2020-06-27T05:30:13.422482+0000 mgr.x (mgr.34109) 1523 : cluster [DBG] pgmap v1606: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:15.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:14 smithi031 bash[22603]: cluster 2020-06-27T05:30:13.422482+0000 mgr.x (mgr.34109) 1523 : cluster [DBG] pgmap v1606: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:17.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:16 smithi051 bash[18409]: cluster 2020-06-27T05:30:15.424203+0000 mgr.x (mgr.34109) 1524 : cluster [DBG] pgmap v1607: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:17.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:16 smithi031 bash[18426]: cluster 2020-06-27T05:30:15.424203+0000 mgr.x (mgr.34109) 1524 : cluster [DBG] pgmap v1607: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:17.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:16 smithi031 bash[22603]: cluster 2020-06-27T05:30:15.424203+0000 mgr.x (mgr.34109) 1524 : cluster [DBG] pgmap v1607: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:19.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:18 smithi051 bash[18409]: cluster 2020-06-27T05:30:17.425918+0000 mgr.x (mgr.34109) 1525 : cluster [DBG] pgmap v1608: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:19.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:18 smithi031 bash[18426]: cluster 2020-06-27T05:30:17.425918+0000 mgr.x (mgr.34109) 1525 : cluster [DBG] pgmap v1608: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:19.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:18 smithi031 bash[22603]: cluster 2020-06-27T05:30:17.425918+0000 mgr.x (mgr.34109) 1525 : cluster [DBG] pgmap v1608: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:21.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:21 smithi051 bash[18409]: cluster 2020-06-27T05:30:19.427595+0000 mgr.x (mgr.34109) 1526 : cluster [DBG] pgmap v1609: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:21.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:21 smithi031 bash[18426]: cluster 2020-06-27T05:30:19.427595+0000 mgr.x (mgr.34109) 1526 : cluster [DBG] pgmap v1609: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:21.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:21 smithi031 bash[22603]: cluster 2020-06-27T05:30:19.427595+0000 mgr.x (mgr.34109) 1526 : cluster [DBG] pgmap v1609: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:23.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:23 smithi051 bash[18409]: cluster 2020-06-27T05:30:21.429244+0000 mgr.x (mgr.34109) 1527 : cluster [DBG] pgmap v1610: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:23.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:23 smithi031 bash[18426]: cluster 2020-06-27T05:30:21.429244+0000 mgr.x (mgr.34109) 1527 : cluster [DBG] pgmap v1610: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:23.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:23 smithi031 bash[22603]: cluster 2020-06-27T05:30:21.429244+0000 mgr.x (mgr.34109) 1527 : cluster [DBG] pgmap v1610: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:25.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:25 smithi051 bash[18409]: cluster 2020-06-27T05:30:23.430980+0000 mgr.x (mgr.34109) 1528 : cluster [DBG] pgmap v1611: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:25.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:25 smithi031 bash[18426]: cluster 2020-06-27T05:30:23.430980+0000 mgr.x (mgr.34109) 1528 : cluster [DBG] pgmap v1611: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:25.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:25 smithi031 bash[22603]: cluster 2020-06-27T05:30:23.430980+0000 mgr.x (mgr.34109) 1528 : cluster [DBG] pgmap v1611: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:27.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:27 smithi051 bash[18409]: cluster 2020-06-27T05:30:25.432557+0000 mgr.x (mgr.34109) 1529 : cluster [DBG] pgmap v1612: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:27.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:27 smithi031 bash[18426]: cluster 2020-06-27T05:30:25.432557+0000 mgr.x (mgr.34109) 1529 : cluster [DBG] pgmap v1612: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:27.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:27 smithi031 bash[22603]: cluster 2020-06-27T05:30:25.432557+0000 mgr.x (mgr.34109) 1529 : cluster [DBG] pgmap v1612: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:29.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:29 smithi051 bash[18409]: cluster 2020-06-27T05:30:27.434216+0000 mgr.x (mgr.34109) 1530 : cluster [DBG] pgmap v1613: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:29.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:29 smithi031 bash[18426]: cluster 2020-06-27T05:30:27.434216+0000 mgr.x (mgr.34109) 1530 : cluster [DBG] pgmap v1613: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:29.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:29 smithi031 bash[22603]: cluster 2020-06-27T05:30:27.434216+0000 mgr.x (mgr.34109) 1530 : cluster [DBG] pgmap v1613: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:31.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:31 smithi051 bash[18409]: cluster 2020-06-27T05:30:29.435922+0000 mgr.x (mgr.34109) 1531 : cluster [DBG] pgmap v1614: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:31.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:31 smithi031 bash[18426]: cluster 2020-06-27T05:30:29.435922+0000 mgr.x (mgr.34109) 1531 : cluster [DBG] pgmap v1614: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:31.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:31 smithi031 bash[22603]: cluster 2020-06-27T05:30:29.435922+0000 mgr.x (mgr.34109) 1531 : cluster [DBG] pgmap v1614: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:33.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:33 smithi051 bash[18409]: cluster 2020-06-27T05:30:31.437658+0000 mgr.x (mgr.34109) 1532 : cluster [DBG] pgmap v1615: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:33.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:33 smithi031 bash[18426]: cluster 2020-06-27T05:30:31.437658+0000 mgr.x (mgr.34109) 1532 : cluster [DBG] pgmap v1615: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:33.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:33 smithi031 bash[22603]: cluster 2020-06-27T05:30:31.437658+0000 mgr.x (mgr.34109) 1532 : cluster [DBG] pgmap v1615: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:35.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:35 smithi051 bash[18409]: cluster 2020-06-27T05:30:33.439347+0000 mgr.x (mgr.34109) 1533 : cluster [DBG] pgmap v1616: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:35.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:35 smithi031 bash[18426]: cluster 2020-06-27T05:30:33.439347+0000 mgr.x (mgr.34109) 1533 : cluster [DBG] pgmap v1616: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:35.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:35 smithi031 bash[22603]: cluster 2020-06-27T05:30:33.439347+0000 mgr.x (mgr.34109) 1533 : cluster [DBG] pgmap v1616: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:37.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:37 smithi051 bash[18409]: cluster 2020-06-27T05:30:35.440906+0000 mgr.x (mgr.34109) 1534 : cluster [DBG] pgmap v1617: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:37.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:37 smithi031 bash[18426]: cluster 2020-06-27T05:30:35.440906+0000 mgr.x (mgr.34109) 1534 : cluster [DBG] pgmap v1617: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:37.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:37 smithi031 bash[22603]: cluster 2020-06-27T05:30:35.440906+0000 mgr.x (mgr.34109) 1534 : cluster [DBG] pgmap v1617: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:39.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:39 smithi051 bash[18409]: cluster 2020-06-27T05:30:37.442642+0000 mgr.x (mgr.34109) 1535 : cluster [DBG] pgmap v1618: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:39.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:39 smithi031 bash[18426]: cluster 2020-06-27T05:30:37.442642+0000 mgr.x (mgr.34109) 1535 : cluster [DBG] pgmap v1618: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:39.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:39 smithi031 bash[22603]: cluster 2020-06-27T05:30:37.442642+0000 mgr.x (mgr.34109) 1535 : cluster [DBG] pgmap v1618: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:41.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:41 smithi051 bash[18409]: cluster 2020-06-27T05:30:39.444257+0000 mgr.x (mgr.34109) 1536 : cluster [DBG] pgmap v1619: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:41.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:41 smithi031 bash[18426]: cluster 2020-06-27T05:30:39.444257+0000 mgr.x (mgr.34109) 1536 : cluster [DBG] pgmap v1619: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:41.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:41 smithi031 bash[22603]: cluster 2020-06-27T05:30:39.444257+0000 mgr.x (mgr.34109) 1536 : cluster [DBG] pgmap v1619: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:43.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:43 smithi051 bash[18409]: cluster 2020-06-27T05:30:41.445857+0000 mgr.x (mgr.34109) 1537 : cluster [DBG] pgmap v1620: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:43.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:43 smithi031 bash[18426]: cluster 2020-06-27T05:30:41.445857+0000 mgr.x (mgr.34109) 1537 : cluster [DBG] pgmap v1620: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:43.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:43 smithi031 bash[22603]: cluster 2020-06-27T05:30:41.445857+0000 mgr.x (mgr.34109) 1537 : cluster [DBG] pgmap v1620: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:45.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:45 smithi051 bash[18409]: cluster 2020-06-27T05:30:43.447569+0000 mgr.x (mgr.34109) 1538 : cluster [DBG] pgmap v1621: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:45.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:45 smithi031 bash[22603]: cluster 2020-06-27T05:30:43.447569+0000 mgr.x (mgr.34109) 1538 : cluster [DBG] pgmap v1621: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:45.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:45 smithi031 bash[18426]: cluster 2020-06-27T05:30:43.447569+0000 mgr.x (mgr.34109) 1538 : cluster [DBG] pgmap v1621: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:47.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:47 smithi051 bash[18409]: cluster 2020-06-27T05:30:45.449238+0000 mgr.x (mgr.34109) 1539 : cluster [DBG] pgmap v1622: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:47.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:47 smithi031 bash[18426]: cluster 2020-06-27T05:30:45.449238+0000 mgr.x (mgr.34109) 1539 : cluster [DBG] pgmap v1622: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:47.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:47 smithi031 bash[22603]: cluster 2020-06-27T05:30:45.449238+0000 mgr.x (mgr.34109) 1539 : cluster [DBG] pgmap v1622: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:49.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:49 smithi051 bash[18409]: cluster 2020-06-27T05:30:47.450931+0000 mgr.x (mgr.34109) 1540 : cluster [DBG] pgmap v1623: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:49.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:49 smithi031 bash[18426]: cluster 2020-06-27T05:30:47.450931+0000 mgr.x (mgr.34109) 1540 : cluster [DBG] pgmap v1623: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:49.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:49 smithi031 bash[22603]: cluster 2020-06-27T05:30:47.450931+0000 mgr.x (mgr.34109) 1540 : cluster [DBG] pgmap v1623: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:51.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:51 smithi051 bash[18409]: cluster 2020-06-27T05:30:49.452550+0000 mgr.x (mgr.34109) 1541 : cluster [DBG] pgmap v1624: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:51.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:51 smithi031 bash[18426]: cluster 2020-06-27T05:30:49.452550+0000 mgr.x (mgr.34109) 1541 : cluster [DBG] pgmap v1624: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:51.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:51 smithi031 bash[22603]: cluster 2020-06-27T05:30:49.452550+0000 mgr.x (mgr.34109) 1541 : cluster [DBG] pgmap v1624: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:53.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:53 smithi051 bash[18409]: cluster 2020-06-27T05:30:51.454204+0000 mgr.x (mgr.34109) 1542 : cluster [DBG] pgmap v1625: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:53.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:53 smithi031 bash[18426]: cluster 2020-06-27T05:30:51.454204+0000 mgr.x (mgr.34109) 1542 : cluster [DBG] pgmap v1625: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:53.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:53 smithi031 bash[22603]: cluster 2020-06-27T05:30:51.454204+0000 mgr.x (mgr.34109) 1542 : cluster [DBG] pgmap v1625: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:55.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:55 smithi051 bash[18409]: cluster 2020-06-27T05:30:53.455780+0000 mgr.x (mgr.34109) 1543 : cluster [DBG] pgmap v1626: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:55.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:55 smithi031 bash[18426]: cluster 2020-06-27T05:30:53.455780+0000 mgr.x (mgr.34109) 1543 : cluster [DBG] pgmap v1626: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:55.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:55 smithi031 bash[22603]: cluster 2020-06-27T05:30:53.455780+0000 mgr.x (mgr.34109) 1543 : cluster [DBG] pgmap v1626: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:57.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:57 smithi051 bash[18409]: cluster 2020-06-27T05:30:55.457423+0000 mgr.x (mgr.34109) 1544 : cluster [DBG] pgmap v1627: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:57.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:57 smithi031 bash[18426]: cluster 2020-06-27T05:30:55.457423+0000 mgr.x (mgr.34109) 1544 : cluster [DBG] pgmap v1627: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:57.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:57 smithi031 bash[22603]: cluster 2020-06-27T05:30:55.457423+0000 mgr.x (mgr.34109) 1544 : cluster [DBG] pgmap v1627: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:59.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:30:59 smithi051 bash[18409]: cluster 2020-06-27T05:30:57.459051+0000 mgr.x (mgr.34109) 1545 : cluster [DBG] pgmap v1628: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:59.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:30:59 smithi031 bash[18426]: cluster 2020-06-27T05:30:57.459051+0000 mgr.x (mgr.34109) 1545 : cluster [DBG] pgmap v1628: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:30:59.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:30:59 smithi031 bash[22603]: cluster 2020-06-27T05:30:57.459051+0000 mgr.x (mgr.34109) 1545 : cluster [DBG] pgmap v1628: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:01.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:01 smithi051 bash[18409]: cluster 2020-06-27T05:30:59.460709+0000 mgr.x (mgr.34109) 1546 : cluster [DBG] pgmap v1629: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:01.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:01 smithi031 bash[18426]: cluster 2020-06-27T05:30:59.460709+0000 mgr.x (mgr.34109) 1546 : cluster [DBG] pgmap v1629: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:01.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:01 smithi031 bash[22603]: cluster 2020-06-27T05:30:59.460709+0000 mgr.x (mgr.34109) 1546 : cluster [DBG] pgmap v1629: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:03.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:03 smithi051 bash[18409]: cluster 2020-06-27T05:31:01.462312+0000 mgr.x (mgr.34109) 1547 : cluster [DBG] pgmap v1630: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:03.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:03 smithi031 bash[18426]: cluster 2020-06-27T05:31:01.462312+0000 mgr.x (mgr.34109) 1547 : cluster [DBG] pgmap v1630: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:03.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:03 smithi031 bash[22603]: cluster 2020-06-27T05:31:01.462312+0000 mgr.x (mgr.34109) 1547 : cluster [DBG] pgmap v1630: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:05.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:05 smithi051 bash[18409]: cluster 2020-06-27T05:31:03.464024+0000 mgr.x (mgr.34109) 1548 : cluster [DBG] pgmap v1631: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:05.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:05 smithi031 bash[18426]: cluster 2020-06-27T05:31:03.464024+0000 mgr.x (mgr.34109) 1548 : cluster [DBG] pgmap v1631: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:05.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:05 smithi031 bash[22603]: cluster 2020-06-27T05:31:03.464024+0000 mgr.x (mgr.34109) 1548 : cluster [DBG] pgmap v1631: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:07.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:07 smithi051 bash[18409]: cluster 2020-06-27T05:31:05.465743+0000 mgr.x (mgr.34109) 1549 : cluster [DBG] pgmap v1632: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:07.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:07 smithi031 bash[18426]: cluster 2020-06-27T05:31:05.465743+0000 mgr.x (mgr.34109) 1549 : cluster [DBG] pgmap v1632: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:07.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:07 smithi031 bash[22603]: cluster 2020-06-27T05:31:05.465743+0000 mgr.x (mgr.34109) 1549 : cluster [DBG] pgmap v1632: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:09.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:09 smithi051 bash[18409]: cluster 2020-06-27T05:31:07.467414+0000 mgr.x (mgr.34109) 1550 : cluster [DBG] pgmap v1633: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:09.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:09 smithi031 bash[18426]: cluster 2020-06-27T05:31:07.467414+0000 mgr.x (mgr.34109) 1550 : cluster [DBG] pgmap v1633: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:09.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:09 smithi031 bash[22603]: cluster 2020-06-27T05:31:07.467414+0000 mgr.x (mgr.34109) 1550 : cluster [DBG] pgmap v1633: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:11.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:11 smithi051 bash[18409]: cluster 2020-06-27T05:31:09.468995+0000 mgr.x (mgr.34109) 1551 : cluster [DBG] pgmap v1634: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:11 smithi031 bash[18426]: cluster 2020-06-27T05:31:09.468995+0000 mgr.x (mgr.34109) 1551 : cluster [DBG] pgmap v1634: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:11.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:11 smithi031 bash[22603]: cluster 2020-06-27T05:31:09.468995+0000 mgr.x (mgr.34109) 1551 : cluster [DBG] pgmap v1634: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:13.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:13 smithi051 bash[18409]: cluster 2020-06-27T05:31:11.470590+0000 mgr.x (mgr.34109) 1552 : cluster [DBG] pgmap v1635: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:13.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:13 smithi031 bash[18426]: cluster 2020-06-27T05:31:11.470590+0000 mgr.x (mgr.34109) 1552 : cluster [DBG] pgmap v1635: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:13.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:13 smithi031 bash[22603]: cluster 2020-06-27T05:31:11.470590+0000 mgr.x (mgr.34109) 1552 : cluster [DBG] pgmap v1635: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:15.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:15 smithi051 bash[18409]: cluster 2020-06-27T05:31:13.472092+0000 mgr.x (mgr.34109) 1553 : cluster [DBG] pgmap v1636: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:15.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:15 smithi031 bash[22603]: cluster 2020-06-27T05:31:13.472092+0000 mgr.x (mgr.34109) 1553 : cluster [DBG] pgmap v1636: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:15.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:15 smithi031 bash[18426]: cluster 2020-06-27T05:31:13.472092+0000 mgr.x (mgr.34109) 1553 : cluster [DBG] pgmap v1636: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:17.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:17 smithi051 bash[18409]: cluster 2020-06-27T05:31:15.473695+0000 mgr.x (mgr.34109) 1554 : cluster [DBG] pgmap v1637: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:17.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:17 smithi031 bash[22603]: cluster 2020-06-27T05:31:15.473695+0000 mgr.x (mgr.34109) 1554 : cluster [DBG] pgmap v1637: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:17.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:17 smithi031 bash[18426]: cluster 2020-06-27T05:31:15.473695+0000 mgr.x (mgr.34109) 1554 : cluster [DBG] pgmap v1637: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:19.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:19 smithi051 bash[18409]: cluster 2020-06-27T05:31:17.475254+0000 mgr.x (mgr.34109) 1555 : cluster [DBG] pgmap v1638: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:19.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:19 smithi031 bash[22603]: cluster 2020-06-27T05:31:17.475254+0000 mgr.x (mgr.34109) 1555 : cluster [DBG] pgmap v1638: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:19.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:19 smithi031 bash[18426]: cluster 2020-06-27T05:31:17.475254+0000 mgr.x (mgr.34109) 1555 : cluster [DBG] pgmap v1638: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:21.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:21 smithi051 bash[18409]: cluster 2020-06-27T05:31:19.476914+0000 mgr.x (mgr.34109) 1556 : cluster [DBG] pgmap v1639: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:21.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:21 smithi031 bash[18426]: cluster 2020-06-27T05:31:19.476914+0000 mgr.x (mgr.34109) 1556 : cluster [DBG] pgmap v1639: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:21.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:21 smithi031 bash[22603]: cluster 2020-06-27T05:31:19.476914+0000 mgr.x (mgr.34109) 1556 : cluster [DBG] pgmap v1639: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:23.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:23 smithi051 bash[18409]: cluster 2020-06-27T05:31:21.478546+0000 mgr.x (mgr.34109) 1557 : cluster [DBG] pgmap v1640: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:23.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:23 smithi031 bash[18426]: cluster 2020-06-27T05:31:21.478546+0000 mgr.x (mgr.34109) 1557 : cluster [DBG] pgmap v1640: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:23.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:23 smithi031 bash[22603]: cluster 2020-06-27T05:31:21.478546+0000 mgr.x (mgr.34109) 1557 : cluster [DBG] pgmap v1640: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:25.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:25 smithi051 bash[18409]: cluster 2020-06-27T05:31:23.480083+0000 mgr.x (mgr.34109) 1558 : cluster [DBG] pgmap v1641: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:25.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:25 smithi031 bash[18426]: cluster 2020-06-27T05:31:23.480083+0000 mgr.x (mgr.34109) 1558 : cluster [DBG] pgmap v1641: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:25.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:25 smithi031 bash[22603]: cluster 2020-06-27T05:31:23.480083+0000 mgr.x (mgr.34109) 1558 : cluster [DBG] pgmap v1641: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:27.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:27 smithi051 bash[18409]: cluster 2020-06-27T05:31:25.481756+0000 mgr.x (mgr.34109) 1559 : cluster [DBG] pgmap v1642: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:27.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:27 smithi031 bash[18426]: cluster 2020-06-27T05:31:25.481756+0000 mgr.x (mgr.34109) 1559 : cluster [DBG] pgmap v1642: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:27.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:27 smithi031 bash[22603]: cluster 2020-06-27T05:31:25.481756+0000 mgr.x (mgr.34109) 1559 : cluster [DBG] pgmap v1642: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:29.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:29 smithi051 bash[18409]: cluster 2020-06-27T05:31:27.483380+0000 mgr.x (mgr.34109) 1560 : cluster [DBG] pgmap v1643: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:29.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:29 smithi031 bash[18426]: cluster 2020-06-27T05:31:27.483380+0000 mgr.x (mgr.34109) 1560 : cluster [DBG] pgmap v1643: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:29.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:29 smithi031 bash[22603]: cluster 2020-06-27T05:31:27.483380+0000 mgr.x (mgr.34109) 1560 : cluster [DBG] pgmap v1643: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:31.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:31 smithi051 bash[18409]: cluster 2020-06-27T05:31:29.485022+0000 mgr.x (mgr.34109) 1561 : cluster [DBG] pgmap v1644: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:31.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:31 smithi031 bash[18426]: cluster 2020-06-27T05:31:29.485022+0000 mgr.x (mgr.34109) 1561 : cluster [DBG] pgmap v1644: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:31.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:31 smithi031 bash[22603]: cluster 2020-06-27T05:31:29.485022+0000 mgr.x (mgr.34109) 1561 : cluster [DBG] pgmap v1644: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:33.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:33 smithi051 bash[18409]: cluster 2020-06-27T05:31:31.486758+0000 mgr.x (mgr.34109) 1562 : cluster [DBG] pgmap v1645: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:33.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:33 smithi031 bash[18426]: cluster 2020-06-27T05:31:31.486758+0000 mgr.x (mgr.34109) 1562 : cluster [DBG] pgmap v1645: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:33.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:33 smithi031 bash[22603]: cluster 2020-06-27T05:31:31.486758+0000 mgr.x (mgr.34109) 1562 : cluster [DBG] pgmap v1645: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:35.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:35 smithi051 bash[18409]: cluster 2020-06-27T05:31:33.488468+0000 mgr.x (mgr.34109) 1563 : cluster [DBG] pgmap v1646: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:35.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:35 smithi031 bash[18426]: cluster 2020-06-27T05:31:33.488468+0000 mgr.x (mgr.34109) 1563 : cluster [DBG] pgmap v1646: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:35.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:35 smithi031 bash[22603]: cluster 2020-06-27T05:31:33.488468+0000 mgr.x (mgr.34109) 1563 : cluster [DBG] pgmap v1646: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:37.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:37 smithi051 bash[18409]: cluster 2020-06-27T05:31:35.490139+0000 mgr.x (mgr.34109) 1564 : cluster [DBG] pgmap v1647: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:37.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:37 smithi031 bash[18426]: cluster 2020-06-27T05:31:35.490139+0000 mgr.x (mgr.34109) 1564 : cluster [DBG] pgmap v1647: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:37.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:37 smithi031 bash[22603]: cluster 2020-06-27T05:31:35.490139+0000 mgr.x (mgr.34109) 1564 : cluster [DBG] pgmap v1647: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:39.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:39 smithi031 bash[18426]: cluster 2020-06-27T05:31:37.491876+0000 mgr.x (mgr.34109) 1565 : cluster [DBG] pgmap v1648: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:39.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:39 smithi031 bash[22603]: cluster 2020-06-27T05:31:37.491876+0000 mgr.x (mgr.34109) 1565 : cluster [DBG] pgmap v1648: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:39.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:39 smithi051 bash[18409]: cluster 2020-06-27T05:31:37.491876+0000 mgr.x (mgr.34109) 1565 : cluster [DBG] pgmap v1648: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:41 smithi051 bash[18409]: cluster 2020-06-27T05:31:39.493555+0000 mgr.x (mgr.34109) 1566 : cluster [DBG] pgmap v1649: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:41 smithi031 bash[18426]: cluster 2020-06-27T05:31:39.493555+0000 mgr.x (mgr.34109) 1566 : cluster [DBG] pgmap v1649: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:41.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:41 smithi031 bash[22603]: cluster 2020-06-27T05:31:39.493555+0000 mgr.x (mgr.34109) 1566 : cluster [DBG] pgmap v1649: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:43 smithi051 bash[18409]: cluster 2020-06-27T05:31:41.495158+0000 mgr.x (mgr.34109) 1567 : cluster [DBG] pgmap v1650: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:43.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:43 smithi031 bash[18426]: cluster 2020-06-27T05:31:41.495158+0000 mgr.x (mgr.34109) 1567 : cluster [DBG] pgmap v1650: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:43 smithi031 bash[22603]: cluster 2020-06-27T05:31:41.495158+0000 mgr.x (mgr.34109) 1567 : cluster [DBG] pgmap v1650: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:45.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:45 smithi051 bash[18409]: cluster 2020-06-27T05:31:43.496889+0000 mgr.x (mgr.34109) 1568 : cluster [DBG] pgmap v1651: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:45.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:45 smithi031 bash[18426]: cluster 2020-06-27T05:31:43.496889+0000 mgr.x (mgr.34109) 1568 : cluster [DBG] pgmap v1651: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:45.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:45 smithi031 bash[22603]: cluster 2020-06-27T05:31:43.496889+0000 mgr.x (mgr.34109) 1568 : cluster [DBG] pgmap v1651: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:47.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:47 smithi051 bash[18409]: cluster 2020-06-27T05:31:45.498698+0000 mgr.x (mgr.34109) 1569 : cluster [DBG] pgmap v1652: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:47.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:47 smithi031 bash[18426]: cluster 2020-06-27T05:31:45.498698+0000 mgr.x (mgr.34109) 1569 : cluster [DBG] pgmap v1652: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:47.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:47 smithi031 bash[22603]: cluster 2020-06-27T05:31:45.498698+0000 mgr.x (mgr.34109) 1569 : cluster [DBG] pgmap v1652: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:49.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:49 smithi051 bash[18409]: cluster 2020-06-27T05:31:47.500385+0000 mgr.x (mgr.34109) 1570 : cluster [DBG] pgmap v1653: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:49.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:49 smithi031 bash[18426]: cluster 2020-06-27T05:31:47.500385+0000 mgr.x (mgr.34109) 1570 : cluster [DBG] pgmap v1653: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:49.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:49 smithi031 bash[22603]: cluster 2020-06-27T05:31:47.500385+0000 mgr.x (mgr.34109) 1570 : cluster [DBG] pgmap v1653: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:51.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:51 smithi051 bash[18409]: cluster 2020-06-27T05:31:49.502096+0000 mgr.x (mgr.34109) 1571 : cluster [DBG] pgmap v1654: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:51.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:51 smithi031 bash[18426]: cluster 2020-06-27T05:31:49.502096+0000 mgr.x (mgr.34109) 1571 : cluster [DBG] pgmap v1654: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:51.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:51 smithi031 bash[22603]: cluster 2020-06-27T05:31:49.502096+0000 mgr.x (mgr.34109) 1571 : cluster [DBG] pgmap v1654: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:53.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:53 smithi051 bash[18409]: cluster 2020-06-27T05:31:51.503751+0000 mgr.x (mgr.34109) 1572 : cluster [DBG] pgmap v1655: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:53.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:53 smithi031 bash[18426]: cluster 2020-06-27T05:31:51.503751+0000 mgr.x (mgr.34109) 1572 : cluster [DBG] pgmap v1655: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:53.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:53 smithi031 bash[22603]: cluster 2020-06-27T05:31:51.503751+0000 mgr.x (mgr.34109) 1572 : cluster [DBG] pgmap v1655: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:55.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:55 smithi051 bash[18409]: cluster 2020-06-27T05:31:53.505346+0000 mgr.x (mgr.34109) 1573 : cluster [DBG] pgmap v1656: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:55.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:55 smithi031 bash[18426]: cluster 2020-06-27T05:31:53.505346+0000 mgr.x (mgr.34109) 1573 : cluster [DBG] pgmap v1656: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:55.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:55 smithi031 bash[22603]: cluster 2020-06-27T05:31:53.505346+0000 mgr.x (mgr.34109) 1573 : cluster [DBG] pgmap v1656: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:57.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:57 smithi051 bash[18409]: cluster 2020-06-27T05:31:55.506761+0000 mgr.x (mgr.34109) 1574 : cluster [DBG] pgmap v1657: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:57.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:57 smithi031 bash[18426]: cluster 2020-06-27T05:31:55.506761+0000 mgr.x (mgr.34109) 1574 : cluster [DBG] pgmap v1657: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:57.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:57 smithi031 bash[22603]: cluster 2020-06-27T05:31:55.506761+0000 mgr.x (mgr.34109) 1574 : cluster [DBG] pgmap v1657: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:58.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:31:58 smithi051 bash[18409]: cluster 2020-06-27T05:31:57.508526+0000 mgr.x (mgr.34109) 1575 : cluster [DBG] pgmap v1658: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:58.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:31:58 smithi031 bash[18426]: cluster 2020-06-27T05:31:57.508526+0000 mgr.x (mgr.34109) 1575 : cluster [DBG] pgmap v1658: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:31:58.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:31:58 smithi031 bash[22603]: cluster 2020-06-27T05:31:57.508526+0000 mgr.x (mgr.34109) 1575 : cluster [DBG] pgmap v1658: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:01.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:00 smithi051 bash[18409]: cluster 2020-06-27T05:31:59.510277+0000 mgr.x (mgr.34109) 1576 : cluster [DBG] pgmap v1659: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:01.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:00 smithi031 bash[18426]: cluster 2020-06-27T05:31:59.510277+0000 mgr.x (mgr.34109) 1576 : cluster [DBG] pgmap v1659: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:01.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:00 smithi031 bash[22603]: cluster 2020-06-27T05:31:59.510277+0000 mgr.x (mgr.34109) 1576 : cluster [DBG] pgmap v1659: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:03.227 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:02 smithi031 bash[18426]: cluster 2020-06-27T05:32:01.511879+0000 mgr.x (mgr.34109) 1577 : cluster [DBG] pgmap v1660: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:03.228 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:02 smithi031 bash[22603]: cluster 2020-06-27T05:32:01.511879+0000 mgr.x (mgr.34109) 1577 : cluster [DBG] pgmap v1660: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:03.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:02 smithi051 bash[18409]: cluster 2020-06-27T05:32:01.511879+0000 mgr.x (mgr.34109) 1577 : cluster [DBG] pgmap v1660: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:05.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:04 smithi051 bash[18409]: cluster 2020-06-27T05:32:03.525515+0000 mgr.x (mgr.34109) 1578 : cluster [DBG] pgmap v1661: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:05.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:04 smithi031 bash[22603]: cluster 2020-06-27T05:32:03.525515+0000 mgr.x (mgr.34109) 1578 : cluster [DBG] pgmap v1661: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:05.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:04 smithi031 bash[18426]: cluster 2020-06-27T05:32:03.525515+0000 mgr.x (mgr.34109) 1578 : cluster [DBG] pgmap v1661: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:07.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:06 smithi051 bash[18409]: cluster 2020-06-27T05:32:05.527203+0000 mgr.x (mgr.34109) 1579 : cluster [DBG] pgmap v1662: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:07.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:06 smithi031 bash[22603]: cluster 2020-06-27T05:32:05.527203+0000 mgr.x (mgr.34109) 1579 : cluster [DBG] pgmap v1662: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:07.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:06 smithi031 bash[18426]: cluster 2020-06-27T05:32:05.527203+0000 mgr.x (mgr.34109) 1579 : cluster [DBG] pgmap v1662: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:09.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:08 smithi051 bash[18409]: cluster 2020-06-27T05:32:07.528851+0000 mgr.x (mgr.34109) 1580 : cluster [DBG] pgmap v1663: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:09.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:08 smithi031 bash[22603]: cluster 2020-06-27T05:32:07.528851+0000 mgr.x (mgr.34109) 1580 : cluster [DBG] pgmap v1663: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:09.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:08 smithi031 bash[18426]: cluster 2020-06-27T05:32:07.528851+0000 mgr.x (mgr.34109) 1580 : cluster [DBG] pgmap v1663: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:11.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:10 smithi051 bash[18409]: cluster 2020-06-27T05:32:09.530504+0000 mgr.x (mgr.34109) 1581 : cluster [DBG] pgmap v1664: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:11.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:10 smithi031 bash[22603]: cluster 2020-06-27T05:32:09.530504+0000 mgr.x (mgr.34109) 1581 : cluster [DBG] pgmap v1664: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:10 smithi031 bash[18426]: cluster 2020-06-27T05:32:09.530504+0000 mgr.x (mgr.34109) 1581 : cluster [DBG] pgmap v1664: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:13.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:13 smithi051 bash[18409]: cluster 2020-06-27T05:32:11.532109+0000 mgr.x (mgr.34109) 1582 : cluster [DBG] pgmap v1665: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:13.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:13 smithi031 bash[22603]: cluster 2020-06-27T05:32:11.532109+0000 mgr.x (mgr.34109) 1582 : cluster [DBG] pgmap v1665: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:13.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:13 smithi031 bash[18426]: cluster 2020-06-27T05:32:11.532109+0000 mgr.x (mgr.34109) 1582 : cluster [DBG] pgmap v1665: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:15.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:15 smithi051 bash[18409]: cluster 2020-06-27T05:32:13.533748+0000 mgr.x (mgr.34109) 1583 : cluster [DBG] pgmap v1666: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:15.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:15 smithi031 bash[22603]: cluster 2020-06-27T05:32:13.533748+0000 mgr.x (mgr.34109) 1583 : cluster [DBG] pgmap v1666: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:15.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:15 smithi031 bash[18426]: cluster 2020-06-27T05:32:13.533748+0000 mgr.x (mgr.34109) 1583 : cluster [DBG] pgmap v1666: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:17.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:17 smithi051 bash[18409]: cluster 2020-06-27T05:32:15.535463+0000 mgr.x (mgr.34109) 1584 : cluster [DBG] pgmap v1667: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:17.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:17 smithi031 bash[22603]: cluster 2020-06-27T05:32:15.535463+0000 mgr.x (mgr.34109) 1584 : cluster [DBG] pgmap v1667: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:17.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:17 smithi031 bash[18426]: cluster 2020-06-27T05:32:15.535463+0000 mgr.x (mgr.34109) 1584 : cluster [DBG] pgmap v1667: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:19.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:19 smithi051 bash[18409]: cluster 2020-06-27T05:32:17.537053+0000 mgr.x (mgr.34109) 1585 : cluster [DBG] pgmap v1668: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:19.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:19 smithi031 bash[22603]: cluster 2020-06-27T05:32:17.537053+0000 mgr.x (mgr.34109) 1585 : cluster [DBG] pgmap v1668: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:19.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:19 smithi031 bash[18426]: cluster 2020-06-27T05:32:17.537053+0000 mgr.x (mgr.34109) 1585 : cluster [DBG] pgmap v1668: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:21.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:21 smithi051 bash[18409]: cluster 2020-06-27T05:32:19.538703+0000 mgr.x (mgr.34109) 1586 : cluster [DBG] pgmap v1669: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:21.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:21 smithi031 bash[18426]: cluster 2020-06-27T05:32:19.538703+0000 mgr.x (mgr.34109) 1586 : cluster [DBG] pgmap v1669: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:21.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:21 smithi031 bash[22603]: cluster 2020-06-27T05:32:19.538703+0000 mgr.x (mgr.34109) 1586 : cluster [DBG] pgmap v1669: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:23.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:23 smithi051 bash[18409]: cluster 2020-06-27T05:32:21.540274+0000 mgr.x (mgr.34109) 1587 : cluster [DBG] pgmap v1670: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:23.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:23 smithi031 bash[22603]: cluster 2020-06-27T05:32:21.540274+0000 mgr.x (mgr.34109) 1587 : cluster [DBG] pgmap v1670: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:23.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:23 smithi031 bash[18426]: cluster 2020-06-27T05:32:21.540274+0000 mgr.x (mgr.34109) 1587 : cluster [DBG] pgmap v1670: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:25.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:25 smithi051 bash[18409]: cluster 2020-06-27T05:32:23.541958+0000 mgr.x (mgr.34109) 1588 : cluster [DBG] pgmap v1671: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:25.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:25 smithi031 bash[22603]: cluster 2020-06-27T05:32:23.541958+0000 mgr.x (mgr.34109) 1588 : cluster [DBG] pgmap v1671: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:25.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:25 smithi031 bash[18426]: cluster 2020-06-27T05:32:23.541958+0000 mgr.x (mgr.34109) 1588 : cluster [DBG] pgmap v1671: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:27.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:27 smithi051 bash[18409]: cluster 2020-06-27T05:32:25.543573+0000 mgr.x (mgr.34109) 1589 : cluster [DBG] pgmap v1672: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:27.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:27 smithi031 bash[18426]: cluster 2020-06-27T05:32:25.543573+0000 mgr.x (mgr.34109) 1589 : cluster [DBG] pgmap v1672: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:27.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:27 smithi031 bash[22603]: cluster 2020-06-27T05:32:25.543573+0000 mgr.x (mgr.34109) 1589 : cluster [DBG] pgmap v1672: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:29.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:29 smithi051 bash[18409]: cluster 2020-06-27T05:32:27.545169+0000 mgr.x (mgr.34109) 1590 : cluster [DBG] pgmap v1673: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:29.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:29 smithi031 bash[18426]: cluster 2020-06-27T05:32:27.545169+0000 mgr.x (mgr.34109) 1590 : cluster [DBG] pgmap v1673: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:29.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:29 smithi031 bash[22603]: cluster 2020-06-27T05:32:27.545169+0000 mgr.x (mgr.34109) 1590 : cluster [DBG] pgmap v1673: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:31.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:31 smithi051 bash[18409]: cluster 2020-06-27T05:32:29.546854+0000 mgr.x (mgr.34109) 1591 : cluster [DBG] pgmap v1674: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:31.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:31 smithi031 bash[22603]: cluster 2020-06-27T05:32:29.546854+0000 mgr.x (mgr.34109) 1591 : cluster [DBG] pgmap v1674: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:31.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:31 smithi031 bash[18426]: cluster 2020-06-27T05:32:29.546854+0000 mgr.x (mgr.34109) 1591 : cluster [DBG] pgmap v1674: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:33.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:33 smithi051 bash[18409]: cluster 2020-06-27T05:32:31.548526+0000 mgr.x (mgr.34109) 1592 : cluster [DBG] pgmap v1675: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:33.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:33 smithi031 bash[22603]: cluster 2020-06-27T05:32:31.548526+0000 mgr.x (mgr.34109) 1592 : cluster [DBG] pgmap v1675: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:33.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:33 smithi031 bash[18426]: cluster 2020-06-27T05:32:31.548526+0000 mgr.x (mgr.34109) 1592 : cluster [DBG] pgmap v1675: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:35.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:35 smithi051 bash[18409]: cluster 2020-06-27T05:32:33.550145+0000 mgr.x (mgr.34109) 1593 : cluster [DBG] pgmap v1676: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:35.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:35 smithi031 bash[22603]: cluster 2020-06-27T05:32:33.550145+0000 mgr.x (mgr.34109) 1593 : cluster [DBG] pgmap v1676: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:35.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:35 smithi031 bash[18426]: cluster 2020-06-27T05:32:33.550145+0000 mgr.x (mgr.34109) 1593 : cluster [DBG] pgmap v1676: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:37.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:37 smithi051 bash[18409]: cluster 2020-06-27T05:32:35.551871+0000 mgr.x (mgr.34109) 1594 : cluster [DBG] pgmap v1677: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:37.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:37 smithi031 bash[22603]: cluster 2020-06-27T05:32:35.551871+0000 mgr.x (mgr.34109) 1594 : cluster [DBG] pgmap v1677: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:37.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:37 smithi031 bash[18426]: cluster 2020-06-27T05:32:35.551871+0000 mgr.x (mgr.34109) 1594 : cluster [DBG] pgmap v1677: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:39.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:39 smithi051 bash[18409]: cluster 2020-06-27T05:32:37.553579+0000 mgr.x (mgr.34109) 1595 : cluster [DBG] pgmap v1678: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:39.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:39 smithi031 bash[22603]: cluster 2020-06-27T05:32:37.553579+0000 mgr.x (mgr.34109) 1595 : cluster [DBG] pgmap v1678: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:39.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:39 smithi031 bash[18426]: cluster 2020-06-27T05:32:37.553579+0000 mgr.x (mgr.34109) 1595 : cluster [DBG] pgmap v1678: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:41.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:41 smithi051 bash[18409]: cluster 2020-06-27T05:32:39.555214+0000 mgr.x (mgr.34109) 1596 : cluster [DBG] pgmap v1679: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:41.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:41 smithi031 bash[18426]: cluster 2020-06-27T05:32:39.555214+0000 mgr.x (mgr.34109) 1596 : cluster [DBG] pgmap v1679: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:41.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:41 smithi031 bash[22603]: cluster 2020-06-27T05:32:39.555214+0000 mgr.x (mgr.34109) 1596 : cluster [DBG] pgmap v1679: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:43.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:43 smithi051 bash[18409]: cluster 2020-06-27T05:32:41.557003+0000 mgr.x (mgr.34109) 1597 : cluster [DBG] pgmap v1680: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:43.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:43 smithi031 bash[18426]: cluster 2020-06-27T05:32:41.557003+0000 mgr.x (mgr.34109) 1597 : cluster [DBG] pgmap v1680: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:43.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:43 smithi031 bash[22603]: cluster 2020-06-27T05:32:41.557003+0000 mgr.x (mgr.34109) 1597 : cluster [DBG] pgmap v1680: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:45.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:45 smithi051 bash[18409]: cluster 2020-06-27T05:32:43.558669+0000 mgr.x (mgr.34109) 1598 : cluster [DBG] pgmap v1681: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:45.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:45 smithi031 bash[18426]: cluster 2020-06-27T05:32:43.558669+0000 mgr.x (mgr.34109) 1598 : cluster [DBG] pgmap v1681: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:45.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:45 smithi031 bash[22603]: cluster 2020-06-27T05:32:43.558669+0000 mgr.x (mgr.34109) 1598 : cluster [DBG] pgmap v1681: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:47.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:47 smithi051 bash[18409]: cluster 2020-06-27T05:32:45.560352+0000 mgr.x (mgr.34109) 1599 : cluster [DBG] pgmap v1682: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:47.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:47 smithi031 bash[22603]: cluster 2020-06-27T05:32:45.560352+0000 mgr.x (mgr.34109) 1599 : cluster [DBG] pgmap v1682: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:47.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:47 smithi031 bash[18426]: cluster 2020-06-27T05:32:45.560352+0000 mgr.x (mgr.34109) 1599 : cluster [DBG] pgmap v1682: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:49.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:49 smithi051 bash[18409]: cluster 2020-06-27T05:32:47.561989+0000 mgr.x (mgr.34109) 1600 : cluster [DBG] pgmap v1683: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:49.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:49 smithi031 bash[22603]: cluster 2020-06-27T05:32:47.561989+0000 mgr.x (mgr.34109) 1600 : cluster [DBG] pgmap v1683: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:49.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:49 smithi031 bash[18426]: cluster 2020-06-27T05:32:47.561989+0000 mgr.x (mgr.34109) 1600 : cluster [DBG] pgmap v1683: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:51.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:51 smithi051 bash[18409]: cluster 2020-06-27T05:32:49.563713+0000 mgr.x (mgr.34109) 1601 : cluster [DBG] pgmap v1684: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:51.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:51 smithi031 bash[18426]: cluster 2020-06-27T05:32:49.563713+0000 mgr.x (mgr.34109) 1601 : cluster [DBG] pgmap v1684: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:51.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:51 smithi031 bash[22603]: cluster 2020-06-27T05:32:49.563713+0000 mgr.x (mgr.34109) 1601 : cluster [DBG] pgmap v1684: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:53.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:53 smithi051 bash[18409]: cluster 2020-06-27T05:32:51.565319+0000 mgr.x (mgr.34109) 1602 : cluster [DBG] pgmap v1685: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:53.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:53 smithi031 bash[18426]: cluster 2020-06-27T05:32:51.565319+0000 mgr.x (mgr.34109) 1602 : cluster [DBG] pgmap v1685: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:53.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:53 smithi031 bash[22603]: cluster 2020-06-27T05:32:51.565319+0000 mgr.x (mgr.34109) 1602 : cluster [DBG] pgmap v1685: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:55.723 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:55 smithi051 bash[18409]: cluster 2020-06-27T05:32:53.567066+0000 mgr.x (mgr.34109) 1603 : cluster [DBG] pgmap v1686: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:55.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:55 smithi031 bash[18426]: cluster 2020-06-27T05:32:53.567066+0000 mgr.x (mgr.34109) 1603 : cluster [DBG] pgmap v1686: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:55.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:55 smithi031 bash[22603]: cluster 2020-06-27T05:32:53.567066+0000 mgr.x (mgr.34109) 1603 : cluster [DBG] pgmap v1686: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:57.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:57 smithi051 bash[18409]: cluster 2020-06-27T05:32:55.568728+0000 mgr.x (mgr.34109) 1604 : cluster [DBG] pgmap v1687: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:57.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:57 smithi031 bash[18426]: cluster 2020-06-27T05:32:55.568728+0000 mgr.x (mgr.34109) 1604 : cluster [DBG] pgmap v1687: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:57.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:57 smithi031 bash[22603]: cluster 2020-06-27T05:32:55.568728+0000 mgr.x (mgr.34109) 1604 : cluster [DBG] pgmap v1687: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:59.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:32:59 smithi051 bash[18409]: cluster 2020-06-27T05:32:57.570429+0000 mgr.x (mgr.34109) 1605 : cluster [DBG] pgmap v1688: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:59.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:32:59 smithi031 bash[18426]: cluster 2020-06-27T05:32:57.570429+0000 mgr.x (mgr.34109) 1605 : cluster [DBG] pgmap v1688: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:32:59.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:32:59 smithi031 bash[22603]: cluster 2020-06-27T05:32:57.570429+0000 mgr.x (mgr.34109) 1605 : cluster [DBG] pgmap v1688: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:01.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:01 smithi051 bash[18409]: cluster 2020-06-27T05:32:59.572026+0000 mgr.x (mgr.34109) 1606 : cluster [DBG] pgmap v1689: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:01.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:01 smithi031 bash[18426]: cluster 2020-06-27T05:32:59.572026+0000 mgr.x (mgr.34109) 1606 : cluster [DBG] pgmap v1689: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:01.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:01 smithi031 bash[22603]: cluster 2020-06-27T05:32:59.572026+0000 mgr.x (mgr.34109) 1606 : cluster [DBG] pgmap v1689: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:03.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:03 smithi051 bash[18409]: cluster 2020-06-27T05:33:01.573658+0000 mgr.x (mgr.34109) 1607 : cluster [DBG] pgmap v1690: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:03.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:03 smithi031 bash[18426]: cluster 2020-06-27T05:33:01.573658+0000 mgr.x (mgr.34109) 1607 : cluster [DBG] pgmap v1690: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:03.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:03 smithi031 bash[22603]: cluster 2020-06-27T05:33:01.573658+0000 mgr.x (mgr.34109) 1607 : cluster [DBG] pgmap v1690: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:05.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:05 smithi051 bash[18409]: cluster 2020-06-27T05:33:03.575351+0000 mgr.x (mgr.34109) 1608 : cluster [DBG] pgmap v1691: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:05 smithi031 bash[18426]: cluster 2020-06-27T05:33:03.575351+0000 mgr.x (mgr.34109) 1608 : cluster [DBG] pgmap v1691: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:05.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:05 smithi031 bash[22603]: cluster 2020-06-27T05:33:03.575351+0000 mgr.x (mgr.34109) 1608 : cluster [DBG] pgmap v1691: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:07.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:07 smithi051 bash[18409]: cluster 2020-06-27T05:33:05.576916+0000 mgr.x (mgr.34109) 1609 : cluster [DBG] pgmap v1692: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:07.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:07 smithi031 bash[18426]: cluster 2020-06-27T05:33:05.576916+0000 mgr.x (mgr.34109) 1609 : cluster [DBG] pgmap v1692: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:07.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:07 smithi031 bash[22603]: cluster 2020-06-27T05:33:05.576916+0000 mgr.x (mgr.34109) 1609 : cluster [DBG] pgmap v1692: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:09 smithi051 bash[18409]: cluster 2020-06-27T05:33:07.578552+0000 mgr.x (mgr.34109) 1610 : cluster [DBG] pgmap v1693: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:09.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:09 smithi031 bash[18426]: cluster 2020-06-27T05:33:07.578552+0000 mgr.x (mgr.34109) 1610 : cluster [DBG] pgmap v1693: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:09.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:09 smithi031 bash[22603]: cluster 2020-06-27T05:33:07.578552+0000 mgr.x (mgr.34109) 1610 : cluster [DBG] pgmap v1693: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:11.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:11 smithi051 bash[18409]: cluster 2020-06-27T05:33:09.580349+0000 mgr.x (mgr.34109) 1611 : cluster [DBG] pgmap v1694: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:11.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:11 smithi031 bash[22603]: cluster 2020-06-27T05:33:09.580349+0000 mgr.x (mgr.34109) 1611 : cluster [DBG] pgmap v1694: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:11.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:11 smithi031 bash[18426]: cluster 2020-06-27T05:33:09.580349+0000 mgr.x (mgr.34109) 1611 : cluster [DBG] pgmap v1694: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:13.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:13 smithi051 bash[18409]: cluster 2020-06-27T05:33:11.581996+0000 mgr.x (mgr.34109) 1612 : cluster [DBG] pgmap v1695: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:13.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:13 smithi031 bash[22603]: cluster 2020-06-27T05:33:11.581996+0000 mgr.x (mgr.34109) 1612 : cluster [DBG] pgmap v1695: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:13.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:13 smithi031 bash[18426]: cluster 2020-06-27T05:33:11.581996+0000 mgr.x (mgr.34109) 1612 : cluster [DBG] pgmap v1695: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:15.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:15 smithi051 bash[18409]: cluster 2020-06-27T05:33:13.583723+0000 mgr.x (mgr.34109) 1613 : cluster [DBG] pgmap v1696: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:15.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:15 smithi031 bash[18426]: cluster 2020-06-27T05:33:13.583723+0000 mgr.x (mgr.34109) 1613 : cluster [DBG] pgmap v1696: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:15.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:15 smithi031 bash[22603]: cluster 2020-06-27T05:33:13.583723+0000 mgr.x (mgr.34109) 1613 : cluster [DBG] pgmap v1696: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:17 smithi051 bash[18409]: cluster 2020-06-27T05:33:15.585446+0000 mgr.x (mgr.34109) 1614 : cluster [DBG] pgmap v1697: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:17.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:17 smithi031 bash[18426]: cluster 2020-06-27T05:33:15.585446+0000 mgr.x (mgr.34109) 1614 : cluster [DBG] pgmap v1697: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:17.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:17 smithi031 bash[22603]: cluster 2020-06-27T05:33:15.585446+0000 mgr.x (mgr.34109) 1614 : cluster [DBG] pgmap v1697: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:19.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:19 smithi051 bash[18409]: cluster 2020-06-27T05:33:17.587161+0000 mgr.x (mgr.34109) 1615 : cluster [DBG] pgmap v1698: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:19.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:19 smithi031 bash[18426]: cluster 2020-06-27T05:33:17.587161+0000 mgr.x (mgr.34109) 1615 : cluster [DBG] pgmap v1698: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:19.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:19 smithi031 bash[22603]: cluster 2020-06-27T05:33:17.587161+0000 mgr.x (mgr.34109) 1615 : cluster [DBG] pgmap v1698: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:21.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:21 smithi051 bash[18409]: cluster 2020-06-27T05:33:19.588775+0000 mgr.x (mgr.34109) 1616 : cluster [DBG] pgmap v1699: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:21.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:21 smithi031 bash[18426]: cluster 2020-06-27T05:33:19.588775+0000 mgr.x (mgr.34109) 1616 : cluster [DBG] pgmap v1699: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:21.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:21 smithi031 bash[22603]: cluster 2020-06-27T05:33:19.588775+0000 mgr.x (mgr.34109) 1616 : cluster [DBG] pgmap v1699: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:23.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:23 smithi051 bash[18409]: cluster 2020-06-27T05:33:21.590494+0000 mgr.x (mgr.34109) 1617 : cluster [DBG] pgmap v1700: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:23.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:23 smithi031 bash[18426]: cluster 2020-06-27T05:33:21.590494+0000 mgr.x (mgr.34109) 1617 : cluster [DBG] pgmap v1700: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:23.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:23 smithi031 bash[22603]: cluster 2020-06-27T05:33:21.590494+0000 mgr.x (mgr.34109) 1617 : cluster [DBG] pgmap v1700: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:25.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:25 smithi051 bash[18409]: cluster 2020-06-27T05:33:23.592153+0000 mgr.x (mgr.34109) 1618 : cluster [DBG] pgmap v1701: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:25.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:25 smithi031 bash[18426]: cluster 2020-06-27T05:33:23.592153+0000 mgr.x (mgr.34109) 1618 : cluster [DBG] pgmap v1701: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:25.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:25 smithi031 bash[22603]: cluster 2020-06-27T05:33:23.592153+0000 mgr.x (mgr.34109) 1618 : cluster [DBG] pgmap v1701: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:27.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:27 smithi051 bash[18409]: cluster 2020-06-27T05:33:25.593748+0000 mgr.x (mgr.34109) 1619 : cluster [DBG] pgmap v1702: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:27.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:27 smithi031 bash[22603]: cluster 2020-06-27T05:33:25.593748+0000 mgr.x (mgr.34109) 1619 : cluster [DBG] pgmap v1702: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:27.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:27 smithi031 bash[18426]: cluster 2020-06-27T05:33:25.593748+0000 mgr.x (mgr.34109) 1619 : cluster [DBG] pgmap v1702: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:29.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:29 smithi051 bash[18409]: cluster 2020-06-27T05:33:27.595365+0000 mgr.x (mgr.34109) 1620 : cluster [DBG] pgmap v1703: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:29.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:29 smithi031 bash[22603]: cluster 2020-06-27T05:33:27.595365+0000 mgr.x (mgr.34109) 1620 : cluster [DBG] pgmap v1703: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:29.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:29 smithi031 bash[18426]: cluster 2020-06-27T05:33:27.595365+0000 mgr.x (mgr.34109) 1620 : cluster [DBG] pgmap v1703: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:31.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:31 smithi051 bash[18409]: cluster 2020-06-27T05:33:29.597051+0000 mgr.x (mgr.34109) 1621 : cluster [DBG] pgmap v1704: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:31.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:31 smithi031 bash[18426]: cluster 2020-06-27T05:33:29.597051+0000 mgr.x (mgr.34109) 1621 : cluster [DBG] pgmap v1704: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:31.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:31 smithi031 bash[22603]: cluster 2020-06-27T05:33:29.597051+0000 mgr.x (mgr.34109) 1621 : cluster [DBG] pgmap v1704: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:33 smithi051 bash[18409]: cluster 2020-06-27T05:33:31.598651+0000 mgr.x (mgr.34109) 1622 : cluster [DBG] pgmap v1705: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:33.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:33 smithi031 bash[18426]: cluster 2020-06-27T05:33:31.598651+0000 mgr.x (mgr.34109) 1622 : cluster [DBG] pgmap v1705: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:33.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:33 smithi031 bash[22603]: cluster 2020-06-27T05:33:31.598651+0000 mgr.x (mgr.34109) 1622 : cluster [DBG] pgmap v1705: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:35.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:35 smithi051 bash[18409]: cluster 2020-06-27T05:33:33.600357+0000 mgr.x (mgr.34109) 1623 : cluster [DBG] pgmap v1706: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:35.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:35 smithi031 bash[18426]: cluster 2020-06-27T05:33:33.600357+0000 mgr.x (mgr.34109) 1623 : cluster [DBG] pgmap v1706: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:35.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:35 smithi031 bash[22603]: cluster 2020-06-27T05:33:33.600357+0000 mgr.x (mgr.34109) 1623 : cluster [DBG] pgmap v1706: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:37.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:37 smithi051 bash[18409]: cluster 2020-06-27T05:33:35.602053+0000 mgr.x (mgr.34109) 1624 : cluster [DBG] pgmap v1707: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:37.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:37 smithi031 bash[18426]: cluster 2020-06-27T05:33:35.602053+0000 mgr.x (mgr.34109) 1624 : cluster [DBG] pgmap v1707: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:37.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:37 smithi031 bash[22603]: cluster 2020-06-27T05:33:35.602053+0000 mgr.x (mgr.34109) 1624 : cluster [DBG] pgmap v1707: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:38.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:38 smithi051 bash[18409]: cluster 2020-06-27T05:33:37.603671+0000 mgr.x (mgr.34109) 1625 : cluster [DBG] pgmap v1708: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:38.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:38 smithi031 bash[18426]: cluster 2020-06-27T05:33:37.603671+0000 mgr.x (mgr.34109) 1625 : cluster [DBG] pgmap v1708: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:38.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:38 smithi031 bash[22603]: cluster 2020-06-27T05:33:37.603671+0000 mgr.x (mgr.34109) 1625 : cluster [DBG] pgmap v1708: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:41.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:41 smithi051 bash[18409]: cluster 2020-06-27T05:33:39.605291+0000 mgr.x (mgr.34109) 1626 : cluster [DBG] pgmap v1709: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:41.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:41 smithi031 bash[18426]: cluster 2020-06-27T05:33:39.605291+0000 mgr.x (mgr.34109) 1626 : cluster [DBG] pgmap v1709: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:41.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:41 smithi031 bash[22603]: cluster 2020-06-27T05:33:39.605291+0000 mgr.x (mgr.34109) 1626 : cluster [DBG] pgmap v1709: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:43.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:43 smithi051 bash[18409]: cluster 2020-06-27T05:33:41.606972+0000 mgr.x (mgr.34109) 1627 : cluster [DBG] pgmap v1710: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:43.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:43 smithi031 bash[18426]: cluster 2020-06-27T05:33:41.606972+0000 mgr.x (mgr.34109) 1627 : cluster [DBG] pgmap v1710: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:43.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:43 smithi031 bash[22603]: cluster 2020-06-27T05:33:41.606972+0000 mgr.x (mgr.34109) 1627 : cluster [DBG] pgmap v1710: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:45.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:45 smithi051 bash[18409]: cluster 2020-06-27T05:33:43.608633+0000 mgr.x (mgr.34109) 1628 : cluster [DBG] pgmap v1711: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:45.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:45 smithi031 bash[18426]: cluster 2020-06-27T05:33:43.608633+0000 mgr.x (mgr.34109) 1628 : cluster [DBG] pgmap v1711: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:45.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:45 smithi031 bash[22603]: cluster 2020-06-27T05:33:43.608633+0000 mgr.x (mgr.34109) 1628 : cluster [DBG] pgmap v1711: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:47.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:47 smithi051 bash[18409]: cluster 2020-06-27T05:33:45.610360+0000 mgr.x (mgr.34109) 1629 : cluster [DBG] pgmap v1712: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:47.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:47 smithi031 bash[18426]: cluster 2020-06-27T05:33:45.610360+0000 mgr.x (mgr.34109) 1629 : cluster [DBG] pgmap v1712: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:47.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:47 smithi031 bash[22603]: cluster 2020-06-27T05:33:45.610360+0000 mgr.x (mgr.34109) 1629 : cluster [DBG] pgmap v1712: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:49.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:49 smithi051 bash[18409]: cluster 2020-06-27T05:33:47.611983+0000 mgr.x (mgr.34109) 1630 : cluster [DBG] pgmap v1713: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:49.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:49 smithi031 bash[18426]: cluster 2020-06-27T05:33:47.611983+0000 mgr.x (mgr.34109) 1630 : cluster [DBG] pgmap v1713: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:49.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:49 smithi031 bash[22603]: cluster 2020-06-27T05:33:47.611983+0000 mgr.x (mgr.34109) 1630 : cluster [DBG] pgmap v1713: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:51.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:51 smithi051 bash[18409]: cluster 2020-06-27T05:33:49.613644+0000 mgr.x (mgr.34109) 1631 : cluster [DBG] pgmap v1714: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:51.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:51 smithi031 bash[18426]: cluster 2020-06-27T05:33:49.613644+0000 mgr.x (mgr.34109) 1631 : cluster [DBG] pgmap v1714: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:51.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:51 smithi031 bash[22603]: cluster 2020-06-27T05:33:49.613644+0000 mgr.x (mgr.34109) 1631 : cluster [DBG] pgmap v1714: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:53.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:53 smithi051 bash[18409]: cluster 2020-06-27T05:33:51.615393+0000 mgr.x (mgr.34109) 1632 : cluster [DBG] pgmap v1715: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:53.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:53 smithi031 bash[18426]: cluster 2020-06-27T05:33:51.615393+0000 mgr.x (mgr.34109) 1632 : cluster [DBG] pgmap v1715: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:53.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:53 smithi031 bash[22603]: cluster 2020-06-27T05:33:51.615393+0000 mgr.x (mgr.34109) 1632 : cluster [DBG] pgmap v1715: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:55.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:55 smithi031 bash[18426]: cluster 2020-06-27T05:33:53.617006+0000 mgr.x (mgr.34109) 1633 : cluster [DBG] pgmap v1716: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:55.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:55 smithi031 bash[22603]: cluster 2020-06-27T05:33:53.617006+0000 mgr.x (mgr.34109) 1633 : cluster [DBG] pgmap v1716: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:55.475 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:55 smithi051 bash[18409]: cluster 2020-06-27T05:33:53.617006+0000 mgr.x (mgr.34109) 1633 : cluster [DBG] pgmap v1716: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:57.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:57 smithi051 bash[18409]: cluster 2020-06-27T05:33:55.618733+0000 mgr.x (mgr.34109) 1634 : cluster [DBG] pgmap v1717: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:57.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:57 smithi031 bash[22603]: cluster 2020-06-27T05:33:55.618733+0000 mgr.x (mgr.34109) 1634 : cluster [DBG] pgmap v1717: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:57.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:57 smithi031 bash[18426]: cluster 2020-06-27T05:33:55.618733+0000 mgr.x (mgr.34109) 1634 : cluster [DBG] pgmap v1717: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:59.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:33:59 smithi051 bash[18409]: cluster 2020-06-27T05:33:57.620445+0000 mgr.x (mgr.34109) 1635 : cluster [DBG] pgmap v1718: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:59.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:33:59 smithi031 bash[22603]: cluster 2020-06-27T05:33:57.620445+0000 mgr.x (mgr.34109) 1635 : cluster [DBG] pgmap v1718: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:33:59.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:33:59 smithi031 bash[18426]: cluster 2020-06-27T05:33:57.620445+0000 mgr.x (mgr.34109) 1635 : cluster [DBG] pgmap v1718: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:01.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:01 smithi051 bash[18409]: cluster 2020-06-27T05:33:59.622065+0000 mgr.x (mgr.34109) 1636 : cluster [DBG] pgmap v1719: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:01.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:01 smithi031 bash[18426]: cluster 2020-06-27T05:33:59.622065+0000 mgr.x (mgr.34109) 1636 : cluster [DBG] pgmap v1719: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:01.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:01 smithi031 bash[22603]: cluster 2020-06-27T05:33:59.622065+0000 mgr.x (mgr.34109) 1636 : cluster [DBG] pgmap v1719: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:03.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:03 smithi051 bash[18409]: cluster 2020-06-27T05:34:01.623661+0000 mgr.x (mgr.34109) 1637 : cluster [DBG] pgmap v1720: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:03.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:03 smithi031 bash[18426]: cluster 2020-06-27T05:34:01.623661+0000 mgr.x (mgr.34109) 1637 : cluster [DBG] pgmap v1720: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:03.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:03 smithi031 bash[22603]: cluster 2020-06-27T05:34:01.623661+0000 mgr.x (mgr.34109) 1637 : cluster [DBG] pgmap v1720: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:05.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:05 smithi051 bash[18409]: cluster 2020-06-27T05:34:03.625361+0000 mgr.x (mgr.34109) 1638 : cluster [DBG] pgmap v1721: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:05.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:05 smithi031 bash[18426]: cluster 2020-06-27T05:34:03.625361+0000 mgr.x (mgr.34109) 1638 : cluster [DBG] pgmap v1721: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:05.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:05 smithi031 bash[22603]: cluster 2020-06-27T05:34:03.625361+0000 mgr.x (mgr.34109) 1638 : cluster [DBG] pgmap v1721: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:07.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:07 smithi051 bash[18409]: cluster 2020-06-27T05:34:05.627091+0000 mgr.x (mgr.34109) 1639 : cluster [DBG] pgmap v1722: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:07.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:07 smithi031 bash[18426]: cluster 2020-06-27T05:34:05.627091+0000 mgr.x (mgr.34109) 1639 : cluster [DBG] pgmap v1722: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:07.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:07 smithi031 bash[22603]: cluster 2020-06-27T05:34:05.627091+0000 mgr.x (mgr.34109) 1639 : cluster [DBG] pgmap v1722: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:09.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:09 smithi051 bash[18409]: cluster 2020-06-27T05:34:07.628669+0000 mgr.x (mgr.34109) 1640 : cluster [DBG] pgmap v1723: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:09.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:09 smithi031 bash[18426]: cluster 2020-06-27T05:34:07.628669+0000 mgr.x (mgr.34109) 1640 : cluster [DBG] pgmap v1723: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:09.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:09 smithi031 bash[22603]: cluster 2020-06-27T05:34:07.628669+0000 mgr.x (mgr.34109) 1640 : cluster [DBG] pgmap v1723: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:11.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:11 smithi051 bash[18409]: cluster 2020-06-27T05:34:09.630383+0000 mgr.x (mgr.34109) 1641 : cluster [DBG] pgmap v1724: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:11.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:11 smithi031 bash[22603]: cluster 2020-06-27T05:34:09.630383+0000 mgr.x (mgr.34109) 1641 : cluster [DBG] pgmap v1724: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:11 smithi031 bash[18426]: cluster 2020-06-27T05:34:09.630383+0000 mgr.x (mgr.34109) 1641 : cluster [DBG] pgmap v1724: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:13.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:13 smithi051 bash[18409]: cluster 2020-06-27T05:34:11.632028+0000 mgr.x (mgr.34109) 1642 : cluster [DBG] pgmap v1725: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:13.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:13 smithi031 bash[22603]: cluster 2020-06-27T05:34:11.632028+0000 mgr.x (mgr.34109) 1642 : cluster [DBG] pgmap v1725: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:13.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:13 smithi031 bash[18426]: cluster 2020-06-27T05:34:11.632028+0000 mgr.x (mgr.34109) 1642 : cluster [DBG] pgmap v1725: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:15.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:15 smithi051 bash[18409]: cluster 2020-06-27T05:34:13.633639+0000 mgr.x (mgr.34109) 1643 : cluster [DBG] pgmap v1726: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:15.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:15 smithi031 bash[18426]: cluster 2020-06-27T05:34:13.633639+0000 mgr.x (mgr.34109) 1643 : cluster [DBG] pgmap v1726: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:15.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:15 smithi031 bash[22603]: cluster 2020-06-27T05:34:13.633639+0000 mgr.x (mgr.34109) 1643 : cluster [DBG] pgmap v1726: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:17.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:17 smithi051 bash[18409]: cluster 2020-06-27T05:34:15.635396+0000 mgr.x (mgr.34109) 1644 : cluster [DBG] pgmap v1727: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:17.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:17 smithi031 bash[22603]: cluster 2020-06-27T05:34:15.635396+0000 mgr.x (mgr.34109) 1644 : cluster [DBG] pgmap v1727: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:17.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:17 smithi031 bash[18426]: cluster 2020-06-27T05:34:15.635396+0000 mgr.x (mgr.34109) 1644 : cluster [DBG] pgmap v1727: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:19.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:19 smithi051 bash[18409]: cluster 2020-06-27T05:34:17.637166+0000 mgr.x (mgr.34109) 1645 : cluster [DBG] pgmap v1728: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:19.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:19 smithi031 bash[22603]: cluster 2020-06-27T05:34:17.637166+0000 mgr.x (mgr.34109) 1645 : cluster [DBG] pgmap v1728: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:19.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:19 smithi031 bash[18426]: cluster 2020-06-27T05:34:17.637166+0000 mgr.x (mgr.34109) 1645 : cluster [DBG] pgmap v1728: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:21.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:21 smithi051 bash[18409]: cluster 2020-06-27T05:34:19.638854+0000 mgr.x (mgr.34109) 1646 : cluster [DBG] pgmap v1729: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:21.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:21 smithi031 bash[22603]: cluster 2020-06-27T05:34:19.638854+0000 mgr.x (mgr.34109) 1646 : cluster [DBG] pgmap v1729: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:21.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:21 smithi031 bash[18426]: cluster 2020-06-27T05:34:19.638854+0000 mgr.x (mgr.34109) 1646 : cluster [DBG] pgmap v1729: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:23.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:23 smithi051 bash[18409]: cluster 2020-06-27T05:34:21.640672+0000 mgr.x (mgr.34109) 1647 : cluster [DBG] pgmap v1730: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:23.478 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:23 smithi031 bash[22603]: cluster 2020-06-27T05:34:21.640672+0000 mgr.x (mgr.34109) 1647 : cluster [DBG] pgmap v1730: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:23.478 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:23 smithi031 bash[18426]: cluster 2020-06-27T05:34:21.640672+0000 mgr.x (mgr.34109) 1647 : cluster [DBG] pgmap v1730: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:25.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:25 smithi051 bash[18409]: cluster 2020-06-27T05:34:23.642281+0000 mgr.x (mgr.34109) 1648 : cluster [DBG] pgmap v1731: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:25.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:25 smithi031 bash[22603]: cluster 2020-06-27T05:34:23.642281+0000 mgr.x (mgr.34109) 1648 : cluster [DBG] pgmap v1731: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:25.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:25 smithi031 bash[18426]: cluster 2020-06-27T05:34:23.642281+0000 mgr.x (mgr.34109) 1648 : cluster [DBG] pgmap v1731: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:27.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:27 smithi051 bash[18409]: cluster 2020-06-27T05:34:25.643953+0000 mgr.x (mgr.34109) 1649 : cluster [DBG] pgmap v1732: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:27.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:27 smithi031 bash[18426]: cluster 2020-06-27T05:34:25.643953+0000 mgr.x (mgr.34109) 1649 : cluster [DBG] pgmap v1732: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:27.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:27 smithi031 bash[22603]: cluster 2020-06-27T05:34:25.643953+0000 mgr.x (mgr.34109) 1649 : cluster [DBG] pgmap v1732: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:29.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:29 smithi051 bash[18409]: cluster 2020-06-27T05:34:27.645698+0000 mgr.x (mgr.34109) 1650 : cluster [DBG] pgmap v1733: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:29.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:29 smithi031 bash[18426]: cluster 2020-06-27T05:34:27.645698+0000 mgr.x (mgr.34109) 1650 : cluster [DBG] pgmap v1733: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:29.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:29 smithi031 bash[22603]: cluster 2020-06-27T05:34:27.645698+0000 mgr.x (mgr.34109) 1650 : cluster [DBG] pgmap v1733: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:31.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:31 smithi051 bash[18409]: cluster 2020-06-27T05:34:29.647449+0000 mgr.x (mgr.34109) 1651 : cluster [DBG] pgmap v1734: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:31.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:31 smithi031 bash[18426]: cluster 2020-06-27T05:34:29.647449+0000 mgr.x (mgr.34109) 1651 : cluster [DBG] pgmap v1734: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:31.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:31 smithi031 bash[22603]: cluster 2020-06-27T05:34:29.647449+0000 mgr.x (mgr.34109) 1651 : cluster [DBG] pgmap v1734: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:33.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:33 smithi051 bash[18409]: cluster 2020-06-27T05:34:31.649127+0000 mgr.x (mgr.34109) 1652 : cluster [DBG] pgmap v1735: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:33.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:33 smithi031 bash[18426]: cluster 2020-06-27T05:34:31.649127+0000 mgr.x (mgr.34109) 1652 : cluster [DBG] pgmap v1735: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:33.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:33 smithi031 bash[22603]: cluster 2020-06-27T05:34:31.649127+0000 mgr.x (mgr.34109) 1652 : cluster [DBG] pgmap v1735: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:35.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:35 smithi051 bash[18409]: cluster 2020-06-27T05:34:33.650829+0000 mgr.x (mgr.34109) 1653 : cluster [DBG] pgmap v1736: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:35.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:35 smithi031 bash[18426]: cluster 2020-06-27T05:34:33.650829+0000 mgr.x (mgr.34109) 1653 : cluster [DBG] pgmap v1736: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:35.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:35 smithi031 bash[22603]: cluster 2020-06-27T05:34:33.650829+0000 mgr.x (mgr.34109) 1653 : cluster [DBG] pgmap v1736: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:37.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:37 smithi051 bash[18409]: cluster 2020-06-27T05:34:35.652461+0000 mgr.x (mgr.34109) 1654 : cluster [DBG] pgmap v1737: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:37.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:37 smithi031 bash[18426]: cluster 2020-06-27T05:34:35.652461+0000 mgr.x (mgr.34109) 1654 : cluster [DBG] pgmap v1737: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:37.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:37 smithi031 bash[22603]: cluster 2020-06-27T05:34:35.652461+0000 mgr.x (mgr.34109) 1654 : cluster [DBG] pgmap v1737: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:39.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:39 smithi051 bash[18409]: cluster 2020-06-27T05:34:37.654132+0000 mgr.x (mgr.34109) 1655 : cluster [DBG] pgmap v1738: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:39.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:39 smithi031 bash[18426]: cluster 2020-06-27T05:34:37.654132+0000 mgr.x (mgr.34109) 1655 : cluster [DBG] pgmap v1738: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:39.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:39 smithi031 bash[22603]: cluster 2020-06-27T05:34:37.654132+0000 mgr.x (mgr.34109) 1655 : cluster [DBG] pgmap v1738: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:41.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:41 smithi051 bash[18409]: cluster 2020-06-27T05:34:39.655898+0000 mgr.x (mgr.34109) 1656 : cluster [DBG] pgmap v1739: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:41.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:41 smithi031 bash[18426]: cluster 2020-06-27T05:34:39.655898+0000 mgr.x (mgr.34109) 1656 : cluster [DBG] pgmap v1739: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:41.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:41 smithi031 bash[22603]: cluster 2020-06-27T05:34:39.655898+0000 mgr.x (mgr.34109) 1656 : cluster [DBG] pgmap v1739: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:43.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:43 smithi051 bash[18409]: cluster 2020-06-27T05:34:41.657623+0000 mgr.x (mgr.34109) 1657 : cluster [DBG] pgmap v1740: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:43.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:43 smithi031 bash[18426]: cluster 2020-06-27T05:34:41.657623+0000 mgr.x (mgr.34109) 1657 : cluster [DBG] pgmap v1740: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:43.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:43 smithi031 bash[22603]: cluster 2020-06-27T05:34:41.657623+0000 mgr.x (mgr.34109) 1657 : cluster [DBG] pgmap v1740: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:45.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:45 smithi051 bash[18409]: cluster 2020-06-27T05:34:43.659321+0000 mgr.x (mgr.34109) 1658 : cluster [DBG] pgmap v1741: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:45.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:45 smithi031 bash[18426]: cluster 2020-06-27T05:34:43.659321+0000 mgr.x (mgr.34109) 1658 : cluster [DBG] pgmap v1741: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:45.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:45 smithi031 bash[22603]: cluster 2020-06-27T05:34:43.659321+0000 mgr.x (mgr.34109) 1658 : cluster [DBG] pgmap v1741: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:47.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:47 smithi051 bash[18409]: cluster 2020-06-27T05:34:45.660975+0000 mgr.x (mgr.34109) 1659 : cluster [DBG] pgmap v1742: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:47.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:47 smithi031 bash[18426]: cluster 2020-06-27T05:34:45.660975+0000 mgr.x (mgr.34109) 1659 : cluster [DBG] pgmap v1742: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:47.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:47 smithi031 bash[22603]: cluster 2020-06-27T05:34:45.660975+0000 mgr.x (mgr.34109) 1659 : cluster [DBG] pgmap v1742: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:49.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:49 smithi051 bash[18409]: cluster 2020-06-27T05:34:47.662559+0000 mgr.x (mgr.34109) 1660 : cluster [DBG] pgmap v1743: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:49.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:49 smithi031 bash[18426]: cluster 2020-06-27T05:34:47.662559+0000 mgr.x (mgr.34109) 1660 : cluster [DBG] pgmap v1743: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:49.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:49 smithi031 bash[22603]: cluster 2020-06-27T05:34:47.662559+0000 mgr.x (mgr.34109) 1660 : cluster [DBG] pgmap v1743: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:51.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:51 smithi051 bash[18409]: cluster 2020-06-27T05:34:49.664285+0000 mgr.x (mgr.34109) 1661 : cluster [DBG] pgmap v1744: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:51.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:51 smithi031 bash[18426]: cluster 2020-06-27T05:34:49.664285+0000 mgr.x (mgr.34109) 1661 : cluster [DBG] pgmap v1744: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:51.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:51 smithi031 bash[22603]: cluster 2020-06-27T05:34:49.664285+0000 mgr.x (mgr.34109) 1661 : cluster [DBG] pgmap v1744: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:53.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:53 smithi031 bash[22603]: cluster 2020-06-27T05:34:51.665905+0000 mgr.x (mgr.34109) 1662 : cluster [DBG] pgmap v1745: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:53.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:53 smithi031 bash[18426]: cluster 2020-06-27T05:34:51.665905+0000 mgr.x (mgr.34109) 1662 : cluster [DBG] pgmap v1745: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:53.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:53 smithi051 bash[18409]: cluster 2020-06-27T05:34:51.665905+0000 mgr.x (mgr.34109) 1662 : cluster [DBG] pgmap v1745: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:55.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:55 smithi051 bash[18409]: cluster 2020-06-27T05:34:53.667668+0000 mgr.x (mgr.34109) 1663 : cluster [DBG] pgmap v1746: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:55.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:55 smithi031 bash[18426]: cluster 2020-06-27T05:34:53.667668+0000 mgr.x (mgr.34109) 1663 : cluster [DBG] pgmap v1746: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:55.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:55 smithi031 bash[22603]: cluster 2020-06-27T05:34:53.667668+0000 mgr.x (mgr.34109) 1663 : cluster [DBG] pgmap v1746: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:57.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:57 smithi051 bash[18409]: cluster 2020-06-27T05:34:55.669449+0000 mgr.x (mgr.34109) 1664 : cluster [DBG] pgmap v1747: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:57.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:57 smithi031 bash[18426]: cluster 2020-06-27T05:34:55.669449+0000 mgr.x (mgr.34109) 1664 : cluster [DBG] pgmap v1747: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:57.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:57 smithi031 bash[22603]: cluster 2020-06-27T05:34:55.669449+0000 mgr.x (mgr.34109) 1664 : cluster [DBG] pgmap v1747: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:59.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:34:59 smithi051 bash[18409]: cluster 2020-06-27T05:34:57.671160+0000 mgr.x (mgr.34109) 1665 : cluster [DBG] pgmap v1748: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:59.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:34:59 smithi031 bash[22603]: cluster 2020-06-27T05:34:57.671160+0000 mgr.x (mgr.34109) 1665 : cluster [DBG] pgmap v1748: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:34:59.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:34:59 smithi031 bash[18426]: cluster 2020-06-27T05:34:57.671160+0000 mgr.x (mgr.34109) 1665 : cluster [DBG] pgmap v1748: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:01.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:01 smithi051 bash[18409]: cluster 2020-06-27T05:34:59.672774+0000 mgr.x (mgr.34109) 1666 : cluster [DBG] pgmap v1749: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:01.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:01 smithi031 bash[22603]: cluster 2020-06-27T05:34:59.672774+0000 mgr.x (mgr.34109) 1666 : cluster [DBG] pgmap v1749: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:01.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:01 smithi031 bash[18426]: cluster 2020-06-27T05:34:59.672774+0000 mgr.x (mgr.34109) 1666 : cluster [DBG] pgmap v1749: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:03.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:03 smithi051 bash[18409]: cluster 2020-06-27T05:35:01.674362+0000 mgr.x (mgr.34109) 1667 : cluster [DBG] pgmap v1750: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:03.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:03 smithi031 bash[18426]: cluster 2020-06-27T05:35:01.674362+0000 mgr.x (mgr.34109) 1667 : cluster [DBG] pgmap v1750: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:03.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:03 smithi031 bash[22603]: cluster 2020-06-27T05:35:01.674362+0000 mgr.x (mgr.34109) 1667 : cluster [DBG] pgmap v1750: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:05.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:05 smithi051 bash[18409]: cluster 2020-06-27T05:35:03.676093+0000 mgr.x (mgr.34109) 1668 : cluster [DBG] pgmap v1751: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:05 smithi031 bash[18426]: cluster 2020-06-27T05:35:03.676093+0000 mgr.x (mgr.34109) 1668 : cluster [DBG] pgmap v1751: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:05.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:05 smithi031 bash[22603]: cluster 2020-06-27T05:35:03.676093+0000 mgr.x (mgr.34109) 1668 : cluster [DBG] pgmap v1751: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:07.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:07 smithi051 bash[18409]: cluster 2020-06-27T05:35:05.677734+0000 mgr.x (mgr.34109) 1669 : cluster [DBG] pgmap v1752: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:07.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:07 smithi031 bash[18426]: cluster 2020-06-27T05:35:05.677734+0000 mgr.x (mgr.34109) 1669 : cluster [DBG] pgmap v1752: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:07.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:07 smithi031 bash[22603]: cluster 2020-06-27T05:35:05.677734+0000 mgr.x (mgr.34109) 1669 : cluster [DBG] pgmap v1752: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:09 smithi051 bash[18409]: cluster 2020-06-27T05:35:07.679473+0000 mgr.x (mgr.34109) 1670 : cluster [DBG] pgmap v1753: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:09.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:09 smithi031 bash[18426]: cluster 2020-06-27T05:35:07.679473+0000 mgr.x (mgr.34109) 1670 : cluster [DBG] pgmap v1753: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:09.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:09 smithi031 bash[22603]: cluster 2020-06-27T05:35:07.679473+0000 mgr.x (mgr.34109) 1670 : cluster [DBG] pgmap v1753: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:11.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:11 smithi051 bash[18409]: cluster 2020-06-27T05:35:09.681164+0000 mgr.x (mgr.34109) 1671 : cluster [DBG] pgmap v1754: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:11.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:11 smithi031 bash[18426]: cluster 2020-06-27T05:35:09.681164+0000 mgr.x (mgr.34109) 1671 : cluster [DBG] pgmap v1754: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:11.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:11 smithi031 bash[22603]: cluster 2020-06-27T05:35:09.681164+0000 mgr.x (mgr.34109) 1671 : cluster [DBG] pgmap v1754: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:13.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:13 smithi051 bash[18409]: cluster 2020-06-27T05:35:11.682748+0000 mgr.x (mgr.34109) 1672 : cluster [DBG] pgmap v1755: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:13.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:13 smithi031 bash[18426]: cluster 2020-06-27T05:35:11.682748+0000 mgr.x (mgr.34109) 1672 : cluster [DBG] pgmap v1755: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:13.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:13 smithi031 bash[22603]: cluster 2020-06-27T05:35:11.682748+0000 mgr.x (mgr.34109) 1672 : cluster [DBG] pgmap v1755: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:15.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:15 smithi051 bash[18409]: cluster 2020-06-27T05:35:13.684425+0000 mgr.x (mgr.34109) 1673 : cluster [DBG] pgmap v1756: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:15.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:15 smithi031 bash[18426]: cluster 2020-06-27T05:35:13.684425+0000 mgr.x (mgr.34109) 1673 : cluster [DBG] pgmap v1756: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:15.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:15 smithi031 bash[22603]: cluster 2020-06-27T05:35:13.684425+0000 mgr.x (mgr.34109) 1673 : cluster [DBG] pgmap v1756: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:17 smithi051 bash[18409]: cluster 2020-06-27T05:35:15.685983+0000 mgr.x (mgr.34109) 1674 : cluster [DBG] pgmap v1757: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:17.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:17 smithi031 bash[18426]: cluster 2020-06-27T05:35:15.685983+0000 mgr.x (mgr.34109) 1674 : cluster [DBG] pgmap v1757: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:17.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:17 smithi031 bash[22603]: cluster 2020-06-27T05:35:15.685983+0000 mgr.x (mgr.34109) 1674 : cluster [DBG] pgmap v1757: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:19.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:19 smithi051 bash[18409]: cluster 2020-06-27T05:35:17.687756+0000 mgr.x (mgr.34109) 1675 : cluster [DBG] pgmap v1758: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:19.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:19 smithi031 bash[18426]: cluster 2020-06-27T05:35:17.687756+0000 mgr.x (mgr.34109) 1675 : cluster [DBG] pgmap v1758: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:19.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:19 smithi031 bash[22603]: cluster 2020-06-27T05:35:17.687756+0000 mgr.x (mgr.34109) 1675 : cluster [DBG] pgmap v1758: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:21.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:21 smithi051 bash[18409]: cluster 2020-06-27T05:35:19.689494+0000 mgr.x (mgr.34109) 1676 : cluster [DBG] pgmap v1759: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:21.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:21 smithi031 bash[18426]: cluster 2020-06-27T05:35:19.689494+0000 mgr.x (mgr.34109) 1676 : cluster [DBG] pgmap v1759: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:21.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:21 smithi031 bash[22603]: cluster 2020-06-27T05:35:19.689494+0000 mgr.x (mgr.34109) 1676 : cluster [DBG] pgmap v1759: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:23.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:23 smithi051 bash[18409]: cluster 2020-06-27T05:35:21.691194+0000 mgr.x (mgr.34109) 1677 : cluster [DBG] pgmap v1760: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:23.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:23 smithi031 bash[18426]: cluster 2020-06-27T05:35:21.691194+0000 mgr.x (mgr.34109) 1677 : cluster [DBG] pgmap v1760: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:23.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:23 smithi031 bash[22603]: cluster 2020-06-27T05:35:21.691194+0000 mgr.x (mgr.34109) 1677 : cluster [DBG] pgmap v1760: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:25.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:25 smithi051 bash[18409]: cluster 2020-06-27T05:35:23.692592+0000 mgr.x (mgr.34109) 1678 : cluster [DBG] pgmap v1761: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:25.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:25 smithi031 bash[18426]: cluster 2020-06-27T05:35:23.692592+0000 mgr.x (mgr.34109) 1678 : cluster [DBG] pgmap v1761: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:25.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:25 smithi031 bash[22603]: cluster 2020-06-27T05:35:23.692592+0000 mgr.x (mgr.34109) 1678 : cluster [DBG] pgmap v1761: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:27.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:27 smithi051 bash[18409]: cluster 2020-06-27T05:35:25.694150+0000 mgr.x (mgr.34109) 1679 : cluster [DBG] pgmap v1762: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:27.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:27 smithi031 bash[18426]: cluster 2020-06-27T05:35:25.694150+0000 mgr.x (mgr.34109) 1679 : cluster [DBG] pgmap v1762: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:27.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:27 smithi031 bash[22603]: cluster 2020-06-27T05:35:25.694150+0000 mgr.x (mgr.34109) 1679 : cluster [DBG] pgmap v1762: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:29.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:29 smithi051 bash[18409]: cluster 2020-06-27T05:35:27.695767+0000 mgr.x (mgr.34109) 1680 : cluster [DBG] pgmap v1763: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:29.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:29 smithi031 bash[18426]: cluster 2020-06-27T05:35:27.695767+0000 mgr.x (mgr.34109) 1680 : cluster [DBG] pgmap v1763: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:29.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:29 smithi031 bash[22603]: cluster 2020-06-27T05:35:27.695767+0000 mgr.x (mgr.34109) 1680 : cluster [DBG] pgmap v1763: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:31.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:31 smithi051 bash[18409]: cluster 2020-06-27T05:35:29.697489+0000 mgr.x (mgr.34109) 1681 : cluster [DBG] pgmap v1764: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:31.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:31 smithi031 bash[18426]: cluster 2020-06-27T05:35:29.697489+0000 mgr.x (mgr.34109) 1681 : cluster [DBG] pgmap v1764: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:31.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:31 smithi031 bash[22603]: cluster 2020-06-27T05:35:29.697489+0000 mgr.x (mgr.34109) 1681 : cluster [DBG] pgmap v1764: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:33 smithi051 bash[18409]: cluster 2020-06-27T05:35:31.699232+0000 mgr.x (mgr.34109) 1682 : cluster [DBG] pgmap v1765: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:33.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:33 smithi031 bash[18426]: cluster 2020-06-27T05:35:31.699232+0000 mgr.x (mgr.34109) 1682 : cluster [DBG] pgmap v1765: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:33.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:33 smithi031 bash[22603]: cluster 2020-06-27T05:35:31.699232+0000 mgr.x (mgr.34109) 1682 : cluster [DBG] pgmap v1765: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:35.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:35 smithi051 bash[18409]: cluster 2020-06-27T05:35:33.700861+0000 mgr.x (mgr.34109) 1683 : cluster [DBG] pgmap v1766: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:35.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:35 smithi031 bash[18426]: cluster 2020-06-27T05:35:33.700861+0000 mgr.x (mgr.34109) 1683 : cluster [DBG] pgmap v1766: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:35.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:35 smithi031 bash[22603]: cluster 2020-06-27T05:35:33.700861+0000 mgr.x (mgr.34109) 1683 : cluster [DBG] pgmap v1766: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:37.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:37 smithi051 bash[18409]: cluster 2020-06-27T05:35:35.702538+0000 mgr.x (mgr.34109) 1684 : cluster [DBG] pgmap v1767: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:37.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:37 smithi031 bash[18426]: cluster 2020-06-27T05:35:35.702538+0000 mgr.x (mgr.34109) 1684 : cluster [DBG] pgmap v1767: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:37.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:37 smithi031 bash[22603]: cluster 2020-06-27T05:35:35.702538+0000 mgr.x (mgr.34109) 1684 : cluster [DBG] pgmap v1767: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:39.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:39 smithi051 bash[18409]: cluster 2020-06-27T05:35:37.704143+0000 mgr.x (mgr.34109) 1685 : cluster [DBG] pgmap v1768: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:39 smithi031 bash[18426]: cluster 2020-06-27T05:35:37.704143+0000 mgr.x (mgr.34109) 1685 : cluster [DBG] pgmap v1768: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:39.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:39 smithi031 bash[22603]: cluster 2020-06-27T05:35:37.704143+0000 mgr.x (mgr.34109) 1685 : cluster [DBG] pgmap v1768: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:41 smithi051 bash[18409]: cluster 2020-06-27T05:35:39.705839+0000 mgr.x (mgr.34109) 1686 : cluster [DBG] pgmap v1769: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:41 smithi031 bash[18426]: cluster 2020-06-27T05:35:39.705839+0000 mgr.x (mgr.34109) 1686 : cluster [DBG] pgmap v1769: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:41.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:41 smithi031 bash[22603]: cluster 2020-06-27T05:35:39.705839+0000 mgr.x (mgr.34109) 1686 : cluster [DBG] pgmap v1769: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:43 smithi051 bash[18409]: cluster 2020-06-27T05:35:41.707425+0000 mgr.x (mgr.34109) 1687 : cluster [DBG] pgmap v1770: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:43.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:43 smithi031 bash[18426]: cluster 2020-06-27T05:35:41.707425+0000 mgr.x (mgr.34109) 1687 : cluster [DBG] pgmap v1770: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:43 smithi031 bash[22603]: cluster 2020-06-27T05:35:41.707425+0000 mgr.x (mgr.34109) 1687 : cluster [DBG] pgmap v1770: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:45.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:45 smithi051 bash[18409]: cluster 2020-06-27T05:35:43.709009+0000 mgr.x (mgr.34109) 1688 : cluster [DBG] pgmap v1771: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:45.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:45 smithi031 bash[18426]: cluster 2020-06-27T05:35:43.709009+0000 mgr.x (mgr.34109) 1688 : cluster [DBG] pgmap v1771: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:45.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:45 smithi031 bash[22603]: cluster 2020-06-27T05:35:43.709009+0000 mgr.x (mgr.34109) 1688 : cluster [DBG] pgmap v1771: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:47.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:47 smithi051 bash[18409]: cluster 2020-06-27T05:35:45.710782+0000 mgr.x (mgr.34109) 1689 : cluster [DBG] pgmap v1772: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:47.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:47 smithi031 bash[18426]: cluster 2020-06-27T05:35:45.710782+0000 mgr.x (mgr.34109) 1689 : cluster [DBG] pgmap v1772: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:47.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:47 smithi031 bash[22603]: cluster 2020-06-27T05:35:45.710782+0000 mgr.x (mgr.34109) 1689 : cluster [DBG] pgmap v1772: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:49.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:49 smithi051 bash[18409]: cluster 2020-06-27T05:35:47.712465+0000 mgr.x (mgr.34109) 1690 : cluster [DBG] pgmap v1773: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:49.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:49 smithi031 bash[18426]: cluster 2020-06-27T05:35:47.712465+0000 mgr.x (mgr.34109) 1690 : cluster [DBG] pgmap v1773: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:49.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:49 smithi031 bash[22603]: cluster 2020-06-27T05:35:47.712465+0000 mgr.x (mgr.34109) 1690 : cluster [DBG] pgmap v1773: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:51.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:51 smithi051 bash[18409]: cluster 2020-06-27T05:35:49.714142+0000 mgr.x (mgr.34109) 1691 : cluster [DBG] pgmap v1774: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:51.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:51 smithi031 bash[22603]: cluster 2020-06-27T05:35:49.714142+0000 mgr.x (mgr.34109) 1691 : cluster [DBG] pgmap v1774: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:51.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:51 smithi031 bash[18426]: cluster 2020-06-27T05:35:49.714142+0000 mgr.x (mgr.34109) 1691 : cluster [DBG] pgmap v1774: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:53.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:53 smithi051 bash[18409]: cluster 2020-06-27T05:35:51.715886+0000 mgr.x (mgr.34109) 1692 : cluster [DBG] pgmap v1775: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:53.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:53 smithi031 bash[22603]: cluster 2020-06-27T05:35:51.715886+0000 mgr.x (mgr.34109) 1692 : cluster [DBG] pgmap v1775: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:53.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:53 smithi031 bash[18426]: cluster 2020-06-27T05:35:51.715886+0000 mgr.x (mgr.34109) 1692 : cluster [DBG] pgmap v1775: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:55.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:55 smithi051 bash[18409]: cluster 2020-06-27T05:35:53.717527+0000 mgr.x (mgr.34109) 1693 : cluster [DBG] pgmap v1776: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:55.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:55 smithi031 bash[22603]: cluster 2020-06-27T05:35:53.717527+0000 mgr.x (mgr.34109) 1693 : cluster [DBG] pgmap v1776: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:55.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:55 smithi031 bash[18426]: cluster 2020-06-27T05:35:53.717527+0000 mgr.x (mgr.34109) 1693 : cluster [DBG] pgmap v1776: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:57.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:57 smithi051 bash[18409]: cluster 2020-06-27T05:35:55.719284+0000 mgr.x (mgr.34109) 1694 : cluster [DBG] pgmap v1777: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:57.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:57 smithi051 bash[18409]: audit 2020-06-27T05:35:56.154523+0000 mon.b (mon.2) 389 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871648\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871724\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871758\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871937\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872036\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872132\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872227\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872264\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872294\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.872372\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:35:56.153711\"}"}]: dispatch 2020-06-27T05:35:57.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:57 smithi051 bash[18409]: audit 2020-06-27T05:35:56.155132+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871648\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871724\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871758\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871937\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872036\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872132\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872227\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872264\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872294\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.872372\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:35:56.153711\"}"}]: dispatch 2020-06-27T05:35:57.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:57 smithi051 bash[18409]: audit 2020-06-27T05:35:56.155786+0000 mon.b (mon.2) 390 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542816\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.542852\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543112\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543290\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543463\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543628\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543685\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543746\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.543876\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:35:56.155112\"}"}]: dispatch 2020-06-27T05:35:57.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:57 smithi051 bash[18409]: audit 2020-06-27T05:35:56.157677+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871648\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871724\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871758\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871937\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872036\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872132\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872227\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872264\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872294\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.872372\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:35:56.153711\"}"}]': finished 2020-06-27T05:35:57.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:57 smithi051 bash[18409]: audit 2020-06-27T05:35:56.157966+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542816\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.542852\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543112\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543290\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543463\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543628\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543685\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543746\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.543876\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:35:56.155112\"}"}]: dispatch 2020-06-27T05:35:57.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:57 smithi051 bash[18409]: audit 2020-06-27T05:35:56.158741+0000 mon.b (mon.2) 391 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:35:57.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:57 smithi051 bash[18409]: audit 2020-06-27T05:35:56.159903+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542816\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.542852\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543112\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543290\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543463\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543628\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543685\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543746\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.543876\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:35:56.155112\"}"}]': finished 2020-06-27T05:35:57.472 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:57 smithi051 bash[18409]: audit 2020-06-27T05:35:56.160614+0000 mon.b (mon.2) 392 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:35:57.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:57 smithi031 bash[22603]: cluster 2020-06-27T05:35:55.719284+0000 mgr.x (mgr.34109) 1694 : cluster [DBG] pgmap v1777: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:57.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:57 smithi031 bash[22603]: audit 2020-06-27T05:35:56.154523+0000 mon.b (mon.2) 389 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871648\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871724\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871758\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871937\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872036\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872132\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872227\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872264\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872294\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.872372\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:35:56.153711\"}"}]: dispatch 2020-06-27T05:35:57.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:57 smithi031 bash[22603]: audit 2020-06-27T05:35:56.155132+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871648\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871724\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871758\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871937\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872036\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872132\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872227\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872264\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872294\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.872372\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:35:56.153711\"}"}]: dispatch 2020-06-27T05:35:57.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:57 smithi031 bash[22603]: audit 2020-06-27T05:35:56.155786+0000 mon.b (mon.2) 390 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542816\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.542852\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543112\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543290\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543463\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543628\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543685\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543746\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.543876\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:35:56.155112\"}"}]: dispatch 2020-06-27T05:35:57.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:57 smithi031 bash[22603]: audit 2020-06-27T05:35:56.157677+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871648\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871724\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871758\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871937\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872036\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872132\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872227\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872264\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872294\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.872372\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:35:56.153711\"}"}]': finished 2020-06-27T05:35:57.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:57 smithi031 bash[22603]: audit 2020-06-27T05:35:56.157966+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542816\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.542852\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543112\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543290\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543463\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543628\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543685\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543746\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.543876\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:35:56.155112\"}"}]: dispatch 2020-06-27T05:35:57.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:57 smithi031 bash[22603]: audit 2020-06-27T05:35:56.158741+0000 mon.b (mon.2) 391 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:35:57.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:57 smithi031 bash[22603]: audit 2020-06-27T05:35:56.159903+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542816\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.542852\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543112\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543290\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543463\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543628\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543685\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543746\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.543876\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:35:56.155112\"}"}]': finished 2020-06-27T05:35:57.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:57 smithi031 bash[22603]: audit 2020-06-27T05:35:56.160614+0000 mon.b (mon.2) 392 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:35:57.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:57 smithi031 bash[18426]: cluster 2020-06-27T05:35:55.719284+0000 mgr.x (mgr.34109) 1694 : cluster [DBG] pgmap v1777: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:57.478 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:57 smithi031 bash[18426]: audit 2020-06-27T05:35:56.154523+0000 mon.b (mon.2) 389 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871648\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871724\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871758\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871937\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872036\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872132\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872227\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872264\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872294\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.872372\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:35:56.153711\"}"}]: dispatch 2020-06-27T05:35:57.478 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:57 smithi031 bash[18426]: audit 2020-06-27T05:35:56.155132+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871648\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871724\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871758\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871937\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872036\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872132\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872227\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872264\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872294\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.872372\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:35:56.153711\"}"}]: dispatch 2020-06-27T05:35:57.478 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:57 smithi031 bash[18426]: audit 2020-06-27T05:35:56.155786+0000 mon.b (mon.2) 390 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542816\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.542852\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543112\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543290\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543463\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543628\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543685\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543746\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.543876\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:35:56.155112\"}"}]: dispatch 2020-06-27T05:35:57.478 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:57 smithi031 bash[18426]: audit 2020-06-27T05:35:56.157677+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871648\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.871724\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871758\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.871937\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872036\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.872132\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872227\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872264\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.872294\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.872372\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:35:56.153711\"}"}]': finished 2020-06-27T05:35:57.479 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:57 smithi031 bash[18426]: audit 2020-06-27T05:35:56.157966+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542816\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.542852\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543112\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543290\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543463\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543628\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543685\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543746\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.543876\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:35:56.155112\"}"}]: dispatch 2020-06-27T05:35:57.479 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:57 smithi031 bash[18426]: audit 2020-06-27T05:35:56.158741+0000 mon.b (mon.2) 391 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:35:57.479 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:57 smithi031 bash[18426]: audit 2020-06-27T05:35:56.159903+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542703\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.542816\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.542852\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543112\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543290\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:25:55.543463\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543628\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543685\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:25:55.543746\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:25:55.543876\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:35:56.155112\"}"}]': finished 2020-06-27T05:35:57.480 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:57 smithi031 bash[18426]: audit 2020-06-27T05:35:56.160614+0000 mon.b (mon.2) 392 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:35:58.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:58 smithi051 bash[18409]: audit 2020-06-27T05:35:58.044510+0000 mon.b (mon.2) 393 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043003\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043080\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043114\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043289\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043386\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043487\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043582\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043618\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043649\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.043733\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:35:56.155112\"}"}]: dispatch 2020-06-27T05:35:58.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:58 smithi051 bash[18409]: audit 2020-06-27T05:35:58.045318+0000 mon.a (mon.0) 1471 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043003\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043080\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043114\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043289\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043386\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043487\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043582\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043618\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043649\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.043733\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:35:56.155112\"}"}]: dispatch 2020-06-27T05:35:58.219 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:58 smithi051 bash[18409]: audit 2020-06-27T05:35:58.047849+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043003\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043080\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043114\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043289\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043386\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043487\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043582\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043618\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043649\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.043733\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:35:56.155112\"}"}]': finished 2020-06-27T05:35:58.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:58 smithi031 bash[22603]: audit 2020-06-27T05:35:58.044510+0000 mon.b (mon.2) 393 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043003\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043080\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043114\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043289\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043386\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043487\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043582\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043618\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043649\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.043733\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:35:56.155112\"}"}]: dispatch 2020-06-27T05:35:58.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:58 smithi031 bash[22603]: audit 2020-06-27T05:35:58.045318+0000 mon.a (mon.0) 1471 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043003\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043080\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043114\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043289\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043386\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043487\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043582\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043618\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043649\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.043733\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:35:56.155112\"}"}]: dispatch 2020-06-27T05:35:58.224 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:58 smithi031 bash[22603]: audit 2020-06-27T05:35:58.047849+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043003\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043080\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043114\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043289\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043386\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043487\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043582\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043618\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043649\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.043733\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:35:56.155112\"}"}]': finished 2020-06-27T05:35:58.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:58 smithi031 bash[18426]: audit 2020-06-27T05:35:58.044510+0000 mon.b (mon.2) 393 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043003\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043080\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043114\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043289\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043386\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043487\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043582\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043618\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043649\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.043733\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:35:56.155112\"}"}]: dispatch 2020-06-27T05:35:58.225 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:58 smithi031 bash[18426]: audit 2020-06-27T05:35:58.045318+0000 mon.a (mon.0) 1471 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043003\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043080\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043114\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043289\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043386\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043487\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043582\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043618\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043649\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.043733\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:35:56.155112\"}"}]: dispatch 2020-06-27T05:35:58.226 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:58 smithi031 bash[18426]: audit 2020-06-27T05:35:58.047849+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043003\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043080\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043114\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043289\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043386\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043487\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043582\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043618\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043649\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.043733\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:35:56.155112\"}"}]': finished 2020-06-27T05:35:59.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:59 smithi051 bash[18409]: cluster 2020-06-27T05:35:57.721344+0000 mgr.x (mgr.34109) 1695 : cluster [DBG] pgmap v1778: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:59.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:59 smithi051 bash[18409]: audit 2020-06-27T05:35:58.411135+0000 mon.b (mon.2) 394 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409642\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409718\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409752\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409927\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410024\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410118\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410211\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410247\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410277\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.410355\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:35:56.153711\"}"}]: dispatch 2020-06-27T05:35:59.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:59 smithi051 bash[18409]: audit 2020-06-27T05:35:58.411863+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409642\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409718\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409752\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409927\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410024\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410118\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410211\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410247\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410277\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.410355\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:35:56.153711\"}"}]: dispatch 2020-06-27T05:35:59.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:59 smithi051 bash[18409]: audit 2020-06-27T05:35:58.414414+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409642\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409718\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409752\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409927\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410024\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410118\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410211\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410247\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410277\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.410355\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:35:56.153711\"}"}]': finished 2020-06-27T05:35:59.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:59 smithi051 bash[18409]: audit 2020-06-27T05:35:58.417157+0000 mon.b (mon.2) 395 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:35:59.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:59 smithi051 bash[18409]: audit 2020-06-27T05:35:58.418131+0000 mon.b (mon.2) 396 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:35:59.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:35:59 smithi051 bash[18409]: audit 2020-06-27T05:35:58.419003+0000 mon.b (mon.2) 397 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:35:59.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:59 smithi031 bash[18426]: cluster 2020-06-27T05:35:57.721344+0000 mgr.x (mgr.34109) 1695 : cluster [DBG] pgmap v1778: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:59.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:59 smithi031 bash[18426]: audit 2020-06-27T05:35:58.411135+0000 mon.b (mon.2) 394 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409642\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409718\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409752\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409927\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410024\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410118\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410211\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410247\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410277\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.410355\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:35:56.153711\"}"}]: dispatch 2020-06-27T05:35:59.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:59 smithi031 bash[18426]: audit 2020-06-27T05:35:58.411863+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409642\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409718\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409752\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409927\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410024\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410118\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410211\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410247\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410277\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.410355\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:35:56.153711\"}"}]: dispatch 2020-06-27T05:35:59.477 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:59 smithi031 bash[18426]: audit 2020-06-27T05:35:58.414414+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409642\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409718\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409752\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409927\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410024\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410118\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410211\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410247\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410277\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.410355\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:35:56.153711\"}"}]': finished 2020-06-27T05:35:59.478 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:59 smithi031 bash[18426]: audit 2020-06-27T05:35:58.417157+0000 mon.b (mon.2) 395 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:35:59.478 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:59 smithi031 bash[18426]: audit 2020-06-27T05:35:58.418131+0000 mon.b (mon.2) 396 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:35:59.478 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:35:59 smithi031 bash[18426]: audit 2020-06-27T05:35:58.419003+0000 mon.b (mon.2) 397 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:35:59.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:59 smithi031 bash[22603]: cluster 2020-06-27T05:35:57.721344+0000 mgr.x (mgr.34109) 1695 : cluster [DBG] pgmap v1778: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:35:59.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:59 smithi031 bash[22603]: audit 2020-06-27T05:35:58.411135+0000 mon.b (mon.2) 394 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409642\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409718\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409752\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409927\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410024\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410118\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410211\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410247\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410277\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.410355\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:35:56.153711\"}"}]: dispatch 2020-06-27T05:35:59.479 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:59 smithi031 bash[22603]: audit 2020-06-27T05:35:58.411863+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409642\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409718\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409752\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409927\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410024\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410118\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410211\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410247\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410277\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.410355\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:35:56.153711\"}"}]: dispatch 2020-06-27T05:35:59.480 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:59 smithi031 bash[22603]: audit 2020-06-27T05:35:58.414414+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409642\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409718\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409752\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409927\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410024\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410118\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410211\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410247\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410277\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.410355\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:35:56.153711\"}"}]': finished 2020-06-27T05:35:59.480 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:59 smithi031 bash[22603]: audit 2020-06-27T05:35:58.417157+0000 mon.b (mon.2) 395 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:35:59.480 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:59 smithi031 bash[22603]: audit 2020-06-27T05:35:58.418131+0000 mon.b (mon.2) 396 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:35:59.480 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:35:59 smithi031 bash[22603]: audit 2020-06-27T05:35:58.419003+0000 mon.b (mon.2) 397 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:36:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:00 smithi051 bash[18409]: audit 2020-06-27T05:35:58.417435+0000 mgr.x (mgr.34109) 1696 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:36:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:00 smithi051 bash[18409]: audit 2020-06-27T05:35:58.418366+0000 mgr.x (mgr.34109) 1697 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:36:00.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:00 smithi051 bash[18409]: audit 2020-06-27T05:35:58.419207+0000 mgr.x (mgr.34109) 1698 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:36:00.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:00 smithi031 bash[18426]: audit 2020-06-27T05:35:58.417435+0000 mgr.x (mgr.34109) 1696 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:36:00.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:00 smithi031 bash[18426]: audit 2020-06-27T05:35:58.418366+0000 mgr.x (mgr.34109) 1697 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:36:00.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:00 smithi031 bash[18426]: audit 2020-06-27T05:35:58.419207+0000 mgr.x (mgr.34109) 1698 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:36:00.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:00 smithi031 bash[22603]: audit 2020-06-27T05:35:58.417435+0000 mgr.x (mgr.34109) 1696 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:36:00.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:00 smithi031 bash[22603]: audit 2020-06-27T05:35:58.418366+0000 mgr.x (mgr.34109) 1697 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:36:00.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:00 smithi031 bash[22603]: audit 2020-06-27T05:35:58.419207+0000 mgr.x (mgr.34109) 1698 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:36:01.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:01 smithi051 bash[18409]: cluster 2020-06-27T05:35:59.723129+0000 mgr.x (mgr.34109) 1699 : cluster [DBG] pgmap v1779: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:01.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:01 smithi031 bash[18426]: cluster 2020-06-27T05:35:59.723129+0000 mgr.x (mgr.34109) 1699 : cluster [DBG] pgmap v1779: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:01.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:01 smithi031 bash[22603]: cluster 2020-06-27T05:35:59.723129+0000 mgr.x (mgr.34109) 1699 : cluster [DBG] pgmap v1779: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:03.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:03 smithi051 bash[18409]: cluster 2020-06-27T05:36:01.724923+0000 mgr.x (mgr.34109) 1700 : cluster [DBG] pgmap v1780: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:03.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:03 smithi031 bash[18426]: cluster 2020-06-27T05:36:01.724923+0000 mgr.x (mgr.34109) 1700 : cluster [DBG] pgmap v1780: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:03.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:03 smithi031 bash[22603]: cluster 2020-06-27T05:36:01.724923+0000 mgr.x (mgr.34109) 1700 : cluster [DBG] pgmap v1780: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:05.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:05 smithi051 bash[18409]: cluster 2020-06-27T05:36:03.726689+0000 mgr.x (mgr.34109) 1701 : cluster [DBG] pgmap v1781: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:05.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:05 smithi031 bash[18426]: cluster 2020-06-27T05:36:03.726689+0000 mgr.x (mgr.34109) 1701 : cluster [DBG] pgmap v1781: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:05.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:05 smithi031 bash[22603]: cluster 2020-06-27T05:36:03.726689+0000 mgr.x (mgr.34109) 1701 : cluster [DBG] pgmap v1781: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:07.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:07 smithi051 bash[18409]: cluster 2020-06-27T05:36:05.728304+0000 mgr.x (mgr.34109) 1702 : cluster [DBG] pgmap v1782: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:07.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:07 smithi031 bash[18426]: cluster 2020-06-27T05:36:05.728304+0000 mgr.x (mgr.34109) 1702 : cluster [DBG] pgmap v1782: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:07.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:07 smithi031 bash[22603]: cluster 2020-06-27T05:36:05.728304+0000 mgr.x (mgr.34109) 1702 : cluster [DBG] pgmap v1782: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:09.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:09 smithi051 bash[18409]: cluster 2020-06-27T05:36:07.729984+0000 mgr.x (mgr.34109) 1703 : cluster [DBG] pgmap v1783: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:09.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:09 smithi031 bash[18426]: cluster 2020-06-27T05:36:07.729984+0000 mgr.x (mgr.34109) 1703 : cluster [DBG] pgmap v1783: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:09.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:09 smithi031 bash[22603]: cluster 2020-06-27T05:36:07.729984+0000 mgr.x (mgr.34109) 1703 : cluster [DBG] pgmap v1783: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:11.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:11 smithi051 bash[18409]: cluster 2020-06-27T05:36:09.731734+0000 mgr.x (mgr.34109) 1704 : cluster [DBG] pgmap v1784: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:11 smithi031 bash[18426]: cluster 2020-06-27T05:36:09.731734+0000 mgr.x (mgr.34109) 1704 : cluster [DBG] pgmap v1784: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:11.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:11 smithi031 bash[22603]: cluster 2020-06-27T05:36:09.731734+0000 mgr.x (mgr.34109) 1704 : cluster [DBG] pgmap v1784: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:13.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:13 smithi051 bash[18409]: cluster 2020-06-27T05:36:11.733394+0000 mgr.x (mgr.34109) 1705 : cluster [DBG] pgmap v1785: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:13.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:13 smithi031 bash[18426]: cluster 2020-06-27T05:36:11.733394+0000 mgr.x (mgr.34109) 1705 : cluster [DBG] pgmap v1785: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:13.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:13 smithi031 bash[22603]: cluster 2020-06-27T05:36:11.733394+0000 mgr.x (mgr.34109) 1705 : cluster [DBG] pgmap v1785: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:15.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:15 smithi051 bash[18409]: cluster 2020-06-27T05:36:13.735045+0000 mgr.x (mgr.34109) 1706 : cluster [DBG] pgmap v1786: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:15.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:15 smithi031 bash[18426]: cluster 2020-06-27T05:36:13.735045+0000 mgr.x (mgr.34109) 1706 : cluster [DBG] pgmap v1786: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:15.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:15 smithi031 bash[22603]: cluster 2020-06-27T05:36:13.735045+0000 mgr.x (mgr.34109) 1706 : cluster [DBG] pgmap v1786: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:17.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:17 smithi051 bash[18409]: cluster 2020-06-27T05:36:15.736688+0000 mgr.x (mgr.34109) 1707 : cluster [DBG] pgmap v1787: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:17.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:17 smithi031 bash[18426]: cluster 2020-06-27T05:36:15.736688+0000 mgr.x (mgr.34109) 1707 : cluster [DBG] pgmap v1787: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:17.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:17 smithi031 bash[22603]: cluster 2020-06-27T05:36:15.736688+0000 mgr.x (mgr.34109) 1707 : cluster [DBG] pgmap v1787: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:19.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:19 smithi051 bash[18409]: cluster 2020-06-27T05:36:17.738376+0000 mgr.x (mgr.34109) 1708 : cluster [DBG] pgmap v1788: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:19.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:19 smithi031 bash[18426]: cluster 2020-06-27T05:36:17.738376+0000 mgr.x (mgr.34109) 1708 : cluster [DBG] pgmap v1788: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:19.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:19 smithi031 bash[22603]: cluster 2020-06-27T05:36:17.738376+0000 mgr.x (mgr.34109) 1708 : cluster [DBG] pgmap v1788: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:21.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:21 smithi051 bash[18409]: cluster 2020-06-27T05:36:19.740108+0000 mgr.x (mgr.34109) 1709 : cluster [DBG] pgmap v1789: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:21.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:21 smithi031 bash[18426]: cluster 2020-06-27T05:36:19.740108+0000 mgr.x (mgr.34109) 1709 : cluster [DBG] pgmap v1789: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:21.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:21 smithi031 bash[22603]: cluster 2020-06-27T05:36:19.740108+0000 mgr.x (mgr.34109) 1709 : cluster [DBG] pgmap v1789: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:23.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:23 smithi051 bash[18409]: cluster 2020-06-27T05:36:21.741893+0000 mgr.x (mgr.34109) 1710 : cluster [DBG] pgmap v1790: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:23.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:23 smithi031 bash[18426]: cluster 2020-06-27T05:36:21.741893+0000 mgr.x (mgr.34109) 1710 : cluster [DBG] pgmap v1790: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:23.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:23 smithi031 bash[22603]: cluster 2020-06-27T05:36:21.741893+0000 mgr.x (mgr.34109) 1710 : cluster [DBG] pgmap v1790: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:25.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:25 smithi051 bash[18409]: cluster 2020-06-27T05:36:23.743572+0000 mgr.x (mgr.34109) 1711 : cluster [DBG] pgmap v1791: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:25.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:25 smithi031 bash[18426]: cluster 2020-06-27T05:36:23.743572+0000 mgr.x (mgr.34109) 1711 : cluster [DBG] pgmap v1791: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:25.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:25 smithi031 bash[22603]: cluster 2020-06-27T05:36:23.743572+0000 mgr.x (mgr.34109) 1711 : cluster [DBG] pgmap v1791: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:27.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:27 smithi051 bash[18409]: cluster 2020-06-27T05:36:25.745242+0000 mgr.x (mgr.34109) 1712 : cluster [DBG] pgmap v1792: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:27.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:27 smithi031 bash[18426]: cluster 2020-06-27T05:36:25.745242+0000 mgr.x (mgr.34109) 1712 : cluster [DBG] pgmap v1792: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:27.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:27 smithi031 bash[22603]: cluster 2020-06-27T05:36:25.745242+0000 mgr.x (mgr.34109) 1712 : cluster [DBG] pgmap v1792: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:29.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:29 smithi051 bash[18409]: cluster 2020-06-27T05:36:27.746866+0000 mgr.x (mgr.34109) 1713 : cluster [DBG] pgmap v1793: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:29.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:29 smithi031 bash[18426]: cluster 2020-06-27T05:36:27.746866+0000 mgr.x (mgr.34109) 1713 : cluster [DBG] pgmap v1793: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:29.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:29 smithi031 bash[22603]: cluster 2020-06-27T05:36:27.746866+0000 mgr.x (mgr.34109) 1713 : cluster [DBG] pgmap v1793: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:31.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:31 smithi051 bash[18409]: cluster 2020-06-27T05:36:29.748488+0000 mgr.x (mgr.34109) 1714 : cluster [DBG] pgmap v1794: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:31.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:31 smithi031 bash[18426]: cluster 2020-06-27T05:36:29.748488+0000 mgr.x (mgr.34109) 1714 : cluster [DBG] pgmap v1794: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:31.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:31 smithi031 bash[22603]: cluster 2020-06-27T05:36:29.748488+0000 mgr.x (mgr.34109) 1714 : cluster [DBG] pgmap v1794: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:33.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:33 smithi051 bash[18409]: cluster 2020-06-27T05:36:31.750106+0000 mgr.x (mgr.34109) 1715 : cluster [DBG] pgmap v1795: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:33.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:33 smithi031 bash[18426]: cluster 2020-06-27T05:36:31.750106+0000 mgr.x (mgr.34109) 1715 : cluster [DBG] pgmap v1795: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:33.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:33 smithi031 bash[22603]: cluster 2020-06-27T05:36:31.750106+0000 mgr.x (mgr.34109) 1715 : cluster [DBG] pgmap v1795: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:35.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:35 smithi051 bash[18409]: cluster 2020-06-27T05:36:33.751814+0000 mgr.x (mgr.34109) 1716 : cluster [DBG] pgmap v1796: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:35.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:35 smithi031 bash[18426]: cluster 2020-06-27T05:36:33.751814+0000 mgr.x (mgr.34109) 1716 : cluster [DBG] pgmap v1796: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:35.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:35 smithi031 bash[22603]: cluster 2020-06-27T05:36:33.751814+0000 mgr.x (mgr.34109) 1716 : cluster [DBG] pgmap v1796: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:37.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:37 smithi051 bash[18409]: cluster 2020-06-27T05:36:35.753455+0000 mgr.x (mgr.34109) 1717 : cluster [DBG] pgmap v1797: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:37.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:37 smithi031 bash[18426]: cluster 2020-06-27T05:36:35.753455+0000 mgr.x (mgr.34109) 1717 : cluster [DBG] pgmap v1797: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:37.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:37 smithi031 bash[22603]: cluster 2020-06-27T05:36:35.753455+0000 mgr.x (mgr.34109) 1717 : cluster [DBG] pgmap v1797: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:39.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:39 smithi031 bash[18426]: cluster 2020-06-27T05:36:37.755159+0000 mgr.x (mgr.34109) 1718 : cluster [DBG] pgmap v1798: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:39.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:39 smithi031 bash[22603]: cluster 2020-06-27T05:36:37.755159+0000 mgr.x (mgr.34109) 1718 : cluster [DBG] pgmap v1798: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:39.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:39 smithi051 bash[18409]: cluster 2020-06-27T05:36:37.755159+0000 mgr.x (mgr.34109) 1718 : cluster [DBG] pgmap v1798: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:41.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:41 smithi031 bash[22603]: cluster 2020-06-27T05:36:39.756872+0000 mgr.x (mgr.34109) 1719 : cluster [DBG] pgmap v1799: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:41.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:41 smithi031 bash[18426]: cluster 2020-06-27T05:36:39.756872+0000 mgr.x (mgr.34109) 1719 : cluster [DBG] pgmap v1799: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:41 smithi051 bash[18409]: cluster 2020-06-27T05:36:39.756872+0000 mgr.x (mgr.34109) 1719 : cluster [DBG] pgmap v1799: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:43 smithi051 bash[18409]: cluster 2020-06-27T05:36:41.758462+0000 mgr.x (mgr.34109) 1720 : cluster [DBG] pgmap v1800: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:43.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:43 smithi031 bash[18426]: cluster 2020-06-27T05:36:41.758462+0000 mgr.x (mgr.34109) 1720 : cluster [DBG] pgmap v1800: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:43 smithi031 bash[22603]: cluster 2020-06-27T05:36:41.758462+0000 mgr.x (mgr.34109) 1720 : cluster [DBG] pgmap v1800: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:45.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:45 smithi051 bash[18409]: cluster 2020-06-27T05:36:43.760082+0000 mgr.x (mgr.34109) 1721 : cluster [DBG] pgmap v1801: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:45.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:45 smithi031 bash[18426]: cluster 2020-06-27T05:36:43.760082+0000 mgr.x (mgr.34109) 1721 : cluster [DBG] pgmap v1801: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:45.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:45 smithi031 bash[22603]: cluster 2020-06-27T05:36:43.760082+0000 mgr.x (mgr.34109) 1721 : cluster [DBG] pgmap v1801: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:47.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:47 smithi051 bash[18409]: cluster 2020-06-27T05:36:45.761823+0000 mgr.x (mgr.34109) 1722 : cluster [DBG] pgmap v1802: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:47.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:47 smithi031 bash[18426]: cluster 2020-06-27T05:36:45.761823+0000 mgr.x (mgr.34109) 1722 : cluster [DBG] pgmap v1802: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:47.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:47 smithi031 bash[22603]: cluster 2020-06-27T05:36:45.761823+0000 mgr.x (mgr.34109) 1722 : cluster [DBG] pgmap v1802: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:49.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:49 smithi051 bash[18409]: cluster 2020-06-27T05:36:47.763500+0000 mgr.x (mgr.34109) 1723 : cluster [DBG] pgmap v1803: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:49.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:49 smithi031 bash[18426]: cluster 2020-06-27T05:36:47.763500+0000 mgr.x (mgr.34109) 1723 : cluster [DBG] pgmap v1803: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:49.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:49 smithi031 bash[22603]: cluster 2020-06-27T05:36:47.763500+0000 mgr.x (mgr.34109) 1723 : cluster [DBG] pgmap v1803: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:51.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:51 smithi051 bash[18409]: cluster 2020-06-27T05:36:49.765251+0000 mgr.x (mgr.34109) 1724 : cluster [DBG] pgmap v1804: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:51.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:51 smithi031 bash[18426]: cluster 2020-06-27T05:36:49.765251+0000 mgr.x (mgr.34109) 1724 : cluster [DBG] pgmap v1804: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:51.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:51 smithi031 bash[22603]: cluster 2020-06-27T05:36:49.765251+0000 mgr.x (mgr.34109) 1724 : cluster [DBG] pgmap v1804: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:53.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:53 smithi051 bash[18409]: cluster 2020-06-27T05:36:51.766987+0000 mgr.x (mgr.34109) 1725 : cluster [DBG] pgmap v1805: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:53.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:53 smithi031 bash[22603]: cluster 2020-06-27T05:36:51.766987+0000 mgr.x (mgr.34109) 1725 : cluster [DBG] pgmap v1805: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:53.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:53 smithi031 bash[18426]: cluster 2020-06-27T05:36:51.766987+0000 mgr.x (mgr.34109) 1725 : cluster [DBG] pgmap v1805: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:55.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:55 smithi051 bash[18409]: cluster 2020-06-27T05:36:53.768606+0000 mgr.x (mgr.34109) 1726 : cluster [DBG] pgmap v1806: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:55.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:55 smithi031 bash[18426]: cluster 2020-06-27T05:36:53.768606+0000 mgr.x (mgr.34109) 1726 : cluster [DBG] pgmap v1806: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:55.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:55 smithi031 bash[22603]: cluster 2020-06-27T05:36:53.768606+0000 mgr.x (mgr.34109) 1726 : cluster [DBG] pgmap v1806: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:57.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:57 smithi051 bash[18409]: cluster 2020-06-27T05:36:55.770272+0000 mgr.x (mgr.34109) 1727 : cluster [DBG] pgmap v1807: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:57.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:57 smithi031 bash[18426]: cluster 2020-06-27T05:36:55.770272+0000 mgr.x (mgr.34109) 1727 : cluster [DBG] pgmap v1807: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:57.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:57 smithi031 bash[22603]: cluster 2020-06-27T05:36:55.770272+0000 mgr.x (mgr.34109) 1727 : cluster [DBG] pgmap v1807: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:59.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:36:59 smithi051 bash[18409]: cluster 2020-06-27T05:36:57.771919+0000 mgr.x (mgr.34109) 1728 : cluster [DBG] pgmap v1808: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:59.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:36:59 smithi031 bash[18426]: cluster 2020-06-27T05:36:57.771919+0000 mgr.x (mgr.34109) 1728 : cluster [DBG] pgmap v1808: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:36:59.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:36:59 smithi031 bash[22603]: cluster 2020-06-27T05:36:57.771919+0000 mgr.x (mgr.34109) 1728 : cluster [DBG] pgmap v1808: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:01.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:01 smithi051 bash[18409]: cluster 2020-06-27T05:36:59.773641+0000 mgr.x (mgr.34109) 1729 : cluster [DBG] pgmap v1809: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:01.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:01 smithi031 bash[18426]: cluster 2020-06-27T05:36:59.773641+0000 mgr.x (mgr.34109) 1729 : cluster [DBG] pgmap v1809: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:01.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:01 smithi031 bash[22603]: cluster 2020-06-27T05:36:59.773641+0000 mgr.x (mgr.34109) 1729 : cluster [DBG] pgmap v1809: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:03.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:03 smithi051 bash[18409]: cluster 2020-06-27T05:37:01.775146+0000 mgr.x (mgr.34109) 1730 : cluster [DBG] pgmap v1810: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:03.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:03 smithi031 bash[18426]: cluster 2020-06-27T05:37:01.775146+0000 mgr.x (mgr.34109) 1730 : cluster [DBG] pgmap v1810: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:03.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:03 smithi031 bash[22603]: cluster 2020-06-27T05:37:01.775146+0000 mgr.x (mgr.34109) 1730 : cluster [DBG] pgmap v1810: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:05.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:05 smithi051 bash[18409]: cluster 2020-06-27T05:37:03.776852+0000 mgr.x (mgr.34109) 1731 : cluster [DBG] pgmap v1811: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:05 smithi031 bash[18426]: cluster 2020-06-27T05:37:03.776852+0000 mgr.x (mgr.34109) 1731 : cluster [DBG] pgmap v1811: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:05.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:05 smithi031 bash[22603]: cluster 2020-06-27T05:37:03.776852+0000 mgr.x (mgr.34109) 1731 : cluster [DBG] pgmap v1811: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:07.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:07 smithi051 bash[18409]: cluster 2020-06-27T05:37:05.778427+0000 mgr.x (mgr.34109) 1732 : cluster [DBG] pgmap v1812: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:07.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:07 smithi031 bash[18426]: cluster 2020-06-27T05:37:05.778427+0000 mgr.x (mgr.34109) 1732 : cluster [DBG] pgmap v1812: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:07.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:07 smithi031 bash[22603]: cluster 2020-06-27T05:37:05.778427+0000 mgr.x (mgr.34109) 1732 : cluster [DBG] pgmap v1812: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:09 smithi051 bash[18409]: cluster 2020-06-27T05:37:07.779968+0000 mgr.x (mgr.34109) 1733 : cluster [DBG] pgmap v1813: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:09.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:09 smithi031 bash[18426]: cluster 2020-06-27T05:37:07.779968+0000 mgr.x (mgr.34109) 1733 : cluster [DBG] pgmap v1813: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:09.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:09 smithi031 bash[22603]: cluster 2020-06-27T05:37:07.779968+0000 mgr.x (mgr.34109) 1733 : cluster [DBG] pgmap v1813: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:11.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:11 smithi051 bash[18409]: cluster 2020-06-27T05:37:09.781605+0000 mgr.x (mgr.34109) 1734 : cluster [DBG] pgmap v1814: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:12.664 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:11 smithi031 bash[18426]: cluster 2020-06-27T05:37:09.781605+0000 mgr.x (mgr.34109) 1734 : cluster [DBG] pgmap v1814: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:12.664 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:11 smithi031 bash[22603]: cluster 2020-06-27T05:37:09.781605+0000 mgr.x (mgr.34109) 1734 : cluster [DBG] pgmap v1814: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:13.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:13 smithi051 bash[18409]: cluster 2020-06-27T05:37:11.783143+0000 mgr.x (mgr.34109) 1735 : cluster [DBG] pgmap v1815: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:13.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:13 smithi031 bash[18426]: cluster 2020-06-27T05:37:11.783143+0000 mgr.x (mgr.34109) 1735 : cluster [DBG] pgmap v1815: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:13.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:13 smithi031 bash[22603]: cluster 2020-06-27T05:37:11.783143+0000 mgr.x (mgr.34109) 1735 : cluster [DBG] pgmap v1815: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:15.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:15 smithi051 bash[18409]: cluster 2020-06-27T05:37:13.784726+0000 mgr.x (mgr.34109) 1736 : cluster [DBG] pgmap v1816: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:15.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:15 smithi031 bash[18426]: cluster 2020-06-27T05:37:13.784726+0000 mgr.x (mgr.34109) 1736 : cluster [DBG] pgmap v1816: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:15.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:15 smithi031 bash[22603]: cluster 2020-06-27T05:37:13.784726+0000 mgr.x (mgr.34109) 1736 : cluster [DBG] pgmap v1816: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:17 smithi051 bash[18409]: cluster 2020-06-27T05:37:15.786312+0000 mgr.x (mgr.34109) 1737 : cluster [DBG] pgmap v1817: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:17.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:17 smithi031 bash[18426]: cluster 2020-06-27T05:37:15.786312+0000 mgr.x (mgr.34109) 1737 : cluster [DBG] pgmap v1817: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:17.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:17 smithi031 bash[22603]: cluster 2020-06-27T05:37:15.786312+0000 mgr.x (mgr.34109) 1737 : cluster [DBG] pgmap v1817: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:19.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:19 smithi051 bash[18409]: cluster 2020-06-27T05:37:17.787883+0000 mgr.x (mgr.34109) 1738 : cluster [DBG] pgmap v1818: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:19.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:19 smithi031 bash[18426]: cluster 2020-06-27T05:37:17.787883+0000 mgr.x (mgr.34109) 1738 : cluster [DBG] pgmap v1818: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:19.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:19 smithi031 bash[22603]: cluster 2020-06-27T05:37:17.787883+0000 mgr.x (mgr.34109) 1738 : cluster [DBG] pgmap v1818: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:21.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:21 smithi051 bash[18409]: cluster 2020-06-27T05:37:19.789627+0000 mgr.x (mgr.34109) 1739 : cluster [DBG] pgmap v1819: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:21.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:21 smithi031 bash[18426]: cluster 2020-06-27T05:37:19.789627+0000 mgr.x (mgr.34109) 1739 : cluster [DBG] pgmap v1819: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:21.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:21 smithi031 bash[22603]: cluster 2020-06-27T05:37:19.789627+0000 mgr.x (mgr.34109) 1739 : cluster [DBG] pgmap v1819: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:23.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:23 smithi051 bash[18409]: cluster 2020-06-27T05:37:21.791260+0000 mgr.x (mgr.34109) 1740 : cluster [DBG] pgmap v1820: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:23.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:23 smithi031 bash[18426]: cluster 2020-06-27T05:37:21.791260+0000 mgr.x (mgr.34109) 1740 : cluster [DBG] pgmap v1820: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:23.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:23 smithi031 bash[22603]: cluster 2020-06-27T05:37:21.791260+0000 mgr.x (mgr.34109) 1740 : cluster [DBG] pgmap v1820: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:25.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:25 smithi051 bash[18409]: cluster 2020-06-27T05:37:23.792958+0000 mgr.x (mgr.34109) 1741 : cluster [DBG] pgmap v1821: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:25.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:25 smithi031 bash[18426]: cluster 2020-06-27T05:37:23.792958+0000 mgr.x (mgr.34109) 1741 : cluster [DBG] pgmap v1821: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:25.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:25 smithi031 bash[22603]: cluster 2020-06-27T05:37:23.792958+0000 mgr.x (mgr.34109) 1741 : cluster [DBG] pgmap v1821: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:27.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:27 smithi051 bash[18409]: cluster 2020-06-27T05:37:25.794588+0000 mgr.x (mgr.34109) 1742 : cluster [DBG] pgmap v1822: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:27.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:27 smithi031 bash[18426]: cluster 2020-06-27T05:37:25.794588+0000 mgr.x (mgr.34109) 1742 : cluster [DBG] pgmap v1822: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:27.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:27 smithi031 bash[22603]: cluster 2020-06-27T05:37:25.794588+0000 mgr.x (mgr.34109) 1742 : cluster [DBG] pgmap v1822: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:29.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:29 smithi051 bash[18409]: cluster 2020-06-27T05:37:27.796110+0000 mgr.x (mgr.34109) 1743 : cluster [DBG] pgmap v1823: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:29.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:29 smithi031 bash[18426]: cluster 2020-06-27T05:37:27.796110+0000 mgr.x (mgr.34109) 1743 : cluster [DBG] pgmap v1823: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:29.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:29 smithi031 bash[22603]: cluster 2020-06-27T05:37:27.796110+0000 mgr.x (mgr.34109) 1743 : cluster [DBG] pgmap v1823: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:31.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:31 smithi051 bash[18409]: cluster 2020-06-27T05:37:29.797837+0000 mgr.x (mgr.34109) 1744 : cluster [DBG] pgmap v1824: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:31.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:31 smithi031 bash[18426]: cluster 2020-06-27T05:37:29.797837+0000 mgr.x (mgr.34109) 1744 : cluster [DBG] pgmap v1824: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:31.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:31 smithi031 bash[22603]: cluster 2020-06-27T05:37:29.797837+0000 mgr.x (mgr.34109) 1744 : cluster [DBG] pgmap v1824: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:33 smithi051 bash[18409]: cluster 2020-06-27T05:37:31.799505+0000 mgr.x (mgr.34109) 1745 : cluster [DBG] pgmap v1825: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:33.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:33 smithi031 bash[18426]: cluster 2020-06-27T05:37:31.799505+0000 mgr.x (mgr.34109) 1745 : cluster [DBG] pgmap v1825: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:33.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:33 smithi031 bash[22603]: cluster 2020-06-27T05:37:31.799505+0000 mgr.x (mgr.34109) 1745 : cluster [DBG] pgmap v1825: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:35.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:35 smithi051 bash[18409]: cluster 2020-06-27T05:37:33.801208+0000 mgr.x (mgr.34109) 1746 : cluster [DBG] pgmap v1826: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:35.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:35 smithi031 bash[18426]: cluster 2020-06-27T05:37:33.801208+0000 mgr.x (mgr.34109) 1746 : cluster [DBG] pgmap v1826: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:35.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:35 smithi031 bash[22603]: cluster 2020-06-27T05:37:33.801208+0000 mgr.x (mgr.34109) 1746 : cluster [DBG] pgmap v1826: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:37.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:37 smithi051 bash[18409]: cluster 2020-06-27T05:37:35.802847+0000 mgr.x (mgr.34109) 1747 : cluster [DBG] pgmap v1827: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:37.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:37 smithi031 bash[18426]: cluster 2020-06-27T05:37:35.802847+0000 mgr.x (mgr.34109) 1747 : cluster [DBG] pgmap v1827: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:37.729 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:37 smithi031 bash[22603]: cluster 2020-06-27T05:37:35.802847+0000 mgr.x (mgr.34109) 1747 : cluster [DBG] pgmap v1827: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:38.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:38 smithi051 bash[18409]: cluster 2020-06-27T05:37:37.804571+0000 mgr.x (mgr.34109) 1748 : cluster [DBG] pgmap v1828: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:38.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:38 smithi031 bash[18426]: cluster 2020-06-27T05:37:37.804571+0000 mgr.x (mgr.34109) 1748 : cluster [DBG] pgmap v1828: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:38.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:38 smithi031 bash[22603]: cluster 2020-06-27T05:37:37.804571+0000 mgr.x (mgr.34109) 1748 : cluster [DBG] pgmap v1828: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:41.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:41 smithi051 bash[18409]: cluster 2020-06-27T05:37:39.806268+0000 mgr.x (mgr.34109) 1749 : cluster [DBG] pgmap v1829: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:41.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:41 smithi031 bash[18426]: cluster 2020-06-27T05:37:39.806268+0000 mgr.x (mgr.34109) 1749 : cluster [DBG] pgmap v1829: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:41.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:41 smithi031 bash[22603]: cluster 2020-06-27T05:37:39.806268+0000 mgr.x (mgr.34109) 1749 : cluster [DBG] pgmap v1829: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:43.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:43 smithi051 bash[18409]: cluster 2020-06-27T05:37:41.807896+0000 mgr.x (mgr.34109) 1750 : cluster [DBG] pgmap v1830: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:43.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:43 smithi031 bash[18426]: cluster 2020-06-27T05:37:41.807896+0000 mgr.x (mgr.34109) 1750 : cluster [DBG] pgmap v1830: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:43.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:43 smithi031 bash[22603]: cluster 2020-06-27T05:37:41.807896+0000 mgr.x (mgr.34109) 1750 : cluster [DBG] pgmap v1830: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:45.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:45 smithi051 bash[18409]: cluster 2020-06-27T05:37:43.809537+0000 mgr.x (mgr.34109) 1751 : cluster [DBG] pgmap v1831: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:45.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:45 smithi031 bash[18426]: cluster 2020-06-27T05:37:43.809537+0000 mgr.x (mgr.34109) 1751 : cluster [DBG] pgmap v1831: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:45.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:45 smithi031 bash[22603]: cluster 2020-06-27T05:37:43.809537+0000 mgr.x (mgr.34109) 1751 : cluster [DBG] pgmap v1831: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:47.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:47 smithi051 bash[18409]: cluster 2020-06-27T05:37:45.811144+0000 mgr.x (mgr.34109) 1752 : cluster [DBG] pgmap v1832: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:47.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:47 smithi031 bash[18426]: cluster 2020-06-27T05:37:45.811144+0000 mgr.x (mgr.34109) 1752 : cluster [DBG] pgmap v1832: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:47.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:47 smithi031 bash[22603]: cluster 2020-06-27T05:37:45.811144+0000 mgr.x (mgr.34109) 1752 : cluster [DBG] pgmap v1832: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:49.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:49 smithi051 bash[18409]: cluster 2020-06-27T05:37:47.812904+0000 mgr.x (mgr.34109) 1753 : cluster [DBG] pgmap v1833: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:49.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:49 smithi031 bash[22603]: cluster 2020-06-27T05:37:47.812904+0000 mgr.x (mgr.34109) 1753 : cluster [DBG] pgmap v1833: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:49.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:49 smithi031 bash[18426]: cluster 2020-06-27T05:37:47.812904+0000 mgr.x (mgr.34109) 1753 : cluster [DBG] pgmap v1833: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:51.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:51 smithi051 bash[18409]: cluster 2020-06-27T05:37:49.814526+0000 mgr.x (mgr.34109) 1754 : cluster [DBG] pgmap v1834: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:51.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:51 smithi031 bash[22603]: cluster 2020-06-27T05:37:49.814526+0000 mgr.x (mgr.34109) 1754 : cluster [DBG] pgmap v1834: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:51.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:51 smithi031 bash[18426]: cluster 2020-06-27T05:37:49.814526+0000 mgr.x (mgr.34109) 1754 : cluster [DBG] pgmap v1834: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:53.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:53 smithi051 bash[18409]: cluster 2020-06-27T05:37:51.816327+0000 mgr.x (mgr.34109) 1755 : cluster [DBG] pgmap v1835: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:53.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:53 smithi031 bash[22603]: cluster 2020-06-27T05:37:51.816327+0000 mgr.x (mgr.34109) 1755 : cluster [DBG] pgmap v1835: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:53.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:53 smithi031 bash[18426]: cluster 2020-06-27T05:37:51.816327+0000 mgr.x (mgr.34109) 1755 : cluster [DBG] pgmap v1835: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:55.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:55 smithi051 bash[18409]: cluster 2020-06-27T05:37:53.817968+0000 mgr.x (mgr.34109) 1756 : cluster [DBG] pgmap v1836: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:55.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:55 smithi031 bash[18426]: cluster 2020-06-27T05:37:53.817968+0000 mgr.x (mgr.34109) 1756 : cluster [DBG] pgmap v1836: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:55.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:55 smithi031 bash[22603]: cluster 2020-06-27T05:37:53.817968+0000 mgr.x (mgr.34109) 1756 : cluster [DBG] pgmap v1836: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:57.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:57 smithi051 bash[18409]: cluster 2020-06-27T05:37:55.819645+0000 mgr.x (mgr.34109) 1757 : cluster [DBG] pgmap v1837: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:57.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:57 smithi031 bash[18426]: cluster 2020-06-27T05:37:55.819645+0000 mgr.x (mgr.34109) 1757 : cluster [DBG] pgmap v1837: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:57.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:57 smithi031 bash[22603]: cluster 2020-06-27T05:37:55.819645+0000 mgr.x (mgr.34109) 1757 : cluster [DBG] pgmap v1837: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:59.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:37:59 smithi051 bash[18409]: cluster 2020-06-27T05:37:57.821347+0000 mgr.x (mgr.34109) 1758 : cluster [DBG] pgmap v1838: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:59.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:37:59 smithi031 bash[22603]: cluster 2020-06-27T05:37:57.821347+0000 mgr.x (mgr.34109) 1758 : cluster [DBG] pgmap v1838: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:37:59.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:37:59 smithi031 bash[18426]: cluster 2020-06-27T05:37:57.821347+0000 mgr.x (mgr.34109) 1758 : cluster [DBG] pgmap v1838: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:01.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:01 smithi051 bash[18409]: cluster 2020-06-27T05:37:59.822974+0000 mgr.x (mgr.34109) 1759 : cluster [DBG] pgmap v1839: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:01.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:01 smithi031 bash[18426]: cluster 2020-06-27T05:37:59.822974+0000 mgr.x (mgr.34109) 1759 : cluster [DBG] pgmap v1839: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:01.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:01 smithi031 bash[22603]: cluster 2020-06-27T05:37:59.822974+0000 mgr.x (mgr.34109) 1759 : cluster [DBG] pgmap v1839: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:03.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:03 smithi051 bash[18409]: cluster 2020-06-27T05:38:01.824707+0000 mgr.x (mgr.34109) 1760 : cluster [DBG] pgmap v1840: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:03.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:03 smithi031 bash[18426]: cluster 2020-06-27T05:38:01.824707+0000 mgr.x (mgr.34109) 1760 : cluster [DBG] pgmap v1840: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:03.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:03 smithi031 bash[22603]: cluster 2020-06-27T05:38:01.824707+0000 mgr.x (mgr.34109) 1760 : cluster [DBG] pgmap v1840: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:05.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:05 smithi051 bash[18409]: cluster 2020-06-27T05:38:03.826443+0000 mgr.x (mgr.34109) 1761 : cluster [DBG] pgmap v1841: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:05.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:05 smithi031 bash[18426]: cluster 2020-06-27T05:38:03.826443+0000 mgr.x (mgr.34109) 1761 : cluster [DBG] pgmap v1841: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:05.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:05 smithi031 bash[22603]: cluster 2020-06-27T05:38:03.826443+0000 mgr.x (mgr.34109) 1761 : cluster [DBG] pgmap v1841: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:07.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:07 smithi051 bash[18409]: cluster 2020-06-27T05:38:05.828112+0000 mgr.x (mgr.34109) 1762 : cluster [DBG] pgmap v1842: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:07.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:07 smithi031 bash[18426]: cluster 2020-06-27T05:38:05.828112+0000 mgr.x (mgr.34109) 1762 : cluster [DBG] pgmap v1842: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:07.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:07 smithi031 bash[22603]: cluster 2020-06-27T05:38:05.828112+0000 mgr.x (mgr.34109) 1762 : cluster [DBG] pgmap v1842: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:09.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:09 smithi051 bash[18409]: cluster 2020-06-27T05:38:07.829829+0000 mgr.x (mgr.34109) 1763 : cluster [DBG] pgmap v1843: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:09.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:09 smithi031 bash[18426]: cluster 2020-06-27T05:38:07.829829+0000 mgr.x (mgr.34109) 1763 : cluster [DBG] pgmap v1843: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:09.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:09 smithi031 bash[22603]: cluster 2020-06-27T05:38:07.829829+0000 mgr.x (mgr.34109) 1763 : cluster [DBG] pgmap v1843: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:11.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:11 smithi051 bash[18409]: cluster 2020-06-27T05:38:09.831569+0000 mgr.x (mgr.34109) 1764 : cluster [DBG] pgmap v1844: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:11.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:11 smithi031 bash[22603]: cluster 2020-06-27T05:38:09.831569+0000 mgr.x (mgr.34109) 1764 : cluster [DBG] pgmap v1844: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:11 smithi031 bash[18426]: cluster 2020-06-27T05:38:09.831569+0000 mgr.x (mgr.34109) 1764 : cluster [DBG] pgmap v1844: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:13.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:13 smithi051 bash[18409]: cluster 2020-06-27T05:38:11.833125+0000 mgr.x (mgr.34109) 1765 : cluster [DBG] pgmap v1845: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:13.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:13 smithi031 bash[22603]: cluster 2020-06-27T05:38:11.833125+0000 mgr.x (mgr.34109) 1765 : cluster [DBG] pgmap v1845: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:13.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:13 smithi031 bash[18426]: cluster 2020-06-27T05:38:11.833125+0000 mgr.x (mgr.34109) 1765 : cluster [DBG] pgmap v1845: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:15.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:15 smithi051 bash[18409]: cluster 2020-06-27T05:38:13.834809+0000 mgr.x (mgr.34109) 1766 : cluster [DBG] pgmap v1846: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:15.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:15 smithi031 bash[18426]: cluster 2020-06-27T05:38:13.834809+0000 mgr.x (mgr.34109) 1766 : cluster [DBG] pgmap v1846: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:15.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:15 smithi031 bash[22603]: cluster 2020-06-27T05:38:13.834809+0000 mgr.x (mgr.34109) 1766 : cluster [DBG] pgmap v1846: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:17.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:17 smithi051 bash[18409]: cluster 2020-06-27T05:38:15.836511+0000 mgr.x (mgr.34109) 1767 : cluster [DBG] pgmap v1847: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:17.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:17 smithi031 bash[18426]: cluster 2020-06-27T05:38:15.836511+0000 mgr.x (mgr.34109) 1767 : cluster [DBG] pgmap v1847: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:17.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:17 smithi031 bash[22603]: cluster 2020-06-27T05:38:15.836511+0000 mgr.x (mgr.34109) 1767 : cluster [DBG] pgmap v1847: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:19.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:19 smithi051 bash[18409]: cluster 2020-06-27T05:38:17.838160+0000 mgr.x (mgr.34109) 1768 : cluster [DBG] pgmap v1848: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:19.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:19 smithi031 bash[18426]: cluster 2020-06-27T05:38:17.838160+0000 mgr.x (mgr.34109) 1768 : cluster [DBG] pgmap v1848: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:19.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:19 smithi031 bash[22603]: cluster 2020-06-27T05:38:17.838160+0000 mgr.x (mgr.34109) 1768 : cluster [DBG] pgmap v1848: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:21.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:21 smithi051 bash[18409]: cluster 2020-06-27T05:38:19.839757+0000 mgr.x (mgr.34109) 1769 : cluster [DBG] pgmap v1849: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:21.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:21 smithi031 bash[18426]: cluster 2020-06-27T05:38:19.839757+0000 mgr.x (mgr.34109) 1769 : cluster [DBG] pgmap v1849: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:21.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:21 smithi031 bash[22603]: cluster 2020-06-27T05:38:19.839757+0000 mgr.x (mgr.34109) 1769 : cluster [DBG] pgmap v1849: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:23.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:23 smithi051 bash[18409]: cluster 2020-06-27T05:38:21.841447+0000 mgr.x (mgr.34109) 1770 : cluster [DBG] pgmap v1850: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:23.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:23 smithi031 bash[18426]: cluster 2020-06-27T05:38:21.841447+0000 mgr.x (mgr.34109) 1770 : cluster [DBG] pgmap v1850: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:23.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:23 smithi031 bash[22603]: cluster 2020-06-27T05:38:21.841447+0000 mgr.x (mgr.34109) 1770 : cluster [DBG] pgmap v1850: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:25.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:25 smithi051 bash[18409]: cluster 2020-06-27T05:38:23.843166+0000 mgr.x (mgr.34109) 1771 : cluster [DBG] pgmap v1851: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:25.472 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:25 smithi031 bash[18426]: cluster 2020-06-27T05:38:23.843166+0000 mgr.x (mgr.34109) 1771 : cluster [DBG] pgmap v1851: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:25.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:25 smithi031 bash[22603]: cluster 2020-06-27T05:38:23.843166+0000 mgr.x (mgr.34109) 1771 : cluster [DBG] pgmap v1851: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:27.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:27 smithi051 bash[18409]: cluster 2020-06-27T05:38:25.844862+0000 mgr.x (mgr.34109) 1772 : cluster [DBG] pgmap v1852: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:27.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:27 smithi031 bash[18426]: cluster 2020-06-27T05:38:25.844862+0000 mgr.x (mgr.34109) 1772 : cluster [DBG] pgmap v1852: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:27.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:27 smithi031 bash[22603]: cluster 2020-06-27T05:38:25.844862+0000 mgr.x (mgr.34109) 1772 : cluster [DBG] pgmap v1852: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:29.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:29 smithi051 bash[18409]: cluster 2020-06-27T05:38:27.846517+0000 mgr.x (mgr.34109) 1773 : cluster [DBG] pgmap v1853: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:29.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:29 smithi031 bash[18426]: cluster 2020-06-27T05:38:27.846517+0000 mgr.x (mgr.34109) 1773 : cluster [DBG] pgmap v1853: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:29.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:29 smithi031 bash[22603]: cluster 2020-06-27T05:38:27.846517+0000 mgr.x (mgr.34109) 1773 : cluster [DBG] pgmap v1853: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:31.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:31 smithi051 bash[18409]: cluster 2020-06-27T05:38:29.848338+0000 mgr.x (mgr.34109) 1774 : cluster [DBG] pgmap v1854: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:31.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:31 smithi031 bash[18426]: cluster 2020-06-27T05:38:29.848338+0000 mgr.x (mgr.34109) 1774 : cluster [DBG] pgmap v1854: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:31.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:31 smithi031 bash[22603]: cluster 2020-06-27T05:38:29.848338+0000 mgr.x (mgr.34109) 1774 : cluster [DBG] pgmap v1854: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:33 smithi051 bash[18409]: cluster 2020-06-27T05:38:31.850074+0000 mgr.x (mgr.34109) 1775 : cluster [DBG] pgmap v1855: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:33.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:33 smithi031 bash[18426]: cluster 2020-06-27T05:38:31.850074+0000 mgr.x (mgr.34109) 1775 : cluster [DBG] pgmap v1855: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:33.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:33 smithi031 bash[22603]: cluster 2020-06-27T05:38:31.850074+0000 mgr.x (mgr.34109) 1775 : cluster [DBG] pgmap v1855: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:35.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:35 smithi051 bash[18409]: cluster 2020-06-27T05:38:33.851721+0000 mgr.x (mgr.34109) 1776 : cluster [DBG] pgmap v1856: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:35.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:35 smithi031 bash[18426]: cluster 2020-06-27T05:38:33.851721+0000 mgr.x (mgr.34109) 1776 : cluster [DBG] pgmap v1856: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:35.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:35 smithi031 bash[22603]: cluster 2020-06-27T05:38:33.851721+0000 mgr.x (mgr.34109) 1776 : cluster [DBG] pgmap v1856: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:37.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:37 smithi051 bash[18409]: cluster 2020-06-27T05:38:35.853372+0000 mgr.x (mgr.34109) 1777 : cluster [DBG] pgmap v1857: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:37.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:37 smithi031 bash[18426]: cluster 2020-06-27T05:38:35.853372+0000 mgr.x (mgr.34109) 1777 : cluster [DBG] pgmap v1857: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:37.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:37 smithi031 bash[22603]: cluster 2020-06-27T05:38:35.853372+0000 mgr.x (mgr.34109) 1777 : cluster [DBG] pgmap v1857: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:39.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:39 smithi051 bash[18409]: cluster 2020-06-27T05:38:37.855022+0000 mgr.x (mgr.34109) 1778 : cluster [DBG] pgmap v1858: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:39 smithi031 bash[18426]: cluster 2020-06-27T05:38:37.855022+0000 mgr.x (mgr.34109) 1778 : cluster [DBG] pgmap v1858: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:39.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:39 smithi031 bash[22603]: cluster 2020-06-27T05:38:37.855022+0000 mgr.x (mgr.34109) 1778 : cluster [DBG] pgmap v1858: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:41 smithi051 bash[18409]: cluster 2020-06-27T05:38:39.856837+0000 mgr.x (mgr.34109) 1779 : cluster [DBG] pgmap v1859: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:41 smithi031 bash[18426]: cluster 2020-06-27T05:38:39.856837+0000 mgr.x (mgr.34109) 1779 : cluster [DBG] pgmap v1859: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:41.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:41 smithi031 bash[22603]: cluster 2020-06-27T05:38:39.856837+0000 mgr.x (mgr.34109) 1779 : cluster [DBG] pgmap v1859: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:43 smithi051 bash[18409]: cluster 2020-06-27T05:38:41.858472+0000 mgr.x (mgr.34109) 1780 : cluster [DBG] pgmap v1860: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:43 smithi031 bash[22603]: cluster 2020-06-27T05:38:41.858472+0000 mgr.x (mgr.34109) 1780 : cluster [DBG] pgmap v1860: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:43.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:43 smithi031 bash[18426]: cluster 2020-06-27T05:38:41.858472+0000 mgr.x (mgr.34109) 1780 : cluster [DBG] pgmap v1860: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:45.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:45 smithi051 bash[18409]: cluster 2020-06-27T05:38:43.860042+0000 mgr.x (mgr.34109) 1781 : cluster [DBG] pgmap v1861: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:45.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:45 smithi031 bash[18426]: cluster 2020-06-27T05:38:43.860042+0000 mgr.x (mgr.34109) 1781 : cluster [DBG] pgmap v1861: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:45.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:45 smithi031 bash[22603]: cluster 2020-06-27T05:38:43.860042+0000 mgr.x (mgr.34109) 1781 : cluster [DBG] pgmap v1861: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:47.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:47 smithi051 bash[18409]: cluster 2020-06-27T05:38:45.861825+0000 mgr.x (mgr.34109) 1782 : cluster [DBG] pgmap v1862: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:47.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:47 smithi031 bash[18426]: cluster 2020-06-27T05:38:45.861825+0000 mgr.x (mgr.34109) 1782 : cluster [DBG] pgmap v1862: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:47.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:47 smithi031 bash[22603]: cluster 2020-06-27T05:38:45.861825+0000 mgr.x (mgr.34109) 1782 : cluster [DBG] pgmap v1862: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:49.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:49 smithi051 bash[18409]: cluster 2020-06-27T05:38:47.863497+0000 mgr.x (mgr.34109) 1783 : cluster [DBG] pgmap v1863: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:49.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:49 smithi031 bash[18426]: cluster 2020-06-27T05:38:47.863497+0000 mgr.x (mgr.34109) 1783 : cluster [DBG] pgmap v1863: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:49.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:49 smithi031 bash[22603]: cluster 2020-06-27T05:38:47.863497+0000 mgr.x (mgr.34109) 1783 : cluster [DBG] pgmap v1863: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:51.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:51 smithi051 bash[18409]: cluster 2020-06-27T05:38:49.865246+0000 mgr.x (mgr.34109) 1784 : cluster [DBG] pgmap v1864: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:51.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:51 smithi031 bash[18426]: cluster 2020-06-27T05:38:49.865246+0000 mgr.x (mgr.34109) 1784 : cluster [DBG] pgmap v1864: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:51.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:51 smithi031 bash[22603]: cluster 2020-06-27T05:38:49.865246+0000 mgr.x (mgr.34109) 1784 : cluster [DBG] pgmap v1864: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:53.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:53 smithi051 bash[18409]: cluster 2020-06-27T05:38:51.866963+0000 mgr.x (mgr.34109) 1785 : cluster [DBG] pgmap v1865: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:53.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:53 smithi031 bash[18426]: cluster 2020-06-27T05:38:51.866963+0000 mgr.x (mgr.34109) 1785 : cluster [DBG] pgmap v1865: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:53.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:53 smithi031 bash[22603]: cluster 2020-06-27T05:38:51.866963+0000 mgr.x (mgr.34109) 1785 : cluster [DBG] pgmap v1865: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:55.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:55 smithi051 bash[18409]: cluster 2020-06-27T05:38:53.868688+0000 mgr.x (mgr.34109) 1786 : cluster [DBG] pgmap v1866: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:55.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:55 smithi031 bash[18426]: cluster 2020-06-27T05:38:53.868688+0000 mgr.x (mgr.34109) 1786 : cluster [DBG] pgmap v1866: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:55.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:55 smithi031 bash[22603]: cluster 2020-06-27T05:38:53.868688+0000 mgr.x (mgr.34109) 1786 : cluster [DBG] pgmap v1866: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:57.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:57 smithi051 bash[18409]: cluster 2020-06-27T05:38:55.870373+0000 mgr.x (mgr.34109) 1787 : cluster [DBG] pgmap v1867: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:57.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:57 smithi031 bash[18426]: cluster 2020-06-27T05:38:55.870373+0000 mgr.x (mgr.34109) 1787 : cluster [DBG] pgmap v1867: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:57.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:57 smithi031 bash[22603]: cluster 2020-06-27T05:38:55.870373+0000 mgr.x (mgr.34109) 1787 : cluster [DBG] pgmap v1867: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:59.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:38:59 smithi051 bash[18409]: cluster 2020-06-27T05:38:57.871924+0000 mgr.x (mgr.34109) 1788 : cluster [DBG] pgmap v1868: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:59.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:38:59 smithi031 bash[18426]: cluster 2020-06-27T05:38:57.871924+0000 mgr.x (mgr.34109) 1788 : cluster [DBG] pgmap v1868: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:38:59.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:38:59 smithi031 bash[22603]: cluster 2020-06-27T05:38:57.871924+0000 mgr.x (mgr.34109) 1788 : cluster [DBG] pgmap v1868: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:01.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:01 smithi051 bash[18409]: cluster 2020-06-27T05:38:59.873541+0000 mgr.x (mgr.34109) 1789 : cluster [DBG] pgmap v1869: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:01.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:01 smithi031 bash[18426]: cluster 2020-06-27T05:38:59.873541+0000 mgr.x (mgr.34109) 1789 : cluster [DBG] pgmap v1869: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:01.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:01 smithi031 bash[22603]: cluster 2020-06-27T05:38:59.873541+0000 mgr.x (mgr.34109) 1789 : cluster [DBG] pgmap v1869: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:03.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:03 smithi051 bash[18409]: cluster 2020-06-27T05:39:01.875233+0000 mgr.x (mgr.34109) 1790 : cluster [DBG] pgmap v1870: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:03.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:03 smithi031 bash[18426]: cluster 2020-06-27T05:39:01.875233+0000 mgr.x (mgr.34109) 1790 : cluster [DBG] pgmap v1870: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:03.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:03 smithi031 bash[22603]: cluster 2020-06-27T05:39:01.875233+0000 mgr.x (mgr.34109) 1790 : cluster [DBG] pgmap v1870: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:05.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:05 smithi051 bash[18409]: cluster 2020-06-27T05:39:03.876861+0000 mgr.x (mgr.34109) 1791 : cluster [DBG] pgmap v1871: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:05 smithi031 bash[18426]: cluster 2020-06-27T05:39:03.876861+0000 mgr.x (mgr.34109) 1791 : cluster [DBG] pgmap v1871: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:05.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:05 smithi031 bash[22603]: cluster 2020-06-27T05:39:03.876861+0000 mgr.x (mgr.34109) 1791 : cluster [DBG] pgmap v1871: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:07.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:07 smithi051 bash[18409]: cluster 2020-06-27T05:39:05.878565+0000 mgr.x (mgr.34109) 1792 : cluster [DBG] pgmap v1872: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:07.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:07 smithi031 bash[18426]: cluster 2020-06-27T05:39:05.878565+0000 mgr.x (mgr.34109) 1792 : cluster [DBG] pgmap v1872: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:07.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:07 smithi031 bash[22603]: cluster 2020-06-27T05:39:05.878565+0000 mgr.x (mgr.34109) 1792 : cluster [DBG] pgmap v1872: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:09 smithi051 bash[18409]: cluster 2020-06-27T05:39:07.880375+0000 mgr.x (mgr.34109) 1793 : cluster [DBG] pgmap v1873: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:09.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:09 smithi031 bash[18426]: cluster 2020-06-27T05:39:07.880375+0000 mgr.x (mgr.34109) 1793 : cluster [DBG] pgmap v1873: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:09.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:09 smithi031 bash[22603]: cluster 2020-06-27T05:39:07.880375+0000 mgr.x (mgr.34109) 1793 : cluster [DBG] pgmap v1873: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:11.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:11 smithi051 bash[18409]: cluster 2020-06-27T05:39:09.882160+0000 mgr.x (mgr.34109) 1794 : cluster [DBG] pgmap v1874: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:11.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:11 smithi031 bash[18426]: cluster 2020-06-27T05:39:09.882160+0000 mgr.x (mgr.34109) 1794 : cluster [DBG] pgmap v1874: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:11.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:11 smithi031 bash[22603]: cluster 2020-06-27T05:39:09.882160+0000 mgr.x (mgr.34109) 1794 : cluster [DBG] pgmap v1874: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:13.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:13 smithi051 bash[18409]: cluster 2020-06-27T05:39:11.883796+0000 mgr.x (mgr.34109) 1795 : cluster [DBG] pgmap v1875: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:13.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:13 smithi031 bash[18426]: cluster 2020-06-27T05:39:11.883796+0000 mgr.x (mgr.34109) 1795 : cluster [DBG] pgmap v1875: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:13.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:13 smithi031 bash[22603]: cluster 2020-06-27T05:39:11.883796+0000 mgr.x (mgr.34109) 1795 : cluster [DBG] pgmap v1875: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:15.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:15 smithi051 bash[18409]: cluster 2020-06-27T05:39:13.885526+0000 mgr.x (mgr.34109) 1796 : cluster [DBG] pgmap v1876: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:15.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:15 smithi031 bash[18426]: cluster 2020-06-27T05:39:13.885526+0000 mgr.x (mgr.34109) 1796 : cluster [DBG] pgmap v1876: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:15.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:15 smithi031 bash[22603]: cluster 2020-06-27T05:39:13.885526+0000 mgr.x (mgr.34109) 1796 : cluster [DBG] pgmap v1876: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:17 smithi051 bash[18409]: cluster 2020-06-27T05:39:15.887252+0000 mgr.x (mgr.34109) 1797 : cluster [DBG] pgmap v1877: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:17.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:17 smithi031 bash[18426]: cluster 2020-06-27T05:39:15.887252+0000 mgr.x (mgr.34109) 1797 : cluster [DBG] pgmap v1877: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:17.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:17 smithi031 bash[22603]: cluster 2020-06-27T05:39:15.887252+0000 mgr.x (mgr.34109) 1797 : cluster [DBG] pgmap v1877: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:19.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:19 smithi051 bash[18409]: cluster 2020-06-27T05:39:17.888957+0000 mgr.x (mgr.34109) 1798 : cluster [DBG] pgmap v1878: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:19.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:19 smithi031 bash[18426]: cluster 2020-06-27T05:39:17.888957+0000 mgr.x (mgr.34109) 1798 : cluster [DBG] pgmap v1878: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:19.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:19 smithi031 bash[22603]: cluster 2020-06-27T05:39:17.888957+0000 mgr.x (mgr.34109) 1798 : cluster [DBG] pgmap v1878: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:21.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:21 smithi051 bash[18409]: cluster 2020-06-27T05:39:19.890625+0000 mgr.x (mgr.34109) 1799 : cluster [DBG] pgmap v1879: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:21.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:21 smithi031 bash[18426]: cluster 2020-06-27T05:39:19.890625+0000 mgr.x (mgr.34109) 1799 : cluster [DBG] pgmap v1879: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:21.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:21 smithi031 bash[22603]: cluster 2020-06-27T05:39:19.890625+0000 mgr.x (mgr.34109) 1799 : cluster [DBG] pgmap v1879: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:23.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:23 smithi051 bash[18409]: cluster 2020-06-27T05:39:21.892370+0000 mgr.x (mgr.34109) 1800 : cluster [DBG] pgmap v1880: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:23.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:23 smithi031 bash[18426]: cluster 2020-06-27T05:39:21.892370+0000 mgr.x (mgr.34109) 1800 : cluster [DBG] pgmap v1880: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:23.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:23 smithi031 bash[22603]: cluster 2020-06-27T05:39:21.892370+0000 mgr.x (mgr.34109) 1800 : cluster [DBG] pgmap v1880: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:25.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:25 smithi051 bash[18409]: cluster 2020-06-27T05:39:23.893981+0000 mgr.x (mgr.34109) 1801 : cluster [DBG] pgmap v1881: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:25.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:25 smithi031 bash[18426]: cluster 2020-06-27T05:39:23.893981+0000 mgr.x (mgr.34109) 1801 : cluster [DBG] pgmap v1881: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:25.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:25 smithi031 bash[22603]: cluster 2020-06-27T05:39:23.893981+0000 mgr.x (mgr.34109) 1801 : cluster [DBG] pgmap v1881: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:27.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:27 smithi051 bash[18409]: cluster 2020-06-27T05:39:25.895594+0000 mgr.x (mgr.34109) 1802 : cluster [DBG] pgmap v1882: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:27.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:27 smithi031 bash[18426]: cluster 2020-06-27T05:39:25.895594+0000 mgr.x (mgr.34109) 1802 : cluster [DBG] pgmap v1882: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:27.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:27 smithi031 bash[22603]: cluster 2020-06-27T05:39:25.895594+0000 mgr.x (mgr.34109) 1802 : cluster [DBG] pgmap v1882: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:29.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:29 smithi051 bash[18409]: cluster 2020-06-27T05:39:27.897264+0000 mgr.x (mgr.34109) 1803 : cluster [DBG] pgmap v1883: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:29.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:29 smithi031 bash[18426]: cluster 2020-06-27T05:39:27.897264+0000 mgr.x (mgr.34109) 1803 : cluster [DBG] pgmap v1883: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:29.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:29 smithi031 bash[22603]: cluster 2020-06-27T05:39:27.897264+0000 mgr.x (mgr.34109) 1803 : cluster [DBG] pgmap v1883: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:31.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:31 smithi051 bash[18409]: cluster 2020-06-27T05:39:29.898998+0000 mgr.x (mgr.34109) 1804 : cluster [DBG] pgmap v1884: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:31.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:31 smithi031 bash[18426]: cluster 2020-06-27T05:39:29.898998+0000 mgr.x (mgr.34109) 1804 : cluster [DBG] pgmap v1884: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:31.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:31 smithi031 bash[22603]: cluster 2020-06-27T05:39:29.898998+0000 mgr.x (mgr.34109) 1804 : cluster [DBG] pgmap v1884: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:33 smithi051 bash[18409]: cluster 2020-06-27T05:39:31.900552+0000 mgr.x (mgr.34109) 1805 : cluster [DBG] pgmap v1885: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:33.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:33 smithi031 bash[18426]: cluster 2020-06-27T05:39:31.900552+0000 mgr.x (mgr.34109) 1805 : cluster [DBG] pgmap v1885: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:33.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:33 smithi031 bash[22603]: cluster 2020-06-27T05:39:31.900552+0000 mgr.x (mgr.34109) 1805 : cluster [DBG] pgmap v1885: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:35.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:35 smithi051 bash[18409]: cluster 2020-06-27T05:39:33.902311+0000 mgr.x (mgr.34109) 1806 : cluster [DBG] pgmap v1886: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:35.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:35 smithi031 bash[18426]: cluster 2020-06-27T05:39:33.902311+0000 mgr.x (mgr.34109) 1806 : cluster [DBG] pgmap v1886: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:35.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:35 smithi031 bash[22603]: cluster 2020-06-27T05:39:33.902311+0000 mgr.x (mgr.34109) 1806 : cluster [DBG] pgmap v1886: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:37.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:37 smithi051 bash[18409]: cluster 2020-06-27T05:39:35.903997+0000 mgr.x (mgr.34109) 1807 : cluster [DBG] pgmap v1887: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:37.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:37 smithi031 bash[18426]: cluster 2020-06-27T05:39:35.903997+0000 mgr.x (mgr.34109) 1807 : cluster [DBG] pgmap v1887: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:37.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:37 smithi031 bash[22603]: cluster 2020-06-27T05:39:35.903997+0000 mgr.x (mgr.34109) 1807 : cluster [DBG] pgmap v1887: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:39.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:39 smithi051 bash[18409]: cluster 2020-06-27T05:39:37.905689+0000 mgr.x (mgr.34109) 1808 : cluster [DBG] pgmap v1888: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:39 smithi031 bash[18426]: cluster 2020-06-27T05:39:37.905689+0000 mgr.x (mgr.34109) 1808 : cluster [DBG] pgmap v1888: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:39.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:39 smithi031 bash[22603]: cluster 2020-06-27T05:39:37.905689+0000 mgr.x (mgr.34109) 1808 : cluster [DBG] pgmap v1888: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:41.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:41 smithi051 bash[18409]: cluster 2020-06-27T05:39:39.907395+0000 mgr.x (mgr.34109) 1809 : cluster [DBG] pgmap v1889: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:41 smithi031 bash[18426]: cluster 2020-06-27T05:39:39.907395+0000 mgr.x (mgr.34109) 1809 : cluster [DBG] pgmap v1889: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:41.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:41 smithi031 bash[22603]: cluster 2020-06-27T05:39:39.907395+0000 mgr.x (mgr.34109) 1809 : cluster [DBG] pgmap v1889: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:43 smithi051 bash[18409]: cluster 2020-06-27T05:39:41.908974+0000 mgr.x (mgr.34109) 1810 : cluster [DBG] pgmap v1890: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:43.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:43 smithi031 bash[18426]: cluster 2020-06-27T05:39:41.908974+0000 mgr.x (mgr.34109) 1810 : cluster [DBG] pgmap v1890: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:43 smithi031 bash[22603]: cluster 2020-06-27T05:39:41.908974+0000 mgr.x (mgr.34109) 1810 : cluster [DBG] pgmap v1890: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:44.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:44 smithi051 bash[18409]: cluster 2020-06-27T05:39:43.910566+0000 mgr.x (mgr.34109) 1811 : cluster [DBG] pgmap v1891: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:44.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:44 smithi031 bash[18426]: cluster 2020-06-27T05:39:43.910566+0000 mgr.x (mgr.34109) 1811 : cluster [DBG] pgmap v1891: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:44.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:44 smithi031 bash[22603]: cluster 2020-06-27T05:39:43.910566+0000 mgr.x (mgr.34109) 1811 : cluster [DBG] pgmap v1891: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:47.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:47 smithi051 bash[18409]: cluster 2020-06-27T05:39:45.912267+0000 mgr.x (mgr.34109) 1812 : cluster [DBG] pgmap v1892: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:47.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:47 smithi031 bash[22603]: cluster 2020-06-27T05:39:45.912267+0000 mgr.x (mgr.34109) 1812 : cluster [DBG] pgmap v1892: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:47.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:47 smithi031 bash[18426]: cluster 2020-06-27T05:39:45.912267+0000 mgr.x (mgr.34109) 1812 : cluster [DBG] pgmap v1892: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:49.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:49 smithi051 bash[18409]: cluster 2020-06-27T05:39:47.913996+0000 mgr.x (mgr.34109) 1813 : cluster [DBG] pgmap v1893: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:49.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:49 smithi031 bash[18426]: cluster 2020-06-27T05:39:47.913996+0000 mgr.x (mgr.34109) 1813 : cluster [DBG] pgmap v1893: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:49.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:49 smithi031 bash[22603]: cluster 2020-06-27T05:39:47.913996+0000 mgr.x (mgr.34109) 1813 : cluster [DBG] pgmap v1893: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:51.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:51 smithi051 bash[18409]: cluster 2020-06-27T05:39:49.915712+0000 mgr.x (mgr.34109) 1814 : cluster [DBG] pgmap v1894: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:51.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:51 smithi031 bash[18426]: cluster 2020-06-27T05:39:49.915712+0000 mgr.x (mgr.34109) 1814 : cluster [DBG] pgmap v1894: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:51.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:51 smithi031 bash[22603]: cluster 2020-06-27T05:39:49.915712+0000 mgr.x (mgr.34109) 1814 : cluster [DBG] pgmap v1894: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:53.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:53 smithi051 bash[18409]: cluster 2020-06-27T05:39:51.917318+0000 mgr.x (mgr.34109) 1815 : cluster [DBG] pgmap v1895: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:53.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:53 smithi031 bash[18426]: cluster 2020-06-27T05:39:51.917318+0000 mgr.x (mgr.34109) 1815 : cluster [DBG] pgmap v1895: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:53.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:53 smithi031 bash[22603]: cluster 2020-06-27T05:39:51.917318+0000 mgr.x (mgr.34109) 1815 : cluster [DBG] pgmap v1895: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:55.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:55 smithi051 bash[18409]: cluster 2020-06-27T05:39:53.919017+0000 mgr.x (mgr.34109) 1816 : cluster [DBG] pgmap v1896: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:55.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:55 smithi031 bash[18426]: cluster 2020-06-27T05:39:53.919017+0000 mgr.x (mgr.34109) 1816 : cluster [DBG] pgmap v1896: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:55.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:55 smithi031 bash[22603]: cluster 2020-06-27T05:39:53.919017+0000 mgr.x (mgr.34109) 1816 : cluster [DBG] pgmap v1896: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:57.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:57 smithi051 bash[18409]: cluster 2020-06-27T05:39:55.920722+0000 mgr.x (mgr.34109) 1817 : cluster [DBG] pgmap v1897: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:57.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:57 smithi031 bash[18426]: cluster 2020-06-27T05:39:55.920722+0000 mgr.x (mgr.34109) 1817 : cluster [DBG] pgmap v1897: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:57.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:57 smithi031 bash[22603]: cluster 2020-06-27T05:39:55.920722+0000 mgr.x (mgr.34109) 1817 : cluster [DBG] pgmap v1897: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:59.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:39:59 smithi051 bash[18409]: cluster 2020-06-27T05:39:57.922429+0000 mgr.x (mgr.34109) 1818 : cluster [DBG] pgmap v1898: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:59.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:39:59 smithi031 bash[18426]: cluster 2020-06-27T05:39:57.922429+0000 mgr.x (mgr.34109) 1818 : cluster [DBG] pgmap v1898: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:39:59.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:39:59 smithi031 bash[22603]: cluster 2020-06-27T05:39:57.922429+0000 mgr.x (mgr.34109) 1818 : cluster [DBG] pgmap v1898: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:01.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:01 smithi051 bash[18409]: cluster 2020-06-27T05:39:59.924213+0000 mgr.x (mgr.34109) 1819 : cluster [DBG] pgmap v1899: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:01.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:01 smithi031 bash[18426]: cluster 2020-06-27T05:39:59.924213+0000 mgr.x (mgr.34109) 1819 : cluster [DBG] pgmap v1899: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:01.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:01 smithi031 bash[22603]: cluster 2020-06-27T05:39:59.924213+0000 mgr.x (mgr.34109) 1819 : cluster [DBG] pgmap v1899: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:03.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:03 smithi051 bash[18409]: cluster 2020-06-27T05:40:01.925811+0000 mgr.x (mgr.34109) 1820 : cluster [DBG] pgmap v1900: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:03.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:03 smithi031 bash[18426]: cluster 2020-06-27T05:40:01.925811+0000 mgr.x (mgr.34109) 1820 : cluster [DBG] pgmap v1900: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:03.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:03 smithi031 bash[22603]: cluster 2020-06-27T05:40:01.925811+0000 mgr.x (mgr.34109) 1820 : cluster [DBG] pgmap v1900: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:05.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:05 smithi051 bash[18409]: cluster 2020-06-27T05:40:03.927352+0000 mgr.x (mgr.34109) 1821 : cluster [DBG] pgmap v1901: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:05.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:05 smithi031 bash[18426]: cluster 2020-06-27T05:40:03.927352+0000 mgr.x (mgr.34109) 1821 : cluster [DBG] pgmap v1901: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:05.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:05 smithi031 bash[22603]: cluster 2020-06-27T05:40:03.927352+0000 mgr.x (mgr.34109) 1821 : cluster [DBG] pgmap v1901: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:07.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:07 smithi051 bash[18409]: cluster 2020-06-27T05:40:05.929040+0000 mgr.x (mgr.34109) 1822 : cluster [DBG] pgmap v1902: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:07.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:07 smithi031 bash[18426]: cluster 2020-06-27T05:40:05.929040+0000 mgr.x (mgr.34109) 1822 : cluster [DBG] pgmap v1902: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:07.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:07 smithi031 bash[22603]: cluster 2020-06-27T05:40:05.929040+0000 mgr.x (mgr.34109) 1822 : cluster [DBG] pgmap v1902: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:09.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:09 smithi051 bash[18409]: cluster 2020-06-27T05:40:07.930712+0000 mgr.x (mgr.34109) 1823 : cluster [DBG] pgmap v1903: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:09.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:09 smithi031 bash[18426]: cluster 2020-06-27T05:40:07.930712+0000 mgr.x (mgr.34109) 1823 : cluster [DBG] pgmap v1903: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:09.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:09 smithi031 bash[22603]: cluster 2020-06-27T05:40:07.930712+0000 mgr.x (mgr.34109) 1823 : cluster [DBG] pgmap v1903: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:11.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:11 smithi051 bash[18409]: cluster 2020-06-27T05:40:09.932471+0000 mgr.x (mgr.34109) 1824 : cluster [DBG] pgmap v1904: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:11 smithi031 bash[18426]: cluster 2020-06-27T05:40:09.932471+0000 mgr.x (mgr.34109) 1824 : cluster [DBG] pgmap v1904: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:11.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:11 smithi031 bash[22603]: cluster 2020-06-27T05:40:09.932471+0000 mgr.x (mgr.34109) 1824 : cluster [DBG] pgmap v1904: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:13.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:13 smithi051 bash[18409]: cluster 2020-06-27T05:40:11.934135+0000 mgr.x (mgr.34109) 1825 : cluster [DBG] pgmap v1905: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:13.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:13 smithi031 bash[18426]: cluster 2020-06-27T05:40:11.934135+0000 mgr.x (mgr.34109) 1825 : cluster [DBG] pgmap v1905: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:13.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:13 smithi031 bash[22603]: cluster 2020-06-27T05:40:11.934135+0000 mgr.x (mgr.34109) 1825 : cluster [DBG] pgmap v1905: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:15.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:15 smithi051 bash[18409]: cluster 2020-06-27T05:40:13.935867+0000 mgr.x (mgr.34109) 1826 : cluster [DBG] pgmap v1906: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:15.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:15 smithi031 bash[18426]: cluster 2020-06-27T05:40:13.935867+0000 mgr.x (mgr.34109) 1826 : cluster [DBG] pgmap v1906: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:15.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:15 smithi031 bash[22603]: cluster 2020-06-27T05:40:13.935867+0000 mgr.x (mgr.34109) 1826 : cluster [DBG] pgmap v1906: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:17 smithi051 bash[18409]: cluster 2020-06-27T05:40:15.937424+0000 mgr.x (mgr.34109) 1827 : cluster [DBG] pgmap v1907: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:17.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:17 smithi031 bash[18426]: cluster 2020-06-27T05:40:15.937424+0000 mgr.x (mgr.34109) 1827 : cluster [DBG] pgmap v1907: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:17.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:17 smithi031 bash[22603]: cluster 2020-06-27T05:40:15.937424+0000 mgr.x (mgr.34109) 1827 : cluster [DBG] pgmap v1907: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:19.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:19 smithi051 bash[18409]: cluster 2020-06-27T05:40:17.939083+0000 mgr.x (mgr.34109) 1828 : cluster [DBG] pgmap v1908: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:19.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:19 smithi031 bash[18426]: cluster 2020-06-27T05:40:17.939083+0000 mgr.x (mgr.34109) 1828 : cluster [DBG] pgmap v1908: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:19.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:19 smithi031 bash[22603]: cluster 2020-06-27T05:40:17.939083+0000 mgr.x (mgr.34109) 1828 : cluster [DBG] pgmap v1908: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:21.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:21 smithi051 bash[18409]: cluster 2020-06-27T05:40:19.940715+0000 mgr.x (mgr.34109) 1829 : cluster [DBG] pgmap v1909: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:21.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:21 smithi031 bash[18426]: cluster 2020-06-27T05:40:19.940715+0000 mgr.x (mgr.34109) 1829 : cluster [DBG] pgmap v1909: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:21.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:21 smithi031 bash[22603]: cluster 2020-06-27T05:40:19.940715+0000 mgr.x (mgr.34109) 1829 : cluster [DBG] pgmap v1909: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:23.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:23 smithi051 bash[18409]: cluster 2020-06-27T05:40:21.942392+0000 mgr.x (mgr.34109) 1830 : cluster [DBG] pgmap v1910: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:23.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:23 smithi031 bash[18426]: cluster 2020-06-27T05:40:21.942392+0000 mgr.x (mgr.34109) 1830 : cluster [DBG] pgmap v1910: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:23.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:23 smithi031 bash[22603]: cluster 2020-06-27T05:40:21.942392+0000 mgr.x (mgr.34109) 1830 : cluster [DBG] pgmap v1910: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:25.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:25 smithi051 bash[18409]: cluster 2020-06-27T05:40:23.943976+0000 mgr.x (mgr.34109) 1831 : cluster [DBG] pgmap v1911: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:25.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:25 smithi031 bash[18426]: cluster 2020-06-27T05:40:23.943976+0000 mgr.x (mgr.34109) 1831 : cluster [DBG] pgmap v1911: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:25.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:25 smithi031 bash[22603]: cluster 2020-06-27T05:40:23.943976+0000 mgr.x (mgr.34109) 1831 : cluster [DBG] pgmap v1911: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:27.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:27 smithi051 bash[18409]: cluster 2020-06-27T05:40:25.945672+0000 mgr.x (mgr.34109) 1832 : cluster [DBG] pgmap v1912: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:27.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:27 smithi031 bash[18426]: cluster 2020-06-27T05:40:25.945672+0000 mgr.x (mgr.34109) 1832 : cluster [DBG] pgmap v1912: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:27.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:27 smithi031 bash[22603]: cluster 2020-06-27T05:40:25.945672+0000 mgr.x (mgr.34109) 1832 : cluster [DBG] pgmap v1912: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:29.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:29 smithi051 bash[18409]: cluster 2020-06-27T05:40:27.947276+0000 mgr.x (mgr.34109) 1833 : cluster [DBG] pgmap v1913: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:29.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:29 smithi031 bash[18426]: cluster 2020-06-27T05:40:27.947276+0000 mgr.x (mgr.34109) 1833 : cluster [DBG] pgmap v1913: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:29.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:29 smithi031 bash[22603]: cluster 2020-06-27T05:40:27.947276+0000 mgr.x (mgr.34109) 1833 : cluster [DBG] pgmap v1913: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:31.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:31 smithi051 bash[18409]: cluster 2020-06-27T05:40:29.948920+0000 mgr.x (mgr.34109) 1834 : cluster [DBG] pgmap v1914: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:31.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:31 smithi031 bash[18426]: cluster 2020-06-27T05:40:29.948920+0000 mgr.x (mgr.34109) 1834 : cluster [DBG] pgmap v1914: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:31.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:31 smithi031 bash[22603]: cluster 2020-06-27T05:40:29.948920+0000 mgr.x (mgr.34109) 1834 : cluster [DBG] pgmap v1914: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:33 smithi051 bash[18409]: cluster 2020-06-27T05:40:31.950593+0000 mgr.x (mgr.34109) 1835 : cluster [DBG] pgmap v1915: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:33.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:33 smithi031 bash[18426]: cluster 2020-06-27T05:40:31.950593+0000 mgr.x (mgr.34109) 1835 : cluster [DBG] pgmap v1915: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:33.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:33 smithi031 bash[22603]: cluster 2020-06-27T05:40:31.950593+0000 mgr.x (mgr.34109) 1835 : cluster [DBG] pgmap v1915: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:35.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:35 smithi051 bash[18409]: cluster 2020-06-27T05:40:33.952336+0000 mgr.x (mgr.34109) 1836 : cluster [DBG] pgmap v1916: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:35.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:35 smithi031 bash[18426]: cluster 2020-06-27T05:40:33.952336+0000 mgr.x (mgr.34109) 1836 : cluster [DBG] pgmap v1916: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:35.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:35 smithi031 bash[22603]: cluster 2020-06-27T05:40:33.952336+0000 mgr.x (mgr.34109) 1836 : cluster [DBG] pgmap v1916: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:37.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:37 smithi051 bash[18409]: cluster 2020-06-27T05:40:35.954026+0000 mgr.x (mgr.34109) 1837 : cluster [DBG] pgmap v1917: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:37.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:37 smithi031 bash[18426]: cluster 2020-06-27T05:40:35.954026+0000 mgr.x (mgr.34109) 1837 : cluster [DBG] pgmap v1917: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:37.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:37 smithi031 bash[22603]: cluster 2020-06-27T05:40:35.954026+0000 mgr.x (mgr.34109) 1837 : cluster [DBG] pgmap v1917: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:39.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:39 smithi051 bash[18409]: cluster 2020-06-27T05:40:37.955656+0000 mgr.x (mgr.34109) 1838 : cluster [DBG] pgmap v1918: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:39.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:39 smithi031 bash[22603]: cluster 2020-06-27T05:40:37.955656+0000 mgr.x (mgr.34109) 1838 : cluster [DBG] pgmap v1918: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:39 smithi031 bash[18426]: cluster 2020-06-27T05:40:37.955656+0000 mgr.x (mgr.34109) 1838 : cluster [DBG] pgmap v1918: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:41 smithi051 bash[18409]: cluster 2020-06-27T05:40:39.957402+0000 mgr.x (mgr.34109) 1839 : cluster [DBG] pgmap v1919: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:41 smithi031 bash[18426]: cluster 2020-06-27T05:40:39.957402+0000 mgr.x (mgr.34109) 1839 : cluster [DBG] pgmap v1919: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:41.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:41 smithi031 bash[22603]: cluster 2020-06-27T05:40:39.957402+0000 mgr.x (mgr.34109) 1839 : cluster [DBG] pgmap v1919: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:43 smithi051 bash[18409]: cluster 2020-06-27T05:40:41.958922+0000 mgr.x (mgr.34109) 1840 : cluster [DBG] pgmap v1920: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:43.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:43 smithi031 bash[18426]: cluster 2020-06-27T05:40:41.958922+0000 mgr.x (mgr.34109) 1840 : cluster [DBG] pgmap v1920: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:43 smithi031 bash[22603]: cluster 2020-06-27T05:40:41.958922+0000 mgr.x (mgr.34109) 1840 : cluster [DBG] pgmap v1920: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:45.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:45 smithi051 bash[18409]: cluster 2020-06-27T05:40:43.960594+0000 mgr.x (mgr.34109) 1841 : cluster [DBG] pgmap v1921: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:45.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:45 smithi031 bash[18426]: cluster 2020-06-27T05:40:43.960594+0000 mgr.x (mgr.34109) 1841 : cluster [DBG] pgmap v1921: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:45.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:45 smithi031 bash[22603]: cluster 2020-06-27T05:40:43.960594+0000 mgr.x (mgr.34109) 1841 : cluster [DBG] pgmap v1921: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:47.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:47 smithi051 bash[18409]: cluster 2020-06-27T05:40:45.962318+0000 mgr.x (mgr.34109) 1842 : cluster [DBG] pgmap v1922: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:47.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:47 smithi031 bash[18426]: cluster 2020-06-27T05:40:45.962318+0000 mgr.x (mgr.34109) 1842 : cluster [DBG] pgmap v1922: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:47.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:47 smithi031 bash[22603]: cluster 2020-06-27T05:40:45.962318+0000 mgr.x (mgr.34109) 1842 : cluster [DBG] pgmap v1922: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:49.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:49 smithi051 bash[18409]: cluster 2020-06-27T05:40:47.963921+0000 mgr.x (mgr.34109) 1843 : cluster [DBG] pgmap v1923: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:49.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:49 smithi031 bash[18426]: cluster 2020-06-27T05:40:47.963921+0000 mgr.x (mgr.34109) 1843 : cluster [DBG] pgmap v1923: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:49.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:49 smithi031 bash[22603]: cluster 2020-06-27T05:40:47.963921+0000 mgr.x (mgr.34109) 1843 : cluster [DBG] pgmap v1923: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:51.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:51 smithi051 bash[18409]: cluster 2020-06-27T05:40:49.965492+0000 mgr.x (mgr.34109) 1844 : cluster [DBG] pgmap v1924: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:51.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:51 smithi031 bash[18426]: cluster 2020-06-27T05:40:49.965492+0000 mgr.x (mgr.34109) 1844 : cluster [DBG] pgmap v1924: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:51.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:51 smithi031 bash[22603]: cluster 2020-06-27T05:40:49.965492+0000 mgr.x (mgr.34109) 1844 : cluster [DBG] pgmap v1924: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:53.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:53 smithi051 bash[18409]: cluster 2020-06-27T05:40:51.967242+0000 mgr.x (mgr.34109) 1845 : cluster [DBG] pgmap v1925: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:53.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:53 smithi031 bash[18426]: cluster 2020-06-27T05:40:51.967242+0000 mgr.x (mgr.34109) 1845 : cluster [DBG] pgmap v1925: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:53.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:53 smithi031 bash[22603]: cluster 2020-06-27T05:40:51.967242+0000 mgr.x (mgr.34109) 1845 : cluster [DBG] pgmap v1925: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:55.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:55 smithi051 bash[18409]: cluster 2020-06-27T05:40:53.968936+0000 mgr.x (mgr.34109) 1846 : cluster [DBG] pgmap v1926: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:55.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:55 smithi031 bash[18426]: cluster 2020-06-27T05:40:53.968936+0000 mgr.x (mgr.34109) 1846 : cluster [DBG] pgmap v1926: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:55.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:55 smithi031 bash[22603]: cluster 2020-06-27T05:40:53.968936+0000 mgr.x (mgr.34109) 1846 : cluster [DBG] pgmap v1926: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:57.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:57 smithi051 bash[18409]: cluster 2020-06-27T05:40:55.970741+0000 mgr.x (mgr.34109) 1847 : cluster [DBG] pgmap v1927: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:57.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:57 smithi031 bash[18426]: cluster 2020-06-27T05:40:55.970741+0000 mgr.x (mgr.34109) 1847 : cluster [DBG] pgmap v1927: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:57.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:57 smithi031 bash[22603]: cluster 2020-06-27T05:40:55.970741+0000 mgr.x (mgr.34109) 1847 : cluster [DBG] pgmap v1927: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:59.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:40:59 smithi051 bash[18409]: cluster 2020-06-27T05:40:57.972367+0000 mgr.x (mgr.34109) 1848 : cluster [DBG] pgmap v1928: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:59.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:40:59 smithi031 bash[18426]: cluster 2020-06-27T05:40:57.972367+0000 mgr.x (mgr.34109) 1848 : cluster [DBG] pgmap v1928: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:40:59.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:40:59 smithi031 bash[22603]: cluster 2020-06-27T05:40:57.972367+0000 mgr.x (mgr.34109) 1848 : cluster [DBG] pgmap v1928: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:01.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:01 smithi051 bash[18409]: cluster 2020-06-27T05:40:59.974008+0000 mgr.x (mgr.34109) 1849 : cluster [DBG] pgmap v1929: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:01.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:01 smithi031 bash[18426]: cluster 2020-06-27T05:40:59.974008+0000 mgr.x (mgr.34109) 1849 : cluster [DBG] pgmap v1929: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:01.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:01 smithi031 bash[22603]: cluster 2020-06-27T05:40:59.974008+0000 mgr.x (mgr.34109) 1849 : cluster [DBG] pgmap v1929: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:03.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:03 smithi051 bash[18409]: cluster 2020-06-27T05:41:01.975670+0000 mgr.x (mgr.34109) 1850 : cluster [DBG] pgmap v1930: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:03.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:03 smithi031 bash[18426]: cluster 2020-06-27T05:41:01.975670+0000 mgr.x (mgr.34109) 1850 : cluster [DBG] pgmap v1930: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:03.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:03 smithi031 bash[22603]: cluster 2020-06-27T05:41:01.975670+0000 mgr.x (mgr.34109) 1850 : cluster [DBG] pgmap v1930: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:05.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:05 smithi051 bash[18409]: cluster 2020-06-27T05:41:03.977394+0000 mgr.x (mgr.34109) 1851 : cluster [DBG] pgmap v1931: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:05 smithi031 bash[18426]: cluster 2020-06-27T05:41:03.977394+0000 mgr.x (mgr.34109) 1851 : cluster [DBG] pgmap v1931: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:05.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:05 smithi031 bash[22603]: cluster 2020-06-27T05:41:03.977394+0000 mgr.x (mgr.34109) 1851 : cluster [DBG] pgmap v1931: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:06.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:06 smithi051 bash[18409]: cluster 2020-06-27T05:41:05.979100+0000 mgr.x (mgr.34109) 1852 : cluster [DBG] pgmap v1932: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:06.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:06 smithi031 bash[18426]: cluster 2020-06-27T05:41:05.979100+0000 mgr.x (mgr.34109) 1852 : cluster [DBG] pgmap v1932: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:06.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:06 smithi031 bash[22603]: cluster 2020-06-27T05:41:05.979100+0000 mgr.x (mgr.34109) 1852 : cluster [DBG] pgmap v1932: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:09.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:09 smithi051 bash[18409]: cluster 2020-06-27T05:41:07.980652+0000 mgr.x (mgr.34109) 1853 : cluster [DBG] pgmap v1933: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:09.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:09 smithi031 bash[18426]: cluster 2020-06-27T05:41:07.980652+0000 mgr.x (mgr.34109) 1853 : cluster [DBG] pgmap v1933: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:09.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:09 smithi031 bash[22603]: cluster 2020-06-27T05:41:07.980652+0000 mgr.x (mgr.34109) 1853 : cluster [DBG] pgmap v1933: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:11.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:11 smithi051 bash[18409]: cluster 2020-06-27T05:41:09.982302+0000 mgr.x (mgr.34109) 1854 : cluster [DBG] pgmap v1934: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:11.476 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:11 smithi031 bash[18426]: cluster 2020-06-27T05:41:09.982302+0000 mgr.x (mgr.34109) 1854 : cluster [DBG] pgmap v1934: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:11.477 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:11 smithi031 bash[22603]: cluster 2020-06-27T05:41:09.982302+0000 mgr.x (mgr.34109) 1854 : cluster [DBG] pgmap v1934: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:13.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:13 smithi051 bash[18409]: cluster 2020-06-27T05:41:11.984054+0000 mgr.x (mgr.34109) 1855 : cluster [DBG] pgmap v1935: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:13.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:13 smithi031 bash[18426]: cluster 2020-06-27T05:41:11.984054+0000 mgr.x (mgr.34109) 1855 : cluster [DBG] pgmap v1935: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:13.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:13 smithi031 bash[22603]: cluster 2020-06-27T05:41:11.984054+0000 mgr.x (mgr.34109) 1855 : cluster [DBG] pgmap v1935: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:15.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:15 smithi051 bash[18409]: cluster 2020-06-27T05:41:13.985719+0000 mgr.x (mgr.34109) 1856 : cluster [DBG] pgmap v1936: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:15.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:15 smithi031 bash[18426]: cluster 2020-06-27T05:41:13.985719+0000 mgr.x (mgr.34109) 1856 : cluster [DBG] pgmap v1936: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:15.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:15 smithi031 bash[22603]: cluster 2020-06-27T05:41:13.985719+0000 mgr.x (mgr.34109) 1856 : cluster [DBG] pgmap v1936: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:17.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:17 smithi051 bash[18409]: cluster 2020-06-27T05:41:15.987403+0000 mgr.x (mgr.34109) 1857 : cluster [DBG] pgmap v1937: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:17.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:17 smithi031 bash[18426]: cluster 2020-06-27T05:41:15.987403+0000 mgr.x (mgr.34109) 1857 : cluster [DBG] pgmap v1937: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:17.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:17 smithi031 bash[22603]: cluster 2020-06-27T05:41:15.987403+0000 mgr.x (mgr.34109) 1857 : cluster [DBG] pgmap v1937: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:19.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:19 smithi051 bash[18409]: cluster 2020-06-27T05:41:17.988994+0000 mgr.x (mgr.34109) 1858 : cluster [DBG] pgmap v1938: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:19.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:19 smithi031 bash[18426]: cluster 2020-06-27T05:41:17.988994+0000 mgr.x (mgr.34109) 1858 : cluster [DBG] pgmap v1938: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:19.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:19 smithi031 bash[22603]: cluster 2020-06-27T05:41:17.988994+0000 mgr.x (mgr.34109) 1858 : cluster [DBG] pgmap v1938: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:21.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:21 smithi051 bash[18409]: cluster 2020-06-27T05:41:19.990592+0000 mgr.x (mgr.34109) 1859 : cluster [DBG] pgmap v1939: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:21.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:21 smithi031 bash[18426]: cluster 2020-06-27T05:41:19.990592+0000 mgr.x (mgr.34109) 1859 : cluster [DBG] pgmap v1939: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:21.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:21 smithi031 bash[22603]: cluster 2020-06-27T05:41:19.990592+0000 mgr.x (mgr.34109) 1859 : cluster [DBG] pgmap v1939: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:23.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:23 smithi051 bash[18409]: cluster 2020-06-27T05:41:21.992259+0000 mgr.x (mgr.34109) 1860 : cluster [DBG] pgmap v1940: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:23.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:23 smithi031 bash[18426]: cluster 2020-06-27T05:41:21.992259+0000 mgr.x (mgr.34109) 1860 : cluster [DBG] pgmap v1940: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:23.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:23 smithi031 bash[22603]: cluster 2020-06-27T05:41:21.992259+0000 mgr.x (mgr.34109) 1860 : cluster [DBG] pgmap v1940: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:25.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:25 smithi051 bash[18409]: cluster 2020-06-27T05:41:23.993938+0000 mgr.x (mgr.34109) 1861 : cluster [DBG] pgmap v1941: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:25.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:25 smithi031 bash[18426]: cluster 2020-06-27T05:41:23.993938+0000 mgr.x (mgr.34109) 1861 : cluster [DBG] pgmap v1941: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:25.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:25 smithi031 bash[22603]: cluster 2020-06-27T05:41:23.993938+0000 mgr.x (mgr.34109) 1861 : cluster [DBG] pgmap v1941: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:27.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:27 smithi051 bash[18409]: cluster 2020-06-27T05:41:25.995643+0000 mgr.x (mgr.34109) 1862 : cluster [DBG] pgmap v1942: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:27.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:27 smithi031 bash[18426]: cluster 2020-06-27T05:41:25.995643+0000 mgr.x (mgr.34109) 1862 : cluster [DBG] pgmap v1942: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:27.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:27 smithi031 bash[22603]: cluster 2020-06-27T05:41:25.995643+0000 mgr.x (mgr.34109) 1862 : cluster [DBG] pgmap v1942: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:29.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:29 smithi051 bash[18409]: cluster 2020-06-27T05:41:27.997327+0000 mgr.x (mgr.34109) 1863 : cluster [DBG] pgmap v1943: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:29.474 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:29 smithi031 bash[18426]: cluster 2020-06-27T05:41:27.997327+0000 mgr.x (mgr.34109) 1863 : cluster [DBG] pgmap v1943: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:29.475 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:29 smithi031 bash[22603]: cluster 2020-06-27T05:41:27.997327+0000 mgr.x (mgr.34109) 1863 : cluster [DBG] pgmap v1943: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:31.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:31 smithi051 bash[18409]: cluster 2020-06-27T05:41:29.999020+0000 mgr.x (mgr.34109) 1864 : cluster [DBG] pgmap v1944: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:31.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:31 smithi031 bash[18426]: cluster 2020-06-27T05:41:29.999020+0000 mgr.x (mgr.34109) 1864 : cluster [DBG] pgmap v1944: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:31.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:31 smithi031 bash[22603]: cluster 2020-06-27T05:41:29.999020+0000 mgr.x (mgr.34109) 1864 : cluster [DBG] pgmap v1944: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:33.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:33 smithi031 bash[18426]: cluster 2020-06-27T05:41:32.000719+0000 mgr.x (mgr.34109) 1865 : cluster [DBG] pgmap v1945: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:33.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:33 smithi031 bash[22603]: cluster 2020-06-27T05:41:32.000719+0000 mgr.x (mgr.34109) 1865 : cluster [DBG] pgmap v1945: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:33 smithi051 bash[18409]: cluster 2020-06-27T05:41:32.000719+0000 mgr.x (mgr.34109) 1865 : cluster [DBG] pgmap v1945: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:35.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:35 smithi051 bash[18409]: cluster 2020-06-27T05:41:34.002502+0000 mgr.x (mgr.34109) 1866 : cluster [DBG] pgmap v1946: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:35.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:35 smithi031 bash[18426]: cluster 2020-06-27T05:41:34.002502+0000 mgr.x (mgr.34109) 1866 : cluster [DBG] pgmap v1946: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:35.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:35 smithi031 bash[22603]: cluster 2020-06-27T05:41:34.002502+0000 mgr.x (mgr.34109) 1866 : cluster [DBG] pgmap v1946: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:37.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:37 smithi051 bash[18409]: cluster 2020-06-27T05:41:36.004082+0000 mgr.x (mgr.34109) 1867 : cluster [DBG] pgmap v1947: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:37.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:37 smithi031 bash[22603]: cluster 2020-06-27T05:41:36.004082+0000 mgr.x (mgr.34109) 1867 : cluster [DBG] pgmap v1947: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:37.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:37 smithi031 bash[18426]: cluster 2020-06-27T05:41:36.004082+0000 mgr.x (mgr.34109) 1867 : cluster [DBG] pgmap v1947: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:39.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:39 smithi051 bash[18409]: cluster 2020-06-27T05:41:38.005719+0000 mgr.x (mgr.34109) 1868 : cluster [DBG] pgmap v1948: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:39 smithi031 bash[18426]: cluster 2020-06-27T05:41:38.005719+0000 mgr.x (mgr.34109) 1868 : cluster [DBG] pgmap v1948: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:39.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:39 smithi031 bash[22603]: cluster 2020-06-27T05:41:38.005719+0000 mgr.x (mgr.34109) 1868 : cluster [DBG] pgmap v1948: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:41 smithi051 bash[18409]: cluster 2020-06-27T05:41:40.007436+0000 mgr.x (mgr.34109) 1869 : cluster [DBG] pgmap v1949: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:41 smithi031 bash[18426]: cluster 2020-06-27T05:41:40.007436+0000 mgr.x (mgr.34109) 1869 : cluster [DBG] pgmap v1949: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:41.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:41 smithi031 bash[22603]: cluster 2020-06-27T05:41:40.007436+0000 mgr.x (mgr.34109) 1869 : cluster [DBG] pgmap v1949: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:43 smithi051 bash[18409]: cluster 2020-06-27T05:41:42.009026+0000 mgr.x (mgr.34109) 1870 : cluster [DBG] pgmap v1950: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:43.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:43 smithi031 bash[18426]: cluster 2020-06-27T05:41:42.009026+0000 mgr.x (mgr.34109) 1870 : cluster [DBG] pgmap v1950: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:43 smithi031 bash[22603]: cluster 2020-06-27T05:41:42.009026+0000 mgr.x (mgr.34109) 1870 : cluster [DBG] pgmap v1950: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:45.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:45 smithi051 bash[18409]: cluster 2020-06-27T05:41:44.010685+0000 mgr.x (mgr.34109) 1871 : cluster [DBG] pgmap v1951: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:45.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:45 smithi031 bash[18426]: cluster 2020-06-27T05:41:44.010685+0000 mgr.x (mgr.34109) 1871 : cluster [DBG] pgmap v1951: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:45.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:45 smithi031 bash[22603]: cluster 2020-06-27T05:41:44.010685+0000 mgr.x (mgr.34109) 1871 : cluster [DBG] pgmap v1951: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:47.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:47 smithi051 bash[18409]: cluster 2020-06-27T05:41:46.012362+0000 mgr.x (mgr.34109) 1872 : cluster [DBG] pgmap v1952: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:47.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:47 smithi031 bash[18426]: cluster 2020-06-27T05:41:46.012362+0000 mgr.x (mgr.34109) 1872 : cluster [DBG] pgmap v1952: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:47.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:47 smithi031 bash[22603]: cluster 2020-06-27T05:41:46.012362+0000 mgr.x (mgr.34109) 1872 : cluster [DBG] pgmap v1952: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:49.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:49 smithi051 bash[18409]: cluster 2020-06-27T05:41:48.014138+0000 mgr.x (mgr.34109) 1873 : cluster [DBG] pgmap v1953: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:49.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:49 smithi031 bash[18426]: cluster 2020-06-27T05:41:48.014138+0000 mgr.x (mgr.34109) 1873 : cluster [DBG] pgmap v1953: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:49.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:49 smithi031 bash[22603]: cluster 2020-06-27T05:41:48.014138+0000 mgr.x (mgr.34109) 1873 : cluster [DBG] pgmap v1953: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:51.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:51 smithi051 bash[18409]: cluster 2020-06-27T05:41:50.015793+0000 mgr.x (mgr.34109) 1874 : cluster [DBG] pgmap v1954: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:51.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:51 smithi031 bash[22603]: cluster 2020-06-27T05:41:50.015793+0000 mgr.x (mgr.34109) 1874 : cluster [DBG] pgmap v1954: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:51.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:51 smithi031 bash[18426]: cluster 2020-06-27T05:41:50.015793+0000 mgr.x (mgr.34109) 1874 : cluster [DBG] pgmap v1954: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:53.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:53 smithi051 bash[18409]: cluster 2020-06-27T05:41:52.017375+0000 mgr.x (mgr.34109) 1875 : cluster [DBG] pgmap v1955: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:53.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:53 smithi031 bash[22603]: cluster 2020-06-27T05:41:52.017375+0000 mgr.x (mgr.34109) 1875 : cluster [DBG] pgmap v1955: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:53.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:53 smithi031 bash[18426]: cluster 2020-06-27T05:41:52.017375+0000 mgr.x (mgr.34109) 1875 : cluster [DBG] pgmap v1955: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:55.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:55 smithi051 bash[18409]: cluster 2020-06-27T05:41:54.019057+0000 mgr.x (mgr.34109) 1876 : cluster [DBG] pgmap v1956: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:55.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:55 smithi031 bash[18426]: cluster 2020-06-27T05:41:54.019057+0000 mgr.x (mgr.34109) 1876 : cluster [DBG] pgmap v1956: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:55.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:55 smithi031 bash[22603]: cluster 2020-06-27T05:41:54.019057+0000 mgr.x (mgr.34109) 1876 : cluster [DBG] pgmap v1956: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:57.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:57 smithi051 bash[18409]: cluster 2020-06-27T05:41:56.020738+0000 mgr.x (mgr.34109) 1877 : cluster [DBG] pgmap v1957: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:57.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:57 smithi031 bash[18426]: cluster 2020-06-27T05:41:56.020738+0000 mgr.x (mgr.34109) 1877 : cluster [DBG] pgmap v1957: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:57.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:57 smithi031 bash[22603]: cluster 2020-06-27T05:41:56.020738+0000 mgr.x (mgr.34109) 1877 : cluster [DBG] pgmap v1957: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:59.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:41:59 smithi051 bash[18409]: cluster 2020-06-27T05:41:58.022387+0000 mgr.x (mgr.34109) 1878 : cluster [DBG] pgmap v1958: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:59.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:41:59 smithi031 bash[18426]: cluster 2020-06-27T05:41:58.022387+0000 mgr.x (mgr.34109) 1878 : cluster [DBG] pgmap v1958: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:41:59.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:41:59 smithi031 bash[22603]: cluster 2020-06-27T05:41:58.022387+0000 mgr.x (mgr.34109) 1878 : cluster [DBG] pgmap v1958: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:01.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:01 smithi051 bash[18409]: cluster 2020-06-27T05:42:00.024007+0000 mgr.x (mgr.34109) 1879 : cluster [DBG] pgmap v1959: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:01.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:01 smithi031 bash[18426]: cluster 2020-06-27T05:42:00.024007+0000 mgr.x (mgr.34109) 1879 : cluster [DBG] pgmap v1959: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:01.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:01 smithi031 bash[22603]: cluster 2020-06-27T05:42:00.024007+0000 mgr.x (mgr.34109) 1879 : cluster [DBG] pgmap v1959: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:03.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:03 smithi051 bash[18409]: cluster 2020-06-27T05:42:02.025687+0000 mgr.x (mgr.34109) 1880 : cluster [DBG] pgmap v1960: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:03.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:03 smithi031 bash[18426]: cluster 2020-06-27T05:42:02.025687+0000 mgr.x (mgr.34109) 1880 : cluster [DBG] pgmap v1960: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:03.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:03 smithi031 bash[22603]: cluster 2020-06-27T05:42:02.025687+0000 mgr.x (mgr.34109) 1880 : cluster [DBG] pgmap v1960: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:05.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:05 smithi051 bash[18409]: cluster 2020-06-27T05:42:04.027329+0000 mgr.x (mgr.34109) 1881 : cluster [DBG] pgmap v1961: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:05.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:05 smithi031 bash[22603]: cluster 2020-06-27T05:42:04.027329+0000 mgr.x (mgr.34109) 1881 : cluster [DBG] pgmap v1961: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:05 smithi031 bash[18426]: cluster 2020-06-27T05:42:04.027329+0000 mgr.x (mgr.34109) 1881 : cluster [DBG] pgmap v1961: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:07.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:07 smithi051 bash[18409]: cluster 2020-06-27T05:42:06.028940+0000 mgr.x (mgr.34109) 1882 : cluster [DBG] pgmap v1962: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:07.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:07 smithi031 bash[18426]: cluster 2020-06-27T05:42:06.028940+0000 mgr.x (mgr.34109) 1882 : cluster [DBG] pgmap v1962: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:07.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:07 smithi031 bash[22603]: cluster 2020-06-27T05:42:06.028940+0000 mgr.x (mgr.34109) 1882 : cluster [DBG] pgmap v1962: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:09 smithi051 bash[18409]: cluster 2020-06-27T05:42:08.030553+0000 mgr.x (mgr.34109) 1883 : cluster [DBG] pgmap v1963: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:09.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:09 smithi031 bash[18426]: cluster 2020-06-27T05:42:08.030553+0000 mgr.x (mgr.34109) 1883 : cluster [DBG] pgmap v1963: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:09.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:09 smithi031 bash[22603]: cluster 2020-06-27T05:42:08.030553+0000 mgr.x (mgr.34109) 1883 : cluster [DBG] pgmap v1963: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:11.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:11 smithi051 bash[18409]: cluster 2020-06-27T05:42:10.032283+0000 mgr.x (mgr.34109) 1884 : cluster [DBG] pgmap v1964: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:11.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:11 smithi031 bash[18426]: cluster 2020-06-27T05:42:10.032283+0000 mgr.x (mgr.34109) 1884 : cluster [DBG] pgmap v1964: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:11.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:11 smithi031 bash[22603]: cluster 2020-06-27T05:42:10.032283+0000 mgr.x (mgr.34109) 1884 : cluster [DBG] pgmap v1964: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:13.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:13 smithi051 bash[18409]: cluster 2020-06-27T05:42:12.034016+0000 mgr.x (mgr.34109) 1885 : cluster [DBG] pgmap v1965: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:13.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:13 smithi031 bash[18426]: cluster 2020-06-27T05:42:12.034016+0000 mgr.x (mgr.34109) 1885 : cluster [DBG] pgmap v1965: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:13.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:13 smithi031 bash[22603]: cluster 2020-06-27T05:42:12.034016+0000 mgr.x (mgr.34109) 1885 : cluster [DBG] pgmap v1965: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:15.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:15 smithi051 bash[18409]: cluster 2020-06-27T05:42:14.035747+0000 mgr.x (mgr.34109) 1886 : cluster [DBG] pgmap v1966: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:15.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:15 smithi031 bash[18426]: cluster 2020-06-27T05:42:14.035747+0000 mgr.x (mgr.34109) 1886 : cluster [DBG] pgmap v1966: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:15.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:15 smithi031 bash[22603]: cluster 2020-06-27T05:42:14.035747+0000 mgr.x (mgr.34109) 1886 : cluster [DBG] pgmap v1966: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:17 smithi051 bash[18409]: cluster 2020-06-27T05:42:16.037390+0000 mgr.x (mgr.34109) 1887 : cluster [DBG] pgmap v1967: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:17.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:17 smithi031 bash[18426]: cluster 2020-06-27T05:42:16.037390+0000 mgr.x (mgr.34109) 1887 : cluster [DBG] pgmap v1967: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:17.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:17 smithi031 bash[22603]: cluster 2020-06-27T05:42:16.037390+0000 mgr.x (mgr.34109) 1887 : cluster [DBG] pgmap v1967: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:19.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:19 smithi051 bash[18409]: cluster 2020-06-27T05:42:18.039028+0000 mgr.x (mgr.34109) 1888 : cluster [DBG] pgmap v1968: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:19.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:19 smithi031 bash[18426]: cluster 2020-06-27T05:42:18.039028+0000 mgr.x (mgr.34109) 1888 : cluster [DBG] pgmap v1968: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:19.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:19 smithi031 bash[22603]: cluster 2020-06-27T05:42:18.039028+0000 mgr.x (mgr.34109) 1888 : cluster [DBG] pgmap v1968: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:21.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:21 smithi051 bash[18409]: cluster 2020-06-27T05:42:20.040788+0000 mgr.x (mgr.34109) 1889 : cluster [DBG] pgmap v1969: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:21.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:21 smithi031 bash[22603]: cluster 2020-06-27T05:42:20.040788+0000 mgr.x (mgr.34109) 1889 : cluster [DBG] pgmap v1969: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:21.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:21 smithi031 bash[18426]: cluster 2020-06-27T05:42:20.040788+0000 mgr.x (mgr.34109) 1889 : cluster [DBG] pgmap v1969: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:23.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:23 smithi051 bash[18409]: cluster 2020-06-27T05:42:22.042396+0000 mgr.x (mgr.34109) 1890 : cluster [DBG] pgmap v1970: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:23.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:23 smithi031 bash[22603]: cluster 2020-06-27T05:42:22.042396+0000 mgr.x (mgr.34109) 1890 : cluster [DBG] pgmap v1970: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:23.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:23 smithi031 bash[18426]: cluster 2020-06-27T05:42:22.042396+0000 mgr.x (mgr.34109) 1890 : cluster [DBG] pgmap v1970: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:25.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:25 smithi051 bash[18409]: cluster 2020-06-27T05:42:24.044138+0000 mgr.x (mgr.34109) 1891 : cluster [DBG] pgmap v1971: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:25.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:25 smithi031 bash[22603]: cluster 2020-06-27T05:42:24.044138+0000 mgr.x (mgr.34109) 1891 : cluster [DBG] pgmap v1971: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:25.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:25 smithi031 bash[18426]: cluster 2020-06-27T05:42:24.044138+0000 mgr.x (mgr.34109) 1891 : cluster [DBG] pgmap v1971: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:27.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:27 smithi051 bash[18409]: cluster 2020-06-27T05:42:26.045847+0000 mgr.x (mgr.34109) 1892 : cluster [DBG] pgmap v1972: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:27.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:27 smithi031 bash[18426]: cluster 2020-06-27T05:42:26.045847+0000 mgr.x (mgr.34109) 1892 : cluster [DBG] pgmap v1972: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:27.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:27 smithi031 bash[22603]: cluster 2020-06-27T05:42:26.045847+0000 mgr.x (mgr.34109) 1892 : cluster [DBG] pgmap v1972: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:29.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:29 smithi051 bash[18409]: cluster 2020-06-27T05:42:28.047538+0000 mgr.x (mgr.34109) 1893 : cluster [DBG] pgmap v1973: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:29.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:29 smithi031 bash[18426]: cluster 2020-06-27T05:42:28.047538+0000 mgr.x (mgr.34109) 1893 : cluster [DBG] pgmap v1973: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:29.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:29 smithi031 bash[22603]: cluster 2020-06-27T05:42:28.047538+0000 mgr.x (mgr.34109) 1893 : cluster [DBG] pgmap v1973: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:31.717 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:31 smithi051 bash[18409]: cluster 2020-06-27T05:42:30.049224+0000 mgr.x (mgr.34109) 1894 : cluster [DBG] pgmap v1974: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:31.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:31 smithi031 bash[18426]: cluster 2020-06-27T05:42:30.049224+0000 mgr.x (mgr.34109) 1894 : cluster [DBG] pgmap v1974: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:31.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:31 smithi031 bash[22603]: cluster 2020-06-27T05:42:30.049224+0000 mgr.x (mgr.34109) 1894 : cluster [DBG] pgmap v1974: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:33 smithi051 bash[18409]: cluster 2020-06-27T05:42:32.050835+0000 mgr.x (mgr.34109) 1895 : cluster [DBG] pgmap v1975: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:33.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:33 smithi031 bash[18426]: cluster 2020-06-27T05:42:32.050835+0000 mgr.x (mgr.34109) 1895 : cluster [DBG] pgmap v1975: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:33.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:33 smithi031 bash[22603]: cluster 2020-06-27T05:42:32.050835+0000 mgr.x (mgr.34109) 1895 : cluster [DBG] pgmap v1975: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:35.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:35 smithi051 bash[18409]: cluster 2020-06-27T05:42:34.052520+0000 mgr.x (mgr.34109) 1896 : cluster [DBG] pgmap v1976: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:35.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:35 smithi031 bash[18426]: cluster 2020-06-27T05:42:34.052520+0000 mgr.x (mgr.34109) 1896 : cluster [DBG] pgmap v1976: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:35.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:35 smithi031 bash[22603]: cluster 2020-06-27T05:42:34.052520+0000 mgr.x (mgr.34109) 1896 : cluster [DBG] pgmap v1976: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:37.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:37 smithi051 bash[18409]: cluster 2020-06-27T05:42:36.054110+0000 mgr.x (mgr.34109) 1897 : cluster [DBG] pgmap v1977: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:37.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:37 smithi031 bash[18426]: cluster 2020-06-27T05:42:36.054110+0000 mgr.x (mgr.34109) 1897 : cluster [DBG] pgmap v1977: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:37.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:37 smithi031 bash[22603]: cluster 2020-06-27T05:42:36.054110+0000 mgr.x (mgr.34109) 1897 : cluster [DBG] pgmap v1977: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:39.723 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:39 smithi051 bash[18409]: cluster 2020-06-27T05:42:38.055722+0000 mgr.x (mgr.34109) 1898 : cluster [DBG] pgmap v1978: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:39.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:39 smithi031 bash[18426]: cluster 2020-06-27T05:42:38.055722+0000 mgr.x (mgr.34109) 1898 : cluster [DBG] pgmap v1978: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:39.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:39 smithi031 bash[22603]: cluster 2020-06-27T05:42:38.055722+0000 mgr.x (mgr.34109) 1898 : cluster [DBG] pgmap v1978: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:41 smithi051 bash[18409]: cluster 2020-06-27T05:42:40.057321+0000 mgr.x (mgr.34109) 1899 : cluster [DBG] pgmap v1979: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:41 smithi031 bash[18426]: cluster 2020-06-27T05:42:40.057321+0000 mgr.x (mgr.34109) 1899 : cluster [DBG] pgmap v1979: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:41.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:41 smithi031 bash[22603]: cluster 2020-06-27T05:42:40.057321+0000 mgr.x (mgr.34109) 1899 : cluster [DBG] pgmap v1979: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:43 smithi051 bash[18409]: cluster 2020-06-27T05:42:42.059093+0000 mgr.x (mgr.34109) 1900 : cluster [DBG] pgmap v1980: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:43.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:43 smithi031 bash[18426]: cluster 2020-06-27T05:42:42.059093+0000 mgr.x (mgr.34109) 1900 : cluster [DBG] pgmap v1980: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:43 smithi031 bash[22603]: cluster 2020-06-27T05:42:42.059093+0000 mgr.x (mgr.34109) 1900 : cluster [DBG] pgmap v1980: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:45.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:45 smithi051 bash[18409]: cluster 2020-06-27T05:42:44.060748+0000 mgr.x (mgr.34109) 1901 : cluster [DBG] pgmap v1981: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:45.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:45 smithi031 bash[18426]: cluster 2020-06-27T05:42:44.060748+0000 mgr.x (mgr.34109) 1901 : cluster [DBG] pgmap v1981: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:45.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:45 smithi031 bash[22603]: cluster 2020-06-27T05:42:44.060748+0000 mgr.x (mgr.34109) 1901 : cluster [DBG] pgmap v1981: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:47.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:47 smithi051 bash[18409]: cluster 2020-06-27T05:42:46.062467+0000 mgr.x (mgr.34109) 1902 : cluster [DBG] pgmap v1982: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:47.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:47 smithi031 bash[18426]: cluster 2020-06-27T05:42:46.062467+0000 mgr.x (mgr.34109) 1902 : cluster [DBG] pgmap v1982: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:47.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:47 smithi031 bash[22603]: cluster 2020-06-27T05:42:46.062467+0000 mgr.x (mgr.34109) 1902 : cluster [DBG] pgmap v1982: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:49.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:49 smithi051 bash[18409]: cluster 2020-06-27T05:42:48.064177+0000 mgr.x (mgr.34109) 1903 : cluster [DBG] pgmap v1983: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:49.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:49 smithi031 bash[18426]: cluster 2020-06-27T05:42:48.064177+0000 mgr.x (mgr.34109) 1903 : cluster [DBG] pgmap v1983: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:49.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:49 smithi031 bash[22603]: cluster 2020-06-27T05:42:48.064177+0000 mgr.x (mgr.34109) 1903 : cluster [DBG] pgmap v1983: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:51.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:51 smithi031 bash[18426]: cluster 2020-06-27T05:42:50.065871+0000 mgr.x (mgr.34109) 1904 : cluster [DBG] pgmap v1984: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:51.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:51 smithi031 bash[22603]: cluster 2020-06-27T05:42:50.065871+0000 mgr.x (mgr.34109) 1904 : cluster [DBG] pgmap v1984: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:51.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:51 smithi051 bash[18409]: cluster 2020-06-27T05:42:50.065871+0000 mgr.x (mgr.34109) 1904 : cluster [DBG] pgmap v1984: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:52 smithi051 bash[18409]: cluster 2020-06-27T05:42:52.067506+0000 mgr.x (mgr.34109) 1905 : cluster [DBG] pgmap v1985: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:52 smithi031 bash[18426]: cluster 2020-06-27T05:42:52.067506+0000 mgr.x (mgr.34109) 1905 : cluster [DBG] pgmap v1985: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:52 smithi031 bash[22603]: cluster 2020-06-27T05:42:52.067506+0000 mgr.x (mgr.34109) 1905 : cluster [DBG] pgmap v1985: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:55.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:55 smithi051 bash[18409]: cluster 2020-06-27T05:42:54.069117+0000 mgr.x (mgr.34109) 1906 : cluster [DBG] pgmap v1986: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:55.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:55 smithi031 bash[18426]: cluster 2020-06-27T05:42:54.069117+0000 mgr.x (mgr.34109) 1906 : cluster [DBG] pgmap v1986: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:55.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:55 smithi031 bash[22603]: cluster 2020-06-27T05:42:54.069117+0000 mgr.x (mgr.34109) 1906 : cluster [DBG] pgmap v1986: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:57.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:57 smithi051 bash[18409]: cluster 2020-06-27T05:42:56.070842+0000 mgr.x (mgr.34109) 1907 : cluster [DBG] pgmap v1987: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:57.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:57 smithi031 bash[18426]: cluster 2020-06-27T05:42:56.070842+0000 mgr.x (mgr.34109) 1907 : cluster [DBG] pgmap v1987: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:57.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:57 smithi031 bash[22603]: cluster 2020-06-27T05:42:56.070842+0000 mgr.x (mgr.34109) 1907 : cluster [DBG] pgmap v1987: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:59.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:42:59 smithi051 bash[18409]: cluster 2020-06-27T05:42:58.072518+0000 mgr.x (mgr.34109) 1908 : cluster [DBG] pgmap v1988: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:59.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:42:59 smithi031 bash[18426]: cluster 2020-06-27T05:42:58.072518+0000 mgr.x (mgr.34109) 1908 : cluster [DBG] pgmap v1988: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:42:59.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:42:59 smithi031 bash[22603]: cluster 2020-06-27T05:42:58.072518+0000 mgr.x (mgr.34109) 1908 : cluster [DBG] pgmap v1988: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:01.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:01 smithi051 bash[18409]: cluster 2020-06-27T05:43:00.074142+0000 mgr.x (mgr.34109) 1909 : cluster [DBG] pgmap v1989: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:01.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:01 smithi031 bash[22603]: cluster 2020-06-27T05:43:00.074142+0000 mgr.x (mgr.34109) 1909 : cluster [DBG] pgmap v1989: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:01.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:01 smithi031 bash[18426]: cluster 2020-06-27T05:43:00.074142+0000 mgr.x (mgr.34109) 1909 : cluster [DBG] pgmap v1989: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:03.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:03 smithi051 bash[18409]: cluster 2020-06-27T05:43:02.075902+0000 mgr.x (mgr.34109) 1910 : cluster [DBG] pgmap v1990: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:03.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:03 smithi031 bash[18426]: cluster 2020-06-27T05:43:02.075902+0000 mgr.x (mgr.34109) 1910 : cluster [DBG] pgmap v1990: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:03.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:03 smithi031 bash[22603]: cluster 2020-06-27T05:43:02.075902+0000 mgr.x (mgr.34109) 1910 : cluster [DBG] pgmap v1990: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:05.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:05 smithi051 bash[18409]: cluster 2020-06-27T05:43:04.077617+0000 mgr.x (mgr.34109) 1911 : cluster [DBG] pgmap v1991: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:05.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:05 smithi031 bash[18426]: cluster 2020-06-27T05:43:04.077617+0000 mgr.x (mgr.34109) 1911 : cluster [DBG] pgmap v1991: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:05.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:05 smithi031 bash[22603]: cluster 2020-06-27T05:43:04.077617+0000 mgr.x (mgr.34109) 1911 : cluster [DBG] pgmap v1991: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:07.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:07 smithi051 bash[18409]: cluster 2020-06-27T05:43:06.079332+0000 mgr.x (mgr.34109) 1912 : cluster [DBG] pgmap v1992: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:07.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:07 smithi031 bash[18426]: cluster 2020-06-27T05:43:06.079332+0000 mgr.x (mgr.34109) 1912 : cluster [DBG] pgmap v1992: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:07.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:07 smithi031 bash[22603]: cluster 2020-06-27T05:43:06.079332+0000 mgr.x (mgr.34109) 1912 : cluster [DBG] pgmap v1992: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:09.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:09 smithi051 bash[18409]: cluster 2020-06-27T05:43:08.080936+0000 mgr.x (mgr.34109) 1913 : cluster [DBG] pgmap v1993: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:09.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:09 smithi031 bash[18426]: cluster 2020-06-27T05:43:08.080936+0000 mgr.x (mgr.34109) 1913 : cluster [DBG] pgmap v1993: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:09.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:09 smithi031 bash[22603]: cluster 2020-06-27T05:43:08.080936+0000 mgr.x (mgr.34109) 1913 : cluster [DBG] pgmap v1993: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:11.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:11 smithi051 bash[18409]: cluster 2020-06-27T05:43:10.082519+0000 mgr.x (mgr.34109) 1914 : cluster [DBG] pgmap v1994: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:11 smithi031 bash[18426]: cluster 2020-06-27T05:43:10.082519+0000 mgr.x (mgr.34109) 1914 : cluster [DBG] pgmap v1994: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:11.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:11 smithi031 bash[22603]: cluster 2020-06-27T05:43:10.082519+0000 mgr.x (mgr.34109) 1914 : cluster [DBG] pgmap v1994: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:13.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:13 smithi031 bash[18426]: cluster 2020-06-27T05:43:12.084165+0000 mgr.x (mgr.34109) 1915 : cluster [DBG] pgmap v1995: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:13.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:13 smithi031 bash[22603]: cluster 2020-06-27T05:43:12.084165+0000 mgr.x (mgr.34109) 1915 : cluster [DBG] pgmap v1995: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:13.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:13 smithi051 bash[18409]: cluster 2020-06-27T05:43:12.084165+0000 mgr.x (mgr.34109) 1915 : cluster [DBG] pgmap v1995: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:15.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:15 smithi051 bash[18409]: cluster 2020-06-27T05:43:14.085832+0000 mgr.x (mgr.34109) 1916 : cluster [DBG] pgmap v1996: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:15.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:15 smithi031 bash[18426]: cluster 2020-06-27T05:43:14.085832+0000 mgr.x (mgr.34109) 1916 : cluster [DBG] pgmap v1996: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:15.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:15 smithi031 bash[22603]: cluster 2020-06-27T05:43:14.085832+0000 mgr.x (mgr.34109) 1916 : cluster [DBG] pgmap v1996: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:17 smithi051 bash[18409]: cluster 2020-06-27T05:43:16.087404+0000 mgr.x (mgr.34109) 1917 : cluster [DBG] pgmap v1997: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:17.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:17 smithi031 bash[18426]: cluster 2020-06-27T05:43:16.087404+0000 mgr.x (mgr.34109) 1917 : cluster [DBG] pgmap v1997: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:17.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:17 smithi031 bash[22603]: cluster 2020-06-27T05:43:16.087404+0000 mgr.x (mgr.34109) 1917 : cluster [DBG] pgmap v1997: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:19.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:19 smithi051 bash[18409]: cluster 2020-06-27T05:43:18.089081+0000 mgr.x (mgr.34109) 1918 : cluster [DBG] pgmap v1998: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:19.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:19 smithi031 bash[22603]: cluster 2020-06-27T05:43:18.089081+0000 mgr.x (mgr.34109) 1918 : cluster [DBG] pgmap v1998: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:19.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:19 smithi031 bash[18426]: cluster 2020-06-27T05:43:18.089081+0000 mgr.x (mgr.34109) 1918 : cluster [DBG] pgmap v1998: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:21.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:21 smithi051 bash[18409]: cluster 2020-06-27T05:43:20.090822+0000 mgr.x (mgr.34109) 1919 : cluster [DBG] pgmap v1999: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:21.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:21 smithi031 bash[22603]: cluster 2020-06-27T05:43:20.090822+0000 mgr.x (mgr.34109) 1919 : cluster [DBG] pgmap v1999: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:21.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:21 smithi031 bash[18426]: cluster 2020-06-27T05:43:20.090822+0000 mgr.x (mgr.34109) 1919 : cluster [DBG] pgmap v1999: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:23.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:23 smithi051 bash[18409]: cluster 2020-06-27T05:43:22.092503+0000 mgr.x (mgr.34109) 1920 : cluster [DBG] pgmap v2000: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:23.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:23 smithi031 bash[18426]: cluster 2020-06-27T05:43:22.092503+0000 mgr.x (mgr.34109) 1920 : cluster [DBG] pgmap v2000: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:23.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:23 smithi031 bash[22603]: cluster 2020-06-27T05:43:22.092503+0000 mgr.x (mgr.34109) 1920 : cluster [DBG] pgmap v2000: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:25.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:25 smithi051 bash[18409]: cluster 2020-06-27T05:43:24.094078+0000 mgr.x (mgr.34109) 1921 : cluster [DBG] pgmap v2001: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:25.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:25 smithi031 bash[18426]: cluster 2020-06-27T05:43:24.094078+0000 mgr.x (mgr.34109) 1921 : cluster [DBG] pgmap v2001: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:25.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:25 smithi031 bash[22603]: cluster 2020-06-27T05:43:24.094078+0000 mgr.x (mgr.34109) 1921 : cluster [DBG] pgmap v2001: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:27.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:27 smithi051 bash[18409]: cluster 2020-06-27T05:43:26.095709+0000 mgr.x (mgr.34109) 1922 : cluster [DBG] pgmap v2002: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:27.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:27 smithi031 bash[22603]: cluster 2020-06-27T05:43:26.095709+0000 mgr.x (mgr.34109) 1922 : cluster [DBG] pgmap v2002: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:27.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:27 smithi031 bash[18426]: cluster 2020-06-27T05:43:26.095709+0000 mgr.x (mgr.34109) 1922 : cluster [DBG] pgmap v2002: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:29.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:29 smithi051 bash[18409]: cluster 2020-06-27T05:43:28.097337+0000 mgr.x (mgr.34109) 1923 : cluster [DBG] pgmap v2003: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:29.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:29 smithi031 bash[18426]: cluster 2020-06-27T05:43:28.097337+0000 mgr.x (mgr.34109) 1923 : cluster [DBG] pgmap v2003: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:29.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:29 smithi031 bash[22603]: cluster 2020-06-27T05:43:28.097337+0000 mgr.x (mgr.34109) 1923 : cluster [DBG] pgmap v2003: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:31.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:31 smithi051 bash[18409]: cluster 2020-06-27T05:43:30.098956+0000 mgr.x (mgr.34109) 1924 : cluster [DBG] pgmap v2004: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:31.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:31 smithi031 bash[18426]: cluster 2020-06-27T05:43:30.098956+0000 mgr.x (mgr.34109) 1924 : cluster [DBG] pgmap v2004: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:31.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:31 smithi031 bash[22603]: cluster 2020-06-27T05:43:30.098956+0000 mgr.x (mgr.34109) 1924 : cluster [DBG] pgmap v2004: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:33 smithi051 bash[18409]: cluster 2020-06-27T05:43:32.100768+0000 mgr.x (mgr.34109) 1925 : cluster [DBG] pgmap v2005: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:33.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:33 smithi031 bash[18426]: cluster 2020-06-27T05:43:32.100768+0000 mgr.x (mgr.34109) 1925 : cluster [DBG] pgmap v2005: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:33.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:33 smithi031 bash[22603]: cluster 2020-06-27T05:43:32.100768+0000 mgr.x (mgr.34109) 1925 : cluster [DBG] pgmap v2005: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:35.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:35 smithi051 bash[18409]: cluster 2020-06-27T05:43:34.102388+0000 mgr.x (mgr.34109) 1926 : cluster [DBG] pgmap v2006: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:35.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:35 smithi031 bash[18426]: cluster 2020-06-27T05:43:34.102388+0000 mgr.x (mgr.34109) 1926 : cluster [DBG] pgmap v2006: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:35.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:35 smithi031 bash[22603]: cluster 2020-06-27T05:43:34.102388+0000 mgr.x (mgr.34109) 1926 : cluster [DBG] pgmap v2006: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:37.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:37 smithi051 bash[18409]: cluster 2020-06-27T05:43:36.104028+0000 mgr.x (mgr.34109) 1927 : cluster [DBG] pgmap v2007: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:37.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:37 smithi031 bash[18426]: cluster 2020-06-27T05:43:36.104028+0000 mgr.x (mgr.34109) 1927 : cluster [DBG] pgmap v2007: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:37.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:37 smithi031 bash[22603]: cluster 2020-06-27T05:43:36.104028+0000 mgr.x (mgr.34109) 1927 : cluster [DBG] pgmap v2007: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:39.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:39 smithi051 bash[18409]: cluster 2020-06-27T05:43:38.105746+0000 mgr.x (mgr.34109) 1928 : cluster [DBG] pgmap v2008: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:39 smithi031 bash[18426]: cluster 2020-06-27T05:43:38.105746+0000 mgr.x (mgr.34109) 1928 : cluster [DBG] pgmap v2008: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:39.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:39 smithi031 bash[22603]: cluster 2020-06-27T05:43:38.105746+0000 mgr.x (mgr.34109) 1928 : cluster [DBG] pgmap v2008: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:41 smithi051 bash[18409]: cluster 2020-06-27T05:43:40.107450+0000 mgr.x (mgr.34109) 1929 : cluster [DBG] pgmap v2009: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:41 smithi031 bash[18426]: cluster 2020-06-27T05:43:40.107450+0000 mgr.x (mgr.34109) 1929 : cluster [DBG] pgmap v2009: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:41.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:41 smithi031 bash[22603]: cluster 2020-06-27T05:43:40.107450+0000 mgr.x (mgr.34109) 1929 : cluster [DBG] pgmap v2009: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:43 smithi051 bash[18409]: cluster 2020-06-27T05:43:42.109117+0000 mgr.x (mgr.34109) 1930 : cluster [DBG] pgmap v2010: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:43.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:43 smithi031 bash[18426]: cluster 2020-06-27T05:43:42.109117+0000 mgr.x (mgr.34109) 1930 : cluster [DBG] pgmap v2010: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:43 smithi031 bash[22603]: cluster 2020-06-27T05:43:42.109117+0000 mgr.x (mgr.34109) 1930 : cluster [DBG] pgmap v2010: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:45.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:45 smithi051 bash[18409]: cluster 2020-06-27T05:43:44.110774+0000 mgr.x (mgr.34109) 1931 : cluster [DBG] pgmap v2011: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:45.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:45 smithi031 bash[18426]: cluster 2020-06-27T05:43:44.110774+0000 mgr.x (mgr.34109) 1931 : cluster [DBG] pgmap v2011: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:45.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:45 smithi031 bash[22603]: cluster 2020-06-27T05:43:44.110774+0000 mgr.x (mgr.34109) 1931 : cluster [DBG] pgmap v2011: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:47.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:47 smithi051 bash[18409]: cluster 2020-06-27T05:43:46.112510+0000 mgr.x (mgr.34109) 1932 : cluster [DBG] pgmap v2012: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:47.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:47 smithi031 bash[18426]: cluster 2020-06-27T05:43:46.112510+0000 mgr.x (mgr.34109) 1932 : cluster [DBG] pgmap v2012: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:47.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:47 smithi031 bash[22603]: cluster 2020-06-27T05:43:46.112510+0000 mgr.x (mgr.34109) 1932 : cluster [DBG] pgmap v2012: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:49.717 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:49 smithi051 bash[18409]: cluster 2020-06-27T05:43:48.114310+0000 mgr.x (mgr.34109) 1933 : cluster [DBG] pgmap v2013: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:49.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:49 smithi031 bash[22603]: cluster 2020-06-27T05:43:48.114310+0000 mgr.x (mgr.34109) 1933 : cluster [DBG] pgmap v2013: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:49.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:49 smithi031 bash[18426]: cluster 2020-06-27T05:43:48.114310+0000 mgr.x (mgr.34109) 1933 : cluster [DBG] pgmap v2013: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:51.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:51 smithi051 bash[18409]: cluster 2020-06-27T05:43:50.115958+0000 mgr.x (mgr.34109) 1934 : cluster [DBG] pgmap v2014: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:51.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:51 smithi031 bash[18426]: cluster 2020-06-27T05:43:50.115958+0000 mgr.x (mgr.34109) 1934 : cluster [DBG] pgmap v2014: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:51.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:51 smithi031 bash[22603]: cluster 2020-06-27T05:43:50.115958+0000 mgr.x (mgr.34109) 1934 : cluster [DBG] pgmap v2014: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:53.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:53 smithi051 bash[18409]: cluster 2020-06-27T05:43:52.117649+0000 mgr.x (mgr.34109) 1935 : cluster [DBG] pgmap v2015: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:53.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:53 smithi031 bash[18426]: cluster 2020-06-27T05:43:52.117649+0000 mgr.x (mgr.34109) 1935 : cluster [DBG] pgmap v2015: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:53.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:53 smithi031 bash[22603]: cluster 2020-06-27T05:43:52.117649+0000 mgr.x (mgr.34109) 1935 : cluster [DBG] pgmap v2015: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:55.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:55 smithi051 bash[18409]: cluster 2020-06-27T05:43:54.119272+0000 mgr.x (mgr.34109) 1936 : cluster [DBG] pgmap v2016: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:55.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:55 smithi031 bash[18426]: cluster 2020-06-27T05:43:54.119272+0000 mgr.x (mgr.34109) 1936 : cluster [DBG] pgmap v2016: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:55.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:55 smithi031 bash[22603]: cluster 2020-06-27T05:43:54.119272+0000 mgr.x (mgr.34109) 1936 : cluster [DBG] pgmap v2016: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:57.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:57 smithi051 bash[18409]: cluster 2020-06-27T05:43:56.121026+0000 mgr.x (mgr.34109) 1937 : cluster [DBG] pgmap v2017: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:57.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:57 smithi031 bash[18426]: cluster 2020-06-27T05:43:56.121026+0000 mgr.x (mgr.34109) 1937 : cluster [DBG] pgmap v2017: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:57.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:57 smithi031 bash[22603]: cluster 2020-06-27T05:43:56.121026+0000 mgr.x (mgr.34109) 1937 : cluster [DBG] pgmap v2017: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:59.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:43:59 smithi051 bash[18409]: cluster 2020-06-27T05:43:58.122787+0000 mgr.x (mgr.34109) 1938 : cluster [DBG] pgmap v2018: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:59.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:43:59 smithi031 bash[18426]: cluster 2020-06-27T05:43:58.122787+0000 mgr.x (mgr.34109) 1938 : cluster [DBG] pgmap v2018: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:43:59.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:43:59 smithi031 bash[22603]: cluster 2020-06-27T05:43:58.122787+0000 mgr.x (mgr.34109) 1938 : cluster [DBG] pgmap v2018: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:01.650 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:01 smithi031 bash[18426]: cluster 2020-06-27T05:44:00.124530+0000 mgr.x (mgr.34109) 1939 : cluster [DBG] pgmap v2019: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:01.651 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:01 smithi031 bash[22603]: cluster 2020-06-27T05:44:00.124530+0000 mgr.x (mgr.34109) 1939 : cluster [DBG] pgmap v2019: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:01.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:01 smithi051 bash[18409]: cluster 2020-06-27T05:44:00.124530+0000 mgr.x (mgr.34109) 1939 : cluster [DBG] pgmap v2019: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:03.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:03 smithi051 bash[18409]: cluster 2020-06-27T05:44:02.126217+0000 mgr.x (mgr.34109) 1940 : cluster [DBG] pgmap v2020: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:03.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:03 smithi031 bash[18426]: cluster 2020-06-27T05:44:02.126217+0000 mgr.x (mgr.34109) 1940 : cluster [DBG] pgmap v2020: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:03.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:03 smithi031 bash[22603]: cluster 2020-06-27T05:44:02.126217+0000 mgr.x (mgr.34109) 1940 : cluster [DBG] pgmap v2020: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:05.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:05 smithi051 bash[18409]: cluster 2020-06-27T05:44:04.127838+0000 mgr.x (mgr.34109) 1941 : cluster [DBG] pgmap v2021: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:05 smithi031 bash[18426]: cluster 2020-06-27T05:44:04.127838+0000 mgr.x (mgr.34109) 1941 : cluster [DBG] pgmap v2021: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:05.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:05 smithi031 bash[22603]: cluster 2020-06-27T05:44:04.127838+0000 mgr.x (mgr.34109) 1941 : cluster [DBG] pgmap v2021: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:07.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:07 smithi051 bash[18409]: cluster 2020-06-27T05:44:06.129456+0000 mgr.x (mgr.34109) 1942 : cluster [DBG] pgmap v2022: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:07.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:07 smithi031 bash[18426]: cluster 2020-06-27T05:44:06.129456+0000 mgr.x (mgr.34109) 1942 : cluster [DBG] pgmap v2022: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:07.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:07 smithi031 bash[22603]: cluster 2020-06-27T05:44:06.129456+0000 mgr.x (mgr.34109) 1942 : cluster [DBG] pgmap v2022: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:09 smithi051 bash[18409]: cluster 2020-06-27T05:44:08.131061+0000 mgr.x (mgr.34109) 1943 : cluster [DBG] pgmap v2023: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:09.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:09 smithi031 bash[18426]: cluster 2020-06-27T05:44:08.131061+0000 mgr.x (mgr.34109) 1943 : cluster [DBG] pgmap v2023: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:09.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:09 smithi031 bash[22603]: cluster 2020-06-27T05:44:08.131061+0000 mgr.x (mgr.34109) 1943 : cluster [DBG] pgmap v2023: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:11.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:11 smithi051 bash[18409]: cluster 2020-06-27T05:44:10.132805+0000 mgr.x (mgr.34109) 1944 : cluster [DBG] pgmap v2024: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:11.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:11 smithi031 bash[18426]: cluster 2020-06-27T05:44:10.132805+0000 mgr.x (mgr.34109) 1944 : cluster [DBG] pgmap v2024: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:11.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:11 smithi031 bash[22603]: cluster 2020-06-27T05:44:10.132805+0000 mgr.x (mgr.34109) 1944 : cluster [DBG] pgmap v2024: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:13.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:13 smithi051 bash[18409]: cluster 2020-06-27T05:44:12.134532+0000 mgr.x (mgr.34109) 1945 : cluster [DBG] pgmap v2025: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:13.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:13 smithi031 bash[18426]: cluster 2020-06-27T05:44:12.134532+0000 mgr.x (mgr.34109) 1945 : cluster [DBG] pgmap v2025: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:13.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:13 smithi031 bash[22603]: cluster 2020-06-27T05:44:12.134532+0000 mgr.x (mgr.34109) 1945 : cluster [DBG] pgmap v2025: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:15.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:15 smithi051 bash[18409]: cluster 2020-06-27T05:44:14.136200+0000 mgr.x (mgr.34109) 1946 : cluster [DBG] pgmap v2026: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:15.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:15 smithi031 bash[18426]: cluster 2020-06-27T05:44:14.136200+0000 mgr.x (mgr.34109) 1946 : cluster [DBG] pgmap v2026: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:15.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:15 smithi031 bash[22603]: cluster 2020-06-27T05:44:14.136200+0000 mgr.x (mgr.34109) 1946 : cluster [DBG] pgmap v2026: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:17 smithi051 bash[18409]: cluster 2020-06-27T05:44:16.137866+0000 mgr.x (mgr.34109) 1947 : cluster [DBG] pgmap v2027: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:17.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:17 smithi031 bash[18426]: cluster 2020-06-27T05:44:16.137866+0000 mgr.x (mgr.34109) 1947 : cluster [DBG] pgmap v2027: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:17.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:17 smithi031 bash[22603]: cluster 2020-06-27T05:44:16.137866+0000 mgr.x (mgr.34109) 1947 : cluster [DBG] pgmap v2027: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:19.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:19 smithi051 bash[18409]: cluster 2020-06-27T05:44:18.139609+0000 mgr.x (mgr.34109) 1948 : cluster [DBG] pgmap v2028: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:19.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:19 smithi031 bash[18426]: cluster 2020-06-27T05:44:18.139609+0000 mgr.x (mgr.34109) 1948 : cluster [DBG] pgmap v2028: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:19.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:19 smithi031 bash[22603]: cluster 2020-06-27T05:44:18.139609+0000 mgr.x (mgr.34109) 1948 : cluster [DBG] pgmap v2028: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:21.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:21 smithi051 bash[18409]: cluster 2020-06-27T05:44:20.141223+0000 mgr.x (mgr.34109) 1949 : cluster [DBG] pgmap v2029: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:21.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:21 smithi031 bash[18426]: cluster 2020-06-27T05:44:20.141223+0000 mgr.x (mgr.34109) 1949 : cluster [DBG] pgmap v2029: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:21.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:21 smithi031 bash[22603]: cluster 2020-06-27T05:44:20.141223+0000 mgr.x (mgr.34109) 1949 : cluster [DBG] pgmap v2029: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:23.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:23 smithi051 bash[18409]: cluster 2020-06-27T05:44:22.142842+0000 mgr.x (mgr.34109) 1950 : cluster [DBG] pgmap v2030: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:23.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:23 smithi031 bash[18426]: cluster 2020-06-27T05:44:22.142842+0000 mgr.x (mgr.34109) 1950 : cluster [DBG] pgmap v2030: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:23.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:23 smithi031 bash[22603]: cluster 2020-06-27T05:44:22.142842+0000 mgr.x (mgr.34109) 1950 : cluster [DBG] pgmap v2030: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:25.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:25 smithi051 bash[18409]: cluster 2020-06-27T05:44:24.144565+0000 mgr.x (mgr.34109) 1951 : cluster [DBG] pgmap v2031: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:25.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:25 smithi031 bash[18426]: cluster 2020-06-27T05:44:24.144565+0000 mgr.x (mgr.34109) 1951 : cluster [DBG] pgmap v2031: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:25.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:25 smithi031 bash[22603]: cluster 2020-06-27T05:44:24.144565+0000 mgr.x (mgr.34109) 1951 : cluster [DBG] pgmap v2031: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:27.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:27 smithi031 bash[18426]: cluster 2020-06-27T05:44:26.146190+0000 mgr.x (mgr.34109) 1952 : cluster [DBG] pgmap v2032: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:27.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:27 smithi031 bash[22603]: cluster 2020-06-27T05:44:26.146190+0000 mgr.x (mgr.34109) 1952 : cluster [DBG] pgmap v2032: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:27.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:27 smithi051 bash[18409]: cluster 2020-06-27T05:44:26.146190+0000 mgr.x (mgr.34109) 1952 : cluster [DBG] pgmap v2032: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:29.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:29 smithi051 bash[18409]: cluster 2020-06-27T05:44:28.147932+0000 mgr.x (mgr.34109) 1953 : cluster [DBG] pgmap v2033: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:29.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:29 smithi031 bash[18426]: cluster 2020-06-27T05:44:28.147932+0000 mgr.x (mgr.34109) 1953 : cluster [DBG] pgmap v2033: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:29.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:29 smithi031 bash[22603]: cluster 2020-06-27T05:44:28.147932+0000 mgr.x (mgr.34109) 1953 : cluster [DBG] pgmap v2033: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:31.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:31 smithi051 bash[18409]: cluster 2020-06-27T05:44:30.149661+0000 mgr.x (mgr.34109) 1954 : cluster [DBG] pgmap v2034: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:31.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:31 smithi031 bash[18426]: cluster 2020-06-27T05:44:30.149661+0000 mgr.x (mgr.34109) 1954 : cluster [DBG] pgmap v2034: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:31.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:31 smithi031 bash[22603]: cluster 2020-06-27T05:44:30.149661+0000 mgr.x (mgr.34109) 1954 : cluster [DBG] pgmap v2034: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:33.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:33 smithi051 bash[18409]: cluster 2020-06-27T05:44:32.151361+0000 mgr.x (mgr.34109) 1955 : cluster [DBG] pgmap v2035: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:33.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:33 smithi031 bash[18426]: cluster 2020-06-27T05:44:32.151361+0000 mgr.x (mgr.34109) 1955 : cluster [DBG] pgmap v2035: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:33.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:33 smithi031 bash[22603]: cluster 2020-06-27T05:44:32.151361+0000 mgr.x (mgr.34109) 1955 : cluster [DBG] pgmap v2035: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:34.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:34 smithi051 bash[18409]: cluster 2020-06-27T05:44:34.153053+0000 mgr.x (mgr.34109) 1956 : cluster [DBG] pgmap v2036: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:34 smithi031 bash[18426]: cluster 2020-06-27T05:44:34.153053+0000 mgr.x (mgr.34109) 1956 : cluster [DBG] pgmap v2036: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:34 smithi031 bash[22603]: cluster 2020-06-27T05:44:34.153053+0000 mgr.x (mgr.34109) 1956 : cluster [DBG] pgmap v2036: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:37.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:37 smithi051 bash[18409]: cluster 2020-06-27T05:44:36.154807+0000 mgr.x (mgr.34109) 1957 : cluster [DBG] pgmap v2037: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:37.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:37 smithi031 bash[18426]: cluster 2020-06-27T05:44:36.154807+0000 mgr.x (mgr.34109) 1957 : cluster [DBG] pgmap v2037: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:37.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:37 smithi031 bash[22603]: cluster 2020-06-27T05:44:36.154807+0000 mgr.x (mgr.34109) 1957 : cluster [DBG] pgmap v2037: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:39.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:39 smithi051 bash[18409]: cluster 2020-06-27T05:44:38.156415+0000 mgr.x (mgr.34109) 1958 : cluster [DBG] pgmap v2038: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:39.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:39 smithi031 bash[18426]: cluster 2020-06-27T05:44:38.156415+0000 mgr.x (mgr.34109) 1958 : cluster [DBG] pgmap v2038: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:39.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:39 smithi031 bash[22603]: cluster 2020-06-27T05:44:38.156415+0000 mgr.x (mgr.34109) 1958 : cluster [DBG] pgmap v2038: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:41.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:41 smithi051 bash[18409]: cluster 2020-06-27T05:44:40.158143+0000 mgr.x (mgr.34109) 1959 : cluster [DBG] pgmap v2039: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:41.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:41 smithi031 bash[18426]: cluster 2020-06-27T05:44:40.158143+0000 mgr.x (mgr.34109) 1959 : cluster [DBG] pgmap v2039: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:41.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:41 smithi031 bash[22603]: cluster 2020-06-27T05:44:40.158143+0000 mgr.x (mgr.34109) 1959 : cluster [DBG] pgmap v2039: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:43.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:43 smithi051 bash[18409]: cluster 2020-06-27T05:44:42.159881+0000 mgr.x (mgr.34109) 1960 : cluster [DBG] pgmap v2040: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:43.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:43 smithi031 bash[18426]: cluster 2020-06-27T05:44:42.159881+0000 mgr.x (mgr.34109) 1960 : cluster [DBG] pgmap v2040: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:43.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:43 smithi031 bash[22603]: cluster 2020-06-27T05:44:42.159881+0000 mgr.x (mgr.34109) 1960 : cluster [DBG] pgmap v2040: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:45.475 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:45 smithi031 bash[18426]: cluster 2020-06-27T05:44:44.161506+0000 mgr.x (mgr.34109) 1961 : cluster [DBG] pgmap v2041: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:45.476 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:45 smithi031 bash[22603]: cluster 2020-06-27T05:44:44.161506+0000 mgr.x (mgr.34109) 1961 : cluster [DBG] pgmap v2041: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:45.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:45 smithi051 bash[18409]: cluster 2020-06-27T05:44:44.161506+0000 mgr.x (mgr.34109) 1961 : cluster [DBG] pgmap v2041: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:47.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:47 smithi051 bash[18409]: cluster 2020-06-27T05:44:46.163105+0000 mgr.x (mgr.34109) 1962 : cluster [DBG] pgmap v2042: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:47.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:47 smithi031 bash[18426]: cluster 2020-06-27T05:44:46.163105+0000 mgr.x (mgr.34109) 1962 : cluster [DBG] pgmap v2042: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:47.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:47 smithi031 bash[22603]: cluster 2020-06-27T05:44:46.163105+0000 mgr.x (mgr.34109) 1962 : cluster [DBG] pgmap v2042: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:49.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:49 smithi051 bash[18409]: cluster 2020-06-27T05:44:48.164836+0000 mgr.x (mgr.34109) 1963 : cluster [DBG] pgmap v2043: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:49.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:49 smithi031 bash[18426]: cluster 2020-06-27T05:44:48.164836+0000 mgr.x (mgr.34109) 1963 : cluster [DBG] pgmap v2043: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:49.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:49 smithi031 bash[22603]: cluster 2020-06-27T05:44:48.164836+0000 mgr.x (mgr.34109) 1963 : cluster [DBG] pgmap v2043: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:51.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:51 smithi051 bash[18409]: cluster 2020-06-27T05:44:50.166633+0000 mgr.x (mgr.34109) 1964 : cluster [DBG] pgmap v2044: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:51.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:51 smithi031 bash[18426]: cluster 2020-06-27T05:44:50.166633+0000 mgr.x (mgr.34109) 1964 : cluster [DBG] pgmap v2044: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:51.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:51 smithi031 bash[22603]: cluster 2020-06-27T05:44:50.166633+0000 mgr.x (mgr.34109) 1964 : cluster [DBG] pgmap v2044: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:53.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:53 smithi051 bash[18409]: cluster 2020-06-27T05:44:52.168353+0000 mgr.x (mgr.34109) 1965 : cluster [DBG] pgmap v2045: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:53.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:53 smithi031 bash[18426]: cluster 2020-06-27T05:44:52.168353+0000 mgr.x (mgr.34109) 1965 : cluster [DBG] pgmap v2045: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:53.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:53 smithi031 bash[22603]: cluster 2020-06-27T05:44:52.168353+0000 mgr.x (mgr.34109) 1965 : cluster [DBG] pgmap v2045: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:55.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:55 smithi051 bash[18409]: cluster 2020-06-27T05:44:54.169963+0000 mgr.x (mgr.34109) 1966 : cluster [DBG] pgmap v2046: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:55.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:55 smithi031 bash[18426]: cluster 2020-06-27T05:44:54.169963+0000 mgr.x (mgr.34109) 1966 : cluster [DBG] pgmap v2046: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:55.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:55 smithi031 bash[22603]: cluster 2020-06-27T05:44:54.169963+0000 mgr.x (mgr.34109) 1966 : cluster [DBG] pgmap v2046: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:57.717 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:57 smithi051 bash[18409]: cluster 2020-06-27T05:44:56.171792+0000 mgr.x (mgr.34109) 1967 : cluster [DBG] pgmap v2047: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:57.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:57 smithi031 bash[18426]: cluster 2020-06-27T05:44:56.171792+0000 mgr.x (mgr.34109) 1967 : cluster [DBG] pgmap v2047: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:57.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:57 smithi031 bash[22603]: cluster 2020-06-27T05:44:56.171792+0000 mgr.x (mgr.34109) 1967 : cluster [DBG] pgmap v2047: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:59.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:44:59 smithi051 bash[18409]: cluster 2020-06-27T05:44:58.173384+0000 mgr.x (mgr.34109) 1968 : cluster [DBG] pgmap v2048: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:59.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:44:59 smithi031 bash[18426]: cluster 2020-06-27T05:44:58.173384+0000 mgr.x (mgr.34109) 1968 : cluster [DBG] pgmap v2048: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:44:59.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:44:59 smithi031 bash[22603]: cluster 2020-06-27T05:44:58.173384+0000 mgr.x (mgr.34109) 1968 : cluster [DBG] pgmap v2048: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:01.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:01 smithi051 bash[18409]: cluster 2020-06-27T05:45:00.176215+0000 mgr.x (mgr.34109) 1969 : cluster [DBG] pgmap v2049: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:01.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:01 smithi031 bash[18426]: cluster 2020-06-27T05:45:00.176215+0000 mgr.x (mgr.34109) 1969 : cluster [DBG] pgmap v2049: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:01.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:01 smithi031 bash[22603]: cluster 2020-06-27T05:45:00.176215+0000 mgr.x (mgr.34109) 1969 : cluster [DBG] pgmap v2049: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:03.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:03 smithi051 bash[18409]: cluster 2020-06-27T05:45:02.178038+0000 mgr.x (mgr.34109) 1970 : cluster [DBG] pgmap v2050: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:03.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:03 smithi031 bash[18426]: cluster 2020-06-27T05:45:02.178038+0000 mgr.x (mgr.34109) 1970 : cluster [DBG] pgmap v2050: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:03.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:03 smithi031 bash[22603]: cluster 2020-06-27T05:45:02.178038+0000 mgr.x (mgr.34109) 1970 : cluster [DBG] pgmap v2050: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:05.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:05 smithi051 bash[18409]: cluster 2020-06-27T05:45:04.179734+0000 mgr.x (mgr.34109) 1971 : cluster [DBG] pgmap v2051: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:05 smithi031 bash[18426]: cluster 2020-06-27T05:45:04.179734+0000 mgr.x (mgr.34109) 1971 : cluster [DBG] pgmap v2051: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:05.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:05 smithi031 bash[22603]: cluster 2020-06-27T05:45:04.179734+0000 mgr.x (mgr.34109) 1971 : cluster [DBG] pgmap v2051: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:07.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:07 smithi051 bash[18409]: cluster 2020-06-27T05:45:06.181464+0000 mgr.x (mgr.34109) 1972 : cluster [DBG] pgmap v2052: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:07.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:07 smithi031 bash[18426]: cluster 2020-06-27T05:45:06.181464+0000 mgr.x (mgr.34109) 1972 : cluster [DBG] pgmap v2052: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:07.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:07 smithi031 bash[22603]: cluster 2020-06-27T05:45:06.181464+0000 mgr.x (mgr.34109) 1972 : cluster [DBG] pgmap v2052: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:09 smithi051 bash[18409]: cluster 2020-06-27T05:45:08.183215+0000 mgr.x (mgr.34109) 1973 : cluster [DBG] pgmap v2053: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:09.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:09 smithi031 bash[22603]: cluster 2020-06-27T05:45:08.183215+0000 mgr.x (mgr.34109) 1973 : cluster [DBG] pgmap v2053: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:09.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:09 smithi031 bash[18426]: cluster 2020-06-27T05:45:08.183215+0000 mgr.x (mgr.34109) 1973 : cluster [DBG] pgmap v2053: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:11.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:11 smithi051 bash[18409]: cluster 2020-06-27T05:45:10.184957+0000 mgr.x (mgr.34109) 1974 : cluster [DBG] pgmap v2054: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:11 smithi031 bash[18426]: cluster 2020-06-27T05:45:10.184957+0000 mgr.x (mgr.34109) 1974 : cluster [DBG] pgmap v2054: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:11.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:11 smithi031 bash[22603]: cluster 2020-06-27T05:45:10.184957+0000 mgr.x (mgr.34109) 1974 : cluster [DBG] pgmap v2054: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:13.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:13 smithi051 bash[18409]: cluster 2020-06-27T05:45:12.186707+0000 mgr.x (mgr.34109) 1975 : cluster [DBG] pgmap v2055: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:13.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:13 smithi031 bash[18426]: cluster 2020-06-27T05:45:12.186707+0000 mgr.x (mgr.34109) 1975 : cluster [DBG] pgmap v2055: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:13.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:13 smithi031 bash[22603]: cluster 2020-06-27T05:45:12.186707+0000 mgr.x (mgr.34109) 1975 : cluster [DBG] pgmap v2055: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:15.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:15 smithi051 bash[18409]: cluster 2020-06-27T05:45:14.188353+0000 mgr.x (mgr.34109) 1976 : cluster [DBG] pgmap v2056: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:15.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:15 smithi031 bash[22603]: cluster 2020-06-27T05:45:14.188353+0000 mgr.x (mgr.34109) 1976 : cluster [DBG] pgmap v2056: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:15.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:15 smithi031 bash[18426]: cluster 2020-06-27T05:45:14.188353+0000 mgr.x (mgr.34109) 1976 : cluster [DBG] pgmap v2056: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:17.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:17 smithi051 bash[18409]: cluster 2020-06-27T05:45:16.190076+0000 mgr.x (mgr.34109) 1977 : cluster [DBG] pgmap v2057: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:17.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:17 smithi031 bash[18426]: cluster 2020-06-27T05:45:16.190076+0000 mgr.x (mgr.34109) 1977 : cluster [DBG] pgmap v2057: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:17.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:17 smithi031 bash[22603]: cluster 2020-06-27T05:45:16.190076+0000 mgr.x (mgr.34109) 1977 : cluster [DBG] pgmap v2057: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:19.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:19 smithi031 bash[18426]: cluster 2020-06-27T05:45:18.191883+0000 mgr.x (mgr.34109) 1978 : cluster [DBG] pgmap v2058: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:19.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:19 smithi031 bash[22603]: cluster 2020-06-27T05:45:18.191883+0000 mgr.x (mgr.34109) 1978 : cluster [DBG] pgmap v2058: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:19.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:19 smithi051 bash[18409]: cluster 2020-06-27T05:45:18.191883+0000 mgr.x (mgr.34109) 1978 : cluster [DBG] pgmap v2058: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:21.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:21 smithi051 bash[18409]: cluster 2020-06-27T05:45:20.193481+0000 mgr.x (mgr.34109) 1979 : cluster [DBG] pgmap v2059: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:21.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:21 smithi031 bash[18426]: cluster 2020-06-27T05:45:20.193481+0000 mgr.x (mgr.34109) 1979 : cluster [DBG] pgmap v2059: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:21.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:21 smithi031 bash[22603]: cluster 2020-06-27T05:45:20.193481+0000 mgr.x (mgr.34109) 1979 : cluster [DBG] pgmap v2059: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:23.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:23 smithi051 bash[18409]: cluster 2020-06-27T05:45:22.195209+0000 mgr.x (mgr.34109) 1980 : cluster [DBG] pgmap v2060: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:23.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:23 smithi031 bash[18426]: cluster 2020-06-27T05:45:22.195209+0000 mgr.x (mgr.34109) 1980 : cluster [DBG] pgmap v2060: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:23.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:23 smithi031 bash[22603]: cluster 2020-06-27T05:45:22.195209+0000 mgr.x (mgr.34109) 1980 : cluster [DBG] pgmap v2060: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:25.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:25 smithi051 bash[18409]: cluster 2020-06-27T05:45:24.197021+0000 mgr.x (mgr.34109) 1981 : cluster [DBG] pgmap v2061: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:25.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:25 smithi031 bash[18426]: cluster 2020-06-27T05:45:24.197021+0000 mgr.x (mgr.34109) 1981 : cluster [DBG] pgmap v2061: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:25.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:25 smithi031 bash[22603]: cluster 2020-06-27T05:45:24.197021+0000 mgr.x (mgr.34109) 1981 : cluster [DBG] pgmap v2061: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:27.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:27 smithi051 bash[18409]: cluster 2020-06-27T05:45:26.198700+0000 mgr.x (mgr.34109) 1982 : cluster [DBG] pgmap v2062: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:27.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:27 smithi031 bash[18426]: cluster 2020-06-27T05:45:26.198700+0000 mgr.x (mgr.34109) 1982 : cluster [DBG] pgmap v2062: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:27.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:27 smithi031 bash[22603]: cluster 2020-06-27T05:45:26.198700+0000 mgr.x (mgr.34109) 1982 : cluster [DBG] pgmap v2062: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:29.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:29 smithi051 bash[18409]: cluster 2020-06-27T05:45:28.200369+0000 mgr.x (mgr.34109) 1983 : cluster [DBG] pgmap v2063: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:29.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:29 smithi031 bash[18426]: cluster 2020-06-27T05:45:28.200369+0000 mgr.x (mgr.34109) 1983 : cluster [DBG] pgmap v2063: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:29.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:29 smithi031 bash[22603]: cluster 2020-06-27T05:45:28.200369+0000 mgr.x (mgr.34109) 1983 : cluster [DBG] pgmap v2063: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:31.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:31 smithi051 bash[18409]: cluster 2020-06-27T05:45:30.202040+0000 mgr.x (mgr.34109) 1984 : cluster [DBG] pgmap v2064: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:31.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:31 smithi031 bash[18426]: cluster 2020-06-27T05:45:30.202040+0000 mgr.x (mgr.34109) 1984 : cluster [DBG] pgmap v2064: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:31.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:31 smithi031 bash[22603]: cluster 2020-06-27T05:45:30.202040+0000 mgr.x (mgr.34109) 1984 : cluster [DBG] pgmap v2064: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:33 smithi051 bash[18409]: cluster 2020-06-27T05:45:32.203844+0000 mgr.x (mgr.34109) 1985 : cluster [DBG] pgmap v2065: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:33.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:33 smithi031 bash[18426]: cluster 2020-06-27T05:45:32.203844+0000 mgr.x (mgr.34109) 1985 : cluster [DBG] pgmap v2065: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:33.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:33 smithi031 bash[22603]: cluster 2020-06-27T05:45:32.203844+0000 mgr.x (mgr.34109) 1985 : cluster [DBG] pgmap v2065: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:35.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:35 smithi051 bash[18409]: cluster 2020-06-27T05:45:34.205507+0000 mgr.x (mgr.34109) 1986 : cluster [DBG] pgmap v2066: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:35.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:35 smithi031 bash[18426]: cluster 2020-06-27T05:45:34.205507+0000 mgr.x (mgr.34109) 1986 : cluster [DBG] pgmap v2066: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:35.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:35 smithi031 bash[22603]: cluster 2020-06-27T05:45:34.205507+0000 mgr.x (mgr.34109) 1986 : cluster [DBG] pgmap v2066: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:37.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:37 smithi051 bash[18409]: cluster 2020-06-27T05:45:36.207188+0000 mgr.x (mgr.34109) 1987 : cluster [DBG] pgmap v2067: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:37.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:37 smithi031 bash[18426]: cluster 2020-06-27T05:45:36.207188+0000 mgr.x (mgr.34109) 1987 : cluster [DBG] pgmap v2067: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:37.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:37 smithi031 bash[22603]: cluster 2020-06-27T05:45:36.207188+0000 mgr.x (mgr.34109) 1987 : cluster [DBG] pgmap v2067: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:39.717 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:39 smithi051 bash[18409]: cluster 2020-06-27T05:45:38.208930+0000 mgr.x (mgr.34109) 1988 : cluster [DBG] pgmap v2068: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:39 smithi031 bash[18426]: cluster 2020-06-27T05:45:38.208930+0000 mgr.x (mgr.34109) 1988 : cluster [DBG] pgmap v2068: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:39.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:39 smithi031 bash[22603]: cluster 2020-06-27T05:45:38.208930+0000 mgr.x (mgr.34109) 1988 : cluster [DBG] pgmap v2068: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:41.467 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:41 smithi051 bash[18409]: cluster 2020-06-27T05:45:40.210769+0000 mgr.x (mgr.34109) 1989 : cluster [DBG] pgmap v2069: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:41.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:41 smithi031 bash[18426]: cluster 2020-06-27T05:45:40.210769+0000 mgr.x (mgr.34109) 1989 : cluster [DBG] pgmap v2069: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:41.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:41 smithi031 bash[22603]: cluster 2020-06-27T05:45:40.210769+0000 mgr.x (mgr.34109) 1989 : cluster [DBG] pgmap v2069: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:43 smithi051 bash[18409]: cluster 2020-06-27T05:45:42.212456+0000 mgr.x (mgr.34109) 1990 : cluster [DBG] pgmap v2070: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:43.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:43 smithi031 bash[18426]: cluster 2020-06-27T05:45:42.212456+0000 mgr.x (mgr.34109) 1990 : cluster [DBG] pgmap v2070: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:43 smithi031 bash[22603]: cluster 2020-06-27T05:45:42.212456+0000 mgr.x (mgr.34109) 1990 : cluster [DBG] pgmap v2070: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:45.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:45 smithi051 bash[18409]: cluster 2020-06-27T05:45:44.214246+0000 mgr.x (mgr.34109) 1991 : cluster [DBG] pgmap v2071: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:45.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:45 smithi031 bash[18426]: cluster 2020-06-27T05:45:44.214246+0000 mgr.x (mgr.34109) 1991 : cluster [DBG] pgmap v2071: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:45.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:45 smithi031 bash[22603]: cluster 2020-06-27T05:45:44.214246+0000 mgr.x (mgr.34109) 1991 : cluster [DBG] pgmap v2071: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:47.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:47 smithi051 bash[18409]: cluster 2020-06-27T05:45:46.216088+0000 mgr.x (mgr.34109) 1992 : cluster [DBG] pgmap v2072: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:47.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:47 smithi031 bash[18426]: cluster 2020-06-27T05:45:46.216088+0000 mgr.x (mgr.34109) 1992 : cluster [DBG] pgmap v2072: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:47.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:47 smithi031 bash[22603]: cluster 2020-06-27T05:45:46.216088+0000 mgr.x (mgr.34109) 1992 : cluster [DBG] pgmap v2072: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:49.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:49 smithi051 bash[18409]: cluster 2020-06-27T05:45:48.217799+0000 mgr.x (mgr.34109) 1993 : cluster [DBG] pgmap v2073: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:49.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:49 smithi031 bash[22603]: cluster 2020-06-27T05:45:48.217799+0000 mgr.x (mgr.34109) 1993 : cluster [DBG] pgmap v2073: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:49.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:49 smithi031 bash[18426]: cluster 2020-06-27T05:45:48.217799+0000 mgr.x (mgr.34109) 1993 : cluster [DBG] pgmap v2073: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:51.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:51 smithi051 bash[18409]: cluster 2020-06-27T05:45:50.219624+0000 mgr.x (mgr.34109) 1994 : cluster [DBG] pgmap v2074: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:51.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:51 smithi031 bash[22603]: cluster 2020-06-27T05:45:50.219624+0000 mgr.x (mgr.34109) 1994 : cluster [DBG] pgmap v2074: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:51.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:51 smithi031 bash[18426]: cluster 2020-06-27T05:45:50.219624+0000 mgr.x (mgr.34109) 1994 : cluster [DBG] pgmap v2074: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:53.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:53 smithi051 bash[18409]: cluster 2020-06-27T05:45:52.221462+0000 mgr.x (mgr.34109) 1995 : cluster [DBG] pgmap v2075: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:53.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:53 smithi031 bash[22603]: cluster 2020-06-27T05:45:52.221462+0000 mgr.x (mgr.34109) 1995 : cluster [DBG] pgmap v2075: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:53.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:53 smithi031 bash[18426]: cluster 2020-06-27T05:45:52.221462+0000 mgr.x (mgr.34109) 1995 : cluster [DBG] pgmap v2075: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:55.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:55 smithi051 bash[18409]: cluster 2020-06-27T05:45:54.223170+0000 mgr.x (mgr.34109) 1996 : cluster [DBG] pgmap v2076: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:55.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:55 smithi031 bash[18426]: cluster 2020-06-27T05:45:54.223170+0000 mgr.x (mgr.34109) 1996 : cluster [DBG] pgmap v2076: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:55.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:55 smithi031 bash[22603]: cluster 2020-06-27T05:45:54.223170+0000 mgr.x (mgr.34109) 1996 : cluster [DBG] pgmap v2076: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:57.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:57 smithi051 bash[18409]: cluster 2020-06-27T05:45:56.224919+0000 mgr.x (mgr.34109) 1997 : cluster [DBG] pgmap v2077: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:57.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:57 smithi031 bash[22603]: cluster 2020-06-27T05:45:56.224919+0000 mgr.x (mgr.34109) 1997 : cluster [DBG] pgmap v2077: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:57.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:57 smithi031 bash[18426]: cluster 2020-06-27T05:45:56.224919+0000 mgr.x (mgr.34109) 1997 : cluster [DBG] pgmap v2077: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:59.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:59 smithi051 bash[18409]: cluster 2020-06-27T05:45:58.226531+0000 mgr.x (mgr.34109) 1998 : cluster [DBG] pgmap v2078: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:59.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:59 smithi051 bash[18409]: audit 2020-06-27T05:45:58.689856+0000 mon.b (mon.2) 398 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409642\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409718\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409752\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409927\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410024\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410118\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410211\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410247\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410277\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.410355\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]: dispatch 2020-06-27T05:45:59.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:59 smithi051 bash[18409]: audit 2020-06-27T05:45:58.690469+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409642\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409718\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409752\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409927\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410024\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410118\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410211\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410247\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410277\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.410355\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]: dispatch 2020-06-27T05:45:59.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:59 smithi051 bash[18409]: audit 2020-06-27T05:45:58.695456+0000 mon.a (mon.0) 1476 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409642\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409718\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409752\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409927\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410024\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410118\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410211\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410247\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410277\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.410355\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]': finished 2020-06-27T05:45:59.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:59 smithi051 bash[18409]: audit 2020-06-27T05:45:58.696012+0000 mon.b (mon.2) 399 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043003\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043080\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043114\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043289\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043386\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043487\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043582\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043618\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043649\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.043733\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]: dispatch 2020-06-27T05:45:59.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:59 smithi051 bash[18409]: audit 2020-06-27T05:45:58.696409+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043003\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043080\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043114\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043289\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043386\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043487\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043582\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043618\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043649\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.043733\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]: dispatch 2020-06-27T05:45:59.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:59 smithi051 bash[18409]: audit 2020-06-27T05:45:58.696527+0000 mon.b (mon.2) 400 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:45:59.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:59 smithi051 bash[18409]: audit 2020-06-27T05:45:58.700908+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043003\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043080\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043114\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043289\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043386\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043487\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043582\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043618\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043649\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.043733\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]': finished 2020-06-27T05:45:59.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:45:59 smithi051 bash[18409]: audit 2020-06-27T05:45:58.702359+0000 mon.b (mon.2) 401 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:45:59.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:59 smithi031 bash[18426]: cluster 2020-06-27T05:45:58.226531+0000 mgr.x (mgr.34109) 1998 : cluster [DBG] pgmap v2078: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:59.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:59 smithi031 bash[18426]: audit 2020-06-27T05:45:58.689856+0000 mon.b (mon.2) 398 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409642\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409718\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409752\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409927\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410024\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410118\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410211\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410247\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410277\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.410355\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]: dispatch 2020-06-27T05:45:59.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:59 smithi031 bash[18426]: audit 2020-06-27T05:45:58.690469+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409642\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409718\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409752\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409927\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410024\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410118\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410211\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410247\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410277\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.410355\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]: dispatch 2020-06-27T05:45:59.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:59 smithi031 bash[18426]: audit 2020-06-27T05:45:58.695456+0000 mon.a (mon.0) 1476 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409642\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409718\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409752\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409927\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410024\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410118\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410211\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410247\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410277\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.410355\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]': finished 2020-06-27T05:45:59.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:59 smithi031 bash[18426]: audit 2020-06-27T05:45:58.696012+0000 mon.b (mon.2) 399 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043003\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043080\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043114\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043289\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043386\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043487\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043582\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043618\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043649\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.043733\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]: dispatch 2020-06-27T05:45:59.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:59 smithi031 bash[18426]: audit 2020-06-27T05:45:58.696409+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043003\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043080\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043114\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043289\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043386\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043487\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043582\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043618\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043649\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.043733\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]: dispatch 2020-06-27T05:45:59.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:59 smithi031 bash[18426]: audit 2020-06-27T05:45:58.696527+0000 mon.b (mon.2) 400 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:45:59.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:59 smithi031 bash[18426]: audit 2020-06-27T05:45:58.700908+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043003\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043080\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043114\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043289\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043386\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043487\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043582\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043618\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043649\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.043733\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]': finished 2020-06-27T05:45:59.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:45:59 smithi031 bash[18426]: audit 2020-06-27T05:45:58.702359+0000 mon.b (mon.2) 401 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:45:59.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:59 smithi031 bash[22603]: cluster 2020-06-27T05:45:58.226531+0000 mgr.x (mgr.34109) 1998 : cluster [DBG] pgmap v2078: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:45:59.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:59 smithi031 bash[22603]: audit 2020-06-27T05:45:58.689856+0000 mon.b (mon.2) 398 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409642\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409718\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409752\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409927\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410024\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410118\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410211\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410247\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410277\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.410355\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]: dispatch 2020-06-27T05:45:59.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:59 smithi031 bash[22603]: audit 2020-06-27T05:45:58.690469+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409642\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409718\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409752\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409927\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410024\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410118\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410211\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410247\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410277\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.410355\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]: dispatch 2020-06-27T05:45:59.729 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:59 smithi031 bash[22603]: audit 2020-06-27T05:45:58.695456+0000 mon.a (mon.0) 1476 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409642\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.409718\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409752\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.409927\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410024\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.410118\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410211\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410247\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.410277\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.410355\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]': finished 2020-06-27T05:45:59.729 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:59 smithi031 bash[22603]: audit 2020-06-27T05:45:58.696012+0000 mon.b (mon.2) 399 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043003\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043080\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043114\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043289\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043386\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043487\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043582\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043618\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043649\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.043733\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]: dispatch 2020-06-27T05:45:59.729 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:59 smithi031 bash[22603]: audit 2020-06-27T05:45:58.696409+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043003\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043080\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043114\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043289\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043386\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043487\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043582\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043618\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043649\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.043733\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]: dispatch 2020-06-27T05:45:59.730 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:59 smithi031 bash[22603]: audit 2020-06-27T05:45:58.696527+0000 mon.b (mon.2) 400 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:45:59.730 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:59 smithi031 bash[22603]: audit 2020-06-27T05:45:58.700908+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043003\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043080\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043114\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043289\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043386\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:35:58.043487\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043582\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043618\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:35:58.043649\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:35:58.043733\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]': finished 2020-06-27T05:45:59.730 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:45:59 smithi031 bash[22603]: audit 2020-06-27T05:45:58.702359+0000 mon.b (mon.2) 401 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:46:01.381 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:01 smithi031 bash[22603]: cluster 2020-06-27T05:46:00.227812+0000 mgr.x (mgr.34109) 1999 : cluster [DBG] pgmap v2079: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:01.382 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:01 smithi031 bash[18426]: cluster 2020-06-27T05:46:00.227812+0000 mgr.x (mgr.34109) 1999 : cluster [DBG] pgmap v2079: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:01.382 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:01 smithi031 bash[18426]: audit 2020-06-27T05:46:00.661712+0000 mon.b (mon.2) 402 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]: dispatch 2020-06-27T05:46:01.386 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:01 smithi031 bash[22603]: audit 2020-06-27T05:46:00.661712+0000 mon.b (mon.2) 402 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]: dispatch 2020-06-27T05:46:01.387 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:01 smithi031 bash[22603]: audit 2020-06-27T05:46:00.662278+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]: dispatch 2020-06-27T05:46:01.387 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:01 smithi031 bash[22603]: audit 2020-06-27T05:46:00.664991+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]': finished 2020-06-27T05:46:01.387 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:01 smithi031 bash[22603]: audit 2020-06-27T05:46:00.665830+0000 mon.b (mon.2) 403 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T05:46:01.388 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:01 smithi031 bash[22603]: audit 2020-06-27T05:46:00.916140+0000 mon.b (mon.2) 404 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]: dispatch 2020-06-27T05:46:01.388 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:01 smithi031 bash[22603]: audit 2020-06-27T05:46:00.916668+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]: dispatch 2020-06-27T05:46:01.388 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:01 smithi031 bash[22603]: audit 2020-06-27T05:46:00.919791+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]': finished 2020-06-27T05:46:01.389 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:01 smithi031 bash[22603]: audit 2020-06-27T05:46:00.920415+0000 mon.b (mon.2) 405 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T05:46:01.389 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:01 smithi031 bash[18426]: audit 2020-06-27T05:46:00.662278+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]: dispatch 2020-06-27T05:46:01.389 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:01 smithi031 bash[18426]: audit 2020-06-27T05:46:00.664991+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]': finished 2020-06-27T05:46:01.390 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:01 smithi031 bash[18426]: audit 2020-06-27T05:46:00.665830+0000 mon.b (mon.2) 403 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T05:46:01.390 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:01 smithi031 bash[18426]: audit 2020-06-27T05:46:00.916140+0000 mon.b (mon.2) 404 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]: dispatch 2020-06-27T05:46:01.390 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:01 smithi031 bash[18426]: audit 2020-06-27T05:46:00.916668+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]: dispatch 2020-06-27T05:46:01.390 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:01 smithi031 bash[18426]: audit 2020-06-27T05:46:00.919791+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]': finished 2020-06-27T05:46:01.391 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:01 smithi031 bash[18426]: audit 2020-06-27T05:46:00.920415+0000 mon.b (mon.2) 405 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T05:46:01.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:01 smithi051 bash[18409]: cluster 2020-06-27T05:46:00.227812+0000 mgr.x (mgr.34109) 1999 : cluster [DBG] pgmap v2079: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:01.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:01 smithi051 bash[18409]: audit 2020-06-27T05:46:00.661712+0000 mon.b (mon.2) 402 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]: dispatch 2020-06-27T05:46:01.469 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:01 smithi051 bash[18409]: audit 2020-06-27T05:46:00.662278+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]: dispatch 2020-06-27T05:46:01.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:01 smithi051 bash[18409]: audit 2020-06-27T05:46:00.664991+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:15:52.904682\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]': finished 2020-06-27T05:46:01.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:01 smithi051 bash[18409]: audit 2020-06-27T05:46:00.665830+0000 mon.b (mon.2) 403 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T05:46:01.470 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:01 smithi051 bash[18409]: audit 2020-06-27T05:46:00.916140+0000 mon.b (mon.2) 404 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]: dispatch 2020-06-27T05:46:01.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:01 smithi051 bash[18409]: audit 2020-06-27T05:46:00.916668+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]: dispatch 2020-06-27T05:46:01.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:01 smithi051 bash[18409]: audit 2020-06-27T05:46:00.919791+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:15:53.354200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]': finished 2020-06-27T05:46:01.471 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:01 smithi051 bash[18409]: audit 2020-06-27T05:46:00.920415+0000 mon.b (mon.2) 405 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-06-27T05:46:03.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:03 smithi051 bash[18409]: cluster 2020-06-27T05:46:02.229378+0000 mgr.x (mgr.34109) 2000 : cluster [DBG] pgmap v2080: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:03.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:03 smithi031 bash[18426]: cluster 2020-06-27T05:46:02.229378+0000 mgr.x (mgr.34109) 2000 : cluster [DBG] pgmap v2080: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:03.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:03 smithi031 bash[22603]: cluster 2020-06-27T05:46:02.229378+0000 mgr.x (mgr.34109) 2000 : cluster [DBG] pgmap v2080: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:04.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:04 smithi051 bash[18409]: audit 2020-06-27T05:46:03.380740+0000 mon.b (mon.2) 406 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:46:04.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:04 smithi051 bash[18409]: audit 2020-06-27T05:46:03.622702+0000 mon.b (mon.2) 407 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]: dispatch 2020-06-27T05:46:04.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:04 smithi051 bash[18409]: audit 2020-06-27T05:46:03.623409+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]: dispatch 2020-06-27T05:46:04.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:04 smithi051 bash[18409]: audit 2020-06-27T05:46:03.625978+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]': finished 2020-06-27T05:46:04.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:04 smithi051 bash[18409]: audit 2020-06-27T05:46:03.683600+0000 mon.b (mon.2) 408 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:46:04.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:04 smithi051 bash[18409]: audit 2020-06-27T05:46:03.925369+0000 mon.b (mon.2) 409 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]: dispatch 2020-06-27T05:46:04.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:04 smithi051 bash[18409]: audit 2020-06-27T05:46:03.926105+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]: dispatch 2020-06-27T05:46:04.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:04 smithi051 bash[18409]: audit 2020-06-27T05:46:03.931090+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]': finished 2020-06-27T05:46:04.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:04 smithi051 bash[18409]: audit 2020-06-27T05:46:03.934107+0000 mon.b (mon.2) 410 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:46:04.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:04 smithi051 bash[18409]: audit 2020-06-27T05:46:03.935090+0000 mon.b (mon.2) 411 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:46:04.723 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:04 smithi051 bash[18409]: audit 2020-06-27T05:46:03.935986+0000 mon.b (mon.2) 412 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:46:04.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[18426]: audit 2020-06-27T05:46:03.380740+0000 mon.b (mon.2) 406 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:46:04.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[18426]: audit 2020-06-27T05:46:03.622702+0000 mon.b (mon.2) 407 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]: dispatch 2020-06-27T05:46:04.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[18426]: audit 2020-06-27T05:46:03.623409+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]: dispatch 2020-06-27T05:46:04.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[18426]: audit 2020-06-27T05:46:03.625978+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]': finished 2020-06-27T05:46:04.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[18426]: audit 2020-06-27T05:46:03.683600+0000 mon.b (mon.2) 408 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:46:04.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[18426]: audit 2020-06-27T05:46:03.925369+0000 mon.b (mon.2) 409 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]: dispatch 2020-06-27T05:46:04.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[18426]: audit 2020-06-27T05:46:03.926105+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]: dispatch 2020-06-27T05:46:04.727 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[18426]: audit 2020-06-27T05:46:03.931090+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]': finished 2020-06-27T05:46:04.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[18426]: audit 2020-06-27T05:46:03.934107+0000 mon.b (mon.2) 410 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:46:04.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[18426]: audit 2020-06-27T05:46:03.935090+0000 mon.b (mon.2) 411 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:46:04.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[18426]: audit 2020-06-27T05:46:03.935986+0000 mon.b (mon.2) 412 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:46:04.729 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[22603]: audit 2020-06-27T05:46:03.380740+0000 mon.b (mon.2) 406 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:46:04.729 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[22603]: audit 2020-06-27T05:46:03.622702+0000 mon.b (mon.2) 407 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]: dispatch 2020-06-27T05:46:04.729 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[22603]: audit 2020-06-27T05:46:03.623409+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]: dispatch 2020-06-27T05:46:04.730 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[22603]: audit 2020-06-27T05:46:03.625978+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:45:58.694820\"}"}]': finished 2020-06-27T05:46:04.730 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[22603]: audit 2020-06-27T05:46:03.683600+0000 mon.b (mon.2) 408 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:46:04.731 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[22603]: audit 2020-06-27T05:46:03.925369+0000 mon.b (mon.2) 409 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]: dispatch 2020-06-27T05:46:04.731 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[22603]: audit 2020-06-27T05:46:03.926105+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]: dispatch 2020-06-27T05:46:04.731 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[22603]: audit 2020-06-27T05:46:03.931090+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:45:58.689061\"}"}]': finished 2020-06-27T05:46:04.731 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[22603]: audit 2020-06-27T05:46:03.934107+0000 mon.b (mon.2) 410 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:46:04.732 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[22603]: audit 2020-06-27T05:46:03.935090+0000 mon.b (mon.2) 411 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:46:04.732 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:04 smithi031 bash[22603]: audit 2020-06-27T05:46:03.935986+0000 mon.b (mon.2) 412 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:46:05.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:05 smithi051 bash[18409]: audit 2020-06-27T05:46:03.934390+0000 mgr.x (mgr.34109) 2001 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:46:05.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:05 smithi051 bash[18409]: audit 2020-06-27T05:46:03.935388+0000 mgr.x (mgr.34109) 2002 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:46:05.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:05 smithi051 bash[18409]: audit 2020-06-27T05:46:03.936219+0000 mgr.x (mgr.34109) 2003 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:46:05.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:05 smithi051 bash[18409]: cluster 2020-06-27T05:46:04.230855+0000 mgr.x (mgr.34109) 2004 : cluster [DBG] pgmap v2081: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:05 smithi031 bash[18426]: audit 2020-06-27T05:46:03.934390+0000 mgr.x (mgr.34109) 2001 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:46:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:05 smithi031 bash[18426]: audit 2020-06-27T05:46:03.935388+0000 mgr.x (mgr.34109) 2002 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:46:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:05 smithi031 bash[18426]: audit 2020-06-27T05:46:03.936219+0000 mgr.x (mgr.34109) 2003 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:46:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:05 smithi031 bash[18426]: cluster 2020-06-27T05:46:04.230855+0000 mgr.x (mgr.34109) 2004 : cluster [DBG] pgmap v2081: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:05.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:05 smithi031 bash[22603]: audit 2020-06-27T05:46:03.934390+0000 mgr.x (mgr.34109) 2001 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:46:05.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:05 smithi031 bash[22603]: audit 2020-06-27T05:46:03.935388+0000 mgr.x (mgr.34109) 2002 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:46:05.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:05 smithi031 bash[22603]: audit 2020-06-27T05:46:03.936219+0000 mgr.x (mgr.34109) 2003 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:46:05.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:05 smithi031 bash[22603]: cluster 2020-06-27T05:46:04.230855+0000 mgr.x (mgr.34109) 2004 : cluster [DBG] pgmap v2081: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:07.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:07 smithi051 bash[18409]: cluster 2020-06-27T05:46:06.232502+0000 mgr.x (mgr.34109) 2005 : cluster [DBG] pgmap v2082: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:07.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:07 smithi031 bash[18426]: cluster 2020-06-27T05:46:06.232502+0000 mgr.x (mgr.34109) 2005 : cluster [DBG] pgmap v2082: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:07.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:07 smithi031 bash[22603]: cluster 2020-06-27T05:46:06.232502+0000 mgr.x (mgr.34109) 2005 : cluster [DBG] pgmap v2082: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:09 smithi051 bash[18409]: cluster 2020-06-27T05:46:08.234181+0000 mgr.x (mgr.34109) 2006 : cluster [DBG] pgmap v2083: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:09.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:09 smithi031 bash[18426]: cluster 2020-06-27T05:46:08.234181+0000 mgr.x (mgr.34109) 2006 : cluster [DBG] pgmap v2083: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:09.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:09 smithi031 bash[22603]: cluster 2020-06-27T05:46:08.234181+0000 mgr.x (mgr.34109) 2006 : cluster [DBG] pgmap v2083: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:11.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:11 smithi051 bash[18409]: cluster 2020-06-27T05:46:10.235856+0000 mgr.x (mgr.34109) 2007 : cluster [DBG] pgmap v2084: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:11 smithi031 bash[18426]: cluster 2020-06-27T05:46:10.235856+0000 mgr.x (mgr.34109) 2007 : cluster [DBG] pgmap v2084: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:11.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:11 smithi031 bash[22603]: cluster 2020-06-27T05:46:10.235856+0000 mgr.x (mgr.34109) 2007 : cluster [DBG] pgmap v2084: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:13.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:13 smithi051 bash[18409]: cluster 2020-06-27T05:46:12.237447+0000 mgr.x (mgr.34109) 2008 : cluster [DBG] pgmap v2085: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:13.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:13 smithi031 bash[18426]: cluster 2020-06-27T05:46:12.237447+0000 mgr.x (mgr.34109) 2008 : cluster [DBG] pgmap v2085: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:13.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:13 smithi031 bash[22603]: cluster 2020-06-27T05:46:12.237447+0000 mgr.x (mgr.34109) 2008 : cluster [DBG] pgmap v2085: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:15.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:15 smithi051 bash[18409]: cluster 2020-06-27T05:46:14.239072+0000 mgr.x (mgr.34109) 2009 : cluster [DBG] pgmap v2086: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:15.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:15 smithi031 bash[18426]: cluster 2020-06-27T05:46:14.239072+0000 mgr.x (mgr.34109) 2009 : cluster [DBG] pgmap v2086: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:15.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:15 smithi031 bash[22603]: cluster 2020-06-27T05:46:14.239072+0000 mgr.x (mgr.34109) 2009 : cluster [DBG] pgmap v2086: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:17 smithi051 bash[18409]: cluster 2020-06-27T05:46:16.240670+0000 mgr.x (mgr.34109) 2010 : cluster [DBG] pgmap v2087: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:17.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:17 smithi031 bash[18426]: cluster 2020-06-27T05:46:16.240670+0000 mgr.x (mgr.34109) 2010 : cluster [DBG] pgmap v2087: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:17.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:17 smithi031 bash[22603]: cluster 2020-06-27T05:46:16.240670+0000 mgr.x (mgr.34109) 2010 : cluster [DBG] pgmap v2087: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:19.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:19 smithi051 bash[18409]: cluster 2020-06-27T05:46:18.242154+0000 mgr.x (mgr.34109) 2011 : cluster [DBG] pgmap v2088: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:19.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:19 smithi031 bash[18426]: cluster 2020-06-27T05:46:18.242154+0000 mgr.x (mgr.34109) 2011 : cluster [DBG] pgmap v2088: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:19.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:19 smithi031 bash[22603]: cluster 2020-06-27T05:46:18.242154+0000 mgr.x (mgr.34109) 2011 : cluster [DBG] pgmap v2088: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:21.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:21 smithi051 bash[18409]: cluster 2020-06-27T05:46:20.243738+0000 mgr.x (mgr.34109) 2012 : cluster [DBG] pgmap v2089: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:21.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:21 smithi031 bash[18426]: cluster 2020-06-27T05:46:20.243738+0000 mgr.x (mgr.34109) 2012 : cluster [DBG] pgmap v2089: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:21.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:21 smithi031 bash[22603]: cluster 2020-06-27T05:46:20.243738+0000 mgr.x (mgr.34109) 2012 : cluster [DBG] pgmap v2089: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:23.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:23 smithi051 bash[18409]: cluster 2020-06-27T05:46:22.245346+0000 mgr.x (mgr.34109) 2013 : cluster [DBG] pgmap v2090: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:23.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:23 smithi031 bash[18426]: cluster 2020-06-27T05:46:22.245346+0000 mgr.x (mgr.34109) 2013 : cluster [DBG] pgmap v2090: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:23.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:23 smithi031 bash[22603]: cluster 2020-06-27T05:46:22.245346+0000 mgr.x (mgr.34109) 2013 : cluster [DBG] pgmap v2090: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:25.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:25 smithi051 bash[18409]: cluster 2020-06-27T05:46:24.247083+0000 mgr.x (mgr.34109) 2014 : cluster [DBG] pgmap v2091: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:25.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:25 smithi031 bash[18426]: cluster 2020-06-27T05:46:24.247083+0000 mgr.x (mgr.34109) 2014 : cluster [DBG] pgmap v2091: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:25.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:25 smithi031 bash[22603]: cluster 2020-06-27T05:46:24.247083+0000 mgr.x (mgr.34109) 2014 : cluster [DBG] pgmap v2091: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:27.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:27 smithi051 bash[18409]: cluster 2020-06-27T05:46:26.248634+0000 mgr.x (mgr.34109) 2015 : cluster [DBG] pgmap v2092: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:27.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:27 smithi031 bash[18426]: cluster 2020-06-27T05:46:26.248634+0000 mgr.x (mgr.34109) 2015 : cluster [DBG] pgmap v2092: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:27.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:27 smithi031 bash[22603]: cluster 2020-06-27T05:46:26.248634+0000 mgr.x (mgr.34109) 2015 : cluster [DBG] pgmap v2092: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:29.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:29 smithi051 bash[18409]: cluster 2020-06-27T05:46:28.250310+0000 mgr.x (mgr.34109) 2016 : cluster [DBG] pgmap v2093: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:29.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:29 smithi031 bash[22603]: cluster 2020-06-27T05:46:28.250310+0000 mgr.x (mgr.34109) 2016 : cluster [DBG] pgmap v2093: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:29.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:29 smithi031 bash[18426]: cluster 2020-06-27T05:46:28.250310+0000 mgr.x (mgr.34109) 2016 : cluster [DBG] pgmap v2093: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:31.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:31 smithi051 bash[18409]: cluster 2020-06-27T05:46:30.251919+0000 mgr.x (mgr.34109) 2017 : cluster [DBG] pgmap v2094: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:31.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:31 smithi031 bash[18426]: cluster 2020-06-27T05:46:30.251919+0000 mgr.x (mgr.34109) 2017 : cluster [DBG] pgmap v2094: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:31.474 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:31 smithi031 bash[22603]: cluster 2020-06-27T05:46:30.251919+0000 mgr.x (mgr.34109) 2017 : cluster [DBG] pgmap v2094: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:33 smithi051 bash[18409]: cluster 2020-06-27T05:46:32.253633+0000 mgr.x (mgr.34109) 2018 : cluster [DBG] pgmap v2095: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:33.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:33 smithi031 bash[18426]: cluster 2020-06-27T05:46:32.253633+0000 mgr.x (mgr.34109) 2018 : cluster [DBG] pgmap v2095: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:33.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:33 smithi031 bash[22603]: cluster 2020-06-27T05:46:32.253633+0000 mgr.x (mgr.34109) 2018 : cluster [DBG] pgmap v2095: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:35.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:35 smithi051 bash[18409]: cluster 2020-06-27T05:46:34.255216+0000 mgr.x (mgr.34109) 2019 : cluster [DBG] pgmap v2096: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:35.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:35 smithi031 bash[18426]: cluster 2020-06-27T05:46:34.255216+0000 mgr.x (mgr.34109) 2019 : cluster [DBG] pgmap v2096: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:35.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:35 smithi031 bash[22603]: cluster 2020-06-27T05:46:34.255216+0000 mgr.x (mgr.34109) 2019 : cluster [DBG] pgmap v2096: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:37.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:37 smithi051 bash[18409]: cluster 2020-06-27T05:46:36.256840+0000 mgr.x (mgr.34109) 2020 : cluster [DBG] pgmap v2097: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:37.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:37 smithi031 bash[18426]: cluster 2020-06-27T05:46:36.256840+0000 mgr.x (mgr.34109) 2020 : cluster [DBG] pgmap v2097: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:37.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:37 smithi031 bash[22603]: cluster 2020-06-27T05:46:36.256840+0000 mgr.x (mgr.34109) 2020 : cluster [DBG] pgmap v2097: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:39.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:39 smithi051 bash[18409]: cluster 2020-06-27T05:46:38.258471+0000 mgr.x (mgr.34109) 2021 : cluster [DBG] pgmap v2098: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:39 smithi031 bash[18426]: cluster 2020-06-27T05:46:38.258471+0000 mgr.x (mgr.34109) 2021 : cluster [DBG] pgmap v2098: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:39.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:39 smithi031 bash[22603]: cluster 2020-06-27T05:46:38.258471+0000 mgr.x (mgr.34109) 2021 : cluster [DBG] pgmap v2098: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:41.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:41 smithi031 bash[22603]: cluster 2020-06-27T05:46:40.260043+0000 mgr.x (mgr.34109) 2022 : cluster [DBG] pgmap v2099: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:41.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:41 smithi031 bash[18426]: cluster 2020-06-27T05:46:40.260043+0000 mgr.x (mgr.34109) 2022 : cluster [DBG] pgmap v2099: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:41 smithi051 bash[18409]: cluster 2020-06-27T05:46:40.260043+0000 mgr.x (mgr.34109) 2022 : cluster [DBG] pgmap v2099: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:43 smithi051 bash[18409]: cluster 2020-06-27T05:46:42.261572+0000 mgr.x (mgr.34109) 2023 : cluster [DBG] pgmap v2100: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:43 smithi031 bash[22603]: cluster 2020-06-27T05:46:42.261572+0000 mgr.x (mgr.34109) 2023 : cluster [DBG] pgmap v2100: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:43.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:43 smithi031 bash[18426]: cluster 2020-06-27T05:46:42.261572+0000 mgr.x (mgr.34109) 2023 : cluster [DBG] pgmap v2100: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:45.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:45 smithi051 bash[18409]: cluster 2020-06-27T05:46:44.263150+0000 mgr.x (mgr.34109) 2024 : cluster [DBG] pgmap v2101: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:45.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:45 smithi031 bash[22603]: cluster 2020-06-27T05:46:44.263150+0000 mgr.x (mgr.34109) 2024 : cluster [DBG] pgmap v2101: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:45.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:45 smithi031 bash[18426]: cluster 2020-06-27T05:46:44.263150+0000 mgr.x (mgr.34109) 2024 : cluster [DBG] pgmap v2101: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:47.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:47 smithi051 bash[18409]: cluster 2020-06-27T05:46:46.264718+0000 mgr.x (mgr.34109) 2025 : cluster [DBG] pgmap v2102: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:47.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:47 smithi031 bash[22603]: cluster 2020-06-27T05:46:46.264718+0000 mgr.x (mgr.34109) 2025 : cluster [DBG] pgmap v2102: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:47.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:47 smithi031 bash[18426]: cluster 2020-06-27T05:46:46.264718+0000 mgr.x (mgr.34109) 2025 : cluster [DBG] pgmap v2102: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:49.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:49 smithi051 bash[18409]: cluster 2020-06-27T05:46:48.266378+0000 mgr.x (mgr.34109) 2026 : cluster [DBG] pgmap v2103: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:49.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:49 smithi031 bash[18426]: cluster 2020-06-27T05:46:48.266378+0000 mgr.x (mgr.34109) 2026 : cluster [DBG] pgmap v2103: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:49.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:49 smithi031 bash[22603]: cluster 2020-06-27T05:46:48.266378+0000 mgr.x (mgr.34109) 2026 : cluster [DBG] pgmap v2103: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:51.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:51 smithi031 bash[18426]: cluster 2020-06-27T05:46:50.268043+0000 mgr.x (mgr.34109) 2027 : cluster [DBG] pgmap v2104: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:51.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:51 smithi031 bash[22603]: cluster 2020-06-27T05:46:50.268043+0000 mgr.x (mgr.34109) 2027 : cluster [DBG] pgmap v2104: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:51.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:51 smithi051 bash[18409]: cluster 2020-06-27T05:46:50.268043+0000 mgr.x (mgr.34109) 2027 : cluster [DBG] pgmap v2104: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:53.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:53 smithi051 bash[18409]: cluster 2020-06-27T05:46:52.269474+0000 mgr.x (mgr.34109) 2028 : cluster [DBG] pgmap v2105: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:53.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:53 smithi031 bash[18426]: cluster 2020-06-27T05:46:52.269474+0000 mgr.x (mgr.34109) 2028 : cluster [DBG] pgmap v2105: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:53.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:53 smithi031 bash[22603]: cluster 2020-06-27T05:46:52.269474+0000 mgr.x (mgr.34109) 2028 : cluster [DBG] pgmap v2105: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:55.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:55 smithi051 bash[18409]: cluster 2020-06-27T05:46:54.271118+0000 mgr.x (mgr.34109) 2029 : cluster [DBG] pgmap v2106: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:55.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:55 smithi031 bash[18426]: cluster 2020-06-27T05:46:54.271118+0000 mgr.x (mgr.34109) 2029 : cluster [DBG] pgmap v2106: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:55.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:55 smithi031 bash[22603]: cluster 2020-06-27T05:46:54.271118+0000 mgr.x (mgr.34109) 2029 : cluster [DBG] pgmap v2106: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:57.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:57 smithi051 bash[18409]: cluster 2020-06-27T05:46:56.272821+0000 mgr.x (mgr.34109) 2030 : cluster [DBG] pgmap v2107: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:57.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:57 smithi031 bash[18426]: cluster 2020-06-27T05:46:56.272821+0000 mgr.x (mgr.34109) 2030 : cluster [DBG] pgmap v2107: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:57.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:57 smithi031 bash[22603]: cluster 2020-06-27T05:46:56.272821+0000 mgr.x (mgr.34109) 2030 : cluster [DBG] pgmap v2107: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:59.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:46:59 smithi051 bash[18409]: cluster 2020-06-27T05:46:58.274508+0000 mgr.x (mgr.34109) 2031 : cluster [DBG] pgmap v2108: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:59.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:46:59 smithi031 bash[18426]: cluster 2020-06-27T05:46:58.274508+0000 mgr.x (mgr.34109) 2031 : cluster [DBG] pgmap v2108: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:46:59.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:46:59 smithi031 bash[22603]: cluster 2020-06-27T05:46:58.274508+0000 mgr.x (mgr.34109) 2031 : cluster [DBG] pgmap v2108: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:01.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:01 smithi031 bash[18426]: cluster 2020-06-27T05:47:00.276069+0000 mgr.x (mgr.34109) 2032 : cluster [DBG] pgmap v2109: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:01.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:01 smithi031 bash[22603]: cluster 2020-06-27T05:47:00.276069+0000 mgr.x (mgr.34109) 2032 : cluster [DBG] pgmap v2109: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:01.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:01 smithi051 bash[18409]: cluster 2020-06-27T05:47:00.276069+0000 mgr.x (mgr.34109) 2032 : cluster [DBG] pgmap v2109: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:03.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:03 smithi051 bash[18409]: cluster 2020-06-27T05:47:02.277673+0000 mgr.x (mgr.34109) 2033 : cluster [DBG] pgmap v2110: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:03.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:03 smithi031 bash[18426]: cluster 2020-06-27T05:47:02.277673+0000 mgr.x (mgr.34109) 2033 : cluster [DBG] pgmap v2110: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:03.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:03 smithi031 bash[22603]: cluster 2020-06-27T05:47:02.277673+0000 mgr.x (mgr.34109) 2033 : cluster [DBG] pgmap v2110: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:05.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:05 smithi051 bash[18409]: cluster 2020-06-27T05:47:04.279360+0000 mgr.x (mgr.34109) 2034 : cluster [DBG] pgmap v2111: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:05 smithi031 bash[18426]: cluster 2020-06-27T05:47:04.279360+0000 mgr.x (mgr.34109) 2034 : cluster [DBG] pgmap v2111: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:05.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:05 smithi031 bash[22603]: cluster 2020-06-27T05:47:04.279360+0000 mgr.x (mgr.34109) 2034 : cluster [DBG] pgmap v2111: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:07.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:07 smithi051 bash[18409]: cluster 2020-06-27T05:47:06.281083+0000 mgr.x (mgr.34109) 2035 : cluster [DBG] pgmap v2112: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:07.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:07 smithi031 bash[18426]: cluster 2020-06-27T05:47:06.281083+0000 mgr.x (mgr.34109) 2035 : cluster [DBG] pgmap v2112: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:07.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:07 smithi031 bash[22603]: cluster 2020-06-27T05:47:06.281083+0000 mgr.x (mgr.34109) 2035 : cluster [DBG] pgmap v2112: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:09 smithi051 bash[18409]: cluster 2020-06-27T05:47:08.282769+0000 mgr.x (mgr.34109) 2036 : cluster [DBG] pgmap v2113: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:09.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:09 smithi031 bash[18426]: cluster 2020-06-27T05:47:08.282769+0000 mgr.x (mgr.34109) 2036 : cluster [DBG] pgmap v2113: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:09.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:09 smithi031 bash[22603]: cluster 2020-06-27T05:47:08.282769+0000 mgr.x (mgr.34109) 2036 : cluster [DBG] pgmap v2113: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:11.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:11 smithi031 bash[18426]: cluster 2020-06-27T05:47:10.284477+0000 mgr.x (mgr.34109) 2037 : cluster [DBG] pgmap v2114: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:11.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:11 smithi031 bash[22603]: cluster 2020-06-27T05:47:10.284477+0000 mgr.x (mgr.34109) 2037 : cluster [DBG] pgmap v2114: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:11.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:11 smithi051 bash[18409]: cluster 2020-06-27T05:47:10.284477+0000 mgr.x (mgr.34109) 2037 : cluster [DBG] pgmap v2114: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:13.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:13 smithi051 bash[18409]: cluster 2020-06-27T05:47:12.286029+0000 mgr.x (mgr.34109) 2038 : cluster [DBG] pgmap v2115: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:13.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:13 smithi031 bash[18426]: cluster 2020-06-27T05:47:12.286029+0000 mgr.x (mgr.34109) 2038 : cluster [DBG] pgmap v2115: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:13.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:13 smithi031 bash[22603]: cluster 2020-06-27T05:47:12.286029+0000 mgr.x (mgr.34109) 2038 : cluster [DBG] pgmap v2115: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:15.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:15 smithi051 bash[18409]: cluster 2020-06-27T05:47:14.287614+0000 mgr.x (mgr.34109) 2039 : cluster [DBG] pgmap v2116: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:15.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:15 smithi031 bash[18426]: cluster 2020-06-27T05:47:14.287614+0000 mgr.x (mgr.34109) 2039 : cluster [DBG] pgmap v2116: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:15.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:15 smithi031 bash[22603]: cluster 2020-06-27T05:47:14.287614+0000 mgr.x (mgr.34109) 2039 : cluster [DBG] pgmap v2116: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:17 smithi051 bash[18409]: cluster 2020-06-27T05:47:16.289220+0000 mgr.x (mgr.34109) 2040 : cluster [DBG] pgmap v2117: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:17.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:17 smithi031 bash[18426]: cluster 2020-06-27T05:47:16.289220+0000 mgr.x (mgr.34109) 2040 : cluster [DBG] pgmap v2117: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:17.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:17 smithi031 bash[22603]: cluster 2020-06-27T05:47:16.289220+0000 mgr.x (mgr.34109) 2040 : cluster [DBG] pgmap v2117: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:19.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:19 smithi051 bash[18409]: cluster 2020-06-27T05:47:18.290832+0000 mgr.x (mgr.34109) 2041 : cluster [DBG] pgmap v2118: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:19.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:19 smithi031 bash[18426]: cluster 2020-06-27T05:47:18.290832+0000 mgr.x (mgr.34109) 2041 : cluster [DBG] pgmap v2118: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:19.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:19 smithi031 bash[22603]: cluster 2020-06-27T05:47:18.290832+0000 mgr.x (mgr.34109) 2041 : cluster [DBG] pgmap v2118: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:21.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:21 smithi031 bash[18426]: cluster 2020-06-27T05:47:20.292430+0000 mgr.x (mgr.34109) 2042 : cluster [DBG] pgmap v2119: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:21.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:21 smithi031 bash[22603]: cluster 2020-06-27T05:47:20.292430+0000 mgr.x (mgr.34109) 2042 : cluster [DBG] pgmap v2119: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:21.717 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:21 smithi051 bash[18409]: cluster 2020-06-27T05:47:20.292430+0000 mgr.x (mgr.34109) 2042 : cluster [DBG] pgmap v2119: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:23.717 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:23 smithi051 bash[18409]: cluster 2020-06-27T05:47:22.294140+0000 mgr.x (mgr.34109) 2043 : cluster [DBG] pgmap v2120: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:23.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:23 smithi031 bash[18426]: cluster 2020-06-27T05:47:22.294140+0000 mgr.x (mgr.34109) 2043 : cluster [DBG] pgmap v2120: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:23.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:23 smithi031 bash[22603]: cluster 2020-06-27T05:47:22.294140+0000 mgr.x (mgr.34109) 2043 : cluster [DBG] pgmap v2120: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:25.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:25 smithi051 bash[18409]: cluster 2020-06-27T05:47:24.295816+0000 mgr.x (mgr.34109) 2044 : cluster [DBG] pgmap v2121: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:25.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:25 smithi031 bash[18426]: cluster 2020-06-27T05:47:24.295816+0000 mgr.x (mgr.34109) 2044 : cluster [DBG] pgmap v2121: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:25.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:25 smithi031 bash[22603]: cluster 2020-06-27T05:47:24.295816+0000 mgr.x (mgr.34109) 2044 : cluster [DBG] pgmap v2121: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:27.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:27 smithi051 bash[18409]: cluster 2020-06-27T05:47:26.297430+0000 mgr.x (mgr.34109) 2045 : cluster [DBG] pgmap v2122: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:27.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:27 smithi031 bash[18426]: cluster 2020-06-27T05:47:26.297430+0000 mgr.x (mgr.34109) 2045 : cluster [DBG] pgmap v2122: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:27.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:27 smithi031 bash[22603]: cluster 2020-06-27T05:47:26.297430+0000 mgr.x (mgr.34109) 2045 : cluster [DBG] pgmap v2122: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:29.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:29 smithi051 bash[18409]: cluster 2020-06-27T05:47:28.298993+0000 mgr.x (mgr.34109) 2046 : cluster [DBG] pgmap v2123: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:29.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:29 smithi031 bash[18426]: cluster 2020-06-27T05:47:28.298993+0000 mgr.x (mgr.34109) 2046 : cluster [DBG] pgmap v2123: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:29.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:29 smithi031 bash[22603]: cluster 2020-06-27T05:47:28.298993+0000 mgr.x (mgr.34109) 2046 : cluster [DBG] pgmap v2123: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:31.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:31 smithi031 bash[18426]: cluster 2020-06-27T05:47:30.300600+0000 mgr.x (mgr.34109) 2047 : cluster [DBG] pgmap v2124: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:31.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:31 smithi031 bash[22603]: cluster 2020-06-27T05:47:30.300600+0000 mgr.x (mgr.34109) 2047 : cluster [DBG] pgmap v2124: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:31.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:31 smithi051 bash[18409]: cluster 2020-06-27T05:47:30.300600+0000 mgr.x (mgr.34109) 2047 : cluster [DBG] pgmap v2124: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:33 smithi051 bash[18409]: cluster 2020-06-27T05:47:32.302321+0000 mgr.x (mgr.34109) 2048 : cluster [DBG] pgmap v2125: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:33.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:33 smithi031 bash[18426]: cluster 2020-06-27T05:47:32.302321+0000 mgr.x (mgr.34109) 2048 : cluster [DBG] pgmap v2125: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:33.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:33 smithi031 bash[22603]: cluster 2020-06-27T05:47:32.302321+0000 mgr.x (mgr.34109) 2048 : cluster [DBG] pgmap v2125: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:35.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:35 smithi051 bash[18409]: cluster 2020-06-27T05:47:34.303917+0000 mgr.x (mgr.34109) 2049 : cluster [DBG] pgmap v2126: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:35.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:35 smithi031 bash[18426]: cluster 2020-06-27T05:47:34.303917+0000 mgr.x (mgr.34109) 2049 : cluster [DBG] pgmap v2126: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:35.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:35 smithi031 bash[22603]: cluster 2020-06-27T05:47:34.303917+0000 mgr.x (mgr.34109) 2049 : cluster [DBG] pgmap v2126: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:37.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:37 smithi051 bash[18409]: cluster 2020-06-27T05:47:36.305611+0000 mgr.x (mgr.34109) 2050 : cluster [DBG] pgmap v2127: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:37.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:37 smithi031 bash[18426]: cluster 2020-06-27T05:47:36.305611+0000 mgr.x (mgr.34109) 2050 : cluster [DBG] pgmap v2127: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:37.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:37 smithi031 bash[22603]: cluster 2020-06-27T05:47:36.305611+0000 mgr.x (mgr.34109) 2050 : cluster [DBG] pgmap v2127: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:39.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:39 smithi051 bash[18409]: cluster 2020-06-27T05:47:38.307241+0000 mgr.x (mgr.34109) 2051 : cluster [DBG] pgmap v2128: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:39 smithi031 bash[18426]: cluster 2020-06-27T05:47:38.307241+0000 mgr.x (mgr.34109) 2051 : cluster [DBG] pgmap v2128: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:39.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:39 smithi031 bash[22603]: cluster 2020-06-27T05:47:38.307241+0000 mgr.x (mgr.34109) 2051 : cluster [DBG] pgmap v2128: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:41 smithi051 bash[18409]: cluster 2020-06-27T05:47:40.308937+0000 mgr.x (mgr.34109) 2052 : cluster [DBG] pgmap v2129: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:41 smithi031 bash[18426]: cluster 2020-06-27T05:47:40.308937+0000 mgr.x (mgr.34109) 2052 : cluster [DBG] pgmap v2129: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:41.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:41 smithi031 bash[22603]: cluster 2020-06-27T05:47:40.308937+0000 mgr.x (mgr.34109) 2052 : cluster [DBG] pgmap v2129: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:43.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:43 smithi051 bash[18409]: cluster 2020-06-27T05:47:42.310600+0000 mgr.x (mgr.34109) 2053 : cluster [DBG] pgmap v2130: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:43.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:43 smithi031 bash[18426]: cluster 2020-06-27T05:47:42.310600+0000 mgr.x (mgr.34109) 2053 : cluster [DBG] pgmap v2130: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:43 smithi031 bash[22603]: cluster 2020-06-27T05:47:42.310600+0000 mgr.x (mgr.34109) 2053 : cluster [DBG] pgmap v2130: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:45.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:45 smithi051 bash[18409]: cluster 2020-06-27T05:47:44.312311+0000 mgr.x (mgr.34109) 2054 : cluster [DBG] pgmap v2131: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:45.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:45 smithi031 bash[22603]: cluster 2020-06-27T05:47:44.312311+0000 mgr.x (mgr.34109) 2054 : cluster [DBG] pgmap v2131: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:45.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:45 smithi031 bash[18426]: cluster 2020-06-27T05:47:44.312311+0000 mgr.x (mgr.34109) 2054 : cluster [DBG] pgmap v2131: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:47.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:47 smithi051 bash[18409]: cluster 2020-06-27T05:47:46.314032+0000 mgr.x (mgr.34109) 2055 : cluster [DBG] pgmap v2132: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:47.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:47 smithi031 bash[22603]: cluster 2020-06-27T05:47:46.314032+0000 mgr.x (mgr.34109) 2055 : cluster [DBG] pgmap v2132: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:47.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:47 smithi031 bash[18426]: cluster 2020-06-27T05:47:46.314032+0000 mgr.x (mgr.34109) 2055 : cluster [DBG] pgmap v2132: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:49.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:49 smithi051 bash[18409]: cluster 2020-06-27T05:47:48.315707+0000 mgr.x (mgr.34109) 2056 : cluster [DBG] pgmap v2133: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:49.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:49 smithi031 bash[22603]: cluster 2020-06-27T05:47:48.315707+0000 mgr.x (mgr.34109) 2056 : cluster [DBG] pgmap v2133: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:49.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:49 smithi031 bash[18426]: cluster 2020-06-27T05:47:48.315707+0000 mgr.x (mgr.34109) 2056 : cluster [DBG] pgmap v2133: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:51.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:51 smithi051 bash[18409]: cluster 2020-06-27T05:47:50.317408+0000 mgr.x (mgr.34109) 2057 : cluster [DBG] pgmap v2134: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:51.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:51 smithi031 bash[18426]: cluster 2020-06-27T05:47:50.317408+0000 mgr.x (mgr.34109) 2057 : cluster [DBG] pgmap v2134: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:51.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:51 smithi031 bash[22603]: cluster 2020-06-27T05:47:50.317408+0000 mgr.x (mgr.34109) 2057 : cluster [DBG] pgmap v2134: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:53.717 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:53 smithi051 bash[18409]: cluster 2020-06-27T05:47:52.319041+0000 mgr.x (mgr.34109) 2058 : cluster [DBG] pgmap v2135: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:53.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:53 smithi031 bash[18426]: cluster 2020-06-27T05:47:52.319041+0000 mgr.x (mgr.34109) 2058 : cluster [DBG] pgmap v2135: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:53.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:53 smithi031 bash[22603]: cluster 2020-06-27T05:47:52.319041+0000 mgr.x (mgr.34109) 2058 : cluster [DBG] pgmap v2135: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:55.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:55 smithi051 bash[18409]: cluster 2020-06-27T05:47:54.320778+0000 mgr.x (mgr.34109) 2059 : cluster [DBG] pgmap v2136: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:55.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:55 smithi031 bash[18426]: cluster 2020-06-27T05:47:54.320778+0000 mgr.x (mgr.34109) 2059 : cluster [DBG] pgmap v2136: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:55.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:55 smithi031 bash[22603]: cluster 2020-06-27T05:47:54.320778+0000 mgr.x (mgr.34109) 2059 : cluster [DBG] pgmap v2136: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:57.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:57 smithi051 bash[18409]: cluster 2020-06-27T05:47:56.322434+0000 mgr.x (mgr.34109) 2060 : cluster [DBG] pgmap v2137: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:57.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:57 smithi031 bash[18426]: cluster 2020-06-27T05:47:56.322434+0000 mgr.x (mgr.34109) 2060 : cluster [DBG] pgmap v2137: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:57.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:57 smithi031 bash[22603]: cluster 2020-06-27T05:47:56.322434+0000 mgr.x (mgr.34109) 2060 : cluster [DBG] pgmap v2137: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:59.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:47:59 smithi051 bash[18409]: cluster 2020-06-27T05:47:58.324127+0000 mgr.x (mgr.34109) 2061 : cluster [DBG] pgmap v2138: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:59.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:47:59 smithi031 bash[18426]: cluster 2020-06-27T05:47:58.324127+0000 mgr.x (mgr.34109) 2061 : cluster [DBG] pgmap v2138: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:47:59.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:47:59 smithi031 bash[22603]: cluster 2020-06-27T05:47:58.324127+0000 mgr.x (mgr.34109) 2061 : cluster [DBG] pgmap v2138: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:01.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:01 smithi051 bash[18409]: cluster 2020-06-27T05:48:00.325749+0000 mgr.x (mgr.34109) 2062 : cluster [DBG] pgmap v2139: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:01.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:01 smithi031 bash[18426]: cluster 2020-06-27T05:48:00.325749+0000 mgr.x (mgr.34109) 2062 : cluster [DBG] pgmap v2139: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:01.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:01 smithi031 bash[22603]: cluster 2020-06-27T05:48:00.325749+0000 mgr.x (mgr.34109) 2062 : cluster [DBG] pgmap v2139: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:03.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:03 smithi051 bash[18409]: cluster 2020-06-27T05:48:02.327413+0000 mgr.x (mgr.34109) 2063 : cluster [DBG] pgmap v2140: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:03.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:03 smithi031 bash[18426]: cluster 2020-06-27T05:48:02.327413+0000 mgr.x (mgr.34109) 2063 : cluster [DBG] pgmap v2140: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:03.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:03 smithi031 bash[22603]: cluster 2020-06-27T05:48:02.327413+0000 mgr.x (mgr.34109) 2063 : cluster [DBG] pgmap v2140: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:05.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:05 smithi051 bash[18409]: cluster 2020-06-27T05:48:04.329150+0000 mgr.x (mgr.34109) 2064 : cluster [DBG] pgmap v2141: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:05 smithi031 bash[18426]: cluster 2020-06-27T05:48:04.329150+0000 mgr.x (mgr.34109) 2064 : cluster [DBG] pgmap v2141: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:05.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:05 smithi031 bash[22603]: cluster 2020-06-27T05:48:04.329150+0000 mgr.x (mgr.34109) 2064 : cluster [DBG] pgmap v2141: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:07.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:07 smithi051 bash[18409]: cluster 2020-06-27T05:48:06.330735+0000 mgr.x (mgr.34109) 2065 : cluster [DBG] pgmap v2142: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:07.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:07 smithi031 bash[18426]: cluster 2020-06-27T05:48:06.330735+0000 mgr.x (mgr.34109) 2065 : cluster [DBG] pgmap v2142: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:07.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:07 smithi031 bash[22603]: cluster 2020-06-27T05:48:06.330735+0000 mgr.x (mgr.34109) 2065 : cluster [DBG] pgmap v2142: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:09 smithi051 bash[18409]: cluster 2020-06-27T05:48:08.332303+0000 mgr.x (mgr.34109) 2066 : cluster [DBG] pgmap v2143: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:09.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:09 smithi031 bash[18426]: cluster 2020-06-27T05:48:08.332303+0000 mgr.x (mgr.34109) 2066 : cluster [DBG] pgmap v2143: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:09.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:09 smithi031 bash[22603]: cluster 2020-06-27T05:48:08.332303+0000 mgr.x (mgr.34109) 2066 : cluster [DBG] pgmap v2143: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:11.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:11 smithi051 bash[18409]: cluster 2020-06-27T05:48:10.333948+0000 mgr.x (mgr.34109) 2067 : cluster [DBG] pgmap v2144: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:11.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:11 smithi031 bash[18426]: cluster 2020-06-27T05:48:10.333948+0000 mgr.x (mgr.34109) 2067 : cluster [DBG] pgmap v2144: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:11.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:11 smithi031 bash[22603]: cluster 2020-06-27T05:48:10.333948+0000 mgr.x (mgr.34109) 2067 : cluster [DBG] pgmap v2144: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:13.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:13 smithi051 bash[18409]: cluster 2020-06-27T05:48:12.335590+0000 mgr.x (mgr.34109) 2068 : cluster [DBG] pgmap v2145: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:13.728 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:13 smithi031 bash[18426]: cluster 2020-06-27T05:48:12.335590+0000 mgr.x (mgr.34109) 2068 : cluster [DBG] pgmap v2145: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:13.729 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:13 smithi031 bash[22603]: cluster 2020-06-27T05:48:12.335590+0000 mgr.x (mgr.34109) 2068 : cluster [DBG] pgmap v2145: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:15.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:15 smithi051 bash[18409]: cluster 2020-06-27T05:48:14.337124+0000 mgr.x (mgr.34109) 2069 : cluster [DBG] pgmap v2146: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:15.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:15 smithi031 bash[18426]: cluster 2020-06-27T05:48:14.337124+0000 mgr.x (mgr.34109) 2069 : cluster [DBG] pgmap v2146: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:15.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:15 smithi031 bash[22603]: cluster 2020-06-27T05:48:14.337124+0000 mgr.x (mgr.34109) 2069 : cluster [DBG] pgmap v2146: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:17 smithi051 bash[18409]: cluster 2020-06-27T05:48:16.338830+0000 mgr.x (mgr.34109) 2070 : cluster [DBG] pgmap v2147: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:17.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:17 smithi031 bash[22603]: cluster 2020-06-27T05:48:16.338830+0000 mgr.x (mgr.34109) 2070 : cluster [DBG] pgmap v2147: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:17.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:17 smithi031 bash[18426]: cluster 2020-06-27T05:48:16.338830+0000 mgr.x (mgr.34109) 2070 : cluster [DBG] pgmap v2147: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:19.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:19 smithi051 bash[18409]: cluster 2020-06-27T05:48:18.340437+0000 mgr.x (mgr.34109) 2071 : cluster [DBG] pgmap v2148: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:19.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:19 smithi031 bash[18426]: cluster 2020-06-27T05:48:18.340437+0000 mgr.x (mgr.34109) 2071 : cluster [DBG] pgmap v2148: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:19.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:19 smithi031 bash[22603]: cluster 2020-06-27T05:48:18.340437+0000 mgr.x (mgr.34109) 2071 : cluster [DBG] pgmap v2148: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:21.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:21 smithi051 bash[18409]: cluster 2020-06-27T05:48:20.342181+0000 mgr.x (mgr.34109) 2072 : cluster [DBG] pgmap v2149: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:21.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:21 smithi031 bash[18426]: cluster 2020-06-27T05:48:20.342181+0000 mgr.x (mgr.34109) 2072 : cluster [DBG] pgmap v2149: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:21.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:21 smithi031 bash[22603]: cluster 2020-06-27T05:48:20.342181+0000 mgr.x (mgr.34109) 2072 : cluster [DBG] pgmap v2149: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:23.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:23 smithi051 bash[18409]: cluster 2020-06-27T05:48:22.343864+0000 mgr.x (mgr.34109) 2073 : cluster [DBG] pgmap v2150: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:23.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:23 smithi031 bash[18426]: cluster 2020-06-27T05:48:22.343864+0000 mgr.x (mgr.34109) 2073 : cluster [DBG] pgmap v2150: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:23.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:23 smithi031 bash[22603]: cluster 2020-06-27T05:48:22.343864+0000 mgr.x (mgr.34109) 2073 : cluster [DBG] pgmap v2150: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:25.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:25 smithi051 bash[18409]: cluster 2020-06-27T05:48:24.345663+0000 mgr.x (mgr.34109) 2074 : cluster [DBG] pgmap v2151: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:25.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:25 smithi031 bash[18426]: cluster 2020-06-27T05:48:24.345663+0000 mgr.x (mgr.34109) 2074 : cluster [DBG] pgmap v2151: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:25.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:25 smithi031 bash[22603]: cluster 2020-06-27T05:48:24.345663+0000 mgr.x (mgr.34109) 2074 : cluster [DBG] pgmap v2151: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:27.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:27 smithi051 bash[18409]: cluster 2020-06-27T05:48:26.347448+0000 mgr.x (mgr.34109) 2075 : cluster [DBG] pgmap v2152: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:27.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:27 smithi031 bash[18426]: cluster 2020-06-27T05:48:26.347448+0000 mgr.x (mgr.34109) 2075 : cluster [DBG] pgmap v2152: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:27.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:27 smithi031 bash[22603]: cluster 2020-06-27T05:48:26.347448+0000 mgr.x (mgr.34109) 2075 : cluster [DBG] pgmap v2152: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:29.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:29 smithi051 bash[18409]: cluster 2020-06-27T05:48:28.349129+0000 mgr.x (mgr.34109) 2076 : cluster [DBG] pgmap v2153: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:29.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:29 smithi031 bash[18426]: cluster 2020-06-27T05:48:28.349129+0000 mgr.x (mgr.34109) 2076 : cluster [DBG] pgmap v2153: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:29.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:29 smithi031 bash[22603]: cluster 2020-06-27T05:48:28.349129+0000 mgr.x (mgr.34109) 2076 : cluster [DBG] pgmap v2153: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:31.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:31 smithi051 bash[18409]: cluster 2020-06-27T05:48:30.350844+0000 mgr.x (mgr.34109) 2077 : cluster [DBG] pgmap v2154: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:31.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:31 smithi031 bash[22603]: cluster 2020-06-27T05:48:30.350844+0000 mgr.x (mgr.34109) 2077 : cluster [DBG] pgmap v2154: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:31.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:31 smithi031 bash[18426]: cluster 2020-06-27T05:48:30.350844+0000 mgr.x (mgr.34109) 2077 : cluster [DBG] pgmap v2154: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:33 smithi051 bash[18409]: cluster 2020-06-27T05:48:32.352620+0000 mgr.x (mgr.34109) 2078 : cluster [DBG] pgmap v2155: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:33.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:33 smithi031 bash[22603]: cluster 2020-06-27T05:48:32.352620+0000 mgr.x (mgr.34109) 2078 : cluster [DBG] pgmap v2155: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:33.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:33 smithi031 bash[18426]: cluster 2020-06-27T05:48:32.352620+0000 mgr.x (mgr.34109) 2078 : cluster [DBG] pgmap v2155: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:35.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:35 smithi051 bash[18409]: cluster 2020-06-27T05:48:34.354289+0000 mgr.x (mgr.34109) 2079 : cluster [DBG] pgmap v2156: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:35.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:35 smithi031 bash[18426]: cluster 2020-06-27T05:48:34.354289+0000 mgr.x (mgr.34109) 2079 : cluster [DBG] pgmap v2156: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:35.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:35 smithi031 bash[22603]: cluster 2020-06-27T05:48:34.354289+0000 mgr.x (mgr.34109) 2079 : cluster [DBG] pgmap v2156: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:36 smithi051 bash[18409]: cluster 2020-06-27T05:48:36.355874+0000 mgr.x (mgr.34109) 2080 : cluster [DBG] pgmap v2157: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:36 smithi031 bash[18426]: cluster 2020-06-27T05:48:36.355874+0000 mgr.x (mgr.34109) 2080 : cluster [DBG] pgmap v2157: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:36.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:36 smithi031 bash[22603]: cluster 2020-06-27T05:48:36.355874+0000 mgr.x (mgr.34109) 2080 : cluster [DBG] pgmap v2157: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:39.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:39 smithi051 bash[18409]: cluster 2020-06-27T05:48:38.357487+0000 mgr.x (mgr.34109) 2081 : cluster [DBG] pgmap v2158: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:39.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:39 smithi031 bash[18426]: cluster 2020-06-27T05:48:38.357487+0000 mgr.x (mgr.34109) 2081 : cluster [DBG] pgmap v2158: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:39.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:39 smithi031 bash[22603]: cluster 2020-06-27T05:48:38.357487+0000 mgr.x (mgr.34109) 2081 : cluster [DBG] pgmap v2158: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:41 smithi051 bash[18409]: cluster 2020-06-27T05:48:40.359118+0000 mgr.x (mgr.34109) 2082 : cluster [DBG] pgmap v2159: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:41 smithi031 bash[18426]: cluster 2020-06-27T05:48:40.359118+0000 mgr.x (mgr.34109) 2082 : cluster [DBG] pgmap v2159: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:41.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:41 smithi031 bash[22603]: cluster 2020-06-27T05:48:40.359118+0000 mgr.x (mgr.34109) 2082 : cluster [DBG] pgmap v2159: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:43.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:43 smithi051 bash[18409]: cluster 2020-06-27T05:48:42.360764+0000 mgr.x (mgr.34109) 2083 : cluster [DBG] pgmap v2160: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:43.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:43 smithi031 bash[18426]: cluster 2020-06-27T05:48:42.360764+0000 mgr.x (mgr.34109) 2083 : cluster [DBG] pgmap v2160: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:43.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:43 smithi031 bash[22603]: cluster 2020-06-27T05:48:42.360764+0000 mgr.x (mgr.34109) 2083 : cluster [DBG] pgmap v2160: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:45.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:45 smithi051 bash[18409]: cluster 2020-06-27T05:48:44.362531+0000 mgr.x (mgr.34109) 2084 : cluster [DBG] pgmap v2161: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:45.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:45 smithi031 bash[18426]: cluster 2020-06-27T05:48:44.362531+0000 mgr.x (mgr.34109) 2084 : cluster [DBG] pgmap v2161: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:45.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:45 smithi031 bash[22603]: cluster 2020-06-27T05:48:44.362531+0000 mgr.x (mgr.34109) 2084 : cluster [DBG] pgmap v2161: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:47.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:47 smithi051 bash[18409]: cluster 2020-06-27T05:48:46.364173+0000 mgr.x (mgr.34109) 2085 : cluster [DBG] pgmap v2162: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:47.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:47 smithi031 bash[22603]: cluster 2020-06-27T05:48:46.364173+0000 mgr.x (mgr.34109) 2085 : cluster [DBG] pgmap v2162: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:47.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:47 smithi031 bash[18426]: cluster 2020-06-27T05:48:46.364173+0000 mgr.x (mgr.34109) 2085 : cluster [DBG] pgmap v2162: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:49.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:49 smithi051 bash[18409]: cluster 2020-06-27T05:48:48.365831+0000 mgr.x (mgr.34109) 2086 : cluster [DBG] pgmap v2163: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:49.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:49 smithi031 bash[18426]: cluster 2020-06-27T05:48:48.365831+0000 mgr.x (mgr.34109) 2086 : cluster [DBG] pgmap v2163: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:49.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:49 smithi031 bash[22603]: cluster 2020-06-27T05:48:48.365831+0000 mgr.x (mgr.34109) 2086 : cluster [DBG] pgmap v2163: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:51.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:51 smithi051 bash[18409]: cluster 2020-06-27T05:48:50.367459+0000 mgr.x (mgr.34109) 2087 : cluster [DBG] pgmap v2164: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:51.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:51 smithi031 bash[22603]: cluster 2020-06-27T05:48:50.367459+0000 mgr.x (mgr.34109) 2087 : cluster [DBG] pgmap v2164: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:51.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:51 smithi031 bash[18426]: cluster 2020-06-27T05:48:50.367459+0000 mgr.x (mgr.34109) 2087 : cluster [DBG] pgmap v2164: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:53.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:53 smithi051 bash[18409]: cluster 2020-06-27T05:48:52.369032+0000 mgr.x (mgr.34109) 2088 : cluster [DBG] pgmap v2165: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:53.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:53 smithi031 bash[22603]: cluster 2020-06-27T05:48:52.369032+0000 mgr.x (mgr.34109) 2088 : cluster [DBG] pgmap v2165: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:53.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:53 smithi031 bash[18426]: cluster 2020-06-27T05:48:52.369032+0000 mgr.x (mgr.34109) 2088 : cluster [DBG] pgmap v2165: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:55.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:55 smithi051 bash[18409]: cluster 2020-06-27T05:48:54.370643+0000 mgr.x (mgr.34109) 2089 : cluster [DBG] pgmap v2166: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:55.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:55 smithi031 bash[18426]: cluster 2020-06-27T05:48:54.370643+0000 mgr.x (mgr.34109) 2089 : cluster [DBG] pgmap v2166: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:55.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:55 smithi031 bash[22603]: cluster 2020-06-27T05:48:54.370643+0000 mgr.x (mgr.34109) 2089 : cluster [DBG] pgmap v2166: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:57.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:57 smithi051 bash[18409]: cluster 2020-06-27T05:48:56.372363+0000 mgr.x (mgr.34109) 2090 : cluster [DBG] pgmap v2167: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:57.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:57 smithi031 bash[18426]: cluster 2020-06-27T05:48:56.372363+0000 mgr.x (mgr.34109) 2090 : cluster [DBG] pgmap v2167: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:57.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:57 smithi031 bash[22603]: cluster 2020-06-27T05:48:56.372363+0000 mgr.x (mgr.34109) 2090 : cluster [DBG] pgmap v2167: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:59.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:48:59 smithi051 bash[18409]: cluster 2020-06-27T05:48:58.374076+0000 mgr.x (mgr.34109) 2091 : cluster [DBG] pgmap v2168: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:59.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:48:59 smithi031 bash[18426]: cluster 2020-06-27T05:48:58.374076+0000 mgr.x (mgr.34109) 2091 : cluster [DBG] pgmap v2168: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:48:59.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:48:59 smithi031 bash[22603]: cluster 2020-06-27T05:48:58.374076+0000 mgr.x (mgr.34109) 2091 : cluster [DBG] pgmap v2168: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:01.717 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:01 smithi051 bash[18409]: cluster 2020-06-27T05:49:00.375803+0000 mgr.x (mgr.34109) 2092 : cluster [DBG] pgmap v2169: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:01.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:01 smithi031 bash[22603]: cluster 2020-06-27T05:49:00.375803+0000 mgr.x (mgr.34109) 2092 : cluster [DBG] pgmap v2169: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:01.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:01 smithi031 bash[18426]: cluster 2020-06-27T05:49:00.375803+0000 mgr.x (mgr.34109) 2092 : cluster [DBG] pgmap v2169: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:03.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:03 smithi051 bash[18409]: cluster 2020-06-27T05:49:02.377512+0000 mgr.x (mgr.34109) 2093 : cluster [DBG] pgmap v2170: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:03.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:03 smithi031 bash[18426]: cluster 2020-06-27T05:49:02.377512+0000 mgr.x (mgr.34109) 2093 : cluster [DBG] pgmap v2170: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:03.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:03 smithi031 bash[22603]: cluster 2020-06-27T05:49:02.377512+0000 mgr.x (mgr.34109) 2093 : cluster [DBG] pgmap v2170: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:05.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:05 smithi051 bash[18409]: cluster 2020-06-27T05:49:04.379123+0000 mgr.x (mgr.34109) 2094 : cluster [DBG] pgmap v2171: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:05.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:05 smithi031 bash[18426]: cluster 2020-06-27T05:49:04.379123+0000 mgr.x (mgr.34109) 2094 : cluster [DBG] pgmap v2171: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:05.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:05 smithi031 bash[22603]: cluster 2020-06-27T05:49:04.379123+0000 mgr.x (mgr.34109) 2094 : cluster [DBG] pgmap v2171: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:07.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:07 smithi051 bash[18409]: cluster 2020-06-27T05:49:06.380759+0000 mgr.x (mgr.34109) 2095 : cluster [DBG] pgmap v2172: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:07.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:07 smithi031 bash[18426]: cluster 2020-06-27T05:49:06.380759+0000 mgr.x (mgr.34109) 2095 : cluster [DBG] pgmap v2172: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:07.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:07 smithi031 bash[22603]: cluster 2020-06-27T05:49:06.380759+0000 mgr.x (mgr.34109) 2095 : cluster [DBG] pgmap v2172: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:09.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:09 smithi051 bash[18409]: cluster 2020-06-27T05:49:08.382356+0000 mgr.x (mgr.34109) 2096 : cluster [DBG] pgmap v2173: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:09.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:09 smithi031 bash[18426]: cluster 2020-06-27T05:49:08.382356+0000 mgr.x (mgr.34109) 2096 : cluster [DBG] pgmap v2173: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:09.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:09 smithi031 bash[22603]: cluster 2020-06-27T05:49:08.382356+0000 mgr.x (mgr.34109) 2096 : cluster [DBG] pgmap v2173: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:11.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:11 smithi051 bash[18409]: cluster 2020-06-27T05:49:10.384031+0000 mgr.x (mgr.34109) 2097 : cluster [DBG] pgmap v2174: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:11.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:11 smithi031 bash[18426]: cluster 2020-06-27T05:49:10.384031+0000 mgr.x (mgr.34109) 2097 : cluster [DBG] pgmap v2174: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:11.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:11 smithi031 bash[22603]: cluster 2020-06-27T05:49:10.384031+0000 mgr.x (mgr.34109) 2097 : cluster [DBG] pgmap v2174: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:13.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:13 smithi051 bash[18409]: cluster 2020-06-27T05:49:12.385786+0000 mgr.x (mgr.34109) 2098 : cluster [DBG] pgmap v2175: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:13.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:13 smithi031 bash[18426]: cluster 2020-06-27T05:49:12.385786+0000 mgr.x (mgr.34109) 2098 : cluster [DBG] pgmap v2175: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:13.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:13 smithi031 bash[22603]: cluster 2020-06-27T05:49:12.385786+0000 mgr.x (mgr.34109) 2098 : cluster [DBG] pgmap v2175: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:15.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:15 smithi051 bash[18409]: cluster 2020-06-27T05:49:14.387506+0000 mgr.x (mgr.34109) 2099 : cluster [DBG] pgmap v2176: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:15.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:15 smithi031 bash[18426]: cluster 2020-06-27T05:49:14.387506+0000 mgr.x (mgr.34109) 2099 : cluster [DBG] pgmap v2176: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:15.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:15 smithi031 bash[22603]: cluster 2020-06-27T05:49:14.387506+0000 mgr.x (mgr.34109) 2099 : cluster [DBG] pgmap v2176: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:17.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:17 smithi051 bash[18409]: cluster 2020-06-27T05:49:16.389206+0000 mgr.x (mgr.34109) 2100 : cluster [DBG] pgmap v2177: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:17.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:17 smithi031 bash[18426]: cluster 2020-06-27T05:49:16.389206+0000 mgr.x (mgr.34109) 2100 : cluster [DBG] pgmap v2177: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:17.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:17 smithi031 bash[22603]: cluster 2020-06-27T05:49:16.389206+0000 mgr.x (mgr.34109) 2100 : cluster [DBG] pgmap v2177: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:19.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:19 smithi031 bash[18426]: cluster 2020-06-27T05:49:18.390871+0000 mgr.x (mgr.34109) 2101 : cluster [DBG] pgmap v2178: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:19.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:19 smithi031 bash[22603]: cluster 2020-06-27T05:49:18.390871+0000 mgr.x (mgr.34109) 2101 : cluster [DBG] pgmap v2178: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:19.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:19 smithi051 bash[18409]: cluster 2020-06-27T05:49:18.390871+0000 mgr.x (mgr.34109) 2101 : cluster [DBG] pgmap v2178: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:21.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:21 smithi051 bash[18409]: cluster 2020-06-27T05:49:20.392457+0000 mgr.x (mgr.34109) 2102 : cluster [DBG] pgmap v2179: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:21.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:21 smithi031 bash[18426]: cluster 2020-06-27T05:49:20.392457+0000 mgr.x (mgr.34109) 2102 : cluster [DBG] pgmap v2179: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:21.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:21 smithi031 bash[22603]: cluster 2020-06-27T05:49:20.392457+0000 mgr.x (mgr.34109) 2102 : cluster [DBG] pgmap v2179: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:23.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:23 smithi051 bash[18409]: cluster 2020-06-27T05:49:22.394135+0000 mgr.x (mgr.34109) 2103 : cluster [DBG] pgmap v2180: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:23.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:23 smithi031 bash[18426]: cluster 2020-06-27T05:49:22.394135+0000 mgr.x (mgr.34109) 2103 : cluster [DBG] pgmap v2180: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:23.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:23 smithi031 bash[22603]: cluster 2020-06-27T05:49:22.394135+0000 mgr.x (mgr.34109) 2103 : cluster [DBG] pgmap v2180: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:25.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:25 smithi051 bash[18409]: cluster 2020-06-27T05:49:24.395855+0000 mgr.x (mgr.34109) 2104 : cluster [DBG] pgmap v2181: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:25.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:25 smithi031 bash[18426]: cluster 2020-06-27T05:49:24.395855+0000 mgr.x (mgr.34109) 2104 : cluster [DBG] pgmap v2181: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:25.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:25 smithi031 bash[22603]: cluster 2020-06-27T05:49:24.395855+0000 mgr.x (mgr.34109) 2104 : cluster [DBG] pgmap v2181: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:27.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:27 smithi051 bash[18409]: cluster 2020-06-27T05:49:26.397526+0000 mgr.x (mgr.34109) 2105 : cluster [DBG] pgmap v2182: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:27.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:27 smithi031 bash[18426]: cluster 2020-06-27T05:49:26.397526+0000 mgr.x (mgr.34109) 2105 : cluster [DBG] pgmap v2182: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:27.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:27 smithi031 bash[22603]: cluster 2020-06-27T05:49:26.397526+0000 mgr.x (mgr.34109) 2105 : cluster [DBG] pgmap v2182: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:29.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:29 smithi051 bash[18409]: cluster 2020-06-27T05:49:28.399143+0000 mgr.x (mgr.34109) 2106 : cluster [DBG] pgmap v2183: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:29.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:29 smithi031 bash[18426]: cluster 2020-06-27T05:49:28.399143+0000 mgr.x (mgr.34109) 2106 : cluster [DBG] pgmap v2183: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:29.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:29 smithi031 bash[22603]: cluster 2020-06-27T05:49:28.399143+0000 mgr.x (mgr.34109) 2106 : cluster [DBG] pgmap v2183: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:31.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:31 smithi051 bash[18409]: cluster 2020-06-27T05:49:30.400663+0000 mgr.x (mgr.34109) 2107 : cluster [DBG] pgmap v2184: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:31.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:31 smithi031 bash[18426]: cluster 2020-06-27T05:49:30.400663+0000 mgr.x (mgr.34109) 2107 : cluster [DBG] pgmap v2184: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:31.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:31 smithi031 bash[22603]: cluster 2020-06-27T05:49:30.400663+0000 mgr.x (mgr.34109) 2107 : cluster [DBG] pgmap v2184: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:33.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:33 smithi051 bash[18409]: cluster 2020-06-27T05:49:32.402229+0000 mgr.x (mgr.34109) 2108 : cluster [DBG] pgmap v2185: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:33.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:33 smithi031 bash[18426]: cluster 2020-06-27T05:49:32.402229+0000 mgr.x (mgr.34109) 2108 : cluster [DBG] pgmap v2185: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:33.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:33 smithi031 bash[22603]: cluster 2020-06-27T05:49:32.402229+0000 mgr.x (mgr.34109) 2108 : cluster [DBG] pgmap v2185: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:35.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:35 smithi031 bash[18426]: cluster 2020-06-27T05:49:34.403939+0000 mgr.x (mgr.34109) 2109 : cluster [DBG] pgmap v2186: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:35.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:35 smithi031 bash[22603]: cluster 2020-06-27T05:49:34.403939+0000 mgr.x (mgr.34109) 2109 : cluster [DBG] pgmap v2186: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:35.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:35 smithi051 bash[18409]: cluster 2020-06-27T05:49:34.403939+0000 mgr.x (mgr.34109) 2109 : cluster [DBG] pgmap v2186: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:37.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:37 smithi051 bash[18409]: cluster 2020-06-27T05:49:36.405613+0000 mgr.x (mgr.34109) 2110 : cluster [DBG] pgmap v2187: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:37.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:37 smithi031 bash[18426]: cluster 2020-06-27T05:49:36.405613+0000 mgr.x (mgr.34109) 2110 : cluster [DBG] pgmap v2187: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:37.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:37 smithi031 bash[22603]: cluster 2020-06-27T05:49:36.405613+0000 mgr.x (mgr.34109) 2110 : cluster [DBG] pgmap v2187: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:39.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:39 smithi051 bash[18409]: cluster 2020-06-27T05:49:38.407387+0000 mgr.x (mgr.34109) 2111 : cluster [DBG] pgmap v2188: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:39.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:39 smithi031 bash[18426]: cluster 2020-06-27T05:49:38.407387+0000 mgr.x (mgr.34109) 2111 : cluster [DBG] pgmap v2188: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:39.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:39 smithi031 bash[22603]: cluster 2020-06-27T05:49:38.407387+0000 mgr.x (mgr.34109) 2111 : cluster [DBG] pgmap v2188: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:41 smithi051 bash[18409]: cluster 2020-06-27T05:49:40.409118+0000 mgr.x (mgr.34109) 2112 : cluster [DBG] pgmap v2189: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:41 smithi031 bash[18426]: cluster 2020-06-27T05:49:40.409118+0000 mgr.x (mgr.34109) 2112 : cluster [DBG] pgmap v2189: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:41.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:41 smithi031 bash[22603]: cluster 2020-06-27T05:49:40.409118+0000 mgr.x (mgr.34109) 2112 : cluster [DBG] pgmap v2189: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:43.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:43 smithi031 bash[18426]: cluster 2020-06-27T05:49:42.410807+0000 mgr.x (mgr.34109) 2113 : cluster [DBG] pgmap v2190: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:43.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:43 smithi031 bash[22603]: cluster 2020-06-27T05:49:42.410807+0000 mgr.x (mgr.34109) 2113 : cluster [DBG] pgmap v2190: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:43.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:43 smithi051 bash[18409]: cluster 2020-06-27T05:49:42.410807+0000 mgr.x (mgr.34109) 2113 : cluster [DBG] pgmap v2190: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:45.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:45 smithi051 bash[18409]: cluster 2020-06-27T05:49:44.412650+0000 mgr.x (mgr.34109) 2114 : cluster [DBG] pgmap v2191: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:45.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:45 smithi031 bash[22603]: cluster 2020-06-27T05:49:44.412650+0000 mgr.x (mgr.34109) 2114 : cluster [DBG] pgmap v2191: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:45.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:45 smithi031 bash[18426]: cluster 2020-06-27T05:49:44.412650+0000 mgr.x (mgr.34109) 2114 : cluster [DBG] pgmap v2191: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:47.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:47 smithi051 bash[18409]: cluster 2020-06-27T05:49:46.414162+0000 mgr.x (mgr.34109) 2115 : cluster [DBG] pgmap v2192: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:47.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:47 smithi031 bash[18426]: cluster 2020-06-27T05:49:46.414162+0000 mgr.x (mgr.34109) 2115 : cluster [DBG] pgmap v2192: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:47.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:47 smithi031 bash[22603]: cluster 2020-06-27T05:49:46.414162+0000 mgr.x (mgr.34109) 2115 : cluster [DBG] pgmap v2192: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:49.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:49 smithi051 bash[18409]: cluster 2020-06-27T05:49:48.415844+0000 mgr.x (mgr.34109) 2116 : cluster [DBG] pgmap v2193: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:49.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:49 smithi031 bash[22603]: cluster 2020-06-27T05:49:48.415844+0000 mgr.x (mgr.34109) 2116 : cluster [DBG] pgmap v2193: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:49.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:49 smithi031 bash[18426]: cluster 2020-06-27T05:49:48.415844+0000 mgr.x (mgr.34109) 2116 : cluster [DBG] pgmap v2193: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:51.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:51 smithi051 bash[18409]: cluster 2020-06-27T05:49:50.417472+0000 mgr.x (mgr.34109) 2117 : cluster [DBG] pgmap v2194: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:51.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:51 smithi031 bash[18426]: cluster 2020-06-27T05:49:50.417472+0000 mgr.x (mgr.34109) 2117 : cluster [DBG] pgmap v2194: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:51.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:51 smithi031 bash[22603]: cluster 2020-06-27T05:49:50.417472+0000 mgr.x (mgr.34109) 2117 : cluster [DBG] pgmap v2194: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:53.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:53 smithi051 bash[18409]: cluster 2020-06-27T05:49:52.419153+0000 mgr.x (mgr.34109) 2118 : cluster [DBG] pgmap v2195: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:53.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:53 smithi031 bash[22603]: cluster 2020-06-27T05:49:52.419153+0000 mgr.x (mgr.34109) 2118 : cluster [DBG] pgmap v2195: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:53.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:53 smithi031 bash[18426]: cluster 2020-06-27T05:49:52.419153+0000 mgr.x (mgr.34109) 2118 : cluster [DBG] pgmap v2195: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:55.971 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:55 smithi051 bash[18409]: cluster 2020-06-27T05:49:54.420722+0000 mgr.x (mgr.34109) 2119 : cluster [DBG] pgmap v2196: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:55.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:55 smithi031 bash[22603]: cluster 2020-06-27T05:49:54.420722+0000 mgr.x (mgr.34109) 2119 : cluster [DBG] pgmap v2196: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:55.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:55 smithi031 bash[18426]: cluster 2020-06-27T05:49:54.420722+0000 mgr.x (mgr.34109) 2119 : cluster [DBG] pgmap v2196: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:57.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:57 smithi051 bash[18409]: cluster 2020-06-27T05:49:56.422412+0000 mgr.x (mgr.34109) 2120 : cluster [DBG] pgmap v2197: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:57.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:57 smithi031 bash[18426]: cluster 2020-06-27T05:49:56.422412+0000 mgr.x (mgr.34109) 2120 : cluster [DBG] pgmap v2197: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:57.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:57 smithi031 bash[22603]: cluster 2020-06-27T05:49:56.422412+0000 mgr.x (mgr.34109) 2120 : cluster [DBG] pgmap v2197: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:59.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:49:59 smithi051 bash[18409]: cluster 2020-06-27T05:49:58.423972+0000 mgr.x (mgr.34109) 2121 : cluster [DBG] pgmap v2198: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:59.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:49:59 smithi031 bash[18426]: cluster 2020-06-27T05:49:58.423972+0000 mgr.x (mgr.34109) 2121 : cluster [DBG] pgmap v2198: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:49:59.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:49:59 smithi031 bash[22603]: cluster 2020-06-27T05:49:58.423972+0000 mgr.x (mgr.34109) 2121 : cluster [DBG] pgmap v2198: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:01.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:01 smithi051 bash[18409]: cluster 2020-06-27T05:50:00.425744+0000 mgr.x (mgr.34109) 2122 : cluster [DBG] pgmap v2199: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:01.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:01 smithi031 bash[18426]: cluster 2020-06-27T05:50:00.425744+0000 mgr.x (mgr.34109) 2122 : cluster [DBG] pgmap v2199: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:01.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:01 smithi031 bash[22603]: cluster 2020-06-27T05:50:00.425744+0000 mgr.x (mgr.34109) 2122 : cluster [DBG] pgmap v2199: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:03.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:03 smithi051 bash[18409]: cluster 2020-06-27T05:50:02.427431+0000 mgr.x (mgr.34109) 2123 : cluster [DBG] pgmap v2200: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:03.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:03 smithi031 bash[22603]: cluster 2020-06-27T05:50:02.427431+0000 mgr.x (mgr.34109) 2123 : cluster [DBG] pgmap v2200: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:03.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:03 smithi031 bash[18426]: cluster 2020-06-27T05:50:02.427431+0000 mgr.x (mgr.34109) 2123 : cluster [DBG] pgmap v2200: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:05.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:05 smithi051 bash[18409]: cluster 2020-06-27T05:50:04.428977+0000 mgr.x (mgr.34109) 2124 : cluster [DBG] pgmap v2201: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:05.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:05 smithi031 bash[18426]: cluster 2020-06-27T05:50:04.428977+0000 mgr.x (mgr.34109) 2124 : cluster [DBG] pgmap v2201: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:05.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:05 smithi031 bash[22603]: cluster 2020-06-27T05:50:04.428977+0000 mgr.x (mgr.34109) 2124 : cluster [DBG] pgmap v2201: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:07.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:07 smithi051 bash[18409]: cluster 2020-06-27T05:50:06.430593+0000 mgr.x (mgr.34109) 2125 : cluster [DBG] pgmap v2202: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:07.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:07 smithi031 bash[18426]: cluster 2020-06-27T05:50:06.430593+0000 mgr.x (mgr.34109) 2125 : cluster [DBG] pgmap v2202: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:07.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:07 smithi031 bash[22603]: cluster 2020-06-27T05:50:06.430593+0000 mgr.x (mgr.34109) 2125 : cluster [DBG] pgmap v2202: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:09.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:09 smithi051 bash[18409]: cluster 2020-06-27T05:50:08.432272+0000 mgr.x (mgr.34109) 2126 : cluster [DBG] pgmap v2203: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:09.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:09 smithi031 bash[18426]: cluster 2020-06-27T05:50:08.432272+0000 mgr.x (mgr.34109) 2126 : cluster [DBG] pgmap v2203: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:09.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:09 smithi031 bash[22603]: cluster 2020-06-27T05:50:08.432272+0000 mgr.x (mgr.34109) 2126 : cluster [DBG] pgmap v2203: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:11.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:11 smithi051 bash[18409]: cluster 2020-06-27T05:50:10.433857+0000 mgr.x (mgr.34109) 2127 : cluster [DBG] pgmap v2204: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:11.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:11 smithi031 bash[18426]: cluster 2020-06-27T05:50:10.433857+0000 mgr.x (mgr.34109) 2127 : cluster [DBG] pgmap v2204: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:11.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:11 smithi031 bash[22603]: cluster 2020-06-27T05:50:10.433857+0000 mgr.x (mgr.34109) 2127 : cluster [DBG] pgmap v2204: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:13.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:13 smithi051 bash[18409]: cluster 2020-06-27T05:50:12.435473+0000 mgr.x (mgr.34109) 2128 : cluster [DBG] pgmap v2205: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:13.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:13 smithi031 bash[22603]: cluster 2020-06-27T05:50:12.435473+0000 mgr.x (mgr.34109) 2128 : cluster [DBG] pgmap v2205: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:13.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:13 smithi031 bash[18426]: cluster 2020-06-27T05:50:12.435473+0000 mgr.x (mgr.34109) 2128 : cluster [DBG] pgmap v2205: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:15.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:15 smithi051 bash[18409]: cluster 2020-06-27T05:50:14.437218+0000 mgr.x (mgr.34109) 2129 : cluster [DBG] pgmap v2206: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:15.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:15 smithi031 bash[22603]: cluster 2020-06-27T05:50:14.437218+0000 mgr.x (mgr.34109) 2129 : cluster [DBG] pgmap v2206: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:15.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:15 smithi031 bash[18426]: cluster 2020-06-27T05:50:14.437218+0000 mgr.x (mgr.34109) 2129 : cluster [DBG] pgmap v2206: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:17.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:17 smithi051 bash[18409]: cluster 2020-06-27T05:50:16.438805+0000 mgr.x (mgr.34109) 2130 : cluster [DBG] pgmap v2207: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:17.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:17 smithi031 bash[18426]: cluster 2020-06-27T05:50:16.438805+0000 mgr.x (mgr.34109) 2130 : cluster [DBG] pgmap v2207: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:17.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:17 smithi031 bash[22603]: cluster 2020-06-27T05:50:16.438805+0000 mgr.x (mgr.34109) 2130 : cluster [DBG] pgmap v2207: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:19.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:19 smithi051 bash[18409]: cluster 2020-06-27T05:50:18.440484+0000 mgr.x (mgr.34109) 2131 : cluster [DBG] pgmap v2208: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:19.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:19 smithi031 bash[18426]: cluster 2020-06-27T05:50:18.440484+0000 mgr.x (mgr.34109) 2131 : cluster [DBG] pgmap v2208: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:19.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:19 smithi031 bash[22603]: cluster 2020-06-27T05:50:18.440484+0000 mgr.x (mgr.34109) 2131 : cluster [DBG] pgmap v2208: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:21.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:21 smithi051 bash[18409]: cluster 2020-06-27T05:50:20.442133+0000 mgr.x (mgr.34109) 2132 : cluster [DBG] pgmap v2209: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:21.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:21 smithi031 bash[18426]: cluster 2020-06-27T05:50:20.442133+0000 mgr.x (mgr.34109) 2132 : cluster [DBG] pgmap v2209: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:21.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:21 smithi031 bash[22603]: cluster 2020-06-27T05:50:20.442133+0000 mgr.x (mgr.34109) 2132 : cluster [DBG] pgmap v2209: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:23.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:23 smithi051 bash[18409]: cluster 2020-06-27T05:50:22.443843+0000 mgr.x (mgr.34109) 2133 : cluster [DBG] pgmap v2210: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:23.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:23 smithi031 bash[18426]: cluster 2020-06-27T05:50:22.443843+0000 mgr.x (mgr.34109) 2133 : cluster [DBG] pgmap v2210: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:23.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:23 smithi031 bash[22603]: cluster 2020-06-27T05:50:22.443843+0000 mgr.x (mgr.34109) 2133 : cluster [DBG] pgmap v2210: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:25.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:25 smithi051 bash[18409]: cluster 2020-06-27T05:50:24.445472+0000 mgr.x (mgr.34109) 2134 : cluster [DBG] pgmap v2211: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:25.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:25 smithi031 bash[18426]: cluster 2020-06-27T05:50:24.445472+0000 mgr.x (mgr.34109) 2134 : cluster [DBG] pgmap v2211: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:25.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:25 smithi031 bash[22603]: cluster 2020-06-27T05:50:24.445472+0000 mgr.x (mgr.34109) 2134 : cluster [DBG] pgmap v2211: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:27.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:27 smithi051 bash[18409]: cluster 2020-06-27T05:50:26.447145+0000 mgr.x (mgr.34109) 2135 : cluster [DBG] pgmap v2212: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:27.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:27 smithi031 bash[18426]: cluster 2020-06-27T05:50:26.447145+0000 mgr.x (mgr.34109) 2135 : cluster [DBG] pgmap v2212: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:27.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:27 smithi031 bash[22603]: cluster 2020-06-27T05:50:26.447145+0000 mgr.x (mgr.34109) 2135 : cluster [DBG] pgmap v2212: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:29.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:29 smithi051 bash[18409]: cluster 2020-06-27T05:50:28.448810+0000 mgr.x (mgr.34109) 2136 : cluster [DBG] pgmap v2213: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:29.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:29 smithi031 bash[18426]: cluster 2020-06-27T05:50:28.448810+0000 mgr.x (mgr.34109) 2136 : cluster [DBG] pgmap v2213: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:29.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:29 smithi031 bash[22603]: cluster 2020-06-27T05:50:28.448810+0000 mgr.x (mgr.34109) 2136 : cluster [DBG] pgmap v2213: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:31.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:31 smithi051 bash[18409]: cluster 2020-06-27T05:50:30.450434+0000 mgr.x (mgr.34109) 2137 : cluster [DBG] pgmap v2214: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:31.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:31 smithi031 bash[18426]: cluster 2020-06-27T05:50:30.450434+0000 mgr.x (mgr.34109) 2137 : cluster [DBG] pgmap v2214: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:31.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:31 smithi031 bash[22603]: cluster 2020-06-27T05:50:30.450434+0000 mgr.x (mgr.34109) 2137 : cluster [DBG] pgmap v2214: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:33.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:33 smithi051 bash[18409]: cluster 2020-06-27T05:50:32.451991+0000 mgr.x (mgr.34109) 2138 : cluster [DBG] pgmap v2215: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:33.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:33 smithi031 bash[18426]: cluster 2020-06-27T05:50:32.451991+0000 mgr.x (mgr.34109) 2138 : cluster [DBG] pgmap v2215: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:33.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:33 smithi031 bash[22603]: cluster 2020-06-27T05:50:32.451991+0000 mgr.x (mgr.34109) 2138 : cluster [DBG] pgmap v2215: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:35.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:35 smithi051 bash[18409]: cluster 2020-06-27T05:50:34.453668+0000 mgr.x (mgr.34109) 2139 : cluster [DBG] pgmap v2216: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:35.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:35 smithi031 bash[18426]: cluster 2020-06-27T05:50:34.453668+0000 mgr.x (mgr.34109) 2139 : cluster [DBG] pgmap v2216: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:35.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:35 smithi031 bash[22603]: cluster 2020-06-27T05:50:34.453668+0000 mgr.x (mgr.34109) 2139 : cluster [DBG] pgmap v2216: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:37.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:37 smithi051 bash[18409]: cluster 2020-06-27T05:50:36.455481+0000 mgr.x (mgr.34109) 2140 : cluster [DBG] pgmap v2217: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:37.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:37 smithi031 bash[18426]: cluster 2020-06-27T05:50:36.455481+0000 mgr.x (mgr.34109) 2140 : cluster [DBG] pgmap v2217: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:37.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:37 smithi031 bash[22603]: cluster 2020-06-27T05:50:36.455481+0000 mgr.x (mgr.34109) 2140 : cluster [DBG] pgmap v2217: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:39.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:39 smithi051 bash[18409]: cluster 2020-06-27T05:50:38.457130+0000 mgr.x (mgr.34109) 2141 : cluster [DBG] pgmap v2218: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:39.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:39 smithi031 bash[18426]: cluster 2020-06-27T05:50:38.457130+0000 mgr.x (mgr.34109) 2141 : cluster [DBG] pgmap v2218: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:39.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:39 smithi031 bash[22603]: cluster 2020-06-27T05:50:38.457130+0000 mgr.x (mgr.34109) 2141 : cluster [DBG] pgmap v2218: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:41 smithi051 bash[18409]: cluster 2020-06-27T05:50:40.458959+0000 mgr.x (mgr.34109) 2142 : cluster [DBG] pgmap v2219: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:41 smithi031 bash[18426]: cluster 2020-06-27T05:50:40.458959+0000 mgr.x (mgr.34109) 2142 : cluster [DBG] pgmap v2219: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:41.725 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:41 smithi031 bash[22603]: cluster 2020-06-27T05:50:40.458959+0000 mgr.x (mgr.34109) 2142 : cluster [DBG] pgmap v2219: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:43.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:43 smithi051 bash[18409]: cluster 2020-06-27T05:50:42.460604+0000 mgr.x (mgr.34109) 2143 : cluster [DBG] pgmap v2220: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:43.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:43 smithi031 bash[18426]: cluster 2020-06-27T05:50:42.460604+0000 mgr.x (mgr.34109) 2143 : cluster [DBG] pgmap v2220: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:43.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:43 smithi031 bash[22603]: cluster 2020-06-27T05:50:42.460604+0000 mgr.x (mgr.34109) 2143 : cluster [DBG] pgmap v2220: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:45.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:45 smithi051 bash[18409]: cluster 2020-06-27T05:50:44.462387+0000 mgr.x (mgr.34109) 2144 : cluster [DBG] pgmap v2221: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:45.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:45 smithi031 bash[18426]: cluster 2020-06-27T05:50:44.462387+0000 mgr.x (mgr.34109) 2144 : cluster [DBG] pgmap v2221: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:45.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:45 smithi031 bash[22603]: cluster 2020-06-27T05:50:44.462387+0000 mgr.x (mgr.34109) 2144 : cluster [DBG] pgmap v2221: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:47.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:47 smithi051 bash[18409]: cluster 2020-06-27T05:50:46.464066+0000 mgr.x (mgr.34109) 2145 : cluster [DBG] pgmap v2222: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:47.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:47 smithi031 bash[18426]: cluster 2020-06-27T05:50:46.464066+0000 mgr.x (mgr.34109) 2145 : cluster [DBG] pgmap v2222: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:47.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:47 smithi031 bash[22603]: cluster 2020-06-27T05:50:46.464066+0000 mgr.x (mgr.34109) 2145 : cluster [DBG] pgmap v2222: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:49.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:49 smithi051 bash[18409]: cluster 2020-06-27T05:50:48.465768+0000 mgr.x (mgr.34109) 2146 : cluster [DBG] pgmap v2223: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:49.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:49 smithi031 bash[18426]: cluster 2020-06-27T05:50:48.465768+0000 mgr.x (mgr.34109) 2146 : cluster [DBG] pgmap v2223: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:49.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:49 smithi031 bash[22603]: cluster 2020-06-27T05:50:48.465768+0000 mgr.x (mgr.34109) 2146 : cluster [DBG] pgmap v2223: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:51.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:51 smithi051 bash[18409]: cluster 2020-06-27T05:50:50.467452+0000 mgr.x (mgr.34109) 2147 : cluster [DBG] pgmap v2224: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:51.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:51 smithi031 bash[18426]: cluster 2020-06-27T05:50:50.467452+0000 mgr.x (mgr.34109) 2147 : cluster [DBG] pgmap v2224: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:51.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:51 smithi031 bash[22603]: cluster 2020-06-27T05:50:50.467452+0000 mgr.x (mgr.34109) 2147 : cluster [DBG] pgmap v2224: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:53.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:53 smithi051 bash[18409]: cluster 2020-06-27T05:50:52.469030+0000 mgr.x (mgr.34109) 2148 : cluster [DBG] pgmap v2225: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:53.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:53 smithi031 bash[18426]: cluster 2020-06-27T05:50:52.469030+0000 mgr.x (mgr.34109) 2148 : cluster [DBG] pgmap v2225: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:53.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:53 smithi031 bash[22603]: cluster 2020-06-27T05:50:52.469030+0000 mgr.x (mgr.34109) 2148 : cluster [DBG] pgmap v2225: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:55.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:55 smithi051 bash[18409]: cluster 2020-06-27T05:50:54.470751+0000 mgr.x (mgr.34109) 2149 : cluster [DBG] pgmap v2226: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:55.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:55 smithi031 bash[18426]: cluster 2020-06-27T05:50:54.470751+0000 mgr.x (mgr.34109) 2149 : cluster [DBG] pgmap v2226: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:55.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:55 smithi031 bash[22603]: cluster 2020-06-27T05:50:54.470751+0000 mgr.x (mgr.34109) 2149 : cluster [DBG] pgmap v2226: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:57.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:57 smithi051 bash[18409]: cluster 2020-06-27T05:50:56.472349+0000 mgr.x (mgr.34109) 2150 : cluster [DBG] pgmap v2227: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:57.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:57 smithi031 bash[18426]: cluster 2020-06-27T05:50:56.472349+0000 mgr.x (mgr.34109) 2150 : cluster [DBG] pgmap v2227: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:57.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:57 smithi031 bash[22603]: cluster 2020-06-27T05:50:56.472349+0000 mgr.x (mgr.34109) 2150 : cluster [DBG] pgmap v2227: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:59.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:50:59 smithi051 bash[18409]: cluster 2020-06-27T05:50:58.473949+0000 mgr.x (mgr.34109) 2151 : cluster [DBG] pgmap v2228: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:59.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:50:59 smithi031 bash[18426]: cluster 2020-06-27T05:50:58.473949+0000 mgr.x (mgr.34109) 2151 : cluster [DBG] pgmap v2228: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:50:59.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:50:59 smithi031 bash[22603]: cluster 2020-06-27T05:50:58.473949+0000 mgr.x (mgr.34109) 2151 : cluster [DBG] pgmap v2228: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:01.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:01 smithi051 bash[18409]: cluster 2020-06-27T05:51:00.475537+0000 mgr.x (mgr.34109) 2152 : cluster [DBG] pgmap v2229: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:01.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:01 smithi031 bash[18426]: cluster 2020-06-27T05:51:00.475537+0000 mgr.x (mgr.34109) 2152 : cluster [DBG] pgmap v2229: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:01.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:01 smithi031 bash[22603]: cluster 2020-06-27T05:51:00.475537+0000 mgr.x (mgr.34109) 2152 : cluster [DBG] pgmap v2229: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:03.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:03 smithi051 bash[18409]: cluster 2020-06-27T05:51:02.477185+0000 mgr.x (mgr.34109) 2153 : cluster [DBG] pgmap v2230: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:03.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:03 smithi031 bash[18426]: cluster 2020-06-27T05:51:02.477185+0000 mgr.x (mgr.34109) 2153 : cluster [DBG] pgmap v2230: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:03.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:03 smithi031 bash[22603]: cluster 2020-06-27T05:51:02.477185+0000 mgr.x (mgr.34109) 2153 : cluster [DBG] pgmap v2230: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:05.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:05 smithi051 bash[18409]: cluster 2020-06-27T05:51:04.478908+0000 mgr.x (mgr.34109) 2154 : cluster [DBG] pgmap v2231: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:05.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:05 smithi031 bash[22603]: cluster 2020-06-27T05:51:04.478908+0000 mgr.x (mgr.34109) 2154 : cluster [DBG] pgmap v2231: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:05.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:05 smithi031 bash[18426]: cluster 2020-06-27T05:51:04.478908+0000 mgr.x (mgr.34109) 2154 : cluster [DBG] pgmap v2231: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:07.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:07 smithi051 bash[18409]: cluster 2020-06-27T05:51:06.480743+0000 mgr.x (mgr.34109) 2155 : cluster [DBG] pgmap v2232: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:07.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:07 smithi031 bash[18426]: cluster 2020-06-27T05:51:06.480743+0000 mgr.x (mgr.34109) 2155 : cluster [DBG] pgmap v2232: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:07.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:07 smithi031 bash[22603]: cluster 2020-06-27T05:51:06.480743+0000 mgr.x (mgr.34109) 2155 : cluster [DBG] pgmap v2232: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:09.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:09 smithi051 bash[18409]: cluster 2020-06-27T05:51:08.482377+0000 mgr.x (mgr.34109) 2156 : cluster [DBG] pgmap v2233: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:09.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:09 smithi031 bash[22603]: cluster 2020-06-27T05:51:08.482377+0000 mgr.x (mgr.34109) 2156 : cluster [DBG] pgmap v2233: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:09.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:09 smithi031 bash[18426]: cluster 2020-06-27T05:51:08.482377+0000 mgr.x (mgr.34109) 2156 : cluster [DBG] pgmap v2233: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:11.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:11 smithi051 bash[18409]: cluster 2020-06-27T05:51:10.483963+0000 mgr.x (mgr.34109) 2157 : cluster [DBG] pgmap v2234: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:11.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:11 smithi031 bash[18426]: cluster 2020-06-27T05:51:10.483963+0000 mgr.x (mgr.34109) 2157 : cluster [DBG] pgmap v2234: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:11.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:11 smithi031 bash[22603]: cluster 2020-06-27T05:51:10.483963+0000 mgr.x (mgr.34109) 2157 : cluster [DBG] pgmap v2234: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:13.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:13 smithi051 bash[18409]: cluster 2020-06-27T05:51:12.485716+0000 mgr.x (mgr.34109) 2158 : cluster [DBG] pgmap v2235: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:13.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:13 smithi031 bash[18426]: cluster 2020-06-27T05:51:12.485716+0000 mgr.x (mgr.34109) 2158 : cluster [DBG] pgmap v2235: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:13.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:13 smithi031 bash[22603]: cluster 2020-06-27T05:51:12.485716+0000 mgr.x (mgr.34109) 2158 : cluster [DBG] pgmap v2235: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:15.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:15 smithi051 bash[18409]: cluster 2020-06-27T05:51:14.487453+0000 mgr.x (mgr.34109) 2159 : cluster [DBG] pgmap v2236: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:15.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:15 smithi031 bash[18426]: cluster 2020-06-27T05:51:14.487453+0000 mgr.x (mgr.34109) 2159 : cluster [DBG] pgmap v2236: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:15.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:15 smithi031 bash[22603]: cluster 2020-06-27T05:51:14.487453+0000 mgr.x (mgr.34109) 2159 : cluster [DBG] pgmap v2236: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:17.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:17 smithi051 bash[18409]: cluster 2020-06-27T05:51:16.489073+0000 mgr.x (mgr.34109) 2160 : cluster [DBG] pgmap v2237: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:17.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:17 smithi031 bash[18426]: cluster 2020-06-27T05:51:16.489073+0000 mgr.x (mgr.34109) 2160 : cluster [DBG] pgmap v2237: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:17.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:17 smithi031 bash[22603]: cluster 2020-06-27T05:51:16.489073+0000 mgr.x (mgr.34109) 2160 : cluster [DBG] pgmap v2237: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:18.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:18 smithi051 bash[18409]: cluster 2020-06-27T05:51:18.490749+0000 mgr.x (mgr.34109) 2161 : cluster [DBG] pgmap v2238: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:18 smithi031 bash[18426]: cluster 2020-06-27T05:51:18.490749+0000 mgr.x (mgr.34109) 2161 : cluster [DBG] pgmap v2238: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:18 smithi031 bash[22603]: cluster 2020-06-27T05:51:18.490749+0000 mgr.x (mgr.34109) 2161 : cluster [DBG] pgmap v2238: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:21.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:21 smithi051 bash[18409]: cluster 2020-06-27T05:51:20.492308+0000 mgr.x (mgr.34109) 2162 : cluster [DBG] pgmap v2239: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:21.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:21 smithi031 bash[18426]: cluster 2020-06-27T05:51:20.492308+0000 mgr.x (mgr.34109) 2162 : cluster [DBG] pgmap v2239: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:21.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:21 smithi031 bash[22603]: cluster 2020-06-27T05:51:20.492308+0000 mgr.x (mgr.34109) 2162 : cluster [DBG] pgmap v2239: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:23.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:23 smithi051 bash[18409]: cluster 2020-06-27T05:51:22.493910+0000 mgr.x (mgr.34109) 2163 : cluster [DBG] pgmap v2240: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:23.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:23 smithi031 bash[18426]: cluster 2020-06-27T05:51:22.493910+0000 mgr.x (mgr.34109) 2163 : cluster [DBG] pgmap v2240: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:23.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:23 smithi031 bash[22603]: cluster 2020-06-27T05:51:22.493910+0000 mgr.x (mgr.34109) 2163 : cluster [DBG] pgmap v2240: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:25.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:25 smithi051 bash[18409]: cluster 2020-06-27T05:51:24.495508+0000 mgr.x (mgr.34109) 2164 : cluster [DBG] pgmap v2241: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:25.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:25 smithi031 bash[18426]: cluster 2020-06-27T05:51:24.495508+0000 mgr.x (mgr.34109) 2164 : cluster [DBG] pgmap v2241: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:25.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:25 smithi031 bash[22603]: cluster 2020-06-27T05:51:24.495508+0000 mgr.x (mgr.34109) 2164 : cluster [DBG] pgmap v2241: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:26.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:26 smithi051 bash[18409]: cluster 2020-06-27T05:51:26.497171+0000 mgr.x (mgr.34109) 2165 : cluster [DBG] pgmap v2242: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:26.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:26 smithi031 bash[18426]: cluster 2020-06-27T05:51:26.497171+0000 mgr.x (mgr.34109) 2165 : cluster [DBG] pgmap v2242: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:26.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:26 smithi031 bash[22603]: cluster 2020-06-27T05:51:26.497171+0000 mgr.x (mgr.34109) 2165 : cluster [DBG] pgmap v2242: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:29.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:29 smithi051 bash[18409]: cluster 2020-06-27T05:51:28.498880+0000 mgr.x (mgr.34109) 2166 : cluster [DBG] pgmap v2243: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:29.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:29 smithi031 bash[18426]: cluster 2020-06-27T05:51:28.498880+0000 mgr.x (mgr.34109) 2166 : cluster [DBG] pgmap v2243: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:29.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:29 smithi031 bash[22603]: cluster 2020-06-27T05:51:28.498880+0000 mgr.x (mgr.34109) 2166 : cluster [DBG] pgmap v2243: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:31.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:31 smithi051 bash[18409]: cluster 2020-06-27T05:51:30.500473+0000 mgr.x (mgr.34109) 2167 : cluster [DBG] pgmap v2244: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:31.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:31 smithi031 bash[18426]: cluster 2020-06-27T05:51:30.500473+0000 mgr.x (mgr.34109) 2167 : cluster [DBG] pgmap v2244: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:31.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:31 smithi031 bash[22603]: cluster 2020-06-27T05:51:30.500473+0000 mgr.x (mgr.34109) 2167 : cluster [DBG] pgmap v2244: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:33.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:33 smithi051 bash[18409]: cluster 2020-06-27T05:51:32.502084+0000 mgr.x (mgr.34109) 2168 : cluster [DBG] pgmap v2245: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:33.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:33 smithi031 bash[18426]: cluster 2020-06-27T05:51:32.502084+0000 mgr.x (mgr.34109) 2168 : cluster [DBG] pgmap v2245: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:33.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:33 smithi031 bash[22603]: cluster 2020-06-27T05:51:32.502084+0000 mgr.x (mgr.34109) 2168 : cluster [DBG] pgmap v2245: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:34.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:34 smithi051 bash[18409]: cluster 2020-06-27T05:51:34.503686+0000 mgr.x (mgr.34109) 2169 : cluster [DBG] pgmap v2246: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:34 smithi031 bash[18426]: cluster 2020-06-27T05:51:34.503686+0000 mgr.x (mgr.34109) 2169 : cluster [DBG] pgmap v2246: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:34 smithi031 bash[22603]: cluster 2020-06-27T05:51:34.503686+0000 mgr.x (mgr.34109) 2169 : cluster [DBG] pgmap v2246: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:37.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:37 smithi051 bash[18409]: cluster 2020-06-27T05:51:36.505363+0000 mgr.x (mgr.34109) 2170 : cluster [DBG] pgmap v2247: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:37.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:37 smithi031 bash[18426]: cluster 2020-06-27T05:51:36.505363+0000 mgr.x (mgr.34109) 2170 : cluster [DBG] pgmap v2247: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:37.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:37 smithi031 bash[22603]: cluster 2020-06-27T05:51:36.505363+0000 mgr.x (mgr.34109) 2170 : cluster [DBG] pgmap v2247: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:38.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:38 smithi051 bash[18409]: cluster 2020-06-27T05:51:38.507090+0000 mgr.x (mgr.34109) 2171 : cluster [DBG] pgmap v2248: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:38 smithi031 bash[18426]: cluster 2020-06-27T05:51:38.507090+0000 mgr.x (mgr.34109) 2171 : cluster [DBG] pgmap v2248: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:38 smithi031 bash[22603]: cluster 2020-06-27T05:51:38.507090+0000 mgr.x (mgr.34109) 2171 : cluster [DBG] pgmap v2248: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:41 smithi051 bash[18409]: cluster 2020-06-27T05:51:40.508646+0000 mgr.x (mgr.34109) 2172 : cluster [DBG] pgmap v2249: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:41 smithi031 bash[18426]: cluster 2020-06-27T05:51:40.508646+0000 mgr.x (mgr.34109) 2172 : cluster [DBG] pgmap v2249: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:41.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:41 smithi031 bash[22603]: cluster 2020-06-27T05:51:40.508646+0000 mgr.x (mgr.34109) 2172 : cluster [DBG] pgmap v2249: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:42.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:42 smithi051 bash[18409]: cluster 2020-06-27T05:51:42.510285+0000 mgr.x (mgr.34109) 2173 : cluster [DBG] pgmap v2250: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:42.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:42 smithi031 bash[18426]: cluster 2020-06-27T05:51:42.510285+0000 mgr.x (mgr.34109) 2173 : cluster [DBG] pgmap v2250: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:42.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:42 smithi031 bash[22603]: cluster 2020-06-27T05:51:42.510285+0000 mgr.x (mgr.34109) 2173 : cluster [DBG] pgmap v2250: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:44.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:44 smithi051 bash[18409]: cluster 2020-06-27T05:51:44.511911+0000 mgr.x (mgr.34109) 2174 : cluster [DBG] pgmap v2251: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:44 smithi031 bash[18426]: cluster 2020-06-27T05:51:44.511911+0000 mgr.x (mgr.34109) 2174 : cluster [DBG] pgmap v2251: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:44 smithi031 bash[22603]: cluster 2020-06-27T05:51:44.511911+0000 mgr.x (mgr.34109) 2174 : cluster [DBG] pgmap v2251: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:46.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:46 smithi051 bash[18409]: cluster 2020-06-27T05:51:46.513477+0000 mgr.x (mgr.34109) 2175 : cluster [DBG] pgmap v2252: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:46 smithi031 bash[18426]: cluster 2020-06-27T05:51:46.513477+0000 mgr.x (mgr.34109) 2175 : cluster [DBG] pgmap v2252: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:46.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:46 smithi031 bash[22603]: cluster 2020-06-27T05:51:46.513477+0000 mgr.x (mgr.34109) 2175 : cluster [DBG] pgmap v2252: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:48.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:48 smithi051 bash[18409]: cluster 2020-06-27T05:51:48.515155+0000 mgr.x (mgr.34109) 2176 : cluster [DBG] pgmap v2253: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:48.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:48 smithi031 bash[18426]: cluster 2020-06-27T05:51:48.515155+0000 mgr.x (mgr.34109) 2176 : cluster [DBG] pgmap v2253: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:48.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:48 smithi031 bash[22603]: cluster 2020-06-27T05:51:48.515155+0000 mgr.x (mgr.34109) 2176 : cluster [DBG] pgmap v2253: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:51.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:51 smithi051 bash[18409]: cluster 2020-06-27T05:51:50.516845+0000 mgr.x (mgr.34109) 2177 : cluster [DBG] pgmap v2254: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:51.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:51 smithi031 bash[18426]: cluster 2020-06-27T05:51:50.516845+0000 mgr.x (mgr.34109) 2177 : cluster [DBG] pgmap v2254: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:51.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:51 smithi031 bash[22603]: cluster 2020-06-27T05:51:50.516845+0000 mgr.x (mgr.34109) 2177 : cluster [DBG] pgmap v2254: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:52 smithi051 bash[18409]: cluster 2020-06-27T05:51:52.518467+0000 mgr.x (mgr.34109) 2178 : cluster [DBG] pgmap v2255: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:52 smithi031 bash[18426]: cluster 2020-06-27T05:51:52.518467+0000 mgr.x (mgr.34109) 2178 : cluster [DBG] pgmap v2255: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:52 smithi031 bash[22603]: cluster 2020-06-27T05:51:52.518467+0000 mgr.x (mgr.34109) 2178 : cluster [DBG] pgmap v2255: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:54.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:54 smithi051 bash[18409]: cluster 2020-06-27T05:51:54.520077+0000 mgr.x (mgr.34109) 2179 : cluster [DBG] pgmap v2256: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:54.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:54 smithi031 bash[18426]: cluster 2020-06-27T05:51:54.520077+0000 mgr.x (mgr.34109) 2179 : cluster [DBG] pgmap v2256: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:54 smithi031 bash[22603]: cluster 2020-06-27T05:51:54.520077+0000 mgr.x (mgr.34109) 2179 : cluster [DBG] pgmap v2256: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:56.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:56 smithi051 bash[18409]: cluster 2020-06-27T05:51:56.521667+0000 mgr.x (mgr.34109) 2180 : cluster [DBG] pgmap v2257: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:56.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:56 smithi031 bash[18426]: cluster 2020-06-27T05:51:56.521667+0000 mgr.x (mgr.34109) 2180 : cluster [DBG] pgmap v2257: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:56.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:56 smithi031 bash[22603]: cluster 2020-06-27T05:51:56.521667+0000 mgr.x (mgr.34109) 2180 : cluster [DBG] pgmap v2257: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:58.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:51:58 smithi051 bash[18409]: cluster 2020-06-27T05:51:58.523269+0000 mgr.x (mgr.34109) 2181 : cluster [DBG] pgmap v2258: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:58.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:51:58 smithi031 bash[18426]: cluster 2020-06-27T05:51:58.523269+0000 mgr.x (mgr.34109) 2181 : cluster [DBG] pgmap v2258: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:51:58.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:51:58 smithi031 bash[22603]: cluster 2020-06-27T05:51:58.523269+0000 mgr.x (mgr.34109) 2181 : cluster [DBG] pgmap v2258: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:01.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:01 smithi051 bash[18409]: cluster 2020-06-27T05:52:00.524985+0000 mgr.x (mgr.34109) 2182 : cluster [DBG] pgmap v2259: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:01.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:01 smithi031 bash[18426]: cluster 2020-06-27T05:52:00.524985+0000 mgr.x (mgr.34109) 2182 : cluster [DBG] pgmap v2259: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:01.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:01 smithi031 bash[22603]: cluster 2020-06-27T05:52:00.524985+0000 mgr.x (mgr.34109) 2182 : cluster [DBG] pgmap v2259: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:02.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:02 smithi051 bash[18409]: cluster 2020-06-27T05:52:02.526563+0000 mgr.x (mgr.34109) 2183 : cluster [DBG] pgmap v2260: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:02.982 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:02 smithi031 bash[22603]: cluster 2020-06-27T05:52:02.526563+0000 mgr.x (mgr.34109) 2183 : cluster [DBG] pgmap v2260: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:02.982 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:02 smithi031 bash[18426]: cluster 2020-06-27T05:52:02.526563+0000 mgr.x (mgr.34109) 2183 : cluster [DBG] pgmap v2260: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:04.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:04 smithi051 bash[18409]: cluster 2020-06-27T05:52:04.528174+0000 mgr.x (mgr.34109) 2184 : cluster [DBG] pgmap v2261: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:04.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:04 smithi031 bash[18426]: cluster 2020-06-27T05:52:04.528174+0000 mgr.x (mgr.34109) 2184 : cluster [DBG] pgmap v2261: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:04.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:04 smithi031 bash[22603]: cluster 2020-06-27T05:52:04.528174+0000 mgr.x (mgr.34109) 2184 : cluster [DBG] pgmap v2261: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:06.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:06 smithi051 bash[18409]: cluster 2020-06-27T05:52:06.529823+0000 mgr.x (mgr.34109) 2185 : cluster [DBG] pgmap v2262: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:06.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:06 smithi031 bash[18426]: cluster 2020-06-27T05:52:06.529823+0000 mgr.x (mgr.34109) 2185 : cluster [DBG] pgmap v2262: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:06.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:06 smithi031 bash[22603]: cluster 2020-06-27T05:52:06.529823+0000 mgr.x (mgr.34109) 2185 : cluster [DBG] pgmap v2262: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:08.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:08 smithi051 bash[18409]: cluster 2020-06-27T05:52:08.531516+0000 mgr.x (mgr.34109) 2186 : cluster [DBG] pgmap v2263: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:08.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:08 smithi031 bash[22603]: cluster 2020-06-27T05:52:08.531516+0000 mgr.x (mgr.34109) 2186 : cluster [DBG] pgmap v2263: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:08.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:08 smithi031 bash[18426]: cluster 2020-06-27T05:52:08.531516+0000 mgr.x (mgr.34109) 2186 : cluster [DBG] pgmap v2263: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:11.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:11 smithi051 bash[18409]: cluster 2020-06-27T05:52:10.533156+0000 mgr.x (mgr.34109) 2187 : cluster [DBG] pgmap v2264: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:11.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:11 smithi031 bash[18426]: cluster 2020-06-27T05:52:10.533156+0000 mgr.x (mgr.34109) 2187 : cluster [DBG] pgmap v2264: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:11.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:11 smithi031 bash[22603]: cluster 2020-06-27T05:52:10.533156+0000 mgr.x (mgr.34109) 2187 : cluster [DBG] pgmap v2264: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:12.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:12 smithi051 bash[18409]: cluster 2020-06-27T05:52:12.534747+0000 mgr.x (mgr.34109) 2188 : cluster [DBG] pgmap v2265: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:12 smithi031 bash[18426]: cluster 2020-06-27T05:52:12.534747+0000 mgr.x (mgr.34109) 2188 : cluster [DBG] pgmap v2265: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:12.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:12 smithi031 bash[22603]: cluster 2020-06-27T05:52:12.534747+0000 mgr.x (mgr.34109) 2188 : cluster [DBG] pgmap v2265: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:14 smithi051 bash[18409]: cluster 2020-06-27T05:52:14.536328+0000 mgr.x (mgr.34109) 2189 : cluster [DBG] pgmap v2266: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:14 smithi031 bash[18426]: cluster 2020-06-27T05:52:14.536328+0000 mgr.x (mgr.34109) 2189 : cluster [DBG] pgmap v2266: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:14 smithi031 bash[22603]: cluster 2020-06-27T05:52:14.536328+0000 mgr.x (mgr.34109) 2189 : cluster [DBG] pgmap v2266: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:16 smithi051 bash[18409]: cluster 2020-06-27T05:52:16.538007+0000 mgr.x (mgr.34109) 2190 : cluster [DBG] pgmap v2267: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:16 smithi031 bash[18426]: cluster 2020-06-27T05:52:16.538007+0000 mgr.x (mgr.34109) 2190 : cluster [DBG] pgmap v2267: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:16 smithi031 bash[22603]: cluster 2020-06-27T05:52:16.538007+0000 mgr.x (mgr.34109) 2190 : cluster [DBG] pgmap v2267: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:18.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:18 smithi051 bash[18409]: cluster 2020-06-27T05:52:18.539564+0000 mgr.x (mgr.34109) 2191 : cluster [DBG] pgmap v2268: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:18 smithi031 bash[18426]: cluster 2020-06-27T05:52:18.539564+0000 mgr.x (mgr.34109) 2191 : cluster [DBG] pgmap v2268: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:18 smithi031 bash[22603]: cluster 2020-06-27T05:52:18.539564+0000 mgr.x (mgr.34109) 2191 : cluster [DBG] pgmap v2268: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:21.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:21 smithi051 bash[18409]: cluster 2020-06-27T05:52:20.541163+0000 mgr.x (mgr.34109) 2192 : cluster [DBG] pgmap v2269: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:21.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:21 smithi031 bash[18426]: cluster 2020-06-27T05:52:20.541163+0000 mgr.x (mgr.34109) 2192 : cluster [DBG] pgmap v2269: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:21.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:21 smithi031 bash[22603]: cluster 2020-06-27T05:52:20.541163+0000 mgr.x (mgr.34109) 2192 : cluster [DBG] pgmap v2269: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:22 smithi051 bash[18409]: cluster 2020-06-27T05:52:22.542905+0000 mgr.x (mgr.34109) 2193 : cluster [DBG] pgmap v2270: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:22.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:22 smithi031 bash[18426]: cluster 2020-06-27T05:52:22.542905+0000 mgr.x (mgr.34109) 2193 : cluster [DBG] pgmap v2270: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:22.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:22 smithi031 bash[22603]: cluster 2020-06-27T05:52:22.542905+0000 mgr.x (mgr.34109) 2193 : cluster [DBG] pgmap v2270: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:24 smithi051 bash[18409]: cluster 2020-06-27T05:52:24.544546+0000 mgr.x (mgr.34109) 2194 : cluster [DBG] pgmap v2271: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:24.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:24 smithi031 bash[18426]: cluster 2020-06-27T05:52:24.544546+0000 mgr.x (mgr.34109) 2194 : cluster [DBG] pgmap v2271: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:24 smithi031 bash[22603]: cluster 2020-06-27T05:52:24.544546+0000 mgr.x (mgr.34109) 2194 : cluster [DBG] pgmap v2271: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:26.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:26 smithi051 bash[18409]: cluster 2020-06-27T05:52:26.546138+0000 mgr.x (mgr.34109) 2195 : cluster [DBG] pgmap v2272: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:26 smithi031 bash[18426]: cluster 2020-06-27T05:52:26.546138+0000 mgr.x (mgr.34109) 2195 : cluster [DBG] pgmap v2272: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:26.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:26 smithi031 bash[22603]: cluster 2020-06-27T05:52:26.546138+0000 mgr.x (mgr.34109) 2195 : cluster [DBG] pgmap v2272: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:28.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:28 smithi051 bash[18409]: cluster 2020-06-27T05:52:28.547841+0000 mgr.x (mgr.34109) 2196 : cluster [DBG] pgmap v2273: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:28.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:28 smithi031 bash[18426]: cluster 2020-06-27T05:52:28.547841+0000 mgr.x (mgr.34109) 2196 : cluster [DBG] pgmap v2273: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:28.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:28 smithi031 bash[22603]: cluster 2020-06-27T05:52:28.547841+0000 mgr.x (mgr.34109) 2196 : cluster [DBG] pgmap v2273: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:31.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:31 smithi051 bash[18409]: cluster 2020-06-27T05:52:30.549583+0000 mgr.x (mgr.34109) 2197 : cluster [DBG] pgmap v2274: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:31.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:31 smithi031 bash[18426]: cluster 2020-06-27T05:52:30.549583+0000 mgr.x (mgr.34109) 2197 : cluster [DBG] pgmap v2274: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:31.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:31 smithi031 bash[22603]: cluster 2020-06-27T05:52:30.549583+0000 mgr.x (mgr.34109) 2197 : cluster [DBG] pgmap v2274: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:32.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:32 smithi051 bash[18409]: cluster 2020-06-27T05:52:32.551219+0000 mgr.x (mgr.34109) 2198 : cluster [DBG] pgmap v2275: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:32.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:32 smithi031 bash[18426]: cluster 2020-06-27T05:52:32.551219+0000 mgr.x (mgr.34109) 2198 : cluster [DBG] pgmap v2275: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:32.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:32 smithi031 bash[22603]: cluster 2020-06-27T05:52:32.551219+0000 mgr.x (mgr.34109) 2198 : cluster [DBG] pgmap v2275: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:34.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:34 smithi051 bash[18409]: cluster 2020-06-27T05:52:34.552773+0000 mgr.x (mgr.34109) 2199 : cluster [DBG] pgmap v2276: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:34 smithi031 bash[18426]: cluster 2020-06-27T05:52:34.552773+0000 mgr.x (mgr.34109) 2199 : cluster [DBG] pgmap v2276: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:34 smithi031 bash[22603]: cluster 2020-06-27T05:52:34.552773+0000 mgr.x (mgr.34109) 2199 : cluster [DBG] pgmap v2276: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:36 smithi051 bash[18409]: cluster 2020-06-27T05:52:36.554474+0000 mgr.x (mgr.34109) 2200 : cluster [DBG] pgmap v2277: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:36 smithi031 bash[18426]: cluster 2020-06-27T05:52:36.554474+0000 mgr.x (mgr.34109) 2200 : cluster [DBG] pgmap v2277: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:36.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:36 smithi031 bash[22603]: cluster 2020-06-27T05:52:36.554474+0000 mgr.x (mgr.34109) 2200 : cluster [DBG] pgmap v2277: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:38.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:38 smithi051 bash[18409]: cluster 2020-06-27T05:52:38.556008+0000 mgr.x (mgr.34109) 2201 : cluster [DBG] pgmap v2278: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:38 smithi031 bash[18426]: cluster 2020-06-27T05:52:38.556008+0000 mgr.x (mgr.34109) 2201 : cluster [DBG] pgmap v2278: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:38 smithi031 bash[22603]: cluster 2020-06-27T05:52:38.556008+0000 mgr.x (mgr.34109) 2201 : cluster [DBG] pgmap v2278: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:41.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:41 smithi051 bash[18409]: cluster 2020-06-27T05:52:40.557673+0000 mgr.x (mgr.34109) 2202 : cluster [DBG] pgmap v2279: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:41.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:41 smithi031 bash[18426]: cluster 2020-06-27T05:52:40.557673+0000 mgr.x (mgr.34109) 2202 : cluster [DBG] pgmap v2279: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:41.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:41 smithi031 bash[22603]: cluster 2020-06-27T05:52:40.557673+0000 mgr.x (mgr.34109) 2202 : cluster [DBG] pgmap v2279: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:42.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:42 smithi051 bash[18409]: cluster 2020-06-27T05:52:42.559424+0000 mgr.x (mgr.34109) 2203 : cluster [DBG] pgmap v2280: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:42.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:42 smithi031 bash[18426]: cluster 2020-06-27T05:52:42.559424+0000 mgr.x (mgr.34109) 2203 : cluster [DBG] pgmap v2280: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:42.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:42 smithi031 bash[22603]: cluster 2020-06-27T05:52:42.559424+0000 mgr.x (mgr.34109) 2203 : cluster [DBG] pgmap v2280: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:44.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:44 smithi051 bash[18409]: cluster 2020-06-27T05:52:44.561116+0000 mgr.x (mgr.34109) 2204 : cluster [DBG] pgmap v2281: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:44 smithi031 bash[18426]: cluster 2020-06-27T05:52:44.561116+0000 mgr.x (mgr.34109) 2204 : cluster [DBG] pgmap v2281: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:44 smithi031 bash[22603]: cluster 2020-06-27T05:52:44.561116+0000 mgr.x (mgr.34109) 2204 : cluster [DBG] pgmap v2281: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:46.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:46 smithi051 bash[18409]: cluster 2020-06-27T05:52:46.562898+0000 mgr.x (mgr.34109) 2205 : cluster [DBG] pgmap v2282: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:46.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:46 smithi031 bash[22603]: cluster 2020-06-27T05:52:46.562898+0000 mgr.x (mgr.34109) 2205 : cluster [DBG] pgmap v2282: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:46 smithi031 bash[18426]: cluster 2020-06-27T05:52:46.562898+0000 mgr.x (mgr.34109) 2205 : cluster [DBG] pgmap v2282: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:48.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:48 smithi051 bash[18409]: cluster 2020-06-27T05:52:48.564619+0000 mgr.x (mgr.34109) 2206 : cluster [DBG] pgmap v2283: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:48.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:48 smithi031 bash[18426]: cluster 2020-06-27T05:52:48.564619+0000 mgr.x (mgr.34109) 2206 : cluster [DBG] pgmap v2283: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:48.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:48 smithi031 bash[22603]: cluster 2020-06-27T05:52:48.564619+0000 mgr.x (mgr.34109) 2206 : cluster [DBG] pgmap v2283: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:51.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:51 smithi051 bash[18409]: cluster 2020-06-27T05:52:50.566234+0000 mgr.x (mgr.34109) 2207 : cluster [DBG] pgmap v2284: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:51.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:51 smithi031 bash[18426]: cluster 2020-06-27T05:52:50.566234+0000 mgr.x (mgr.34109) 2207 : cluster [DBG] pgmap v2284: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:51.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:51 smithi031 bash[22603]: cluster 2020-06-27T05:52:50.566234+0000 mgr.x (mgr.34109) 2207 : cluster [DBG] pgmap v2284: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:52.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:52 smithi051 bash[18409]: cluster 2020-06-27T05:52:52.567938+0000 mgr.x (mgr.34109) 2208 : cluster [DBG] pgmap v2285: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:52 smithi031 bash[18426]: cluster 2020-06-27T05:52:52.567938+0000 mgr.x (mgr.34109) 2208 : cluster [DBG] pgmap v2285: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:52 smithi031 bash[22603]: cluster 2020-06-27T05:52:52.567938+0000 mgr.x (mgr.34109) 2208 : cluster [DBG] pgmap v2285: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:54.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:54 smithi051 bash[18409]: cluster 2020-06-27T05:52:54.569580+0000 mgr.x (mgr.34109) 2209 : cluster [DBG] pgmap v2286: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:54.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:54 smithi031 bash[18426]: cluster 2020-06-27T05:52:54.569580+0000 mgr.x (mgr.34109) 2209 : cluster [DBG] pgmap v2286: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:54 smithi031 bash[22603]: cluster 2020-06-27T05:52:54.569580+0000 mgr.x (mgr.34109) 2209 : cluster [DBG] pgmap v2286: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:56.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:56 smithi051 bash[18409]: cluster 2020-06-27T05:52:56.571193+0000 mgr.x (mgr.34109) 2210 : cluster [DBG] pgmap v2287: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:56.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:56 smithi031 bash[18426]: cluster 2020-06-27T05:52:56.571193+0000 mgr.x (mgr.34109) 2210 : cluster [DBG] pgmap v2287: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:56.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:56 smithi031 bash[22603]: cluster 2020-06-27T05:52:56.571193+0000 mgr.x (mgr.34109) 2210 : cluster [DBG] pgmap v2287: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:58.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:52:58 smithi051 bash[18409]: cluster 2020-06-27T05:52:58.572906+0000 mgr.x (mgr.34109) 2211 : cluster [DBG] pgmap v2288: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:58.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:52:58 smithi031 bash[18426]: cluster 2020-06-27T05:52:58.572906+0000 mgr.x (mgr.34109) 2211 : cluster [DBG] pgmap v2288: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:52:58.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:52:58 smithi031 bash[22603]: cluster 2020-06-27T05:52:58.572906+0000 mgr.x (mgr.34109) 2211 : cluster [DBG] pgmap v2288: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:02.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:02 smithi051 bash[18409]: cluster 2020-06-27T05:53:00.574523+0000 mgr.x (mgr.34109) 2212 : cluster [DBG] pgmap v2289: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:02.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:02 smithi031 bash[18426]: cluster 2020-06-27T05:53:00.574523+0000 mgr.x (mgr.34109) 2212 : cluster [DBG] pgmap v2289: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:02.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:02 smithi031 bash[22603]: cluster 2020-06-27T05:53:00.574523+0000 mgr.x (mgr.34109) 2212 : cluster [DBG] pgmap v2289: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:04.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:04 smithi051 bash[18409]: cluster 2020-06-27T05:53:02.576068+0000 mgr.x (mgr.34109) 2213 : cluster [DBG] pgmap v2290: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:04.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:04 smithi031 bash[18426]: cluster 2020-06-27T05:53:02.576068+0000 mgr.x (mgr.34109) 2213 : cluster [DBG] pgmap v2290: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:04.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:04 smithi031 bash[22603]: cluster 2020-06-27T05:53:02.576068+0000 mgr.x (mgr.34109) 2213 : cluster [DBG] pgmap v2290: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:06.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:06 smithi051 bash[18409]: cluster 2020-06-27T05:53:04.577835+0000 mgr.x (mgr.34109) 2214 : cluster [DBG] pgmap v2291: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:06.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:06 smithi031 bash[18426]: cluster 2020-06-27T05:53:04.577835+0000 mgr.x (mgr.34109) 2214 : cluster [DBG] pgmap v2291: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:06.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:06 smithi031 bash[22603]: cluster 2020-06-27T05:53:04.577835+0000 mgr.x (mgr.34109) 2214 : cluster [DBG] pgmap v2291: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:08.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:08 smithi051 bash[18409]: cluster 2020-06-27T05:53:06.579436+0000 mgr.x (mgr.34109) 2215 : cluster [DBG] pgmap v2292: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:08.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:08 smithi031 bash[18426]: cluster 2020-06-27T05:53:06.579436+0000 mgr.x (mgr.34109) 2215 : cluster [DBG] pgmap v2292: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:08.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:08 smithi031 bash[22603]: cluster 2020-06-27T05:53:06.579436+0000 mgr.x (mgr.34109) 2215 : cluster [DBG] pgmap v2292: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:10.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:10 smithi051 bash[18409]: cluster 2020-06-27T05:53:08.581047+0000 mgr.x (mgr.34109) 2216 : cluster [DBG] pgmap v2293: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:10.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:10 smithi031 bash[22603]: cluster 2020-06-27T05:53:08.581047+0000 mgr.x (mgr.34109) 2216 : cluster [DBG] pgmap v2293: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:10.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:10 smithi031 bash[18426]: cluster 2020-06-27T05:53:08.581047+0000 mgr.x (mgr.34109) 2216 : cluster [DBG] pgmap v2293: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:12.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:12 smithi051 bash[18409]: cluster 2020-06-27T05:53:10.582633+0000 mgr.x (mgr.34109) 2217 : cluster [DBG] pgmap v2294: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:12.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:12 smithi031 bash[22603]: cluster 2020-06-27T05:53:10.582633+0000 mgr.x (mgr.34109) 2217 : cluster [DBG] pgmap v2294: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:12.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:12 smithi031 bash[18426]: cluster 2020-06-27T05:53:10.582633+0000 mgr.x (mgr.34109) 2217 : cluster [DBG] pgmap v2294: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:14.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:14 smithi051 bash[18409]: cluster 2020-06-27T05:53:12.584340+0000 mgr.x (mgr.34109) 2218 : cluster [DBG] pgmap v2295: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:14.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:14 smithi031 bash[18426]: cluster 2020-06-27T05:53:12.584340+0000 mgr.x (mgr.34109) 2218 : cluster [DBG] pgmap v2295: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:14.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:14 smithi031 bash[22603]: cluster 2020-06-27T05:53:12.584340+0000 mgr.x (mgr.34109) 2218 : cluster [DBG] pgmap v2295: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:16.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:16 smithi051 bash[18409]: cluster 2020-06-27T05:53:14.586046+0000 mgr.x (mgr.34109) 2219 : cluster [DBG] pgmap v2296: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:16.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:16 smithi031 bash[22603]: cluster 2020-06-27T05:53:14.586046+0000 mgr.x (mgr.34109) 2219 : cluster [DBG] pgmap v2296: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:16.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:16 smithi031 bash[18426]: cluster 2020-06-27T05:53:14.586046+0000 mgr.x (mgr.34109) 2219 : cluster [DBG] pgmap v2296: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:18.722 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:18 smithi051 bash[18409]: cluster 2020-06-27T05:53:16.587735+0000 mgr.x (mgr.34109) 2220 : cluster [DBG] pgmap v2297: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:18.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:18 smithi031 bash[18426]: cluster 2020-06-27T05:53:16.587735+0000 mgr.x (mgr.34109) 2220 : cluster [DBG] pgmap v2297: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:18.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:18 smithi031 bash[22603]: cluster 2020-06-27T05:53:16.587735+0000 mgr.x (mgr.34109) 2220 : cluster [DBG] pgmap v2297: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:20.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:20 smithi051 bash[18409]: cluster 2020-06-27T05:53:18.589360+0000 mgr.x (mgr.34109) 2221 : cluster [DBG] pgmap v2298: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:20.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:20 smithi031 bash[18426]: cluster 2020-06-27T05:53:18.589360+0000 mgr.x (mgr.34109) 2221 : cluster [DBG] pgmap v2298: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:20.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:20 smithi031 bash[22603]: cluster 2020-06-27T05:53:18.589360+0000 mgr.x (mgr.34109) 2221 : cluster [DBG] pgmap v2298: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:22.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:22 smithi051 bash[18409]: cluster 2020-06-27T05:53:20.591171+0000 mgr.x (mgr.34109) 2222 : cluster [DBG] pgmap v2299: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:22.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:22 smithi031 bash[18426]: cluster 2020-06-27T05:53:20.591171+0000 mgr.x (mgr.34109) 2222 : cluster [DBG] pgmap v2299: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:22.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:22 smithi031 bash[22603]: cluster 2020-06-27T05:53:20.591171+0000 mgr.x (mgr.34109) 2222 : cluster [DBG] pgmap v2299: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:24.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:24 smithi051 bash[18409]: cluster 2020-06-27T05:53:22.592848+0000 mgr.x (mgr.34109) 2223 : cluster [DBG] pgmap v2300: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:24.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:24 smithi031 bash[18426]: cluster 2020-06-27T05:53:22.592848+0000 mgr.x (mgr.34109) 2223 : cluster [DBG] pgmap v2300: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:24.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:24 smithi031 bash[22603]: cluster 2020-06-27T05:53:22.592848+0000 mgr.x (mgr.34109) 2223 : cluster [DBG] pgmap v2300: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:26.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:26 smithi051 bash[18409]: cluster 2020-06-27T05:53:24.594535+0000 mgr.x (mgr.34109) 2224 : cluster [DBG] pgmap v2301: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:26.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:26 smithi031 bash[18426]: cluster 2020-06-27T05:53:24.594535+0000 mgr.x (mgr.34109) 2224 : cluster [DBG] pgmap v2301: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:26.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:26 smithi031 bash[22603]: cluster 2020-06-27T05:53:24.594535+0000 mgr.x (mgr.34109) 2224 : cluster [DBG] pgmap v2301: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:28.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:28 smithi051 bash[18409]: cluster 2020-06-27T05:53:26.596174+0000 mgr.x (mgr.34109) 2225 : cluster [DBG] pgmap v2302: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:28.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:28 smithi031 bash[22603]: cluster 2020-06-27T05:53:26.596174+0000 mgr.x (mgr.34109) 2225 : cluster [DBG] pgmap v2302: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:28.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:28 smithi031 bash[18426]: cluster 2020-06-27T05:53:26.596174+0000 mgr.x (mgr.34109) 2225 : cluster [DBG] pgmap v2302: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:30.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:30 smithi051 bash[18409]: cluster 2020-06-27T05:53:28.597876+0000 mgr.x (mgr.34109) 2226 : cluster [DBG] pgmap v2303: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:30.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:30 smithi031 bash[18426]: cluster 2020-06-27T05:53:28.597876+0000 mgr.x (mgr.34109) 2226 : cluster [DBG] pgmap v2303: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:30.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:30 smithi031 bash[22603]: cluster 2020-06-27T05:53:28.597876+0000 mgr.x (mgr.34109) 2226 : cluster [DBG] pgmap v2303: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:32.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:32 smithi051 bash[18409]: cluster 2020-06-27T05:53:30.599597+0000 mgr.x (mgr.34109) 2227 : cluster [DBG] pgmap v2304: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:32.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:32 smithi031 bash[18426]: cluster 2020-06-27T05:53:30.599597+0000 mgr.x (mgr.34109) 2227 : cluster [DBG] pgmap v2304: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:32.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:32 smithi031 bash[22603]: cluster 2020-06-27T05:53:30.599597+0000 mgr.x (mgr.34109) 2227 : cluster [DBG] pgmap v2304: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:34.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:34 smithi051 bash[18409]: cluster 2020-06-27T05:53:32.601360+0000 mgr.x (mgr.34109) 2228 : cluster [DBG] pgmap v2305: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:34.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:34 smithi031 bash[18426]: cluster 2020-06-27T05:53:32.601360+0000 mgr.x (mgr.34109) 2228 : cluster [DBG] pgmap v2305: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:34.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:34 smithi031 bash[22603]: cluster 2020-06-27T05:53:32.601360+0000 mgr.x (mgr.34109) 2228 : cluster [DBG] pgmap v2305: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:36.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:36 smithi051 bash[18409]: cluster 2020-06-27T05:53:34.602984+0000 mgr.x (mgr.34109) 2229 : cluster [DBG] pgmap v2306: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:36.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:36 smithi031 bash[18426]: cluster 2020-06-27T05:53:34.602984+0000 mgr.x (mgr.34109) 2229 : cluster [DBG] pgmap v2306: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:36.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:36 smithi031 bash[22603]: cluster 2020-06-27T05:53:34.602984+0000 mgr.x (mgr.34109) 2229 : cluster [DBG] pgmap v2306: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:38.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:38 smithi051 bash[18409]: cluster 2020-06-27T05:53:36.604663+0000 mgr.x (mgr.34109) 2230 : cluster [DBG] pgmap v2307: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:38.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:38 smithi031 bash[18426]: cluster 2020-06-27T05:53:36.604663+0000 mgr.x (mgr.34109) 2230 : cluster [DBG] pgmap v2307: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:38.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:38 smithi031 bash[22603]: cluster 2020-06-27T05:53:36.604663+0000 mgr.x (mgr.34109) 2230 : cluster [DBG] pgmap v2307: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:40.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:40 smithi051 bash[18409]: cluster 2020-06-27T05:53:38.606275+0000 mgr.x (mgr.34109) 2231 : cluster [DBG] pgmap v2308: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:40.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:40 smithi031 bash[18426]: cluster 2020-06-27T05:53:38.606275+0000 mgr.x (mgr.34109) 2231 : cluster [DBG] pgmap v2308: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:40.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:40 smithi031 bash[22603]: cluster 2020-06-27T05:53:38.606275+0000 mgr.x (mgr.34109) 2231 : cluster [DBG] pgmap v2308: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:42.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:42 smithi051 bash[18409]: cluster 2020-06-27T05:53:40.607939+0000 mgr.x (mgr.34109) 2232 : cluster [DBG] pgmap v2309: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:42.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:42 smithi031 bash[18426]: cluster 2020-06-27T05:53:40.607939+0000 mgr.x (mgr.34109) 2232 : cluster [DBG] pgmap v2309: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:42.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:42 smithi031 bash[22603]: cluster 2020-06-27T05:53:40.607939+0000 mgr.x (mgr.34109) 2232 : cluster [DBG] pgmap v2309: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:44.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:44 smithi031 bash[18426]: cluster 2020-06-27T05:53:42.609545+0000 mgr.x (mgr.34109) 2233 : cluster [DBG] pgmap v2310: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:44.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:44 smithi031 bash[22603]: cluster 2020-06-27T05:53:42.609545+0000 mgr.x (mgr.34109) 2233 : cluster [DBG] pgmap v2310: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:44.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:44 smithi051 bash[18409]: cluster 2020-06-27T05:53:42.609545+0000 mgr.x (mgr.34109) 2233 : cluster [DBG] pgmap v2310: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:46.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:46 smithi051 bash[18409]: cluster 2020-06-27T05:53:44.611151+0000 mgr.x (mgr.34109) 2234 : cluster [DBG] pgmap v2311: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:46 smithi031 bash[18426]: cluster 2020-06-27T05:53:44.611151+0000 mgr.x (mgr.34109) 2234 : cluster [DBG] pgmap v2311: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:46.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:46 smithi031 bash[22603]: cluster 2020-06-27T05:53:44.611151+0000 mgr.x (mgr.34109) 2234 : cluster [DBG] pgmap v2311: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:48.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:48 smithi051 bash[18409]: cluster 2020-06-27T05:53:46.612823+0000 mgr.x (mgr.34109) 2235 : cluster [DBG] pgmap v2312: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:48.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:48 smithi031 bash[18426]: cluster 2020-06-27T05:53:46.612823+0000 mgr.x (mgr.34109) 2235 : cluster [DBG] pgmap v2312: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:48.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:48 smithi031 bash[22603]: cluster 2020-06-27T05:53:46.612823+0000 mgr.x (mgr.34109) 2235 : cluster [DBG] pgmap v2312: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:50.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:50 smithi051 bash[18409]: cluster 2020-06-27T05:53:48.614501+0000 mgr.x (mgr.34109) 2236 : cluster [DBG] pgmap v2313: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:50.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:50 smithi031 bash[18426]: cluster 2020-06-27T05:53:48.614501+0000 mgr.x (mgr.34109) 2236 : cluster [DBG] pgmap v2313: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:50.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:50 smithi031 bash[22603]: cluster 2020-06-27T05:53:48.614501+0000 mgr.x (mgr.34109) 2236 : cluster [DBG] pgmap v2313: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:52 smithi051 bash[18409]: cluster 2020-06-27T05:53:50.616113+0000 mgr.x (mgr.34109) 2237 : cluster [DBG] pgmap v2314: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:52.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:52 smithi031 bash[18426]: cluster 2020-06-27T05:53:50.616113+0000 mgr.x (mgr.34109) 2237 : cluster [DBG] pgmap v2314: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:52.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:52 smithi031 bash[22603]: cluster 2020-06-27T05:53:50.616113+0000 mgr.x (mgr.34109) 2237 : cluster [DBG] pgmap v2314: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:54.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:54 smithi051 bash[18409]: cluster 2020-06-27T05:53:52.617782+0000 mgr.x (mgr.34109) 2238 : cluster [DBG] pgmap v2315: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:54.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:54 smithi031 bash[18426]: cluster 2020-06-27T05:53:52.617782+0000 mgr.x (mgr.34109) 2238 : cluster [DBG] pgmap v2315: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:54 smithi031 bash[22603]: cluster 2020-06-27T05:53:52.617782+0000 mgr.x (mgr.34109) 2238 : cluster [DBG] pgmap v2315: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:56.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:56 smithi051 bash[18409]: cluster 2020-06-27T05:53:54.619496+0000 mgr.x (mgr.34109) 2239 : cluster [DBG] pgmap v2316: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:56.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:56 smithi031 bash[18426]: cluster 2020-06-27T05:53:54.619496+0000 mgr.x (mgr.34109) 2239 : cluster [DBG] pgmap v2316: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:56.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:56 smithi031 bash[22603]: cluster 2020-06-27T05:53:54.619496+0000 mgr.x (mgr.34109) 2239 : cluster [DBG] pgmap v2316: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:58.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:53:58 smithi051 bash[18409]: cluster 2020-06-27T05:53:56.621103+0000 mgr.x (mgr.34109) 2240 : cluster [DBG] pgmap v2317: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:58.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:53:58 smithi031 bash[18426]: cluster 2020-06-27T05:53:56.621103+0000 mgr.x (mgr.34109) 2240 : cluster [DBG] pgmap v2317: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:53:58.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:53:58 smithi031 bash[22603]: cluster 2020-06-27T05:53:56.621103+0000 mgr.x (mgr.34109) 2240 : cluster [DBG] pgmap v2317: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:00.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:00 smithi051 bash[18409]: cluster 2020-06-27T05:53:58.622773+0000 mgr.x (mgr.34109) 2241 : cluster [DBG] pgmap v2318: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:00.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:00 smithi031 bash[18426]: cluster 2020-06-27T05:53:58.622773+0000 mgr.x (mgr.34109) 2241 : cluster [DBG] pgmap v2318: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:00.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:00 smithi031 bash[22603]: cluster 2020-06-27T05:53:58.622773+0000 mgr.x (mgr.34109) 2241 : cluster [DBG] pgmap v2318: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:02.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:02 smithi051 bash[18409]: cluster 2020-06-27T05:54:00.624324+0000 mgr.x (mgr.34109) 2242 : cluster [DBG] pgmap v2319: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:02.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:02 smithi031 bash[18426]: cluster 2020-06-27T05:54:00.624324+0000 mgr.x (mgr.34109) 2242 : cluster [DBG] pgmap v2319: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:02.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:02 smithi031 bash[22603]: cluster 2020-06-27T05:54:00.624324+0000 mgr.x (mgr.34109) 2242 : cluster [DBG] pgmap v2319: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:04.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:04 smithi051 bash[18409]: cluster 2020-06-27T05:54:02.625965+0000 mgr.x (mgr.34109) 2243 : cluster [DBG] pgmap v2320: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:04.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:04 smithi031 bash[18426]: cluster 2020-06-27T05:54:02.625965+0000 mgr.x (mgr.34109) 2243 : cluster [DBG] pgmap v2320: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:04.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:04 smithi031 bash[22603]: cluster 2020-06-27T05:54:02.625965+0000 mgr.x (mgr.34109) 2243 : cluster [DBG] pgmap v2320: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:06.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:06 smithi051 bash[18409]: cluster 2020-06-27T05:54:04.627537+0000 mgr.x (mgr.34109) 2244 : cluster [DBG] pgmap v2321: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:06.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:06 smithi031 bash[18426]: cluster 2020-06-27T05:54:04.627537+0000 mgr.x (mgr.34109) 2244 : cluster [DBG] pgmap v2321: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:06.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:06 smithi031 bash[22603]: cluster 2020-06-27T05:54:04.627537+0000 mgr.x (mgr.34109) 2244 : cluster [DBG] pgmap v2321: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:08.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:08 smithi051 bash[18409]: cluster 2020-06-27T05:54:06.629280+0000 mgr.x (mgr.34109) 2245 : cluster [DBG] pgmap v2322: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:08.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:08 smithi031 bash[18426]: cluster 2020-06-27T05:54:06.629280+0000 mgr.x (mgr.34109) 2245 : cluster [DBG] pgmap v2322: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:08.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:08 smithi031 bash[22603]: cluster 2020-06-27T05:54:06.629280+0000 mgr.x (mgr.34109) 2245 : cluster [DBG] pgmap v2322: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:10.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:10 smithi051 bash[18409]: cluster 2020-06-27T05:54:08.630912+0000 mgr.x (mgr.34109) 2246 : cluster [DBG] pgmap v2323: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:10.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:10 smithi031 bash[18426]: cluster 2020-06-27T05:54:08.630912+0000 mgr.x (mgr.34109) 2246 : cluster [DBG] pgmap v2323: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:10.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:10 smithi031 bash[22603]: cluster 2020-06-27T05:54:08.630912+0000 mgr.x (mgr.34109) 2246 : cluster [DBG] pgmap v2323: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:12.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:12 smithi051 bash[18409]: cluster 2020-06-27T05:54:10.632607+0000 mgr.x (mgr.34109) 2247 : cluster [DBG] pgmap v2324: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:12 smithi031 bash[18426]: cluster 2020-06-27T05:54:10.632607+0000 mgr.x (mgr.34109) 2247 : cluster [DBG] pgmap v2324: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:12.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:12 smithi031 bash[22603]: cluster 2020-06-27T05:54:10.632607+0000 mgr.x (mgr.34109) 2247 : cluster [DBG] pgmap v2324: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:14 smithi051 bash[18409]: cluster 2020-06-27T05:54:12.634276+0000 mgr.x (mgr.34109) 2248 : cluster [DBG] pgmap v2325: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:14 smithi031 bash[18426]: cluster 2020-06-27T05:54:12.634276+0000 mgr.x (mgr.34109) 2248 : cluster [DBG] pgmap v2325: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:14 smithi031 bash[22603]: cluster 2020-06-27T05:54:12.634276+0000 mgr.x (mgr.34109) 2248 : cluster [DBG] pgmap v2325: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:16 smithi051 bash[18409]: cluster 2020-06-27T05:54:14.636009+0000 mgr.x (mgr.34109) 2249 : cluster [DBG] pgmap v2326: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:16 smithi031 bash[18426]: cluster 2020-06-27T05:54:14.636009+0000 mgr.x (mgr.34109) 2249 : cluster [DBG] pgmap v2326: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:16 smithi031 bash[22603]: cluster 2020-06-27T05:54:14.636009+0000 mgr.x (mgr.34109) 2249 : cluster [DBG] pgmap v2326: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:18.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:18 smithi051 bash[18409]: cluster 2020-06-27T05:54:16.637697+0000 mgr.x (mgr.34109) 2250 : cluster [DBG] pgmap v2327: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:18 smithi031 bash[18426]: cluster 2020-06-27T05:54:16.637697+0000 mgr.x (mgr.34109) 2250 : cluster [DBG] pgmap v2327: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:18 smithi031 bash[22603]: cluster 2020-06-27T05:54:16.637697+0000 mgr.x (mgr.34109) 2250 : cluster [DBG] pgmap v2327: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:20.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:20 smithi051 bash[18409]: cluster 2020-06-27T05:54:18.639302+0000 mgr.x (mgr.34109) 2251 : cluster [DBG] pgmap v2328: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:20 smithi031 bash[18426]: cluster 2020-06-27T05:54:18.639302+0000 mgr.x (mgr.34109) 2251 : cluster [DBG] pgmap v2328: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:20.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:20 smithi031 bash[22603]: cluster 2020-06-27T05:54:18.639302+0000 mgr.x (mgr.34109) 2251 : cluster [DBG] pgmap v2328: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:22 smithi051 bash[18409]: cluster 2020-06-27T05:54:20.640952+0000 mgr.x (mgr.34109) 2252 : cluster [DBG] pgmap v2329: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:22.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:22 smithi031 bash[18426]: cluster 2020-06-27T05:54:20.640952+0000 mgr.x (mgr.34109) 2252 : cluster [DBG] pgmap v2329: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:22.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:22 smithi031 bash[22603]: cluster 2020-06-27T05:54:20.640952+0000 mgr.x (mgr.34109) 2252 : cluster [DBG] pgmap v2329: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:24 smithi051 bash[18409]: cluster 2020-06-27T05:54:22.642460+0000 mgr.x (mgr.34109) 2253 : cluster [DBG] pgmap v2330: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:24.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:24 smithi031 bash[18426]: cluster 2020-06-27T05:54:22.642460+0000 mgr.x (mgr.34109) 2253 : cluster [DBG] pgmap v2330: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:24 smithi031 bash[22603]: cluster 2020-06-27T05:54:22.642460+0000 mgr.x (mgr.34109) 2253 : cluster [DBG] pgmap v2330: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:26.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:26 smithi051 bash[18409]: cluster 2020-06-27T05:54:24.644169+0000 mgr.x (mgr.34109) 2254 : cluster [DBG] pgmap v2331: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:26.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:26 smithi031 bash[18426]: cluster 2020-06-27T05:54:24.644169+0000 mgr.x (mgr.34109) 2254 : cluster [DBG] pgmap v2331: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:26.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:26 smithi031 bash[22603]: cluster 2020-06-27T05:54:24.644169+0000 mgr.x (mgr.34109) 2254 : cluster [DBG] pgmap v2331: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:28.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:28 smithi051 bash[18409]: cluster 2020-06-27T05:54:26.645765+0000 mgr.x (mgr.34109) 2255 : cluster [DBG] pgmap v2332: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:28.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:28 smithi031 bash[22603]: cluster 2020-06-27T05:54:26.645765+0000 mgr.x (mgr.34109) 2255 : cluster [DBG] pgmap v2332: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:28.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:28 smithi031 bash[18426]: cluster 2020-06-27T05:54:26.645765+0000 mgr.x (mgr.34109) 2255 : cluster [DBG] pgmap v2332: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:30.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:30 smithi051 bash[18409]: cluster 2020-06-27T05:54:28.647341+0000 mgr.x (mgr.34109) 2256 : cluster [DBG] pgmap v2333: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:30.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:30 smithi031 bash[22603]: cluster 2020-06-27T05:54:28.647341+0000 mgr.x (mgr.34109) 2256 : cluster [DBG] pgmap v2333: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:30.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:30 smithi031 bash[18426]: cluster 2020-06-27T05:54:28.647341+0000 mgr.x (mgr.34109) 2256 : cluster [DBG] pgmap v2333: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:32.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:32 smithi051 bash[18409]: cluster 2020-06-27T05:54:30.649071+0000 mgr.x (mgr.34109) 2257 : cluster [DBG] pgmap v2334: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:32.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:32 smithi031 bash[18426]: cluster 2020-06-27T05:54:30.649071+0000 mgr.x (mgr.34109) 2257 : cluster [DBG] pgmap v2334: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:32.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:32 smithi031 bash[22603]: cluster 2020-06-27T05:54:30.649071+0000 mgr.x (mgr.34109) 2257 : cluster [DBG] pgmap v2334: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:34.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:34 smithi051 bash[18409]: cluster 2020-06-27T05:54:32.650653+0000 mgr.x (mgr.34109) 2258 : cluster [DBG] pgmap v2335: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:34.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:34 smithi031 bash[18426]: cluster 2020-06-27T05:54:32.650653+0000 mgr.x (mgr.34109) 2258 : cluster [DBG] pgmap v2335: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:34.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:34 smithi031 bash[22603]: cluster 2020-06-27T05:54:32.650653+0000 mgr.x (mgr.34109) 2258 : cluster [DBG] pgmap v2335: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:36.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:36 smithi051 bash[18409]: cluster 2020-06-27T05:54:34.652208+0000 mgr.x (mgr.34109) 2259 : cluster [DBG] pgmap v2336: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:36.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:36 smithi031 bash[18426]: cluster 2020-06-27T05:54:34.652208+0000 mgr.x (mgr.34109) 2259 : cluster [DBG] pgmap v2336: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:36.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:36 smithi031 bash[22603]: cluster 2020-06-27T05:54:34.652208+0000 mgr.x (mgr.34109) 2259 : cluster [DBG] pgmap v2336: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:38.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:38 smithi051 bash[18409]: cluster 2020-06-27T05:54:36.653912+0000 mgr.x (mgr.34109) 2260 : cluster [DBG] pgmap v2337: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:38.732 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:38 smithi031 bash[18426]: cluster 2020-06-27T05:54:36.653912+0000 mgr.x (mgr.34109) 2260 : cluster [DBG] pgmap v2337: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:38.733 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:38 smithi031 bash[22603]: cluster 2020-06-27T05:54:36.653912+0000 mgr.x (mgr.34109) 2260 : cluster [DBG] pgmap v2337: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:40.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:40 smithi051 bash[18409]: cluster 2020-06-27T05:54:38.655543+0000 mgr.x (mgr.34109) 2261 : cluster [DBG] pgmap v2338: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:40.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:40 smithi031 bash[18426]: cluster 2020-06-27T05:54:38.655543+0000 mgr.x (mgr.34109) 2261 : cluster [DBG] pgmap v2338: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:40.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:40 smithi031 bash[22603]: cluster 2020-06-27T05:54:38.655543+0000 mgr.x (mgr.34109) 2261 : cluster [DBG] pgmap v2338: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:42.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:42 smithi051 bash[18409]: cluster 2020-06-27T05:54:40.657241+0000 mgr.x (mgr.34109) 2262 : cluster [DBG] pgmap v2339: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:42.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:42 smithi031 bash[18426]: cluster 2020-06-27T05:54:40.657241+0000 mgr.x (mgr.34109) 2262 : cluster [DBG] pgmap v2339: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:42.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:42 smithi031 bash[22603]: cluster 2020-06-27T05:54:40.657241+0000 mgr.x (mgr.34109) 2262 : cluster [DBG] pgmap v2339: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:44.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:44 smithi051 bash[18409]: cluster 2020-06-27T05:54:42.658822+0000 mgr.x (mgr.34109) 2263 : cluster [DBG] pgmap v2340: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:44.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:44 smithi031 bash[18426]: cluster 2020-06-27T05:54:42.658822+0000 mgr.x (mgr.34109) 2263 : cluster [DBG] pgmap v2340: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:44.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:44 smithi031 bash[22603]: cluster 2020-06-27T05:54:42.658822+0000 mgr.x (mgr.34109) 2263 : cluster [DBG] pgmap v2340: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:46.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:46 smithi051 bash[18409]: cluster 2020-06-27T05:54:44.660399+0000 mgr.x (mgr.34109) 2264 : cluster [DBG] pgmap v2341: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:46.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:46 smithi031 bash[18426]: cluster 2020-06-27T05:54:44.660399+0000 mgr.x (mgr.34109) 2264 : cluster [DBG] pgmap v2341: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:46.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:46 smithi031 bash[22603]: cluster 2020-06-27T05:54:44.660399+0000 mgr.x (mgr.34109) 2264 : cluster [DBG] pgmap v2341: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:48.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:48 smithi051 bash[18409]: cluster 2020-06-27T05:54:46.661968+0000 mgr.x (mgr.34109) 2265 : cluster [DBG] pgmap v2342: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:48.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:48 smithi031 bash[22603]: cluster 2020-06-27T05:54:46.661968+0000 mgr.x (mgr.34109) 2265 : cluster [DBG] pgmap v2342: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:48.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:48 smithi031 bash[18426]: cluster 2020-06-27T05:54:46.661968+0000 mgr.x (mgr.34109) 2265 : cluster [DBG] pgmap v2342: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:50.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:50 smithi051 bash[18409]: cluster 2020-06-27T05:54:48.663573+0000 mgr.x (mgr.34109) 2266 : cluster [DBG] pgmap v2343: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:50.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:50 smithi031 bash[22603]: cluster 2020-06-27T05:54:48.663573+0000 mgr.x (mgr.34109) 2266 : cluster [DBG] pgmap v2343: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:50.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:50 smithi031 bash[18426]: cluster 2020-06-27T05:54:48.663573+0000 mgr.x (mgr.34109) 2266 : cluster [DBG] pgmap v2343: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:52.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:52 smithi051 bash[18409]: cluster 2020-06-27T05:54:50.665272+0000 mgr.x (mgr.34109) 2267 : cluster [DBG] pgmap v2344: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:52.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:52 smithi031 bash[18426]: cluster 2020-06-27T05:54:50.665272+0000 mgr.x (mgr.34109) 2267 : cluster [DBG] pgmap v2344: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:52.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:52 smithi031 bash[22603]: cluster 2020-06-27T05:54:50.665272+0000 mgr.x (mgr.34109) 2267 : cluster [DBG] pgmap v2344: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:54.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:54 smithi051 bash[18409]: cluster 2020-06-27T05:54:52.667108+0000 mgr.x (mgr.34109) 2268 : cluster [DBG] pgmap v2345: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:54.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:54 smithi031 bash[18426]: cluster 2020-06-27T05:54:52.667108+0000 mgr.x (mgr.34109) 2268 : cluster [DBG] pgmap v2345: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:54.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:54 smithi031 bash[22603]: cluster 2020-06-27T05:54:52.667108+0000 mgr.x (mgr.34109) 2268 : cluster [DBG] pgmap v2345: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:56.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:56 smithi051 bash[18409]: cluster 2020-06-27T05:54:54.668710+0000 mgr.x (mgr.34109) 2269 : cluster [DBG] pgmap v2346: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:56.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:56 smithi031 bash[18426]: cluster 2020-06-27T05:54:54.668710+0000 mgr.x (mgr.34109) 2269 : cluster [DBG] pgmap v2346: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:56.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:56 smithi031 bash[22603]: cluster 2020-06-27T05:54:54.668710+0000 mgr.x (mgr.34109) 2269 : cluster [DBG] pgmap v2346: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:58.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:54:58 smithi051 bash[18409]: cluster 2020-06-27T05:54:56.670216+0000 mgr.x (mgr.34109) 2270 : cluster [DBG] pgmap v2347: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:58.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:54:58 smithi031 bash[18426]: cluster 2020-06-27T05:54:56.670216+0000 mgr.x (mgr.34109) 2270 : cluster [DBG] pgmap v2347: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:54:58.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:54:58 smithi031 bash[22603]: cluster 2020-06-27T05:54:56.670216+0000 mgr.x (mgr.34109) 2270 : cluster [DBG] pgmap v2347: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:00.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:00 smithi051 bash[18409]: cluster 2020-06-27T05:54:58.671869+0000 mgr.x (mgr.34109) 2271 : cluster [DBG] pgmap v2348: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:00.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:00 smithi031 bash[18426]: cluster 2020-06-27T05:54:58.671869+0000 mgr.x (mgr.34109) 2271 : cluster [DBG] pgmap v2348: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:00.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:00 smithi031 bash[22603]: cluster 2020-06-27T05:54:58.671869+0000 mgr.x (mgr.34109) 2271 : cluster [DBG] pgmap v2348: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:02.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:02 smithi051 bash[18409]: cluster 2020-06-27T05:55:00.673456+0000 mgr.x (mgr.34109) 2272 : cluster [DBG] pgmap v2349: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:02.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:02 smithi031 bash[18426]: cluster 2020-06-27T05:55:00.673456+0000 mgr.x (mgr.34109) 2272 : cluster [DBG] pgmap v2349: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:02.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:02 smithi031 bash[22603]: cluster 2020-06-27T05:55:00.673456+0000 mgr.x (mgr.34109) 2272 : cluster [DBG] pgmap v2349: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:04.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:04 smithi051 bash[18409]: cluster 2020-06-27T05:55:02.675187+0000 mgr.x (mgr.34109) 2273 : cluster [DBG] pgmap v2350: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:04.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:04 smithi031 bash[18426]: cluster 2020-06-27T05:55:02.675187+0000 mgr.x (mgr.34109) 2273 : cluster [DBG] pgmap v2350: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:04.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:04 smithi031 bash[22603]: cluster 2020-06-27T05:55:02.675187+0000 mgr.x (mgr.34109) 2273 : cluster [DBG] pgmap v2350: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:06.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:06 smithi051 bash[18409]: cluster 2020-06-27T05:55:04.676959+0000 mgr.x (mgr.34109) 2274 : cluster [DBG] pgmap v2351: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:06.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:06 smithi031 bash[18426]: cluster 2020-06-27T05:55:04.676959+0000 mgr.x (mgr.34109) 2274 : cluster [DBG] pgmap v2351: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:06.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:06 smithi031 bash[22603]: cluster 2020-06-27T05:55:04.676959+0000 mgr.x (mgr.34109) 2274 : cluster [DBG] pgmap v2351: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:08.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:08 smithi031 bash[18426]: cluster 2020-06-27T05:55:06.678655+0000 mgr.x (mgr.34109) 2275 : cluster [DBG] pgmap v2352: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:08.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:08 smithi031 bash[22603]: cluster 2020-06-27T05:55:06.678655+0000 mgr.x (mgr.34109) 2275 : cluster [DBG] pgmap v2352: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:08.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:08 smithi051 bash[18409]: cluster 2020-06-27T05:55:06.678655+0000 mgr.x (mgr.34109) 2275 : cluster [DBG] pgmap v2352: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:10.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:10 smithi051 bash[18409]: cluster 2020-06-27T05:55:08.680383+0000 mgr.x (mgr.34109) 2276 : cluster [DBG] pgmap v2353: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:10.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:10 smithi031 bash[18426]: cluster 2020-06-27T05:55:08.680383+0000 mgr.x (mgr.34109) 2276 : cluster [DBG] pgmap v2353: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:10.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:10 smithi031 bash[22603]: cluster 2020-06-27T05:55:08.680383+0000 mgr.x (mgr.34109) 2276 : cluster [DBG] pgmap v2353: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:12.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:12 smithi051 bash[18409]: cluster 2020-06-27T05:55:10.682106+0000 mgr.x (mgr.34109) 2277 : cluster [DBG] pgmap v2354: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:12 smithi031 bash[18426]: cluster 2020-06-27T05:55:10.682106+0000 mgr.x (mgr.34109) 2277 : cluster [DBG] pgmap v2354: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:12.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:12 smithi031 bash[22603]: cluster 2020-06-27T05:55:10.682106+0000 mgr.x (mgr.34109) 2277 : cluster [DBG] pgmap v2354: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:14 smithi051 bash[18409]: cluster 2020-06-27T05:55:12.683820+0000 mgr.x (mgr.34109) 2278 : cluster [DBG] pgmap v2355: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:14 smithi031 bash[18426]: cluster 2020-06-27T05:55:12.683820+0000 mgr.x (mgr.34109) 2278 : cluster [DBG] pgmap v2355: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:14 smithi031 bash[22603]: cluster 2020-06-27T05:55:12.683820+0000 mgr.x (mgr.34109) 2278 : cluster [DBG] pgmap v2355: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:16 smithi051 bash[18409]: cluster 2020-06-27T05:55:14.685467+0000 mgr.x (mgr.34109) 2279 : cluster [DBG] pgmap v2356: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:16 smithi031 bash[18426]: cluster 2020-06-27T05:55:14.685467+0000 mgr.x (mgr.34109) 2279 : cluster [DBG] pgmap v2356: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:16 smithi031 bash[22603]: cluster 2020-06-27T05:55:14.685467+0000 mgr.x (mgr.34109) 2279 : cluster [DBG] pgmap v2356: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:18.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:18 smithi051 bash[18409]: cluster 2020-06-27T05:55:16.687145+0000 mgr.x (mgr.34109) 2280 : cluster [DBG] pgmap v2357: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:18 smithi031 bash[18426]: cluster 2020-06-27T05:55:16.687145+0000 mgr.x (mgr.34109) 2280 : cluster [DBG] pgmap v2357: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:18 smithi031 bash[22603]: cluster 2020-06-27T05:55:16.687145+0000 mgr.x (mgr.34109) 2280 : cluster [DBG] pgmap v2357: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:20.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:20 smithi051 bash[18409]: cluster 2020-06-27T05:55:18.688803+0000 mgr.x (mgr.34109) 2281 : cluster [DBG] pgmap v2358: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:20 smithi031 bash[18426]: cluster 2020-06-27T05:55:18.688803+0000 mgr.x (mgr.34109) 2281 : cluster [DBG] pgmap v2358: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:20.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:20 smithi031 bash[22603]: cluster 2020-06-27T05:55:18.688803+0000 mgr.x (mgr.34109) 2281 : cluster [DBG] pgmap v2358: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:22 smithi051 bash[18409]: cluster 2020-06-27T05:55:20.690440+0000 mgr.x (mgr.34109) 2282 : cluster [DBG] pgmap v2359: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:22.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:22 smithi031 bash[18426]: cluster 2020-06-27T05:55:20.690440+0000 mgr.x (mgr.34109) 2282 : cluster [DBG] pgmap v2359: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:22.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:22 smithi031 bash[22603]: cluster 2020-06-27T05:55:20.690440+0000 mgr.x (mgr.34109) 2282 : cluster [DBG] pgmap v2359: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:24 smithi051 bash[18409]: cluster 2020-06-27T05:55:22.692066+0000 mgr.x (mgr.34109) 2283 : cluster [DBG] pgmap v2360: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:24.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:24 smithi031 bash[18426]: cluster 2020-06-27T05:55:22.692066+0000 mgr.x (mgr.34109) 2283 : cluster [DBG] pgmap v2360: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:24 smithi031 bash[22603]: cluster 2020-06-27T05:55:22.692066+0000 mgr.x (mgr.34109) 2283 : cluster [DBG] pgmap v2360: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:26.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:26 smithi051 bash[18409]: cluster 2020-06-27T05:55:24.693859+0000 mgr.x (mgr.34109) 2284 : cluster [DBG] pgmap v2361: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:26.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:26 smithi031 bash[22603]: cluster 2020-06-27T05:55:24.693859+0000 mgr.x (mgr.34109) 2284 : cluster [DBG] pgmap v2361: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:26 smithi031 bash[18426]: cluster 2020-06-27T05:55:24.693859+0000 mgr.x (mgr.34109) 2284 : cluster [DBG] pgmap v2361: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:28.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:28 smithi051 bash[18409]: cluster 2020-06-27T05:55:26.695491+0000 mgr.x (mgr.34109) 2285 : cluster [DBG] pgmap v2362: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:28.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:28 smithi031 bash[18426]: cluster 2020-06-27T05:55:26.695491+0000 mgr.x (mgr.34109) 2285 : cluster [DBG] pgmap v2362: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:28.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:28 smithi031 bash[22603]: cluster 2020-06-27T05:55:26.695491+0000 mgr.x (mgr.34109) 2285 : cluster [DBG] pgmap v2362: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:30.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:30 smithi051 bash[18409]: cluster 2020-06-27T05:55:28.697085+0000 mgr.x (mgr.34109) 2286 : cluster [DBG] pgmap v2363: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:30.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:30 smithi031 bash[18426]: cluster 2020-06-27T05:55:28.697085+0000 mgr.x (mgr.34109) 2286 : cluster [DBG] pgmap v2363: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:30.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:30 smithi031 bash[22603]: cluster 2020-06-27T05:55:28.697085+0000 mgr.x (mgr.34109) 2286 : cluster [DBG] pgmap v2363: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:32.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:32 smithi051 bash[18409]: cluster 2020-06-27T05:55:30.698765+0000 mgr.x (mgr.34109) 2287 : cluster [DBG] pgmap v2364: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:32.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:32 smithi031 bash[22603]: cluster 2020-06-27T05:55:30.698765+0000 mgr.x (mgr.34109) 2287 : cluster [DBG] pgmap v2364: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:32.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:32 smithi031 bash[18426]: cluster 2020-06-27T05:55:30.698765+0000 mgr.x (mgr.34109) 2287 : cluster [DBG] pgmap v2364: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:34.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:34 smithi051 bash[18409]: cluster 2020-06-27T05:55:32.700406+0000 mgr.x (mgr.34109) 2288 : cluster [DBG] pgmap v2365: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:34 smithi031 bash[22603]: cluster 2020-06-27T05:55:32.700406+0000 mgr.x (mgr.34109) 2288 : cluster [DBG] pgmap v2365: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:34 smithi031 bash[18426]: cluster 2020-06-27T05:55:32.700406+0000 mgr.x (mgr.34109) 2288 : cluster [DBG] pgmap v2365: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:36 smithi051 bash[18409]: cluster 2020-06-27T05:55:34.702164+0000 mgr.x (mgr.34109) 2289 : cluster [DBG] pgmap v2366: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:36.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:36 smithi031 bash[22603]: cluster 2020-06-27T05:55:34.702164+0000 mgr.x (mgr.34109) 2289 : cluster [DBG] pgmap v2366: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:36 smithi031 bash[18426]: cluster 2020-06-27T05:55:34.702164+0000 mgr.x (mgr.34109) 2289 : cluster [DBG] pgmap v2366: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:38.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:38 smithi051 bash[18409]: cluster 2020-06-27T05:55:36.703839+0000 mgr.x (mgr.34109) 2290 : cluster [DBG] pgmap v2367: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:38 smithi031 bash[22603]: cluster 2020-06-27T05:55:36.703839+0000 mgr.x (mgr.34109) 2290 : cluster [DBG] pgmap v2367: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:38 smithi031 bash[18426]: cluster 2020-06-27T05:55:36.703839+0000 mgr.x (mgr.34109) 2290 : cluster [DBG] pgmap v2367: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:40.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:40 smithi051 bash[18409]: cluster 2020-06-27T05:55:38.705506+0000 mgr.x (mgr.34109) 2291 : cluster [DBG] pgmap v2368: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:40 smithi031 bash[18426]: cluster 2020-06-27T05:55:38.705506+0000 mgr.x (mgr.34109) 2291 : cluster [DBG] pgmap v2368: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:40.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:40 smithi031 bash[22603]: cluster 2020-06-27T05:55:38.705506+0000 mgr.x (mgr.34109) 2291 : cluster [DBG] pgmap v2368: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:42.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:42 smithi051 bash[18409]: cluster 2020-06-27T05:55:40.707129+0000 mgr.x (mgr.34109) 2292 : cluster [DBG] pgmap v2369: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:42.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:42 smithi031 bash[22603]: cluster 2020-06-27T05:55:40.707129+0000 mgr.x (mgr.34109) 2292 : cluster [DBG] pgmap v2369: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:42.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:42 smithi031 bash[18426]: cluster 2020-06-27T05:55:40.707129+0000 mgr.x (mgr.34109) 2292 : cluster [DBG] pgmap v2369: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:44.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:44 smithi051 bash[18409]: cluster 2020-06-27T05:55:42.708887+0000 mgr.x (mgr.34109) 2293 : cluster [DBG] pgmap v2370: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:44 smithi031 bash[22603]: cluster 2020-06-27T05:55:42.708887+0000 mgr.x (mgr.34109) 2293 : cluster [DBG] pgmap v2370: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:44 smithi031 bash[18426]: cluster 2020-06-27T05:55:42.708887+0000 mgr.x (mgr.34109) 2293 : cluster [DBG] pgmap v2370: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:46.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:46 smithi051 bash[18409]: cluster 2020-06-27T05:55:44.710478+0000 mgr.x (mgr.34109) 2294 : cluster [DBG] pgmap v2371: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:46.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:46 smithi031 bash[22603]: cluster 2020-06-27T05:55:44.710478+0000 mgr.x (mgr.34109) 2294 : cluster [DBG] pgmap v2371: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:46 smithi031 bash[18426]: cluster 2020-06-27T05:55:44.710478+0000 mgr.x (mgr.34109) 2294 : cluster [DBG] pgmap v2371: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:48.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:48 smithi051 bash[18409]: cluster 2020-06-27T05:55:46.712087+0000 mgr.x (mgr.34109) 2295 : cluster [DBG] pgmap v2372: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:48.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:48 smithi031 bash[18426]: cluster 2020-06-27T05:55:46.712087+0000 mgr.x (mgr.34109) 2295 : cluster [DBG] pgmap v2372: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:48.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:48 smithi031 bash[22603]: cluster 2020-06-27T05:55:46.712087+0000 mgr.x (mgr.34109) 2295 : cluster [DBG] pgmap v2372: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:50.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:50 smithi051 bash[18409]: cluster 2020-06-27T05:55:48.713801+0000 mgr.x (mgr.34109) 2296 : cluster [DBG] pgmap v2373: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:50.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:50 smithi031 bash[18426]: cluster 2020-06-27T05:55:48.713801+0000 mgr.x (mgr.34109) 2296 : cluster [DBG] pgmap v2373: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:50.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:50 smithi031 bash[22603]: cluster 2020-06-27T05:55:48.713801+0000 mgr.x (mgr.34109) 2296 : cluster [DBG] pgmap v2373: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:52.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:52 smithi051 bash[18409]: cluster 2020-06-27T05:55:50.715446+0000 mgr.x (mgr.34109) 2297 : cluster [DBG] pgmap v2374: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:52 smithi031 bash[22603]: cluster 2020-06-27T05:55:50.715446+0000 mgr.x (mgr.34109) 2297 : cluster [DBG] pgmap v2374: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:52 smithi031 bash[18426]: cluster 2020-06-27T05:55:50.715446+0000 mgr.x (mgr.34109) 2297 : cluster [DBG] pgmap v2374: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:54.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:54 smithi051 bash[18409]: cluster 2020-06-27T05:55:52.717073+0000 mgr.x (mgr.34109) 2298 : cluster [DBG] pgmap v2375: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:54 smithi031 bash[22603]: cluster 2020-06-27T05:55:52.717073+0000 mgr.x (mgr.34109) 2298 : cluster [DBG] pgmap v2375: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:54.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:54 smithi031 bash[18426]: cluster 2020-06-27T05:55:52.717073+0000 mgr.x (mgr.34109) 2298 : cluster [DBG] pgmap v2375: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:56.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:56 smithi051 bash[18409]: cluster 2020-06-27T05:55:54.718795+0000 mgr.x (mgr.34109) 2299 : cluster [DBG] pgmap v2376: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:56.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:56 smithi031 bash[18426]: cluster 2020-06-27T05:55:54.718795+0000 mgr.x (mgr.34109) 2299 : cluster [DBG] pgmap v2376: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:56.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:56 smithi031 bash[22603]: cluster 2020-06-27T05:55:54.718795+0000 mgr.x (mgr.34109) 2299 : cluster [DBG] pgmap v2376: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:57.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:57 smithi051 bash[18409]: cluster 2020-06-27T05:55:56.720424+0000 mgr.x (mgr.34109) 2300 : cluster [DBG] pgmap v2377: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:57.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:57 smithi031 bash[18426]: cluster 2020-06-27T05:55:56.720424+0000 mgr.x (mgr.34109) 2300 : cluster [DBG] pgmap v2377: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:55:57.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:57 smithi031 bash[22603]: cluster 2020-06-27T05:55:56.720424+0000 mgr.x (mgr.34109) 2300 : cluster [DBG] pgmap v2377: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:00.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:55:59 smithi051 bash[18409]: cluster 2020-06-27T05:55:58.722064+0000 mgr.x (mgr.34109) 2301 : cluster [DBG] pgmap v2378: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:00.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:55:59 smithi031 bash[18426]: cluster 2020-06-27T05:55:58.722064+0000 mgr.x (mgr.34109) 2301 : cluster [DBG] pgmap v2378: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:00.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:55:59 smithi031 bash[22603]: cluster 2020-06-27T05:55:58.722064+0000 mgr.x (mgr.34109) 2301 : cluster [DBG] pgmap v2378: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:02.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:02 smithi051 bash[18409]: cluster 2020-06-27T05:56:00.723711+0000 mgr.x (mgr.34109) 2302 : cluster [DBG] pgmap v2379: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:02.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:02 smithi031 bash[18426]: cluster 2020-06-27T05:56:00.723711+0000 mgr.x (mgr.34109) 2302 : cluster [DBG] pgmap v2379: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:02.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:02 smithi031 bash[22603]: cluster 2020-06-27T05:56:00.723711+0000 mgr.x (mgr.34109) 2302 : cluster [DBG] pgmap v2379: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:04.674 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:04 smithi031 bash[22603]: cluster 2020-06-27T05:56:02.725391+0000 mgr.x (mgr.34109) 2303 : cluster [DBG] pgmap v2380: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:04.674 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:04 smithi031 bash[22603]: audit 2020-06-27T05:56:04.208161+0000 mon.b (mon.2) 413 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:56:04.207375\"}"}]: dispatch 2020-06-27T05:56:04.675 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:04 smithi031 bash[22603]: audit 2020-06-27T05:56:04.208691+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:56:04.207375\"}"}]: dispatch 2020-06-27T05:56:04.675 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:04 smithi031 bash[22603]: audit 2020-06-27T05:56:04.211229+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:56:04.207375\"}"}]': finished 2020-06-27T05:56:04.676 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:04 smithi031 bash[22603]: audit 2020-06-27T05:56:04.211976+0000 mon.b (mon.2) 414 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:56:04.210280\"}"}]: dispatch 2020-06-27T05:56:04.676 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:04 smithi031 bash[22603]: audit 2020-06-27T05:56:04.212350+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:56:04.210280\"}"}]: dispatch 2020-06-27T05:56:04.676 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:04 smithi031 bash[22603]: audit 2020-06-27T05:56:04.212461+0000 mon.b (mon.2) 415 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:56:04.677 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:04 smithi031 bash[22603]: audit 2020-06-27T05:56:04.214793+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:56:04.210280\"}"}]': finished 2020-06-27T05:56:04.677 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:04 smithi031 bash[22603]: audit 2020-06-27T05:56:04.216785+0000 mon.b (mon.2) 416 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:56:04.677 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:04 smithi031 bash[18426]: cluster 2020-06-27T05:56:02.725391+0000 mgr.x (mgr.34109) 2303 : cluster [DBG] pgmap v2380: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:04.677 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:04 smithi031 bash[18426]: audit 2020-06-27T05:56:04.208161+0000 mon.b (mon.2) 413 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:56:04.207375\"}"}]: dispatch 2020-06-27T05:56:04.678 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:04 smithi031 bash[18426]: audit 2020-06-27T05:56:04.208691+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:56:04.207375\"}"}]: dispatch 2020-06-27T05:56:04.678 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:04 smithi031 bash[18426]: audit 2020-06-27T05:56:04.211229+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:56:04.207375\"}"}]': finished 2020-06-27T05:56:04.678 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:04 smithi031 bash[18426]: audit 2020-06-27T05:56:04.211976+0000 mon.b (mon.2) 414 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:56:04.210280\"}"}]: dispatch 2020-06-27T05:56:04.679 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:04 smithi031 bash[18426]: audit 2020-06-27T05:56:04.212350+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:56:04.210280\"}"}]: dispatch 2020-06-27T05:56:04.679 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:04 smithi031 bash[18426]: audit 2020-06-27T05:56:04.212461+0000 mon.b (mon.2) 415 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:56:04.679 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:04 smithi031 bash[18426]: audit 2020-06-27T05:56:04.214793+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:56:04.210280\"}"}]': finished 2020-06-27T05:56:04.679 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:04 smithi031 bash[18426]: audit 2020-06-27T05:56:04.216785+0000 mon.b (mon.2) 416 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:56:04.691 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:04 smithi051 bash[18409]: cluster 2020-06-27T05:56:02.725391+0000 mgr.x (mgr.34109) 2303 : cluster [DBG] pgmap v2380: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:04.691 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:04 smithi051 bash[18409]: audit 2020-06-27T05:56:04.208161+0000 mon.b (mon.2) 413 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:56:04.207375\"}"}]: dispatch 2020-06-27T05:56:04.691 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:04 smithi051 bash[18409]: audit 2020-06-27T05:56:04.208691+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:56:04.207375\"}"}]: dispatch 2020-06-27T05:56:04.692 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:04 smithi051 bash[18409]: audit 2020-06-27T05:56:04.211229+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914690\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.914767\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914800\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.914972\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915069\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.915163\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915257\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915293\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.915323\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.915402\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:56:04.207375\"}"}]': finished 2020-06-27T05:56:04.692 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:04 smithi051 bash[18409]: audit 2020-06-27T05:56:04.211976+0000 mon.b (mon.2) 414 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:56:04.210280\"}"}]: dispatch 2020-06-27T05:56:04.692 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:04 smithi051 bash[18409]: audit 2020-06-27T05:56:04.212350+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:56:04.210280\"}"}]: dispatch 2020-06-27T05:56:04.693 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:04 smithi051 bash[18409]: audit 2020-06-27T05:56:04.212461+0000 mon.b (mon.2) 415 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:56:04.693 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:04 smithi051 bash[18409]: audit 2020-06-27T05:56:04.214793+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660216\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660294\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660328\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660526\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660624\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:46:00.660718\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660811\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660847\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:46:00.660878\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:46:00.660957\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:56:04.210280\"}"}]': finished 2020-06-27T05:56:04.693 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:04 smithi051 bash[18409]: audit 2020-06-27T05:56:04.216785+0000 mon.b (mon.2) 416 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-06-27T05:56:06.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:06 smithi051 bash[18409]: cluster 2020-06-27T05:56:04.726750+0000 mgr.x (mgr.34109) 2304 : cluster [DBG] pgmap v2381: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:06.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:06 smithi051 bash[18409]: audit 2020-06-27T05:56:06.111564+0000 mon.b (mon.2) 417 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110059\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110136\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110170\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110346\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110451\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110547\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110640\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110677\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110708\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:56:06.110787\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:56:04.210280\"}"}]: dispatch 2020-06-27T05:56:06.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:06 smithi051 bash[18409]: audit 2020-06-27T05:56:06.112351+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110059\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110136\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110170\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110346\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110451\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110547\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110640\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110677\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110708\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:56:06.110787\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:56:04.210280\"}"}]: dispatch 2020-06-27T05:56:06.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:06 smithi051 bash[18409]: audit 2020-06-27T05:56:06.114879+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110059\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110136\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110170\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110346\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110451\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110547\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110640\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110677\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110708\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:56:06.110787\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:56:04.210280\"}"}]': finished 2020-06-27T05:56:06.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:06 smithi031 bash[22603]: cluster 2020-06-27T05:56:04.726750+0000 mgr.x (mgr.34109) 2304 : cluster [DBG] pgmap v2381: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:06.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:06 smithi031 bash[22603]: audit 2020-06-27T05:56:06.111564+0000 mon.b (mon.2) 417 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110059\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110136\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110170\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110346\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110451\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110547\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110640\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110677\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110708\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:56:06.110787\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:56:04.210280\"}"}]: dispatch 2020-06-27T05:56:06.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:06 smithi031 bash[22603]: audit 2020-06-27T05:56:06.112351+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110059\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110136\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110170\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110346\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110451\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110547\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110640\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110677\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110708\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:56:06.110787\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:56:04.210280\"}"}]: dispatch 2020-06-27T05:56:06.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:06 smithi031 bash[22603]: audit 2020-06-27T05:56:06.114879+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110059\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110136\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110170\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110346\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110451\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110547\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110640\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110677\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110708\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:56:06.110787\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:56:04.210280\"}"}]': finished 2020-06-27T05:56:06.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:06 smithi031 bash[18426]: cluster 2020-06-27T05:56:04.726750+0000 mgr.x (mgr.34109) 2304 : cluster [DBG] pgmap v2381: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:06.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:06 smithi031 bash[18426]: audit 2020-06-27T05:56:06.111564+0000 mon.b (mon.2) 417 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110059\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110136\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110170\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110346\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110451\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110547\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110640\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110677\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110708\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:56:06.110787\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:56:04.210280\"}"}]: dispatch 2020-06-27T05:56:06.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:06 smithi031 bash[18426]: audit 2020-06-27T05:56:06.112351+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110059\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110136\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110170\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110346\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110451\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110547\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110640\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110677\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110708\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:56:06.110787\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:56:04.210280\"}"}]: dispatch 2020-06-27T05:56:06.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:06 smithi031 bash[18426]: audit 2020-06-27T05:56:06.114879+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi031","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"61817385ac1b\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110059\", \"created\": \"2020-06-27T04:39:36.386938\", \"started\": \"2020-06-27T04:39:41.650338\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi031\", \"container_id\": \"5fcf9eda8bfd\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110136\", \"created\": \"2020-06-27T04:41:20.241225\", \"started\": \"2020-06-27T04:41:20.628719\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110170\", \"created\": \"2020-06-27T04:42:27.975089\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110346\", \"created\": \"2020-06-27T04:42:44.178826\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110451\", \"created\": \"2020-06-27T04:43:00.603559\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi031\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.110547\", \"created\": \"2020-06-27T04:43:16.917295\"}, \"rgw.realm.zone.a\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"realm.zone.a\", \"hostname\": \"smithi031\", \"container_id\": \"e94f871d50c8\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110640\", \"created\": \"2020-06-27T04:44:32.817067\", \"started\": \"2020-06-27T04:44:32.950971\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"8233d564daec\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110677\", \"created\": \"2020-06-27T04:44:51.433766\", \"started\": \"2020-06-27T04:44:55.434952\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi031\", \"container_id\": \"f9fb95342d60\", \"container_image_id\": \"0881eb8f169f5556a292b4e2c01d683172b12830a62a9225a98a8e206bb734f0\", \"container_image_name\": \"docker.io/prom/alertmanager:v0.20.0\", \"version\": \"0.20.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.110708\", \"created\": \"2020-06-27T04:45:03.567570\", \"started\": \"2020-06-27T04:45:30.733682\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5a3667cb-5c57-47fb-8c93-da3a3817c975\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"Mx6xuK-jvcn-I3GV-Uycp-C1kC-15bE-RIV3JB\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"82a9c5cf-2ae0-429e-82a6-03b9928e5c98\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"hflzl8-W5g8-pzIj-jiPR-TVJV-lbRZ-2wXP3R\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e06700d6-7863-486c-a5bd-4ea867e8273c\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZRukD6-LRHU-NDQ3-iNdD-dM2D-tY0o-Eh3l5c\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a82dbaf0-14e8-40a8-b0b8-6adfef817f3b\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"WpfcsA-RspR-X1WK-0KFC-e5tl-j1Yt-N1ULcY\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53310008400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HQEW\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:41.696575\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:38.393161\"}, \"mon.c\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:39.641248\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:26.389233\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:42.577001\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-06-27T04:42:59.002837\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:15.288703\"}, \"rgw.realm.zone.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:31.135898\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.885378\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\"], \"last_config\": \"2020-06-27T04:45:25.489379\"}}, \"last_daemon_update\": \"2020-06-27T05:56:06.110787\", \"last_device_update\": \"2020-06-27T05:46:03.621786\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.31\"]}, \"last_host_check\": \"2020-06-27T05:56:04.210280\"}"}]': finished 2020-06-27T05:56:07.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:07 smithi051 bash[18409]: audit 2020-06-27T05:56:06.445537+0000 mon.b (mon.2) 418 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444008\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444084\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444118\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444291\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444388\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444496\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444594\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444631\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444662\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:56:06.444747\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:56:04.207375\"}"}]: dispatch 2020-06-27T05:56:07.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:07 smithi051 bash[18409]: audit 2020-06-27T05:56:06.446029+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444008\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444084\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444118\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444291\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444388\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444496\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444594\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444631\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444662\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:56:06.444747\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:56:04.207375\"}"}]: dispatch 2020-06-27T05:56:07.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:07 smithi051 bash[18409]: audit 2020-06-27T05:56:06.450769+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444008\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444084\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444118\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444291\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444388\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444496\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444594\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444631\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444662\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:56:06.444747\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:56:04.207375\"}"}]': finished 2020-06-27T05:56:07.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:07 smithi051 bash[18409]: audit 2020-06-27T05:56:06.453634+0000 mon.b (mon.2) 419 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:56:07.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:07 smithi051 bash[18409]: audit 2020-06-27T05:56:06.453892+0000 mgr.x (mgr.34109) 2305 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:56:07.720 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:07 smithi051 bash[18409]: audit 2020-06-27T05:56:06.454583+0000 mon.b (mon.2) 420 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:56:07.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:07 smithi051 bash[18409]: audit 2020-06-27T05:56:06.454811+0000 mgr.x (mgr.34109) 2306 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:56:07.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:07 smithi051 bash[18409]: audit 2020-06-27T05:56:06.455411+0000 mon.b (mon.2) 421 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:56:07.721 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:07 smithi051 bash[18409]: audit 2020-06-27T05:56:06.455627+0000 mgr.x (mgr.34109) 2307 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:56:07.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:07 smithi031 bash[18426]: audit 2020-06-27T05:56:06.445537+0000 mon.b (mon.2) 418 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444008\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444084\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444118\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444291\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444388\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444496\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444594\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444631\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444662\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:56:06.444747\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:56:04.207375\"}"}]: dispatch 2020-06-27T05:56:07.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:07 smithi031 bash[18426]: audit 2020-06-27T05:56:06.446029+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444008\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444084\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444118\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444291\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444388\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444496\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444594\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444631\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444662\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:56:06.444747\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:56:04.207375\"}"}]: dispatch 2020-06-27T05:56:07.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:07 smithi031 bash[18426]: audit 2020-06-27T05:56:06.450769+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444008\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444084\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444118\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444291\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444388\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444496\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444594\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444631\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444662\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:56:06.444747\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:56:04.207375\"}"}]': finished 2020-06-27T05:56:07.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:07 smithi031 bash[18426]: audit 2020-06-27T05:56:06.453634+0000 mon.b (mon.2) 419 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:56:07.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:07 smithi031 bash[18426]: audit 2020-06-27T05:56:06.453892+0000 mgr.x (mgr.34109) 2305 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:56:07.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:07 smithi031 bash[18426]: audit 2020-06-27T05:56:06.454583+0000 mon.b (mon.2) 420 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:56:07.725 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:07 smithi031 bash[18426]: audit 2020-06-27T05:56:06.454811+0000 mgr.x (mgr.34109) 2306 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:56:07.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:07 smithi031 bash[18426]: audit 2020-06-27T05:56:06.455411+0000 mon.b (mon.2) 421 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:56:07.726 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:07 smithi031 bash[18426]: audit 2020-06-27T05:56:06.455627+0000 mgr.x (mgr.34109) 2307 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:56:07.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:07 smithi031 bash[22603]: audit 2020-06-27T05:56:06.445537+0000 mon.b (mon.2) 418 : audit [INF] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444008\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444084\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444118\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444291\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444388\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444496\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444594\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444631\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444662\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:56:06.444747\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:56:04.207375\"}"}]: dispatch 2020-06-27T05:56:07.726 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:07 smithi031 bash[22603]: audit 2020-06-27T05:56:06.446029+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444008\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444084\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444118\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444291\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444388\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444496\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444594\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444631\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444662\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:56:06.444747\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:56:04.207375\"}"}]: dispatch 2020-06-27T05:56:07.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:07 smithi031 bash[22603]: audit 2020-06-27T05:56:06.450769+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.34109 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi051","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"adf72351f403\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444008\", \"created\": \"2020-06-27T04:41:32.144284\", \"started\": \"2020-06-27T04:41:32.692526\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi051\", \"container_id\": \"1d3fecae2b9d\", \"container_image_id\": \"2d35936d34aa403c0550d10092f533f1db79e4288454982fe09d0599c72af119\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"version\": \"16.0.0-2978-g77ddaecfcb0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444084\", \"created\": \"2020-06-27T04:41:47.124030\", \"started\": \"2020-06-27T04:41:47.245454\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444118\", \"created\": \"2020-06-27T04:43:30.625339\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444291\", \"created\": \"2020-06-27T04:43:45.670093\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444388\", \"created\": \"2020-06-27T04:44:01.625833\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi051\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-06-27T05:56:06.444496\", \"created\": \"2020-06-27T04:44:17.341577\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"f55c20db5bf8\", \"container_image_id\": \"de242295e2257c37c8cadfd962369228f8f10b2d48a44259b65fef44ad4f6490\", \"container_image_name\": \"docker.io/prom/prometheus:v2.18.1\", \"version\": \"2.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444594\", \"created\": \"2020-06-27T04:44:48.866063\", \"started\": \"2020-06-27T04:45:35.947123\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi051\", \"container_id\": \"aa5208eb7cd4\", \"container_image_id\": \"e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87\", \"container_image_name\": \"docker.io/prom/node-exporter:v0.18.1\", \"version\": \"0.18.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444631\", \"created\": \"2020-06-27T04:44:50.851031\", \"started\": \"2020-06-27T04:44:54.869006\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi051\", \"container_id\": \"992ff21e4e7f\", \"container_image_id\": \"a0dce381714a1605bd246c4b407423449da95cb7d0d0a8bce349c3b4dd0b3288\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:6.6.2\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-06-27T05:56:06.444662\", \"created\": \"2020-06-27T04:45:22.715511\", \"started\": \"2020-06-27T04:45:22.845924\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD016T4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1600321314816.0, \"human_readable_size\": \"1.46 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"41502006-951e-4786-872a-1fd840460fa7\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"ZgXfqU-ykW7-A1RE-WY0j-zePf-icGs-8ttGLh\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6125844a-2c24-409d-9f33-ba0cbb1bb822\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"HR7rkG-Otod-Tj42-TYv2-10MH-Fn9l-OFs0dZ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1dca5a6a-245c-4161-9042-713f7c0bbfe4\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"OLjA9c-BJZf-CRvq-QDys-UWvV-la4J-gYlB3i\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"62c9b092-2f7d-4391-acae-dd78afcf7d5a\", \"cluster_fsid\": \"12892ae2-b830-11ea-a06d-001a4aab830c\", \"osdspec_affinity\": \"\", \"block_uuid\": \"EWlmAD-VWoB-179e-u0cg-2CuQ-bg8D-V8SonU\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD016T4_CVFT6011006A1P6DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W4HPJX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:43.070441\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-06-27T04:41:45.564303\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:29.175018\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-06-27T04:43:44.178200\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:00.061460\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:15.849786\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-06-27T04:45:30.624570\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-06-27T04:44:50.336360\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-06-27T04:45:03.608840\"}}, \"last_daemon_update\": \"2020-06-27T05:56:06.444747\", \"last_device_update\": \"2020-06-27T05:46:03.924488\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.51\"]}, \"last_host_check\": \"2020-06-27T05:56:04.207375\"}"}]': finished 2020-06-27T05:56:07.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:07 smithi031 bash[22603]: audit 2020-06-27T05:56:06.453634+0000 mon.b (mon.2) 419 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:56:07.727 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:07 smithi031 bash[22603]: audit 2020-06-27T05:56:06.453892+0000 mgr.x (mgr.34109) 2305 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-06-27T05:56:07.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:07 smithi031 bash[22603]: audit 2020-06-27T05:56:06.454583+0000 mon.b (mon.2) 420 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:56:07.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:07 smithi031 bash[22603]: audit 2020-06-27T05:56:06.454811+0000 mgr.x (mgr.34109) 2306 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-06-27T05:56:07.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:07 smithi031 bash[22603]: audit 2020-06-27T05:56:06.455411+0000 mon.b (mon.2) 421 : audit [DBG] from='mgr.34109 172.21.15.51:0/3511110830' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:56:07.728 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:07 smithi031 bash[22603]: audit 2020-06-27T05:56:06.455627+0000 mgr.x (mgr.34109) 2307 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-06-27T05:56:08.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:08 smithi051 bash[18409]: cluster 2020-06-27T05:56:06.728194+0000 mgr.x (mgr.34109) 2308 : cluster [DBG] pgmap v2382: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:08.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:08 smithi031 bash[18426]: cluster 2020-06-27T05:56:06.728194+0000 mgr.x (mgr.34109) 2308 : cluster [DBG] pgmap v2382: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:08.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:08 smithi031 bash[22603]: cluster 2020-06-27T05:56:06.728194+0000 mgr.x (mgr.34109) 2308 : cluster [DBG] pgmap v2382: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:10.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:10 smithi051 bash[18409]: cluster 2020-06-27T05:56:08.729781+0000 mgr.x (mgr.34109) 2309 : cluster [DBG] pgmap v2383: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:10.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:10 smithi031 bash[18426]: cluster 2020-06-27T05:56:08.729781+0000 mgr.x (mgr.34109) 2309 : cluster [DBG] pgmap v2383: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:10.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:10 smithi031 bash[22603]: cluster 2020-06-27T05:56:08.729781+0000 mgr.x (mgr.34109) 2309 : cluster [DBG] pgmap v2383: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:12.742 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:12 smithi031 bash[18426]: cluster 2020-06-27T05:56:10.731493+0000 mgr.x (mgr.34109) 2310 : cluster [DBG] pgmap v2384: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:12.742 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:12 smithi031 bash[22603]: cluster 2020-06-27T05:56:10.731493+0000 mgr.x (mgr.34109) 2310 : cluster [DBG] pgmap v2384: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:12.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:12 smithi051 bash[18409]: cluster 2020-06-27T05:56:10.731493+0000 mgr.x (mgr.34109) 2310 : cluster [DBG] pgmap v2384: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:14 smithi051 bash[18409]: cluster 2020-06-27T05:56:12.733110+0000 mgr.x (mgr.34109) 2311 : cluster [DBG] pgmap v2385: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:14 smithi031 bash[18426]: cluster 2020-06-27T05:56:12.733110+0000 mgr.x (mgr.34109) 2311 : cluster [DBG] pgmap v2385: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:14 smithi031 bash[22603]: cluster 2020-06-27T05:56:12.733110+0000 mgr.x (mgr.34109) 2311 : cluster [DBG] pgmap v2385: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:16 smithi051 bash[18409]: cluster 2020-06-27T05:56:14.734900+0000 mgr.x (mgr.34109) 2312 : cluster [DBG] pgmap v2386: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:16 smithi031 bash[18426]: cluster 2020-06-27T05:56:14.734900+0000 mgr.x (mgr.34109) 2312 : cluster [DBG] pgmap v2386: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:16 smithi031 bash[22603]: cluster 2020-06-27T05:56:14.734900+0000 mgr.x (mgr.34109) 2312 : cluster [DBG] pgmap v2386: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:18.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:18 smithi051 bash[18409]: cluster 2020-06-27T05:56:16.736627+0000 mgr.x (mgr.34109) 2313 : cluster [DBG] pgmap v2387: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:18 smithi031 bash[18426]: cluster 2020-06-27T05:56:16.736627+0000 mgr.x (mgr.34109) 2313 : cluster [DBG] pgmap v2387: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:18 smithi031 bash[22603]: cluster 2020-06-27T05:56:16.736627+0000 mgr.x (mgr.34109) 2313 : cluster [DBG] pgmap v2387: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:20.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:20 smithi051 bash[18409]: cluster 2020-06-27T05:56:18.738340+0000 mgr.x (mgr.34109) 2314 : cluster [DBG] pgmap v2388: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:20 smithi031 bash[18426]: cluster 2020-06-27T05:56:18.738340+0000 mgr.x (mgr.34109) 2314 : cluster [DBG] pgmap v2388: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:20.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:20 smithi031 bash[22603]: cluster 2020-06-27T05:56:18.738340+0000 mgr.x (mgr.34109) 2314 : cluster [DBG] pgmap v2388: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:22 smithi051 bash[18409]: cluster 2020-06-27T05:56:20.739922+0000 mgr.x (mgr.34109) 2315 : cluster [DBG] pgmap v2389: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:22.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:22 smithi031 bash[18426]: cluster 2020-06-27T05:56:20.739922+0000 mgr.x (mgr.34109) 2315 : cluster [DBG] pgmap v2389: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:22.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:22 smithi031 bash[22603]: cluster 2020-06-27T05:56:20.739922+0000 mgr.x (mgr.34109) 2315 : cluster [DBG] pgmap v2389: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:24 smithi051 bash[18409]: cluster 2020-06-27T05:56:22.741645+0000 mgr.x (mgr.34109) 2316 : cluster [DBG] pgmap v2390: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:24.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:24 smithi031 bash[18426]: cluster 2020-06-27T05:56:22.741645+0000 mgr.x (mgr.34109) 2316 : cluster [DBG] pgmap v2390: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:24 smithi031 bash[22603]: cluster 2020-06-27T05:56:22.741645+0000 mgr.x (mgr.34109) 2316 : cluster [DBG] pgmap v2390: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:26.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:26 smithi051 bash[18409]: cluster 2020-06-27T05:56:24.743376+0000 mgr.x (mgr.34109) 2317 : cluster [DBG] pgmap v2391: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:26 smithi031 bash[18426]: cluster 2020-06-27T05:56:24.743376+0000 mgr.x (mgr.34109) 2317 : cluster [DBG] pgmap v2391: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:26.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:26 smithi031 bash[22603]: cluster 2020-06-27T05:56:24.743376+0000 mgr.x (mgr.34109) 2317 : cluster [DBG] pgmap v2391: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:28.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:28 smithi051 bash[18409]: cluster 2020-06-27T05:56:26.744994+0000 mgr.x (mgr.34109) 2318 : cluster [DBG] pgmap v2392: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:28.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:28 smithi031 bash[18426]: cluster 2020-06-27T05:56:26.744994+0000 mgr.x (mgr.34109) 2318 : cluster [DBG] pgmap v2392: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:28.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:28 smithi031 bash[22603]: cluster 2020-06-27T05:56:26.744994+0000 mgr.x (mgr.34109) 2318 : cluster [DBG] pgmap v2392: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:30.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:30 smithi051 bash[18409]: cluster 2020-06-27T05:56:28.746697+0000 mgr.x (mgr.34109) 2319 : cluster [DBG] pgmap v2393: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:30.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:30 smithi031 bash[18426]: cluster 2020-06-27T05:56:28.746697+0000 mgr.x (mgr.34109) 2319 : cluster [DBG] pgmap v2393: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:30.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:30 smithi031 bash[22603]: cluster 2020-06-27T05:56:28.746697+0000 mgr.x (mgr.34109) 2319 : cluster [DBG] pgmap v2393: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:32.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:32 smithi051 bash[18409]: cluster 2020-06-27T05:56:30.748372+0000 mgr.x (mgr.34109) 2320 : cluster [DBG] pgmap v2394: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:32.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:32 smithi031 bash[22603]: cluster 2020-06-27T05:56:30.748372+0000 mgr.x (mgr.34109) 2320 : cluster [DBG] pgmap v2394: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:32.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:32 smithi031 bash[18426]: cluster 2020-06-27T05:56:30.748372+0000 mgr.x (mgr.34109) 2320 : cluster [DBG] pgmap v2394: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:34.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:34 smithi051 bash[18409]: cluster 2020-06-27T05:56:32.750023+0000 mgr.x (mgr.34109) 2321 : cluster [DBG] pgmap v2395: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:34 smithi031 bash[18426]: cluster 2020-06-27T05:56:32.750023+0000 mgr.x (mgr.34109) 2321 : cluster [DBG] pgmap v2395: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:34 smithi031 bash[22603]: cluster 2020-06-27T05:56:32.750023+0000 mgr.x (mgr.34109) 2321 : cluster [DBG] pgmap v2395: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:36.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:36 smithi051 bash[18409]: cluster 2020-06-27T05:56:34.751810+0000 mgr.x (mgr.34109) 2322 : cluster [DBG] pgmap v2396: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:36.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:36 smithi031 bash[22603]: cluster 2020-06-27T05:56:34.751810+0000 mgr.x (mgr.34109) 2322 : cluster [DBG] pgmap v2396: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:36 smithi031 bash[18426]: cluster 2020-06-27T05:56:34.751810+0000 mgr.x (mgr.34109) 2322 : cluster [DBG] pgmap v2396: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:38.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:38 smithi051 bash[18409]: cluster 2020-06-27T05:56:36.753562+0000 mgr.x (mgr.34109) 2323 : cluster [DBG] pgmap v2397: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:38 smithi031 bash[18426]: cluster 2020-06-27T05:56:36.753562+0000 mgr.x (mgr.34109) 2323 : cluster [DBG] pgmap v2397: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:38 smithi031 bash[22603]: cluster 2020-06-27T05:56:36.753562+0000 mgr.x (mgr.34109) 2323 : cluster [DBG] pgmap v2397: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:40.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:40 smithi051 bash[18409]: cluster 2020-06-27T05:56:38.755345+0000 mgr.x (mgr.34109) 2324 : cluster [DBG] pgmap v2398: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:40 smithi031 bash[18426]: cluster 2020-06-27T05:56:38.755345+0000 mgr.x (mgr.34109) 2324 : cluster [DBG] pgmap v2398: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:40.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:40 smithi031 bash[22603]: cluster 2020-06-27T05:56:38.755345+0000 mgr.x (mgr.34109) 2324 : cluster [DBG] pgmap v2398: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:42.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:42 smithi051 bash[18409]: cluster 2020-06-27T05:56:40.757015+0000 mgr.x (mgr.34109) 2325 : cluster [DBG] pgmap v2399: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:42.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:42 smithi031 bash[18426]: cluster 2020-06-27T05:56:40.757015+0000 mgr.x (mgr.34109) 2325 : cluster [DBG] pgmap v2399: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:42.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:42 smithi031 bash[22603]: cluster 2020-06-27T05:56:40.757015+0000 mgr.x (mgr.34109) 2325 : cluster [DBG] pgmap v2399: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:44.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:44 smithi051 bash[18409]: cluster 2020-06-27T05:56:42.758723+0000 mgr.x (mgr.34109) 2326 : cluster [DBG] pgmap v2400: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:44 smithi031 bash[18426]: cluster 2020-06-27T05:56:42.758723+0000 mgr.x (mgr.34109) 2326 : cluster [DBG] pgmap v2400: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:44 smithi031 bash[22603]: cluster 2020-06-27T05:56:42.758723+0000 mgr.x (mgr.34109) 2326 : cluster [DBG] pgmap v2400: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:46.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:46 smithi051 bash[18409]: cluster 2020-06-27T05:56:44.760378+0000 mgr.x (mgr.34109) 2327 : cluster [DBG] pgmap v2401: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:46 smithi031 bash[18426]: cluster 2020-06-27T05:56:44.760378+0000 mgr.x (mgr.34109) 2327 : cluster [DBG] pgmap v2401: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:46.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:46 smithi031 bash[22603]: cluster 2020-06-27T05:56:44.760378+0000 mgr.x (mgr.34109) 2327 : cluster [DBG] pgmap v2401: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:48.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:48 smithi051 bash[18409]: cluster 2020-06-27T05:56:46.762012+0000 mgr.x (mgr.34109) 2328 : cluster [DBG] pgmap v2402: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:48.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:48 smithi031 bash[18426]: cluster 2020-06-27T05:56:46.762012+0000 mgr.x (mgr.34109) 2328 : cluster [DBG] pgmap v2402: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:48.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:48 smithi031 bash[22603]: cluster 2020-06-27T05:56:46.762012+0000 mgr.x (mgr.34109) 2328 : cluster [DBG] pgmap v2402: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:50.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:50 smithi051 bash[18409]: cluster 2020-06-27T05:56:48.763746+0000 mgr.x (mgr.34109) 2329 : cluster [DBG] pgmap v2403: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:50.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:50 smithi031 bash[18426]: cluster 2020-06-27T05:56:48.763746+0000 mgr.x (mgr.34109) 2329 : cluster [DBG] pgmap v2403: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:50.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:50 smithi031 bash[22603]: cluster 2020-06-27T05:56:48.763746+0000 mgr.x (mgr.34109) 2329 : cluster [DBG] pgmap v2403: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:52 smithi051 bash[18409]: cluster 2020-06-27T05:56:50.765353+0000 mgr.x (mgr.34109) 2330 : cluster [DBG] pgmap v2404: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:52 smithi031 bash[18426]: cluster 2020-06-27T05:56:50.765353+0000 mgr.x (mgr.34109) 2330 : cluster [DBG] pgmap v2404: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:52 smithi031 bash[22603]: cluster 2020-06-27T05:56:50.765353+0000 mgr.x (mgr.34109) 2330 : cluster [DBG] pgmap v2404: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:54.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:54 smithi051 bash[18409]: cluster 2020-06-27T05:56:52.767066+0000 mgr.x (mgr.34109) 2331 : cluster [DBG] pgmap v2405: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:54.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:54 smithi031 bash[18426]: cluster 2020-06-27T05:56:52.767066+0000 mgr.x (mgr.34109) 2331 : cluster [DBG] pgmap v2405: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:54 smithi031 bash[22603]: cluster 2020-06-27T05:56:52.767066+0000 mgr.x (mgr.34109) 2331 : cluster [DBG] pgmap v2405: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:56.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:56 smithi051 bash[18409]: cluster 2020-06-27T05:56:54.768841+0000 mgr.x (mgr.34109) 2332 : cluster [DBG] pgmap v2406: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:56.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:56 smithi031 bash[18426]: cluster 2020-06-27T05:56:54.768841+0000 mgr.x (mgr.34109) 2332 : cluster [DBG] pgmap v2406: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:56.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:56 smithi031 bash[22603]: cluster 2020-06-27T05:56:54.768841+0000 mgr.x (mgr.34109) 2332 : cluster [DBG] pgmap v2406: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:57.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:57 smithi051 bash[18409]: cluster 2020-06-27T05:56:56.770489+0000 mgr.x (mgr.34109) 2333 : cluster [DBG] pgmap v2407: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:57.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:57 smithi031 bash[18426]: cluster 2020-06-27T05:56:56.770489+0000 mgr.x (mgr.34109) 2333 : cluster [DBG] pgmap v2407: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:56:57.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:57 smithi031 bash[22603]: cluster 2020-06-27T05:56:56.770489+0000 mgr.x (mgr.34109) 2333 : cluster [DBG] pgmap v2407: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:00.218 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:56:59 smithi051 bash[18409]: cluster 2020-06-27T05:56:58.772165+0000 mgr.x (mgr.34109) 2334 : cluster [DBG] pgmap v2408: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:00.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:56:59 smithi031 bash[18426]: cluster 2020-06-27T05:56:58.772165+0000 mgr.x (mgr.34109) 2334 : cluster [DBG] pgmap v2408: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:00.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:56:59 smithi031 bash[22603]: cluster 2020-06-27T05:56:58.772165+0000 mgr.x (mgr.34109) 2334 : cluster [DBG] pgmap v2408: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:02.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:02 smithi051 bash[18409]: cluster 2020-06-27T05:57:00.773563+0000 mgr.x (mgr.34109) 2335 : cluster [DBG] pgmap v2409: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:02.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:02 smithi031 bash[18426]: cluster 2020-06-27T05:57:00.773563+0000 mgr.x (mgr.34109) 2335 : cluster [DBG] pgmap v2409: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:02.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:02 smithi031 bash[22603]: cluster 2020-06-27T05:57:00.773563+0000 mgr.x (mgr.34109) 2335 : cluster [DBG] pgmap v2409: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:04.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:04 smithi051 bash[18409]: cluster 2020-06-27T05:57:02.775236+0000 mgr.x (mgr.34109) 2336 : cluster [DBG] pgmap v2410: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:04.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:04 smithi031 bash[18426]: cluster 2020-06-27T05:57:02.775236+0000 mgr.x (mgr.34109) 2336 : cluster [DBG] pgmap v2410: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:04.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:04 smithi031 bash[22603]: cluster 2020-06-27T05:57:02.775236+0000 mgr.x (mgr.34109) 2336 : cluster [DBG] pgmap v2410: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:06.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:06 smithi051 bash[18409]: cluster 2020-06-27T05:57:04.777002+0000 mgr.x (mgr.34109) 2337 : cluster [DBG] pgmap v2411: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:06.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:06 smithi031 bash[18426]: cluster 2020-06-27T05:57:04.777002+0000 mgr.x (mgr.34109) 2337 : cluster [DBG] pgmap v2411: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:06.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:06 smithi031 bash[22603]: cluster 2020-06-27T05:57:04.777002+0000 mgr.x (mgr.34109) 2337 : cluster [DBG] pgmap v2411: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:08.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:08 smithi051 bash[18409]: cluster 2020-06-27T05:57:06.778686+0000 mgr.x (mgr.34109) 2338 : cluster [DBG] pgmap v2412: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:08.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:08 smithi031 bash[18426]: cluster 2020-06-27T05:57:06.778686+0000 mgr.x (mgr.34109) 2338 : cluster [DBG] pgmap v2412: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:08.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:08 smithi031 bash[22603]: cluster 2020-06-27T05:57:06.778686+0000 mgr.x (mgr.34109) 2338 : cluster [DBG] pgmap v2412: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:10.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:10 smithi051 bash[18409]: cluster 2020-06-27T05:57:08.780483+0000 mgr.x (mgr.34109) 2339 : cluster [DBG] pgmap v2413: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:10.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:10 smithi031 bash[18426]: cluster 2020-06-27T05:57:08.780483+0000 mgr.x (mgr.34109) 2339 : cluster [DBG] pgmap v2413: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:10.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:10 smithi031 bash[22603]: cluster 2020-06-27T05:57:08.780483+0000 mgr.x (mgr.34109) 2339 : cluster [DBG] pgmap v2413: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:12.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:12 smithi051 bash[18409]: cluster 2020-06-27T05:57:10.781887+0000 mgr.x (mgr.34109) 2340 : cluster [DBG] pgmap v2414: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:12.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:12 smithi031 bash[18426]: cluster 2020-06-27T05:57:10.781887+0000 mgr.x (mgr.34109) 2340 : cluster [DBG] pgmap v2414: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:12.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:12 smithi031 bash[22603]: cluster 2020-06-27T05:57:10.781887+0000 mgr.x (mgr.34109) 2340 : cluster [DBG] pgmap v2414: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:14.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:14 smithi051 bash[18409]: cluster 2020-06-27T05:57:12.783528+0000 mgr.x (mgr.34109) 2341 : cluster [DBG] pgmap v2415: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:14.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:14 smithi031 bash[18426]: cluster 2020-06-27T05:57:12.783528+0000 mgr.x (mgr.34109) 2341 : cluster [DBG] pgmap v2415: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:14.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:14 smithi031 bash[22603]: cluster 2020-06-27T05:57:12.783528+0000 mgr.x (mgr.34109) 2341 : cluster [DBG] pgmap v2415: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:16.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:16 smithi051 bash[18409]: cluster 2020-06-27T05:57:14.785139+0000 mgr.x (mgr.34109) 2342 : cluster [DBG] pgmap v2416: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:16.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:16 smithi031 bash[22603]: cluster 2020-06-27T05:57:14.785139+0000 mgr.x (mgr.34109) 2342 : cluster [DBG] pgmap v2416: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:16.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:16 smithi031 bash[18426]: cluster 2020-06-27T05:57:14.785139+0000 mgr.x (mgr.34109) 2342 : cluster [DBG] pgmap v2416: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:18.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:18 smithi051 bash[18409]: cluster 2020-06-27T05:57:16.786827+0000 mgr.x (mgr.34109) 2343 : cluster [DBG] pgmap v2417: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:18.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:18 smithi031 bash[22603]: cluster 2020-06-27T05:57:16.786827+0000 mgr.x (mgr.34109) 2343 : cluster [DBG] pgmap v2417: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:18.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:18 smithi031 bash[18426]: cluster 2020-06-27T05:57:16.786827+0000 mgr.x (mgr.34109) 2343 : cluster [DBG] pgmap v2417: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:20.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:20 smithi051 bash[18409]: cluster 2020-06-27T05:57:18.788434+0000 mgr.x (mgr.34109) 2344 : cluster [DBG] pgmap v2418: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:20.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:20 smithi031 bash[22603]: cluster 2020-06-27T05:57:18.788434+0000 mgr.x (mgr.34109) 2344 : cluster [DBG] pgmap v2418: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:20.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:20 smithi031 bash[18426]: cluster 2020-06-27T05:57:18.788434+0000 mgr.x (mgr.34109) 2344 : cluster [DBG] pgmap v2418: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:22.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:22 smithi051 bash[18409]: cluster 2020-06-27T05:57:20.790019+0000 mgr.x (mgr.34109) 2345 : cluster [DBG] pgmap v2419: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:22.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:22 smithi031 bash[22603]: cluster 2020-06-27T05:57:20.790019+0000 mgr.x (mgr.34109) 2345 : cluster [DBG] pgmap v2419: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:22.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:22 smithi031 bash[18426]: cluster 2020-06-27T05:57:20.790019+0000 mgr.x (mgr.34109) 2345 : cluster [DBG] pgmap v2419: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:24.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:24 smithi051 bash[18409]: cluster 2020-06-27T05:57:22.791580+0000 mgr.x (mgr.34109) 2346 : cluster [DBG] pgmap v2420: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:24.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:24 smithi031 bash[22603]: cluster 2020-06-27T05:57:22.791580+0000 mgr.x (mgr.34109) 2346 : cluster [DBG] pgmap v2420: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:24.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:24 smithi031 bash[18426]: cluster 2020-06-27T05:57:22.791580+0000 mgr.x (mgr.34109) 2346 : cluster [DBG] pgmap v2420: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:26.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:26 smithi051 bash[18409]: cluster 2020-06-27T05:57:24.793280+0000 mgr.x (mgr.34109) 2347 : cluster [DBG] pgmap v2421: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:26.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:26 smithi031 bash[22603]: cluster 2020-06-27T05:57:24.793280+0000 mgr.x (mgr.34109) 2347 : cluster [DBG] pgmap v2421: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:26.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:26 smithi031 bash[18426]: cluster 2020-06-27T05:57:24.793280+0000 mgr.x (mgr.34109) 2347 : cluster [DBG] pgmap v2421: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:28.719 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:28 smithi051 bash[18409]: cluster 2020-06-27T05:57:26.794984+0000 mgr.x (mgr.34109) 2348 : cluster [DBG] pgmap v2422: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:28.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:28 smithi031 bash[22603]: cluster 2020-06-27T05:57:26.794984+0000 mgr.x (mgr.34109) 2348 : cluster [DBG] pgmap v2422: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:28.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:28 smithi031 bash[18426]: cluster 2020-06-27T05:57:26.794984+0000 mgr.x (mgr.34109) 2348 : cluster [DBG] pgmap v2422: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:30.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:30 smithi031 bash[22603]: cluster 2020-06-27T05:57:28.796593+0000 mgr.x (mgr.34109) 2349 : cluster [DBG] pgmap v2423: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:30.724 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:30 smithi031 bash[18426]: cluster 2020-06-27T05:57:28.796593+0000 mgr.x (mgr.34109) 2349 : cluster [DBG] pgmap v2423: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:30.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:30 smithi051 bash[18409]: cluster 2020-06-27T05:57:28.796593+0000 mgr.x (mgr.34109) 2349 : cluster [DBG] pgmap v2423: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:32.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:32 smithi051 bash[18409]: cluster 2020-06-27T05:57:30.798323+0000 mgr.x (mgr.34109) 2350 : cluster [DBG] pgmap v2424: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:32.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:32 smithi031 bash[22603]: cluster 2020-06-27T05:57:30.798323+0000 mgr.x (mgr.34109) 2350 : cluster [DBG] pgmap v2424: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:32.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:32 smithi031 bash[18426]: cluster 2020-06-27T05:57:30.798323+0000 mgr.x (mgr.34109) 2350 : cluster [DBG] pgmap v2424: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:34.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:34 smithi051 bash[18409]: cluster 2020-06-27T05:57:32.800057+0000 mgr.x (mgr.34109) 2351 : cluster [DBG] pgmap v2425: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:34 smithi031 bash[18426]: cluster 2020-06-27T05:57:32.800057+0000 mgr.x (mgr.34109) 2351 : cluster [DBG] pgmap v2425: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:34 smithi031 bash[22603]: cluster 2020-06-27T05:57:32.800057+0000 mgr.x (mgr.34109) 2351 : cluster [DBG] pgmap v2425: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:36 smithi051 bash[18409]: cluster 2020-06-27T05:57:34.801763+0000 mgr.x (mgr.34109) 2352 : cluster [DBG] pgmap v2426: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:36 smithi031 bash[18426]: cluster 2020-06-27T05:57:34.801763+0000 mgr.x (mgr.34109) 2352 : cluster [DBG] pgmap v2426: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:36.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:36 smithi031 bash[22603]: cluster 2020-06-27T05:57:34.801763+0000 mgr.x (mgr.34109) 2352 : cluster [DBG] pgmap v2426: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:38.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:38 smithi051 bash[18409]: cluster 2020-06-27T05:57:36.803382+0000 mgr.x (mgr.34109) 2353 : cluster [DBG] pgmap v2427: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:38.974 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:38 smithi031 bash[18426]: cluster 2020-06-27T05:57:36.803382+0000 mgr.x (mgr.34109) 2353 : cluster [DBG] pgmap v2427: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:38.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:38 smithi031 bash[22603]: cluster 2020-06-27T05:57:36.803382+0000 mgr.x (mgr.34109) 2353 : cluster [DBG] pgmap v2427: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:40.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:40 smithi051 bash[18409]: cluster 2020-06-27T05:57:38.805105+0000 mgr.x (mgr.34109) 2354 : cluster [DBG] pgmap v2428: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:40 smithi031 bash[18426]: cluster 2020-06-27T05:57:38.805105+0000 mgr.x (mgr.34109) 2354 : cluster [DBG] pgmap v2428: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:40.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:40 smithi031 bash[22603]: cluster 2020-06-27T05:57:38.805105+0000 mgr.x (mgr.34109) 2354 : cluster [DBG] pgmap v2428: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:42.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:42 smithi051 bash[18409]: cluster 2020-06-27T05:57:40.806826+0000 mgr.x (mgr.34109) 2355 : cluster [DBG] pgmap v2429: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:42.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:42 smithi031 bash[18426]: cluster 2020-06-27T05:57:40.806826+0000 mgr.x (mgr.34109) 2355 : cluster [DBG] pgmap v2429: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:42.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:42 smithi031 bash[22603]: cluster 2020-06-27T05:57:40.806826+0000 mgr.x (mgr.34109) 2355 : cluster [DBG] pgmap v2429: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:44.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:44 smithi051 bash[18409]: cluster 2020-06-27T05:57:42.808462+0000 mgr.x (mgr.34109) 2356 : cluster [DBG] pgmap v2430: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:44 smithi031 bash[22603]: cluster 2020-06-27T05:57:42.808462+0000 mgr.x (mgr.34109) 2356 : cluster [DBG] pgmap v2430: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:44 smithi031 bash[18426]: cluster 2020-06-27T05:57:42.808462+0000 mgr.x (mgr.34109) 2356 : cluster [DBG] pgmap v2430: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:46.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:46 smithi051 bash[18409]: cluster 2020-06-27T05:57:44.810046+0000 mgr.x (mgr.34109) 2357 : cluster [DBG] pgmap v2431: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:46 smithi031 bash[18426]: cluster 2020-06-27T05:57:44.810046+0000 mgr.x (mgr.34109) 2357 : cluster [DBG] pgmap v2431: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:46.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:46 smithi031 bash[22603]: cluster 2020-06-27T05:57:44.810046+0000 mgr.x (mgr.34109) 2357 : cluster [DBG] pgmap v2431: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:48.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:48 smithi051 bash[18409]: cluster 2020-06-27T05:57:46.811785+0000 mgr.x (mgr.34109) 2358 : cluster [DBG] pgmap v2432: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:48.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:48 smithi031 bash[18426]: cluster 2020-06-27T05:57:46.811785+0000 mgr.x (mgr.34109) 2358 : cluster [DBG] pgmap v2432: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:48.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:48 smithi031 bash[22603]: cluster 2020-06-27T05:57:46.811785+0000 mgr.x (mgr.34109) 2358 : cluster [DBG] pgmap v2432: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:50.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:50 smithi051 bash[18409]: cluster 2020-06-27T05:57:48.813470+0000 mgr.x (mgr.34109) 2359 : cluster [DBG] pgmap v2433: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:50.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:50 smithi031 bash[18426]: cluster 2020-06-27T05:57:48.813470+0000 mgr.x (mgr.34109) 2359 : cluster [DBG] pgmap v2433: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:50.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:50 smithi031 bash[22603]: cluster 2020-06-27T05:57:48.813470+0000 mgr.x (mgr.34109) 2359 : cluster [DBG] pgmap v2433: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:52 smithi051 bash[18409]: cluster 2020-06-27T05:57:50.814952+0000 mgr.x (mgr.34109) 2360 : cluster [DBG] pgmap v2434: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:52 smithi031 bash[18426]: cluster 2020-06-27T05:57:50.814952+0000 mgr.x (mgr.34109) 2360 : cluster [DBG] pgmap v2434: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:52 smithi031 bash[22603]: cluster 2020-06-27T05:57:50.814952+0000 mgr.x (mgr.34109) 2360 : cluster [DBG] pgmap v2434: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:53.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:53 smithi051 bash[18409]: cluster 2020-06-27T05:57:52.816698+0000 mgr.x (mgr.34109) 2361 : cluster [DBG] pgmap v2435: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:53.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:53 smithi031 bash[18426]: cluster 2020-06-27T05:57:52.816698+0000 mgr.x (mgr.34109) 2361 : cluster [DBG] pgmap v2435: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:53.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:53 smithi031 bash[22603]: cluster 2020-06-27T05:57:52.816698+0000 mgr.x (mgr.34109) 2361 : cluster [DBG] pgmap v2435: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:56.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:56 smithi051 bash[18409]: cluster 2020-06-27T05:57:54.818324+0000 mgr.x (mgr.34109) 2362 : cluster [DBG] pgmap v2436: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:56.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:56 smithi031 bash[18426]: cluster 2020-06-27T05:57:54.818324+0000 mgr.x (mgr.34109) 2362 : cluster [DBG] pgmap v2436: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:56.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:56 smithi031 bash[22603]: cluster 2020-06-27T05:57:54.818324+0000 mgr.x (mgr.34109) 2362 : cluster [DBG] pgmap v2436: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:58.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:57:58 smithi051 bash[18409]: cluster 2020-06-27T05:57:56.820081+0000 mgr.x (mgr.34109) 2363 : cluster [DBG] pgmap v2437: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:58.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:57:58 smithi031 bash[18426]: cluster 2020-06-27T05:57:56.820081+0000 mgr.x (mgr.34109) 2363 : cluster [DBG] pgmap v2437: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:57:58.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:57:58 smithi031 bash[22603]: cluster 2020-06-27T05:57:56.820081+0000 mgr.x (mgr.34109) 2363 : cluster [DBG] pgmap v2437: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:00.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:00 smithi051 bash[18409]: cluster 2020-06-27T05:57:58.821809+0000 mgr.x (mgr.34109) 2364 : cluster [DBG] pgmap v2438: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:00.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:00 smithi031 bash[18426]: cluster 2020-06-27T05:57:58.821809+0000 mgr.x (mgr.34109) 2364 : cluster [DBG] pgmap v2438: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:00.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:00 smithi031 bash[22603]: cluster 2020-06-27T05:57:58.821809+0000 mgr.x (mgr.34109) 2364 : cluster [DBG] pgmap v2438: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:02.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:02 smithi051 bash[18409]: cluster 2020-06-27T05:58:00.823516+0000 mgr.x (mgr.34109) 2365 : cluster [DBG] pgmap v2439: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:02.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:02 smithi031 bash[18426]: cluster 2020-06-27T05:58:00.823516+0000 mgr.x (mgr.34109) 2365 : cluster [DBG] pgmap v2439: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:02.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:02 smithi031 bash[22603]: cluster 2020-06-27T05:58:00.823516+0000 mgr.x (mgr.34109) 2365 : cluster [DBG] pgmap v2439: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:04.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:04 smithi031 bash[18426]: cluster 2020-06-27T05:58:02.825079+0000 mgr.x (mgr.34109) 2366 : cluster [DBG] pgmap v2440: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:04.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:04 smithi031 bash[22603]: cluster 2020-06-27T05:58:02.825079+0000 mgr.x (mgr.34109) 2366 : cluster [DBG] pgmap v2440: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:04.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:04 smithi051 bash[18409]: cluster 2020-06-27T05:58:02.825079+0000 mgr.x (mgr.34109) 2366 : cluster [DBG] pgmap v2440: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:06.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:06 smithi051 bash[18409]: cluster 2020-06-27T05:58:04.826855+0000 mgr.x (mgr.34109) 2367 : cluster [DBG] pgmap v2441: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:06.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:06 smithi031 bash[18426]: cluster 2020-06-27T05:58:04.826855+0000 mgr.x (mgr.34109) 2367 : cluster [DBG] pgmap v2441: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:06.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:06 smithi031 bash[22603]: cluster 2020-06-27T05:58:04.826855+0000 mgr.x (mgr.34109) 2367 : cluster [DBG] pgmap v2441: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:08.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:08 smithi051 bash[18409]: cluster 2020-06-27T05:58:06.828513+0000 mgr.x (mgr.34109) 2368 : cluster [DBG] pgmap v2442: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:08.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:08 smithi031 bash[18426]: cluster 2020-06-27T05:58:06.828513+0000 mgr.x (mgr.34109) 2368 : cluster [DBG] pgmap v2442: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:08.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:08 smithi031 bash[22603]: cluster 2020-06-27T05:58:06.828513+0000 mgr.x (mgr.34109) 2368 : cluster [DBG] pgmap v2442: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:10.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:10 smithi051 bash[18409]: cluster 2020-06-27T05:58:08.830116+0000 mgr.x (mgr.34109) 2369 : cluster [DBG] pgmap v2443: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:10.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:10 smithi031 bash[18426]: cluster 2020-06-27T05:58:08.830116+0000 mgr.x (mgr.34109) 2369 : cluster [DBG] pgmap v2443: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:10.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:10 smithi031 bash[22603]: cluster 2020-06-27T05:58:08.830116+0000 mgr.x (mgr.34109) 2369 : cluster [DBG] pgmap v2443: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:12.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:12 smithi051 bash[18409]: cluster 2020-06-27T05:58:10.831715+0000 mgr.x (mgr.34109) 2370 : cluster [DBG] pgmap v2444: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:12 smithi031 bash[18426]: cluster 2020-06-27T05:58:10.831715+0000 mgr.x (mgr.34109) 2370 : cluster [DBG] pgmap v2444: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:12.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:12 smithi031 bash[22603]: cluster 2020-06-27T05:58:10.831715+0000 mgr.x (mgr.34109) 2370 : cluster [DBG] pgmap v2444: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:14 smithi051 bash[18409]: cluster 2020-06-27T05:58:12.833473+0000 mgr.x (mgr.34109) 2371 : cluster [DBG] pgmap v2445: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:14 smithi031 bash[18426]: cluster 2020-06-27T05:58:12.833473+0000 mgr.x (mgr.34109) 2371 : cluster [DBG] pgmap v2445: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:14 smithi031 bash[22603]: cluster 2020-06-27T05:58:12.833473+0000 mgr.x (mgr.34109) 2371 : cluster [DBG] pgmap v2445: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:16 smithi051 bash[18409]: cluster 2020-06-27T05:58:14.835099+0000 mgr.x (mgr.34109) 2372 : cluster [DBG] pgmap v2446: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:16 smithi031 bash[18426]: cluster 2020-06-27T05:58:14.835099+0000 mgr.x (mgr.34109) 2372 : cluster [DBG] pgmap v2446: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:16 smithi031 bash[22603]: cluster 2020-06-27T05:58:14.835099+0000 mgr.x (mgr.34109) 2372 : cluster [DBG] pgmap v2446: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:18.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:18 smithi051 bash[18409]: cluster 2020-06-27T05:58:16.836760+0000 mgr.x (mgr.34109) 2373 : cluster [DBG] pgmap v2447: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:18 smithi031 bash[18426]: cluster 2020-06-27T05:58:16.836760+0000 mgr.x (mgr.34109) 2373 : cluster [DBG] pgmap v2447: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:18 smithi031 bash[22603]: cluster 2020-06-27T05:58:16.836760+0000 mgr.x (mgr.34109) 2373 : cluster [DBG] pgmap v2447: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:20.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:20 smithi051 bash[18409]: cluster 2020-06-27T05:58:18.838358+0000 mgr.x (mgr.34109) 2374 : cluster [DBG] pgmap v2448: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:20 smithi031 bash[18426]: cluster 2020-06-27T05:58:18.838358+0000 mgr.x (mgr.34109) 2374 : cluster [DBG] pgmap v2448: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:20.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:20 smithi031 bash[22603]: cluster 2020-06-27T05:58:18.838358+0000 mgr.x (mgr.34109) 2374 : cluster [DBG] pgmap v2448: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:22 smithi051 bash[18409]: cluster 2020-06-27T05:58:20.839969+0000 mgr.x (mgr.34109) 2375 : cluster [DBG] pgmap v2449: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:22.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:22 smithi031 bash[18426]: cluster 2020-06-27T05:58:20.839969+0000 mgr.x (mgr.34109) 2375 : cluster [DBG] pgmap v2449: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:22.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:22 smithi031 bash[22603]: cluster 2020-06-27T05:58:20.839969+0000 mgr.x (mgr.34109) 2375 : cluster [DBG] pgmap v2449: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:24 smithi051 bash[18409]: cluster 2020-06-27T05:58:22.841692+0000 mgr.x (mgr.34109) 2376 : cluster [DBG] pgmap v2450: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:24.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:24 smithi031 bash[18426]: cluster 2020-06-27T05:58:22.841692+0000 mgr.x (mgr.34109) 2376 : cluster [DBG] pgmap v2450: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:24 smithi031 bash[22603]: cluster 2020-06-27T05:58:22.841692+0000 mgr.x (mgr.34109) 2376 : cluster [DBG] pgmap v2450: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:26.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:26 smithi051 bash[18409]: cluster 2020-06-27T05:58:24.843382+0000 mgr.x (mgr.34109) 2377 : cluster [DBG] pgmap v2451: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:26.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:26 smithi031 bash[22603]: cluster 2020-06-27T05:58:24.843382+0000 mgr.x (mgr.34109) 2377 : cluster [DBG] pgmap v2451: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:26 smithi031 bash[18426]: cluster 2020-06-27T05:58:24.843382+0000 mgr.x (mgr.34109) 2377 : cluster [DBG] pgmap v2451: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:28.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:28 smithi051 bash[18409]: cluster 2020-06-27T05:58:26.845041+0000 mgr.x (mgr.34109) 2378 : cluster [DBG] pgmap v2452: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:28.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:28 smithi031 bash[22603]: cluster 2020-06-27T05:58:26.845041+0000 mgr.x (mgr.34109) 2378 : cluster [DBG] pgmap v2452: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:28.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:28 smithi031 bash[18426]: cluster 2020-06-27T05:58:26.845041+0000 mgr.x (mgr.34109) 2378 : cluster [DBG] pgmap v2452: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:30.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:30 smithi051 bash[18409]: cluster 2020-06-27T05:58:28.846678+0000 mgr.x (mgr.34109) 2379 : cluster [DBG] pgmap v2453: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:30.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:30 smithi031 bash[22603]: cluster 2020-06-27T05:58:28.846678+0000 mgr.x (mgr.34109) 2379 : cluster [DBG] pgmap v2453: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:30.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:30 smithi031 bash[18426]: cluster 2020-06-27T05:58:28.846678+0000 mgr.x (mgr.34109) 2379 : cluster [DBG] pgmap v2453: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:32.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:32 smithi051 bash[18409]: cluster 2020-06-27T05:58:30.848396+0000 mgr.x (mgr.34109) 2380 : cluster [DBG] pgmap v2454: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:32.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:32 smithi031 bash[18426]: cluster 2020-06-27T05:58:30.848396+0000 mgr.x (mgr.34109) 2380 : cluster [DBG] pgmap v2454: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:32.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:32 smithi031 bash[22603]: cluster 2020-06-27T05:58:30.848396+0000 mgr.x (mgr.34109) 2380 : cluster [DBG] pgmap v2454: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:34.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:34 smithi051 bash[18409]: cluster 2020-06-27T05:58:32.850024+0000 mgr.x (mgr.34109) 2381 : cluster [DBG] pgmap v2455: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:34 smithi031 bash[18426]: cluster 2020-06-27T05:58:32.850024+0000 mgr.x (mgr.34109) 2381 : cluster [DBG] pgmap v2455: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:34 smithi031 bash[22603]: cluster 2020-06-27T05:58:32.850024+0000 mgr.x (mgr.34109) 2381 : cluster [DBG] pgmap v2455: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:36 smithi051 bash[18409]: cluster 2020-06-27T05:58:34.851675+0000 mgr.x (mgr.34109) 2382 : cluster [DBG] pgmap v2456: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:36.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:36 smithi031 bash[22603]: cluster 2020-06-27T05:58:34.851675+0000 mgr.x (mgr.34109) 2382 : cluster [DBG] pgmap v2456: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:36 smithi031 bash[18426]: cluster 2020-06-27T05:58:34.851675+0000 mgr.x (mgr.34109) 2382 : cluster [DBG] pgmap v2456: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:38.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:38 smithi051 bash[18409]: cluster 2020-06-27T05:58:36.853367+0000 mgr.x (mgr.34109) 2383 : cluster [DBG] pgmap v2457: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:38 smithi031 bash[18426]: cluster 2020-06-27T05:58:36.853367+0000 mgr.x (mgr.34109) 2383 : cluster [DBG] pgmap v2457: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:38 smithi031 bash[22603]: cluster 2020-06-27T05:58:36.853367+0000 mgr.x (mgr.34109) 2383 : cluster [DBG] pgmap v2457: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:40.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:40 smithi051 bash[18409]: cluster 2020-06-27T05:58:38.854977+0000 mgr.x (mgr.34109) 2384 : cluster [DBG] pgmap v2458: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:40 smithi031 bash[18426]: cluster 2020-06-27T05:58:38.854977+0000 mgr.x (mgr.34109) 2384 : cluster [DBG] pgmap v2458: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:40.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:40 smithi031 bash[22603]: cluster 2020-06-27T05:58:38.854977+0000 mgr.x (mgr.34109) 2384 : cluster [DBG] pgmap v2458: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:42.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:42 smithi051 bash[18409]: cluster 2020-06-27T05:58:40.856563+0000 mgr.x (mgr.34109) 2385 : cluster [DBG] pgmap v2459: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:42.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:42 smithi031 bash[18426]: cluster 2020-06-27T05:58:40.856563+0000 mgr.x (mgr.34109) 2385 : cluster [DBG] pgmap v2459: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:42.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:42 smithi031 bash[22603]: cluster 2020-06-27T05:58:40.856563+0000 mgr.x (mgr.34109) 2385 : cluster [DBG] pgmap v2459: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:44.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:44 smithi051 bash[18409]: cluster 2020-06-27T05:58:42.858281+0000 mgr.x (mgr.34109) 2386 : cluster [DBG] pgmap v2460: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:44 smithi031 bash[18426]: cluster 2020-06-27T05:58:42.858281+0000 mgr.x (mgr.34109) 2386 : cluster [DBG] pgmap v2460: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:44 smithi031 bash[22603]: cluster 2020-06-27T05:58:42.858281+0000 mgr.x (mgr.34109) 2386 : cluster [DBG] pgmap v2460: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:46.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:46 smithi051 bash[18409]: cluster 2020-06-27T05:58:44.859956+0000 mgr.x (mgr.34109) 2387 : cluster [DBG] pgmap v2461: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:46 smithi031 bash[18426]: cluster 2020-06-27T05:58:44.859956+0000 mgr.x (mgr.34109) 2387 : cluster [DBG] pgmap v2461: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:46.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:46 smithi031 bash[22603]: cluster 2020-06-27T05:58:44.859956+0000 mgr.x (mgr.34109) 2387 : cluster [DBG] pgmap v2461: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:48.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:48 smithi051 bash[18409]: cluster 2020-06-27T05:58:46.861654+0000 mgr.x (mgr.34109) 2388 : cluster [DBG] pgmap v2462: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:48.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:48 smithi031 bash[18426]: cluster 2020-06-27T05:58:46.861654+0000 mgr.x (mgr.34109) 2388 : cluster [DBG] pgmap v2462: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:48.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:48 smithi031 bash[22603]: cluster 2020-06-27T05:58:46.861654+0000 mgr.x (mgr.34109) 2388 : cluster [DBG] pgmap v2462: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:50.969 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:50 smithi051 bash[18409]: cluster 2020-06-27T05:58:48.863252+0000 mgr.x (mgr.34109) 2389 : cluster [DBG] pgmap v2463: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:50.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:50 smithi031 bash[18426]: cluster 2020-06-27T05:58:48.863252+0000 mgr.x (mgr.34109) 2389 : cluster [DBG] pgmap v2463: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:50.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:50 smithi031 bash[22603]: cluster 2020-06-27T05:58:48.863252+0000 mgr.x (mgr.34109) 2389 : cluster [DBG] pgmap v2463: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:52.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:52 smithi051 bash[18409]: cluster 2020-06-27T05:58:50.864944+0000 mgr.x (mgr.34109) 2390 : cluster [DBG] pgmap v2464: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:52 smithi031 bash[18426]: cluster 2020-06-27T05:58:50.864944+0000 mgr.x (mgr.34109) 2390 : cluster [DBG] pgmap v2464: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:52 smithi031 bash[22603]: cluster 2020-06-27T05:58:50.864944+0000 mgr.x (mgr.34109) 2390 : cluster [DBG] pgmap v2464: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:54.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:54 smithi051 bash[18409]: cluster 2020-06-27T05:58:52.866625+0000 mgr.x (mgr.34109) 2391 : cluster [DBG] pgmap v2465: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:54.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:54 smithi031 bash[18426]: cluster 2020-06-27T05:58:52.866625+0000 mgr.x (mgr.34109) 2391 : cluster [DBG] pgmap v2465: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:54 smithi031 bash[22603]: cluster 2020-06-27T05:58:52.866625+0000 mgr.x (mgr.34109) 2391 : cluster [DBG] pgmap v2465: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:56.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:56 smithi051 bash[18409]: cluster 2020-06-27T05:58:54.868323+0000 mgr.x (mgr.34109) 2392 : cluster [DBG] pgmap v2466: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:56.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:56 smithi031 bash[18426]: cluster 2020-06-27T05:58:54.868323+0000 mgr.x (mgr.34109) 2392 : cluster [DBG] pgmap v2466: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:56.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:56 smithi031 bash[22603]: cluster 2020-06-27T05:58:54.868323+0000 mgr.x (mgr.34109) 2392 : cluster [DBG] pgmap v2466: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:58.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:58 smithi051 bash[18409]: cluster 2020-06-27T05:58:56.870066+0000 mgr.x (mgr.34109) 2393 : cluster [DBG] pgmap v2467: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:58.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:58 smithi031 bash[18426]: cluster 2020-06-27T05:58:56.870066+0000 mgr.x (mgr.34109) 2393 : cluster [DBG] pgmap v2467: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:58.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:58 smithi031 bash[22603]: cluster 2020-06-27T05:58:56.870066+0000 mgr.x (mgr.34109) 2393 : cluster [DBG] pgmap v2467: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:59.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:58:59 smithi051 bash[18409]: cluster 2020-06-27T05:58:58.871743+0000 mgr.x (mgr.34109) 2394 : cluster [DBG] pgmap v2468: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:59.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:58:59 smithi031 bash[18426]: cluster 2020-06-27T05:58:58.871743+0000 mgr.x (mgr.34109) 2394 : cluster [DBG] pgmap v2468: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:58:59.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:58:59 smithi031 bash[22603]: cluster 2020-06-27T05:58:58.871743+0000 mgr.x (mgr.34109) 2394 : cluster [DBG] pgmap v2468: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:02.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:02 smithi051 bash[18409]: cluster 2020-06-27T05:59:00.873455+0000 mgr.x (mgr.34109) 2395 : cluster [DBG] pgmap v2469: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:02.729 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:02 smithi031 bash[18426]: cluster 2020-06-27T05:59:00.873455+0000 mgr.x (mgr.34109) 2395 : cluster [DBG] pgmap v2469: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:02.729 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:02 smithi031 bash[22603]: cluster 2020-06-27T05:59:00.873455+0000 mgr.x (mgr.34109) 2395 : cluster [DBG] pgmap v2469: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:04.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:04 smithi051 bash[18409]: cluster 2020-06-27T05:59:02.875129+0000 mgr.x (mgr.34109) 2396 : cluster [DBG] pgmap v2470: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:04.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:04 smithi031 bash[18426]: cluster 2020-06-27T05:59:02.875129+0000 mgr.x (mgr.34109) 2396 : cluster [DBG] pgmap v2470: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:04.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:04 smithi031 bash[22603]: cluster 2020-06-27T05:59:02.875129+0000 mgr.x (mgr.34109) 2396 : cluster [DBG] pgmap v2470: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:06.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:06 smithi031 bash[18426]: cluster 2020-06-27T05:59:04.876850+0000 mgr.x (mgr.34109) 2397 : cluster [DBG] pgmap v2471: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:06.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:06 smithi031 bash[22603]: cluster 2020-06-27T05:59:04.876850+0000 mgr.x (mgr.34109) 2397 : cluster [DBG] pgmap v2471: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:06.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:06 smithi051 bash[18409]: cluster 2020-06-27T05:59:04.876850+0000 mgr.x (mgr.34109) 2397 : cluster [DBG] pgmap v2471: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:08.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:08 smithi051 bash[18409]: cluster 2020-06-27T05:59:06.878557+0000 mgr.x (mgr.34109) 2398 : cluster [DBG] pgmap v2472: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:08.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:08 smithi031 bash[22603]: cluster 2020-06-27T05:59:06.878557+0000 mgr.x (mgr.34109) 2398 : cluster [DBG] pgmap v2472: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:08.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:08 smithi031 bash[18426]: cluster 2020-06-27T05:59:06.878557+0000 mgr.x (mgr.34109) 2398 : cluster [DBG] pgmap v2472: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:10.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:10 smithi051 bash[18409]: cluster 2020-06-27T05:59:08.880316+0000 mgr.x (mgr.34109) 2399 : cluster [DBG] pgmap v2473: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:10.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:10 smithi031 bash[18426]: cluster 2020-06-27T05:59:08.880316+0000 mgr.x (mgr.34109) 2399 : cluster [DBG] pgmap v2473: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:10.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:10 smithi031 bash[22603]: cluster 2020-06-27T05:59:08.880316+0000 mgr.x (mgr.34109) 2399 : cluster [DBG] pgmap v2473: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:12.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:12 smithi051 bash[18409]: cluster 2020-06-27T05:59:10.882084+0000 mgr.x (mgr.34109) 2400 : cluster [DBG] pgmap v2474: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:12.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:12 smithi031 bash[22603]: cluster 2020-06-27T05:59:10.882084+0000 mgr.x (mgr.34109) 2400 : cluster [DBG] pgmap v2474: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:12 smithi031 bash[18426]: cluster 2020-06-27T05:59:10.882084+0000 mgr.x (mgr.34109) 2400 : cluster [DBG] pgmap v2474: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:14 smithi051 bash[18409]: cluster 2020-06-27T05:59:12.883741+0000 mgr.x (mgr.34109) 2401 : cluster [DBG] pgmap v2475: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:14 smithi031 bash[18426]: cluster 2020-06-27T05:59:12.883741+0000 mgr.x (mgr.34109) 2401 : cluster [DBG] pgmap v2475: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:14 smithi031 bash[22603]: cluster 2020-06-27T05:59:12.883741+0000 mgr.x (mgr.34109) 2401 : cluster [DBG] pgmap v2475: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:16 smithi051 bash[18409]: cluster 2020-06-27T05:59:14.885562+0000 mgr.x (mgr.34109) 2402 : cluster [DBG] pgmap v2476: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:16 smithi031 bash[22603]: cluster 2020-06-27T05:59:14.885562+0000 mgr.x (mgr.34109) 2402 : cluster [DBG] pgmap v2476: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:16 smithi031 bash[18426]: cluster 2020-06-27T05:59:14.885562+0000 mgr.x (mgr.34109) 2402 : cluster [DBG] pgmap v2476: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:18.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:18 smithi051 bash[18409]: cluster 2020-06-27T05:59:16.887221+0000 mgr.x (mgr.34109) 2403 : cluster [DBG] pgmap v2477: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:18 smithi031 bash[22603]: cluster 2020-06-27T05:59:16.887221+0000 mgr.x (mgr.34109) 2403 : cluster [DBG] pgmap v2477: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:18 smithi031 bash[18426]: cluster 2020-06-27T05:59:16.887221+0000 mgr.x (mgr.34109) 2403 : cluster [DBG] pgmap v2477: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:20.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:20 smithi051 bash[18409]: cluster 2020-06-27T05:59:18.889029+0000 mgr.x (mgr.34109) 2404 : cluster [DBG] pgmap v2478: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:20.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:20 smithi031 bash[22603]: cluster 2020-06-27T05:59:18.889029+0000 mgr.x (mgr.34109) 2404 : cluster [DBG] pgmap v2478: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:20 smithi031 bash[18426]: cluster 2020-06-27T05:59:18.889029+0000 mgr.x (mgr.34109) 2404 : cluster [DBG] pgmap v2478: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:22 smithi051 bash[18409]: cluster 2020-06-27T05:59:20.890811+0000 mgr.x (mgr.34109) 2405 : cluster [DBG] pgmap v2479: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:22.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:22 smithi031 bash[22603]: cluster 2020-06-27T05:59:20.890811+0000 mgr.x (mgr.34109) 2405 : cluster [DBG] pgmap v2479: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:22.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:22 smithi031 bash[18426]: cluster 2020-06-27T05:59:20.890811+0000 mgr.x (mgr.34109) 2405 : cluster [DBG] pgmap v2479: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:24 smithi051 bash[18409]: cluster 2020-06-27T05:59:22.892635+0000 mgr.x (mgr.34109) 2406 : cluster [DBG] pgmap v2480: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:24.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:24 smithi031 bash[18426]: cluster 2020-06-27T05:59:22.892635+0000 mgr.x (mgr.34109) 2406 : cluster [DBG] pgmap v2480: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:24 smithi031 bash[22603]: cluster 2020-06-27T05:59:22.892635+0000 mgr.x (mgr.34109) 2406 : cluster [DBG] pgmap v2480: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:26.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:26 smithi051 bash[18409]: cluster 2020-06-27T05:59:24.894385+0000 mgr.x (mgr.34109) 2407 : cluster [DBG] pgmap v2481: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:26 smithi031 bash[18426]: cluster 2020-06-27T05:59:24.894385+0000 mgr.x (mgr.34109) 2407 : cluster [DBG] pgmap v2481: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:26.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:26 smithi031 bash[22603]: cluster 2020-06-27T05:59:24.894385+0000 mgr.x (mgr.34109) 2407 : cluster [DBG] pgmap v2481: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:28.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:28 smithi051 bash[18409]: cluster 2020-06-27T05:59:26.896086+0000 mgr.x (mgr.34109) 2408 : cluster [DBG] pgmap v2482: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:28.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:28 smithi031 bash[18426]: cluster 2020-06-27T05:59:26.896086+0000 mgr.x (mgr.34109) 2408 : cluster [DBG] pgmap v2482: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:28.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:28 smithi031 bash[22603]: cluster 2020-06-27T05:59:26.896086+0000 mgr.x (mgr.34109) 2408 : cluster [DBG] pgmap v2482: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:30.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:30 smithi051 bash[18409]: cluster 2020-06-27T05:59:28.897879+0000 mgr.x (mgr.34109) 2409 : cluster [DBG] pgmap v2483: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:30.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:30 smithi031 bash[18426]: cluster 2020-06-27T05:59:28.897879+0000 mgr.x (mgr.34109) 2409 : cluster [DBG] pgmap v2483: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:30.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:30 smithi031 bash[22603]: cluster 2020-06-27T05:59:28.897879+0000 mgr.x (mgr.34109) 2409 : cluster [DBG] pgmap v2483: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:32.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:32 smithi051 bash[18409]: cluster 2020-06-27T05:59:30.899574+0000 mgr.x (mgr.34109) 2410 : cluster [DBG] pgmap v2484: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:32.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:32 smithi031 bash[18426]: cluster 2020-06-27T05:59:30.899574+0000 mgr.x (mgr.34109) 2410 : cluster [DBG] pgmap v2484: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:32.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:32 smithi031 bash[22603]: cluster 2020-06-27T05:59:30.899574+0000 mgr.x (mgr.34109) 2410 : cluster [DBG] pgmap v2484: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:34.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:34 smithi051 bash[18409]: cluster 2020-06-27T05:59:32.901270+0000 mgr.x (mgr.34109) 2411 : cluster [DBG] pgmap v2485: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:34 smithi031 bash[18426]: cluster 2020-06-27T05:59:32.901270+0000 mgr.x (mgr.34109) 2411 : cluster [DBG] pgmap v2485: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:34 smithi031 bash[22603]: cluster 2020-06-27T05:59:32.901270+0000 mgr.x (mgr.34109) 2411 : cluster [DBG] pgmap v2485: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:36 smithi051 bash[18409]: cluster 2020-06-27T05:59:34.902879+0000 mgr.x (mgr.34109) 2412 : cluster [DBG] pgmap v2486: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:36 smithi031 bash[18426]: cluster 2020-06-27T05:59:34.902879+0000 mgr.x (mgr.34109) 2412 : cluster [DBG] pgmap v2486: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:36.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:36 smithi031 bash[22603]: cluster 2020-06-27T05:59:34.902879+0000 mgr.x (mgr.34109) 2412 : cluster [DBG] pgmap v2486: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:38.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:38 smithi051 bash[18409]: cluster 2020-06-27T05:59:36.904470+0000 mgr.x (mgr.34109) 2413 : cluster [DBG] pgmap v2487: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:38 smithi031 bash[18426]: cluster 2020-06-27T05:59:36.904470+0000 mgr.x (mgr.34109) 2413 : cluster [DBG] pgmap v2487: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:38 smithi031 bash[22603]: cluster 2020-06-27T05:59:36.904470+0000 mgr.x (mgr.34109) 2413 : cluster [DBG] pgmap v2487: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:40.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:40 smithi051 bash[18409]: cluster 2020-06-27T05:59:38.906087+0000 mgr.x (mgr.34109) 2414 : cluster [DBG] pgmap v2488: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:40 smithi031 bash[18426]: cluster 2020-06-27T05:59:38.906087+0000 mgr.x (mgr.34109) 2414 : cluster [DBG] pgmap v2488: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:40.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:40 smithi031 bash[22603]: cluster 2020-06-27T05:59:38.906087+0000 mgr.x (mgr.34109) 2414 : cluster [DBG] pgmap v2488: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:42.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:42 smithi051 bash[18409]: cluster 2020-06-27T05:59:40.907843+0000 mgr.x (mgr.34109) 2415 : cluster [DBG] pgmap v2489: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:42.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:42 smithi031 bash[18426]: cluster 2020-06-27T05:59:40.907843+0000 mgr.x (mgr.34109) 2415 : cluster [DBG] pgmap v2489: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:42.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:42 smithi031 bash[22603]: cluster 2020-06-27T05:59:40.907843+0000 mgr.x (mgr.34109) 2415 : cluster [DBG] pgmap v2489: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:44.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:44 smithi051 bash[18409]: cluster 2020-06-27T05:59:42.909506+0000 mgr.x (mgr.34109) 2416 : cluster [DBG] pgmap v2490: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:44 smithi031 bash[18426]: cluster 2020-06-27T05:59:42.909506+0000 mgr.x (mgr.34109) 2416 : cluster [DBG] pgmap v2490: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:44 smithi031 bash[22603]: cluster 2020-06-27T05:59:42.909506+0000 mgr.x (mgr.34109) 2416 : cluster [DBG] pgmap v2490: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:46.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:46 smithi051 bash[18409]: cluster 2020-06-27T05:59:44.911216+0000 mgr.x (mgr.34109) 2417 : cluster [DBG] pgmap v2491: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:46 smithi031 bash[18426]: cluster 2020-06-27T05:59:44.911216+0000 mgr.x (mgr.34109) 2417 : cluster [DBG] pgmap v2491: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:46.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:46 smithi031 bash[22603]: cluster 2020-06-27T05:59:44.911216+0000 mgr.x (mgr.34109) 2417 : cluster [DBG] pgmap v2491: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:48.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:48 smithi051 bash[18409]: cluster 2020-06-27T05:59:46.912859+0000 mgr.x (mgr.34109) 2418 : cluster [DBG] pgmap v2492: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:48.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:48 smithi031 bash[18426]: cluster 2020-06-27T05:59:46.912859+0000 mgr.x (mgr.34109) 2418 : cluster [DBG] pgmap v2492: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:48.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:48 smithi031 bash[22603]: cluster 2020-06-27T05:59:46.912859+0000 mgr.x (mgr.34109) 2418 : cluster [DBG] pgmap v2492: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:50.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:50 smithi051 bash[18409]: cluster 2020-06-27T05:59:48.914530+0000 mgr.x (mgr.34109) 2419 : cluster [DBG] pgmap v2493: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:50.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:50 smithi031 bash[18426]: cluster 2020-06-27T05:59:48.914530+0000 mgr.x (mgr.34109) 2419 : cluster [DBG] pgmap v2493: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:50.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:50 smithi031 bash[22603]: cluster 2020-06-27T05:59:48.914530+0000 mgr.x (mgr.34109) 2419 : cluster [DBG] pgmap v2493: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:52 smithi051 bash[18409]: cluster 2020-06-27T05:59:50.916265+0000 mgr.x (mgr.34109) 2420 : cluster [DBG] pgmap v2494: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:52.976 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:52 smithi031 bash[18426]: cluster 2020-06-27T05:59:50.916265+0000 mgr.x (mgr.34109) 2420 : cluster [DBG] pgmap v2494: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:52.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:52 smithi031 bash[22603]: cluster 2020-06-27T05:59:50.916265+0000 mgr.x (mgr.34109) 2420 : cluster [DBG] pgmap v2494: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:54.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:54 smithi051 bash[18409]: cluster 2020-06-27T05:59:52.917888+0000 mgr.x (mgr.34109) 2421 : cluster [DBG] pgmap v2495: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:54 smithi031 bash[22603]: cluster 2020-06-27T05:59:52.917888+0000 mgr.x (mgr.34109) 2421 : cluster [DBG] pgmap v2495: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:54.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:54 smithi031 bash[18426]: cluster 2020-06-27T05:59:52.917888+0000 mgr.x (mgr.34109) 2421 : cluster [DBG] pgmap v2495: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:56.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:56 smithi051 bash[18409]: cluster 2020-06-27T05:59:54.919455+0000 mgr.x (mgr.34109) 2422 : cluster [DBG] pgmap v2496: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:56.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:56 smithi031 bash[18426]: cluster 2020-06-27T05:59:54.919455+0000 mgr.x (mgr.34109) 2422 : cluster [DBG] pgmap v2496: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:56.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:56 smithi031 bash[22603]: cluster 2020-06-27T05:59:54.919455+0000 mgr.x (mgr.34109) 2422 : cluster [DBG] pgmap v2496: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:58.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 05:59:58 smithi051 bash[18409]: cluster 2020-06-27T05:59:56.921134+0000 mgr.x (mgr.34109) 2423 : cluster [DBG] pgmap v2497: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:58.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 05:59:58 smithi031 bash[18426]: cluster 2020-06-27T05:59:56.921134+0000 mgr.x (mgr.34109) 2423 : cluster [DBG] pgmap v2497: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T05:59:58.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 05:59:58 smithi031 bash[22603]: cluster 2020-06-27T05:59:56.921134+0000 mgr.x (mgr.34109) 2423 : cluster [DBG] pgmap v2497: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:00.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:00 smithi051 bash[18409]: cluster 2020-06-27T05:59:58.922783+0000 mgr.x (mgr.34109) 2424 : cluster [DBG] pgmap v2498: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:00.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:00 smithi051 bash[18409]: cluster 2020-06-27T06:00:00.000253+0000 mon.a (mon.0) 1495 : cluster [WRN] overall HEALTH_WARN 3 osds down; Reduced data availability: 586 pgs inactive, 193 pgs down, 164 pgs peering, 758 pgs stale; Degraded data redundancy: 273/1116 objects degraded (24.462%), 72 pgs degraded, 388 pgs undersized; 9 pool(s) do not have an application enabled; 1 pool(s) full 2020-06-27T06:00:00.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:00 smithi031 bash[18426]: cluster 2020-06-27T05:59:58.922783+0000 mgr.x (mgr.34109) 2424 : cluster [DBG] pgmap v2498: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:00.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:00 smithi031 bash[18426]: cluster 2020-06-27T06:00:00.000253+0000 mon.a (mon.0) 1495 : cluster [WRN] overall HEALTH_WARN 3 osds down; Reduced data availability: 586 pgs inactive, 193 pgs down, 164 pgs peering, 758 pgs stale; Degraded data redundancy: 273/1116 objects degraded (24.462%), 72 pgs degraded, 388 pgs undersized; 9 pool(s) do not have an application enabled; 1 pool(s) full 2020-06-27T06:00:00.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:00 smithi031 bash[22603]: cluster 2020-06-27T05:59:58.922783+0000 mgr.x (mgr.34109) 2424 : cluster [DBG] pgmap v2498: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:00.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:00 smithi031 bash[22603]: cluster 2020-06-27T06:00:00.000253+0000 mon.a (mon.0) 1495 : cluster [WRN] overall HEALTH_WARN 3 osds down; Reduced data availability: 586 pgs inactive, 193 pgs down, 164 pgs peering, 758 pgs stale; Degraded data redundancy: 273/1116 objects degraded (24.462%), 72 pgs degraded, 388 pgs undersized; 9 pool(s) do not have an application enabled; 1 pool(s) full 2020-06-27T06:00:02.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:02 smithi051 bash[18409]: cluster 2020-06-27T06:00:00.924438+0000 mgr.x (mgr.34109) 2425 : cluster [DBG] pgmap v2499: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:02.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:02 smithi031 bash[18426]: cluster 2020-06-27T06:00:00.924438+0000 mgr.x (mgr.34109) 2425 : cluster [DBG] pgmap v2499: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:02.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:02 smithi031 bash[22603]: cluster 2020-06-27T06:00:00.924438+0000 mgr.x (mgr.34109) 2425 : cluster [DBG] pgmap v2499: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:03.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:03 smithi051 bash[18409]: cluster 2020-06-27T06:00:02.926159+0000 mgr.x (mgr.34109) 2426 : cluster [DBG] pgmap v2500: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:03.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:03 smithi031 bash[18426]: cluster 2020-06-27T06:00:02.926159+0000 mgr.x (mgr.34109) 2426 : cluster [DBG] pgmap v2500: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:03.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:03 smithi031 bash[22603]: cluster 2020-06-27T06:00:02.926159+0000 mgr.x (mgr.34109) 2426 : cluster [DBG] pgmap v2500: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:06.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:06 smithi051 bash[18409]: cluster 2020-06-27T06:00:04.927802+0000 mgr.x (mgr.34109) 2427 : cluster [DBG] pgmap v2501: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:06.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:06 smithi031 bash[18426]: cluster 2020-06-27T06:00:04.927802+0000 mgr.x (mgr.34109) 2427 : cluster [DBG] pgmap v2501: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:06.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:06 smithi031 bash[22603]: cluster 2020-06-27T06:00:04.927802+0000 mgr.x (mgr.34109) 2427 : cluster [DBG] pgmap v2501: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:08.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:08 smithi031 bash[18426]: cluster 2020-06-27T06:00:06.929563+0000 mgr.x (mgr.34109) 2428 : cluster [DBG] pgmap v2502: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:08.724 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:08 smithi031 bash[22603]: cluster 2020-06-27T06:00:06.929563+0000 mgr.x (mgr.34109) 2428 : cluster [DBG] pgmap v2502: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:08.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:08 smithi051 bash[18409]: cluster 2020-06-27T06:00:06.929563+0000 mgr.x (mgr.34109) 2428 : cluster [DBG] pgmap v2502: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:10.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:10 smithi051 bash[18409]: cluster 2020-06-27T06:00:08.931263+0000 mgr.x (mgr.34109) 2429 : cluster [DBG] pgmap v2503: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:10.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:10 smithi031 bash[18426]: cluster 2020-06-27T06:00:08.931263+0000 mgr.x (mgr.34109) 2429 : cluster [DBG] pgmap v2503: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:10.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:10 smithi031 bash[22603]: cluster 2020-06-27T06:00:08.931263+0000 mgr.x (mgr.34109) 2429 : cluster [DBG] pgmap v2503: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:12.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:12 smithi051 bash[18409]: cluster 2020-06-27T06:00:10.932932+0000 mgr.x (mgr.34109) 2430 : cluster [DBG] pgmap v2504: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:12 smithi031 bash[18426]: cluster 2020-06-27T06:00:10.932932+0000 mgr.x (mgr.34109) 2430 : cluster [DBG] pgmap v2504: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:12.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:12 smithi031 bash[22603]: cluster 2020-06-27T06:00:10.932932+0000 mgr.x (mgr.34109) 2430 : cluster [DBG] pgmap v2504: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:14 smithi051 bash[18409]: cluster 2020-06-27T06:00:12.934575+0000 mgr.x (mgr.34109) 2431 : cluster [DBG] pgmap v2505: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:14 smithi031 bash[18426]: cluster 2020-06-27T06:00:12.934575+0000 mgr.x (mgr.34109) 2431 : cluster [DBG] pgmap v2505: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:14 smithi031 bash[22603]: cluster 2020-06-27T06:00:12.934575+0000 mgr.x (mgr.34109) 2431 : cluster [DBG] pgmap v2505: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:16 smithi051 bash[18409]: cluster 2020-06-27T06:00:14.936186+0000 mgr.x (mgr.34109) 2432 : cluster [DBG] pgmap v2506: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:16 smithi031 bash[18426]: cluster 2020-06-27T06:00:14.936186+0000 mgr.x (mgr.34109) 2432 : cluster [DBG] pgmap v2506: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:16 smithi031 bash[22603]: cluster 2020-06-27T06:00:14.936186+0000 mgr.x (mgr.34109) 2432 : cluster [DBG] pgmap v2506: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:18.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:18 smithi051 bash[18409]: cluster 2020-06-27T06:00:16.937921+0000 mgr.x (mgr.34109) 2433 : cluster [DBG] pgmap v2507: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:18 smithi031 bash[18426]: cluster 2020-06-27T06:00:16.937921+0000 mgr.x (mgr.34109) 2433 : cluster [DBG] pgmap v2507: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:18 smithi031 bash[22603]: cluster 2020-06-27T06:00:16.937921+0000 mgr.x (mgr.34109) 2433 : cluster [DBG] pgmap v2507: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:20.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:20 smithi051 bash[18409]: cluster 2020-06-27T06:00:18.939517+0000 mgr.x (mgr.34109) 2434 : cluster [DBG] pgmap v2508: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:20 smithi031 bash[18426]: cluster 2020-06-27T06:00:18.939517+0000 mgr.x (mgr.34109) 2434 : cluster [DBG] pgmap v2508: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:20.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:20 smithi031 bash[22603]: cluster 2020-06-27T06:00:18.939517+0000 mgr.x (mgr.34109) 2434 : cluster [DBG] pgmap v2508: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:22 smithi051 bash[18409]: cluster 2020-06-27T06:00:20.941131+0000 mgr.x (mgr.34109) 2435 : cluster [DBG] pgmap v2509: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:22.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:22 smithi031 bash[18426]: cluster 2020-06-27T06:00:20.941131+0000 mgr.x (mgr.34109) 2435 : cluster [DBG] pgmap v2509: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:22.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:22 smithi031 bash[22603]: cluster 2020-06-27T06:00:20.941131+0000 mgr.x (mgr.34109) 2435 : cluster [DBG] pgmap v2509: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:24 smithi051 bash[18409]: cluster 2020-06-27T06:00:22.942819+0000 mgr.x (mgr.34109) 2436 : cluster [DBG] pgmap v2510: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:24.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:24 smithi031 bash[18426]: cluster 2020-06-27T06:00:22.942819+0000 mgr.x (mgr.34109) 2436 : cluster [DBG] pgmap v2510: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:24 smithi031 bash[22603]: cluster 2020-06-27T06:00:22.942819+0000 mgr.x (mgr.34109) 2436 : cluster [DBG] pgmap v2510: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:26.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:26 smithi051 bash[18409]: cluster 2020-06-27T06:00:24.944488+0000 mgr.x (mgr.34109) 2437 : cluster [DBG] pgmap v2511: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:26 smithi031 bash[18426]: cluster 2020-06-27T06:00:24.944488+0000 mgr.x (mgr.34109) 2437 : cluster [DBG] pgmap v2511: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:26.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:26 smithi031 bash[22603]: cluster 2020-06-27T06:00:24.944488+0000 mgr.x (mgr.34109) 2437 : cluster [DBG] pgmap v2511: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:28.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:28 smithi051 bash[18409]: cluster 2020-06-27T06:00:26.946086+0000 mgr.x (mgr.34109) 2438 : cluster [DBG] pgmap v2512: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:28.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:28 smithi031 bash[22603]: cluster 2020-06-27T06:00:26.946086+0000 mgr.x (mgr.34109) 2438 : cluster [DBG] pgmap v2512: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:28.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:28 smithi031 bash[18426]: cluster 2020-06-27T06:00:26.946086+0000 mgr.x (mgr.34109) 2438 : cluster [DBG] pgmap v2512: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:30.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:30 smithi051 bash[18409]: cluster 2020-06-27T06:00:28.947792+0000 mgr.x (mgr.34109) 2439 : cluster [DBG] pgmap v2513: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:30.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:30 smithi031 bash[18426]: cluster 2020-06-27T06:00:28.947792+0000 mgr.x (mgr.34109) 2439 : cluster [DBG] pgmap v2513: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:30.976 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:30 smithi031 bash[22603]: cluster 2020-06-27T06:00:28.947792+0000 mgr.x (mgr.34109) 2439 : cluster [DBG] pgmap v2513: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:32.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:32 smithi051 bash[18409]: cluster 2020-06-27T06:00:30.949471+0000 mgr.x (mgr.34109) 2440 : cluster [DBG] pgmap v2514: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:32.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:32 smithi031 bash[18426]: cluster 2020-06-27T06:00:30.949471+0000 mgr.x (mgr.34109) 2440 : cluster [DBG] pgmap v2514: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:32.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:32 smithi031 bash[22603]: cluster 2020-06-27T06:00:30.949471+0000 mgr.x (mgr.34109) 2440 : cluster [DBG] pgmap v2514: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:34.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:34 smithi051 bash[18409]: cluster 2020-06-27T06:00:32.951160+0000 mgr.x (mgr.34109) 2441 : cluster [DBG] pgmap v2515: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:34 smithi031 bash[18426]: cluster 2020-06-27T06:00:32.951160+0000 mgr.x (mgr.34109) 2441 : cluster [DBG] pgmap v2515: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:34 smithi031 bash[22603]: cluster 2020-06-27T06:00:32.951160+0000 mgr.x (mgr.34109) 2441 : cluster [DBG] pgmap v2515: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:36 smithi051 bash[18409]: cluster 2020-06-27T06:00:34.952782+0000 mgr.x (mgr.34109) 2442 : cluster [DBG] pgmap v2516: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:36 smithi031 bash[18426]: cluster 2020-06-27T06:00:34.952782+0000 mgr.x (mgr.34109) 2442 : cluster [DBG] pgmap v2516: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:36.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:36 smithi031 bash[22603]: cluster 2020-06-27T06:00:34.952782+0000 mgr.x (mgr.34109) 2442 : cluster [DBG] pgmap v2516: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:38.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:38 smithi051 bash[18409]: cluster 2020-06-27T06:00:36.954441+0000 mgr.x (mgr.34109) 2443 : cluster [DBG] pgmap v2517: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:38 smithi031 bash[18426]: cluster 2020-06-27T06:00:36.954441+0000 mgr.x (mgr.34109) 2443 : cluster [DBG] pgmap v2517: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:38 smithi031 bash[22603]: cluster 2020-06-27T06:00:36.954441+0000 mgr.x (mgr.34109) 2443 : cluster [DBG] pgmap v2517: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:40.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:40 smithi051 bash[18409]: cluster 2020-06-27T06:00:38.956010+0000 mgr.x (mgr.34109) 2444 : cluster [DBG] pgmap v2518: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:40 smithi031 bash[18426]: cluster 2020-06-27T06:00:38.956010+0000 mgr.x (mgr.34109) 2444 : cluster [DBG] pgmap v2518: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:40.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:40 smithi031 bash[22603]: cluster 2020-06-27T06:00:38.956010+0000 mgr.x (mgr.34109) 2444 : cluster [DBG] pgmap v2518: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:42.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:42 smithi051 bash[18409]: cluster 2020-06-27T06:00:40.957622+0000 mgr.x (mgr.34109) 2445 : cluster [DBG] pgmap v2519: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:42.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:42 smithi031 bash[18426]: cluster 2020-06-27T06:00:40.957622+0000 mgr.x (mgr.34109) 2445 : cluster [DBG] pgmap v2519: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:42.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:42 smithi031 bash[22603]: cluster 2020-06-27T06:00:40.957622+0000 mgr.x (mgr.34109) 2445 : cluster [DBG] pgmap v2519: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:44.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:44 smithi051 bash[18409]: cluster 2020-06-27T06:00:42.959409+0000 mgr.x (mgr.34109) 2446 : cluster [DBG] pgmap v2520: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:44 smithi031 bash[18426]: cluster 2020-06-27T06:00:42.959409+0000 mgr.x (mgr.34109) 2446 : cluster [DBG] pgmap v2520: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:44 smithi031 bash[22603]: cluster 2020-06-27T06:00:42.959409+0000 mgr.x (mgr.34109) 2446 : cluster [DBG] pgmap v2520: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:46.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:46 smithi051 bash[18409]: cluster 2020-06-27T06:00:44.961066+0000 mgr.x (mgr.34109) 2447 : cluster [DBG] pgmap v2521: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:46 smithi031 bash[18426]: cluster 2020-06-27T06:00:44.961066+0000 mgr.x (mgr.34109) 2447 : cluster [DBG] pgmap v2521: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:46.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:46 smithi031 bash[22603]: cluster 2020-06-27T06:00:44.961066+0000 mgr.x (mgr.34109) 2447 : cluster [DBG] pgmap v2521: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:48.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:48 smithi051 bash[18409]: cluster 2020-06-27T06:00:46.962827+0000 mgr.x (mgr.34109) 2448 : cluster [DBG] pgmap v2522: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:48.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:48 smithi031 bash[18426]: cluster 2020-06-27T06:00:46.962827+0000 mgr.x (mgr.34109) 2448 : cluster [DBG] pgmap v2522: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:48.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:48 smithi031 bash[22603]: cluster 2020-06-27T06:00:46.962827+0000 mgr.x (mgr.34109) 2448 : cluster [DBG] pgmap v2522: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:50.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:50 smithi051 bash[18409]: cluster 2020-06-27T06:00:48.964527+0000 mgr.x (mgr.34109) 2449 : cluster [DBG] pgmap v2523: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:50.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:50 smithi031 bash[18426]: cluster 2020-06-27T06:00:48.964527+0000 mgr.x (mgr.34109) 2449 : cluster [DBG] pgmap v2523: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:50.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:50 smithi031 bash[22603]: cluster 2020-06-27T06:00:48.964527+0000 mgr.x (mgr.34109) 2449 : cluster [DBG] pgmap v2523: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:52 smithi051 bash[18409]: cluster 2020-06-27T06:00:50.966186+0000 mgr.x (mgr.34109) 2450 : cluster [DBG] pgmap v2524: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:52 smithi031 bash[18426]: cluster 2020-06-27T06:00:50.966186+0000 mgr.x (mgr.34109) 2450 : cluster [DBG] pgmap v2524: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:52 smithi031 bash[22603]: cluster 2020-06-27T06:00:50.966186+0000 mgr.x (mgr.34109) 2450 : cluster [DBG] pgmap v2524: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:54.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:54 smithi051 bash[18409]: cluster 2020-06-27T06:00:52.967728+0000 mgr.x (mgr.34109) 2451 : cluster [DBG] pgmap v2525: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:54.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:54 smithi031 bash[18426]: cluster 2020-06-27T06:00:52.967728+0000 mgr.x (mgr.34109) 2451 : cluster [DBG] pgmap v2525: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:54 smithi031 bash[22603]: cluster 2020-06-27T06:00:52.967728+0000 mgr.x (mgr.34109) 2451 : cluster [DBG] pgmap v2525: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:56.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:56 smithi051 bash[18409]: cluster 2020-06-27T06:00:54.969250+0000 mgr.x (mgr.34109) 2452 : cluster [DBG] pgmap v2526: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:56.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:56 smithi031 bash[18426]: cluster 2020-06-27T06:00:54.969250+0000 mgr.x (mgr.34109) 2452 : cluster [DBG] pgmap v2526: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:56.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:56 smithi031 bash[22603]: cluster 2020-06-27T06:00:54.969250+0000 mgr.x (mgr.34109) 2452 : cluster [DBG] pgmap v2526: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:58.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:00:58 smithi051 bash[18409]: cluster 2020-06-27T06:00:56.970917+0000 mgr.x (mgr.34109) 2453 : cluster [DBG] pgmap v2527: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:58.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:00:58 smithi031 bash[18426]: cluster 2020-06-27T06:00:56.970917+0000 mgr.x (mgr.34109) 2453 : cluster [DBG] pgmap v2527: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:00:58.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:00:58 smithi031 bash[22603]: cluster 2020-06-27T06:00:56.970917+0000 mgr.x (mgr.34109) 2453 : cluster [DBG] pgmap v2527: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:00.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:00 smithi051 bash[18409]: cluster 2020-06-27T06:00:58.972502+0000 mgr.x (mgr.34109) 2454 : cluster [DBG] pgmap v2528: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:00.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:00 smithi031 bash[18426]: cluster 2020-06-27T06:00:58.972502+0000 mgr.x (mgr.34109) 2454 : cluster [DBG] pgmap v2528: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:00.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:00 smithi031 bash[22603]: cluster 2020-06-27T06:00:58.972502+0000 mgr.x (mgr.34109) 2454 : cluster [DBG] pgmap v2528: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:02.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:02 smithi051 bash[18409]: cluster 2020-06-27T06:01:00.974049+0000 mgr.x (mgr.34109) 2455 : cluster [DBG] pgmap v2529: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:02.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:02 smithi031 bash[18426]: cluster 2020-06-27T06:01:00.974049+0000 mgr.x (mgr.34109) 2455 : cluster [DBG] pgmap v2529: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:02.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:02 smithi031 bash[22603]: cluster 2020-06-27T06:01:00.974049+0000 mgr.x (mgr.34109) 2455 : cluster [DBG] pgmap v2529: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:04.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:04 smithi051 bash[18409]: cluster 2020-06-27T06:01:02.975661+0000 mgr.x (mgr.34109) 2456 : cluster [DBG] pgmap v2530: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:04.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:04 smithi031 bash[22603]: cluster 2020-06-27T06:01:02.975661+0000 mgr.x (mgr.34109) 2456 : cluster [DBG] pgmap v2530: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:04.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:04 smithi031 bash[18426]: cluster 2020-06-27T06:01:02.975661+0000 mgr.x (mgr.34109) 2456 : cluster [DBG] pgmap v2530: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:06.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:06 smithi051 bash[18409]: cluster 2020-06-27T06:01:04.977235+0000 mgr.x (mgr.34109) 2457 : cluster [DBG] pgmap v2531: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:06.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:06 smithi031 bash[18426]: cluster 2020-06-27T06:01:04.977235+0000 mgr.x (mgr.34109) 2457 : cluster [DBG] pgmap v2531: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:06.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:06 smithi031 bash[22603]: cluster 2020-06-27T06:01:04.977235+0000 mgr.x (mgr.34109) 2457 : cluster [DBG] pgmap v2531: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:08.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:08 smithi051 bash[18409]: cluster 2020-06-27T06:01:06.978913+0000 mgr.x (mgr.34109) 2458 : cluster [DBG] pgmap v2532: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:08.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:08 smithi031 bash[18426]: cluster 2020-06-27T06:01:06.978913+0000 mgr.x (mgr.34109) 2458 : cluster [DBG] pgmap v2532: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:08.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:08 smithi031 bash[22603]: cluster 2020-06-27T06:01:06.978913+0000 mgr.x (mgr.34109) 2458 : cluster [DBG] pgmap v2532: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:10.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:10 smithi051 bash[18409]: cluster 2020-06-27T06:01:08.980613+0000 mgr.x (mgr.34109) 2459 : cluster [DBG] pgmap v2533: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:10.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:10 smithi031 bash[22603]: cluster 2020-06-27T06:01:08.980613+0000 mgr.x (mgr.34109) 2459 : cluster [DBG] pgmap v2533: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:10.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:10 smithi031 bash[18426]: cluster 2020-06-27T06:01:08.980613+0000 mgr.x (mgr.34109) 2459 : cluster [DBG] pgmap v2533: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:11.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:11 smithi051 bash[18409]: cluster 2020-06-27T06:01:10.982296+0000 mgr.x (mgr.34109) 2460 : cluster [DBG] pgmap v2534: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:11.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:11 smithi031 bash[22603]: cluster 2020-06-27T06:01:10.982296+0000 mgr.x (mgr.34109) 2460 : cluster [DBG] pgmap v2534: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:11.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:11 smithi031 bash[18426]: cluster 2020-06-27T06:01:10.982296+0000 mgr.x (mgr.34109) 2460 : cluster [DBG] pgmap v2534: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:14.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:14 smithi051 bash[18409]: cluster 2020-06-27T06:01:12.984069+0000 mgr.x (mgr.34109) 2461 : cluster [DBG] pgmap v2535: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:14.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:14 smithi031 bash[18426]: cluster 2020-06-27T06:01:12.984069+0000 mgr.x (mgr.34109) 2461 : cluster [DBG] pgmap v2535: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:14.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:14 smithi031 bash[22603]: cluster 2020-06-27T06:01:12.984069+0000 mgr.x (mgr.34109) 2461 : cluster [DBG] pgmap v2535: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:16 smithi051 bash[18409]: cluster 2020-06-27T06:01:14.985732+0000 mgr.x (mgr.34109) 2462 : cluster [DBG] pgmap v2536: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:16 smithi031 bash[18426]: cluster 2020-06-27T06:01:14.985732+0000 mgr.x (mgr.34109) 2462 : cluster [DBG] pgmap v2536: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:16 smithi031 bash[22603]: cluster 2020-06-27T06:01:14.985732+0000 mgr.x (mgr.34109) 2462 : cluster [DBG] pgmap v2536: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:18.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:18 smithi051 bash[18409]: cluster 2020-06-27T06:01:16.987386+0000 mgr.x (mgr.34109) 2463 : cluster [DBG] pgmap v2537: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:18 smithi031 bash[18426]: cluster 2020-06-27T06:01:16.987386+0000 mgr.x (mgr.34109) 2463 : cluster [DBG] pgmap v2537: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:18 smithi031 bash[22603]: cluster 2020-06-27T06:01:16.987386+0000 mgr.x (mgr.34109) 2463 : cluster [DBG] pgmap v2537: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:20.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:20 smithi051 bash[18409]: cluster 2020-06-27T06:01:18.989038+0000 mgr.x (mgr.34109) 2464 : cluster [DBG] pgmap v2538: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:20 smithi031 bash[18426]: cluster 2020-06-27T06:01:18.989038+0000 mgr.x (mgr.34109) 2464 : cluster [DBG] pgmap v2538: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:20.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:20 smithi031 bash[22603]: cluster 2020-06-27T06:01:18.989038+0000 mgr.x (mgr.34109) 2464 : cluster [DBG] pgmap v2538: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:22 smithi051 bash[18409]: cluster 2020-06-27T06:01:20.990751+0000 mgr.x (mgr.34109) 2465 : cluster [DBG] pgmap v2539: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:22.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:22 smithi031 bash[22603]: cluster 2020-06-27T06:01:20.990751+0000 mgr.x (mgr.34109) 2465 : cluster [DBG] pgmap v2539: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:22.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:22 smithi031 bash[18426]: cluster 2020-06-27T06:01:20.990751+0000 mgr.x (mgr.34109) 2465 : cluster [DBG] pgmap v2539: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:24 smithi051 bash[18409]: cluster 2020-06-27T06:01:22.992480+0000 mgr.x (mgr.34109) 2466 : cluster [DBG] pgmap v2540: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:24.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:24 smithi031 bash[18426]: cluster 2020-06-27T06:01:22.992480+0000 mgr.x (mgr.34109) 2466 : cluster [DBG] pgmap v2540: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:24 smithi031 bash[22603]: cluster 2020-06-27T06:01:22.992480+0000 mgr.x (mgr.34109) 2466 : cluster [DBG] pgmap v2540: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:26.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:26 smithi051 bash[18409]: cluster 2020-06-27T06:01:24.994202+0000 mgr.x (mgr.34109) 2467 : cluster [DBG] pgmap v2541: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:26 smithi031 bash[18426]: cluster 2020-06-27T06:01:24.994202+0000 mgr.x (mgr.34109) 2467 : cluster [DBG] pgmap v2541: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:26.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:26 smithi031 bash[22603]: cluster 2020-06-27T06:01:24.994202+0000 mgr.x (mgr.34109) 2467 : cluster [DBG] pgmap v2541: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:28.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:28 smithi051 bash[18409]: cluster 2020-06-27T06:01:26.995765+0000 mgr.x (mgr.34109) 2468 : cluster [DBG] pgmap v2542: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:28.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:28 smithi031 bash[18426]: cluster 2020-06-27T06:01:26.995765+0000 mgr.x (mgr.34109) 2468 : cluster [DBG] pgmap v2542: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:28.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:28 smithi031 bash[22603]: cluster 2020-06-27T06:01:26.995765+0000 mgr.x (mgr.34109) 2468 : cluster [DBG] pgmap v2542: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:30.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:30 smithi051 bash[18409]: cluster 2020-06-27T06:01:28.997465+0000 mgr.x (mgr.34109) 2469 : cluster [DBG] pgmap v2543: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:30.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:30 smithi031 bash[18426]: cluster 2020-06-27T06:01:28.997465+0000 mgr.x (mgr.34109) 2469 : cluster [DBG] pgmap v2543: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:30.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:30 smithi031 bash[22603]: cluster 2020-06-27T06:01:28.997465+0000 mgr.x (mgr.34109) 2469 : cluster [DBG] pgmap v2543: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:32.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:32 smithi051 bash[18409]: cluster 2020-06-27T06:01:30.999004+0000 mgr.x (mgr.34109) 2470 : cluster [DBG] pgmap v2544: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:32.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:32 smithi031 bash[22603]: cluster 2020-06-27T06:01:30.999004+0000 mgr.x (mgr.34109) 2470 : cluster [DBG] pgmap v2544: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:32.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:32 smithi031 bash[18426]: cluster 2020-06-27T06:01:30.999004+0000 mgr.x (mgr.34109) 2470 : cluster [DBG] pgmap v2544: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:34.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:34 smithi051 bash[18409]: cluster 2020-06-27T06:01:33.000574+0000 mgr.x (mgr.34109) 2471 : cluster [DBG] pgmap v2545: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:34 smithi031 bash[18426]: cluster 2020-06-27T06:01:33.000574+0000 mgr.x (mgr.34109) 2471 : cluster [DBG] pgmap v2545: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:34 smithi031 bash[22603]: cluster 2020-06-27T06:01:33.000574+0000 mgr.x (mgr.34109) 2471 : cluster [DBG] pgmap v2545: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:36 smithi051 bash[18409]: cluster 2020-06-27T06:01:35.002178+0000 mgr.x (mgr.34109) 2472 : cluster [DBG] pgmap v2546: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:36 smithi031 bash[18426]: cluster 2020-06-27T06:01:35.002178+0000 mgr.x (mgr.34109) 2472 : cluster [DBG] pgmap v2546: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:36.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:36 smithi031 bash[22603]: cluster 2020-06-27T06:01:35.002178+0000 mgr.x (mgr.34109) 2472 : cluster [DBG] pgmap v2546: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:38.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:38 smithi051 bash[18409]: cluster 2020-06-27T06:01:37.003713+0000 mgr.x (mgr.34109) 2473 : cluster [DBG] pgmap v2547: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:38 smithi031 bash[18426]: cluster 2020-06-27T06:01:37.003713+0000 mgr.x (mgr.34109) 2473 : cluster [DBG] pgmap v2547: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:38 smithi031 bash[22603]: cluster 2020-06-27T06:01:37.003713+0000 mgr.x (mgr.34109) 2473 : cluster [DBG] pgmap v2547: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:40.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:40 smithi051 bash[18409]: cluster 2020-06-27T06:01:39.005392+0000 mgr.x (mgr.34109) 2474 : cluster [DBG] pgmap v2548: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:40 smithi031 bash[18426]: cluster 2020-06-27T06:01:39.005392+0000 mgr.x (mgr.34109) 2474 : cluster [DBG] pgmap v2548: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:40.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:40 smithi031 bash[22603]: cluster 2020-06-27T06:01:39.005392+0000 mgr.x (mgr.34109) 2474 : cluster [DBG] pgmap v2548: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:42.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:42 smithi051 bash[18409]: cluster 2020-06-27T06:01:41.007034+0000 mgr.x (mgr.34109) 2475 : cluster [DBG] pgmap v2549: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:42.972 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:42 smithi031 bash[22603]: cluster 2020-06-27T06:01:41.007034+0000 mgr.x (mgr.34109) 2475 : cluster [DBG] pgmap v2549: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:42.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:42 smithi031 bash[18426]: cluster 2020-06-27T06:01:41.007034+0000 mgr.x (mgr.34109) 2475 : cluster [DBG] pgmap v2549: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:44.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:44 smithi051 bash[18409]: cluster 2020-06-27T06:01:43.008723+0000 mgr.x (mgr.34109) 2476 : cluster [DBG] pgmap v2550: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:44 smithi031 bash[22603]: cluster 2020-06-27T06:01:43.008723+0000 mgr.x (mgr.34109) 2476 : cluster [DBG] pgmap v2550: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:44 smithi031 bash[18426]: cluster 2020-06-27T06:01:43.008723+0000 mgr.x (mgr.34109) 2476 : cluster [DBG] pgmap v2550: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:46.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:46 smithi051 bash[18409]: cluster 2020-06-27T06:01:45.010364+0000 mgr.x (mgr.34109) 2477 : cluster [DBG] pgmap v2551: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:46 smithi031 bash[18426]: cluster 2020-06-27T06:01:45.010364+0000 mgr.x (mgr.34109) 2477 : cluster [DBG] pgmap v2551: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:46.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:46 smithi031 bash[22603]: cluster 2020-06-27T06:01:45.010364+0000 mgr.x (mgr.34109) 2477 : cluster [DBG] pgmap v2551: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:48.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:48 smithi051 bash[18409]: cluster 2020-06-27T06:01:47.011972+0000 mgr.x (mgr.34109) 2478 : cluster [DBG] pgmap v2552: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:48.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:48 smithi031 bash[22603]: cluster 2020-06-27T06:01:47.011972+0000 mgr.x (mgr.34109) 2478 : cluster [DBG] pgmap v2552: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:48.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:48 smithi031 bash[18426]: cluster 2020-06-27T06:01:47.011972+0000 mgr.x (mgr.34109) 2478 : cluster [DBG] pgmap v2552: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:50.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:50 smithi051 bash[18409]: cluster 2020-06-27T06:01:49.013608+0000 mgr.x (mgr.34109) 2479 : cluster [DBG] pgmap v2553: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:50.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:50 smithi031 bash[22603]: cluster 2020-06-27T06:01:49.013608+0000 mgr.x (mgr.34109) 2479 : cluster [DBG] pgmap v2553: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:50.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:50 smithi031 bash[18426]: cluster 2020-06-27T06:01:49.013608+0000 mgr.x (mgr.34109) 2479 : cluster [DBG] pgmap v2553: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:52 smithi051 bash[18409]: cluster 2020-06-27T06:01:51.015320+0000 mgr.x (mgr.34109) 2480 : cluster [DBG] pgmap v2554: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:52 smithi031 bash[18426]: cluster 2020-06-27T06:01:51.015320+0000 mgr.x (mgr.34109) 2480 : cluster [DBG] pgmap v2554: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:52 smithi031 bash[22603]: cluster 2020-06-27T06:01:51.015320+0000 mgr.x (mgr.34109) 2480 : cluster [DBG] pgmap v2554: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:54.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:54 smithi051 bash[18409]: cluster 2020-06-27T06:01:53.017042+0000 mgr.x (mgr.34109) 2481 : cluster [DBG] pgmap v2555: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:54.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:54 smithi031 bash[18426]: cluster 2020-06-27T06:01:53.017042+0000 mgr.x (mgr.34109) 2481 : cluster [DBG] pgmap v2555: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:54 smithi031 bash[22603]: cluster 2020-06-27T06:01:53.017042+0000 mgr.x (mgr.34109) 2481 : cluster [DBG] pgmap v2555: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:56.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:56 smithi051 bash[18409]: cluster 2020-06-27T06:01:55.018676+0000 mgr.x (mgr.34109) 2482 : cluster [DBG] pgmap v2556: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:56.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:56 smithi031 bash[18426]: cluster 2020-06-27T06:01:55.018676+0000 mgr.x (mgr.34109) 2482 : cluster [DBG] pgmap v2556: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:56.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:56 smithi031 bash[22603]: cluster 2020-06-27T06:01:55.018676+0000 mgr.x (mgr.34109) 2482 : cluster [DBG] pgmap v2556: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:58.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:01:58 smithi051 bash[18409]: cluster 2020-06-27T06:01:57.020376+0000 mgr.x (mgr.34109) 2483 : cluster [DBG] pgmap v2557: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:58.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:01:58 smithi031 bash[18426]: cluster 2020-06-27T06:01:57.020376+0000 mgr.x (mgr.34109) 2483 : cluster [DBG] pgmap v2557: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:01:58.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:01:58 smithi031 bash[22603]: cluster 2020-06-27T06:01:57.020376+0000 mgr.x (mgr.34109) 2483 : cluster [DBG] pgmap v2557: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:00.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:00 smithi051 bash[18409]: cluster 2020-06-27T06:01:59.021935+0000 mgr.x (mgr.34109) 2484 : cluster [DBG] pgmap v2558: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:00.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:00 smithi031 bash[22603]: cluster 2020-06-27T06:01:59.021935+0000 mgr.x (mgr.34109) 2484 : cluster [DBG] pgmap v2558: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:00.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:00 smithi031 bash[18426]: cluster 2020-06-27T06:01:59.021935+0000 mgr.x (mgr.34109) 2484 : cluster [DBG] pgmap v2558: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:02.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:02 smithi051 bash[18409]: cluster 2020-06-27T06:02:01.023623+0000 mgr.x (mgr.34109) 2485 : cluster [DBG] pgmap v2559: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:02.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:02 smithi031 bash[18426]: cluster 2020-06-27T06:02:01.023623+0000 mgr.x (mgr.34109) 2485 : cluster [DBG] pgmap v2559: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:02.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:02 smithi031 bash[22603]: cluster 2020-06-27T06:02:01.023623+0000 mgr.x (mgr.34109) 2485 : cluster [DBG] pgmap v2559: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:04.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:04 smithi051 bash[18409]: cluster 2020-06-27T06:02:03.025231+0000 mgr.x (mgr.34109) 2486 : cluster [DBG] pgmap v2560: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:04.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:04 smithi031 bash[18426]: cluster 2020-06-27T06:02:03.025231+0000 mgr.x (mgr.34109) 2486 : cluster [DBG] pgmap v2560: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:04.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:04 smithi031 bash[22603]: cluster 2020-06-27T06:02:03.025231+0000 mgr.x (mgr.34109) 2486 : cluster [DBG] pgmap v2560: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:06.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:06 smithi051 bash[18409]: cluster 2020-06-27T06:02:05.027019+0000 mgr.x (mgr.34109) 2487 : cluster [DBG] pgmap v2561: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:06.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:06 smithi031 bash[22603]: cluster 2020-06-27T06:02:05.027019+0000 mgr.x (mgr.34109) 2487 : cluster [DBG] pgmap v2561: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:06.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:06 smithi031 bash[18426]: cluster 2020-06-27T06:02:05.027019+0000 mgr.x (mgr.34109) 2487 : cluster [DBG] pgmap v2561: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:08.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:08 smithi051 bash[18409]: cluster 2020-06-27T06:02:07.028636+0000 mgr.x (mgr.34109) 2488 : cluster [DBG] pgmap v2562: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:08.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:08 smithi031 bash[22603]: cluster 2020-06-27T06:02:07.028636+0000 mgr.x (mgr.34109) 2488 : cluster [DBG] pgmap v2562: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:08.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:08 smithi031 bash[18426]: cluster 2020-06-27T06:02:07.028636+0000 mgr.x (mgr.34109) 2488 : cluster [DBG] pgmap v2562: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:10.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:10 smithi051 bash[18409]: cluster 2020-06-27T06:02:09.030205+0000 mgr.x (mgr.34109) 2489 : cluster [DBG] pgmap v2563: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:10.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:10 smithi031 bash[22603]: cluster 2020-06-27T06:02:09.030205+0000 mgr.x (mgr.34109) 2489 : cluster [DBG] pgmap v2563: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:10.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:10 smithi031 bash[18426]: cluster 2020-06-27T06:02:09.030205+0000 mgr.x (mgr.34109) 2489 : cluster [DBG] pgmap v2563: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:12.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:12 smithi051 bash[18409]: cluster 2020-06-27T06:02:11.031843+0000 mgr.x (mgr.34109) 2490 : cluster [DBG] pgmap v2564: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:12 smithi031 bash[18426]: cluster 2020-06-27T06:02:11.031843+0000 mgr.x (mgr.34109) 2490 : cluster [DBG] pgmap v2564: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:12.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:12 smithi031 bash[22603]: cluster 2020-06-27T06:02:11.031843+0000 mgr.x (mgr.34109) 2490 : cluster [DBG] pgmap v2564: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:14 smithi051 bash[18409]: cluster 2020-06-27T06:02:13.033497+0000 mgr.x (mgr.34109) 2491 : cluster [DBG] pgmap v2565: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:14 smithi031 bash[22603]: cluster 2020-06-27T06:02:13.033497+0000 mgr.x (mgr.34109) 2491 : cluster [DBG] pgmap v2565: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:14 smithi031 bash[18426]: cluster 2020-06-27T06:02:13.033497+0000 mgr.x (mgr.34109) 2491 : cluster [DBG] pgmap v2565: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:16.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:16 smithi051 bash[18409]: cluster 2020-06-27T06:02:15.035256+0000 mgr.x (mgr.34109) 2492 : cluster [DBG] pgmap v2566: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:16 smithi031 bash[18426]: cluster 2020-06-27T06:02:15.035256+0000 mgr.x (mgr.34109) 2492 : cluster [DBG] pgmap v2566: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:16 smithi031 bash[22603]: cluster 2020-06-27T06:02:15.035256+0000 mgr.x (mgr.34109) 2492 : cluster [DBG] pgmap v2566: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:18.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:18 smithi051 bash[18409]: cluster 2020-06-27T06:02:17.036927+0000 mgr.x (mgr.34109) 2493 : cluster [DBG] pgmap v2567: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:18 smithi031 bash[18426]: cluster 2020-06-27T06:02:17.036927+0000 mgr.x (mgr.34109) 2493 : cluster [DBG] pgmap v2567: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:18.974 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:18 smithi031 bash[22603]: cluster 2020-06-27T06:02:17.036927+0000 mgr.x (mgr.34109) 2493 : cluster [DBG] pgmap v2567: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:20.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:20 smithi051 bash[18409]: cluster 2020-06-27T06:02:19.038628+0000 mgr.x (mgr.34109) 2494 : cluster [DBG] pgmap v2568: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:20 smithi031 bash[18426]: cluster 2020-06-27T06:02:19.038628+0000 mgr.x (mgr.34109) 2494 : cluster [DBG] pgmap v2568: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:20.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:20 smithi031 bash[22603]: cluster 2020-06-27T06:02:19.038628+0000 mgr.x (mgr.34109) 2494 : cluster [DBG] pgmap v2568: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:22.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:22 smithi051 bash[18409]: cluster 2020-06-27T06:02:21.040273+0000 mgr.x (mgr.34109) 2495 : cluster [DBG] pgmap v2569: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:22.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:22 smithi031 bash[18426]: cluster 2020-06-27T06:02:21.040273+0000 mgr.x (mgr.34109) 2495 : cluster [DBG] pgmap v2569: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:22.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:22 smithi031 bash[22603]: cluster 2020-06-27T06:02:21.040273+0000 mgr.x (mgr.34109) 2495 : cluster [DBG] pgmap v2569: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:23.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:23 smithi051 bash[18409]: cluster 2020-06-27T06:02:23.041958+0000 mgr.x (mgr.34109) 2496 : cluster [DBG] pgmap v2570: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:23.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:23 smithi031 bash[18426]: cluster 2020-06-27T06:02:23.041958+0000 mgr.x (mgr.34109) 2496 : cluster [DBG] pgmap v2570: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:23.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:23 smithi031 bash[22603]: cluster 2020-06-27T06:02:23.041958+0000 mgr.x (mgr.34109) 2496 : cluster [DBG] pgmap v2570: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:26.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:26 smithi051 bash[18409]: cluster 2020-06-27T06:02:25.043721+0000 mgr.x (mgr.34109) 2497 : cluster [DBG] pgmap v2571: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:26 smithi031 bash[18426]: cluster 2020-06-27T06:02:25.043721+0000 mgr.x (mgr.34109) 2497 : cluster [DBG] pgmap v2571: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:26.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:26 smithi031 bash[22603]: cluster 2020-06-27T06:02:25.043721+0000 mgr.x (mgr.34109) 2497 : cluster [DBG] pgmap v2571: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:28.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:28 smithi051 bash[18409]: cluster 2020-06-27T06:02:27.045387+0000 mgr.x (mgr.34109) 2498 : cluster [DBG] pgmap v2572: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:28.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:28 smithi031 bash[18426]: cluster 2020-06-27T06:02:27.045387+0000 mgr.x (mgr.34109) 2498 : cluster [DBG] pgmap v2572: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:28.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:28 smithi031 bash[22603]: cluster 2020-06-27T06:02:27.045387+0000 mgr.x (mgr.34109) 2498 : cluster [DBG] pgmap v2572: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:30.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:30 smithi051 bash[18409]: cluster 2020-06-27T06:02:29.046997+0000 mgr.x (mgr.34109) 2499 : cluster [DBG] pgmap v2573: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:30.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:30 smithi031 bash[18426]: cluster 2020-06-27T06:02:29.046997+0000 mgr.x (mgr.34109) 2499 : cluster [DBG] pgmap v2573: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:30.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:30 smithi031 bash[22603]: cluster 2020-06-27T06:02:29.046997+0000 mgr.x (mgr.34109) 2499 : cluster [DBG] pgmap v2573: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:32.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:32 smithi051 bash[18409]: cluster 2020-06-27T06:02:31.048611+0000 mgr.x (mgr.34109) 2500 : cluster [DBG] pgmap v2574: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:32.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:32 smithi031 bash[18426]: cluster 2020-06-27T06:02:31.048611+0000 mgr.x (mgr.34109) 2500 : cluster [DBG] pgmap v2574: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:32.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:32 smithi031 bash[22603]: cluster 2020-06-27T06:02:31.048611+0000 mgr.x (mgr.34109) 2500 : cluster [DBG] pgmap v2574: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:34.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:34 smithi051 bash[18409]: cluster 2020-06-27T06:02:33.050279+0000 mgr.x (mgr.34109) 2501 : cluster [DBG] pgmap v2575: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:34 smithi031 bash[18426]: cluster 2020-06-27T06:02:33.050279+0000 mgr.x (mgr.34109) 2501 : cluster [DBG] pgmap v2575: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:34 smithi031 bash[22603]: cluster 2020-06-27T06:02:33.050279+0000 mgr.x (mgr.34109) 2501 : cluster [DBG] pgmap v2575: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:36 smithi051 bash[18409]: cluster 2020-06-27T06:02:35.051861+0000 mgr.x (mgr.34109) 2502 : cluster [DBG] pgmap v2576: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:36 smithi031 bash[18426]: cluster 2020-06-27T06:02:35.051861+0000 mgr.x (mgr.34109) 2502 : cluster [DBG] pgmap v2576: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:36.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:36 smithi031 bash[22603]: cluster 2020-06-27T06:02:35.051861+0000 mgr.x (mgr.34109) 2502 : cluster [DBG] pgmap v2576: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:38.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:38 smithi051 bash[18409]: cluster 2020-06-27T06:02:37.053539+0000 mgr.x (mgr.34109) 2503 : cluster [DBG] pgmap v2577: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:38 smithi031 bash[18426]: cluster 2020-06-27T06:02:37.053539+0000 mgr.x (mgr.34109) 2503 : cluster [DBG] pgmap v2577: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:38 smithi031 bash[22603]: cluster 2020-06-27T06:02:37.053539+0000 mgr.x (mgr.34109) 2503 : cluster [DBG] pgmap v2577: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:40.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:40 smithi051 bash[18409]: cluster 2020-06-27T06:02:39.055136+0000 mgr.x (mgr.34109) 2504 : cluster [DBG] pgmap v2578: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:40 smithi031 bash[18426]: cluster 2020-06-27T06:02:39.055136+0000 mgr.x (mgr.34109) 2504 : cluster [DBG] pgmap v2578: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:40.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:40 smithi031 bash[22603]: cluster 2020-06-27T06:02:39.055136+0000 mgr.x (mgr.34109) 2504 : cluster [DBG] pgmap v2578: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:42.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:42 smithi051 bash[18409]: cluster 2020-06-27T06:02:41.056923+0000 mgr.x (mgr.34109) 2505 : cluster [DBG] pgmap v2579: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:42.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:42 smithi031 bash[18426]: cluster 2020-06-27T06:02:41.056923+0000 mgr.x (mgr.34109) 2505 : cluster [DBG] pgmap v2579: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:42.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:42 smithi031 bash[22603]: cluster 2020-06-27T06:02:41.056923+0000 mgr.x (mgr.34109) 2505 : cluster [DBG] pgmap v2579: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:44.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:44 smithi051 bash[18409]: cluster 2020-06-27T06:02:43.058654+0000 mgr.x (mgr.34109) 2506 : cluster [DBG] pgmap v2580: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:44 smithi031 bash[18426]: cluster 2020-06-27T06:02:43.058654+0000 mgr.x (mgr.34109) 2506 : cluster [DBG] pgmap v2580: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:44 smithi031 bash[22603]: cluster 2020-06-27T06:02:43.058654+0000 mgr.x (mgr.34109) 2506 : cluster [DBG] pgmap v2580: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:46.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:46 smithi051 bash[18409]: cluster 2020-06-27T06:02:45.060258+0000 mgr.x (mgr.34109) 2507 : cluster [DBG] pgmap v2581: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:46 smithi031 bash[18426]: cluster 2020-06-27T06:02:45.060258+0000 mgr.x (mgr.34109) 2507 : cluster [DBG] pgmap v2581: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:46.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:46 smithi031 bash[22603]: cluster 2020-06-27T06:02:45.060258+0000 mgr.x (mgr.34109) 2507 : cluster [DBG] pgmap v2581: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:48.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:48 smithi051 bash[18409]: cluster 2020-06-27T06:02:47.061943+0000 mgr.x (mgr.34109) 2508 : cluster [DBG] pgmap v2582: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:48.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:48 smithi031 bash[18426]: cluster 2020-06-27T06:02:47.061943+0000 mgr.x (mgr.34109) 2508 : cluster [DBG] pgmap v2582: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:48.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:48 smithi031 bash[22603]: cluster 2020-06-27T06:02:47.061943+0000 mgr.x (mgr.34109) 2508 : cluster [DBG] pgmap v2582: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:50.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:50 smithi051 bash[18409]: cluster 2020-06-27T06:02:49.063581+0000 mgr.x (mgr.34109) 2509 : cluster [DBG] pgmap v2583: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:50.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:50 smithi031 bash[18426]: cluster 2020-06-27T06:02:49.063581+0000 mgr.x (mgr.34109) 2509 : cluster [DBG] pgmap v2583: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:50.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:50 smithi031 bash[22603]: cluster 2020-06-27T06:02:49.063581+0000 mgr.x (mgr.34109) 2509 : cluster [DBG] pgmap v2583: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:52 smithi051 bash[18409]: cluster 2020-06-27T06:02:51.065260+0000 mgr.x (mgr.34109) 2510 : cluster [DBG] pgmap v2584: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:52.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:52 smithi031 bash[18426]: cluster 2020-06-27T06:02:51.065260+0000 mgr.x (mgr.34109) 2510 : cluster [DBG] pgmap v2584: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:52 smithi031 bash[22603]: cluster 2020-06-27T06:02:51.065260+0000 mgr.x (mgr.34109) 2510 : cluster [DBG] pgmap v2584: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:54.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:54 smithi051 bash[18409]: cluster 2020-06-27T06:02:53.067015+0000 mgr.x (mgr.34109) 2511 : cluster [DBG] pgmap v2585: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:54.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:54 smithi031 bash[18426]: cluster 2020-06-27T06:02:53.067015+0000 mgr.x (mgr.34109) 2511 : cluster [DBG] pgmap v2585: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:54 smithi031 bash[22603]: cluster 2020-06-27T06:02:53.067015+0000 mgr.x (mgr.34109) 2511 : cluster [DBG] pgmap v2585: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:56.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:56 smithi051 bash[18409]: cluster 2020-06-27T06:02:55.068673+0000 mgr.x (mgr.34109) 2512 : cluster [DBG] pgmap v2586: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:56.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:56 smithi031 bash[18426]: cluster 2020-06-27T06:02:55.068673+0000 mgr.x (mgr.34109) 2512 : cluster [DBG] pgmap v2586: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:56.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:56 smithi031 bash[22603]: cluster 2020-06-27T06:02:55.068673+0000 mgr.x (mgr.34109) 2512 : cluster [DBG] pgmap v2586: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:58.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:02:58 smithi051 bash[18409]: cluster 2020-06-27T06:02:57.070517+0000 mgr.x (mgr.34109) 2513 : cluster [DBG] pgmap v2587: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:58.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:02:58 smithi031 bash[18426]: cluster 2020-06-27T06:02:57.070517+0000 mgr.x (mgr.34109) 2513 : cluster [DBG] pgmap v2587: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:02:58.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:02:58 smithi031 bash[22603]: cluster 2020-06-27T06:02:57.070517+0000 mgr.x (mgr.34109) 2513 : cluster [DBG] pgmap v2587: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:00.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:00 smithi051 bash[18409]: cluster 2020-06-27T06:02:59.072188+0000 mgr.x (mgr.34109) 2514 : cluster [DBG] pgmap v2588: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:00.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:00 smithi031 bash[18426]: cluster 2020-06-27T06:02:59.072188+0000 mgr.x (mgr.34109) 2514 : cluster [DBG] pgmap v2588: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:00.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:00 smithi031 bash[22603]: cluster 2020-06-27T06:02:59.072188+0000 mgr.x (mgr.34109) 2514 : cluster [DBG] pgmap v2588: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:02.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:02 smithi051 bash[18409]: cluster 2020-06-27T06:03:01.073861+0000 mgr.x (mgr.34109) 2515 : cluster [DBG] pgmap v2589: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:02.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:02 smithi031 bash[18426]: cluster 2020-06-27T06:03:01.073861+0000 mgr.x (mgr.34109) 2515 : cluster [DBG] pgmap v2589: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:02.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:02 smithi031 bash[22603]: cluster 2020-06-27T06:03:01.073861+0000 mgr.x (mgr.34109) 2515 : cluster [DBG] pgmap v2589: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:04.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:04 smithi051 bash[18409]: cluster 2020-06-27T06:03:03.075543+0000 mgr.x (mgr.34109) 2516 : cluster [DBG] pgmap v2590: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:04.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:04 smithi031 bash[18426]: cluster 2020-06-27T06:03:03.075543+0000 mgr.x (mgr.34109) 2516 : cluster [DBG] pgmap v2590: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:04.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:04 smithi031 bash[22603]: cluster 2020-06-27T06:03:03.075543+0000 mgr.x (mgr.34109) 2516 : cluster [DBG] pgmap v2590: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:06.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:06 smithi051 bash[18409]: cluster 2020-06-27T06:03:05.077200+0000 mgr.x (mgr.34109) 2517 : cluster [DBG] pgmap v2591: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:06.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:06 smithi031 bash[18426]: cluster 2020-06-27T06:03:05.077200+0000 mgr.x (mgr.34109) 2517 : cluster [DBG] pgmap v2591: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:06.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:06 smithi031 bash[22603]: cluster 2020-06-27T06:03:05.077200+0000 mgr.x (mgr.34109) 2517 : cluster [DBG] pgmap v2591: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:08.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:08 smithi051 bash[18409]: cluster 2020-06-27T06:03:07.078894+0000 mgr.x (mgr.34109) 2518 : cluster [DBG] pgmap v2592: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:08.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:08 smithi031 bash[18426]: cluster 2020-06-27T06:03:07.078894+0000 mgr.x (mgr.34109) 2518 : cluster [DBG] pgmap v2592: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:08.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:08 smithi031 bash[22603]: cluster 2020-06-27T06:03:07.078894+0000 mgr.x (mgr.34109) 2518 : cluster [DBG] pgmap v2592: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:10.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:10 smithi051 bash[18409]: cluster 2020-06-27T06:03:09.080576+0000 mgr.x (mgr.34109) 2519 : cluster [DBG] pgmap v2593: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:10.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:10 smithi031 bash[18426]: cluster 2020-06-27T06:03:09.080576+0000 mgr.x (mgr.34109) 2519 : cluster [DBG] pgmap v2593: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:10.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:10 smithi031 bash[22603]: cluster 2020-06-27T06:03:09.080576+0000 mgr.x (mgr.34109) 2519 : cluster [DBG] pgmap v2593: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:12.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:12 smithi051 bash[18409]: cluster 2020-06-27T06:03:11.082295+0000 mgr.x (mgr.34109) 2520 : cluster [DBG] pgmap v2594: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:12 smithi031 bash[18426]: cluster 2020-06-27T06:03:11.082295+0000 mgr.x (mgr.34109) 2520 : cluster [DBG] pgmap v2594: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:12.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:12 smithi031 bash[22603]: cluster 2020-06-27T06:03:11.082295+0000 mgr.x (mgr.34109) 2520 : cluster [DBG] pgmap v2594: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:14.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:14 smithi051 bash[18409]: cluster 2020-06-27T06:03:13.083971+0000 mgr.x (mgr.34109) 2521 : cluster [DBG] pgmap v2595: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:14 smithi031 bash[18426]: cluster 2020-06-27T06:03:13.083971+0000 mgr.x (mgr.34109) 2521 : cluster [DBG] pgmap v2595: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:14 smithi031 bash[22603]: cluster 2020-06-27T06:03:13.083971+0000 mgr.x (mgr.34109) 2521 : cluster [DBG] pgmap v2595: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:16.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:16 smithi051 bash[18409]: cluster 2020-06-27T06:03:15.085609+0000 mgr.x (mgr.34109) 2522 : cluster [DBG] pgmap v2596: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:16 smithi031 bash[18426]: cluster 2020-06-27T06:03:15.085609+0000 mgr.x (mgr.34109) 2522 : cluster [DBG] pgmap v2596: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:16 smithi031 bash[22603]: cluster 2020-06-27T06:03:15.085609+0000 mgr.x (mgr.34109) 2522 : cluster [DBG] pgmap v2596: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:18.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:18 smithi051 bash[18409]: cluster 2020-06-27T06:03:17.087199+0000 mgr.x (mgr.34109) 2523 : cluster [DBG] pgmap v2597: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:18 smithi031 bash[18426]: cluster 2020-06-27T06:03:17.087199+0000 mgr.x (mgr.34109) 2523 : cluster [DBG] pgmap v2597: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:18 smithi031 bash[22603]: cluster 2020-06-27T06:03:17.087199+0000 mgr.x (mgr.34109) 2523 : cluster [DBG] pgmap v2597: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:20.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:20 smithi051 bash[18409]: cluster 2020-06-27T06:03:19.088779+0000 mgr.x (mgr.34109) 2524 : cluster [DBG] pgmap v2598: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:20.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:20 smithi031 bash[18426]: cluster 2020-06-27T06:03:19.088779+0000 mgr.x (mgr.34109) 2524 : cluster [DBG] pgmap v2598: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:20.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:20 smithi031 bash[22603]: cluster 2020-06-27T06:03:19.088779+0000 mgr.x (mgr.34109) 2524 : cluster [DBG] pgmap v2598: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:22.970 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:22 smithi051 bash[18409]: cluster 2020-06-27T06:03:21.090455+0000 mgr.x (mgr.34109) 2525 : cluster [DBG] pgmap v2599: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:22.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:22 smithi031 bash[18426]: cluster 2020-06-27T06:03:21.090455+0000 mgr.x (mgr.34109) 2525 : cluster [DBG] pgmap v2599: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:22.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:22 smithi031 bash[22603]: cluster 2020-06-27T06:03:21.090455+0000 mgr.x (mgr.34109) 2525 : cluster [DBG] pgmap v2599: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:24.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:24 smithi051 bash[18409]: cluster 2020-06-27T06:03:23.092164+0000 mgr.x (mgr.34109) 2526 : cluster [DBG] pgmap v2600: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:24 smithi031 bash[22603]: cluster 2020-06-27T06:03:23.092164+0000 mgr.x (mgr.34109) 2526 : cluster [DBG] pgmap v2600: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:24.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:24 smithi031 bash[18426]: cluster 2020-06-27T06:03:23.092164+0000 mgr.x (mgr.34109) 2526 : cluster [DBG] pgmap v2600: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:26.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:26 smithi051 bash[18409]: cluster 2020-06-27T06:03:25.093788+0000 mgr.x (mgr.34109) 2527 : cluster [DBG] pgmap v2601: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:26.972 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:26 smithi031 bash[22603]: cluster 2020-06-27T06:03:25.093788+0000 mgr.x (mgr.34109) 2527 : cluster [DBG] pgmap v2601: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:26 smithi031 bash[18426]: cluster 2020-06-27T06:03:25.093788+0000 mgr.x (mgr.34109) 2527 : cluster [DBG] pgmap v2601: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:27.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:27 smithi051 bash[18409]: cluster 2020-06-27T06:03:27.095548+0000 mgr.x (mgr.34109) 2528 : cluster [DBG] pgmap v2602: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:27.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:27 smithi031 bash[18426]: cluster 2020-06-27T06:03:27.095548+0000 mgr.x (mgr.34109) 2528 : cluster [DBG] pgmap v2602: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:27.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:27 smithi031 bash[22603]: cluster 2020-06-27T06:03:27.095548+0000 mgr.x (mgr.34109) 2528 : cluster [DBG] pgmap v2602: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:30.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:30 smithi051 bash[18409]: cluster 2020-06-27T06:03:29.097238+0000 mgr.x (mgr.34109) 2529 : cluster [DBG] pgmap v2603: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:30.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:30 smithi031 bash[18426]: cluster 2020-06-27T06:03:29.097238+0000 mgr.x (mgr.34109) 2529 : cluster [DBG] pgmap v2603: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:30.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:30 smithi031 bash[22603]: cluster 2020-06-27T06:03:29.097238+0000 mgr.x (mgr.34109) 2529 : cluster [DBG] pgmap v2603: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:32.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:32 smithi051 bash[18409]: cluster 2020-06-27T06:03:31.098861+0000 mgr.x (mgr.34109) 2530 : cluster [DBG] pgmap v2604: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:32.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:32 smithi031 bash[18426]: cluster 2020-06-27T06:03:31.098861+0000 mgr.x (mgr.34109) 2530 : cluster [DBG] pgmap v2604: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:32.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:32 smithi031 bash[22603]: cluster 2020-06-27T06:03:31.098861+0000 mgr.x (mgr.34109) 2530 : cluster [DBG] pgmap v2604: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:34.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:34 smithi051 bash[18409]: cluster 2020-06-27T06:03:33.100531+0000 mgr.x (mgr.34109) 2531 : cluster [DBG] pgmap v2605: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:34 smithi031 bash[18426]: cluster 2020-06-27T06:03:33.100531+0000 mgr.x (mgr.34109) 2531 : cluster [DBG] pgmap v2605: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:34 smithi031 bash[22603]: cluster 2020-06-27T06:03:33.100531+0000 mgr.x (mgr.34109) 2531 : cluster [DBG] pgmap v2605: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:36 smithi051 bash[18409]: cluster 2020-06-27T06:03:35.102109+0000 mgr.x (mgr.34109) 2532 : cluster [DBG] pgmap v2606: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:36.972 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:36 smithi031 bash[22603]: cluster 2020-06-27T06:03:35.102109+0000 mgr.x (mgr.34109) 2532 : cluster [DBG] pgmap v2606: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:36 smithi031 bash[18426]: cluster 2020-06-27T06:03:35.102109+0000 mgr.x (mgr.34109) 2532 : cluster [DBG] pgmap v2606: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:38.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:38 smithi051 bash[18409]: cluster 2020-06-27T06:03:37.103824+0000 mgr.x (mgr.34109) 2533 : cluster [DBG] pgmap v2607: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:38 smithi031 bash[18426]: cluster 2020-06-27T06:03:37.103824+0000 mgr.x (mgr.34109) 2533 : cluster [DBG] pgmap v2607: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:38 smithi031 bash[22603]: cluster 2020-06-27T06:03:37.103824+0000 mgr.x (mgr.34109) 2533 : cluster [DBG] pgmap v2607: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:40.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:40 smithi051 bash[18409]: cluster 2020-06-27T06:03:39.105504+0000 mgr.x (mgr.34109) 2534 : cluster [DBG] pgmap v2608: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:40.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:40 smithi031 bash[22603]: cluster 2020-06-27T06:03:39.105504+0000 mgr.x (mgr.34109) 2534 : cluster [DBG] pgmap v2608: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:40.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:40 smithi031 bash[18426]: cluster 2020-06-27T06:03:39.105504+0000 mgr.x (mgr.34109) 2534 : cluster [DBG] pgmap v2608: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:42.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:42 smithi051 bash[18409]: cluster 2020-06-27T06:03:41.107138+0000 mgr.x (mgr.34109) 2535 : cluster [DBG] pgmap v2609: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:42.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:42 smithi031 bash[18426]: cluster 2020-06-27T06:03:41.107138+0000 mgr.x (mgr.34109) 2535 : cluster [DBG] pgmap v2609: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:42.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:42 smithi031 bash[22603]: cluster 2020-06-27T06:03:41.107138+0000 mgr.x (mgr.34109) 2535 : cluster [DBG] pgmap v2609: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:44.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:44 smithi051 bash[18409]: cluster 2020-06-27T06:03:43.108857+0000 mgr.x (mgr.34109) 2536 : cluster [DBG] pgmap v2610: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:44.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:44 smithi031 bash[18426]: cluster 2020-06-27T06:03:43.108857+0000 mgr.x (mgr.34109) 2536 : cluster [DBG] pgmap v2610: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:44 smithi031 bash[22603]: cluster 2020-06-27T06:03:43.108857+0000 mgr.x (mgr.34109) 2536 : cluster [DBG] pgmap v2610: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:46.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:46 smithi051 bash[18409]: cluster 2020-06-27T06:03:45.110612+0000 mgr.x (mgr.34109) 2537 : cluster [DBG] pgmap v2611: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:46.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:46 smithi031 bash[22603]: cluster 2020-06-27T06:03:45.110612+0000 mgr.x (mgr.34109) 2537 : cluster [DBG] pgmap v2611: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:46 smithi031 bash[18426]: cluster 2020-06-27T06:03:45.110612+0000 mgr.x (mgr.34109) 2537 : cluster [DBG] pgmap v2611: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:48.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:48 smithi051 bash[18409]: cluster 2020-06-27T06:03:47.112216+0000 mgr.x (mgr.34109) 2538 : cluster [DBG] pgmap v2612: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:48.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:48 smithi031 bash[18426]: cluster 2020-06-27T06:03:47.112216+0000 mgr.x (mgr.34109) 2538 : cluster [DBG] pgmap v2612: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:48.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:48 smithi031 bash[22603]: cluster 2020-06-27T06:03:47.112216+0000 mgr.x (mgr.34109) 2538 : cluster [DBG] pgmap v2612: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:50.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:50 smithi051 bash[18409]: cluster 2020-06-27T06:03:49.113935+0000 mgr.x (mgr.34109) 2539 : cluster [DBG] pgmap v2613: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:50.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:50 smithi031 bash[18426]: cluster 2020-06-27T06:03:49.113935+0000 mgr.x (mgr.34109) 2539 : cluster [DBG] pgmap v2613: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:50.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:50 smithi031 bash[22603]: cluster 2020-06-27T06:03:49.113935+0000 mgr.x (mgr.34109) 2539 : cluster [DBG] pgmap v2613: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:52 smithi051 bash[18409]: cluster 2020-06-27T06:03:51.115669+0000 mgr.x (mgr.34109) 2540 : cluster [DBG] pgmap v2614: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:52 smithi031 bash[18426]: cluster 2020-06-27T06:03:51.115669+0000 mgr.x (mgr.34109) 2540 : cluster [DBG] pgmap v2614: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:52 smithi031 bash[22603]: cluster 2020-06-27T06:03:51.115669+0000 mgr.x (mgr.34109) 2540 : cluster [DBG] pgmap v2614: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:54.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:54 smithi051 bash[18409]: cluster 2020-06-27T06:03:53.117337+0000 mgr.x (mgr.34109) 2541 : cluster [DBG] pgmap v2615: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:54.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:54 smithi031 bash[18426]: cluster 2020-06-27T06:03:53.117337+0000 mgr.x (mgr.34109) 2541 : cluster [DBG] pgmap v2615: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:54 smithi031 bash[22603]: cluster 2020-06-27T06:03:53.117337+0000 mgr.x (mgr.34109) 2541 : cluster [DBG] pgmap v2615: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:56.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:56 smithi051 bash[18409]: cluster 2020-06-27T06:03:55.119058+0000 mgr.x (mgr.34109) 2542 : cluster [DBG] pgmap v2616: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:56.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:56 smithi031 bash[18426]: cluster 2020-06-27T06:03:55.119058+0000 mgr.x (mgr.34109) 2542 : cluster [DBG] pgmap v2616: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:56.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:56 smithi031 bash[22603]: cluster 2020-06-27T06:03:55.119058+0000 mgr.x (mgr.34109) 2542 : cluster [DBG] pgmap v2616: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:58.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:03:58 smithi051 bash[18409]: cluster 2020-06-27T06:03:57.120705+0000 mgr.x (mgr.34109) 2543 : cluster [DBG] pgmap v2617: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:58.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:03:58 smithi031 bash[18426]: cluster 2020-06-27T06:03:57.120705+0000 mgr.x (mgr.34109) 2543 : cluster [DBG] pgmap v2617: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:03:58.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:03:58 smithi031 bash[22603]: cluster 2020-06-27T06:03:57.120705+0000 mgr.x (mgr.34109) 2543 : cluster [DBG] pgmap v2617: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:00.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:00 smithi051 bash[18409]: cluster 2020-06-27T06:03:59.122454+0000 mgr.x (mgr.34109) 2544 : cluster [DBG] pgmap v2618: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:00.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:00 smithi031 bash[18426]: cluster 2020-06-27T06:03:59.122454+0000 mgr.x (mgr.34109) 2544 : cluster [DBG] pgmap v2618: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:00.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:00 smithi031 bash[22603]: cluster 2020-06-27T06:03:59.122454+0000 mgr.x (mgr.34109) 2544 : cluster [DBG] pgmap v2618: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:02.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:02 smithi051 bash[18409]: cluster 2020-06-27T06:04:01.124077+0000 mgr.x (mgr.34109) 2545 : cluster [DBG] pgmap v2619: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:02.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:02 smithi031 bash[18426]: cluster 2020-06-27T06:04:01.124077+0000 mgr.x (mgr.34109) 2545 : cluster [DBG] pgmap v2619: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:02.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:02 smithi031 bash[22603]: cluster 2020-06-27T06:04:01.124077+0000 mgr.x (mgr.34109) 2545 : cluster [DBG] pgmap v2619: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:04.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:04 smithi051 bash[18409]: cluster 2020-06-27T06:04:03.125717+0000 mgr.x (mgr.34109) 2546 : cluster [DBG] pgmap v2620: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:04.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:04 smithi031 bash[18426]: cluster 2020-06-27T06:04:03.125717+0000 mgr.x (mgr.34109) 2546 : cluster [DBG] pgmap v2620: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:04.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:04 smithi031 bash[22603]: cluster 2020-06-27T06:04:03.125717+0000 mgr.x (mgr.34109) 2546 : cluster [DBG] pgmap v2620: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:06.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:06 smithi051 bash[18409]: cluster 2020-06-27T06:04:05.127363+0000 mgr.x (mgr.34109) 2547 : cluster [DBG] pgmap v2621: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:06.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:06 smithi031 bash[18426]: cluster 2020-06-27T06:04:05.127363+0000 mgr.x (mgr.34109) 2547 : cluster [DBG] pgmap v2621: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:06.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:06 smithi031 bash[22603]: cluster 2020-06-27T06:04:05.127363+0000 mgr.x (mgr.34109) 2547 : cluster [DBG] pgmap v2621: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:08.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:08 smithi051 bash[18409]: cluster 2020-06-27T06:04:07.128837+0000 mgr.x (mgr.34109) 2548 : cluster [DBG] pgmap v2622: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:08.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:08 smithi031 bash[18426]: cluster 2020-06-27T06:04:07.128837+0000 mgr.x (mgr.34109) 2548 : cluster [DBG] pgmap v2622: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:08.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:08 smithi031 bash[22603]: cluster 2020-06-27T06:04:07.128837+0000 mgr.x (mgr.34109) 2548 : cluster [DBG] pgmap v2622: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:10.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:10 smithi051 bash[18409]: cluster 2020-06-27T06:04:09.130549+0000 mgr.x (mgr.34109) 2549 : cluster [DBG] pgmap v2623: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:10.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:10 smithi031 bash[18426]: cluster 2020-06-27T06:04:09.130549+0000 mgr.x (mgr.34109) 2549 : cluster [DBG] pgmap v2623: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:10.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:10 smithi031 bash[22603]: cluster 2020-06-27T06:04:09.130549+0000 mgr.x (mgr.34109) 2549 : cluster [DBG] pgmap v2623: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:12.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:12 smithi051 bash[18409]: cluster 2020-06-27T06:04:11.132245+0000 mgr.x (mgr.34109) 2550 : cluster [DBG] pgmap v2624: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:12.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:12 smithi031 bash[18426]: cluster 2020-06-27T06:04:11.132245+0000 mgr.x (mgr.34109) 2550 : cluster [DBG] pgmap v2624: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:12.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:12 smithi031 bash[22603]: cluster 2020-06-27T06:04:11.132245+0000 mgr.x (mgr.34109) 2550 : cluster [DBG] pgmap v2624: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:14.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:14 smithi051 bash[18409]: cluster 2020-06-27T06:04:13.133929+0000 mgr.x (mgr.34109) 2551 : cluster [DBG] pgmap v2625: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:14.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:14 smithi031 bash[18426]: cluster 2020-06-27T06:04:13.133929+0000 mgr.x (mgr.34109) 2551 : cluster [DBG] pgmap v2625: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:14 smithi031 bash[22603]: cluster 2020-06-27T06:04:13.133929+0000 mgr.x (mgr.34109) 2551 : cluster [DBG] pgmap v2625: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:16.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:16 smithi051 bash[18409]: cluster 2020-06-27T06:04:15.135576+0000 mgr.x (mgr.34109) 2552 : cluster [DBG] pgmap v2626: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:16 smithi031 bash[22603]: cluster 2020-06-27T06:04:15.135576+0000 mgr.x (mgr.34109) 2552 : cluster [DBG] pgmap v2626: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:16.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:16 smithi031 bash[18426]: cluster 2020-06-27T06:04:15.135576+0000 mgr.x (mgr.34109) 2552 : cluster [DBG] pgmap v2626: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:18.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:18 smithi051 bash[18409]: cluster 2020-06-27T06:04:17.137269+0000 mgr.x (mgr.34109) 2553 : cluster [DBG] pgmap v2627: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:18.972 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:18 smithi031 bash[22603]: cluster 2020-06-27T06:04:17.137269+0000 mgr.x (mgr.34109) 2553 : cluster [DBG] pgmap v2627: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:18.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:18 smithi031 bash[18426]: cluster 2020-06-27T06:04:17.137269+0000 mgr.x (mgr.34109) 2553 : cluster [DBG] pgmap v2627: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:20.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:20 smithi051 bash[18409]: cluster 2020-06-27T06:04:19.138955+0000 mgr.x (mgr.34109) 2554 : cluster [DBG] pgmap v2628: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:20.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:20 smithi031 bash[18426]: cluster 2020-06-27T06:04:19.138955+0000 mgr.x (mgr.34109) 2554 : cluster [DBG] pgmap v2628: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:20.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:20 smithi031 bash[22603]: cluster 2020-06-27T06:04:19.138955+0000 mgr.x (mgr.34109) 2554 : cluster [DBG] pgmap v2628: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:22.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:22 smithi051 bash[18409]: cluster 2020-06-27T06:04:21.140695+0000 mgr.x (mgr.34109) 2555 : cluster [DBG] pgmap v2629: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:22.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:22 smithi031 bash[18426]: cluster 2020-06-27T06:04:21.140695+0000 mgr.x (mgr.34109) 2555 : cluster [DBG] pgmap v2629: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:22.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:22 smithi031 bash[22603]: cluster 2020-06-27T06:04:21.140695+0000 mgr.x (mgr.34109) 2555 : cluster [DBG] pgmap v2629: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:24.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:24 smithi051 bash[18409]: cluster 2020-06-27T06:04:23.142372+0000 mgr.x (mgr.34109) 2556 : cluster [DBG] pgmap v2630: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:24.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:24 smithi031 bash[18426]: cluster 2020-06-27T06:04:23.142372+0000 mgr.x (mgr.34109) 2556 : cluster [DBG] pgmap v2630: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:24.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:24 smithi031 bash[22603]: cluster 2020-06-27T06:04:23.142372+0000 mgr.x (mgr.34109) 2556 : cluster [DBG] pgmap v2630: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:26.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:26 smithi051 bash[18409]: cluster 2020-06-27T06:04:25.144085+0000 mgr.x (mgr.34109) 2557 : cluster [DBG] pgmap v2631: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:26.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:26 smithi031 bash[18426]: cluster 2020-06-27T06:04:25.144085+0000 mgr.x (mgr.34109) 2557 : cluster [DBG] pgmap v2631: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:26.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:26 smithi031 bash[22603]: cluster 2020-06-27T06:04:25.144085+0000 mgr.x (mgr.34109) 2557 : cluster [DBG] pgmap v2631: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:28.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:28 smithi051 bash[18409]: cluster 2020-06-27T06:04:27.145769+0000 mgr.x (mgr.34109) 2558 : cluster [DBG] pgmap v2632: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:28.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:28 smithi031 bash[18426]: cluster 2020-06-27T06:04:27.145769+0000 mgr.x (mgr.34109) 2558 : cluster [DBG] pgmap v2632: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:28.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:28 smithi031 bash[22603]: cluster 2020-06-27T06:04:27.145769+0000 mgr.x (mgr.34109) 2558 : cluster [DBG] pgmap v2632: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:30.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:30 smithi051 bash[18409]: cluster 2020-06-27T06:04:29.147353+0000 mgr.x (mgr.34109) 2559 : cluster [DBG] pgmap v2633: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:30.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:30 smithi031 bash[18426]: cluster 2020-06-27T06:04:29.147353+0000 mgr.x (mgr.34109) 2559 : cluster [DBG] pgmap v2633: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:30.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:30 smithi031 bash[22603]: cluster 2020-06-27T06:04:29.147353+0000 mgr.x (mgr.34109) 2559 : cluster [DBG] pgmap v2633: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:32.217 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:31 smithi051 bash[18409]: cluster 2020-06-27T06:04:31.148976+0000 mgr.x (mgr.34109) 2560 : cluster [DBG] pgmap v2634: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:32.223 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:31 smithi031 bash[18426]: cluster 2020-06-27T06:04:31.148976+0000 mgr.x (mgr.34109) 2560 : cluster [DBG] pgmap v2634: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:32.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:31 smithi031 bash[22603]: cluster 2020-06-27T06:04:31.148976+0000 mgr.x (mgr.34109) 2560 : cluster [DBG] pgmap v2634: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:34.468 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:34 smithi051 bash[18409]: cluster 2020-06-27T06:04:33.150636+0000 mgr.x (mgr.34109) 2561 : cluster [DBG] pgmap v2635: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:34.473 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:34 smithi031 bash[18426]: cluster 2020-06-27T06:04:33.150636+0000 mgr.x (mgr.34109) 2561 : cluster [DBG] pgmap v2635: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:34.473 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:34 smithi031 bash[22603]: cluster 2020-06-27T06:04:33.150636+0000 mgr.x (mgr.34109) 2561 : cluster [DBG] pgmap v2635: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:36.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:36 smithi051 bash[18409]: cluster 2020-06-27T06:04:35.152191+0000 mgr.x (mgr.34109) 2562 : cluster [DBG] pgmap v2636: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:36 smithi031 bash[18426]: cluster 2020-06-27T06:04:35.152191+0000 mgr.x (mgr.34109) 2562 : cluster [DBG] pgmap v2636: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:36.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:36 smithi031 bash[22603]: cluster 2020-06-27T06:04:35.152191+0000 mgr.x (mgr.34109) 2562 : cluster [DBG] pgmap v2636: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:38.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:38 smithi051 bash[18409]: cluster 2020-06-27T06:04:37.153884+0000 mgr.x (mgr.34109) 2563 : cluster [DBG] pgmap v2637: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:38 smithi031 bash[18426]: cluster 2020-06-27T06:04:37.153884+0000 mgr.x (mgr.34109) 2563 : cluster [DBG] pgmap v2637: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:38 smithi031 bash[22603]: cluster 2020-06-27T06:04:37.153884+0000 mgr.x (mgr.34109) 2563 : cluster [DBG] pgmap v2637: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:40.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:40 smithi051 bash[18409]: cluster 2020-06-27T06:04:39.155563+0000 mgr.x (mgr.34109) 2564 : cluster [DBG] pgmap v2638: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:40.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:40 smithi031 bash[18426]: cluster 2020-06-27T06:04:39.155563+0000 mgr.x (mgr.34109) 2564 : cluster [DBG] pgmap v2638: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:40.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:40 smithi031 bash[22603]: cluster 2020-06-27T06:04:39.155563+0000 mgr.x (mgr.34109) 2564 : cluster [DBG] pgmap v2638: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:42.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:42 smithi051 bash[18409]: cluster 2020-06-27T06:04:41.157217+0000 mgr.x (mgr.34109) 2565 : cluster [DBG] pgmap v2639: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:42.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:42 smithi031 bash[18426]: cluster 2020-06-27T06:04:41.157217+0000 mgr.x (mgr.34109) 2565 : cluster [DBG] pgmap v2639: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:42.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:42 smithi031 bash[22603]: cluster 2020-06-27T06:04:41.157217+0000 mgr.x (mgr.34109) 2565 : cluster [DBG] pgmap v2639: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:44.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:44 smithi051 bash[18409]: cluster 2020-06-27T06:04:43.158934+0000 mgr.x (mgr.34109) 2566 : cluster [DBG] pgmap v2640: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:44 smithi031 bash[18426]: cluster 2020-06-27T06:04:43.158934+0000 mgr.x (mgr.34109) 2566 : cluster [DBG] pgmap v2640: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:44 smithi031 bash[22603]: cluster 2020-06-27T06:04:43.158934+0000 mgr.x (mgr.34109) 2566 : cluster [DBG] pgmap v2640: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:46.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:46 smithi051 bash[18409]: cluster 2020-06-27T06:04:45.160558+0000 mgr.x (mgr.34109) 2567 : cluster [DBG] pgmap v2641: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:46 smithi031 bash[18426]: cluster 2020-06-27T06:04:45.160558+0000 mgr.x (mgr.34109) 2567 : cluster [DBG] pgmap v2641: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:46.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:46 smithi031 bash[22603]: cluster 2020-06-27T06:04:45.160558+0000 mgr.x (mgr.34109) 2567 : cluster [DBG] pgmap v2641: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:48.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:48 smithi051 bash[18409]: cluster 2020-06-27T06:04:47.162178+0000 mgr.x (mgr.34109) 2568 : cluster [DBG] pgmap v2642: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:48.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:48 smithi031 bash[18426]: cluster 2020-06-27T06:04:47.162178+0000 mgr.x (mgr.34109) 2568 : cluster [DBG] pgmap v2642: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:48.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:48 smithi031 bash[22603]: cluster 2020-06-27T06:04:47.162178+0000 mgr.x (mgr.34109) 2568 : cluster [DBG] pgmap v2642: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:50.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:50 smithi051 bash[18409]: cluster 2020-06-27T06:04:49.163882+0000 mgr.x (mgr.34109) 2569 : cluster [DBG] pgmap v2643: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:50.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:50 smithi031 bash[18426]: cluster 2020-06-27T06:04:49.163882+0000 mgr.x (mgr.34109) 2569 : cluster [DBG] pgmap v2643: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:50.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:50 smithi031 bash[22603]: cluster 2020-06-27T06:04:49.163882+0000 mgr.x (mgr.34109) 2569 : cluster [DBG] pgmap v2643: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:52.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:52 smithi051 bash[18409]: cluster 2020-06-27T06:04:51.165561+0000 mgr.x (mgr.34109) 2570 : cluster [DBG] pgmap v2644: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:52.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:52 smithi031 bash[18426]: cluster 2020-06-27T06:04:51.165561+0000 mgr.x (mgr.34109) 2570 : cluster [DBG] pgmap v2644: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:52 smithi031 bash[22603]: cluster 2020-06-27T06:04:51.165561+0000 mgr.x (mgr.34109) 2570 : cluster [DBG] pgmap v2644: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:54.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:54 smithi051 bash[18409]: cluster 2020-06-27T06:04:53.167237+0000 mgr.x (mgr.34109) 2571 : cluster [DBG] pgmap v2645: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:54.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:54 smithi031 bash[18426]: cluster 2020-06-27T06:04:53.167237+0000 mgr.x (mgr.34109) 2571 : cluster [DBG] pgmap v2645: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:54 smithi031 bash[22603]: cluster 2020-06-27T06:04:53.167237+0000 mgr.x (mgr.34109) 2571 : cluster [DBG] pgmap v2645: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:56.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:56 smithi051 bash[18409]: cluster 2020-06-27T06:04:55.168827+0000 mgr.x (mgr.34109) 2572 : cluster [DBG] pgmap v2646: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:56.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:56 smithi031 bash[18426]: cluster 2020-06-27T06:04:55.168827+0000 mgr.x (mgr.34109) 2572 : cluster [DBG] pgmap v2646: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:56.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:56 smithi031 bash[22603]: cluster 2020-06-27T06:04:55.168827+0000 mgr.x (mgr.34109) 2572 : cluster [DBG] pgmap v2646: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:58.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:04:58 smithi051 bash[18409]: cluster 2020-06-27T06:04:57.170551+0000 mgr.x (mgr.34109) 2573 : cluster [DBG] pgmap v2647: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:58.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:04:58 smithi031 bash[18426]: cluster 2020-06-27T06:04:57.170551+0000 mgr.x (mgr.34109) 2573 : cluster [DBG] pgmap v2647: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:04:58.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:04:58 smithi031 bash[22603]: cluster 2020-06-27T06:04:57.170551+0000 mgr.x (mgr.34109) 2573 : cluster [DBG] pgmap v2647: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:00.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:00 smithi051 bash[18409]: cluster 2020-06-27T06:04:59.172262+0000 mgr.x (mgr.34109) 2574 : cluster [DBG] pgmap v2648: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:00.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:00 smithi031 bash[18426]: cluster 2020-06-27T06:04:59.172262+0000 mgr.x (mgr.34109) 2574 : cluster [DBG] pgmap v2648: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:00.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:00 smithi031 bash[22603]: cluster 2020-06-27T06:04:59.172262+0000 mgr.x (mgr.34109) 2574 : cluster [DBG] pgmap v2648: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:02.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:02 smithi051 bash[18409]: cluster 2020-06-27T06:05:01.174014+0000 mgr.x (mgr.34109) 2575 : cluster [DBG] pgmap v2649: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:02.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:02 smithi031 bash[18426]: cluster 2020-06-27T06:05:01.174014+0000 mgr.x (mgr.34109) 2575 : cluster [DBG] pgmap v2649: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:02.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:02 smithi031 bash[22603]: cluster 2020-06-27T06:05:01.174014+0000 mgr.x (mgr.34109) 2575 : cluster [DBG] pgmap v2649: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:04.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:04 smithi051 bash[18409]: cluster 2020-06-27T06:05:03.176439+0000 mgr.x (mgr.34109) 2576 : cluster [DBG] pgmap v2650: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:04.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:04 smithi031 bash[18426]: cluster 2020-06-27T06:05:03.176439+0000 mgr.x (mgr.34109) 2576 : cluster [DBG] pgmap v2650: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:04.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:04 smithi031 bash[22603]: cluster 2020-06-27T06:05:03.176439+0000 mgr.x (mgr.34109) 2576 : cluster [DBG] pgmap v2650: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:06.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:06 smithi051 bash[18409]: cluster 2020-06-27T06:05:05.178200+0000 mgr.x (mgr.34109) 2577 : cluster [DBG] pgmap v2651: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:06.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:06 smithi031 bash[18426]: cluster 2020-06-27T06:05:05.178200+0000 mgr.x (mgr.34109) 2577 : cluster [DBG] pgmap v2651: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:06.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:06 smithi031 bash[22603]: cluster 2020-06-27T06:05:05.178200+0000 mgr.x (mgr.34109) 2577 : cluster [DBG] pgmap v2651: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:08.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:08 smithi051 bash[18409]: cluster 2020-06-27T06:05:07.179871+0000 mgr.x (mgr.34109) 2578 : cluster [DBG] pgmap v2652: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:08.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:08 smithi031 bash[18426]: cluster 2020-06-27T06:05:07.179871+0000 mgr.x (mgr.34109) 2578 : cluster [DBG] pgmap v2652: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:08.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:08 smithi031 bash[22603]: cluster 2020-06-27T06:05:07.179871+0000 mgr.x (mgr.34109) 2578 : cluster [DBG] pgmap v2652: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:10.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:10 smithi051 bash[18409]: cluster 2020-06-27T06:05:09.181514+0000 mgr.x (mgr.34109) 2579 : cluster [DBG] pgmap v2653: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:10.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:10 smithi031 bash[18426]: cluster 2020-06-27T06:05:09.181514+0000 mgr.x (mgr.34109) 2579 : cluster [DBG] pgmap v2653: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:10.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:10 smithi031 bash[22603]: cluster 2020-06-27T06:05:09.181514+0000 mgr.x (mgr.34109) 2579 : cluster [DBG] pgmap v2653: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:12.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:12 smithi051 bash[18409]: cluster 2020-06-27T06:05:11.183291+0000 mgr.x (mgr.34109) 2580 : cluster [DBG] pgmap v2654: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:12.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:12 smithi031 bash[18426]: cluster 2020-06-27T06:05:11.183291+0000 mgr.x (mgr.34109) 2580 : cluster [DBG] pgmap v2654: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:12.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:12 smithi031 bash[22603]: cluster 2020-06-27T06:05:11.183291+0000 mgr.x (mgr.34109) 2580 : cluster [DBG] pgmap v2654: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:14.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:14 smithi051 bash[18409]: cluster 2020-06-27T06:05:13.184888+0000 mgr.x (mgr.34109) 2581 : cluster [DBG] pgmap v2655: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:14.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:14 smithi031 bash[18426]: cluster 2020-06-27T06:05:13.184888+0000 mgr.x (mgr.34109) 2581 : cluster [DBG] pgmap v2655: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:14.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:14 smithi031 bash[22603]: cluster 2020-06-27T06:05:13.184888+0000 mgr.x (mgr.34109) 2581 : cluster [DBG] pgmap v2655: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:16.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:16 smithi051 bash[18409]: cluster 2020-06-27T06:05:15.186529+0000 mgr.x (mgr.34109) 2582 : cluster [DBG] pgmap v2656: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:16.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:16 smithi031 bash[18426]: cluster 2020-06-27T06:05:15.186529+0000 mgr.x (mgr.34109) 2582 : cluster [DBG] pgmap v2656: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:16.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:16 smithi031 bash[22603]: cluster 2020-06-27T06:05:15.186529+0000 mgr.x (mgr.34109) 2582 : cluster [DBG] pgmap v2656: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:18.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:18 smithi051 bash[18409]: cluster 2020-06-27T06:05:17.188166+0000 mgr.x (mgr.34109) 2583 : cluster [DBG] pgmap v2657: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:18.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:18 smithi031 bash[18426]: cluster 2020-06-27T06:05:17.188166+0000 mgr.x (mgr.34109) 2583 : cluster [DBG] pgmap v2657: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:18.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:18 smithi031 bash[22603]: cluster 2020-06-27T06:05:17.188166+0000 mgr.x (mgr.34109) 2583 : cluster [DBG] pgmap v2657: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:21.217 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:20 smithi051 bash[18409]: cluster 2020-06-27T06:05:19.189771+0000 mgr.x (mgr.34109) 2584 : cluster [DBG] pgmap v2658: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:21.222 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:20 smithi031 bash[18426]: cluster 2020-06-27T06:05:19.189771+0000 mgr.x (mgr.34109) 2584 : cluster [DBG] pgmap v2658: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:21.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:20 smithi031 bash[22603]: cluster 2020-06-27T06:05:19.189771+0000 mgr.x (mgr.34109) 2584 : cluster [DBG] pgmap v2658: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:22.217 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:21 smithi051 bash[18409]: cluster 2020-06-27T06:05:21.191182+0000 mgr.x (mgr.34109) 2585 : cluster [DBG] pgmap v2659: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:22.222 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:21 smithi031 bash[18426]: cluster 2020-06-27T06:05:21.191182+0000 mgr.x (mgr.34109) 2585 : cluster [DBG] pgmap v2659: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:22.223 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:21 smithi031 bash[22603]: cluster 2020-06-27T06:05:21.191182+0000 mgr.x (mgr.34109) 2585 : cluster [DBG] pgmap v2659: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:24.718 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:24 smithi051 bash[18409]: cluster 2020-06-27T06:05:23.192822+0000 mgr.x (mgr.34109) 2586 : cluster [DBG] pgmap v2660: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:24.723 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:24 smithi031 bash[18426]: cluster 2020-06-27T06:05:23.192822+0000 mgr.x (mgr.34109) 2586 : cluster [DBG] pgmap v2660: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:24.723 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:24 smithi031 bash[22603]: cluster 2020-06-27T06:05:23.192822+0000 mgr.x (mgr.34109) 2586 : cluster [DBG] pgmap v2660: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:26.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:26 smithi051 bash[18409]: cluster 2020-06-27T06:05:25.194555+0000 mgr.x (mgr.34109) 2587 : cluster [DBG] pgmap v2661: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:26.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:26 smithi031 bash[18426]: cluster 2020-06-27T06:05:25.194555+0000 mgr.x (mgr.34109) 2587 : cluster [DBG] pgmap v2661: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:26.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:26 smithi031 bash[22603]: cluster 2020-06-27T06:05:25.194555+0000 mgr.x (mgr.34109) 2587 : cluster [DBG] pgmap v2661: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:28.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:28 smithi051 bash[18409]: cluster 2020-06-27T06:05:27.196266+0000 mgr.x (mgr.34109) 2588 : cluster [DBG] pgmap v2662: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:28.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:28 smithi031 bash[18426]: cluster 2020-06-27T06:05:27.196266+0000 mgr.x (mgr.34109) 2588 : cluster [DBG] pgmap v2662: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:28.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:28 smithi031 bash[22603]: cluster 2020-06-27T06:05:27.196266+0000 mgr.x (mgr.34109) 2588 : cluster [DBG] pgmap v2662: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:30.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:30 smithi051 bash[18409]: cluster 2020-06-27T06:05:29.197897+0000 mgr.x (mgr.34109) 2589 : cluster [DBG] pgmap v2663: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:30.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:30 smithi031 bash[18426]: cluster 2020-06-27T06:05:29.197897+0000 mgr.x (mgr.34109) 2589 : cluster [DBG] pgmap v2663: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:30.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:30 smithi031 bash[22603]: cluster 2020-06-27T06:05:29.197897+0000 mgr.x (mgr.34109) 2589 : cluster [DBG] pgmap v2663: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:32.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:32 smithi051 bash[18409]: cluster 2020-06-27T06:05:31.199601+0000 mgr.x (mgr.34109) 2590 : cluster [DBG] pgmap v2664: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:32.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:32 smithi031 bash[18426]: cluster 2020-06-27T06:05:31.199601+0000 mgr.x (mgr.34109) 2590 : cluster [DBG] pgmap v2664: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:32.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:32 smithi031 bash[22603]: cluster 2020-06-27T06:05:31.199601+0000 mgr.x (mgr.34109) 2590 : cluster [DBG] pgmap v2664: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:34.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:34 smithi051 bash[18409]: cluster 2020-06-27T06:05:33.201361+0000 mgr.x (mgr.34109) 2591 : cluster [DBG] pgmap v2665: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:34.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:34 smithi031 bash[18426]: cluster 2020-06-27T06:05:33.201361+0000 mgr.x (mgr.34109) 2591 : cluster [DBG] pgmap v2665: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:34.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:34 smithi031 bash[22603]: cluster 2020-06-27T06:05:33.201361+0000 mgr.x (mgr.34109) 2591 : cluster [DBG] pgmap v2665: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:36.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:36 smithi051 bash[18409]: cluster 2020-06-27T06:05:35.203022+0000 mgr.x (mgr.34109) 2592 : cluster [DBG] pgmap v2666: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:36.972 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:36 smithi031 bash[22603]: cluster 2020-06-27T06:05:35.203022+0000 mgr.x (mgr.34109) 2592 : cluster [DBG] pgmap v2666: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:36.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:36 smithi031 bash[18426]: cluster 2020-06-27T06:05:35.203022+0000 mgr.x (mgr.34109) 2592 : cluster [DBG] pgmap v2666: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:38.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:38 smithi051 bash[18409]: cluster 2020-06-27T06:05:37.204782+0000 mgr.x (mgr.34109) 2593 : cluster [DBG] pgmap v2667: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:38.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:38 smithi031 bash[22603]: cluster 2020-06-27T06:05:37.204782+0000 mgr.x (mgr.34109) 2593 : cluster [DBG] pgmap v2667: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:38.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:38 smithi031 bash[18426]: cluster 2020-06-27T06:05:37.204782+0000 mgr.x (mgr.34109) 2593 : cluster [DBG] pgmap v2667: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:40.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:40 smithi051 bash[18409]: cluster 2020-06-27T06:05:39.206473+0000 mgr.x (mgr.34109) 2594 : cluster [DBG] pgmap v2668: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:40.975 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:40 smithi031 bash[18426]: cluster 2020-06-27T06:05:39.206473+0000 mgr.x (mgr.34109) 2594 : cluster [DBG] pgmap v2668: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:40.975 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:40 smithi031 bash[22603]: cluster 2020-06-27T06:05:39.206473+0000 mgr.x (mgr.34109) 2594 : cluster [DBG] pgmap v2668: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:42.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:42 smithi051 bash[18409]: cluster 2020-06-27T06:05:41.208077+0000 mgr.x (mgr.34109) 2595 : cluster [DBG] pgmap v2669: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:42.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:42 smithi031 bash[18426]: cluster 2020-06-27T06:05:41.208077+0000 mgr.x (mgr.34109) 2595 : cluster [DBG] pgmap v2669: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:42.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:42 smithi031 bash[22603]: cluster 2020-06-27T06:05:41.208077+0000 mgr.x (mgr.34109) 2595 : cluster [DBG] pgmap v2669: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:44.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:44 smithi051 bash[18409]: cluster 2020-06-27T06:05:43.209868+0000 mgr.x (mgr.34109) 2596 : cluster [DBG] pgmap v2670: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:44.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:44 smithi031 bash[18426]: cluster 2020-06-27T06:05:43.209868+0000 mgr.x (mgr.34109) 2596 : cluster [DBG] pgmap v2670: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:44.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:44 smithi031 bash[22603]: cluster 2020-06-27T06:05:43.209868+0000 mgr.x (mgr.34109) 2596 : cluster [DBG] pgmap v2670: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:46.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:46 smithi051 bash[18409]: cluster 2020-06-27T06:05:45.211488+0000 mgr.x (mgr.34109) 2597 : cluster [DBG] pgmap v2671: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:46.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:46 smithi031 bash[22603]: cluster 2020-06-27T06:05:45.211488+0000 mgr.x (mgr.34109) 2597 : cluster [DBG] pgmap v2671: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:46.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:46 smithi031 bash[18426]: cluster 2020-06-27T06:05:45.211488+0000 mgr.x (mgr.34109) 2597 : cluster [DBG] pgmap v2671: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:48.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:48 smithi051 bash[18409]: cluster 2020-06-27T06:05:47.213134+0000 mgr.x (mgr.34109) 2598 : cluster [DBG] pgmap v2672: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:48.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:48 smithi031 bash[18426]: cluster 2020-06-27T06:05:47.213134+0000 mgr.x (mgr.34109) 2598 : cluster [DBG] pgmap v2672: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:48.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:48 smithi031 bash[22603]: cluster 2020-06-27T06:05:47.213134+0000 mgr.x (mgr.34109) 2598 : cluster [DBG] pgmap v2672: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:50.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:50 smithi051 bash[18409]: cluster 2020-06-27T06:05:49.214782+0000 mgr.x (mgr.34109) 2599 : cluster [DBG] pgmap v2673: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:50.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:50 smithi031 bash[18426]: cluster 2020-06-27T06:05:49.214782+0000 mgr.x (mgr.34109) 2599 : cluster [DBG] pgmap v2673: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:50.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:50 smithi031 bash[22603]: cluster 2020-06-27T06:05:49.214782+0000 mgr.x (mgr.34109) 2599 : cluster [DBG] pgmap v2673: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:52.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:52 smithi051 bash[18409]: cluster 2020-06-27T06:05:51.216524+0000 mgr.x (mgr.34109) 2600 : cluster [DBG] pgmap v2674: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:52.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:52 smithi031 bash[18426]: cluster 2020-06-27T06:05:51.216524+0000 mgr.x (mgr.34109) 2600 : cluster [DBG] pgmap v2674: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:52.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:52 smithi031 bash[22603]: cluster 2020-06-27T06:05:51.216524+0000 mgr.x (mgr.34109) 2600 : cluster [DBG] pgmap v2674: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:54.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:54 smithi051 bash[18409]: cluster 2020-06-27T06:05:53.218241+0000 mgr.x (mgr.34109) 2601 : cluster [DBG] pgmap v2675: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:54.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:54 smithi031 bash[18426]: cluster 2020-06-27T06:05:53.218241+0000 mgr.x (mgr.34109) 2601 : cluster [DBG] pgmap v2675: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:54.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:54 smithi031 bash[22603]: cluster 2020-06-27T06:05:53.218241+0000 mgr.x (mgr.34109) 2601 : cluster [DBG] pgmap v2675: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:56.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:56 smithi051 bash[18409]: cluster 2020-06-27T06:05:55.219991+0000 mgr.x (mgr.34109) 2602 : cluster [DBG] pgmap v2676: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:56.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:56 smithi031 bash[18426]: cluster 2020-06-27T06:05:55.219991+0000 mgr.x (mgr.34109) 2602 : cluster [DBG] pgmap v2676: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:56.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:56 smithi031 bash[22603]: cluster 2020-06-27T06:05:55.219991+0000 mgr.x (mgr.34109) 2602 : cluster [DBG] pgmap v2676: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:58.968 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:05:58 smithi051 bash[18409]: cluster 2020-06-27T06:05:57.221600+0000 mgr.x (mgr.34109) 2603 : cluster [DBG] pgmap v2677: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:58.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:05:58 smithi031 bash[18426]: cluster 2020-06-27T06:05:57.221600+0000 mgr.x (mgr.34109) 2603 : cluster [DBG] pgmap v2677: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:05:58.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:05:58 smithi031 bash[22603]: cluster 2020-06-27T06:05:57.221600+0000 mgr.x (mgr.34109) 2603 : cluster [DBG] pgmap v2677: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:06:00.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:06:00 smithi051 bash[18409]: cluster 2020-06-27T06:05:59.223301+0000 mgr.x (mgr.34109) 2604 : cluster [DBG] pgmap v2678: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:06:00.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:06:00 smithi031 bash[18426]: cluster 2020-06-27T06:05:59.223301+0000 mgr.x (mgr.34109) 2604 : cluster [DBG] pgmap v2678: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:06:00.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:06:00 smithi031 bash[22603]: cluster 2020-06-27T06:05:59.223301+0000 mgr.x (mgr.34109) 2604 : cluster [DBG] pgmap v2678: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:06:02.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:06:02 smithi051 bash[18409]: cluster 2020-06-27T06:06:01.224939+0000 mgr.x (mgr.34109) 2605 : cluster [DBG] pgmap v2679: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:06:02.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:06:02 smithi031 bash[18426]: cluster 2020-06-27T06:06:01.224939+0000 mgr.x (mgr.34109) 2605 : cluster [DBG] pgmap v2679: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:06:02.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:06:02 smithi031 bash[22603]: cluster 2020-06-27T06:06:01.224939+0000 mgr.x (mgr.34109) 2605 : cluster [DBG] pgmap v2679: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:06:04.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:06:04 smithi051 bash[18409]: cluster 2020-06-27T06:06:03.226675+0000 mgr.x (mgr.34109) 2606 : cluster [DBG] pgmap v2680: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:06:04.973 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:06:04 smithi031 bash[18426]: cluster 2020-06-27T06:06:03.226675+0000 mgr.x (mgr.34109) 2606 : cluster [DBG] pgmap v2680: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:06:04.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:06:04 smithi031 bash[22603]: cluster 2020-06-27T06:06:03.226675+0000 mgr.x (mgr.34109) 2606 : cluster [DBG] pgmap v2680: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:06:06.967 INFO:ceph.mon.b.smithi051.stdout:Jun 27 06:06:06 smithi051 bash[18409]: cluster 2020-06-27T06:06:05.228293+0000 mgr.x (mgr.34109) 2607 : cluster [DBG] pgmap v2681: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:06:06.972 INFO:ceph.mon.a.smithi031.stdout:Jun 27 06:06:06 smithi031 bash[18426]: cluster 2020-06-27T06:06:05.228293+0000 mgr.x (mgr.34109) 2607 : cluster [DBG] pgmap v2681: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:06:06.973 INFO:ceph.mon.c.smithi031.stdout:Jun 27 06:06:06 smithi031 bash[22603]: cluster 2020-06-27T06:06:05.228293+0000 mgr.x (mgr.34109) 2607 : cluster [DBG] pgmap v2681: 777 pgs: 25 stale+activating+undersized, 13 stale+active+clean, 33 stale+undersized+degraded+peered, 8 stale+creating+down, 3 stale+active+recovery_wait+undersized+degraded, 185 stale+down, 19 unknown, 164 stale+peering, 36 stale+active+undersized+degraded, 152 stale+undersized+peered, 139 stale+active+undersized; 27 KiB data, 18 MiB used, 442 GiB / 447 GiB avail; 273/1116 objects degraded (24.462%) 2020-06-27T06:06:07.206 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-06-27T06:06:07.207 DEBUG:teuthology.task.console_log:Killing console logger for smithi031 2020-06-27T06:06:07.208 DEBUG:teuthology.task.console_log:Killing console logger for smithi051 2020-06-27T06:06:07.209 DEBUG:teuthology.task.console_log:Killing console logger for smithi031 2020-06-27T06:06:07.209 DEBUG:teuthology.task.console_log:Killing console logger for smithi051 2020-06-27T06:06:07.211 DEBUG:teuthology.exit:Finished running handlers